2023-11-05T07:46:33.344 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2 2023-11-05T07:46:33.345 DEBUG:teuthology.run:Teuthology command: teuthology --name benhanokh-2023-10-31_16:46:33-rados-DBG_maintain_prefix_itr_2-distro-default-smithi --description rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/valgrind} --archive /home/teuthworker/archive/benhanokh-2023-10-31_16:46:33-rados-DBG_maintain_prefix_itr_2-distro-default-smithi/7442385 --verbose --owner scheduled_benhanokh@teuthology -- /home/teuthworker/archive/benhanokh-2023-10-31_16:46:33-rados-DBG_maintain_prefix_itr_2-distro-default-smithi/7442385/orig.config.yaml 2023-11-05T07:46:33.387 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T07:46:33.504 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/benhanokh-2023-10-31_16:46:33-rados-DBG_maintain_prefix_itr_2-distro-default-smithi/7442385 branch: DBG_maintain_prefix_itr_2 description: rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/valgrind} email: null first_in_suite: false job_id: '7442385' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: benhanokh-2023-10-31_16:46:33-rados-DBG_maintain_prefix_itr_2-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 10 - volumes: count: 4 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: DBG_maintain_prefix_itr_2 ceph: conf: client: debug monc: 20 debug ms: 1 debug objecter: 20 debug rados: 20 global: mon client directed command retry: 5 mon election default strategy: 1 ms inject socket failures: 5000 ms type: async osd heartbeat grace: 80 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon min osdmap epochs: 50 mon osd crush smoke test: false mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 mon scrub interval: 300 mon warn on pool no app: false paxos service trim min: 10 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true bluestore zero block detection: true debug bluefs: 1 debug bluestore: 1 debug monc: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd class default list: '*' osd class load list: '*' osd client watch timeout: 120 osd debug verify cached snaps: true osd debug verify missing on start: true osd failsafe full ratio: 0.95 osd fast shutdown: false osd mclock override recovery settings: true osd mclock profile: high_recovery_ops osd objectstore: bluestore osd op queue: debug_random osd op queue cut off: debug_random osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - reached quota - overall HEALTH_ - \(CACHE_POOL_NO_HIT_SET\) - \(POOL_FULL\) - \(SMALLER_PGP_NUM\) - \(SLOW_OPS\) - \(CACHE_POOL_NEAR_FULL\) - \(POOL_APP_NOT_ENABLED\) - \(PG_AVAILABILITY\) - \(OBJECT_MISPLACED\) - slow request - overall HEALTH_ - \(PG_ - \(MON_DOWN\) - \(SLOW_OPS\) - slow request sha1: 420cd129397301b1521ceb74e1bdbd9b855d2189 valgrind: mds: - --tool=memcheck mon: - --tool=memcheck - --leak-check=full - --show-reachable=yes osd: - --tool=memcheck ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: debuginfo: true flavor: default sha1: 420cd129397301b1521ceb74e1bdbd9b855d2189 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: DBG_maintain_prefix_itr_2 sha1: 420cd129397301b1521ceb74e1bdbd9b855d2189 owner: scheduled_benhanokh@teuthology priority: 100 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b seed: 9009 sha1: 420cd129397301b1521ceb74e1bdbd9b855d2189 sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: DBG_maintain_prefix_itr_2 suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_420cd129397301b1521ceb74e1bdbd9b855d2189/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 420cd129397301b1521ceb74e1bdbd9b855d2189 targets: smithi052.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEnDpDiifinTJpL2PjgfOfqPw0mIrozR3cpuVohSdrZusZbneajbBvaY0GmuKnMds6oReCVH86Po0gxqygx6Zs4= smithi156.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBjlaTh+P400Hnio2yqVR2ZsDZeYdz/ykjr62agH2TJg9XA0N+iYqmUCBbjM03GAMAR+MiFjR/S3l40LvJzmwTI= tasks: - install: null - ceph: null - workunit: clients: client.0: - rados/test.sh env: ALLOW_TIMEOUTS: '1' timeout: 6h teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 6899cd26fceddb2fec83dc1a1349394b28c8998e timestamp: 2023-10-31_16:46:33 tube: smithi user: benhanokh verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3084822 2023-11-05T07:46:33.504 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_420cd129397301b1521ceb74e1bdbd9b855d2189/qa; will attempt to use it 2023-11-05T07:46:33.505 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_420cd129397301b1521ceb74e1bdbd9b855d2189/qa/tasks 2023-11-05T07:46:33.505 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-11-05T07:46:33.507 INFO:teuthology.task.internal:Checking packages... 2023-11-05T07:46:33.531 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '420cd129397301b1521ceb74e1bdbd9b855d2189' 2023-11-05T07:46:33.531 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-11-05T07:46:33.532 INFO:teuthology.packaging:ref: None 2023-11-05T07:46:33.532 INFO:teuthology.packaging:tag: None 2023-11-05T07:46:33.532 INFO:teuthology.packaging:branch: DBG_maintain_prefix_itr_2 2023-11-05T07:46:33.533 INFO:teuthology.packaging:sha1: 420cd129397301b1521ceb74e1bdbd9b855d2189 2023-11-05T07:46:33.533 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=DBG_maintain_prefix_itr_2 2023-11-05T07:46:33.677 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-6776.g420cd129 2023-11-05T07:46:33.678 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-11-05T07:46:33.684 INFO:teuthology.task.internal:no buildpackages task found 2023-11-05T07:46:33.684 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-11-05T07:46:33.713 INFO:teuthology.task.internal:Saving configuration 2023-11-05T07:46:33.729 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-11-05T07:46:33.735 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-05T07:46:33.761 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi052.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/benhanokh-2023-10-31_16:46:33-rados-DBG_maintain_prefix_itr_2-distro-default-smithi/7442385', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-05 07:41:34.821814', 'locked_by': 'scheduled_benhanokh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEnDpDiifinTJpL2PjgfOfqPw0mIrozR3cpuVohSdrZusZbneajbBvaY0GmuKnMds6oReCVH86Po0gxqygx6Zs4='} 2023-11-05T07:46:33.784 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi156.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/benhanokh-2023-10-31_16:46:33-rados-DBG_maintain_prefix_itr_2-distro-default-smithi/7442385', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-05 07:41:34.820359', 'locked_by': 'scheduled_benhanokh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBjlaTh+P400Hnio2yqVR2ZsDZeYdz/ykjr62agH2TJg9XA0N+iYqmUCBbjM03GAMAR+MiFjR/S3l40LvJzmwTI='} 2023-11-05T07:46:33.785 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-11-05T07:46:33.798 INFO:teuthology.task.internal:roles: ubuntu@smithi052.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2023-11-05T07:46:33.798 INFO:teuthology.task.internal:roles: ubuntu@smithi156.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2023-11-05T07:46:33.798 INFO:teuthology.run_tasks:Running task console_log... 2023-11-05T07:46:33.908 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fca7b994af0>, signals=[15]) 2023-11-05T07:46:33.909 INFO:teuthology.run_tasks:Running task internal.connect... 2023-11-05T07:46:33.923 INFO:teuthology.task.internal:Opening connections... 2023-11-05T07:46:33.924 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi052.front.sepia.ceph.com 2023-11-05T07:46:33.925 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T07:46:34.023 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi156.front.sepia.ceph.com 2023-11-05T07:46:34.024 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T07:46:34.107 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-11-05T07:46:34.114 DEBUG:teuthology.orchestra.run.smithi052:> uname -m 2023-11-05T07:46:34.132 INFO:teuthology.orchestra.run.smithi052.stdout:x86_64 2023-11-05T07:46:34.133 DEBUG:teuthology.orchestra.run.smithi052:> cat /etc/os-release 2023-11-05T07:46:34.190 INFO:teuthology.orchestra.run.smithi052.stdout:NAME="CentOS Stream" 2023-11-05T07:46:34.191 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION="9" 2023-11-05T07:46:34.191 INFO:teuthology.orchestra.run.smithi052.stdout:ID="centos" 2023-11-05T07:46:34.191 INFO:teuthology.orchestra.run.smithi052.stdout:ID_LIKE="rhel fedora" 2023-11-05T07:46:34.191 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION_ID="9" 2023-11-05T07:46:34.192 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM_ID="platform:el9" 2023-11-05T07:46:34.192 INFO:teuthology.orchestra.run.smithi052.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-05T07:46:34.192 INFO:teuthology.orchestra.run.smithi052.stdout:ANSI_COLOR="0;31" 2023-11-05T07:46:34.192 INFO:teuthology.orchestra.run.smithi052.stdout:LOGO="fedora-logo-icon" 2023-11-05T07:46:34.193 INFO:teuthology.orchestra.run.smithi052.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-05T07:46:34.193 INFO:teuthology.orchestra.run.smithi052.stdout:HOME_URL="https://centos.org/" 2023-11-05T07:46:34.193 INFO:teuthology.orchestra.run.smithi052.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-05T07:46:34.193 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-05T07:46:34.193 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-05T07:46:34.194 INFO:teuthology.lock.ops:Updating smithi052.front.sepia.ceph.com on lock server 2023-11-05T07:46:34.219 DEBUG:teuthology.orchestra.run.smithi156:> uname -m 2023-11-05T07:46:34.236 INFO:teuthology.orchestra.run.smithi156.stdout:x86_64 2023-11-05T07:46:34.237 DEBUG:teuthology.orchestra.run.smithi156:> cat /etc/os-release 2023-11-05T07:46:34.292 INFO:teuthology.orchestra.run.smithi156.stdout:NAME="CentOS Stream" 2023-11-05T07:46:34.293 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION="9" 2023-11-05T07:46:34.293 INFO:teuthology.orchestra.run.smithi156.stdout:ID="centos" 2023-11-05T07:46:34.293 INFO:teuthology.orchestra.run.smithi156.stdout:ID_LIKE="rhel fedora" 2023-11-05T07:46:34.293 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION_ID="9" 2023-11-05T07:46:34.293 INFO:teuthology.orchestra.run.smithi156.stdout:PLATFORM_ID="platform:el9" 2023-11-05T07:46:34.294 INFO:teuthology.orchestra.run.smithi156.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-05T07:46:34.294 INFO:teuthology.orchestra.run.smithi156.stdout:ANSI_COLOR="0;31" 2023-11-05T07:46:34.294 INFO:teuthology.orchestra.run.smithi156.stdout:LOGO="fedora-logo-icon" 2023-11-05T07:46:34.294 INFO:teuthology.orchestra.run.smithi156.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-05T07:46:34.295 INFO:teuthology.orchestra.run.smithi156.stdout:HOME_URL="https://centos.org/" 2023-11-05T07:46:34.295 INFO:teuthology.orchestra.run.smithi156.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-05T07:46:34.295 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-05T07:46:34.295 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-05T07:46:34.295 INFO:teuthology.lock.ops:Updating smithi156.front.sepia.ceph.com on lock server 2023-11-05T07:46:34.319 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-11-05T07:46:34.328 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-11-05T07:46:34.377 INFO:teuthology.task.internal:Checking for old test directory... 2023-11-05T07:46:34.377 DEBUG:teuthology.orchestra.run.smithi052:> test '!' -e /home/ubuntu/cephtest 2023-11-05T07:46:34.380 DEBUG:teuthology.orchestra.run.smithi156:> test '!' -e /home/ubuntu/cephtest 2023-11-05T07:46:34.396 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-11-05T07:46:34.402 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-11-05T07:46:34.404 DEBUG:teuthology.orchestra.run.smithi052:> test -z $(ls -A /var/lib/ceph) 2023-11-05T07:46:34.438 DEBUG:teuthology.orchestra.run.smithi156:> test -z $(ls -A /var/lib/ceph) 2023-11-05T07:46:34.462 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-11-05T07:46:34.519 INFO:teuthology.run_tasks:Running task kernel... 2023-11-05T07:46:34.533 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-11-05T07:46:34.534 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-11-05T07:46:34.534 DEBUG:teuthology.orchestra.run.smithi052:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-05T07:46:34.535 DEBUG:teuthology.orchestra.run.smithi156:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-05T07:46:34.549 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-05T07:46:34.550 DEBUG:teuthology.orchestra.run.smithi156:> uname -r 2023-11-05T07:46:34.551 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-05T07:46:34.552 DEBUG:teuthology.orchestra.run.smithi052:> uname -r 2023-11-05T07:46:34.606 INFO:teuthology.orchestra.run.smithi156.stdout:5.14.0-361.el9.x86_64 2023-11-05T07:46:34.607 INFO:teuthology.task.kernel:Running kernel on smithi156: 5.14.0-361.el9.x86_64 2023-11-05T07:46:34.607 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum install -y kernel 2023-11-05T07:46:34.610 INFO:teuthology.orchestra.run.smithi052.stdout:5.14.0-361.el9.x86_64 2023-11-05T07:46:34.610 INFO:teuthology.task.kernel:Running kernel on smithi052: 5.14.0-361.el9.x86_64 2023-11-05T07:46:34.610 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum install -y kernel 2023-11-05T07:46:36.658 INFO:teuthology.orchestra.run.smithi156.stdout:CentOS-9 - AppStream 15 MB/s | 6.3 MB 00:00 2023-11-05T07:46:36.696 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS-9 - AppStream 16 MB/s | 6.3 MB 00:00 2023-11-05T07:46:38.071 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS-9 - BaseOS 6.9 MB/s | 2.0 MB 00:00 2023-11-05T07:46:38.267 INFO:teuthology.orchestra.run.smithi156.stdout:CentOS-9 - BaseOS 3.6 MB/s | 2.0 MB 00:00 2023-11-05T07:46:38.837 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 9 - BaseOS 19 MB/s | 7.9 MB 00:00 2023-11-05T07:46:40.590 INFO:teuthology.orchestra.run.smithi156.stdout:CentOS Stream 9 - BaseOS 4.3 MB/s | 7.9 MB 00:01 2023-11-05T07:46:43.487 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 9 - AppStream 5.0 MB/s | 18 MB 00:03 2023-11-05T07:46:43.550 INFO:teuthology.orchestra.run.smithi156.stdout:CentOS Stream 9 - AppStream 9.6 MB/s | 18 MB 00:01 2023-11-05T07:46:47.296 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 9 - CRB 14 MB/s | 5.8 MB 00:00 2023-11-05T07:46:47.309 INFO:teuthology.orchestra.run.smithi156.stdout:CentOS Stream 9 - CRB 14 MB/s | 5.8 MB 00:00 2023-11-05T07:46:48.626 INFO:teuthology.orchestra.run.smithi156.stdout:CentOS Stream 9 - Extras packages 91 kB/s | 15 kB 00:00 2023-11-05T07:46:49.572 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 9 - Extras packages 13 kB/s | 15 kB 00:01 2023-11-05T07:46:50.319 INFO:teuthology.orchestra.run.smithi156.stdout:Extra Packages for Enterprise Linux 12 MB/s | 19 MB 00:01 2023-11-05T07:46:50.865 INFO:teuthology.orchestra.run.smithi052.stdout:Extra Packages for Enterprise Linux 17 MB/s | 19 MB 00:01 2023-11-05T07:46:54.927 INFO:teuthology.orchestra.run.smithi156.stdout:lab-extras 12 kB/s | 1.7 kB 00:00 2023-11-05T07:46:55.565 INFO:teuthology.orchestra.run.smithi052.stdout:lab-extras 42 kB/s | 1.7 kB 00:00 2023-11-05T07:46:57.101 INFO:teuthology.orchestra.run.smithi156.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2023-11-05T07:46:57.101 INFO:teuthology.orchestra.run.smithi156.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2023-11-05T07:46:57.244 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2023-11-05T07:46:57.250 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-05T07:46:57.250 INFO:teuthology.orchestra.run.smithi156.stdout: Package Architecture Version Repository Size 2023-11-05T07:46:57.251 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-05T07:46:57.251 INFO:teuthology.orchestra.run.smithi156.stdout:Installing: 2023-11-05T07:46:57.251 INFO:teuthology.orchestra.run.smithi156.stdout: kernel x86_64 5.14.0-378.el9 baseos 5.3 M 2023-11-05T07:46:57.252 INFO:teuthology.orchestra.run.smithi156.stdout:Installing dependencies: 2023-11-05T07:46:57.252 INFO:teuthology.orchestra.run.smithi156.stdout: kernel-core x86_64 5.14.0-378.el9 baseos 20 M 2023-11-05T07:46:57.252 INFO:teuthology.orchestra.run.smithi156.stdout: kernel-modules x86_64 5.14.0-378.el9 baseos 38 M 2023-11-05T07:46:57.253 INFO:teuthology.orchestra.run.smithi156.stdout: kernel-modules-core x86_64 5.14.0-378.el9 baseos 32 M 2023-11-05T07:46:57.253 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T07:46:57.254 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2023-11-05T07:46:57.254 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-05T07:46:57.254 INFO:teuthology.orchestra.run.smithi156.stdout:Install 4 Packages 2023-11-05T07:46:57.255 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T07:46:57.256 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 95 M 2023-11-05T07:46:57.256 INFO:teuthology.orchestra.run.smithi156.stdout:Installed size: 120 M 2023-11-05T07:46:57.256 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading Packages: 2023-11-05T07:46:57.722 INFO:teuthology.orchestra.run.smithi052.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2023-11-05T07:46:57.723 INFO:teuthology.orchestra.run.smithi052.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2023-11-05T07:46:57.815 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2023-11-05T07:46:57.823 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-11-05T07:46:57.823 INFO:teuthology.orchestra.run.smithi052.stdout: Package Architecture Version Repository Size 2023-11-05T07:46:57.823 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-11-05T07:46:57.824 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2023-11-05T07:46:57.824 INFO:teuthology.orchestra.run.smithi052.stdout: kernel x86_64 5.14.0-378.el9 baseos 5.3 M 2023-11-05T07:46:57.824 INFO:teuthology.orchestra.run.smithi052.stdout:Installing dependencies: 2023-11-05T07:46:57.824 INFO:teuthology.orchestra.run.smithi052.stdout: kernel-core x86_64 5.14.0-378.el9 baseos 20 M 2023-11-05T07:46:57.824 INFO:teuthology.orchestra.run.smithi052.stdout: kernel-modules x86_64 5.14.0-378.el9 baseos 38 M 2023-11-05T07:46:57.825 INFO:teuthology.orchestra.run.smithi052.stdout: kernel-modules-core x86_64 5.14.0-378.el9 baseos 32 M 2023-11-05T07:46:57.825 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T07:46:57.825 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2023-11-05T07:46:57.826 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-11-05T07:46:57.826 INFO:teuthology.orchestra.run.smithi052.stdout:Install 4 Packages 2023-11-05T07:46:57.826 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T07:46:57.827 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 95 M 2023-11-05T07:46:57.827 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 120 M 2023-11-05T07:46:57.828 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2023-11-05T07:46:58.951 INFO:teuthology.orchestra.run.smithi156.stdout:(1/4): kernel-5.14.0-378.el9.x86_64.rpm 3.3 MB/s | 5.3 MB 00:01 2023-11-05T07:46:59.475 INFO:teuthology.orchestra.run.smithi052.stdout:(1/4): kernel-5.14.0-378.el9.x86_64.rpm 3.3 MB/s | 5.3 MB 00:01 2023-11-05T07:47:01.775 INFO:teuthology.orchestra.run.smithi052.stdout:(2/4): kernel-core-5.14.0-378.el9.x86_64.rpm 5.1 MB/s | 20 MB 00:03 2023-11-05T07:47:02.937 INFO:teuthology.orchestra.run.smithi156.stdout:(2/4): kernel-modules-core-5.14.0-378.el9.x86_6 8.0 MB/s | 32 MB 00:03 2023-11-05T07:47:03.387 INFO:teuthology.orchestra.run.smithi156.stdout:(3/4): kernel-core-5.14.0-378.el9.x86_64.rpm 3.3 MB/s | 20 MB 00:06 2023-11-05T07:47:04.354 INFO:teuthology.orchestra.run.smithi156.stdout:(4/4): kernel-modules-5.14.0-378.el9.x86_64.rpm 5.3 MB/s | 38 MB 00:07 2023-11-05T07:47:04.354 INFO:teuthology.orchestra.run.smithi156.stdout:-------------------------------------------------------------------------------- 2023-11-05T07:47:04.354 INFO:teuthology.orchestra.run.smithi156.stdout:Total 13 MB/s | 95 MB 00:07 2023-11-05T07:47:05.197 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2023-11-05T07:47:05.391 INFO:teuthology.orchestra.run.smithi052.stdout:(3/4): kernel-modules-core-5.14.0-378.el9.x86_6 5.4 MB/s | 32 MB 00:05 2023-11-05T07:47:05.614 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction check succeeded. 2023-11-05T07:47:05.614 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2023-11-05T07:47:06.906 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded. 2023-11-05T07:47:06.906 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2023-11-05T07:47:07.541 INFO:teuthology.orchestra.run.smithi052.stdout:(4/4): kernel-modules-5.14.0-378.el9.x86_64.rpm 3.9 MB/s | 38 MB 00:09 2023-11-05T07:47:07.542 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2023-11-05T07:47:07.542 INFO:teuthology.orchestra.run.smithi052.stdout:Total 9.8 MB/s | 95 MB 00:09 2023-11-05T07:47:08.425 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2023-11-05T07:47:08.850 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2023-11-05T07:47:08.850 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2023-11-05T07:47:09.813 INFO:teuthology.orchestra.run.smithi156.stdout: Preparing : 1/1 2023-11-05T07:47:10.162 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2023-11-05T07:47:10.163 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2023-11-05T07:47:10.460 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : kernel-modules-core-5.14.0-378.el9.x86_64 1/4 2023-11-05T07:47:10.596 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : kernel-core-5.14.0-378.el9.x86_64 2/4 2023-11-05T07:47:12.900 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2023-11-05T07:47:13.342 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: kernel-core-5.14.0-378.el9.x86_64 2/4 2023-11-05T07:47:13.525 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : kernel-modules-5.14.0-378.el9.x86_64 3/4 2023-11-05T07:47:13.541 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : kernel-modules-core-5.14.0-378.el9.x86_64 1/4 2023-11-05T07:47:13.677 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : kernel-core-5.14.0-378.el9.x86_64 2/4 2023-11-05T07:47:16.598 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: kernel-core-5.14.0-378.el9.x86_64 2/4 2023-11-05T07:47:16.779 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : kernel-modules-5.14.0-378.el9.x86_64 3/4 2023-11-05T07:47:18.112 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: kernel-modules-5.14.0-378.el9.x86_64 3/4 2023-11-05T07:47:18.224 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : kernel-5.14.0-378.el9.x86_64 4/4 2023-11-05T07:47:21.738 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: kernel-modules-5.14.0-378.el9.x86_64 3/4 2023-11-05T07:47:21.854 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : kernel-5.14.0-378.el9.x86_64 4/4 2023-11-05T07:47:22.808 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: kernel-modules-core-5.14.0-378.el9.x86_64 4/4 2023-11-05T07:47:26.830 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: kernel-modules-core-5.14.0-378.el9.x86_64 4/4 2023-11-05T07:47:51.456 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: kernel-core-5.14.0-378.el9.x86_64 4/4 2023-11-05T07:47:51.499 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: kernel-modules-5.14.0-378.el9.x86_64 4/4 2023-11-05T07:47:51.946 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: kernel-5.14.0-378.el9.x86_64 4/4 2023-11-05T07:47:51.947 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : kernel-5.14.0-378.el9.x86_64 1/4 2023-11-05T07:47:51.947 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : kernel-core-5.14.0-378.el9.x86_64 2/4 2023-11-05T07:47:51.947 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : kernel-modules-5.14.0-378.el9.x86_64 3/4 2023-11-05T07:47:52.361 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : kernel-modules-core-5.14.0-378.el9.x86_64 4/4 2023-11-05T07:47:52.361 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T07:47:52.361 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2023-11-05T07:47:52.361 INFO:teuthology.orchestra.run.smithi156.stdout: kernel-5.14.0-378.el9.x86_64 2023-11-05T07:47:52.362 INFO:teuthology.orchestra.run.smithi156.stdout: kernel-core-5.14.0-378.el9.x86_64 2023-11-05T07:47:52.362 INFO:teuthology.orchestra.run.smithi156.stdout: kernel-modules-5.14.0-378.el9.x86_64 2023-11-05T07:47:52.362 INFO:teuthology.orchestra.run.smithi156.stdout: kernel-modules-core-5.14.0-378.el9.x86_64 2023-11-05T07:47:52.362 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T07:47:52.363 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2023-11-05T07:47:52.871 DEBUG:teuthology.orchestra.run.smithi156:> rpm -q kernel | sort -rV | head -n 1 2023-11-05T07:47:53.022 INFO:teuthology.orchestra.run.smithi156.stdout:kernel-5.14.0-378.el9.x86_64 2023-11-05T07:47:53.023 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-378.el9.x86_64 2023-11-05T07:47:53.023 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-378.el9.x86_64 2023-11-05T07:47:53.024 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-11-05T07:47:53.024 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-11-05T07:47:53.024 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2023-11-05T07:47:53.024 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi156.front.sepia.ceph.com, path=None, version=distro) 2023-11-05T07:47:53.025 DEBUG:teuthology.orchestra.run.smithi156:> rpm -q kernel | sort -rV | head -n 1 2023-11-05T07:47:53.141 INFO:teuthology.orchestra.run.smithi156.stdout:kernel-5.14.0-378.el9.x86_64 2023-11-05T07:47:53.141 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-378.el9.x86_64 2023-11-05T07:47:53.141 DEBUG:teuthology.orchestra.run.smithi156:> sudo rpm -qi grub2-tools 2023-11-05T07:47:53.185 INFO:teuthology.orchestra.run.smithi156.stdout:Name : grub2-tools 2023-11-05T07:47:53.185 INFO:teuthology.orchestra.run.smithi156.stdout:Epoch : 1 2023-11-05T07:47:53.185 INFO:teuthology.orchestra.run.smithi156.stdout:Version : 2.06 2023-11-05T07:47:53.186 INFO:teuthology.orchestra.run.smithi156.stdout:Release : 68.el9 2023-11-05T07:47:53.186 INFO:teuthology.orchestra.run.smithi156.stdout:Architecture: x86_64 2023-11-05T07:47:53.186 INFO:teuthology.orchestra.run.smithi156.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-11-05T07:47:53.186 INFO:teuthology.orchestra.run.smithi156.stdout:Group : Unspecified 2023-11-05T07:47:53.187 INFO:teuthology.orchestra.run.smithi156.stdout:Size : 8264254 2023-11-05T07:47:53.187 INFO:teuthology.orchestra.run.smithi156.stdout:License : GPLv3+ 2023-11-05T07:47:53.187 INFO:teuthology.orchestra.run.smithi156.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-11-05T07:47:53.187 INFO:teuthology.orchestra.run.smithi156.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-11-05T07:47:53.187 INFO:teuthology.orchestra.run.smithi156.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-11-05T07:47:53.188 INFO:teuthology.orchestra.run.smithi156.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-11-05T07:47:53.188 INFO:teuthology.orchestra.run.smithi156.stdout:Packager : builder@centos.org 2023-11-05T07:47:53.188 INFO:teuthology.orchestra.run.smithi156.stdout:Vendor : CentOS 2023-11-05T07:47:53.188 INFO:teuthology.orchestra.run.smithi156.stdout:URL : http://www.gnu.org/software/grub/ 2023-11-05T07:47:53.189 INFO:teuthology.orchestra.run.smithi156.stdout:Summary : Support tools for GRUB. 2023-11-05T07:47:53.189 INFO:teuthology.orchestra.run.smithi156.stdout:Description : 2023-11-05T07:47:53.189 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T07:47:53.189 INFO:teuthology.orchestra.run.smithi156.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-11-05T07:47:53.189 INFO:teuthology.orchestra.run.smithi156.stdout:customizable bootloader with modular architecture. It supports a rich 2023-11-05T07:47:53.190 INFO:teuthology.orchestra.run.smithi156.stdout:variety of kernel formats, file systems, computer architectures and 2023-11-05T07:47:53.190 INFO:teuthology.orchestra.run.smithi156.stdout:hardware devices. 2023-11-05T07:47:53.190 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T07:47:53.190 INFO:teuthology.orchestra.run.smithi156.stdout:This subpackage provides tools for support of all platforms. 2023-11-05T07:47:53.191 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-11-05T07:47:53.192 INFO:teuthology.task.kernel:Updating grub on smithi156 to boot 5.14.0-378.el9.x86_64 2023-11-05T07:47:53.192 DEBUG:teuthology.orchestra.run.smithi156:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-11-05T07:47:53.891 INFO:teuthology.orchestra.run.smithi156.stderr:Generating grub configuration file ... 2023-11-05T07:47:55.249 INFO:teuthology.orchestra.run.smithi156.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-11-05T07:47:55.283 INFO:teuthology.orchestra.run.smithi156.stderr:done 2023-11-05T07:47:55.286 DEBUG:teuthology.orchestra.run.smithi156:> mktemp 2023-11-05T07:47:55.302 INFO:teuthology.orchestra.run.smithi156.stdout:/tmp/tmp.QJl6v3YFF4 2023-11-05T07:47:55.302 DEBUG:teuthology.orchestra.run.smithi156:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.QJl6v3YFF4 2023-11-05T07:47:55.370 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod 0666 /tmp/tmp.QJl6v3YFF4 2023-11-05T07:47:55.514 DEBUG:teuthology.orchestra.remote:smithi156:/tmp/tmp.QJl6v3YFF4 is 6KB 2023-11-05T07:47:55.563 DEBUG:teuthology.orchestra.run.smithi156:> rm -fr /tmp/tmp.QJl6v3YFF4 2023-11-05T07:47:55.578 DEBUG:teuthology.orchestra.run.smithi156:> sudo /bin/ls /boot/loader/entries || true 2023-11-05T07:47:55.646 INFO:teuthology.orchestra.run.smithi156.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-11-05T07:47:55.646 INFO:teuthology.orchestra.run.smithi156.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-11-05T07:47:55.646 INFO:teuthology.orchestra.run.smithi156.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-11-05T07:47:55.647 INFO:teuthology.orchestra.run.smithi156.stdout:15949e3c88704300882482eddfd7baae-5.14.0-378.el9.x86_64.conf 2023-11-05T07:47:55.648 DEBUG:teuthology.orchestra.run.smithi156:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-378.el9.x86_64 2023-11-05T07:47:55.799 DEBUG:teuthology.orchestra.run.smithi156:> sudo shutdown -r now 2023-11-05T07:47:57.215 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: kernel-core-5.14.0-378.el9.x86_64 4/4 2023-11-05T07:47:57.259 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: kernel-modules-5.14.0-378.el9.x86_64 4/4 2023-11-05T07:47:57.657 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: kernel-5.14.0-378.el9.x86_64 4/4 2023-11-05T07:47:57.657 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : kernel-5.14.0-378.el9.x86_64 1/4 2023-11-05T07:47:57.657 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : kernel-core-5.14.0-378.el9.x86_64 2/4 2023-11-05T07:47:57.657 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : kernel-modules-5.14.0-378.el9.x86_64 3/4 2023-11-05T07:47:58.105 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : kernel-modules-core-5.14.0-378.el9.x86_64 4/4 2023-11-05T07:47:58.105 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T07:47:58.105 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2023-11-05T07:47:58.106 INFO:teuthology.orchestra.run.smithi052.stdout: kernel-5.14.0-378.el9.x86_64 2023-11-05T07:47:58.106 INFO:teuthology.orchestra.run.smithi052.stdout: kernel-core-5.14.0-378.el9.x86_64 2023-11-05T07:47:58.106 INFO:teuthology.orchestra.run.smithi052.stdout: kernel-modules-5.14.0-378.el9.x86_64 2023-11-05T07:47:58.106 INFO:teuthology.orchestra.run.smithi052.stdout: kernel-modules-core-5.14.0-378.el9.x86_64 2023-11-05T07:47:58.106 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T07:47:58.107 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2023-11-05T07:47:58.625 DEBUG:teuthology.orchestra.run.smithi052:> rpm -q kernel | sort -rV | head -n 1 2023-11-05T07:47:58.780 INFO:teuthology.orchestra.run.smithi052.stdout:kernel-5.14.0-378.el9.x86_64 2023-11-05T07:47:58.781 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-378.el9.x86_64 2023-11-05T07:47:58.781 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-378.el9.x86_64 2023-11-05T07:47:58.782 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-11-05T07:47:58.782 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-11-05T07:47:58.782 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-11-05T07:47:58.782 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi052.front.sepia.ceph.com, path=None, version=distro) 2023-11-05T07:47:58.783 DEBUG:teuthology.orchestra.run.smithi052:> rpm -q kernel | sort -rV | head -n 1 2023-11-05T07:47:58.904 INFO:teuthology.orchestra.run.smithi052.stdout:kernel-5.14.0-378.el9.x86_64 2023-11-05T07:47:58.904 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-378.el9.x86_64 2023-11-05T07:47:58.905 DEBUG:teuthology.orchestra.run.smithi052:> sudo rpm -qi grub2-tools 2023-11-05T07:47:58.942 INFO:teuthology.orchestra.run.smithi052.stdout:Name : grub2-tools 2023-11-05T07:47:58.942 INFO:teuthology.orchestra.run.smithi052.stdout:Epoch : 1 2023-11-05T07:47:58.942 INFO:teuthology.orchestra.run.smithi052.stdout:Version : 2.06 2023-11-05T07:47:58.942 INFO:teuthology.orchestra.run.smithi052.stdout:Release : 68.el9 2023-11-05T07:47:58.943 INFO:teuthology.orchestra.run.smithi052.stdout:Architecture: x86_64 2023-11-05T07:47:58.943 INFO:teuthology.orchestra.run.smithi052.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-11-05T07:47:58.943 INFO:teuthology.orchestra.run.smithi052.stdout:Group : Unspecified 2023-11-05T07:47:58.943 INFO:teuthology.orchestra.run.smithi052.stdout:Size : 8264254 2023-11-05T07:47:58.943 INFO:teuthology.orchestra.run.smithi052.stdout:License : GPLv3+ 2023-11-05T07:47:58.944 INFO:teuthology.orchestra.run.smithi052.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-11-05T07:47:58.944 INFO:teuthology.orchestra.run.smithi052.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-11-05T07:47:58.944 INFO:teuthology.orchestra.run.smithi052.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-11-05T07:47:58.944 INFO:teuthology.orchestra.run.smithi052.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-11-05T07:47:58.944 INFO:teuthology.orchestra.run.smithi052.stdout:Packager : builder@centos.org 2023-11-05T07:47:58.945 INFO:teuthology.orchestra.run.smithi052.stdout:Vendor : CentOS 2023-11-05T07:47:58.945 INFO:teuthology.orchestra.run.smithi052.stdout:URL : http://www.gnu.org/software/grub/ 2023-11-05T07:47:58.945 INFO:teuthology.orchestra.run.smithi052.stdout:Summary : Support tools for GRUB. 2023-11-05T07:47:58.945 INFO:teuthology.orchestra.run.smithi052.stdout:Description : 2023-11-05T07:47:58.945 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T07:47:58.946 INFO:teuthology.orchestra.run.smithi052.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-11-05T07:47:58.946 INFO:teuthology.orchestra.run.smithi052.stdout:customizable bootloader with modular architecture. It supports a rich 2023-11-05T07:47:58.946 INFO:teuthology.orchestra.run.smithi052.stdout:variety of kernel formats, file systems, computer architectures and 2023-11-05T07:47:58.946 INFO:teuthology.orchestra.run.smithi052.stdout:hardware devices. 2023-11-05T07:47:58.946 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T07:47:58.947 INFO:teuthology.orchestra.run.smithi052.stdout:This subpackage provides tools for support of all platforms. 2023-11-05T07:47:58.948 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-11-05T07:47:58.948 INFO:teuthology.task.kernel:Updating grub on smithi052 to boot 5.14.0-378.el9.x86_64 2023-11-05T07:47:58.948 DEBUG:teuthology.orchestra.run.smithi052:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-11-05T07:47:59.572 INFO:teuthology.orchestra.run.smithi052.stderr:Generating grub configuration file ... 2023-11-05T07:48:01.103 INFO:teuthology.orchestra.run.smithi052.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-11-05T07:48:01.127 INFO:teuthology.orchestra.run.smithi052.stderr:done 2023-11-05T07:48:01.129 DEBUG:teuthology.orchestra.run.smithi052:> mktemp 2023-11-05T07:48:01.185 INFO:teuthology.orchestra.run.smithi052.stdout:/tmp/tmp.aMPchfRZQ7 2023-11-05T07:48:01.185 DEBUG:teuthology.orchestra.run.smithi052:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.aMPchfRZQ7 2023-11-05T07:48:01.258 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 0666 /tmp/tmp.aMPchfRZQ7 2023-11-05T07:48:01.502 DEBUG:teuthology.orchestra.remote:smithi052:/tmp/tmp.aMPchfRZQ7 is 6KB 2023-11-05T07:48:01.551 DEBUG:teuthology.orchestra.run.smithi052:> rm -fr /tmp/tmp.aMPchfRZQ7 2023-11-05T07:48:01.566 DEBUG:teuthology.orchestra.run.smithi052:> sudo /bin/ls /boot/loader/entries || true 2023-11-05T07:48:01.642 INFO:teuthology.orchestra.run.smithi052.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-11-05T07:48:01.643 INFO:teuthology.orchestra.run.smithi052.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-11-05T07:48:01.643 INFO:teuthology.orchestra.run.smithi052.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-11-05T07:48:01.643 INFO:teuthology.orchestra.run.smithi052.stdout:15949e3c88704300882482eddfd7baae-5.14.0-378.el9.x86_64.conf 2023-11-05T07:48:01.644 DEBUG:teuthology.orchestra.run.smithi052:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-378.el9.x86_64 2023-11-05T07:48:01.802 DEBUG:teuthology.orchestra.run.smithi052:> sudo shutdown -r now 2023-11-05T07:48:25.827 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-11-05T07:48:25.827 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi156.front.sepia.ceph.com' 2023-11-05T07:48:25.828 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T07:48:31.810 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-11-05T07:48:31.811 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com' 2023-11-05T07:48:31.811 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T07:49:25.880 DEBUG:teuthology.orchestra.remote:timed out 2023-11-05T07:49:31.818 DEBUG:teuthology.orchestra.remote:timed out 2023-11-05T07:49:34.885 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi156.front.sepia.ceph.com' 2023-11-05T07:49:34.886 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T07:49:38.284 DEBUG:teuthology.orchestra.run.smithi156:> true 2023-11-05T07:49:38.814 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi156.front.sepia.ceph.com' 2023-11-05T07:49:38.815 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-378.el9.x86_64"... 2023-11-05T07:49:38.815 DEBUG:teuthology.orchestra.run.smithi156:> uname -r 2023-11-05T07:49:38.830 INFO:teuthology.orchestra.run.smithi156.stdout:5.14.0-378.el9.x86_64 2023-11-05T07:49:38.831 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-378.el9.x86_64 vs 5.14.0-378.el9.x86_64 2023-11-05T07:49:38.831 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-05T07:49:38.832 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-11-05T07:49:39.832 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-11-05T07:49:39.833 DEBUG:teuthology.orchestra.run.smithi156:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-11-05T07:49:39.959 INFO:teuthology.orchestra.run.smithi156.stdout:ttyS1 2023-11-05T07:49:40.010 DEBUG:teuthology.parallel:result is None 2023-11-05T07:49:40.819 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com' 2023-11-05T07:49:40.820 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T07:49:41.193 DEBUG:teuthology.orchestra.run.smithi052:> true 2023-11-05T07:49:41.690 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi052.front.sepia.ceph.com' 2023-11-05T07:49:41.691 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-378.el9.x86_64"... 2023-11-05T07:49:41.691 DEBUG:teuthology.orchestra.run.smithi052:> uname -r 2023-11-05T07:49:41.733 INFO:teuthology.orchestra.run.smithi052.stdout:5.14.0-378.el9.x86_64 2023-11-05T07:49:41.733 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-378.el9.x86_64 vs 5.14.0-378.el9.x86_64 2023-11-05T07:49:41.733 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-05T07:49:41.733 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-11-05T07:49:42.734 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-11-05T07:49:42.735 DEBUG:teuthology.orchestra.run.smithi052:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-11-05T07:49:42.794 INFO:teuthology.orchestra.run.smithi052.stdout:ttyS1 2023-11-05T07:49:42.948 DEBUG:teuthology.parallel:result is None 2023-11-05T07:49:42.948 INFO:teuthology.run_tasks:Running task internal.base... 2023-11-05T07:49:42.956 INFO:teuthology.task.internal:Creating test directory... 2023-11-05T07:49:42.957 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-05T07:49:42.959 DEBUG:teuthology.orchestra.run.smithi156:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-05T07:49:42.975 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-11-05T07:49:43.024 INFO:teuthology.run_tasks:Running task internal.archive... 2023-11-05T07:49:43.047 INFO:teuthology.task.internal:Creating archive directory... 2023-11-05T07:49:43.048 DEBUG:teuthology.orchestra.run.smithi052:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-05T07:49:43.050 DEBUG:teuthology.orchestra.run.smithi156:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-05T07:49:43.084 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-11-05T07:49:43.092 INFO:teuthology.task.internal:Enabling coredump saving... 2023-11-05T07:49:43.093 DEBUG:teuthology.orchestra.run.smithi052:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-05T07:49:43.122 DEBUG:teuthology.orchestra.run.smithi156:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-05T07:49:43.153 INFO:teuthology.orchestra.run.smithi052.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-05T07:49:43.153 INFO:teuthology.orchestra.run.smithi156.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-05T07:49:43.166 INFO:teuthology.orchestra.run.smithi156.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-05T07:49:43.169 INFO:teuthology.orchestra.run.smithi052.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-05T07:49:43.170 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-11-05T07:49:43.178 INFO:teuthology.task.internal:Configuring sudo... 2023-11-05T07:49:43.179 DEBUG:teuthology.orchestra.run.smithi052:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-05T07:49:43.213 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-05T07:49:43.243 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-11-05T07:49:43.254 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-11-05T07:49:43.255 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-05T07:49:43.286 DEBUG:teuthology.orchestra.run.smithi156:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-05T07:49:43.301 DEBUG:teuthology.orchestra.run.smithi052:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-05T07:49:43.381 DEBUG:teuthology.orchestra.run.smithi052:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-05T07:49:43.437 DEBUG:teuthology.orchestra.run.smithi052:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-05T07:49:43.519 DEBUG:teuthology.orchestra.run.smithi052:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-05T07:49:43.566 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-11-05T07:49:43.566 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-05T07:49:43.636 DEBUG:teuthology.orchestra.run.smithi156:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-05T07:49:43.677 DEBUG:teuthology.orchestra.run.smithi156:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-05T07:49:43.729 DEBUG:teuthology.orchestra.run.smithi156:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-05T07:49:43.815 DEBUG:teuthology.orchestra.run.smithi156:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-05T07:49:43.860 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-11-05T07:49:43.860 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-05T07:49:43.931 DEBUG:teuthology.orchestra.run.smithi052:> sudo service rsyslog restart 2023-11-05T07:49:43.933 DEBUG:teuthology.orchestra.run.smithi156:> sudo service rsyslog restart 2023-11-05T07:49:43.986 INFO:teuthology.orchestra.run.smithi052.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-05T07:49:44.024 INFO:teuthology.orchestra.run.smithi156.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-05T07:49:44.487 INFO:teuthology.run_tasks:Running task internal.timer... 2023-11-05T07:49:44.497 INFO:teuthology.task.internal:Starting timer... 2023-11-05T07:49:44.498 INFO:teuthology.run_tasks:Running task pcp... 2023-11-05T07:49:44.603 INFO:teuthology.run_tasks:Running task selinux... 2023-11-05T07:49:44.644 DEBUG:teuthology.orchestra.run.smithi052:> sudo service auditd rotate 2023-11-05T07:49:44.696 INFO:teuthology.orchestra.run.smithi052.stdout:Rotating logs: 2023-11-05T07:49:44.698 DEBUG:teuthology.orchestra.run.smithi156:> sudo service auditd rotate 2023-11-05T07:49:44.777 INFO:teuthology.orchestra.run.smithi156.stdout:Rotating logs: 2023-11-05T07:49:44.779 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-11-05T07:49:44.780 DEBUG:teuthology.orchestra.run.smithi052:> /usr/sbin/getenforce 2023-11-05T07:49:44.804 INFO:teuthology.orchestra.run.smithi052.stdout:Permissive 2023-11-05T07:49:44.804 DEBUG:teuthology.orchestra.run.smithi156:> /usr/sbin/getenforce 2023-11-05T07:49:44.854 INFO:teuthology.orchestra.run.smithi156.stdout:Permissive 2023-11-05T07:49:44.854 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi052.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi156.front.sepia.ceph.com': 'permissive'} 2023-11-05T07:49:44.855 DEBUG:teuthology.orchestra.run.smithi052:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-05T07:49:44.886 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-05T07:49:44.887 DEBUG:teuthology.orchestra.run.smithi156:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-05T07:49:44.939 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-05T07:49:44.939 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-11-05T07:49:44.940 DEBUG:teuthology.orchestra.run.smithi052:> sudo /usr/sbin/setenforce permissive 2023-11-05T07:49:44.981 DEBUG:teuthology.orchestra.run.smithi156:> sudo /usr/sbin/setenforce permissive 2023-11-05T07:49:45.214 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-11-05T07:49:45.224 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-11-05T07:49:45.230 INFO:teuthology.repo_utils:Fetching main from origin 2023-11-05T07:49:45.354 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-11-05T07:49:45.369 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-11-05T07:49:45.371 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi052.front.sepia.ceph.com,smithi156.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-11-05T07:55:16.122 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi052.front.sepia.ceph.com'), Remote(name='ubuntu@smithi156.front.sepia.ceph.com')] 2023-11-05T07:55:16.123 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com' 2023-11-05T07:55:16.124 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T07:55:16.220 DEBUG:teuthology.orchestra.run.smithi052:> true 2023-11-05T07:55:16.289 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi052.front.sepia.ceph.com' 2023-11-05T07:55:16.289 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi156.front.sepia.ceph.com' 2023-11-05T07:55:16.290 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T07:55:16.373 DEBUG:teuthology.orchestra.run.smithi156:> true 2023-11-05T07:55:16.440 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi156.front.sepia.ceph.com' 2023-11-05T07:55:16.441 INFO:teuthology.run_tasks:Running task clock... 2023-11-05T07:55:16.453 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-11-05T07:55:16.453 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-05T07:55:16.454 DEBUG:teuthology.orchestra.run.smithi052:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-05T07:55:16.456 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-05T07:55:16.456 DEBUG:teuthology.orchestra.run.smithi156:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-05T07:55:16.489 INFO:teuthology.orchestra.run.smithi052.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-11-05T07:55:16.509 INFO:teuthology.orchestra.run.smithi052.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-11-05T07:55:16.511 INFO:teuthology.orchestra.run.smithi156.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-11-05T07:55:16.527 INFO:teuthology.orchestra.run.smithi156.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-11-05T07:55:16.545 INFO:teuthology.orchestra.run.smithi052.stderr:sudo: ntpd: command not found 2023-11-05T07:55:16.556 INFO:teuthology.orchestra.run.smithi156.stderr:sudo: ntpd: command not found 2023-11-05T07:55:16.562 INFO:teuthology.orchestra.run.smithi052.stdout:506 Cannot talk to daemon 2023-11-05T07:55:16.570 INFO:teuthology.orchestra.run.smithi156.stdout:506 Cannot talk to daemon 2023-11-05T07:55:16.582 INFO:teuthology.orchestra.run.smithi052.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-11-05T07:55:16.586 INFO:teuthology.orchestra.run.smithi156.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-11-05T07:55:16.601 INFO:teuthology.orchestra.run.smithi052.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-11-05T07:55:16.602 INFO:teuthology.orchestra.run.smithi156.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-11-05T07:55:16.645 INFO:teuthology.orchestra.run.smithi156.stderr:bash: line 1: ntpq: command not found 2023-11-05T07:55:16.648 INFO:teuthology.orchestra.run.smithi156.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-05T07:55:16.648 INFO:teuthology.orchestra.run.smithi156.stdout:=============================================================================== 2023-11-05T07:55:16.648 INFO:teuthology.orchestra.run.smithi156.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-05T07:55:16.649 INFO:teuthology.orchestra.run.smithi156.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-05T07:55:16.649 INFO:teuthology.orchestra.run.smithi156.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-05T07:55:16.649 INFO:teuthology.orchestra.run.smithi156.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-05T07:55:16.650 INFO:teuthology.orchestra.run.smithi052.stderr:bash: line 1: ntpq: command not found 2023-11-05T07:55:16.651 INFO:teuthology.orchestra.run.smithi052.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-05T07:55:16.651 INFO:teuthology.orchestra.run.smithi052.stdout:=============================================================================== 2023-11-05T07:55:16.652 INFO:teuthology.orchestra.run.smithi052.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-05T07:55:16.652 INFO:teuthology.orchestra.run.smithi052.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-05T07:55:16.652 INFO:teuthology.orchestra.run.smithi052.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-05T07:55:16.652 INFO:teuthology.orchestra.run.smithi052.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-05T07:55:16.653 INFO:teuthology.run_tasks:Running task install... 2023-11-05T07:55:16.661 DEBUG:teuthology.task.install:project ceph 2023-11-05T07:55:16.662 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': '420cd129397301b1521ceb74e1bdbd9b855d2189'}} 2023-11-05T07:55:16.662 DEBUG:teuthology.task.install:config {'debuginfo': True, 'flavor': 'default', 'sha1': '420cd129397301b1521ceb74e1bdbd9b855d2189'} 2023-11-05T07:55:16.662 INFO:teuthology.task.install:Using flavor: default 2023-11-05T07:55:16.668 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse', 'ceph-common-dbg', 'ceph-fuse-dbg', 'ceph-mds-dbg', 'ceph-mgr-dbg', 'ceph-mon-dbg', 'ceph-osd-dbg', 'ceph-test-dbg', 'libcephfs2-dbg', 'librados2-dbg', 'libradosstriper1-dbg', 'librbd1-dbg', 'librgw2-dbg', 'radosgw-dbg', 'rbd-fuse-dbg', 'rbd-mirror-dbg', 'rbd-nbd-dbg'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd', 'ceph-base-debuginfo', 'ceph-common-debuginfo', 'ceph-immutable-object-cache-debuginfo', 'ceph-radosgw-debuginfo', 'ceph-test-debuginfo', 'ceph-base-debuginfo', 'ceph-mgr-debuginfo', 'ceph-mds-debuginfo', 'ceph-mon-debuginfo', 'ceph-osd-debuginfo', 'ceph-fuse-debuginfo', 'librados-devel-debuginfo', 'libcephfs2-debuginfo', 'librados2-debuginfo', 'librbd1-debuginfo', 'python3-cephfs-debuginfo', 'python3-rados-debuginfo', 'python3-rbd-debuginfo', 'python3-rgw-debuginfo', 'rbd-fuse-debuginfo', 'rbd-mirror-debuginfo', 'rbd-nbd-debuginfo']} 2023-11-05T07:55:16.669 INFO:teuthology.task.install:extra packages: [] 2023-11-05T07:55:16.669 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': True, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '420cd129397301b1521ceb74e1bdbd9b855d2189', 'tag': None, 'wait_for_package': False} 2023-11-05T07:55:16.670 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=420cd129397301b1521ceb74e1bdbd9b855d2189 2023-11-05T07:55:16.672 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': True, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '420cd129397301b1521ceb74e1bdbd9b855d2189', 'tag': None, 'wait_for_package': False} 2023-11-05T07:55:16.672 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=420cd129397301b1521ceb74e1bdbd9b855d2189 2023-11-05T07:55:16.817 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/DBG_maintain_prefix_itr_2/420cd129397301b1521ceb74e1bdbd9b855d2189/centos/9/flavors/default/ 2023-11-05T07:55:16.817 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6776.g420cd129 2023-11-05T07:55:16.882 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/DBG_maintain_prefix_itr_2/420cd129397301b1521ceb74e1bdbd9b855d2189/centos/9/flavors/default/ 2023-11-05T07:55:16.883 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6776.g420cd129 2023-11-05T07:55:16.921 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/DBG_maintain_prefix_itr_2/420cd129397301b1521ceb74e1bdbd9b855d2189/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/DBG_maintain_prefix_itr_2/420cd129397301b1521ceb74e1bdbd9b855d2189/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/DBG_maintain_prefix_itr_2/420cd129397301b1521ceb74e1bdbd9b855d2189/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-11-05T07:55:16.921 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-11-05T07:55:16.921 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-11-05T07:55:16.954 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-base-debuginfo, ceph-common-debuginfo, ceph-immutable-object-cache-debuginfo, ceph-radosgw-debuginfo, ceph-test-debuginfo, ceph-base-debuginfo, ceph-mgr-debuginfo, ceph-mds-debuginfo, ceph-mon-debuginfo, ceph-osd-debuginfo, ceph-fuse-debuginfo, librados-devel-debuginfo, libcephfs2-debuginfo, librados2-debuginfo, librbd1-debuginfo, python3-cephfs-debuginfo, python3-rados-debuginfo, python3-rbd-debuginfo, python3-rgw-debuginfo, rbd-fuse-debuginfo, rbd-mirror-debuginfo, rbd-nbd-debuginfo on remote rpm x86_64 2023-11-05T07:55:16.954 DEBUG:teuthology.orchestra.run.smithi052:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/420cd129397301b1521ceb74e1bdbd9b855d2189/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-11-05T07:55:16.985 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/DBG_maintain_prefix_itr_2/420cd129397301b1521ceb74e1bdbd9b855d2189/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/DBG_maintain_prefix_itr_2/420cd129397301b1521ceb74e1bdbd9b855d2189/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/DBG_maintain_prefix_itr_2/420cd129397301b1521ceb74e1bdbd9b855d2189/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-11-05T07:55:16.985 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-11-05T07:55:16.985 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-11-05T07:55:17.013 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-base-debuginfo, ceph-common-debuginfo, ceph-immutable-object-cache-debuginfo, ceph-radosgw-debuginfo, ceph-test-debuginfo, ceph-base-debuginfo, ceph-mgr-debuginfo, ceph-mds-debuginfo, ceph-mon-debuginfo, ceph-osd-debuginfo, ceph-fuse-debuginfo, librados-devel-debuginfo, libcephfs2-debuginfo, librados2-debuginfo, librbd1-debuginfo, python3-cephfs-debuginfo, python3-rados-debuginfo, python3-rbd-debuginfo, python3-rgw-debuginfo, rbd-fuse-debuginfo, rbd-mirror-debuginfo, rbd-nbd-debuginfo on remote rpm x86_64 2023-11-05T07:55:17.014 DEBUG:teuthology.orchestra.run.smithi156:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/420cd129397301b1521ceb74e1bdbd9b855d2189/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-11-05T07:55:17.026 DEBUG:teuthology.orchestra.run.smithi052:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-11-05T07:55:17.081 DEBUG:teuthology.orchestra.run.smithi156:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-11-05T07:55:17.112 DEBUG:teuthology.orchestra.run.smithi052:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-11-05T07:55:17.142 INFO:teuthology.orchestra.run.smithi052.stdout:check_obsoletes = 1 2023-11-05T07:55:17.144 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum clean all 2023-11-05T07:55:17.161 DEBUG:teuthology.orchestra.run.smithi156:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-11-05T07:55:17.226 INFO:teuthology.orchestra.run.smithi156.stdout:check_obsoletes = 1 2023-11-05T07:55:17.228 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum clean all 2023-11-05T07:55:17.393 INFO:teuthology.orchestra.run.smithi052.stdout:72 files removed 2023-11-05T07:55:17.419 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install ceph-radosgw 2023-11-05T07:55:17.464 INFO:teuthology.orchestra.run.smithi156.stdout:72 files removed 2023-11-05T07:55:17.491 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum -y install ceph-radosgw 2023-11-05T07:55:18.319 INFO:teuthology.orchestra.run.smithi052.stdout:ceph packages for x86_64 138 kB/s | 78 kB 00:00 2023-11-05T07:55:18.468 INFO:teuthology.orchestra.run.smithi156.stdout:ceph packages for x86_64 118 kB/s | 78 kB 00:00 2023-11-05T07:55:18.803 INFO:teuthology.orchestra.run.smithi052.stdout:ceph noarch packages 22 kB/s | 9.4 kB 00:00 2023-11-05T07:55:18.986 INFO:teuthology.orchestra.run.smithi156.stdout:ceph noarch packages 20 kB/s | 9.4 kB 00:00 2023-11-05T07:55:19.237 INFO:teuthology.orchestra.run.smithi052.stdout:ceph source packages 4.8 kB/s | 1.9 kB 00:00 2023-11-05T07:55:19.369 INFO:teuthology.orchestra.run.smithi156.stdout:ceph source packages 5.4 kB/s | 1.9 kB 00:00 2023-11-05T07:55:19.623 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS-9 - AppStream 18 MB/s | 6.3 MB 00:00 2023-11-05T07:55:19.747 INFO:teuthology.orchestra.run.smithi156.stdout:CentOS-9 - AppStream 18 MB/s | 6.3 MB 00:00 2023-11-05T07:55:21.056 INFO:teuthology.orchestra.run.smithi156.stdout:CentOS-9 - BaseOS 7.5 MB/s | 2.0 MB 00:00 2023-11-05T07:55:21.073 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS-9 - BaseOS 5.8 MB/s | 2.0 MB 00:00 2023-11-05T07:55:22.171 INFO:teuthology.orchestra.run.smithi156.stdout:CentOS Stream 9 - BaseOS 9.9 MB/s | 7.9 MB 00:00 2023-11-05T07:55:22.464 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 9 - BaseOS 7.5 MB/s | 7.9 MB 00:01 2023-11-05T07:55:24.714 INFO:teuthology.orchestra.run.smithi156.stdout:CentOS Stream 9 - AppStream 12 MB/s | 18 MB 00:01 2023-11-05T07:55:28.131 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 9 - AppStream 3.9 MB/s | 18 MB 00:04 2023-11-05T07:55:28.965 INFO:teuthology.orchestra.run.smithi156.stdout:CentOS Stream 9 - CRB 6.3 MB/s | 5.8 MB 00:00 2023-11-05T07:55:30.516 INFO:teuthology.orchestra.run.smithi156.stdout:CentOS Stream 9 - Extras packages 33 kB/s | 15 kB 00:00 2023-11-05T07:55:33.374 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 9 - CRB 3.3 MB/s | 5.8 MB 00:01 2023-11-05T07:55:34.562 INFO:teuthology.orchestra.run.smithi156.stdout:Extra Packages for Enterprise Linux 4.9 MB/s | 19 MB 00:03 2023-11-05T07:55:35.608 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 9 - Extras packages 13 kB/s | 15 kB 00:01 2023-11-05T07:55:38.103 INFO:teuthology.orchestra.run.smithi052.stdout:Extra Packages for Enterprise Linux 8.2 MB/s | 19 MB 00:02 2023-11-05T07:55:39.108 INFO:teuthology.orchestra.run.smithi156.stdout:lab-extras 13 kB/s | 1.7 kB 00:00 2023-11-05T07:55:41.544 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2023-11-05T07:55:41.548 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-05T07:55:41.548 INFO:teuthology.orchestra.run.smithi156.stdout: Package Arch Version Repository Size 2023-11-05T07:55:41.548 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-05T07:55:41.548 INFO:teuthology.orchestra.run.smithi156.stdout:Installing: 2023-11-05T07:55:41.549 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-radosgw x86_64 2:18.0.0-6776.g420cd129.el9 ceph 8.6 M 2023-11-05T07:55:41.549 INFO:teuthology.orchestra.run.smithi156.stdout:Upgrading: 2023-11-05T07:55:41.549 INFO:teuthology.orchestra.run.smithi156.stdout: librados2 x86_64 2:18.0.0-6776.g420cd129.el9 ceph 3.3 M 2023-11-05T07:55:41.549 INFO:teuthology.orchestra.run.smithi156.stdout: librbd1 x86_64 2:18.0.0-6776.g420cd129.el9 ceph 3.0 M 2023-11-05T07:55:41.550 INFO:teuthology.orchestra.run.smithi156.stdout:Installing dependencies: 2023-11-05T07:55:41.550 INFO:teuthology.orchestra.run.smithi156.stdout: boost-program-options 2023-11-05T07:55:41.550 INFO:teuthology.orchestra.run.smithi156.stdout: x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-11-05T07:55:41.550 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-base x86_64 2:18.0.0-6776.g420cd129.el9 ceph 5.2 M 2023-11-05T07:55:41.550 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-common x86_64 2:18.0.0-6776.g420cd129.el9 ceph 19 M 2023-11-05T07:55:41.551 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-selinux x86_64 2:18.0.0-6776.g420cd129.el9 ceph 24 k 2023-11-05T07:55:41.551 INFO:teuthology.orchestra.run.smithi156.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2023-11-05T07:55:41.551 INFO:teuthology.orchestra.run.smithi156.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-11-05T07:55:41.551 INFO:teuthology.orchestra.run.smithi156.stdout: libarrow x86_64 9.0.0-9.el9 epel 4.4 M 2023-11-05T07:55:41.551 INFO:teuthology.orchestra.run.smithi156.stdout: libarrow-doc noarch 9.0.0-9.el9 epel 24 k 2023-11-05T07:55:41.551 INFO:teuthology.orchestra.run.smithi156.stdout: libcephfs2 x86_64 2:18.0.0-6776.g420cd129.el9 ceph 715 k 2023-11-05T07:55:41.552 INFO:teuthology.orchestra.run.smithi156.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-11-05T07:55:41.552 INFO:teuthology.orchestra.run.smithi156.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-11-05T07:55:41.552 INFO:teuthology.orchestra.run.smithi156.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2023-11-05T07:55:41.553 INFO:teuthology.orchestra.run.smithi156.stdout: libradosstriper1 x86_64 2:18.0.0-6776.g420cd129.el9 ceph 472 k 2023-11-05T07:55:41.553 INFO:teuthology.orchestra.run.smithi156.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-11-05T07:55:41.553 INFO:teuthology.orchestra.run.smithi156.stdout: librgw2 x86_64 2:18.0.0-6776.g420cd129.el9 ceph 4.8 M 2023-11-05T07:55:41.553 INFO:teuthology.orchestra.run.smithi156.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-11-05T07:55:41.553 INFO:teuthology.orchestra.run.smithi156.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-11-05T07:55:41.553 INFO:teuthology.orchestra.run.smithi156.stdout: parquet-libs x86_64 9.0.0-9.el9 epel 837 k 2023-11-05T07:55:41.554 INFO:teuthology.orchestra.run.smithi156.stdout: python3-ceph-argparse 2023-11-05T07:55:41.554 INFO:teuthology.orchestra.run.smithi156.stdout: x86_64 2:18.0.0-6776.g420cd129.el9 ceph 45 k 2023-11-05T07:55:41.554 INFO:teuthology.orchestra.run.smithi156.stdout: python3-ceph-common x86_64 2:18.0.0-6776.g420cd129.el9 ceph 127 k 2023-11-05T07:55:41.554 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cephfs x86_64 2:18.0.0-6776.g420cd129.el9 ceph 161 k 2023-11-05T07:55:41.554 INFO:teuthology.orchestra.run.smithi156.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-11-05T07:55:41.555 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rados x86_64 2:18.0.0-6776.g420cd129.el9 ceph 321 k 2023-11-05T07:55:41.555 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rbd x86_64 2:18.0.0-6776.g420cd129.el9 ceph 298 k 2023-11-05T07:55:41.555 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rgw x86_64 2:18.0.0-6776.g420cd129.el9 ceph 99 k 2023-11-05T07:55:41.555 INFO:teuthology.orchestra.run.smithi156.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-11-05T07:55:41.555 INFO:teuthology.orchestra.run.smithi156.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-11-05T07:55:41.556 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T07:55:41.556 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2023-11-05T07:55:41.556 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-05T07:55:41.556 INFO:teuthology.orchestra.run.smithi156.stdout:Install 28 Packages 2023-11-05T07:55:41.556 INFO:teuthology.orchestra.run.smithi156.stdout:Upgrade 2 Packages 2023-11-05T07:55:41.557 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T07:55:41.557 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 55 M 2023-11-05T07:55:41.558 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading Packages: 2023-11-05T07:55:42.784 INFO:teuthology.orchestra.run.smithi052.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2023-11-05T07:55:44.001 INFO:teuthology.orchestra.run.smithi156.stdout:(1/30): ceph-base-18.0.0-6776.g420cd129.el9.x86 2.6 MB/s | 5.2 MB 00:01 2023-11-05T07:55:44.110 INFO:teuthology.orchestra.run.smithi156.stdout:(2/30): ceph-radosgw-18.0.0-6776.g420cd129.el9. 4.1 MB/s | 8.6 MB 00:02 2023-11-05T07:55:44.126 INFO:teuthology.orchestra.run.smithi156.stdout:(3/30): ceph-selinux-18.0.0-6776.g420cd129.el9. 192 kB/s | 24 kB 00:00 2023-11-05T07:55:44.318 INFO:teuthology.orchestra.run.smithi156.stdout:(4/30): libradosstriper1-18.0.0-6776.g420cd129. 2.4 MB/s | 472 kB 00:00 2023-11-05T07:55:44.344 INFO:teuthology.orchestra.run.smithi156.stdout:(5/30): libcephfs2-18.0.0-6776.g420cd129.el9.x8 3.0 MB/s | 715 kB 00:00 2023-11-05T07:55:44.386 INFO:teuthology.orchestra.run.smithi156.stdout:(6/30): python3-ceph-argparse-18.0.0-6776.g420c 1.1 MB/s | 45 kB 00:00 2023-11-05T07:55:44.469 INFO:teuthology.orchestra.run.smithi156.stdout:(7/30): python3-ceph-common-18.0.0-6776.g420cd1 1.5 MB/s | 127 kB 00:00 2023-11-05T07:55:44.536 INFO:teuthology.orchestra.run.smithi156.stdout:(8/30): python3-cephfs-18.0.0-6776.g420cd129.el 2.4 MB/s | 161 kB 00:00 2023-11-05T07:55:44.645 INFO:teuthology.orchestra.run.smithi156.stdout:(9/30): python3-rados-18.0.0-6776.g420cd129.el9 2.9 MB/s | 321 kB 00:00 2023-11-05T07:55:44.712 INFO:teuthology.orchestra.run.smithi156.stdout:(10/30): python3-rbd-18.0.0-6776.g420cd129.el9. 4.4 MB/s | 298 kB 00:00 2023-11-05T07:55:44.787 INFO:teuthology.orchestra.run.smithi156.stdout:(11/30): python3-rgw-18.0.0-6776.g420cd129.el9. 1.3 MB/s | 99 kB 00:00 2023-11-05T07:55:44.879 INFO:teuthology.orchestra.run.smithi156.stdout:(12/30): boost-program-options-1.75.0-8.el9.x86 1.1 MB/s | 106 kB 00:00 2023-11-05T07:55:44.929 INFO:teuthology.orchestra.run.smithi156.stdout:(13/30): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 159 kB 00:00 2023-11-05T07:55:44.980 INFO:teuthology.orchestra.run.smithi156.stdout:(14/30): librdkafka-1.6.1-102.el9.x86_64.rpm 13 MB/s | 661 kB 00:00 2023-11-05T07:55:45.013 INFO:teuthology.orchestra.run.smithi156.stdout:(15/30): lttng-ust-2.12.0-6.el9.x86_64.rpm 8.3 MB/s | 282 kB 00:00 2023-11-05T07:55:45.047 INFO:teuthology.orchestra.run.smithi156.stdout:(16/30): python3-prettytable-0.7.2-27.el9.noarc 1.2 MB/s | 41 kB 00:00 2023-11-05T07:55:45.270 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2023-11-05T07:55:45.273 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-11-05T07:55:45.273 INFO:teuthology.orchestra.run.smithi052.stdout: Package Arch Version Repository Size 2023-11-05T07:55:45.274 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-11-05T07:55:45.274 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2023-11-05T07:55:45.274 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-radosgw x86_64 2:18.0.0-6776.g420cd129.el9 ceph 8.6 M 2023-11-05T07:55:45.274 INFO:teuthology.orchestra.run.smithi052.stdout:Upgrading: 2023-11-05T07:55:45.274 INFO:teuthology.orchestra.run.smithi052.stdout: librados2 x86_64 2:18.0.0-6776.g420cd129.el9 ceph 3.3 M 2023-11-05T07:55:45.275 INFO:teuthology.orchestra.run.smithi052.stdout: librbd1 x86_64 2:18.0.0-6776.g420cd129.el9 ceph 3.0 M 2023-11-05T07:55:45.275 INFO:teuthology.orchestra.run.smithi052.stdout:Installing dependencies: 2023-11-05T07:55:45.275 INFO:teuthology.orchestra.run.smithi052.stdout: boost-program-options 2023-11-05T07:55:45.275 INFO:teuthology.orchestra.run.smithi052.stdout: x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-11-05T07:55:45.275 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-base x86_64 2:18.0.0-6776.g420cd129.el9 ceph 5.2 M 2023-11-05T07:55:45.276 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-common x86_64 2:18.0.0-6776.g420cd129.el9 ceph 19 M 2023-11-05T07:55:45.276 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-selinux x86_64 2:18.0.0-6776.g420cd129.el9 ceph 24 k 2023-11-05T07:55:45.276 INFO:teuthology.orchestra.run.smithi052.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2023-11-05T07:55:45.276 INFO:teuthology.orchestra.run.smithi052.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-11-05T07:55:45.276 INFO:teuthology.orchestra.run.smithi052.stdout: libarrow x86_64 9.0.0-9.el9 epel 4.4 M 2023-11-05T07:55:45.277 INFO:teuthology.orchestra.run.smithi052.stdout: libarrow-doc noarch 9.0.0-9.el9 epel 24 k 2023-11-05T07:55:45.277 INFO:teuthology.orchestra.run.smithi052.stdout: libcephfs2 x86_64 2:18.0.0-6776.g420cd129.el9 ceph 715 k 2023-11-05T07:55:45.277 INFO:teuthology.orchestra.run.smithi052.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-11-05T07:55:45.277 INFO:teuthology.orchestra.run.smithi052.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-11-05T07:55:45.277 INFO:teuthology.orchestra.run.smithi052.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2023-11-05T07:55:45.278 INFO:teuthology.orchestra.run.smithi052.stdout: libradosstriper1 x86_64 2:18.0.0-6776.g420cd129.el9 ceph 472 k 2023-11-05T07:55:45.278 INFO:teuthology.orchestra.run.smithi052.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-11-05T07:55:45.278 INFO:teuthology.orchestra.run.smithi052.stdout: librgw2 x86_64 2:18.0.0-6776.g420cd129.el9 ceph 4.8 M 2023-11-05T07:55:45.278 INFO:teuthology.orchestra.run.smithi052.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-11-05T07:55:45.278 INFO:teuthology.orchestra.run.smithi052.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-11-05T07:55:45.279 INFO:teuthology.orchestra.run.smithi052.stdout: parquet-libs x86_64 9.0.0-9.el9 epel 837 k 2023-11-05T07:55:45.279 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ceph-argparse 2023-11-05T07:55:45.279 INFO:teuthology.orchestra.run.smithi052.stdout: x86_64 2:18.0.0-6776.g420cd129.el9 ceph 45 k 2023-11-05T07:55:45.279 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ceph-common x86_64 2:18.0.0-6776.g420cd129.el9 ceph 127 k 2023-11-05T07:55:45.279 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cephfs x86_64 2:18.0.0-6776.g420cd129.el9 ceph 161 k 2023-11-05T07:55:45.280 INFO:teuthology.orchestra.run.smithi052.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-11-05T07:55:45.280 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rados x86_64 2:18.0.0-6776.g420cd129.el9 ceph 321 k 2023-11-05T07:55:45.280 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rbd x86_64 2:18.0.0-6776.g420cd129.el9 ceph 298 k 2023-11-05T07:55:45.280 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rgw x86_64 2:18.0.0-6776.g420cd129.el9 ceph 99 k 2023-11-05T07:55:45.280 INFO:teuthology.orchestra.run.smithi052.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-11-05T07:55:45.281 INFO:teuthology.orchestra.run.smithi052.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-11-05T07:55:45.281 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T07:55:45.281 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2023-11-05T07:55:45.281 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-11-05T07:55:45.281 INFO:teuthology.orchestra.run.smithi052.stdout:Install 28 Packages 2023-11-05T07:55:45.282 INFO:teuthology.orchestra.run.smithi052.stdout:Upgrade 2 Packages 2023-11-05T07:55:45.282 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T07:55:45.282 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 55 M 2023-11-05T07:55:45.283 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2023-11-05T07:55:45.305 INFO:teuthology.orchestra.run.smithi156.stdout:(17/30): librgw2-18.0.0-6776.g420cd129.el9.x86_ 4.8 MB/s | 4.8 MB 00:00 2023-11-05T07:55:45.389 INFO:teuthology.orchestra.run.smithi156.stdout:(18/30): fmt-8.1.1-5.el9.x86_64.rpm 1.3 MB/s | 111 kB 00:00 2023-11-05T07:55:45.439 INFO:teuthology.orchestra.run.smithi156.stdout:(19/30): gperftools-libs-2.9.1-2.el9.x86_64.rpm 6.0 MB/s | 309 kB 00:00 2023-11-05T07:55:45.465 INFO:teuthology.orchestra.run.smithi156.stdout:(20/30): librabbitmq-0.11.0-7.el9.x86_64.rpm 108 kB/s | 45 kB 00:00 2023-11-05T07:55:45.515 INFO:teuthology.orchestra.run.smithi156.stdout:(21/30): libarrow-doc-9.0.0-9.el9.noarch.rpm 488 kB/s | 24 kB 00:00 2023-11-05T07:55:45.582 INFO:teuthology.orchestra.run.smithi156.stdout:(22/30): libarrow-9.0.0-9.el9.x86_64.rpm 31 MB/s | 4.4 MB 00:00 2023-11-05T07:55:45.607 INFO:teuthology.orchestra.run.smithi156.stdout:(23/30): liboath-2.6.7-2.el9.x86_64.rpm 530 kB/s | 49 kB 00:00 2023-11-05T07:55:45.632 INFO:teuthology.orchestra.run.smithi156.stdout:(24/30): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2023-11-05T07:55:45.666 INFO:teuthology.orchestra.run.smithi156.stdout:(25/30): re2-20211101-3.el9.x86_64.rpm 5.7 MB/s | 192 kB 00:00 2023-11-05T07:55:45.708 INFO:teuthology.orchestra.run.smithi156.stdout:(26/30): parquet-libs-9.0.0-9.el9.x86_64.rpm 8.1 MB/s | 837 kB 00:00 2023-11-05T07:55:45.750 INFO:teuthology.orchestra.run.smithi156.stdout:(27/30): thrift-0.15.0-2.el9.x86_64.rpm 19 MB/s | 1.6 MB 00:00 2023-11-05T07:55:46.126 INFO:teuthology.orchestra.run.smithi156.stdout:(28/30): librbd1-18.0.0-6776.g420cd129.el9.x86_ 8.1 MB/s | 3.0 MB 00:00 2023-11-05T07:55:46.284 INFO:teuthology.orchestra.run.smithi156.stdout:(29/30): librados2-18.0.0-6776.g420cd129.el9.x8 5.7 MB/s | 3.3 MB 00:00 2023-11-05T07:55:46.994 INFO:teuthology.orchestra.run.smithi052.stdout:(1/30): ceph-radosgw-18.0.0-6776.g420cd129.el9. 7.0 MB/s | 8.6 MB 00:01 2023-11-05T07:55:47.035 INFO:teuthology.orchestra.run.smithi052.stdout:(2/30): ceph-selinux-18.0.0-6776.g420cd129.el9. 582 kB/s | 24 kB 00:00 2023-11-05T07:55:47.169 INFO:teuthology.orchestra.run.smithi052.stdout:(3/30): libcephfs2-18.0.0-6776.g420cd129.el9.x8 5.2 MB/s | 715 kB 00:00 2023-11-05T07:55:47.253 INFO:teuthology.orchestra.run.smithi052.stdout:(4/30): libradosstriper1-18.0.0-6776.g420cd129. 5.5 MB/s | 472 kB 00:00 2023-11-05T07:55:47.494 INFO:teuthology.orchestra.run.smithi052.stdout:(5/30): ceph-base-18.0.0-6776.g420cd129.el9.x86 3.0 MB/s | 5.2 MB 00:01 2023-11-05T07:55:47.687 INFO:teuthology.orchestra.run.smithi052.stdout:(6/30): ceph-common-18.0.0-6776.g420cd129.el9.x 9.8 MB/s | 19 MB 00:01 2023-11-05T07:55:47.712 INFO:teuthology.orchestra.run.smithi052.stdout:(7/30): python3-ceph-argparse-18.0.0-6776.g420c 208 kB/s | 45 kB 00:00 2023-11-05T07:55:47.737 INFO:teuthology.orchestra.run.smithi052.stdout:(8/30): python3-ceph-common-18.0.0-6776.g420cd1 2.5 MB/s | 127 kB 00:00 2023-11-05T07:55:47.770 INFO:teuthology.orchestra.run.smithi052.stdout:(9/30): python3-cephfs-18.0.0-6776.g420cd129.el 2.7 MB/s | 161 kB 00:00 2023-11-05T07:55:47.796 INFO:teuthology.orchestra.run.smithi052.stdout:(10/30): python3-rados-18.0.0-6776.g420cd129.el 5.4 MB/s | 321 kB 00:00 2023-11-05T07:55:47.863 INFO:teuthology.orchestra.run.smithi052.stdout:(11/30): librgw2-18.0.0-6776.g420cd129.el9.x86_ 7.8 MB/s | 4.8 MB 00:00 2023-11-05T07:55:47.897 INFO:teuthology.orchestra.run.smithi052.stdout:(12/30): python3-rgw-18.0.0-6776.g420cd129.el9. 987 kB/s | 99 kB 00:00 2023-11-05T07:55:47.922 INFO:teuthology.orchestra.run.smithi052.stdout:(13/30): python3-rbd-18.0.0-6776.g420cd129.el9. 1.9 MB/s | 298 kB 00:00 2023-11-05T07:55:48.047 INFO:teuthology.orchestra.run.smithi052.stdout:(14/30): boost-program-options-1.75.0-8.el9.x86 575 kB/s | 106 kB 00:00 2023-11-05T07:55:48.073 INFO:teuthology.orchestra.run.smithi052.stdout:(15/30): libpmemobj-1.12.1-1.el9.x86_64.rpm 907 kB/s | 159 kB 00:00 2023-11-05T07:55:48.097 INFO:teuthology.orchestra.run.smithi052.stdout:(16/30): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.5 MB/s | 282 kB 00:00 2023-11-05T07:55:48.115 INFO:teuthology.orchestra.run.smithi052.stdout:(17/30): python3-prettytable-0.7.2-27.el9.noarc 996 kB/s | 41 kB 00:00 2023-11-05T07:55:48.165 INFO:teuthology.orchestra.run.smithi052.stdout:(18/30): librdkafka-1.6.1-102.el9.x86_64.rpm 3.4 MB/s | 661 kB 00:00 2023-11-05T07:55:48.290 INFO:teuthology.orchestra.run.smithi052.stdout:(19/30): librabbitmq-0.11.0-7.el9.x86_64.rpm 236 kB/s | 45 kB 00:00 2023-11-05T07:55:48.466 INFO:teuthology.orchestra.run.smithi052.stdout:(20/30): fmt-8.1.1-5.el9.x86_64.rpm 316 kB/s | 111 kB 00:00 2023-11-05T07:55:48.509 INFO:teuthology.orchestra.run.smithi156.stdout:(30/30): ceph-common-18.0.0-6776.g420cd129.el9. 2.9 MB/s | 19 MB 00:06 2023-11-05T07:55:48.514 INFO:teuthology.orchestra.run.smithi156.stdout:-------------------------------------------------------------------------------- 2023-11-05T07:55:48.515 INFO:teuthology.orchestra.run.smithi156.stdout:Total 7.9 MB/s | 55 MB 00:06 2023-11-05T07:55:48.516 INFO:teuthology.orchestra.run.smithi052.stdout:(21/30): libarrow-doc-9.0.0-9.el9.noarch.rpm 487 kB/s | 24 kB 00:00 2023-11-05T07:55:48.526 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2023-11-05T07:55:48.566 INFO:teuthology.orchestra.run.smithi052.stdout:(22/30): liboath-2.6.7-2.el9.x86_64.rpm 975 kB/s | 49 kB 00:00 2023-11-05T07:55:48.567 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction check succeeded. 2023-11-05T07:55:48.567 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2023-11-05T07:55:48.591 INFO:teuthology.orchestra.run.smithi052.stdout:(23/30): gperftools-libs-2.9.1-2.el9.x86_64.rpm 771 kB/s | 309 kB 00:00 2023-11-05T07:55:48.616 INFO:teuthology.orchestra.run.smithi052.stdout:(24/30): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2023-11-05T07:55:48.708 INFO:teuthology.orchestra.run.smithi052.stdout:(25/30): re2-20211101-3.el9.x86_64.rpm 2.0 MB/s | 192 kB 00:00 2023-11-05T07:55:48.742 INFO:teuthology.orchestra.run.smithi052.stdout:(26/30): parquet-libs-9.0.0-9.el9.x86_64.rpm 5.4 MB/s | 837 kB 00:00 2023-11-05T07:55:48.901 INFO:teuthology.orchestra.run.smithi052.stdout:(27/30): libarrow-9.0.0-9.el9.x86_64.rpm 7.3 MB/s | 4.4 MB 00:00 2023-11-05T07:55:48.943 INFO:teuthology.orchestra.run.smithi052.stdout:(28/30): thrift-0.15.0-2.el9.x86_64.rpm 6.8 MB/s | 1.6 MB 00:00 2023-11-05T07:55:49.028 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded. 2023-11-05T07:55:49.029 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2023-11-05T07:55:49.143 INFO:teuthology.orchestra.run.smithi052.stdout:(29/30): librbd1-18.0.0-6776.g420cd129.el9.x86_ 13 MB/s | 3.0 MB 00:00 2023-11-05T07:55:49.326 INFO:teuthology.orchestra.run.smithi052.stdout:(30/30): librados2-18.0.0-6776.g420cd129.el9.x8 5.7 MB/s | 3.3 MB 00:00 2023-11-05T07:55:49.333 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2023-11-05T07:55:49.333 INFO:teuthology.orchestra.run.smithi052.stdout:Total 14 MB/s | 55 MB 00:04 2023-11-05T07:55:49.344 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2023-11-05T07:55:49.382 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2023-11-05T07:55:49.382 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2023-11-05T07:55:49.874 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2023-11-05T07:55:49.875 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2023-11-05T07:55:50.398 INFO:teuthology.orchestra.run.smithi156.stdout: Preparing : 1/1 2023-11-05T07:55:50.475 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/32 2023-11-05T07:55:50.525 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/32 2023-11-05T07:55:50.584 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/32 2023-11-05T07:55:50.902 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/32 2023-11-05T07:55:50.966 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : librados2-2:18.0.0-6776.g420cd129.el9.x86_64 5/32 2023-11-05T07:55:51.057 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: librados2-2:18.0.0-6776.g420cd129.el9.x86_64 5/32 2023-11-05T07:55:51.150 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-rados-2:18.0.0-6776.g420cd129.el9.x86_64 6/32 2023-11-05T07:55:51.184 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libcephfs2-2:18.0.0-6776.g420cd129.el9.x86_64 7/32 2023-11-05T07:55:51.246 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: libcephfs2-2:18.0.0-6776.g420cd129.el9.x86_64 7/32 2023-11-05T07:55:51.283 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : liboath-2.6.7-2.el9.x86_64 8/32 2023-11-05T07:55:51.303 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2023-11-05T07:55:51.326 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-ceph-argparse-2:18.0.0-6776.g420cd129.el9. 9/32 2023-11-05T07:55:51.364 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/32 2023-11-05T07:55:51.396 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-cephfs-2:18.0.0-6776.g420cd129.el9.x86_64 10/32 2023-11-05T07:55:51.412 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/32 2023-11-05T07:55:51.427 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libradosstriper1-2:18.0.0-6776.g420cd129.el9.x86_6 11/32 2023-11-05T07:55:51.466 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/32 2023-11-05T07:55:51.476 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6776.g420cd129.el9.x86_6 11/32 2023-11-05T07:55:51.582 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : re2-1:20211101-3.el9.x86_64 12/32 2023-11-05T07:55:51.618 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libarrow-9.0.0-9.el9.x86_64 13/32 2023-11-05T07:55:51.659 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/32 2023-11-05T07:55:51.691 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/32 2023-11-05T07:55:51.718 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libarrow-doc-9.0.0-9.el9.noarch 16/32 2023-11-05T07:55:51.745 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : fmt-8.1.1-5.el9.x86_64 17/32 2023-11-05T07:55:51.778 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 18/32 2023-11-05T07:55:51.849 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/32 2023-11-05T07:55:52.014 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : librados2-2:18.0.0-6776.g420cd129.el9.x86_64 5/32 2023-11-05T07:55:52.081 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 19/32 2023-11-05T07:55:52.090 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: librados2-2:18.0.0-6776.g420cd129.el9.x86_64 5/32 2023-11-05T07:55:52.117 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : librbd1-2:18.0.0-6776.g420cd129.el9.x86_64 20/32 2023-11-05T07:55:52.177 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-rados-2:18.0.0-6776.g420cd129.el9.x86_64 6/32 2023-11-05T07:55:52.190 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: librbd1-2:18.0.0-6776.g420cd129.el9.x86_64 20/32 2023-11-05T07:55:52.207 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libcephfs2-2:18.0.0-6776.g420cd129.el9.x86_64 7/32 2023-11-05T07:55:52.229 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-rbd-2:18.0.0-6776.g420cd129.el9.x86_64 21/32 2023-11-05T07:55:52.266 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 22/32 2023-11-05T07:55:52.270 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: libcephfs2-2:18.0.0-6776.g420cd129.el9.x86_64 7/32 2023-11-05T07:55:52.298 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : liboath-2.6.7-2.el9.x86_64 8/32 2023-11-05T07:55:52.343 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-ceph-argparse-2:18.0.0-6776.g420cd129.el9. 9/32 2023-11-05T07:55:52.415 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cephfs-2:18.0.0-6776.g420cd129.el9.x86_64 10/32 2023-11-05T07:55:52.441 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libradosstriper1-2:18.0.0-6776.g420cd129.el9.x86_6 11/32 2023-11-05T07:55:52.507 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6776.g420cd129.el9.x86_6 11/32 2023-11-05T07:55:52.616 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : re2-1:20211101-3.el9.x86_64 12/32 2023-11-05T07:55:52.649 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libarrow-9.0.0-9.el9.x86_64 13/32 2023-11-05T07:55:52.689 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/32 2023-11-05T07:55:52.693 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : parquet-libs-9.0.0-9.el9.x86_64 23/32 2023-11-05T07:55:52.722 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/32 2023-11-05T07:55:52.727 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : librgw2-2:18.0.0-6776.g420cd129.el9.x86_64 24/32 2023-11-05T07:55:52.749 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libarrow-doc-9.0.0-9.el9.noarch 16/32 2023-11-05T07:55:52.782 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: librgw2-2:18.0.0-6776.g420cd129.el9.x86_64 24/32 2023-11-05T07:55:52.785 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : fmt-8.1.1-5.el9.x86_64 17/32 2023-11-05T07:55:52.817 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 18/32 2023-11-05T07:55:52.857 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-rgw-2:18.0.0-6776.g420cd129.el9.x86_64 25/32 2023-11-05T07:55:52.888 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-ceph-common-2:18.0.0-6776.g420cd129.el9.x8 26/32 2023-11-05T07:55:53.136 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 19/32 2023-11-05T07:55:53.164 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : librbd1-2:18.0.0-6776.g420cd129.el9.x86_64 20/32 2023-11-05T07:55:53.239 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: librbd1-2:18.0.0-6776.g420cd129.el9.x86_64 20/32 2023-11-05T07:55:53.269 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-rbd-2:18.0.0-6776.g420cd129.el9.x86_64 21/32 2023-11-05T07:55:53.305 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 22/32 2023-11-05T07:55:53.754 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : parquet-libs-9.0.0-9.el9.x86_64 23/32 2023-11-05T07:55:53.783 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : librgw2-2:18.0.0-6776.g420cd129.el9.x86_64 24/32 2023-11-05T07:55:53.855 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: librgw2-2:18.0.0-6776.g420cd129.el9.x86_64 24/32 2023-11-05T07:55:53.933 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-rgw-2:18.0.0-6776.g420cd129.el9.x86_64 25/32 2023-11-05T07:55:53.961 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-ceph-common-2:18.0.0-6776.g420cd129.el9.x8 26/32 2023-11-05T07:55:55.028 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-common-2:18.0.0-6776.g420cd129.el9.x86_64 27/32 2023-11-05T07:55:55.068 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-common-2:18.0.0-6776.g420cd129.el9.x86_64 27/32 2023-11-05T07:55:55.626 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-common-2:18.0.0-6776.g420cd129.el9.x86_64 27/32 2023-11-05T07:55:55.672 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-base-2:18.0.0-6776.g420cd129.el9.x86_64 28/32 2023-11-05T07:55:55.770 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-base-2:18.0.0-6776.g420cd129.el9.x86_64 28/32 2023-11-05T07:55:55.770 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-11-05T07:55:55.771 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-11-05T07:55:55.771 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T07:55:55.806 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-selinux-2:18.0.0-6776.g420cd129.el9.x86_64 29/32 2023-11-05T07:55:56.221 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-common-2:18.0.0-6776.g420cd129.el9.x86_64 27/32 2023-11-05T07:55:56.259 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-common-2:18.0.0-6776.g420cd129.el9.x86_64 27/32 2023-11-05T07:55:56.834 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-common-2:18.0.0-6776.g420cd129.el9.x86_64 27/32 2023-11-05T07:55:56.938 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-base-2:18.0.0-6776.g420cd129.el9.x86_64 28/32 2023-11-05T07:55:57.029 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-base-2:18.0.0-6776.g420cd129.el9.x86_64 28/32 2023-11-05T07:55:57.029 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-11-05T07:55:57.029 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-11-05T07:55:57.030 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T07:55:57.064 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-selinux-2:18.0.0-6776.g420cd129.el9.x86_64 29/32 2023-11-05T07:56:05.297 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6776.g420cd129.el9.x86_64 29/32 2023-11-05T07:56:05.297 INFO:teuthology.orchestra.run.smithi156.stdout:skipping the directory /sys 2023-11-05T07:56:05.297 INFO:teuthology.orchestra.run.smithi156.stdout:skipping the directory /proc 2023-11-05T07:56:05.297 INFO:teuthology.orchestra.run.smithi156.stdout:skipping the directory /mnt 2023-11-05T07:56:05.298 INFO:teuthology.orchestra.run.smithi156.stdout:skipping the directory /var/tmp 2023-11-05T07:56:05.298 INFO:teuthology.orchestra.run.smithi156.stdout:skipping the directory /home 2023-11-05T07:56:05.298 INFO:teuthology.orchestra.run.smithi156.stdout:skipping the directory /root 2023-11-05T07:56:05.298 INFO:teuthology.orchestra.run.smithi156.stdout:skipping the directory /tmp 2023-11-05T07:56:05.298 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T07:56:06.143 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-radosgw-2:18.0.0-6776.g420cd129.el9.x86_64 30/32 2023-11-05T07:56:06.167 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6776.g420cd129.el9.x86_64 30/32 2023-11-05T07:56:06.167 INFO:teuthology.orchestra.run.smithi156.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-05T07:56:06.168 INFO:teuthology.orchestra.run.smithi156.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-11-05T07:56:06.168 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-11-05T07:56:06.168 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-11-05T07:56:06.168 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T07:56:06.169 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 31/32 2023-11-05T07:56:06.262 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 31/32 2023-11-05T07:56:06.262 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 32/32 2023-11-05T07:56:06.773 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6776.g420cd129.el9.x86_64 29/32 2023-11-05T07:56:06.774 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /sys 2023-11-05T07:56:06.774 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /proc 2023-11-05T07:56:06.774 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /mnt 2023-11-05T07:56:06.774 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /var/tmp 2023-11-05T07:56:06.775 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /home 2023-11-05T07:56:06.775 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /root 2023-11-05T07:56:06.775 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /tmp 2023-11-05T07:56:06.775 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T07:56:07.412 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 32/32 2023-11-05T07:56:07.413 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-base-2:18.0.0-6776.g420cd129.el9.x86_64 1/32 2023-11-05T07:56:07.413 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-common-2:18.0.0-6776.g420cd129.el9.x86_64 2/32 2023-11-05T07:56:07.413 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-radosgw-2:18.0.0-6776.g420cd129.el9.x86_64 3/32 2023-11-05T07:56:07.413 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-selinux-2:18.0.0-6776.g420cd129.el9.x86_64 4/32 2023-11-05T07:56:07.414 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libcephfs2-2:18.0.0-6776.g420cd129.el9.x86_64 5/32 2023-11-05T07:56:07.414 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libradosstriper1-2:18.0.0-6776.g420cd129.el9.x86_6 6/32 2023-11-05T07:56:07.414 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librgw2-2:18.0.0-6776.g420cd129.el9.x86_64 7/32 2023-11-05T07:56:07.414 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6776.g420cd129.el9. 8/32 2023-11-05T07:56:07.415 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-ceph-common-2:18.0.0-6776.g420cd129.el9.x8 9/32 2023-11-05T07:56:07.415 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-cephfs-2:18.0.0-6776.g420cd129.el9.x86_64 10/32 2023-11-05T07:56:07.415 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-rados-2:18.0.0-6776.g420cd129.el9.x86_64 11/32 2023-11-05T07:56:07.415 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-rbd-2:18.0.0-6776.g420cd129.el9.x86_64 12/32 2023-11-05T07:56:07.415 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-rgw-2:18.0.0-6776.g420cd129.el9.x86_64 13/32 2023-11-05T07:56:07.416 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/32 2023-11-05T07:56:07.416 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/32 2023-11-05T07:56:07.416 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 16/32 2023-11-05T07:56:07.416 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 17/32 2023-11-05T07:56:07.416 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 18/32 2023-11-05T07:56:07.417 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 19/32 2023-11-05T07:56:07.417 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 20/32 2023-11-05T07:56:07.417 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 21/32 2023-11-05T07:56:07.417 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libarrow-9.0.0-9.el9.x86_64 22/32 2023-11-05T07:56:07.417 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libarrow-doc-9.0.0-9.el9.noarch 23/32 2023-11-05T07:56:07.418 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 24/32 2023-11-05T07:56:07.418 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 25/32 2023-11-05T07:56:07.418 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : parquet-libs-9.0.0-9.el9.x86_64 26/32 2023-11-05T07:56:07.418 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : re2-1:20211101-3.el9.x86_64 27/32 2023-11-05T07:56:07.418 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 28/32 2023-11-05T07:56:07.419 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librados2-2:18.0.0-6776.g420cd129.el9.x86_64 29/32 2023-11-05T07:56:07.419 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 30/32 2023-11-05T07:56:07.419 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librbd1-2:18.0.0-6776.g420cd129.el9.x86_64 31/32 2023-11-05T07:56:07.622 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-radosgw-2:18.0.0-6776.g420cd129.el9.x86_64 30/32 2023-11-05T07:56:07.649 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6776.g420cd129.el9.x86_64 30/32 2023-11-05T07:56:07.649 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-05T07:56:07.649 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-11-05T07:56:07.649 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-11-05T07:56:07.649 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-11-05T07:56:07.650 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T07:56:07.651 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 31/32 2023-11-05T07:56:07.734 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 31/32 2023-11-05T07:56:07.734 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 32/32 2023-11-05T07:56:08.519 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 32/32 2023-11-05T07:56:08.519 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T07:56:08.519 INFO:teuthology.orchestra.run.smithi156.stdout:Upgraded: 2023-11-05T07:56:08.519 INFO:teuthology.orchestra.run.smithi156.stdout: librados2-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-05T07:56:08.520 INFO:teuthology.orchestra.run.smithi156.stdout: librbd1-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-05T07:56:08.520 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2023-11-05T07:56:08.520 INFO:teuthology.orchestra.run.smithi156.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-11-05T07:56:08.520 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-base-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-05T07:56:08.520 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-common-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-05T07:56:08.521 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-radosgw-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-05T07:56:08.521 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-selinux-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-05T07:56:08.521 INFO:teuthology.orchestra.run.smithi156.stdout: fmt-8.1.1-5.el9.x86_64 2023-11-05T07:56:08.521 INFO:teuthology.orchestra.run.smithi156.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-11-05T07:56:08.521 INFO:teuthology.orchestra.run.smithi156.stdout: libarrow-9.0.0-9.el9.x86_64 2023-11-05T07:56:08.522 INFO:teuthology.orchestra.run.smithi156.stdout: libarrow-doc-9.0.0-9.el9.noarch 2023-11-05T07:56:08.522 INFO:teuthology.orchestra.run.smithi156.stdout: libcephfs2-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-05T07:56:08.522 INFO:teuthology.orchestra.run.smithi156.stdout: liboath-2.6.7-2.el9.x86_64 2023-11-05T07:56:08.522 INFO:teuthology.orchestra.run.smithi156.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-11-05T07:56:08.522 INFO:teuthology.orchestra.run.smithi156.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-11-05T07:56:08.523 INFO:teuthology.orchestra.run.smithi156.stdout: libradosstriper1-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-05T07:56:08.523 INFO:teuthology.orchestra.run.smithi156.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-11-05T07:56:08.523 INFO:teuthology.orchestra.run.smithi156.stdout: librgw2-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-05T07:56:08.523 INFO:teuthology.orchestra.run.smithi156.stdout: libunwind-1.6.2-1.el9.x86_64 2023-11-05T07:56:08.523 INFO:teuthology.orchestra.run.smithi156.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-11-05T07:56:08.524 INFO:teuthology.orchestra.run.smithi156.stdout: parquet-libs-9.0.0-9.el9.x86_64 2023-11-05T07:56:08.524 INFO:teuthology.orchestra.run.smithi156.stdout: python3-ceph-argparse-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-05T07:56:08.524 INFO:teuthology.orchestra.run.smithi156.stdout: python3-ceph-common-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-05T07:56:08.524 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cephfs-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-05T07:56:08.524 INFO:teuthology.orchestra.run.smithi156.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-11-05T07:56:08.525 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rados-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-05T07:56:08.525 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rbd-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-05T07:56:08.525 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rgw-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-05T07:56:08.525 INFO:teuthology.orchestra.run.smithi156.stdout: re2-1:20211101-3.el9.x86_64 2023-11-05T07:56:08.525 INFO:teuthology.orchestra.run.smithi156.stdout: thrift-0.15.0-2.el9.x86_64 2023-11-05T07:56:08.526 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T07:56:08.526 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2023-11-05T07:56:08.799 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum -y install ceph-test 2023-11-05T07:56:08.913 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 32/32 2023-11-05T07:56:08.913 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-base-2:18.0.0-6776.g420cd129.el9.x86_64 1/32 2023-11-05T07:56:08.914 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-common-2:18.0.0-6776.g420cd129.el9.x86_64 2/32 2023-11-05T07:56:08.914 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-radosgw-2:18.0.0-6776.g420cd129.el9.x86_64 3/32 2023-11-05T07:56:08.914 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-selinux-2:18.0.0-6776.g420cd129.el9.x86_64 4/32 2023-11-05T07:56:08.914 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libcephfs2-2:18.0.0-6776.g420cd129.el9.x86_64 5/32 2023-11-05T07:56:08.914 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libradosstriper1-2:18.0.0-6776.g420cd129.el9.x86_6 6/32 2023-11-05T07:56:08.915 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librgw2-2:18.0.0-6776.g420cd129.el9.x86_64 7/32 2023-11-05T07:56:08.915 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6776.g420cd129.el9. 8/32 2023-11-05T07:56:08.915 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-ceph-common-2:18.0.0-6776.g420cd129.el9.x8 9/32 2023-11-05T07:56:08.915 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cephfs-2:18.0.0-6776.g420cd129.el9.x86_64 10/32 2023-11-05T07:56:08.915 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-rados-2:18.0.0-6776.g420cd129.el9.x86_64 11/32 2023-11-05T07:56:08.916 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-rbd-2:18.0.0-6776.g420cd129.el9.x86_64 12/32 2023-11-05T07:56:08.916 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-rgw-2:18.0.0-6776.g420cd129.el9.x86_64 13/32 2023-11-05T07:56:08.916 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/32 2023-11-05T07:56:08.916 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/32 2023-11-05T07:56:08.916 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 16/32 2023-11-05T07:56:08.916 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 17/32 2023-11-05T07:56:08.917 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 18/32 2023-11-05T07:56:08.917 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 19/32 2023-11-05T07:56:08.917 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 20/32 2023-11-05T07:56:08.917 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 21/32 2023-11-05T07:56:08.917 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libarrow-9.0.0-9.el9.x86_64 22/32 2023-11-05T07:56:08.918 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libarrow-doc-9.0.0-9.el9.noarch 23/32 2023-11-05T07:56:08.918 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 24/32 2023-11-05T07:56:08.918 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 25/32 2023-11-05T07:56:08.918 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : parquet-libs-9.0.0-9.el9.x86_64 26/32 2023-11-05T07:56:08.919 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : re2-1:20211101-3.el9.x86_64 27/32 2023-11-05T07:56:08.919 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 28/32 2023-11-05T07:56:08.920 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librados2-2:18.0.0-6776.g420cd129.el9.x86_64 29/32 2023-11-05T07:56:08.920 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 30/32 2023-11-05T07:56:08.920 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librbd1-2:18.0.0-6776.g420cd129.el9.x86_64 31/32 2023-11-05T07:56:09.348 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:00:30 ago on Sun 05 Nov 2023 07:55:39 AM UTC. 2023-11-05T07:56:09.490 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2023-11-05T07:56:09.491 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-05T07:56:09.491 INFO:teuthology.orchestra.run.smithi156.stdout: Package Arch Version Repository Size 2023-11-05T07:56:09.492 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-05T07:56:09.492 INFO:teuthology.orchestra.run.smithi156.stdout:Installing: 2023-11-05T07:56:09.492 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-test x86_64 2:18.0.0-6776.g420cd129.el9 ceph 41 M 2023-11-05T07:56:09.492 INFO:teuthology.orchestra.run.smithi156.stdout:Installing dependencies: 2023-11-05T07:56:09.492 INFO:teuthology.orchestra.run.smithi156.stdout: jq x86_64 1.6-15.el9 appstream 187 k 2023-11-05T07:56:09.493 INFO:teuthology.orchestra.run.smithi156.stdout: libcephsqlite x86_64 2:18.0.0-6776.g420cd129.el9 ceph 164 k 2023-11-05T07:56:09.493 INFO:teuthology.orchestra.run.smithi156.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-11-05T07:56:09.493 INFO:teuthology.orchestra.run.smithi156.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-11-05T07:56:09.493 INFO:teuthology.orchestra.run.smithi156.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-11-05T07:56:09.494 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T07:56:09.494 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2023-11-05T07:56:09.494 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-05T07:56:09.494 INFO:teuthology.orchestra.run.smithi156.stdout:Install 6 Packages 2023-11-05T07:56:09.494 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T07:56:09.495 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 42 M 2023-11-05T07:56:09.495 INFO:teuthology.orchestra.run.smithi156.stdout:Installed size: 173 M 2023-11-05T07:56:09.496 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading Packages: 2023-11-05T07:56:10.036 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 32/32 2023-11-05T07:56:10.036 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T07:56:10.036 INFO:teuthology.orchestra.run.smithi052.stdout:Upgraded: 2023-11-05T07:56:10.037 INFO:teuthology.orchestra.run.smithi052.stdout: librados2-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-05T07:56:10.037 INFO:teuthology.orchestra.run.smithi052.stdout: librbd1-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-05T07:56:10.037 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2023-11-05T07:56:10.037 INFO:teuthology.orchestra.run.smithi052.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-11-05T07:56:10.037 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-base-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-05T07:56:10.038 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-common-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-05T07:56:10.038 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-radosgw-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-05T07:56:10.038 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-selinux-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-05T07:56:10.038 INFO:teuthology.orchestra.run.smithi052.stdout: fmt-8.1.1-5.el9.x86_64 2023-11-05T07:56:10.038 INFO:teuthology.orchestra.run.smithi052.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-11-05T07:56:10.039 INFO:teuthology.orchestra.run.smithi052.stdout: libarrow-9.0.0-9.el9.x86_64 2023-11-05T07:56:10.039 INFO:teuthology.orchestra.run.smithi052.stdout: libarrow-doc-9.0.0-9.el9.noarch 2023-11-05T07:56:10.039 INFO:teuthology.orchestra.run.smithi052.stdout: libcephfs2-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-05T07:56:10.039 INFO:teuthology.orchestra.run.smithi052.stdout: liboath-2.6.7-2.el9.x86_64 2023-11-05T07:56:10.039 INFO:teuthology.orchestra.run.smithi052.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-11-05T07:56:10.040 INFO:teuthology.orchestra.run.smithi052.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-11-05T07:56:10.040 INFO:teuthology.orchestra.run.smithi052.stdout: libradosstriper1-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-05T07:56:10.040 INFO:teuthology.orchestra.run.smithi052.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-11-05T07:56:10.040 INFO:teuthology.orchestra.run.smithi052.stdout: librgw2-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-05T07:56:10.040 INFO:teuthology.orchestra.run.smithi052.stdout: libunwind-1.6.2-1.el9.x86_64 2023-11-05T07:56:10.041 INFO:teuthology.orchestra.run.smithi052.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-11-05T07:56:10.041 INFO:teuthology.orchestra.run.smithi052.stdout: parquet-libs-9.0.0-9.el9.x86_64 2023-11-05T07:56:10.041 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ceph-argparse-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-05T07:56:10.041 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ceph-common-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-05T07:56:10.041 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cephfs-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-05T07:56:10.042 INFO:teuthology.orchestra.run.smithi052.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-11-05T07:56:10.042 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rados-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-05T07:56:10.042 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rbd-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-05T07:56:10.042 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rgw-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-05T07:56:10.042 INFO:teuthology.orchestra.run.smithi052.stdout: re2-1:20211101-3.el9.x86_64 2023-11-05T07:56:10.043 INFO:teuthology.orchestra.run.smithi052.stdout: thrift-0.15.0-2.el9.x86_64 2023-11-05T07:56:10.043 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T07:56:10.043 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2023-11-05T07:56:10.384 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install ceph-test 2023-11-05T07:56:10.866 INFO:teuthology.orchestra.run.smithi156.stdout:(1/6): oniguruma-6.9.6-1.el9.5.x86_64.rpm 1.4 MB/s | 217 kB 00:00 2023-11-05T07:56:10.933 INFO:teuthology.orchestra.run.smithi156.stdout:(2/6): socat-1.7.4.1-5.el9.x86_64.rpm 4.5 MB/s | 300 kB 00:00 2023-11-05T07:56:10.958 INFO:teuthology.orchestra.run.smithi156.stdout:(3/6): xmlstarlet-1.6.1-20.el9.x86_64.rpm 2.4 MB/s | 63 kB 00:00 2023-11-05T07:56:10.959 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:00:28 ago on Sun 05 Nov 2023 07:55:42 AM UTC. 2023-11-05T07:56:11.017 INFO:teuthology.orchestra.run.smithi156.stdout:(4/6): libcephsqlite-18.0.0-6776.g420cd129.el9. 546 kB/s | 164 kB 00:00 2023-11-05T07:56:11.113 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2023-11-05T07:56:11.114 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-11-05T07:56:11.114 INFO:teuthology.orchestra.run.smithi052.stdout: Package Arch Version Repository Size 2023-11-05T07:56:11.114 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-11-05T07:56:11.115 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2023-11-05T07:56:11.115 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-test x86_64 2:18.0.0-6776.g420cd129.el9 ceph 41 M 2023-11-05T07:56:11.115 INFO:teuthology.orchestra.run.smithi052.stdout:Installing dependencies: 2023-11-05T07:56:11.115 INFO:teuthology.orchestra.run.smithi052.stdout: jq x86_64 1.6-15.el9 appstream 187 k 2023-11-05T07:56:11.116 INFO:teuthology.orchestra.run.smithi052.stdout: libcephsqlite x86_64 2:18.0.0-6776.g420cd129.el9 ceph 164 k 2023-11-05T07:56:11.116 INFO:teuthology.orchestra.run.smithi052.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-11-05T07:56:11.116 INFO:teuthology.orchestra.run.smithi052.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-11-05T07:56:11.116 INFO:teuthology.orchestra.run.smithi052.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-11-05T07:56:11.116 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T07:56:11.117 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2023-11-05T07:56:11.117 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-11-05T07:56:11.117 INFO:teuthology.orchestra.run.smithi052.stdout:Install 6 Packages 2023-11-05T07:56:11.117 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T07:56:11.118 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 42 M 2023-11-05T07:56:11.118 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 173 M 2023-11-05T07:56:11.119 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2023-11-05T07:56:11.313 INFO:teuthology.orchestra.run.smithi052.stdout:(1/6): oniguruma-6.9.6-1.el9.5.x86_64.rpm 1.4 MB/s | 217 kB 00:00 2023-11-05T07:56:11.355 INFO:teuthology.orchestra.run.smithi052.stdout:(2/6): socat-1.7.4.1-5.el9.x86_64.rpm 7.2 MB/s | 300 kB 00:00 2023-11-05T07:56:11.388 INFO:teuthology.orchestra.run.smithi052.stdout:(3/6): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.8 MB/s | 63 kB 00:00 2023-11-05T07:56:11.517 INFO:teuthology.orchestra.run.smithi156.stdout:(5/6): jq-1.6-15.el9.x86_64.rpm 335 kB/s | 187 kB 00:00 2023-11-05T07:56:11.538 INFO:teuthology.orchestra.run.smithi052.stdout:(4/6): libcephsqlite-18.0.0-6776.g420cd129.el9. 434 kB/s | 164 kB 00:00 2023-11-05T07:56:11.889 INFO:teuthology.orchestra.run.smithi052.stdout:(5/6): jq-1.6-15.el9.x86_64.rpm 373 kB/s | 187 kB 00:00 2023-11-05T07:56:13.967 INFO:teuthology.orchestra.run.smithi156.stdout:(6/6): ceph-test-18.0.0-6776.g420cd129.el9.x86_ 13 MB/s | 41 MB 00:03 2023-11-05T07:56:13.972 INFO:teuthology.orchestra.run.smithi156.stdout:-------------------------------------------------------------------------------- 2023-11-05T07:56:13.972 INFO:teuthology.orchestra.run.smithi156.stdout:Total 9.4 MB/s | 42 MB 00:04 2023-11-05T07:56:13.986 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2023-11-05T07:56:14.007 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction check succeeded. 2023-11-05T07:56:14.007 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2023-11-05T07:56:14.372 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded. 2023-11-05T07:56:14.373 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2023-11-05T07:56:14.639 INFO:teuthology.orchestra.run.smithi052.stdout:(6/6): ceph-test-18.0.0-6776.g420cd129.el9.x86_ 12 MB/s | 41 MB 00:03 2023-11-05T07:56:14.642 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2023-11-05T07:56:14.642 INFO:teuthology.orchestra.run.smithi052.stdout:Total 12 MB/s | 42 MB 00:03 2023-11-05T07:56:14.657 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2023-11-05T07:56:14.679 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2023-11-05T07:56:14.680 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2023-11-05T07:56:14.946 INFO:teuthology.orchestra.run.smithi156.stdout: Preparing : 1/1 2023-11-05T07:56:15.021 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/6 2023-11-05T07:56:15.055 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2023-11-05T07:56:15.056 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2023-11-05T07:56:15.068 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/6 2023-11-05T07:56:15.100 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 3/6 2023-11-05T07:56:15.146 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : jq-1.6-15.el9.x86_64 4/6 2023-11-05T07:56:15.170 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libcephsqlite-2:18.0.0-6776.g420cd129.el9.x86_64 5/6 2023-11-05T07:56:15.634 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2023-11-05T07:56:15.718 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/6 2023-11-05T07:56:15.756 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/6 2023-11-05T07:56:15.788 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 3/6 2023-11-05T07:56:15.853 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : jq-1.6-15.el9.x86_64 4/6 2023-11-05T07:56:15.884 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libcephsqlite-2:18.0.0-6776.g420cd129.el9.x86_64 5/6 2023-11-05T07:56:19.277 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6776.g420cd129.el9.x86_64 5/6 2023-11-05T07:56:19.354 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-test-2:18.0.0-6776.g420cd129.el9.x86_64 6/6 2023-11-05T07:56:19.982 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6776.g420cd129.el9.x86_64 5/6 2023-11-05T07:56:20.060 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-test-2:18.0.0-6776.g420cd129.el9.x86_64 6/6 2023-11-05T07:56:21.549 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-test-2:18.0.0-6776.g420cd129.el9.x86_64 6/6 2023-11-05T07:56:21.549 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-test-2:18.0.0-6776.g420cd129.el9.x86_64 1/6 2023-11-05T07:56:21.549 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libcephsqlite-2:18.0.0-6776.g420cd129.el9.x86_64 2/6 2023-11-05T07:56:21.550 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 3/6 2023-11-05T07:56:21.550 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 4/6 2023-11-05T07:56:21.550 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/6 2023-11-05T07:56:21.929 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : jq-1.6-15.el9.x86_64 6/6 2023-11-05T07:56:21.929 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T07:56:21.929 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2023-11-05T07:56:21.930 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-test-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-05T07:56:21.930 INFO:teuthology.orchestra.run.smithi156.stdout: jq-1.6-15.el9.x86_64 2023-11-05T07:56:21.930 INFO:teuthology.orchestra.run.smithi156.stdout: libcephsqlite-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-05T07:56:21.930 INFO:teuthology.orchestra.run.smithi156.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-11-05T07:56:21.930 INFO:teuthology.orchestra.run.smithi156.stdout: socat-1.7.4.1-5.el9.x86_64 2023-11-05T07:56:21.931 INFO:teuthology.orchestra.run.smithi156.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-11-05T07:56:21.931 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T07:56:21.931 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2023-11-05T07:56:22.078 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-test-2:18.0.0-6776.g420cd129.el9.x86_64 6/6 2023-11-05T07:56:22.079 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-test-2:18.0.0-6776.g420cd129.el9.x86_64 1/6 2023-11-05T07:56:22.079 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libcephsqlite-2:18.0.0-6776.g420cd129.el9.x86_64 2/6 2023-11-05T07:56:22.079 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 3/6 2023-11-05T07:56:22.079 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 4/6 2023-11-05T07:56:22.079 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/6 2023-11-05T07:56:22.229 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum -y install ceph 2023-11-05T07:56:22.422 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : jq-1.6-15.el9.x86_64 6/6 2023-11-05T07:56:22.422 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T07:56:22.423 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2023-11-05T07:56:22.423 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-test-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-05T07:56:22.423 INFO:teuthology.orchestra.run.smithi052.stdout: jq-1.6-15.el9.x86_64 2023-11-05T07:56:22.423 INFO:teuthology.orchestra.run.smithi052.stdout: libcephsqlite-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-05T07:56:22.423 INFO:teuthology.orchestra.run.smithi052.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-11-05T07:56:22.424 INFO:teuthology.orchestra.run.smithi052.stdout: socat-1.7.4.1-5.el9.x86_64 2023-11-05T07:56:22.424 INFO:teuthology.orchestra.run.smithi052.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-11-05T07:56:22.424 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T07:56:22.424 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2023-11-05T07:56:22.741 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install ceph 2023-11-05T07:56:22.788 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:00:43 ago on Sun 05 Nov 2023 07:55:39 AM UTC. 2023-11-05T07:56:22.932 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2023-11-05T07:56:22.935 INFO:teuthology.orchestra.run.smithi156.stdout:========================================================================================= 2023-11-05T07:56:22.935 INFO:teuthology.orchestra.run.smithi156.stdout: Package Arch Version Repository Size 2023-11-05T07:56:22.935 INFO:teuthology.orchestra.run.smithi156.stdout:========================================================================================= 2023-11-05T07:56:22.935 INFO:teuthology.orchestra.run.smithi156.stdout:Installing: 2023-11-05T07:56:22.935 INFO:teuthology.orchestra.run.smithi156.stdout: ceph x86_64 2:18.0.0-6776.g420cd129.el9 ceph 6.5 k 2023-11-05T07:56:22.936 INFO:teuthology.orchestra.run.smithi156.stdout:Installing dependencies: 2023-11-05T07:56:22.936 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mds x86_64 2:18.0.0-6776.g420cd129.el9 ceph 2.1 M 2023-11-05T07:56:22.936 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr x86_64 2:18.0.0-6776.g420cd129.el9 ceph 1.5 M 2023-11-05T07:56:22.936 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6776.g420cd129.el9 ceph-noarch 243 k 2023-11-05T07:56:22.936 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mon x86_64 2:18.0.0-6776.g420cd129.el9 ceph 4.4 M 2023-11-05T07:56:22.937 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-osd x86_64 2:18.0.0-6776.g420cd129.el9 ceph 18 M 2023-11-05T07:56:22.937 INFO:teuthology.orchestra.run.smithi156.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-11-05T07:56:22.937 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-11-05T07:56:22.937 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-11-05T07:56:22.937 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-11-05T07:56:22.938 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2023-11-05T07:56:22.938 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-11-05T07:56:22.938 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-11-05T07:56:22.938 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-11-05T07:56:22.938 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-11-05T07:56:22.939 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-11-05T07:56:22.939 INFO:teuthology.orchestra.run.smithi156.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-11-05T07:56:22.939 INFO:teuthology.orchestra.run.smithi156.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-11-05T07:56:22.939 INFO:teuthology.orchestra.run.smithi156.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-11-05T07:56:22.939 INFO:teuthology.orchestra.run.smithi156.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-11-05T07:56:22.940 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-11-05T07:56:22.940 INFO:teuthology.orchestra.run.smithi156.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-11-05T07:56:22.940 INFO:teuthology.orchestra.run.smithi156.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-11-05T07:56:22.940 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-11-05T07:56:22.940 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-11-05T07:56:22.941 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2023-11-05T07:56:22.941 INFO:teuthology.orchestra.run.smithi156.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-11-05T07:56:22.941 INFO:teuthology.orchestra.run.smithi156.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-11-05T07:56:22.941 INFO:teuthology.orchestra.run.smithi156.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-11-05T07:56:22.941 INFO:teuthology.orchestra.run.smithi156.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-11-05T07:56:22.941 INFO:teuthology.orchestra.run.smithi156.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-11-05T07:56:22.942 INFO:teuthology.orchestra.run.smithi156.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-11-05T07:56:22.942 INFO:teuthology.orchestra.run.smithi156.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-11-05T07:56:22.942 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T07:56:22.942 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2023-11-05T07:56:22.942 INFO:teuthology.orchestra.run.smithi156.stdout:========================================================================================= 2023-11-05T07:56:22.943 INFO:teuthology.orchestra.run.smithi156.stdout:Install 33 Packages 2023-11-05T07:56:22.943 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T07:56:22.943 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 30 M 2023-11-05T07:56:22.944 INFO:teuthology.orchestra.run.smithi156.stdout:Installed size: 110 M 2023-11-05T07:56:22.944 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading Packages: 2023-11-05T07:56:23.312 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:00:41 ago on Sun 05 Nov 2023 07:55:42 AM UTC. 2023-11-05T07:56:23.461 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2023-11-05T07:56:23.464 INFO:teuthology.orchestra.run.smithi052.stdout:========================================================================================= 2023-11-05T07:56:23.464 INFO:teuthology.orchestra.run.smithi052.stdout: Package Arch Version Repository Size 2023-11-05T07:56:23.464 INFO:teuthology.orchestra.run.smithi052.stdout:========================================================================================= 2023-11-05T07:56:23.464 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2023-11-05T07:56:23.464 INFO:teuthology.orchestra.run.smithi052.stdout: ceph x86_64 2:18.0.0-6776.g420cd129.el9 ceph 6.5 k 2023-11-05T07:56:23.465 INFO:teuthology.orchestra.run.smithi052.stdout:Installing dependencies: 2023-11-05T07:56:23.465 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mds x86_64 2:18.0.0-6776.g420cd129.el9 ceph 2.1 M 2023-11-05T07:56:23.465 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr x86_64 2:18.0.0-6776.g420cd129.el9 ceph 1.5 M 2023-11-05T07:56:23.465 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6776.g420cd129.el9 ceph-noarch 243 k 2023-11-05T07:56:23.465 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mon x86_64 2:18.0.0-6776.g420cd129.el9 ceph 4.4 M 2023-11-05T07:56:23.466 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-osd x86_64 2:18.0.0-6776.g420cd129.el9 ceph 18 M 2023-11-05T07:56:23.466 INFO:teuthology.orchestra.run.smithi052.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-11-05T07:56:23.466 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-11-05T07:56:23.466 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-11-05T07:56:23.466 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-11-05T07:56:23.467 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2023-11-05T07:56:23.467 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-11-05T07:56:23.467 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-11-05T07:56:23.467 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-11-05T07:56:23.467 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-11-05T07:56:23.468 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-11-05T07:56:23.468 INFO:teuthology.orchestra.run.smithi052.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-11-05T07:56:23.468 INFO:teuthology.orchestra.run.smithi052.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-11-05T07:56:23.468 INFO:teuthology.orchestra.run.smithi052.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-11-05T07:56:23.469 INFO:teuthology.orchestra.run.smithi052.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-11-05T07:56:23.469 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-11-05T07:56:23.469 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-11-05T07:56:23.469 INFO:teuthology.orchestra.run.smithi052.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-11-05T07:56:23.469 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-11-05T07:56:23.469 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-11-05T07:56:23.470 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2023-11-05T07:56:23.470 INFO:teuthology.orchestra.run.smithi052.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-11-05T07:56:23.470 INFO:teuthology.orchestra.run.smithi052.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-11-05T07:56:23.470 INFO:teuthology.orchestra.run.smithi052.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-11-05T07:56:23.470 INFO:teuthology.orchestra.run.smithi052.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-11-05T07:56:23.471 INFO:teuthology.orchestra.run.smithi052.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-11-05T07:56:23.471 INFO:teuthology.orchestra.run.smithi052.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-11-05T07:56:23.471 INFO:teuthology.orchestra.run.smithi052.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-11-05T07:56:23.471 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T07:56:23.471 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2023-11-05T07:56:23.472 INFO:teuthology.orchestra.run.smithi052.stdout:========================================================================================= 2023-11-05T07:56:23.472 INFO:teuthology.orchestra.run.smithi052.stdout:Install 33 Packages 2023-11-05T07:56:23.472 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T07:56:23.473 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 30 M 2023-11-05T07:56:23.474 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 110 M 2023-11-05T07:56:23.474 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2023-11-05T07:56:23.631 INFO:teuthology.orchestra.run.smithi156.stdout:(1/33): ceph-18.0.0-6776.g420cd129.el9.x86_64.r 31 kB/s | 6.5 kB 00:00 2023-11-05T07:56:23.738 INFO:teuthology.orchestra.run.smithi156.stdout:(2/33): ceph-mgr-18.0.0-6776.g420cd129.el9.x86_ 4.6 MB/s | 1.5 MB 00:00 2023-11-05T07:56:24.331 INFO:teuthology.orchestra.run.smithi052.stdout:(1/33): ceph-18.0.0-6776.g420cd129.el9.x86_64.r 22 kB/s | 6.5 kB 00:00 2023-11-05T07:56:24.397 INFO:teuthology.orchestra.run.smithi156.stdout:(3/33): ceph-mds-18.0.0-6776.g420cd129.el9.x86_ 2.1 MB/s | 2.1 MB 00:00 2023-11-05T07:56:24.513 INFO:teuthology.orchestra.run.smithi156.stdout:(4/33): ceph-mgr-modules-core-18.0.0-6776.g420c 2.0 MB/s | 243 kB 00:00 2023-11-05T07:56:24.614 INFO:teuthology.orchestra.run.smithi156.stdout:(5/33): python3-mako-1.1.4-6.el9.noarch.rpm 1.4 MB/s | 144 kB 00:00 2023-11-05T07:56:24.647 INFO:teuthology.orchestra.run.smithi156.stdout:(6/33): python3-markupsafe-1.1.1-12.el9.x86_64. 945 kB/s | 32 kB 00:00 2023-11-05T07:56:24.681 INFO:teuthology.orchestra.run.smithi156.stdout:(7/33): python3-toml-0.10.2-6.el9.noarch.rpm 1.1 MB/s | 39 kB 00:00 2023-11-05T07:56:24.723 INFO:teuthology.orchestra.run.smithi156.stdout:(8/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.6 MB/s | 241 kB 00:00 2023-11-05T07:56:24.756 INFO:teuthology.orchestra.run.smithi156.stdout:(9/33): python3-ply-3.11-14.el9.noarch.rpm 3.0 MB/s | 103 kB 00:00 2023-11-05T07:56:24.790 INFO:teuthology.orchestra.run.smithi156.stdout:(10/33): python3-pycparser-2.20-6.el9.noarch.rp 3.6 MB/s | 124 kB 00:00 2023-11-05T07:56:24.824 INFO:teuthology.orchestra.run.smithi156.stdout:(11/33): python3-requests-2.25.1-7.el9.noarch.r 3.3 MB/s | 113 kB 00:00 2023-11-05T07:56:24.856 INFO:teuthology.orchestra.run.smithi052.stdout:(2/33): ceph-mon-18.0.0-6776.g420cd129.el9.x86_ 8.3 MB/s | 4.4 MB 00:00 2023-11-05T07:56:24.931 INFO:teuthology.orchestra.run.smithi052.stdout:(3/33): ceph-mgr-18.0.0-6776.g420cd129.el9.x86_ 1.6 MB/s | 1.5 MB 00:00 2023-11-05T07:56:24.981 INFO:teuthology.orchestra.run.smithi052.stdout:(4/33): ceph-mds-18.0.0-6776.g420cd129.el9.x86_ 2.2 MB/s | 2.1 MB 00:00 2023-11-05T07:56:24.999 INFO:teuthology.orchestra.run.smithi156.stdout:(12/33): ceph-osd-18.0.0-6776.g420cd129.el9.x86 14 MB/s | 18 MB 00:01 2023-11-05T07:56:25.024 INFO:teuthology.orchestra.run.smithi156.stdout:(13/33): python3-urllib3-1.26.5-4.el9.noarch.rp 932 kB/s | 187 kB 00:00 2023-11-05T07:56:25.056 INFO:teuthology.orchestra.run.smithi052.stdout:(5/33): ceph-mgr-modules-core-18.0.0-6776.g420c 1.9 MB/s | 243 kB 00:00 2023-11-05T07:56:25.091 INFO:teuthology.orchestra.run.smithi156.stdout:(14/33): ceph-mon-18.0.0-6776.g420cd129.el9.x86 3.0 MB/s | 4.4 MB 00:01 2023-11-05T07:56:25.098 INFO:teuthology.orchestra.run.smithi052.stdout:(6/33): python3-markupsafe-1.1.1-12.el9.x86_64. 781 kB/s | 32 kB 00:00 2023-11-05T07:56:25.124 INFO:teuthology.orchestra.run.smithi052.stdout:(7/33): python3-mako-1.1.4-6.el9.noarch.rpm 1.0 MB/s | 144 kB 00:00 2023-11-05T07:56:25.149 INFO:teuthology.orchestra.run.smithi052.stdout:(8/33): python3-toml-0.10.2-6.el9.noarch.rpm 774 kB/s | 39 kB 00:00 2023-11-05T07:56:25.158 INFO:teuthology.orchestra.run.smithi156.stdout:(15/33): python3-pytz-2021.1-5.el9.noarch.rpm 382 kB/s | 51 kB 00:00 2023-11-05T07:56:25.174 INFO:teuthology.orchestra.run.smithi052.stdout:(9/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.7 MB/s | 241 kB 00:00 2023-11-05T07:56:25.200 INFO:teuthology.orchestra.run.smithi052.stdout:(10/33): python3-ply-3.11-14.el9.noarch.rpm 2.0 MB/s | 103 kB 00:00 2023-11-05T07:56:25.225 INFO:teuthology.orchestra.run.smithi052.stdout:(11/33): python3-pycparser-2.20-6.el9.noarch.rp 2.4 MB/s | 124 kB 00:00 2023-11-05T07:56:25.250 INFO:teuthology.orchestra.run.smithi052.stdout:(12/33): python3-requests-2.25.1-7.el9.noarch.r 2.2 MB/s | 113 kB 00:00 2023-11-05T07:56:25.275 INFO:teuthology.orchestra.run.smithi052.stdout:(13/33): python3-urllib3-1.26.5-4.el9.noarch.rp 3.6 MB/s | 187 kB 00:00 2023-11-05T07:56:25.392 INFO:teuthology.orchestra.run.smithi052.stdout:(14/33): python3-cryptography-36.0.1-4.el9.x86_ 8.7 MB/s | 1.2 MB 00:00 2023-11-05T07:56:25.418 INFO:teuthology.orchestra.run.smithi052.stdout:(15/33): python3-pytz-2021.1-5.el9.noarch.rpm 359 kB/s | 51 kB 00:00 2023-11-05T07:56:25.450 INFO:teuthology.orchestra.run.smithi156.stdout:(16/33): python3-cryptography-36.0.1-4.el9.x86_ 2.7 MB/s | 1.2 MB 00:00 2023-11-05T07:56:25.525 INFO:teuthology.orchestra.run.smithi156.stdout:(17/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 100 kB/s | 43 kB 00:00 2023-11-05T07:56:25.560 INFO:teuthology.orchestra.run.smithi052.stdout:(16/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.2 MB/s | 172 kB 00:00 2023-11-05T07:56:25.585 INFO:teuthology.orchestra.run.smithi052.stdout:(17/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 226 kB/s | 43 kB 00:00 2023-11-05T07:56:25.634 INFO:teuthology.orchestra.run.smithi156.stdout:(18/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 98 kB/s | 11 kB 00:00 2023-11-05T07:56:25.743 INFO:teuthology.orchestra.run.smithi156.stdout:(19/33): python3-jaraco-classes-3.2.1-5.el9.noa 165 kB/s | 18 kB 00:00 2023-11-05T07:56:25.760 INFO:teuthology.orchestra.run.smithi052.stdout:(18/33): ceph-osd-18.0.0-6776.g420cd129.el9.x86 20 MB/s | 18 MB 00:00 2023-11-05T07:56:25.776 INFO:teuthology.orchestra.run.smithi156.stdout:(20/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 278 kB/s | 172 kB 00:00 2023-11-05T07:56:25.786 INFO:teuthology.orchestra.run.smithi052.stdout:(19/33): python3-cherrypy-18.6.1-2.el9.noarch.r 1.6 MB/s | 358 kB 00:00 2023-11-05T07:56:25.811 INFO:teuthology.orchestra.run.smithi052.stdout:(20/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 47 kB/s | 11 kB 00:00 2023-11-05T07:56:25.836 INFO:teuthology.orchestra.run.smithi052.stdout:(21/33): python3-jaraco-classes-3.2.1-5.el9.noa 236 kB/s | 18 kB 00:00 2023-11-05T07:56:25.843 INFO:teuthology.orchestra.run.smithi156.stdout:(21/33): python3-jaraco-collections-3.0.0-8.el9 231 kB/s | 23 kB 00:00 2023-11-05T07:56:25.861 INFO:teuthology.orchestra.run.smithi052.stdout:(22/33): python3-jaraco-collections-3.0.0-8.el9 462 kB/s | 23 kB 00:00 2023-11-05T07:56:25.877 INFO:teuthology.orchestra.run.smithi156.stdout:(22/33): python3-jaraco-functools-3.5.0-2.el9.n 194 kB/s | 19 kB 00:00 2023-11-05T07:56:25.886 INFO:teuthology.orchestra.run.smithi052.stdout:(23/33): python3-jaraco-functools-3.5.0-2.el9.n 259 kB/s | 19 kB 00:00 2023-11-05T07:56:25.912 INFO:teuthology.orchestra.run.smithi052.stdout:(24/33): python3-jaraco-text-3.2.0-6.el9.noarch 261 kB/s | 20 kB 00:00 2023-11-05T07:56:25.937 INFO:teuthology.orchestra.run.smithi052.stdout:(25/33): python3-logutils-0.3.5-21.el9.noarch.r 927 kB/s | 46 kB 00:00 2023-11-05T07:56:25.944 INFO:teuthology.orchestra.run.smithi156.stdout:(23/33): python3-jaraco-text-3.2.0-6.el9.noarch 196 kB/s | 20 kB 00:00 2023-11-05T07:56:25.962 INFO:teuthology.orchestra.run.smithi052.stdout:(26/33): python3-more-itertools-8.12.0-2.el9.no 1.0 MB/s | 79 kB 00:00 2023-11-05T07:56:25.977 INFO:teuthology.orchestra.run.smithi156.stdout:(24/33): python3-logutils-0.3.5-21.el9.noarch.r 461 kB/s | 46 kB 00:00 2023-11-05T07:56:25.987 INFO:teuthology.orchestra.run.smithi052.stdout:(27/33): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2023-11-05T07:56:26.012 INFO:teuthology.orchestra.run.smithi052.stdout:(28/33): python3-portend-3.1.0-2.el9.noarch.rpm 333 kB/s | 16 kB 00:00 2023-11-05T07:56:26.037 INFO:teuthology.orchestra.run.smithi052.stdout:(29/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.2 MB/s | 90 kB 00:00 2023-11-05T07:56:26.061 INFO:teuthology.orchestra.run.smithi156.stdout:(25/33): python3-cherrypy-18.6.1-2.el9.noarch.r 587 kB/s | 358 kB 00:00 2023-11-05T07:56:26.063 INFO:teuthology.orchestra.run.smithi052.stdout:(30/33): python3-tempora-5.0.0-2.el9.noarch.rpm 478 kB/s | 36 kB 00:00 2023-11-05T07:56:26.088 INFO:teuthology.orchestra.run.smithi052.stdout:(31/33): python3-webob-1.8.7-6.el9.noarch.rpm 4.5 MB/s | 230 kB 00:00 2023-11-05T07:56:26.113 INFO:teuthology.orchestra.run.smithi052.stdout:(32/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 5.6 MB/s | 427 kB 00:00 2023-11-05T07:56:26.120 INFO:teuthology.orchestra.run.smithi156.stdout:(26/33): python3-more-itertools-8.12.0-2.el9.no 449 kB/s | 79 kB 00:00 2023-11-05T07:56:26.130 INFO:teuthology.orchestra.run.smithi052.stdout:(33/33): python3-zc-lockfile-2.0-10.el9.noarch. 305 kB/s | 20 kB 00:00 2023-11-05T07:56:26.136 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2023-11-05T07:56:26.136 INFO:teuthology.orchestra.run.smithi052.stdout:Total 11 MB/s | 30 MB 00:02 2023-11-05T07:56:26.170 INFO:teuthology.orchestra.run.smithi156.stdout:(27/33): python3-pecan-1.4.2-3.el9.noarch.rpm 1.4 MB/s | 272 kB 00:00 2023-11-05T07:56:26.171 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2023-11-05T07:56:26.187 INFO:teuthology.orchestra.run.smithi156.stdout:(28/33): python3-portend-3.1.0-2.el9.noarch.rpm 130 kB/s | 16 kB 00:00 2023-11-05T07:56:26.214 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2023-11-05T07:56:26.214 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2023-11-05T07:56:26.221 INFO:teuthology.orchestra.run.smithi156.stdout:(29/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 893 kB/s | 90 kB 00:00 2023-11-05T07:56:26.276 INFO:teuthology.orchestra.run.smithi156.stdout:(30/33): python3-tempora-5.0.0-2.el9.noarch.rpm 339 kB/s | 36 kB 00:00 2023-11-05T07:56:26.301 INFO:teuthology.orchestra.run.smithi156.stdout:(31/33): python3-webob-1.8.7-6.el9.noarch.rpm 2.0 MB/s | 230 kB 00:00 2023-11-05T07:56:26.376 INFO:teuthology.orchestra.run.smithi156.stdout:(32/33): python3-zc-lockfile-2.0-10.el9.noarch. 200 kB/s | 20 kB 00:00 2023-11-05T07:56:26.401 INFO:teuthology.orchestra.run.smithi156.stdout:(33/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 2.3 MB/s | 427 kB 00:00 2023-11-05T07:56:26.408 INFO:teuthology.orchestra.run.smithi156.stdout:-------------------------------------------------------------------------------- 2023-11-05T07:56:26.408 INFO:teuthology.orchestra.run.smithi156.stdout:Total 8.6 MB/s | 30 MB 00:03 2023-11-05T07:56:26.442 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2023-11-05T07:56:26.482 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction check succeeded. 2023-11-05T07:56:26.482 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2023-11-05T07:56:26.590 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2023-11-05T07:56:26.591 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2023-11-05T07:56:26.849 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded. 2023-11-05T07:56:26.849 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2023-11-05T07:56:27.875 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2023-11-05T07:56:27.933 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2023-11-05T07:56:27.966 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2023-11-05T07:56:28.007 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2023-11-05T07:56:28.109 INFO:teuthology.orchestra.run.smithi156.stdout: Preparing : 1/1 2023-11-05T07:56:28.110 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2023-11-05T07:56:28.171 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2023-11-05T07:56:28.197 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2023-11-05T07:56:28.203 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2023-11-05T07:56:28.236 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2023-11-05T07:56:28.243 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 6/33 2023-11-05T07:56:28.289 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2023-11-05T07:56:28.328 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2023-11-05T07:56:28.368 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 8/33 2023-11-05T07:56:28.406 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2023-11-05T07:56:28.420 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 9/33 2023-11-05T07:56:28.447 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 6/33 2023-11-05T07:56:28.458 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 10/33 2023-11-05T07:56:28.485 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2023-11-05T07:56:28.516 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-ply-3.11-14.el9.noarch 11/33 2023-11-05T07:56:28.553 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 8/33 2023-11-05T07:56:28.576 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 12/33 2023-11-05T07:56:28.615 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 9/33 2023-11-05T07:56:28.653 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 10/33 2023-11-05T07:56:28.702 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-ply-3.11-14.el9.noarch 11/33 2023-11-05T07:56:28.758 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 12/33 2023-11-05T07:56:28.784 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 13/33 2023-11-05T07:56:28.835 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 14/33 2023-11-05T07:56:28.883 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 15/33 2023-11-05T07:56:28.916 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 16/33 2023-11-05T07:56:28.950 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 13/33 2023-11-05T07:56:28.954 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 17/33 2023-11-05T07:56:29.000 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 14/33 2023-11-05T07:56:29.024 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 18/33 2023-11-05T07:56:29.045 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 15/33 2023-11-05T07:56:29.056 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 19/33 2023-11-05T07:56:29.089 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 20/33 2023-11-05T07:56:29.090 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 16/33 2023-11-05T07:56:29.120 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 17/33 2023-11-05T07:56:29.131 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 21/33 2023-11-05T07:56:29.165 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 22/33 2023-11-05T07:56:29.196 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 18/33 2023-11-05T07:56:29.230 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 19/33 2023-11-05T07:56:29.258 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 23/33 2023-11-05T07:56:29.272 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 20/33 2023-11-05T07:56:29.298 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 24/33 2023-11-05T07:56:29.322 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 21/33 2023-11-05T07:56:29.356 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 22/33 2023-11-05T07:56:29.379 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 25/33 2023-11-05T07:56:29.447 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 23/33 2023-11-05T07:56:29.501 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 24/33 2023-11-05T07:56:29.521 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 26/33 2023-11-05T07:56:29.577 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 25/33 2023-11-05T07:56:29.662 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 27/33 2023-11-05T07:56:29.715 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 26/33 2023-11-05T07:56:29.822 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6776.g420cd129.el9. 28/33 2023-11-05T07:56:29.832 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 27/33 2023-11-05T07:56:29.850 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-2:18.0.0-6776.g420cd129.el9.x86_64 29/33 2023-11-05T07:56:29.876 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6776.g420cd129.el9.x86_64 29/33 2023-11-05T07:56:29.876 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-05T07:56:29.876 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-11-05T07:56:29.876 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-11-05T07:56:29.876 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-11-05T07:56:29.877 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T07:56:30.003 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6776.g420cd129.el9. 28/33 2023-11-05T07:56:30.034 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-mgr-2:18.0.0-6776.g420cd129.el9.x86_64 29/33 2023-11-05T07:56:30.058 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6776.g420cd129.el9.x86_64 29/33 2023-11-05T07:56:30.059 INFO:teuthology.orchestra.run.smithi156.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-05T07:56:30.059 INFO:teuthology.orchestra.run.smithi156.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-11-05T07:56:30.059 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-11-05T07:56:30.059 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-11-05T07:56:30.060 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T07:56:31.493 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-osd-2:18.0.0-6776.g420cd129.el9.x86_64 30/33 2023-11-05T07:56:31.524 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-osd-2:18.0.0-6776.g420cd129.el9.x86_64 30/33 2023-11-05T07:56:31.524 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-05T07:56:31.524 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-11-05T07:56:31.524 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-11-05T07:56:31.525 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-11-05T07:56:31.525 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T07:56:31.644 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-osd-2:18.0.0-6776.g420cd129.el9.x86_64 30/33 2023-11-05T07:56:31.672 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-osd-2:18.0.0-6776.g420cd129.el9.x86_64 30/33 2023-11-05T07:56:31.672 INFO:teuthology.orchestra.run.smithi156.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-05T07:56:31.672 INFO:teuthology.orchestra.run.smithi156.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-11-05T07:56:31.672 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-11-05T07:56:31.673 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-11-05T07:56:31.673 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T07:56:31.986 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mon-2:18.0.0-6776.g420cd129.el9.x86_64 31/33 2023-11-05T07:56:32.010 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mon-2:18.0.0-6776.g420cd129.el9.x86_64 31/33 2023-11-05T07:56:32.010 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-05T07:56:32.011 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-11-05T07:56:32.011 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-11-05T07:56:32.011 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-11-05T07:56:32.011 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T07:56:32.120 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-mon-2:18.0.0-6776.g420cd129.el9.x86_64 31/33 2023-11-05T07:56:32.143 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-mon-2:18.0.0-6776.g420cd129.el9.x86_64 31/33 2023-11-05T07:56:32.143 INFO:teuthology.orchestra.run.smithi156.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-05T07:56:32.143 INFO:teuthology.orchestra.run.smithi156.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-11-05T07:56:32.143 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-11-05T07:56:32.143 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-11-05T07:56:32.144 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T07:56:32.220 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mds-2:18.0.0-6776.g420cd129.el9.x86_64 32/33 2023-11-05T07:56:32.244 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mds-2:18.0.0-6776.g420cd129.el9.x86_64 32/33 2023-11-05T07:56:32.245 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-05T07:56:32.245 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-11-05T07:56:32.245 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-11-05T07:56:32.245 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-11-05T07:56:32.245 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T07:56:32.311 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-2:18.0.0-6776.g420cd129.el9.x86_64 33/33 2023-11-05T07:56:32.346 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-mds-2:18.0.0-6776.g420cd129.el9.x86_64 32/33 2023-11-05T07:56:32.368 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-mds-2:18.0.0-6776.g420cd129.el9.x86_64 32/33 2023-11-05T07:56:32.369 INFO:teuthology.orchestra.run.smithi156.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-05T07:56:32.369 INFO:teuthology.orchestra.run.smithi156.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-11-05T07:56:32.369 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-11-05T07:56:32.370 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-11-05T07:56:32.370 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T07:56:32.436 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-2:18.0.0-6776.g420cd129.el9.x86_64 33/33 2023-11-05T07:56:34.157 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-2:18.0.0-6776.g420cd129.el9.x86_64 33/33 2023-11-05T07:56:34.157 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-2:18.0.0-6776.g420cd129.el9.x86_64 1/33 2023-11-05T07:56:34.157 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mds-2:18.0.0-6776.g420cd129.el9.x86_64 2/33 2023-11-05T07:56:34.158 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-2:18.0.0-6776.g420cd129.el9.x86_64 3/33 2023-11-05T07:56:34.158 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mon-2:18.0.0-6776.g420cd129.el9.x86_64 4/33 2023-11-05T07:56:34.158 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-osd-2:18.0.0-6776.g420cd129.el9.x86_64 5/33 2023-11-05T07:56:34.158 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6776.g420cd129.el9. 6/33 2023-11-05T07:56:34.158 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 7/33 2023-11-05T07:56:34.159 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 8/33 2023-11-05T07:56:34.159 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 9/33 2023-11-05T07:56:34.159 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 10/33 2023-11-05T07:56:34.159 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-ply-3.11-14.el9.noarch 11/33 2023-11-05T07:56:34.160 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 12/33 2023-11-05T07:56:34.160 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 13/33 2023-11-05T07:56:34.160 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 14/33 2023-11-05T07:56:34.160 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 15/33 2023-11-05T07:56:34.160 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 16/33 2023-11-05T07:56:34.161 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2023-11-05T07:56:34.161 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2023-11-05T07:56:34.161 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2023-11-05T07:56:34.161 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2023-11-05T07:56:34.161 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2023-11-05T07:56:34.162 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2023-11-05T07:56:34.162 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2023-11-05T07:56:34.162 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2023-11-05T07:56:34.162 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2023-11-05T07:56:34.162 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2023-11-05T07:56:34.163 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2023-11-05T07:56:34.163 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2023-11-05T07:56:34.163 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2023-11-05T07:56:34.163 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2023-11-05T07:56:34.164 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 31/33 2023-11-05T07:56:34.164 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2023-11-05T07:56:34.194 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-2:18.0.0-6776.g420cd129.el9.x86_64 33/33 2023-11-05T07:56:34.194 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-2:18.0.0-6776.g420cd129.el9.x86_64 1/33 2023-11-05T07:56:34.195 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mds-2:18.0.0-6776.g420cd129.el9.x86_64 2/33 2023-11-05T07:56:34.195 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mgr-2:18.0.0-6776.g420cd129.el9.x86_64 3/33 2023-11-05T07:56:34.195 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mon-2:18.0.0-6776.g420cd129.el9.x86_64 4/33 2023-11-05T07:56:34.195 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-osd-2:18.0.0-6776.g420cd129.el9.x86_64 5/33 2023-11-05T07:56:34.196 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6776.g420cd129.el9. 6/33 2023-11-05T07:56:34.196 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 7/33 2023-11-05T07:56:34.196 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 8/33 2023-11-05T07:56:34.196 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 9/33 2023-11-05T07:56:34.196 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 10/33 2023-11-05T07:56:34.197 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-ply-3.11-14.el9.noarch 11/33 2023-11-05T07:56:34.197 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 12/33 2023-11-05T07:56:34.197 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 13/33 2023-11-05T07:56:34.197 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 14/33 2023-11-05T07:56:34.197 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 15/33 2023-11-05T07:56:34.198 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 16/33 2023-11-05T07:56:34.198 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2023-11-05T07:56:34.198 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2023-11-05T07:56:34.198 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2023-11-05T07:56:34.198 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2023-11-05T07:56:34.199 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2023-11-05T07:56:34.199 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2023-11-05T07:56:34.199 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2023-11-05T07:56:34.199 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2023-11-05T07:56:34.199 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2023-11-05T07:56:34.200 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2023-11-05T07:56:34.200 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2023-11-05T07:56:34.201 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2023-11-05T07:56:34.201 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2023-11-05T07:56:34.201 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2023-11-05T07:56:34.201 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 31/33 2023-11-05T07:56:34.202 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2023-11-05T07:56:35.168 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2023-11-05T07:56:35.169 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T07:56:35.169 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2023-11-05T07:56:35.169 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-05T07:56:35.169 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mds-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-05T07:56:35.170 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-05T07:56:35.170 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-modules-core-2:18.0.0-6776.g420cd129.el9.noarch 2023-11-05T07:56:35.170 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mon-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-05T07:56:35.170 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-osd-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-05T07:56:35.170 INFO:teuthology.orchestra.run.smithi052.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-11-05T07:56:35.171 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-11-05T07:56:35.171 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-11-05T07:56:35.171 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-11-05T07:56:35.171 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-11-05T07:56:35.171 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-11-05T07:56:35.172 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-11-05T07:56:35.172 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-11-05T07:56:35.172 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-11-05T07:56:35.172 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-11-05T07:56:35.172 INFO:teuthology.orchestra.run.smithi052.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-11-05T07:56:35.173 INFO:teuthology.orchestra.run.smithi052.stdout: python3-mako-1.1.4-6.el9.noarch 2023-11-05T07:56:35.173 INFO:teuthology.orchestra.run.smithi052.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-11-05T07:56:35.173 INFO:teuthology.orchestra.run.smithi052.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-11-05T07:56:35.173 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-11-05T07:56:35.173 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ply-3.11-14.el9.noarch 2023-11-05T07:56:35.174 INFO:teuthology.orchestra.run.smithi052.stdout: python3-portend-3.1.0-2.el9.noarch 2023-11-05T07:56:35.174 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-11-05T07:56:35.174 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pycparser-2.20-6.el9.noarch 2023-11-05T07:56:35.174 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pytz-2021.1-5.el9.noarch 2023-11-05T07:56:35.174 INFO:teuthology.orchestra.run.smithi052.stdout: python3-requests-2.25.1-7.el9.noarch 2023-11-05T07:56:35.175 INFO:teuthology.orchestra.run.smithi052.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-11-05T07:56:35.175 INFO:teuthology.orchestra.run.smithi052.stdout: python3-toml-0.10.2-6.el9.noarch 2023-11-05T07:56:35.175 INFO:teuthology.orchestra.run.smithi052.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-11-05T07:56:35.175 INFO:teuthology.orchestra.run.smithi052.stdout: python3-webob-1.8.7-6.el9.noarch 2023-11-05T07:56:35.175 INFO:teuthology.orchestra.run.smithi052.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-11-05T07:56:35.175 INFO:teuthology.orchestra.run.smithi052.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-11-05T07:56:35.176 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T07:56:35.176 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2023-11-05T07:56:35.253 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2023-11-05T07:56:35.253 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T07:56:35.254 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2023-11-05T07:56:35.254 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-05T07:56:35.254 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mds-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-05T07:56:35.254 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-05T07:56:35.254 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-modules-core-2:18.0.0-6776.g420cd129.el9.noarch 2023-11-05T07:56:35.255 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mon-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-05T07:56:35.255 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-osd-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-05T07:56:35.255 INFO:teuthology.orchestra.run.smithi156.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-11-05T07:56:35.255 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-11-05T07:56:35.256 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-11-05T07:56:35.256 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-11-05T07:56:35.256 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-11-05T07:56:35.256 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-11-05T07:56:35.257 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-11-05T07:56:35.257 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-11-05T07:56:35.257 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-11-05T07:56:35.257 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-11-05T07:56:35.258 INFO:teuthology.orchestra.run.smithi156.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-11-05T07:56:35.258 INFO:teuthology.orchestra.run.smithi156.stdout: python3-mako-1.1.4-6.el9.noarch 2023-11-05T07:56:35.258 INFO:teuthology.orchestra.run.smithi156.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-11-05T07:56:35.258 INFO:teuthology.orchestra.run.smithi156.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-11-05T07:56:35.258 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-11-05T07:56:35.259 INFO:teuthology.orchestra.run.smithi156.stdout: python3-ply-3.11-14.el9.noarch 2023-11-05T07:56:35.259 INFO:teuthology.orchestra.run.smithi156.stdout: python3-portend-3.1.0-2.el9.noarch 2023-11-05T07:56:35.259 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-11-05T07:56:35.259 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pycparser-2.20-6.el9.noarch 2023-11-05T07:56:35.259 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pytz-2021.1-5.el9.noarch 2023-11-05T07:56:35.260 INFO:teuthology.orchestra.run.smithi156.stdout: python3-requests-2.25.1-7.el9.noarch 2023-11-05T07:56:35.260 INFO:teuthology.orchestra.run.smithi156.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-11-05T07:56:35.260 INFO:teuthology.orchestra.run.smithi156.stdout: python3-toml-0.10.2-6.el9.noarch 2023-11-05T07:56:35.261 INFO:teuthology.orchestra.run.smithi156.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-11-05T07:56:35.261 INFO:teuthology.orchestra.run.smithi156.stdout: python3-webob-1.8.7-6.el9.noarch 2023-11-05T07:56:35.261 INFO:teuthology.orchestra.run.smithi156.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-11-05T07:56:35.261 INFO:teuthology.orchestra.run.smithi156.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-11-05T07:56:35.261 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T07:56:35.262 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2023-11-05T07:56:35.456 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install ceph-base 2023-11-05T07:56:35.605 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum -y install ceph-base 2023-11-05T07:56:36.035 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:00:54 ago on Sun 05 Nov 2023 07:55:42 AM UTC. 2023-11-05T07:56:36.130 INFO:teuthology.orchestra.run.smithi052.stdout:Package ceph-base-2:18.0.0-6776.g420cd129.el9.x86_64 is already installed. 2023-11-05T07:56:36.158 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:00:57 ago on Sun 05 Nov 2023 07:55:39 AM UTC. 2023-11-05T07:56:36.181 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2023-11-05T07:56:36.182 INFO:teuthology.orchestra.run.smithi052.stdout:Nothing to do. 2023-11-05T07:56:36.183 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2023-11-05T07:56:36.242 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install cephadm 2023-11-05T07:56:36.248 INFO:teuthology.orchestra.run.smithi156.stdout:Package ceph-base-2:18.0.0-6776.g420cd129.el9.x86_64 is already installed. 2023-11-05T07:56:36.297 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2023-11-05T07:56:36.298 INFO:teuthology.orchestra.run.smithi156.stdout:Nothing to do. 2023-11-05T07:56:36.299 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2023-11-05T07:56:36.364 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum -y install cephadm 2023-11-05T07:56:36.819 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:00:54 ago on Sun 05 Nov 2023 07:55:42 AM UTC. 2023-11-05T07:56:36.915 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:00:57 ago on Sun 05 Nov 2023 07:55:39 AM UTC. 2023-11-05T07:56:36.964 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2023-11-05T07:56:36.965 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-11-05T07:56:36.965 INFO:teuthology.orchestra.run.smithi052.stdout: Package Arch Version Repository Size 2023-11-05T07:56:36.966 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-11-05T07:56:36.966 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2023-11-05T07:56:36.966 INFO:teuthology.orchestra.run.smithi052.stdout: cephadm noarch 2:18.0.0-6776.g420cd129.el9 ceph-noarch 270 k 2023-11-05T07:56:36.966 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T07:56:36.967 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2023-11-05T07:56:36.967 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-11-05T07:56:36.967 INFO:teuthology.orchestra.run.smithi052.stdout:Install 1 Package 2023-11-05T07:56:36.967 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T07:56:36.967 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 270 k 2023-11-05T07:56:36.967 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 265 k 2023-11-05T07:56:36.968 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2023-11-05T07:56:37.054 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2023-11-05T07:56:37.055 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-05T07:56:37.055 INFO:teuthology.orchestra.run.smithi156.stdout: Package Arch Version Repository Size 2023-11-05T07:56:37.056 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-05T07:56:37.056 INFO:teuthology.orchestra.run.smithi156.stdout:Installing: 2023-11-05T07:56:37.056 INFO:teuthology.orchestra.run.smithi156.stdout: cephadm noarch 2:18.0.0-6776.g420cd129.el9 ceph-noarch 270 k 2023-11-05T07:56:37.056 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T07:56:37.056 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2023-11-05T07:56:37.057 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-05T07:56:37.057 INFO:teuthology.orchestra.run.smithi156.stdout:Install 1 Package 2023-11-05T07:56:37.057 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T07:56:37.057 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 270 k 2023-11-05T07:56:37.058 INFO:teuthology.orchestra.run.smithi156.stdout:Installed size: 265 k 2023-11-05T07:56:37.058 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading Packages: 2023-11-05T07:56:37.287 INFO:teuthology.orchestra.run.smithi156.stdout:cephadm-18.0.0-6776.g420cd129.el9.noarch.rpm 1.1 MB/s | 270 kB 00:00 2023-11-05T07:56:37.288 INFO:teuthology.orchestra.run.smithi156.stdout:-------------------------------------------------------------------------------- 2023-11-05T07:56:37.288 INFO:teuthology.orchestra.run.smithi156.stdout:Total 1.1 MB/s | 270 kB 00:00 2023-11-05T07:56:37.288 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2023-11-05T07:56:37.293 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction check succeeded. 2023-11-05T07:56:37.293 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2023-11-05T07:56:37.296 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded. 2023-11-05T07:56:37.296 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2023-11-05T07:56:37.367 INFO:teuthology.orchestra.run.smithi052.stdout:cephadm-18.0.0-6776.g420cd129.el9.noarch.rpm 674 kB/s | 270 kB 00:00 2023-11-05T07:56:37.368 INFO:teuthology.orchestra.run.smithi156.stdout: Preparing : 1/1 2023-11-05T07:56:37.368 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2023-11-05T07:56:37.368 INFO:teuthology.orchestra.run.smithi052.stdout:Total 671 kB/s | 270 kB 00:00 2023-11-05T07:56:37.369 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2023-11-05T07:56:37.373 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2023-11-05T07:56:37.374 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2023-11-05T07:56:37.377 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2023-11-05T07:56:37.377 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2023-11-05T07:56:37.453 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2023-11-05T07:56:37.800 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: cephadm-2:18.0.0-6776.g420cd129.el9.noarch 1/1 2023-11-05T07:56:37.891 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : cephadm-2:18.0.0-6776.g420cd129.el9.noarch 1/1 2023-11-05T07:56:37.933 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: cephadm-2:18.0.0-6776.g420cd129.el9.noarch 1/1 2023-11-05T07:56:38.024 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : cephadm-2:18.0.0-6776.g420cd129.el9.noarch 1/1 2023-11-05T07:56:38.254 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: cephadm-2:18.0.0-6776.g420cd129.el9.noarch 1/1 2023-11-05T07:56:38.360 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: cephadm-2:18.0.0-6776.g420cd129.el9.noarch 1/1 2023-11-05T07:56:38.560 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : cephadm-2:18.0.0-6776.g420cd129.el9.noarch 1/1 2023-11-05T07:56:38.561 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T07:56:38.561 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2023-11-05T07:56:38.561 INFO:teuthology.orchestra.run.smithi156.stdout: cephadm-2:18.0.0-6776.g420cd129.el9.noarch 2023-11-05T07:56:38.561 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T07:56:38.561 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2023-11-05T07:56:38.621 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : cephadm-2:18.0.0-6776.g420cd129.el9.noarch 1/1 2023-11-05T07:56:38.622 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T07:56:38.622 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2023-11-05T07:56:38.622 INFO:teuthology.orchestra.run.smithi052.stdout: cephadm-2:18.0.0-6776.g420cd129.el9.noarch 2023-11-05T07:56:38.622 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T07:56:38.622 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2023-11-05T07:56:38.807 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum -y install ceph-immutable-object-cache 2023-11-05T07:56:38.829 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install ceph-immutable-object-cache 2023-11-05T07:56:39.362 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:01:00 ago on Sun 05 Nov 2023 07:55:39 AM UTC. 2023-11-05T07:56:39.405 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:00:57 ago on Sun 05 Nov 2023 07:55:42 AM UTC. 2023-11-05T07:56:39.506 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2023-11-05T07:56:39.507 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-05T07:56:39.508 INFO:teuthology.orchestra.run.smithi156.stdout: Package Arch Version Repo Size 2023-11-05T07:56:39.508 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-05T07:56:39.508 INFO:teuthology.orchestra.run.smithi156.stdout:Installing: 2023-11-05T07:56:39.508 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6776.g420cd129.el9 ceph 142 k 2023-11-05T07:56:39.508 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T07:56:39.509 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2023-11-05T07:56:39.509 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-05T07:56:39.509 INFO:teuthology.orchestra.run.smithi156.stdout:Install 1 Package 2023-11-05T07:56:39.509 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T07:56:39.509 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 142 k 2023-11-05T07:56:39.510 INFO:teuthology.orchestra.run.smithi156.stdout:Installed size: 400 k 2023-11-05T07:56:39.510 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading Packages: 2023-11-05T07:56:39.551 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2023-11-05T07:56:39.552 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-11-05T07:56:39.552 INFO:teuthology.orchestra.run.smithi052.stdout: Package Arch Version Repo Size 2023-11-05T07:56:39.552 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-11-05T07:56:39.552 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2023-11-05T07:56:39.553 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6776.g420cd129.el9 ceph 142 k 2023-11-05T07:56:39.553 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T07:56:39.553 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2023-11-05T07:56:39.553 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-11-05T07:56:39.554 INFO:teuthology.orchestra.run.smithi052.stdout:Install 1 Package 2023-11-05T07:56:39.554 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T07:56:39.554 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 142 k 2023-11-05T07:56:39.554 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 400 k 2023-11-05T07:56:39.554 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2023-11-05T07:56:39.718 INFO:teuthology.orchestra.run.smithi156.stdout:ceph-immutable-object-cache-18.0.0-6776.g420cd1 674 kB/s | 142 kB 00:00 2023-11-05T07:56:39.719 INFO:teuthology.orchestra.run.smithi156.stdout:-------------------------------------------------------------------------------- 2023-11-05T07:56:39.719 INFO:teuthology.orchestra.run.smithi156.stdout:Total 669 kB/s | 142 kB 00:00 2023-11-05T07:56:39.720 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2023-11-05T07:56:39.727 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction check succeeded. 2023-11-05T07:56:39.727 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2023-11-05T07:56:39.778 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded. 2023-11-05T07:56:39.779 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2023-11-05T07:56:39.864 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-immutable-object-cache-18.0.0-6776.g420cd1 455 kB/s | 142 kB 00:00 2023-11-05T07:56:39.865 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2023-11-05T07:56:39.865 INFO:teuthology.orchestra.run.smithi052.stdout:Total 453 kB/s | 142 kB 00:00 2023-11-05T07:56:39.865 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2023-11-05T07:56:39.873 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2023-11-05T07:56:39.873 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2023-11-05T07:56:39.916 INFO:teuthology.orchestra.run.smithi156.stdout: Preparing : 1/1 2023-11-05T07:56:39.928 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2023-11-05T07:56:39.929 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2023-11-05T07:56:39.970 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6776.g420cd129. 1/1 2023-11-05T07:56:39.994 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6776.g420cd129. 1/1 2023-11-05T07:56:39.994 INFO:teuthology.orchestra.run.smithi156.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-05T07:56:39.994 INFO:teuthology.orchestra.run.smithi156.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-11-05T07:56:39.994 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T07:56:40.073 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2023-11-05T07:56:40.140 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6776.g420cd129. 1/1 2023-11-05T07:56:40.166 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6776.g420cd129. 1/1 2023-11-05T07:56:40.166 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-05T07:56:40.167 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-11-05T07:56:40.167 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T07:56:40.990 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6776.g420cd129. 1/1 2023-11-05T07:56:40.990 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T07:56:40.990 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2023-11-05T07:56:40.990 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-immutable-object-cache-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-05T07:56:40.991 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T07:56:40.991 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2023-11-05T07:56:41.202 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6776.g420cd129. 1/1 2023-11-05T07:56:41.203 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T07:56:41.203 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2023-11-05T07:56:41.203 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-immutable-object-cache-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-05T07:56:41.203 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T07:56:41.204 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2023-11-05T07:56:41.264 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum -y install ceph-mgr 2023-11-05T07:56:41.454 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install ceph-mgr 2023-11-05T07:56:41.824 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:01:02 ago on Sun 05 Nov 2023 07:55:39 AM UTC. 2023-11-05T07:56:41.918 INFO:teuthology.orchestra.run.smithi156.stdout:Package ceph-mgr-2:18.0.0-6776.g420cd129.el9.x86_64 is already installed. 2023-11-05T07:56:41.968 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2023-11-05T07:56:41.969 INFO:teuthology.orchestra.run.smithi156.stdout:Nothing to do. 2023-11-05T07:56:41.969 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2023-11-05T07:56:42.033 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:01:00 ago on Sun 05 Nov 2023 07:55:42 AM UTC. 2023-11-05T07:56:42.041 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum -y install ceph-mgr-dashboard 2023-11-05T07:56:42.126 INFO:teuthology.orchestra.run.smithi052.stdout:Package ceph-mgr-2:18.0.0-6776.g420cd129.el9.x86_64 is already installed. 2023-11-05T07:56:42.178 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2023-11-05T07:56:42.179 INFO:teuthology.orchestra.run.smithi052.stdout:Nothing to do. 2023-11-05T07:56:42.179 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2023-11-05T07:56:42.237 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install ceph-mgr-dashboard 2023-11-05T07:56:42.590 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:01:03 ago on Sun 05 Nov 2023 07:55:39 AM UTC. 2023-11-05T07:56:42.732 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2023-11-05T07:56:42.733 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-05T07:56:42.733 INFO:teuthology.orchestra.run.smithi156.stdout: Package Arch Version Repository Size 2023-11-05T07:56:42.733 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-05T07:56:42.733 INFO:teuthology.orchestra.run.smithi156.stdout:Installing: 2023-11-05T07:56:42.734 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6776.g420cd129.el9 ceph-noarch 1.8 M 2023-11-05T07:56:42.734 INFO:teuthology.orchestra.run.smithi156.stdout:Installing dependencies: 2023-11-05T07:56:42.734 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6776.g420cd129.el9 ceph-noarch 23 k 2023-11-05T07:56:42.734 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6776.g420cd129.el9 ceph-noarch 15 k 2023-11-05T07:56:42.734 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-11-05T07:56:42.735 INFO:teuthology.orchestra.run.smithi156.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-11-05T07:56:42.735 INFO:teuthology.orchestra.run.smithi156.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-11-05T07:56:42.735 INFO:teuthology.orchestra.run.smithi156.stdout:Installing weak dependencies: 2023-11-05T07:56:42.735 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-11-05T07:56:42.736 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T07:56:42.736 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2023-11-05T07:56:42.736 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-05T07:56:42.736 INFO:teuthology.orchestra.run.smithi156.stdout:Install 7 Packages 2023-11-05T07:56:42.736 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T07:56:42.737 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 2.1 M 2023-11-05T07:56:42.738 INFO:teuthology.orchestra.run.smithi156.stdout:Installed size: 8.6 M 2023-11-05T07:56:42.738 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading Packages: 2023-11-05T07:56:42.807 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:01:00 ago on Sun 05 Nov 2023 07:55:42 AM UTC. 2023-11-05T07:56:42.953 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2023-11-05T07:56:42.954 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-11-05T07:56:42.955 INFO:teuthology.orchestra.run.smithi052.stdout: Package Arch Version Repository Size 2023-11-05T07:56:42.955 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-11-05T07:56:42.955 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2023-11-05T07:56:42.955 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6776.g420cd129.el9 ceph-noarch 1.8 M 2023-11-05T07:56:42.955 INFO:teuthology.orchestra.run.smithi052.stdout:Installing dependencies: 2023-11-05T07:56:42.956 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6776.g420cd129.el9 ceph-noarch 23 k 2023-11-05T07:56:42.956 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6776.g420cd129.el9 ceph-noarch 15 k 2023-11-05T07:56:42.956 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-11-05T07:56:42.956 INFO:teuthology.orchestra.run.smithi052.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-11-05T07:56:42.956 INFO:teuthology.orchestra.run.smithi052.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-11-05T07:56:42.957 INFO:teuthology.orchestra.run.smithi052.stdout:Installing weak dependencies: 2023-11-05T07:56:42.957 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-11-05T07:56:42.957 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T07:56:42.957 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2023-11-05T07:56:42.957 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-11-05T07:56:42.958 INFO:teuthology.orchestra.run.smithi052.stdout:Install 7 Packages 2023-11-05T07:56:42.958 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T07:56:42.959 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 2.1 M 2023-11-05T07:56:42.959 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 8.6 M 2023-11-05T07:56:42.959 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2023-11-05T07:56:42.982 INFO:teuthology.orchestra.run.smithi156.stdout:(1/7): ceph-grafana-dashboards-18.0.0-6776.g420 123 kB/s | 23 kB 00:00 2023-11-05T07:56:43.074 INFO:teuthology.orchestra.run.smithi156.stdout:(2/7): ceph-prometheus-alerts-18.0.0-6776.g420c 54 kB/s | 15 kB 00:00 2023-11-05T07:56:43.133 INFO:teuthology.orchestra.run.smithi156.stdout:(3/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 60 kB/s | 9.0 kB 00:00 2023-11-05T07:56:43.175 INFO:teuthology.orchestra.run.smithi156.stdout:(4/7): python3-jwt-2.4.0-1.el9.noarch.rpm 412 kB/s | 41 kB 00:00 2023-11-05T07:56:43.200 INFO:teuthology.orchestra.run.smithi156.stdout:(5/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 461 kB/s | 31 kB 00:00 2023-11-05T07:56:43.242 INFO:teuthology.orchestra.run.smithi156.stdout:(6/7): python3-routes-2.5.1-5.el9.noarch.rpm 2.8 MB/s | 188 kB 00:00 2023-11-05T07:56:43.392 INFO:teuthology.orchestra.run.smithi156.stdout:(7/7): ceph-mgr-dashboard-18.0.0-6776.g420cd129 2.9 MB/s | 1.8 MB 00:00 2023-11-05T07:56:43.396 INFO:teuthology.orchestra.run.smithi156.stdout:-------------------------------------------------------------------------------- 2023-11-05T07:56:43.396 INFO:teuthology.orchestra.run.smithi156.stdout:Total 3.1 MB/s | 2.1 MB 00:00 2023-11-05T07:56:43.396 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2023-11-05T07:56:43.403 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction check succeeded. 2023-11-05T07:56:43.404 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2023-11-05T07:56:43.472 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded. 2023-11-05T07:56:43.473 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2023-11-05T07:56:43.525 INFO:teuthology.orchestra.run.smithi052.stdout:(1/7): ceph-grafana-dashboards-18.0.0-6776.g420 106 kB/s | 23 kB 00:00 2023-11-05T07:56:43.550 INFO:teuthology.orchestra.run.smithi052.stdout:(2/7): ceph-prometheus-alerts-18.0.0-6776.g420c 62 kB/s | 15 kB 00:00 2023-11-05T07:56:43.708 INFO:teuthology.orchestra.run.smithi052.stdout:(3/7): ceph-mgr-dashboard-18.0.0-6776.g420cd129 4.4 MB/s | 1.8 MB 00:00 2023-11-05T07:56:43.750 INFO:teuthology.orchestra.run.smithi052.stdout:(4/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 40 kB/s | 9.0 kB 00:00 2023-11-05T07:56:43.772 INFO:teuthology.orchestra.run.smithi156.stdout: Preparing : 1/1 2023-11-05T07:56:43.835 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2023-11-05T07:56:43.861 INFO:teuthology.orchestra.run.smithi052.stdout:(5/7): python3-jwt-2.4.0-1.el9.noarch.rpm 132 kB/s | 41 kB 00:00 2023-11-05T07:56:43.869 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2023-11-05T07:56:43.915 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2023-11-05T07:56:43.956 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2023-11-05T07:56:43.969 INFO:teuthology.orchestra.run.smithi052.stdout:(6/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 119 kB/s | 31 kB 00:00 2023-11-05T07:56:43.984 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6776.g420cd129.el9.n 5/7 2023-11-05T07:56:43.993 INFO:teuthology.orchestra.run.smithi052.stdout:(7/7): python3-routes-2.5.1-5.el9.noarch.rpm 778 kB/s | 188 kB 00:00 2023-11-05T07:56:43.997 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2023-11-05T07:56:43.997 INFO:teuthology.orchestra.run.smithi052.stdout:Total 2.0 MB/s | 2.1 MB 00:01 2023-11-05T07:56:43.997 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2023-11-05T07:56:44.006 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2023-11-05T07:56:44.006 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2023-11-05T07:56:44.076 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2023-11-05T07:56:44.077 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2023-11-05T07:56:44.223 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6776.g420cd129.el9. 6/7 2023-11-05T07:56:44.255 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6776.g420cd129.el9.noarc 7/7 2023-11-05T07:56:44.379 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2023-11-05T07:56:44.444 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2023-11-05T07:56:44.478 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2023-11-05T07:56:44.526 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2023-11-05T07:56:44.557 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2023-11-05T07:56:44.577 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6776.g420cd129.el9.n 5/7 2023-11-05T07:56:44.817 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6776.g420cd129.el9. 6/7 2023-11-05T07:56:44.837 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6776.g420cd129.el9.noarc 7/7 2023-11-05T07:56:44.837 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6776.g420cd129.el9. 1/7 2023-11-05T07:56:44.837 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6776.g420cd129.el9.noarc 2/7 2023-11-05T07:56:44.838 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6776.g420cd129.el9.n 3/7 2023-11-05T07:56:44.838 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2023-11-05T07:56:44.838 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2023-11-05T07:56:44.838 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2023-11-05T07:56:44.846 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6776.g420cd129.el9.noarc 7/7 2023-11-05T07:56:45.160 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2023-11-05T07:56:45.161 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T07:56:45.161 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2023-11-05T07:56:45.161 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-grafana-dashboards-2:18.0.0-6776.g420cd129.el9.noarch 2023-11-05T07:56:45.161 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-dashboard-2:18.0.0-6776.g420cd129.el9.noarch 2023-11-05T07:56:45.162 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-prometheus-alerts-2:18.0.0-6776.g420cd129.el9.noarch 2023-11-05T07:56:45.162 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-11-05T07:56:45.162 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-11-05T07:56:45.162 INFO:teuthology.orchestra.run.smithi156.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-11-05T07:56:45.163 INFO:teuthology.orchestra.run.smithi156.stdout: python3-routes-2.5.1-5.el9.noarch 2023-11-05T07:56:45.163 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T07:56:45.163 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2023-11-05T07:56:45.406 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum -y install ceph-mgr-diskprediction-local 2023-11-05T07:56:45.438 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6776.g420cd129.el9.noarc 7/7 2023-11-05T07:56:45.439 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6776.g420cd129.el9. 1/7 2023-11-05T07:56:45.439 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6776.g420cd129.el9.noarc 2/7 2023-11-05T07:56:45.439 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6776.g420cd129.el9.n 3/7 2023-11-05T07:56:45.439 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2023-11-05T07:56:45.439 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2023-11-05T07:56:45.440 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2023-11-05T07:56:45.870 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2023-11-05T07:56:45.871 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T07:56:45.871 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2023-11-05T07:56:45.871 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-grafana-dashboards-2:18.0.0-6776.g420cd129.el9.noarch 2023-11-05T07:56:45.871 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-dashboard-2:18.0.0-6776.g420cd129.el9.noarch 2023-11-05T07:56:45.871 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-prometheus-alerts-2:18.0.0-6776.g420cd129.el9.noarch 2023-11-05T07:56:45.872 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-11-05T07:56:45.872 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-11-05T07:56:45.872 INFO:teuthology.orchestra.run.smithi052.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-11-05T07:56:45.872 INFO:teuthology.orchestra.run.smithi052.stdout: python3-routes-2.5.1-5.el9.noarch 2023-11-05T07:56:45.872 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T07:56:45.873 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2023-11-05T07:56:45.954 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:01:06 ago on Sun 05 Nov 2023 07:55:39 AM UTC. 2023-11-05T07:56:46.096 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2023-11-05T07:56:46.097 INFO:teuthology.orchestra.run.smithi156.stdout:============================================================================================ 2023-11-05T07:56:46.097 INFO:teuthology.orchestra.run.smithi156.stdout: Package Arch Version Repository Size 2023-11-05T07:56:46.097 INFO:teuthology.orchestra.run.smithi156.stdout:============================================================================================ 2023-11-05T07:56:46.098 INFO:teuthology.orchestra.run.smithi156.stdout:Installing: 2023-11-05T07:56:46.098 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6776.g420cd129.el9 ceph-noarch 7.4 M 2023-11-05T07:56:46.098 INFO:teuthology.orchestra.run.smithi156.stdout:Installing dependencies: 2023-11-05T07:56:46.098 INFO:teuthology.orchestra.run.smithi156.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-11-05T07:56:46.098 INFO:teuthology.orchestra.run.smithi156.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-11-05T07:56:46.099 INFO:teuthology.orchestra.run.smithi156.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-11-05T07:56:46.099 INFO:teuthology.orchestra.run.smithi156.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-11-05T07:56:46.099 INFO:teuthology.orchestra.run.smithi156.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-11-05T07:56:46.099 INFO:teuthology.orchestra.run.smithi156.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-11-05T07:56:46.100 INFO:teuthology.orchestra.run.smithi156.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-11-05T07:56:46.100 INFO:teuthology.orchestra.run.smithi156.stdout: python3-devel x86_64 3.9.17-2.el9 CentOS-AppStream 205 k 2023-11-05T07:56:46.100 INFO:teuthology.orchestra.run.smithi156.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-11-05T07:56:46.100 INFO:teuthology.orchestra.run.smithi156.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-11-05T07:56:46.100 INFO:teuthology.orchestra.run.smithi156.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-11-05T07:56:46.101 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T07:56:46.101 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2023-11-05T07:56:46.101 INFO:teuthology.orchestra.run.smithi156.stdout:============================================================================================ 2023-11-05T07:56:46.101 INFO:teuthology.orchestra.run.smithi156.stdout:Install 12 Packages 2023-11-05T07:56:46.101 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T07:56:46.102 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 37 M 2023-11-05T07:56:46.103 INFO:teuthology.orchestra.run.smithi156.stdout:Installed size: 209 M 2023-11-05T07:56:46.103 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading Packages: 2023-11-05T07:56:46.188 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install ceph-mgr-diskprediction-local 2023-11-05T07:56:46.232 INFO:teuthology.orchestra.run.smithi156.stdout:(1/12): flexiblas-3.0.4-8.el9.x86_64.rpm 238 kB/s | 32 kB 00:00 2023-11-05T07:56:46.258 INFO:teuthology.orchestra.run.smithi156.stdout:(2/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 713 kB/s | 17 kB 00:00 2023-11-05T07:56:46.283 INFO:teuthology.orchestra.run.smithi156.stdout:(3/12): openblas-0.3.21-2.el9.x86_64.rpm 1.4 MB/s | 34 kB 00:00 2023-11-05T07:56:46.342 INFO:teuthology.orchestra.run.smithi156.stdout:(4/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 12 MB/s | 3.0 MB 00:00 2023-11-05T07:56:46.400 INFO:teuthology.orchestra.run.smithi156.stdout:(5/12): python3-devel-3.9.17-2.el9.x86_64.rpm 3.5 MB/s | 205 kB 00:00 2023-11-05T07:56:46.467 INFO:teuthology.orchestra.run.smithi156.stdout:(6/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 26 MB/s | 4.7 MB 00:00 2023-11-05T07:56:46.543 INFO:teuthology.orchestra.run.smithi156.stdout:(7/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 34 MB/s | 4.8 MB 00:00 2023-11-05T07:56:46.568 INFO:teuthology.orchestra.run.smithi156.stdout:(8/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.2 MB/s | 217 kB 00:00 2023-11-05T07:56:46.759 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:01:04 ago on Sun 05 Nov 2023 07:55:42 AM UTC. 2023-11-05T07:56:46.777 INFO:teuthology.orchestra.run.smithi156.stdout:(9/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 67 MB/s | 16 MB 00:00 2023-11-05T07:56:46.802 INFO:teuthology.orchestra.run.smithi156.stdout:(10/12): libgfortran-11.4.1-2.3.el9.x86_64.rpm 3.4 MB/s | 803 kB 00:00 2023-11-05T07:56:46.835 INFO:teuthology.orchestra.run.smithi156.stdout:(11/12): libquadmath-11.4.1-2.3.el9.x86_64.rpm 3.3 MB/s | 195 kB 00:00 2023-11-05T07:56:46.907 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2023-11-05T07:56:46.908 INFO:teuthology.orchestra.run.smithi052.stdout:============================================================================================ 2023-11-05T07:56:46.908 INFO:teuthology.orchestra.run.smithi052.stdout: Package Arch Version Repository Size 2023-11-05T07:56:46.908 INFO:teuthology.orchestra.run.smithi052.stdout:============================================================================================ 2023-11-05T07:56:46.909 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2023-11-05T07:56:46.909 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6776.g420cd129.el9 ceph-noarch 7.4 M 2023-11-05T07:56:46.909 INFO:teuthology.orchestra.run.smithi052.stdout:Installing dependencies: 2023-11-05T07:56:46.909 INFO:teuthology.orchestra.run.smithi052.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-11-05T07:56:46.909 INFO:teuthology.orchestra.run.smithi052.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-11-05T07:56:46.910 INFO:teuthology.orchestra.run.smithi052.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-11-05T07:56:46.910 INFO:teuthology.orchestra.run.smithi052.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-11-05T07:56:46.910 INFO:teuthology.orchestra.run.smithi052.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-11-05T07:56:46.910 INFO:teuthology.orchestra.run.smithi052.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-11-05T07:56:46.910 INFO:teuthology.orchestra.run.smithi052.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-11-05T07:56:46.910 INFO:teuthology.orchestra.run.smithi052.stdout: python3-devel x86_64 3.9.17-2.el9 CentOS-AppStream 205 k 2023-11-05T07:56:46.911 INFO:teuthology.orchestra.run.smithi052.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-11-05T07:56:46.911 INFO:teuthology.orchestra.run.smithi052.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-11-05T07:56:46.911 INFO:teuthology.orchestra.run.smithi052.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-11-05T07:56:46.911 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T07:56:46.911 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2023-11-05T07:56:46.912 INFO:teuthology.orchestra.run.smithi052.stdout:============================================================================================ 2023-11-05T07:56:46.912 INFO:teuthology.orchestra.run.smithi052.stdout:Install 12 Packages 2023-11-05T07:56:46.912 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T07:56:46.913 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 37 M 2023-11-05T07:56:46.913 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 209 M 2023-11-05T07:56:46.913 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2023-11-05T07:56:47.049 INFO:teuthology.orchestra.run.smithi052.stdout:(1/12): flexiblas-3.0.4-8.el9.x86_64.rpm 229 kB/s | 32 kB 00:00 2023-11-05T07:56:47.082 INFO:teuthology.orchestra.run.smithi052.stdout:(2/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 532 kB/s | 17 kB 00:00 2023-11-05T07:56:47.116 INFO:teuthology.orchestra.run.smithi052.stdout:(3/12): openblas-0.3.21-2.el9.x86_64.rpm 1.0 MB/s | 34 kB 00:00 2023-11-05T07:56:47.175 INFO:teuthology.orchestra.run.smithi052.stdout:(4/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 11 MB/s | 3.0 MB 00:00 2023-11-05T07:56:47.233 INFO:teuthology.orchestra.run.smithi052.stdout:(5/12): python3-devel-3.9.17-2.el9.x86_64.rpm 3.5 MB/s | 205 kB 00:00 2023-11-05T07:56:47.300 INFO:teuthology.orchestra.run.smithi052.stdout:(6/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 26 MB/s | 4.7 MB 00:00 2023-11-05T07:56:47.375 INFO:teuthology.orchestra.run.smithi052.stdout:(7/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 34 MB/s | 4.8 MB 00:00 2023-11-05T07:56:47.395 INFO:teuthology.orchestra.run.smithi156.stdout:(12/12): ceph-mgr-diskprediction-local-18.0.0-6 5.7 MB/s | 7.4 MB 00:01 2023-11-05T07:56:47.397 INFO:teuthology.orchestra.run.smithi156.stdout:-------------------------------------------------------------------------------- 2023-11-05T07:56:47.397 INFO:teuthology.orchestra.run.smithi156.stdout:Total 29 MB/s | 37 MB 00:01 2023-11-05T07:56:47.398 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2023-11-05T07:56:47.400 INFO:teuthology.orchestra.run.smithi052.stdout:(8/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.2 MB/s | 217 kB 00:00 2023-11-05T07:56:47.420 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction check succeeded. 2023-11-05T07:56:47.421 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2023-11-05T07:56:47.468 INFO:teuthology.orchestra.run.smithi052.stdout:(9/12): libgfortran-11.4.1-2.3.el9.x86_64.rpm 12 MB/s | 803 kB 00:00 2023-11-05T07:56:47.651 INFO:teuthology.orchestra.run.smithi052.stdout:(10/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 57 MB/s | 16 MB 00:00 2023-11-05T07:56:47.676 INFO:teuthology.orchestra.run.smithi052.stdout:(11/12): libquadmath-11.4.1-2.3.el9.x86_64.rpm 947 kB/s | 195 kB 00:00 2023-11-05T07:56:47.872 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded. 2023-11-05T07:56:47.873 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2023-11-05T07:56:48.102 INFO:teuthology.orchestra.run.smithi052.stdout:(12/12): ceph-mgr-diskprediction-local-18.0.0-6 6.2 MB/s | 7.4 MB 00:01 2023-11-05T07:56:48.104 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2023-11-05T07:56:48.105 INFO:teuthology.orchestra.run.smithi052.stdout:Total 31 MB/s | 37 MB 00:01 2023-11-05T07:56:48.105 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2023-11-05T07:56:48.129 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2023-11-05T07:56:48.129 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2023-11-05T07:56:48.586 INFO:teuthology.orchestra.run.smithi156.stdout: Preparing : 1/1 2023-11-05T07:56:48.604 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2023-11-05T07:56:48.604 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2023-11-05T07:56:48.658 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 1/12 2023-11-05T07:56:48.690 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 2/12 2023-11-05T07:56:48.786 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 3/12 2023-11-05T07:56:48.818 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 4/12 2023-11-05T07:56:49.002 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2023-11-05T07:56:49.026 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2023-11-05T07:56:49.137 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2023-11-05T07:56:49.454 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2023-11-05T07:56:49.525 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 1/12 2023-11-05T07:56:49.556 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 2/12 2023-11-05T07:56:49.652 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 3/12 2023-11-05T07:56:49.810 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 4/12 2023-11-05T07:56:49.815 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2023-11-05T07:56:49.930 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2023-11-05T07:56:49.998 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2023-11-05T07:56:50.033 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2023-11-05T07:56:50.122 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2023-11-05T07:56:50.796 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2023-11-05T07:56:50.908 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2023-11-05T07:56:51.192 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2023-11-05T07:56:52.207 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2023-11-05T07:56:52.224 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2023-11-05T07:56:52.252 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6776.g420cd 12/12 2023-11-05T07:56:53.284 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2023-11-05T07:56:53.314 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6776.g420cd 12/12 2023-11-05T07:56:55.027 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6776.g420cd 12/12 2023-11-05T07:56:55.027 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6776.g420cd 1/12 2023-11-05T07:56:55.028 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 2/12 2023-11-05T07:56:55.028 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 3/12 2023-11-05T07:56:55.028 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 4/12 2023-11-05T07:56:55.028 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 5/12 2023-11-05T07:56:55.028 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2023-11-05T07:56:55.029 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 7/12 2023-11-05T07:56:55.029 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 8/12 2023-11-05T07:56:55.029 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 9/12 2023-11-05T07:56:55.029 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 10/12 2023-11-05T07:56:55.029 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 11/12 2023-11-05T07:56:55.454 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 12/12 2023-11-05T07:56:55.455 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T07:56:55.455 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2023-11-05T07:56:55.455 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6776.g420cd129.el9.noarch 2023-11-05T07:56:55.456 INFO:teuthology.orchestra.run.smithi156.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-11-05T07:56:55.456 INFO:teuthology.orchestra.run.smithi156.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-11-05T07:56:55.456 INFO:teuthology.orchestra.run.smithi156.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-11-05T07:56:55.456 INFO:teuthology.orchestra.run.smithi156.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-11-05T07:56:55.457 INFO:teuthology.orchestra.run.smithi156.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-11-05T07:56:55.457 INFO:teuthology.orchestra.run.smithi156.stdout: openblas-0.3.21-2.el9.x86_64 2023-11-05T07:56:55.457 INFO:teuthology.orchestra.run.smithi156.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-11-05T07:56:55.457 INFO:teuthology.orchestra.run.smithi156.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-11-05T07:56:55.457 INFO:teuthology.orchestra.run.smithi156.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-11-05T07:56:55.457 INFO:teuthology.orchestra.run.smithi156.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-11-05T07:56:55.458 INFO:teuthology.orchestra.run.smithi156.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-11-05T07:56:55.458 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T07:56:55.458 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2023-11-05T07:56:55.779 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6776.g420cd 12/12 2023-11-05T07:56:55.780 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6776.g420cd 1/12 2023-11-05T07:56:55.780 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 2/12 2023-11-05T07:56:55.780 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 3/12 2023-11-05T07:56:55.780 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 4/12 2023-11-05T07:56:55.781 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 5/12 2023-11-05T07:56:55.781 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2023-11-05T07:56:55.781 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 7/12 2023-11-05T07:56:55.781 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 8/12 2023-11-05T07:56:55.781 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 9/12 2023-11-05T07:56:55.782 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 10/12 2023-11-05T07:56:55.782 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 11/12 2023-11-05T07:56:55.815 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum -y install ceph-mgr-rook 2023-11-05T07:56:56.206 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 12/12 2023-11-05T07:56:56.206 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T07:56:56.207 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2023-11-05T07:56:56.207 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6776.g420cd129.el9.noarch 2023-11-05T07:56:56.207 INFO:teuthology.orchestra.run.smithi052.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-11-05T07:56:56.207 INFO:teuthology.orchestra.run.smithi052.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-11-05T07:56:56.207 INFO:teuthology.orchestra.run.smithi052.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-11-05T07:56:56.208 INFO:teuthology.orchestra.run.smithi052.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-11-05T07:56:56.208 INFO:teuthology.orchestra.run.smithi052.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-11-05T07:56:56.208 INFO:teuthology.orchestra.run.smithi052.stdout: openblas-0.3.21-2.el9.x86_64 2023-11-05T07:56:56.208 INFO:teuthology.orchestra.run.smithi052.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-11-05T07:56:56.208 INFO:teuthology.orchestra.run.smithi052.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-11-05T07:56:56.209 INFO:teuthology.orchestra.run.smithi052.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-11-05T07:56:56.209 INFO:teuthology.orchestra.run.smithi052.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-11-05T07:56:56.209 INFO:teuthology.orchestra.run.smithi052.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-11-05T07:56:56.209 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T07:56:56.209 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2023-11-05T07:56:56.368 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:01:17 ago on Sun 05 Nov 2023 07:55:39 AM UTC. 2023-11-05T07:56:56.510 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2023-11-05T07:56:56.511 INFO:teuthology.orchestra.run.smithi156.stdout:======================================================================================== 2023-11-05T07:56:56.511 INFO:teuthology.orchestra.run.smithi156.stdout: Package Arch Version Repository Size 2023-11-05T07:56:56.512 INFO:teuthology.orchestra.run.smithi156.stdout:======================================================================================== 2023-11-05T07:56:56.512 INFO:teuthology.orchestra.run.smithi156.stdout:Installing: 2023-11-05T07:56:56.512 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-rook noarch 2:18.0.0-6776.g420cd129.el9 ceph-noarch 48 k 2023-11-05T07:56:56.512 INFO:teuthology.orchestra.run.smithi156.stdout:Installing dependencies: 2023-11-05T07:56:56.512 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-11-05T07:56:56.513 INFO:teuthology.orchestra.run.smithi156.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-11-05T07:56:56.513 INFO:teuthology.orchestra.run.smithi156.stdout: python3-google-auth noarch 1:2.23.3-1.el9 epel 197 k 2023-11-05T07:56:56.513 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-11-05T07:56:56.513 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-11-05T07:56:56.513 INFO:teuthology.orchestra.run.smithi156.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-11-05T07:56:56.513 INFO:teuthology.orchestra.run.smithi156.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-11-05T07:56:56.514 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-11-05T07:56:56.514 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-11-05T07:56:56.514 INFO:teuthology.orchestra.run.smithi156.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-11-05T07:56:56.514 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-11-05T07:56:56.514 INFO:teuthology.orchestra.run.smithi156.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-11-05T07:56:56.515 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T07:56:56.515 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2023-11-05T07:56:56.515 INFO:teuthology.orchestra.run.smithi156.stdout:======================================================================================== 2023-11-05T07:56:56.515 INFO:teuthology.orchestra.run.smithi156.stdout:Install 13 Packages 2023-11-05T07:56:56.515 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T07:56:56.516 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 2.0 M 2023-11-05T07:56:56.516 INFO:teuthology.orchestra.run.smithi156.stdout:Installed size: 26 M 2023-11-05T07:56:56.516 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading Packages: 2023-11-05T07:56:56.557 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install ceph-mgr-rook 2023-11-05T07:56:56.994 INFO:teuthology.orchestra.run.smithi156.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 152 kB/s | 18 kB 00:00 2023-11-05T07:56:57.020 INFO:teuthology.orchestra.run.smithi156.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 169 kB/s | 24 kB 00:00 2023-11-05T07:56:57.061 INFO:teuthology.orchestra.run.smithi156.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.6 MB/s | 174 kB 00:00 2023-11-05T07:56:57.087 INFO:teuthology.orchestra.run.smithi156.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.9 MB/s | 132 kB 00:00 2023-11-05T07:56:57.113 INFO:teuthology.orchestra.run.smithi156.stdout:(5/13): python3-pyasn1-modules-0.4.8-6.el9.noar 4.1 MB/s | 211 kB 00:00 2023-11-05T07:56:57.129 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:01:15 ago on Sun 05 Nov 2023 07:55:42 AM UTC. 2023-11-05T07:56:57.138 INFO:teuthology.orchestra.run.smithi156.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 855 kB/s | 43 kB 00:00 2023-11-05T07:56:57.278 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2023-11-05T07:56:57.279 INFO:teuthology.orchestra.run.smithi052.stdout:======================================================================================== 2023-11-05T07:56:57.280 INFO:teuthology.orchestra.run.smithi052.stdout: Package Arch Version Repository Size 2023-11-05T07:56:57.280 INFO:teuthology.orchestra.run.smithi052.stdout:======================================================================================== 2023-11-05T07:56:57.280 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2023-11-05T07:56:57.280 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-rook noarch 2:18.0.0-6776.g420cd129.el9 ceph-noarch 48 k 2023-11-05T07:56:57.280 INFO:teuthology.orchestra.run.smithi052.stdout:Installing dependencies: 2023-11-05T07:56:57.281 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-11-05T07:56:57.281 INFO:teuthology.orchestra.run.smithi052.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-11-05T07:56:57.281 INFO:teuthology.orchestra.run.smithi052.stdout: python3-google-auth noarch 1:2.23.3-1.el9 epel 197 k 2023-11-05T07:56:57.281 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-11-05T07:56:57.281 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-11-05T07:56:57.282 INFO:teuthology.orchestra.run.smithi052.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-11-05T07:56:57.282 INFO:teuthology.orchestra.run.smithi052.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-11-05T07:56:57.282 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-11-05T07:56:57.282 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-11-05T07:56:57.282 INFO:teuthology.orchestra.run.smithi052.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-11-05T07:56:57.283 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-11-05T07:56:57.283 INFO:teuthology.orchestra.run.smithi052.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-11-05T07:56:57.283 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T07:56:57.283 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2023-11-05T07:56:57.283 INFO:teuthology.orchestra.run.smithi052.stdout:======================================================================================== 2023-11-05T07:56:57.284 INFO:teuthology.orchestra.run.smithi052.stdout:Install 13 Packages 2023-11-05T07:56:57.284 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T07:56:57.284 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 2.0 M 2023-11-05T07:56:57.285 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 26 M 2023-11-05T07:56:57.285 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2023-11-05T07:56:57.305 INFO:teuthology.orchestra.run.smithi156.stdout:(7/13): ceph-mgr-rook-18.0.0-6776.g420cd129.el9 111 kB/s | 48 kB 00:00 2023-11-05T07:56:57.330 INFO:teuthology.orchestra.run.smithi156.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 148 kB/s | 32 kB 00:00 2023-11-05T07:56:57.381 INFO:teuthology.orchestra.run.smithi156.stdout:(9/13): python3-certifi-2021.10.8-2.el9.noarch. 62 kB/s | 15 kB 00:00 2023-11-05T07:56:57.472 INFO:teuthology.orchestra.run.smithi156.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 645 kB/s | 59 kB 00:00 2023-11-05T07:56:57.556 INFO:teuthology.orchestra.run.smithi156.stdout:(11/13): python3-websocket-client-1.2.3-2.el9.n 1.1 MB/s | 90 kB 00:00 2023-11-05T07:56:57.589 INFO:teuthology.orchestra.run.smithi156.stdout:(12/13): python3-kubernetes-26.1.0-2.el9.noarch 3.9 MB/s | 1.0 MB 00:00 2023-11-05T07:56:57.615 INFO:teuthology.orchestra.run.smithi156.stdout:(13/13): python3-google-auth-2.23.3-1.el9.noarc 637 kB/s | 197 kB 00:00 2023-11-05T07:56:57.619 INFO:teuthology.orchestra.run.smithi156.stdout:-------------------------------------------------------------------------------- 2023-11-05T07:56:57.619 INFO:teuthology.orchestra.run.smithi156.stdout:Total 1.8 MB/s | 2.0 MB 00:01 2023-11-05T07:56:57.619 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2023-11-05T07:56:57.632 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction check succeeded. 2023-11-05T07:56:57.632 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2023-11-05T07:56:57.728 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded. 2023-11-05T07:56:57.729 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2023-11-05T07:56:57.763 INFO:teuthology.orchestra.run.smithi052.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 213 kB/s | 24 kB 00:00 2023-11-05T07:56:57.779 INFO:teuthology.orchestra.run.smithi052.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 138 kB/s | 18 kB 00:00 2023-11-05T07:56:57.822 INFO:teuthology.orchestra.run.smithi052.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.9 MB/s | 174 kB 00:00 2023-11-05T07:56:57.847 INFO:teuthology.orchestra.run.smithi052.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.9 MB/s | 132 kB 00:00 2023-11-05T07:56:57.872 INFO:teuthology.orchestra.run.smithi052.stdout:(5/13): python3-pyasn1-modules-0.4.8-6.el9.noar 4.2 MB/s | 211 kB 00:00 2023-11-05T07:56:57.889 INFO:teuthology.orchestra.run.smithi052.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 1.0 MB/s | 43 kB 00:00 2023-11-05T07:56:58.031 INFO:teuthology.orchestra.run.smithi052.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 203 kB/s | 32 kB 00:00 2023-11-05T07:56:58.048 INFO:teuthology.orchestra.run.smithi052.stdout:(8/13): python3-certifi-2021.10.8-2.el9.noarch. 95 kB/s | 15 kB 00:00 2023-11-05T07:56:58.115 INFO:teuthology.orchestra.run.smithi052.stdout:(9/13): python3-google-auth-2.23.3-1.el9.noarch 2.3 MB/s | 197 kB 00:00 2023-11-05T07:56:58.132 INFO:teuthology.orchestra.run.smithi052.stdout:(10/13): ceph-mgr-rook-18.0.0-6776.g420cd129.el 99 kB/s | 48 kB 00:00 2023-11-05T07:56:58.182 INFO:teuthology.orchestra.run.smithi052.stdout:(11/13): python3-kubernetes-26.1.0-2.el9.noarch 7.6 MB/s | 1.0 MB 00:00 2023-11-05T07:56:58.199 INFO:teuthology.orchestra.run.smithi052.stdout:(12/13): python3-rsa-4.9-2.el9.noarch.rpm 711 kB/s | 59 kB 00:00 2023-11-05T07:56:58.224 INFO:teuthology.orchestra.run.smithi052.stdout:(13/13): python3-websocket-client-1.2.3-2.el9.n 988 kB/s | 90 kB 00:00 2023-11-05T07:56:58.227 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2023-11-05T07:56:58.228 INFO:teuthology.orchestra.run.smithi052.stdout:Total 2.2 MB/s | 2.0 MB 00:00 2023-11-05T07:56:58.228 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2023-11-05T07:56:58.242 INFO:teuthology.orchestra.run.smithi156.stdout: Preparing : 1/1 2023-11-05T07:56:58.242 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2023-11-05T07:56:58.242 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2023-11-05T07:56:58.349 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2023-11-05T07:56:58.349 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2023-11-05T07:56:58.411 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2023-11-05T07:56:58.474 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2023-11-05T07:56:58.537 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2023-11-05T07:56:58.567 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2023-11-05T07:56:58.608 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2023-11-05T07:56:58.700 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2023-11-05T07:56:58.802 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-google-auth-1:2.23.3-1.el9.noarch 7/13 2023-11-05T07:56:58.853 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2023-11-05T07:56:58.883 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2023-11-05T07:56:59.054 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2023-11-05T07:56:59.118 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2023-11-05T07:56:59.173 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2023-11-05T07:56:59.210 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2023-11-05T07:56:59.251 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2023-11-05T07:56:59.346 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2023-11-05T07:56:59.448 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-google-auth-1:2.23.3-1.el9.noarch 7/13 2023-11-05T07:56:59.502 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2023-11-05T07:56:59.580 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2023-11-05T07:56:59.634 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2023-11-05T07:56:59.668 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2023-11-05T07:56:59.714 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2023-11-05T07:56:59.738 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-mgr-rook-2:18.0.0-6776.g420cd129.el9.noarch 13/13 2023-11-05T07:57:00.258 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2023-11-05T07:57:00.307 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2023-11-05T07:57:00.341 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2023-11-05T07:57:00.387 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2023-11-05T07:57:00.410 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-rook-2:18.0.0-6776.g420cd129.el9.noarch 13/13 2023-11-05T07:57:00.582 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6776.g420cd129.el9.noarch 13/13 2023-11-05T07:57:00.582 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6776.g420cd129.el9.noarch 1/13 2023-11-05T07:57:00.583 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2023-11-05T07:57:00.583 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2023-11-05T07:57:00.583 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2023-11-05T07:57:00.583 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2023-11-05T07:57:00.583 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2023-11-05T07:57:00.584 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2023-11-05T07:57:00.584 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2023-11-05T07:57:00.584 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2023-11-05T07:57:00.584 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-google-auth-1:2.23.3-1.el9.noarch 10/13 2023-11-05T07:57:00.584 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2023-11-05T07:57:00.585 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2023-11-05T07:57:00.957 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2023-11-05T07:57:00.958 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T07:57:00.958 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2023-11-05T07:57:00.958 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-rook-2:18.0.0-6776.g420cd129.el9.noarch 2023-11-05T07:57:00.958 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-11-05T07:57:00.959 INFO:teuthology.orchestra.run.smithi156.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-11-05T07:57:00.959 INFO:teuthology.orchestra.run.smithi156.stdout: python3-google-auth-1:2.23.3-1.el9.noarch 2023-11-05T07:57:00.959 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-11-05T07:57:00.959 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-11-05T07:57:00.959 INFO:teuthology.orchestra.run.smithi156.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-11-05T07:57:00.960 INFO:teuthology.orchestra.run.smithi156.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-11-05T07:57:00.960 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-11-05T07:57:00.960 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-11-05T07:57:00.960 INFO:teuthology.orchestra.run.smithi156.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-11-05T07:57:00.960 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rsa-4.9-2.el9.noarch 2023-11-05T07:57:00.961 INFO:teuthology.orchestra.run.smithi156.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-11-05T07:57:00.961 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T07:57:00.961 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2023-11-05T07:57:01.200 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum -y install ceph-mgr-cephadm 2023-11-05T07:57:01.253 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6776.g420cd129.el9.noarch 13/13 2023-11-05T07:57:01.253 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6776.g420cd129.el9.noarch 1/13 2023-11-05T07:57:01.253 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2023-11-05T07:57:01.254 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2023-11-05T07:57:01.254 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2023-11-05T07:57:01.254 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2023-11-05T07:57:01.254 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2023-11-05T07:57:01.254 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2023-11-05T07:57:01.255 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2023-11-05T07:57:01.255 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2023-11-05T07:57:01.255 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-google-auth-1:2.23.3-1.el9.noarch 10/13 2023-11-05T07:57:01.255 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2023-11-05T07:57:01.255 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2023-11-05T07:57:01.630 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2023-11-05T07:57:01.630 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T07:57:01.630 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2023-11-05T07:57:01.631 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-rook-2:18.0.0-6776.g420cd129.el9.noarch 2023-11-05T07:57:01.631 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-11-05T07:57:01.631 INFO:teuthology.orchestra.run.smithi052.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-11-05T07:57:01.631 INFO:teuthology.orchestra.run.smithi052.stdout: python3-google-auth-1:2.23.3-1.el9.noarch 2023-11-05T07:57:01.631 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-11-05T07:57:01.632 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-11-05T07:57:01.632 INFO:teuthology.orchestra.run.smithi052.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-11-05T07:57:01.632 INFO:teuthology.orchestra.run.smithi052.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-11-05T07:57:01.632 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-11-05T07:57:01.633 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-11-05T07:57:01.633 INFO:teuthology.orchestra.run.smithi052.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-11-05T07:57:01.633 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rsa-4.9-2.el9.noarch 2023-11-05T07:57:01.633 INFO:teuthology.orchestra.run.smithi052.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-11-05T07:57:01.633 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T07:57:01.634 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2023-11-05T07:57:01.757 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:01:22 ago on Sun 05 Nov 2023 07:55:39 AM UTC. 2023-11-05T07:57:01.838 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install ceph-mgr-cephadm 2023-11-05T07:57:01.898 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2023-11-05T07:57:01.899 INFO:teuthology.orchestra.run.smithi156.stdout:======================================================================================== 2023-11-05T07:57:01.899 INFO:teuthology.orchestra.run.smithi156.stdout: Package Arch Version Repository Size 2023-11-05T07:57:01.899 INFO:teuthology.orchestra.run.smithi156.stdout:======================================================================================== 2023-11-05T07:57:01.899 INFO:teuthology.orchestra.run.smithi156.stdout:Installing: 2023-11-05T07:57:01.900 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6776.g420cd129.el9 ceph-noarch 132 k 2023-11-05T07:57:01.900 INFO:teuthology.orchestra.run.smithi156.stdout:Installing dependencies: 2023-11-05T07:57:01.900 INFO:teuthology.orchestra.run.smithi156.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-11-05T07:57:01.900 INFO:teuthology.orchestra.run.smithi156.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-11-05T07:57:01.901 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-11-05T07:57:01.901 INFO:teuthology.orchestra.run.smithi156.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-11-05T07:57:01.901 INFO:teuthology.orchestra.run.smithi156.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-11-05T07:57:01.901 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T07:57:01.901 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2023-11-05T07:57:01.902 INFO:teuthology.orchestra.run.smithi156.stdout:======================================================================================== 2023-11-05T07:57:01.902 INFO:teuthology.orchestra.run.smithi156.stdout:Install 6 Packages 2023-11-05T07:57:01.902 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T07:57:01.903 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 6.8 M 2023-11-05T07:57:01.903 INFO:teuthology.orchestra.run.smithi156.stdout:Installed size: 33 M 2023-11-05T07:57:01.903 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading Packages: 2023-11-05T07:57:02.245 INFO:teuthology.orchestra.run.smithi156.stdout:(1/6): python3-jinja2-2.11.3-4.el9.noarch.rpm 1.5 MB/s | 228 kB 00:00 2023-11-05T07:57:02.387 INFO:teuthology.orchestra.run.smithi156.stdout:(2/6): python3-babel-2.9.1-2.el9.noarch.rpm 20 MB/s | 5.8 MB 00:00 2023-11-05T07:57:02.415 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:01:20 ago on Sun 05 Nov 2023 07:55:42 AM UTC. 2023-11-05T07:57:02.563 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2023-11-05T07:57:02.564 INFO:teuthology.orchestra.run.smithi052.stdout:======================================================================================== 2023-11-05T07:57:02.564 INFO:teuthology.orchestra.run.smithi052.stdout: Package Arch Version Repository Size 2023-11-05T07:57:02.565 INFO:teuthology.orchestra.run.smithi052.stdout:======================================================================================== 2023-11-05T07:57:02.565 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2023-11-05T07:57:02.565 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6776.g420cd129.el9 ceph-noarch 132 k 2023-11-05T07:57:02.565 INFO:teuthology.orchestra.run.smithi052.stdout:Installing dependencies: 2023-11-05T07:57:02.565 INFO:teuthology.orchestra.run.smithi052.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-11-05T07:57:02.566 INFO:teuthology.orchestra.run.smithi052.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-11-05T07:57:02.566 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-11-05T07:57:02.566 INFO:teuthology.orchestra.run.smithi052.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-11-05T07:57:02.566 INFO:teuthology.orchestra.run.smithi052.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-11-05T07:57:02.566 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T07:57:02.567 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2023-11-05T07:57:02.567 INFO:teuthology.orchestra.run.smithi052.stdout:======================================================================================== 2023-11-05T07:57:02.567 INFO:teuthology.orchestra.run.smithi052.stdout:Install 6 Packages 2023-11-05T07:57:02.567 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T07:57:02.568 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 6.8 M 2023-11-05T07:57:02.568 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 33 M 2023-11-05T07:57:02.568 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2023-11-05T07:57:02.754 INFO:teuthology.orchestra.run.smithi156.stdout:(3/6): ceph-mgr-cephadm-18.0.0-6776.g420cd129.e 200 kB/s | 132 kB 00:00 2023-11-05T07:57:02.800 INFO:teuthology.orchestra.run.smithi052.stdout:(1/6): python3-jinja2-2.11.3-4.el9.noarch.rpm 1.5 MB/s | 228 kB 00:00 2023-11-05T07:57:02.934 INFO:teuthology.orchestra.run.smithi052.stdout:(2/6): python3-babel-2.9.1-2.el9.noarch.rpm 20 MB/s | 5.8 MB 00:00 2023-11-05T07:57:02.967 INFO:teuthology.orchestra.run.smithi156.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 99 kB/s | 58 kB 00:00 2023-11-05T07:57:03.092 INFO:teuthology.orchestra.run.smithi052.stdout:(3/6): python3-asyncssh-2.13.2-3.el9.noarch.rpm 1.8 MB/s | 548 kB 00:00 2023-11-05T07:57:03.096 INFO:teuthology.orchestra.run.smithi156.stdout:(5/6): python3-asyncssh-2.13.2-3.el9.noarch.rpm 645 kB/s | 548 kB 00:00 2023-11-05T07:57:03.118 INFO:teuthology.orchestra.run.smithi052.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 317 kB/s | 58 kB 00:00 2023-11-05T07:57:03.142 INFO:teuthology.orchestra.run.smithi052.stdout:(5/6): python3-typing-extensions-4.4.0-2.el9.no 1.0 MB/s | 51 kB 00:00 2023-11-05T07:57:03.259 INFO:teuthology.orchestra.run.smithi052.stdout:(6/6): ceph-mgr-cephadm-18.0.0-6776.g420cd129.e 216 kB/s | 132 kB 00:00 2023-11-05T07:57:03.263 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2023-11-05T07:57:03.263 INFO:teuthology.orchestra.run.smithi052.stdout:Total 9.7 MB/s | 6.8 MB 00:00 2023-11-05T07:57:03.264 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2023-11-05T07:57:03.274 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2023-11-05T07:57:03.274 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2023-11-05T07:57:03.370 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2023-11-05T07:57:03.371 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2023-11-05T07:57:03.676 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2023-11-05T07:57:03.856 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2023-11-05T07:57:03.912 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 2/6 2023-11-05T07:57:04.470 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2023-11-05T07:57:04.550 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2023-11-05T07:57:04.618 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 5/6 2023-11-05T07:57:04.648 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6776.g420cd129.el9.noarch 6/6 2023-11-05T07:57:05.346 INFO:teuthology.orchestra.run.smithi156.stdout:(6/6): python3-typing-extensions-4.4.0-2.el9.no 20 kB/s | 51 kB 00:02 2023-11-05T07:57:05.348 INFO:teuthology.orchestra.run.smithi156.stdout:-------------------------------------------------------------------------------- 2023-11-05T07:57:05.349 INFO:teuthology.orchestra.run.smithi156.stdout:Total 2.0 MB/s | 6.8 MB 00:03 2023-11-05T07:57:05.349 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2023-11-05T07:57:05.360 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction check succeeded. 2023-11-05T07:57:05.360 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2023-11-05T07:57:05.455 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded. 2023-11-05T07:57:05.461 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2023-11-05T07:57:05.570 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6776.g420cd129.el9.noarch 6/6 2023-11-05T07:57:05.570 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6776.g420cd129.el9.noarch 1/6 2023-11-05T07:57:05.571 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2023-11-05T07:57:05.571 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 3/6 2023-11-05T07:57:05.571 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 4/6 2023-11-05T07:57:05.571 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2023-11-05T07:57:05.767 INFO:teuthology.orchestra.run.smithi156.stdout: Preparing : 1/1 2023-11-05T07:57:05.877 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2023-11-05T07:57:05.877 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T07:57:05.878 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2023-11-05T07:57:05.878 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-cephadm-2:18.0.0-6776.g420cd129.el9.noarch 2023-11-05T07:57:05.878 INFO:teuthology.orchestra.run.smithi052.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-11-05T07:57:05.878 INFO:teuthology.orchestra.run.smithi052.stdout: python3-babel-2.9.1-2.el9.noarch 2023-11-05T07:57:05.879 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-11-05T07:57:05.879 INFO:teuthology.orchestra.run.smithi052.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-11-05T07:57:05.879 INFO:teuthology.orchestra.run.smithi052.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-11-05T07:57:05.879 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T07:57:05.880 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2023-11-05T07:57:05.953 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2023-11-05T07:57:06.006 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 2/6 2023-11-05T07:57:06.114 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install ceph-fuse 2023-11-05T07:57:06.526 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2023-11-05T07:57:06.616 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2023-11-05T07:57:06.687 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 5/6 2023-11-05T07:57:06.697 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:01:24 ago on Sun 05 Nov 2023 07:55:42 AM UTC. 2023-11-05T07:57:06.710 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6776.g420cd129.el9.noarch 6/6 2023-11-05T07:57:06.844 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2023-11-05T07:57:06.845 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-11-05T07:57:06.845 INFO:teuthology.orchestra.run.smithi052.stdout: Package Arch Version Repository Size 2023-11-05T07:57:06.846 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-11-05T07:57:06.846 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2023-11-05T07:57:06.846 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-fuse x86_64 2:18.0.0-6776.g420cd129.el9 ceph 855 k 2023-11-05T07:57:06.846 INFO:teuthology.orchestra.run.smithi052.stdout:Installing dependencies: 2023-11-05T07:57:06.846 INFO:teuthology.orchestra.run.smithi052.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-11-05T07:57:06.847 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T07:57:06.847 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2023-11-05T07:57:06.847 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-11-05T07:57:06.847 INFO:teuthology.orchestra.run.smithi052.stdout:Install 2 Packages 2023-11-05T07:57:06.847 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T07:57:06.847 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 934 k 2023-11-05T07:57:06.848 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 2.7 M 2023-11-05T07:57:06.848 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2023-11-05T07:57:06.971 INFO:teuthology.orchestra.run.smithi052.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 631 kB/s | 79 kB 00:00 2023-11-05T07:57:07.171 INFO:teuthology.orchestra.run.smithi052.stdout:(2/2): ceph-fuse-18.0.0-6776.g420cd129.el9.x86_ 2.6 MB/s | 855 kB 00:00 2023-11-05T07:57:07.172 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2023-11-05T07:57:07.173 INFO:teuthology.orchestra.run.smithi052.stdout:Total 2.8 MB/s | 934 kB 00:00 2023-11-05T07:57:07.173 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2023-11-05T07:57:07.194 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2023-11-05T07:57:07.194 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2023-11-05T07:57:07.273 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2023-11-05T07:57:07.274 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2023-11-05T07:57:07.476 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2023-11-05T07:57:07.525 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6776.g420cd129.el9.noarch 6/6 2023-11-05T07:57:07.526 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6776.g420cd129.el9.noarch 1/6 2023-11-05T07:57:07.526 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2023-11-05T07:57:07.526 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 3/6 2023-11-05T07:57:07.526 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 4/6 2023-11-05T07:57:07.527 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2023-11-05T07:57:07.616 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2023-11-05T07:57:07.681 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-fuse-2:18.0.0-6776.g420cd129.el9.x86_64 2/2 2023-11-05T07:57:07.837 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2023-11-05T07:57:07.837 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T07:57:07.838 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2023-11-05T07:57:07.838 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-cephadm-2:18.0.0-6776.g420cd129.el9.noarch 2023-11-05T07:57:07.838 INFO:teuthology.orchestra.run.smithi156.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-11-05T07:57:07.838 INFO:teuthology.orchestra.run.smithi156.stdout: python3-babel-2.9.1-2.el9.noarch 2023-11-05T07:57:07.838 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-11-05T07:57:07.839 INFO:teuthology.orchestra.run.smithi156.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-11-05T07:57:07.839 INFO:teuthology.orchestra.run.smithi156.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-11-05T07:57:07.839 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T07:57:07.839 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2023-11-05T07:57:08.094 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum -y install ceph-fuse 2023-11-05T07:57:08.364 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-fuse-2:18.0.0-6776.g420cd129.el9.x86_64 2/2 2023-11-05T07:57:08.364 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-fuse-2:18.0.0-6776.g420cd129.el9.x86_64 1/2 2023-11-05T07:57:08.650 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:01:29 ago on Sun 05 Nov 2023 07:55:39 AM UTC. 2023-11-05T07:57:08.676 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2023-11-05T07:57:08.677 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T07:57:08.677 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2023-11-05T07:57:08.677 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-fuse-2:18.0.0-6776.g420cd129.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2023-11-05T07:57:08.677 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T07:57:08.678 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2023-11-05T07:57:08.791 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2023-11-05T07:57:08.792 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-05T07:57:08.792 INFO:teuthology.orchestra.run.smithi156.stdout: Package Arch Version Repository Size 2023-11-05T07:57:08.793 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-05T07:57:08.793 INFO:teuthology.orchestra.run.smithi156.stdout:Installing: 2023-11-05T07:57:08.793 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-fuse x86_64 2:18.0.0-6776.g420cd129.el9 ceph 855 k 2023-11-05T07:57:08.793 INFO:teuthology.orchestra.run.smithi156.stdout:Installing dependencies: 2023-11-05T07:57:08.793 INFO:teuthology.orchestra.run.smithi156.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-11-05T07:57:08.794 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T07:57:08.794 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2023-11-05T07:57:08.794 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-05T07:57:08.794 INFO:teuthology.orchestra.run.smithi156.stdout:Install 2 Packages 2023-11-05T07:57:08.795 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T07:57:08.795 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 934 k 2023-11-05T07:57:08.795 INFO:teuthology.orchestra.run.smithi156.stdout:Installed size: 2.7 M 2023-11-05T07:57:08.795 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading Packages: 2023-11-05T07:57:08.907 INFO:teuthology.orchestra.run.smithi156.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 692 kB/s | 79 kB 00:00 2023-11-05T07:57:08.950 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install ceph-volume 2023-11-05T07:57:09.124 INFO:teuthology.orchestra.run.smithi156.stdout:(2/2): ceph-fuse-18.0.0-6776.g420cd129.el9.x86_ 2.5 MB/s | 855 kB 00:00 2023-11-05T07:57:09.125 INFO:teuthology.orchestra.run.smithi156.stdout:-------------------------------------------------------------------------------- 2023-11-05T07:57:09.126 INFO:teuthology.orchestra.run.smithi156.stdout:Total 2.7 MB/s | 934 kB 00:00 2023-11-05T07:57:09.126 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2023-11-05T07:57:09.146 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction check succeeded. 2023-11-05T07:57:09.146 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2023-11-05T07:57:09.221 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded. 2023-11-05T07:57:09.222 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2023-11-05T07:57:09.412 INFO:teuthology.orchestra.run.smithi156.stdout: Preparing : 1/1 2023-11-05T07:57:09.529 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:01:27 ago on Sun 05 Nov 2023 07:55:42 AM UTC. 2023-11-05T07:57:09.540 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2023-11-05T07:57:09.615 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-fuse-2:18.0.0-6776.g420cd129.el9.x86_64 2/2 2023-11-05T07:57:09.675 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2023-11-05T07:57:09.676 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-11-05T07:57:09.676 INFO:teuthology.orchestra.run.smithi052.stdout: Package Arch Version Repository Size 2023-11-05T07:57:09.677 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-11-05T07:57:09.677 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2023-11-05T07:57:09.677 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-volume noarch 2:18.0.0-6776.g420cd129.el9 ceph-noarch 262 k 2023-11-05T07:57:09.677 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T07:57:09.677 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2023-11-05T07:57:09.678 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-11-05T07:57:09.678 INFO:teuthology.orchestra.run.smithi052.stdout:Install 1 Package 2023-11-05T07:57:09.678 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T07:57:09.678 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 262 k 2023-11-05T07:57:09.678 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 1.2 M 2023-11-05T07:57:09.679 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2023-11-05T07:57:10.042 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-volume-18.0.0-6776.g420cd129.el9.noarch.rp 719 kB/s | 262 kB 00:00 2023-11-05T07:57:10.043 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2023-11-05T07:57:10.043 INFO:teuthology.orchestra.run.smithi052.stdout:Total 716 kB/s | 262 kB 00:00 2023-11-05T07:57:10.043 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2023-11-05T07:57:10.051 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2023-11-05T07:57:10.052 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2023-11-05T07:57:10.091 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2023-11-05T07:57:10.092 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2023-11-05T07:57:10.313 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-fuse-2:18.0.0-6776.g420cd129.el9.x86_64 2/2 2023-11-05T07:57:10.313 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-fuse-2:18.0.0-6776.g420cd129.el9.x86_64 1/2 2023-11-05T07:57:10.317 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2023-11-05T07:57:10.385 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-volume-2:18.0.0-6776.g420cd129.el9.noarch 1/1 2023-11-05T07:57:10.402 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-volume-2:18.0.0-6776.g420cd129.el9.noarch 1/1 2023-11-05T07:57:10.402 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-05T07:57:10.402 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-11-05T07:57:10.403 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T07:57:10.613 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2023-11-05T07:57:10.613 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T07:57:10.614 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2023-11-05T07:57:10.614 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-fuse-2:18.0.0-6776.g420cd129.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2023-11-05T07:57:10.614 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T07:57:10.614 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2023-11-05T07:57:10.971 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum -y install ceph-volume 2023-11-05T07:57:11.536 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:01:32 ago on Sun 05 Nov 2023 07:55:39 AM UTC. 2023-11-05T07:57:11.557 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-volume-2:18.0.0-6776.g420cd129.el9.noarch 1/1 2023-11-05T07:57:11.558 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T07:57:11.558 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2023-11-05T07:57:11.558 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-volume-2:18.0.0-6776.g420cd129.el9.noarch 2023-11-05T07:57:11.558 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T07:57:11.558 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2023-11-05T07:57:11.681 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2023-11-05T07:57:11.682 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-05T07:57:11.682 INFO:teuthology.orchestra.run.smithi156.stdout: Package Arch Version Repository Size 2023-11-05T07:57:11.682 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-05T07:57:11.682 INFO:teuthology.orchestra.run.smithi156.stdout:Installing: 2023-11-05T07:57:11.683 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-volume noarch 2:18.0.0-6776.g420cd129.el9 ceph-noarch 262 k 2023-11-05T07:57:11.683 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T07:57:11.683 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2023-11-05T07:57:11.683 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-05T07:57:11.683 INFO:teuthology.orchestra.run.smithi156.stdout:Install 1 Package 2023-11-05T07:57:11.684 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T07:57:11.684 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 262 k 2023-11-05T07:57:11.684 INFO:teuthology.orchestra.run.smithi156.stdout:Installed size: 1.2 M 2023-11-05T07:57:11.684 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading Packages: 2023-11-05T07:57:11.863 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install librados-devel 2023-11-05T07:57:12.138 INFO:teuthology.orchestra.run.smithi156.stdout:ceph-volume-18.0.0-6776.g420cd129.el9.noarch.rp 576 kB/s | 262 kB 00:00 2023-11-05T07:57:12.139 INFO:teuthology.orchestra.run.smithi156.stdout:-------------------------------------------------------------------------------- 2023-11-05T07:57:12.139 INFO:teuthology.orchestra.run.smithi156.stdout:Total 574 kB/s | 262 kB 00:00 2023-11-05T07:57:12.139 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2023-11-05T07:57:12.147 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction check succeeded. 2023-11-05T07:57:12.147 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2023-11-05T07:57:12.181 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded. 2023-11-05T07:57:12.182 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2023-11-05T07:57:12.401 INFO:teuthology.orchestra.run.smithi156.stdout: Preparing : 1/1 2023-11-05T07:57:12.442 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:01:30 ago on Sun 05 Nov 2023 07:55:42 AM UTC. 2023-11-05T07:57:12.473 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-volume-2:18.0.0-6776.g420cd129.el9.noarch 1/1 2023-11-05T07:57:12.490 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-volume-2:18.0.0-6776.g420cd129.el9.noarch 1/1 2023-11-05T07:57:12.490 INFO:teuthology.orchestra.run.smithi156.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-05T07:57:12.491 INFO:teuthology.orchestra.run.smithi156.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-11-05T07:57:12.491 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T07:57:12.589 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2023-11-05T07:57:12.590 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-11-05T07:57:12.591 INFO:teuthology.orchestra.run.smithi052.stdout: Package Arch Version Repo Size 2023-11-05T07:57:12.591 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-11-05T07:57:12.591 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2023-11-05T07:57:12.591 INFO:teuthology.orchestra.run.smithi052.stdout: librados-devel x86_64 2:18.0.0-6776.g420cd129.el9 ceph 126 k 2023-11-05T07:57:12.591 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T07:57:12.592 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2023-11-05T07:57:12.592 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-11-05T07:57:12.592 INFO:teuthology.orchestra.run.smithi052.stdout:Install 1 Package 2023-11-05T07:57:12.592 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T07:57:12.592 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 126 k 2023-11-05T07:57:12.593 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 456 k 2023-11-05T07:57:12.593 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2023-11-05T07:57:13.038 INFO:teuthology.orchestra.run.smithi052.stdout:librados-devel-18.0.0-6776.g420cd129.el9.x86_64 283 kB/s | 126 kB 00:00 2023-11-05T07:57:13.039 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2023-11-05T07:57:13.039 INFO:teuthology.orchestra.run.smithi052.stdout:Total 282 kB/s | 126 kB 00:00 2023-11-05T07:57:13.039 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2023-11-05T07:57:13.045 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2023-11-05T07:57:13.045 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2023-11-05T07:57:13.104 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2023-11-05T07:57:13.104 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2023-11-05T07:57:13.257 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2023-11-05T07:57:13.355 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : librados-devel-2:18.0.0-6776.g420cd129.el9.x86_64 1/1 2023-11-05T07:57:13.477 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-volume-2:18.0.0-6776.g420cd129.el9.noarch 1/1 2023-11-05T07:57:13.478 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T07:57:13.478 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2023-11-05T07:57:13.478 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-volume-2:18.0.0-6776.g420cd129.el9.noarch 2023-11-05T07:57:13.478 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T07:57:13.478 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2023-11-05T07:57:13.767 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum -y install librados-devel 2023-11-05T07:57:13.800 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: librados-devel-2:18.0.0-6776.g420cd129.el9.x86_64 1/1 2023-11-05T07:57:14.114 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librados-devel-2:18.0.0-6776.g420cd129.el9.x86_64 1/1 2023-11-05T07:57:14.114 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T07:57:14.114 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2023-11-05T07:57:14.114 INFO:teuthology.orchestra.run.smithi052.stdout: librados-devel-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-05T07:57:14.115 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T07:57:14.115 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2023-11-05T07:57:14.328 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:01:35 ago on Sun 05 Nov 2023 07:55:39 AM UTC. 2023-11-05T07:57:14.366 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install libcephfs2 2023-11-05T07:57:14.472 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2023-11-05T07:57:14.473 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-05T07:57:14.474 INFO:teuthology.orchestra.run.smithi156.stdout: Package Arch Version Repo Size 2023-11-05T07:57:14.474 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-05T07:57:14.474 INFO:teuthology.orchestra.run.smithi156.stdout:Installing: 2023-11-05T07:57:14.475 INFO:teuthology.orchestra.run.smithi156.stdout: librados-devel x86_64 2:18.0.0-6776.g420cd129.el9 ceph 126 k 2023-11-05T07:57:14.475 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T07:57:14.476 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2023-11-05T07:57:14.476 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-05T07:57:14.476 INFO:teuthology.orchestra.run.smithi156.stdout:Install 1 Package 2023-11-05T07:57:14.477 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T07:57:14.477 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 126 k 2023-11-05T07:57:14.478 INFO:teuthology.orchestra.run.smithi156.stdout:Installed size: 456 k 2023-11-05T07:57:14.478 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading Packages: 2023-11-05T07:57:14.947 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:01:32 ago on Sun 05 Nov 2023 07:55:42 AM UTC. 2023-11-05T07:57:15.027 INFO:teuthology.orchestra.run.smithi156.stdout:librados-devel-18.0.0-6776.g420cd129.el9.x86_64 228 kB/s | 126 kB 00:00 2023-11-05T07:57:15.028 INFO:teuthology.orchestra.run.smithi156.stdout:-------------------------------------------------------------------------------- 2023-11-05T07:57:15.028 INFO:teuthology.orchestra.run.smithi156.stdout:Total 228 kB/s | 126 kB 00:00 2023-11-05T07:57:15.028 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2023-11-05T07:57:15.033 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction check succeeded. 2023-11-05T07:57:15.033 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2023-11-05T07:57:15.042 INFO:teuthology.orchestra.run.smithi052.stdout:Package libcephfs2-2:18.0.0-6776.g420cd129.el9.x86_64 is already installed. 2023-11-05T07:57:15.088 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded. 2023-11-05T07:57:15.089 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2023-11-05T07:57:15.094 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2023-11-05T07:57:15.096 INFO:teuthology.orchestra.run.smithi052.stdout:Nothing to do. 2023-11-05T07:57:15.096 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2023-11-05T07:57:15.158 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install libcephfs-devel 2023-11-05T07:57:15.235 INFO:teuthology.orchestra.run.smithi156.stdout: Preparing : 1/1 2023-11-05T07:57:15.334 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : librados-devel-2:18.0.0-6776.g420cd129.el9.x86_64 1/1 2023-11-05T07:57:15.733 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:01:33 ago on Sun 05 Nov 2023 07:55:42 AM UTC. 2023-11-05T07:57:15.761 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: librados-devel-2:18.0.0-6776.g420cd129.el9.x86_64 1/1 2023-11-05T07:57:15.882 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2023-11-05T07:57:15.883 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-11-05T07:57:15.883 INFO:teuthology.orchestra.run.smithi052.stdout: Package Arch Version Repo Size 2023-11-05T07:57:15.883 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-11-05T07:57:15.883 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2023-11-05T07:57:15.883 INFO:teuthology.orchestra.run.smithi052.stdout: libcephfs-devel x86_64 2:18.0.0-6776.g420cd129.el9 ceph 31 k 2023-11-05T07:57:15.884 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T07:57:15.884 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2023-11-05T07:57:15.884 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-11-05T07:57:15.884 INFO:teuthology.orchestra.run.smithi052.stdout:Install 1 Package 2023-11-05T07:57:15.884 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T07:57:15.885 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 31 k 2023-11-05T07:57:15.885 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 139 k 2023-11-05T07:57:15.885 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2023-11-05T07:57:16.098 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librados-devel-2:18.0.0-6776.g420cd129.el9.x86_64 1/1 2023-11-05T07:57:16.098 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T07:57:16.098 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2023-11-05T07:57:16.099 INFO:teuthology.orchestra.run.smithi156.stdout: librados-devel-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-05T07:57:16.099 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T07:57:16.099 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2023-11-05T07:57:16.291 INFO:teuthology.orchestra.run.smithi052.stdout:libcephfs-devel-18.0.0-6776.g420cd129.el9.x86_6 76 kB/s | 31 kB 00:00 2023-11-05T07:57:16.291 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2023-11-05T07:57:16.292 INFO:teuthology.orchestra.run.smithi052.stdout:Total 76 kB/s | 31 kB 00:00 2023-11-05T07:57:16.292 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2023-11-05T07:57:16.296 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2023-11-05T07:57:16.296 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2023-11-05T07:57:16.321 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2023-11-05T07:57:16.322 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2023-11-05T07:57:16.344 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum -y install libcephfs2 2023-11-05T07:57:16.414 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2023-11-05T07:57:16.524 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libcephfs-devel-2:18.0.0-6776.g420cd129.el9.x86_64 1/1 2023-11-05T07:57:16.903 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:01:37 ago on Sun 05 Nov 2023 07:55:39 AM UTC. 2023-11-05T07:57:16.998 INFO:teuthology.orchestra.run.smithi156.stdout:Package libcephfs2-2:18.0.0-6776.g420cd129.el9.x86_64 is already installed. 2023-11-05T07:57:17.027 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: libcephfs-devel-2:18.0.0-6776.g420cd129.el9.x86_64 1/1 2023-11-05T07:57:17.050 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2023-11-05T07:57:17.051 INFO:teuthology.orchestra.run.smithi156.stdout:Nothing to do. 2023-11-05T07:57:17.051 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2023-11-05T07:57:17.127 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum -y install libcephfs-devel 2023-11-05T07:57:17.308 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libcephfs-devel-2:18.0.0-6776.g420cd129.el9.x86_64 1/1 2023-11-05T07:57:17.309 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T07:57:17.309 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2023-11-05T07:57:17.309 INFO:teuthology.orchestra.run.smithi052.stdout: libcephfs-devel-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-05T07:57:17.309 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T07:57:17.310 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2023-11-05T07:57:17.635 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install librados2 2023-11-05T07:57:17.672 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:01:38 ago on Sun 05 Nov 2023 07:55:39 AM UTC. 2023-11-05T07:57:17.814 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2023-11-05T07:57:17.815 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-05T07:57:17.815 INFO:teuthology.orchestra.run.smithi156.stdout: Package Arch Version Repo Size 2023-11-05T07:57:17.815 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-05T07:57:17.815 INFO:teuthology.orchestra.run.smithi156.stdout:Installing: 2023-11-05T07:57:17.815 INFO:teuthology.orchestra.run.smithi156.stdout: libcephfs-devel x86_64 2:18.0.0-6776.g420cd129.el9 ceph 31 k 2023-11-05T07:57:17.816 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T07:57:17.816 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2023-11-05T07:57:17.816 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-05T07:57:17.816 INFO:teuthology.orchestra.run.smithi156.stdout:Install 1 Package 2023-11-05T07:57:17.817 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T07:57:17.817 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 31 k 2023-11-05T07:57:17.817 INFO:teuthology.orchestra.run.smithi156.stdout:Installed size: 139 k 2023-11-05T07:57:17.817 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading Packages: 2023-11-05T07:57:18.139 INFO:teuthology.orchestra.run.smithi156.stdout:libcephfs-devel-18.0.0-6776.g420cd129.el9.x86_6 96 kB/s | 31 kB 00:00 2023-11-05T07:57:18.140 INFO:teuthology.orchestra.run.smithi156.stdout:-------------------------------------------------------------------------------- 2023-11-05T07:57:18.140 INFO:teuthology.orchestra.run.smithi156.stdout:Total 96 kB/s | 31 kB 00:00 2023-11-05T07:57:18.140 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2023-11-05T07:57:18.144 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction check succeeded. 2023-11-05T07:57:18.144 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2023-11-05T07:57:18.179 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded. 2023-11-05T07:57:18.180 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2023-11-05T07:57:18.212 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:01:36 ago on Sun 05 Nov 2023 07:55:42 AM UTC. 2023-11-05T07:57:18.267 INFO:teuthology.orchestra.run.smithi156.stdout: Preparing : 1/1 2023-11-05T07:57:18.306 INFO:teuthology.orchestra.run.smithi052.stdout:Package librados2-2:18.0.0-6776.g420cd129.el9.x86_64 is already installed. 2023-11-05T07:57:18.359 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2023-11-05T07:57:18.360 INFO:teuthology.orchestra.run.smithi052.stdout:Nothing to do. 2023-11-05T07:57:18.360 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2023-11-05T07:57:18.378 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libcephfs-devel-2:18.0.0-6776.g420cd129.el9.x86_64 1/1 2023-11-05T07:57:18.424 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install librbd1 2023-11-05T07:57:18.759 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: libcephfs-devel-2:18.0.0-6776.g420cd129.el9.x86_64 1/1 2023-11-05T07:57:19.002 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:01:37 ago on Sun 05 Nov 2023 07:55:42 AM UTC. 2023-11-05T07:57:19.025 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libcephfs-devel-2:18.0.0-6776.g420cd129.el9.x86_64 1/1 2023-11-05T07:57:19.025 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T07:57:19.026 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2023-11-05T07:57:19.026 INFO:teuthology.orchestra.run.smithi156.stdout: libcephfs-devel-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-05T07:57:19.026 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T07:57:19.026 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2023-11-05T07:57:19.095 INFO:teuthology.orchestra.run.smithi052.stdout:Package librbd1-2:18.0.0-6776.g420cd129.el9.x86_64 is already installed. 2023-11-05T07:57:19.148 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2023-11-05T07:57:19.149 INFO:teuthology.orchestra.run.smithi052.stdout:Nothing to do. 2023-11-05T07:57:19.149 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2023-11-05T07:57:19.220 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install python3-rados 2023-11-05T07:57:19.227 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum -y install librados2 2023-11-05T07:57:19.783 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:01:40 ago on Sun 05 Nov 2023 07:55:39 AM UTC. 2023-11-05T07:57:19.795 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:01:37 ago on Sun 05 Nov 2023 07:55:42 AM UTC. 2023-11-05T07:57:19.873 INFO:teuthology.orchestra.run.smithi156.stdout:Package librados2-2:18.0.0-6776.g420cd129.el9.x86_64 is already installed. 2023-11-05T07:57:19.889 INFO:teuthology.orchestra.run.smithi052.stdout:Package python3-rados-2:18.0.0-6776.g420cd129.el9.x86_64 is already installed. 2023-11-05T07:57:19.923 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2023-11-05T07:57:19.924 INFO:teuthology.orchestra.run.smithi156.stdout:Nothing to do. 2023-11-05T07:57:19.924 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2023-11-05T07:57:19.942 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2023-11-05T07:57:19.943 INFO:teuthology.orchestra.run.smithi052.stdout:Nothing to do. 2023-11-05T07:57:19.943 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2023-11-05T07:57:20.007 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum -y install librbd1 2023-11-05T07:57:20.012 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install python3-rgw 2023-11-05T07:57:20.558 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:01:41 ago on Sun 05 Nov 2023 07:55:39 AM UTC. 2023-11-05T07:57:20.589 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:01:38 ago on Sun 05 Nov 2023 07:55:42 AM UTC. 2023-11-05T07:57:20.650 INFO:teuthology.orchestra.run.smithi156.stdout:Package librbd1-2:18.0.0-6776.g420cd129.el9.x86_64 is already installed. 2023-11-05T07:57:20.682 INFO:teuthology.orchestra.run.smithi052.stdout:Package python3-rgw-2:18.0.0-6776.g420cd129.el9.x86_64 is already installed. 2023-11-05T07:57:20.700 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2023-11-05T07:57:20.701 INFO:teuthology.orchestra.run.smithi156.stdout:Nothing to do. 2023-11-05T07:57:20.701 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2023-11-05T07:57:20.735 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2023-11-05T07:57:20.736 INFO:teuthology.orchestra.run.smithi052.stdout:Nothing to do. 2023-11-05T07:57:20.736 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2023-11-05T07:57:20.782 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum -y install python3-rados 2023-11-05T07:57:20.811 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install python3-cephfs 2023-11-05T07:57:21.330 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:01:42 ago on Sun 05 Nov 2023 07:55:39 AM UTC. 2023-11-05T07:57:21.385 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:01:39 ago on Sun 05 Nov 2023 07:55:42 AM UTC. 2023-11-05T07:57:21.421 INFO:teuthology.orchestra.run.smithi156.stdout:Package python3-rados-2:18.0.0-6776.g420cd129.el9.x86_64 is already installed. 2023-11-05T07:57:21.470 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2023-11-05T07:57:21.471 INFO:teuthology.orchestra.run.smithi156.stdout:Nothing to do. 2023-11-05T07:57:21.472 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2023-11-05T07:57:21.480 INFO:teuthology.orchestra.run.smithi052.stdout:Package python3-cephfs-2:18.0.0-6776.g420cd129.el9.x86_64 is already installed. 2023-11-05T07:57:21.533 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2023-11-05T07:57:21.535 INFO:teuthology.orchestra.run.smithi052.stdout:Nothing to do. 2023-11-05T07:57:21.536 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2023-11-05T07:57:21.556 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum -y install python3-rgw 2023-11-05T07:57:21.602 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install python3-rbd 2023-11-05T07:57:22.101 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:01:43 ago on Sun 05 Nov 2023 07:55:39 AM UTC. 2023-11-05T07:57:22.176 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:01:40 ago on Sun 05 Nov 2023 07:55:42 AM UTC. 2023-11-05T07:57:22.193 INFO:teuthology.orchestra.run.smithi156.stdout:Package python3-rgw-2:18.0.0-6776.g420cd129.el9.x86_64 is already installed. 2023-11-05T07:57:22.247 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2023-11-05T07:57:22.248 INFO:teuthology.orchestra.run.smithi156.stdout:Nothing to do. 2023-11-05T07:57:22.248 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2023-11-05T07:57:22.269 INFO:teuthology.orchestra.run.smithi052.stdout:Package python3-rbd-2:18.0.0-6776.g420cd129.el9.x86_64 is already installed. 2023-11-05T07:57:22.322 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2023-11-05T07:57:22.323 INFO:teuthology.orchestra.run.smithi052.stdout:Nothing to do. 2023-11-05T07:57:22.323 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2023-11-05T07:57:22.334 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum -y install python3-cephfs 2023-11-05T07:57:22.402 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install rbd-fuse 2023-11-05T07:57:22.879 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:01:43 ago on Sun 05 Nov 2023 07:55:39 AM UTC. 2023-11-05T07:57:22.971 INFO:teuthology.orchestra.run.smithi156.stdout:Package python3-cephfs-2:18.0.0-6776.g420cd129.el9.x86_64 is already installed. 2023-11-05T07:57:22.983 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:01:40 ago on Sun 05 Nov 2023 07:55:42 AM UTC. 2023-11-05T07:57:23.021 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2023-11-05T07:57:23.022 INFO:teuthology.orchestra.run.smithi156.stdout:Nothing to do. 2023-11-05T07:57:23.022 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2023-11-05T07:57:23.099 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum -y install python3-rbd 2023-11-05T07:57:23.129 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2023-11-05T07:57:23.130 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-11-05T07:57:23.130 INFO:teuthology.orchestra.run.smithi052.stdout: Package Architecture Version Repository Size 2023-11-05T07:57:23.130 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-11-05T07:57:23.131 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2023-11-05T07:57:23.131 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-fuse x86_64 2:18.0.0-6776.g420cd129.el9 ceph 85 k 2023-11-05T07:57:23.131 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T07:57:23.131 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2023-11-05T07:57:23.131 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-11-05T07:57:23.131 INFO:teuthology.orchestra.run.smithi052.stdout:Install 1 Package 2023-11-05T07:57:23.132 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T07:57:23.132 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 85 k 2023-11-05T07:57:23.132 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 227 k 2023-11-05T07:57:23.132 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2023-11-05T07:57:23.452 INFO:teuthology.orchestra.run.smithi052.stdout:rbd-fuse-18.0.0-6776.g420cd129.el9.x86_64.rpm 265 kB/s | 85 kB 00:00 2023-11-05T07:57:23.453 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2023-11-05T07:57:23.453 INFO:teuthology.orchestra.run.smithi052.stdout:Total 263 kB/s | 85 kB 00:00 2023-11-05T07:57:23.453 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2023-11-05T07:57:23.461 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2023-11-05T07:57:23.461 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2023-11-05T07:57:23.520 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2023-11-05T07:57:23.520 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2023-11-05T07:57:23.644 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:01:44 ago on Sun 05 Nov 2023 07:55:39 AM UTC. 2023-11-05T07:57:23.668 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2023-11-05T07:57:23.736 INFO:teuthology.orchestra.run.smithi156.stdout:Package python3-rbd-2:18.0.0-6776.g420cd129.el9.x86_64 is already installed. 2023-11-05T07:57:23.785 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2023-11-05T07:57:23.786 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : rbd-fuse-2:18.0.0-6776.g420cd129.el9.x86_64 1/1 2023-11-05T07:57:23.787 INFO:teuthology.orchestra.run.smithi156.stdout:Nothing to do. 2023-11-05T07:57:23.787 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2023-11-05T07:57:23.864 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum -y install rbd-fuse 2023-11-05T07:57:24.165 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: rbd-fuse-2:18.0.0-6776.g420cd129.el9.x86_64 1/1 2023-11-05T07:57:24.417 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:01:45 ago on Sun 05 Nov 2023 07:55:39 AM UTC. 2023-11-05T07:57:24.465 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : rbd-fuse-2:18.0.0-6776.g420cd129.el9.x86_64 1/1 2023-11-05T07:57:24.466 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T07:57:24.466 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2023-11-05T07:57:24.466 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-fuse-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-05T07:57:24.466 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T07:57:24.466 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2023-11-05T07:57:24.558 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2023-11-05T07:57:24.559 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-05T07:57:24.559 INFO:teuthology.orchestra.run.smithi156.stdout: Package Architecture Version Repository Size 2023-11-05T07:57:24.559 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-05T07:57:24.560 INFO:teuthology.orchestra.run.smithi156.stdout:Installing: 2023-11-05T07:57:24.560 INFO:teuthology.orchestra.run.smithi156.stdout: rbd-fuse x86_64 2:18.0.0-6776.g420cd129.el9 ceph 85 k 2023-11-05T07:57:24.560 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T07:57:24.560 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2023-11-05T07:57:24.560 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-05T07:57:24.561 INFO:teuthology.orchestra.run.smithi156.stdout:Install 1 Package 2023-11-05T07:57:24.561 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T07:57:24.561 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 85 k 2023-11-05T07:57:24.561 INFO:teuthology.orchestra.run.smithi156.stdout:Installed size: 227 k 2023-11-05T07:57:24.561 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading Packages: 2023-11-05T07:57:24.706 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install rbd-mirror 2023-11-05T07:57:24.843 INFO:teuthology.orchestra.run.smithi156.stdout:rbd-fuse-18.0.0-6776.g420cd129.el9.x86_64.rpm 301 kB/s | 85 kB 00:00 2023-11-05T07:57:24.843 INFO:teuthology.orchestra.run.smithi156.stdout:-------------------------------------------------------------------------------- 2023-11-05T07:57:24.844 INFO:teuthology.orchestra.run.smithi156.stdout:Total 299 kB/s | 85 kB 00:00 2023-11-05T07:57:24.844 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2023-11-05T07:57:24.850 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction check succeeded. 2023-11-05T07:57:24.851 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2023-11-05T07:57:24.906 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded. 2023-11-05T07:57:24.906 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2023-11-05T07:57:25.045 INFO:teuthology.orchestra.run.smithi156.stdout: Preparing : 1/1 2023-11-05T07:57:25.148 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : rbd-fuse-2:18.0.0-6776.g420cd129.el9.x86_64 1/1 2023-11-05T07:57:25.294 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:01:43 ago on Sun 05 Nov 2023 07:55:42 AM UTC. 2023-11-05T07:57:25.441 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2023-11-05T07:57:25.442 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-11-05T07:57:25.442 INFO:teuthology.orchestra.run.smithi052.stdout: Package Arch Version Repo Size 2023-11-05T07:57:25.442 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-11-05T07:57:25.443 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2023-11-05T07:57:25.443 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-mirror x86_64 2:18.0.0-6776.g420cd129.el9 ceph 3.0 M 2023-11-05T07:57:25.443 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T07:57:25.443 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2023-11-05T07:57:25.443 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-11-05T07:57:25.443 INFO:teuthology.orchestra.run.smithi052.stdout:Install 1 Package 2023-11-05T07:57:25.444 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T07:57:25.444 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 3.0 M 2023-11-05T07:57:25.444 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 12 M 2023-11-05T07:57:25.444 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2023-11-05T07:57:25.537 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: rbd-fuse-2:18.0.0-6776.g420cd129.el9.x86_64 1/1 2023-11-05T07:57:25.788 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : rbd-fuse-2:18.0.0-6776.g420cd129.el9.x86_64 1/1 2023-11-05T07:57:25.789 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T07:57:25.789 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2023-11-05T07:57:25.789 INFO:teuthology.orchestra.run.smithi156.stdout: rbd-fuse-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-05T07:57:25.789 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T07:57:25.789 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2023-11-05T07:57:25.971 INFO:teuthology.orchestra.run.smithi052.stdout:rbd-mirror-18.0.0-6776.g420cd129.el9.x86_64.rpm 5.7 MB/s | 3.0 MB 00:00 2023-11-05T07:57:25.972 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2023-11-05T07:57:25.972 INFO:teuthology.orchestra.run.smithi052.stdout:Total 5.7 MB/s | 3.0 MB 00:00 2023-11-05T07:57:25.973 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2023-11-05T07:57:25.982 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2023-11-05T07:57:25.983 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2023-11-05T07:57:26.034 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum -y install rbd-mirror 2023-11-05T07:57:26.058 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2023-11-05T07:57:26.059 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2023-11-05T07:57:26.501 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2023-11-05T07:57:26.555 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : rbd-mirror-2:18.0.0-6776.g420cd129.el9.x86_64 1/1 2023-11-05T07:57:26.581 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6776.g420cd129.el9.x86_64 1/1 2023-11-05T07:57:26.581 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-05T07:57:26.581 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-11-05T07:57:26.581 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-11-05T07:57:26.582 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-11-05T07:57:26.582 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T07:57:26.595 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:01:47 ago on Sun 05 Nov 2023 07:55:39 AM UTC. 2023-11-05T07:57:26.741 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2023-11-05T07:57:26.742 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-05T07:57:26.742 INFO:teuthology.orchestra.run.smithi156.stdout: Package Arch Version Repo Size 2023-11-05T07:57:26.742 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-05T07:57:26.742 INFO:teuthology.orchestra.run.smithi156.stdout:Installing: 2023-11-05T07:57:26.743 INFO:teuthology.orchestra.run.smithi156.stdout: rbd-mirror x86_64 2:18.0.0-6776.g420cd129.el9 ceph 3.0 M 2023-11-05T07:57:26.743 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T07:57:26.743 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2023-11-05T07:57:26.743 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-05T07:57:26.743 INFO:teuthology.orchestra.run.smithi156.stdout:Install 1 Package 2023-11-05T07:57:26.744 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T07:57:26.744 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 3.0 M 2023-11-05T07:57:26.744 INFO:teuthology.orchestra.run.smithi156.stdout:Installed size: 12 M 2023-11-05T07:57:26.744 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading Packages: 2023-11-05T07:57:27.105 INFO:teuthology.orchestra.run.smithi156.stdout:rbd-mirror-18.0.0-6776.g420cd129.el9.x86_64.rpm 8.3 MB/s | 3.0 MB 00:00 2023-11-05T07:57:27.106 INFO:teuthology.orchestra.run.smithi156.stdout:-------------------------------------------------------------------------------- 2023-11-05T07:57:27.106 INFO:teuthology.orchestra.run.smithi156.stdout:Total 8.3 MB/s | 3.0 MB 00:00 2023-11-05T07:57:27.107 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2023-11-05T07:57:27.115 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction check succeeded. 2023-11-05T07:57:27.115 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2023-11-05T07:57:27.187 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded. 2023-11-05T07:57:27.188 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2023-11-05T07:57:27.611 INFO:teuthology.orchestra.run.smithi156.stdout: Preparing : 1/1 2023-11-05T07:57:27.673 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : rbd-mirror-2:18.0.0-6776.g420cd129.el9.x86_64 1/1 2023-11-05T07:57:27.690 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : rbd-mirror-2:18.0.0-6776.g420cd129.el9.x86_64 1/1 2023-11-05T07:57:27.690 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T07:57:27.690 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2023-11-05T07:57:27.690 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-mirror-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-05T07:57:27.691 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T07:57:27.691 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2023-11-05T07:57:27.697 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6776.g420cd129.el9.x86_64 1/1 2023-11-05T07:57:27.697 INFO:teuthology.orchestra.run.smithi156.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-05T07:57:27.697 INFO:teuthology.orchestra.run.smithi156.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-11-05T07:57:27.697 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-11-05T07:57:27.698 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-11-05T07:57:27.698 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T07:57:27.909 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install rbd-nbd 2023-11-05T07:57:28.492 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:01:46 ago on Sun 05 Nov 2023 07:55:42 AM UTC. 2023-11-05T07:57:28.639 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2023-11-05T07:57:28.640 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-11-05T07:57:28.640 INFO:teuthology.orchestra.run.smithi052.stdout: Package Architecture Version Repository Size 2023-11-05T07:57:28.641 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-11-05T07:57:28.641 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2023-11-05T07:57:28.641 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-nbd x86_64 2:18.0.0-6776.g420cd129.el9 ceph 169 k 2023-11-05T07:57:28.641 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T07:57:28.642 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2023-11-05T07:57:28.642 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-11-05T07:57:28.642 INFO:teuthology.orchestra.run.smithi052.stdout:Install 1 Package 2023-11-05T07:57:28.642 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T07:57:28.642 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 169 k 2023-11-05T07:57:28.642 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 490 k 2023-11-05T07:57:28.643 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2023-11-05T07:57:28.882 INFO:teuthology.orchestra.run.smithi052.stdout:rbd-nbd-18.0.0-6776.g420cd129.el9.x86_64.rpm 701 kB/s | 169 kB 00:00 2023-11-05T07:57:28.883 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2023-11-05T07:57:28.883 INFO:teuthology.orchestra.run.smithi052.stdout:Total 696 kB/s | 169 kB 00:00 2023-11-05T07:57:28.884 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2023-11-05T07:57:28.892 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2023-11-05T07:57:28.892 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2023-11-05T07:57:28.950 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2023-11-05T07:57:28.950 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2023-11-05T07:57:28.968 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : rbd-mirror-2:18.0.0-6776.g420cd129.el9.x86_64 1/1 2023-11-05T07:57:28.969 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T07:57:28.969 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2023-11-05T07:57:28.969 INFO:teuthology.orchestra.run.smithi156.stdout: rbd-mirror-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-05T07:57:28.969 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T07:57:28.969 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2023-11-05T07:57:29.101 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2023-11-05T07:57:29.208 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : rbd-nbd-2:18.0.0-6776.g420cd129.el9.x86_64 1/1 2023-11-05T07:57:29.243 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum -y install rbd-nbd 2023-11-05T07:57:29.658 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: rbd-nbd-2:18.0.0-6776.g420cd129.el9.x86_64 1/1 2023-11-05T07:57:29.804 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:01:50 ago on Sun 05 Nov 2023 07:55:39 AM UTC. 2023-11-05T07:57:29.945 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2023-11-05T07:57:29.946 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-05T07:57:29.946 INFO:teuthology.orchestra.run.smithi156.stdout: Package Architecture Version Repository Size 2023-11-05T07:57:29.946 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-05T07:57:29.946 INFO:teuthology.orchestra.run.smithi156.stdout:Installing: 2023-11-05T07:57:29.947 INFO:teuthology.orchestra.run.smithi156.stdout: rbd-nbd x86_64 2:18.0.0-6776.g420cd129.el9 ceph 169 k 2023-11-05T07:57:29.947 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T07:57:29.947 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2023-11-05T07:57:29.947 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-05T07:57:29.947 INFO:teuthology.orchestra.run.smithi156.stdout:Install 1 Package 2023-11-05T07:57:29.948 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T07:57:29.948 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 169 k 2023-11-05T07:57:29.948 INFO:teuthology.orchestra.run.smithi156.stdout:Installed size: 490 k 2023-11-05T07:57:29.948 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading Packages: 2023-11-05T07:57:30.005 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : rbd-nbd-2:18.0.0-6776.g420cd129.el9.x86_64 1/1 2023-11-05T07:57:30.005 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T07:57:30.005 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2023-11-05T07:57:30.006 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-nbd-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-05T07:57:30.006 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T07:57:30.006 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2023-11-05T07:57:30.192 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install ceph-base-debuginfo 2023-11-05T07:57:30.260 INFO:teuthology.orchestra.run.smithi156.stdout:rbd-nbd-18.0.0-6776.g420cd129.el9.x86_64.rpm 539 kB/s | 169 kB 00:00 2023-11-05T07:57:30.260 INFO:teuthology.orchestra.run.smithi156.stdout:-------------------------------------------------------------------------------- 2023-11-05T07:57:30.261 INFO:teuthology.orchestra.run.smithi156.stdout:Total 537 kB/s | 169 kB 00:00 2023-11-05T07:57:30.261 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2023-11-05T07:57:30.269 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction check succeeded. 2023-11-05T07:57:30.269 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2023-11-05T07:57:30.326 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded. 2023-11-05T07:57:30.327 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2023-11-05T07:57:30.475 INFO:teuthology.orchestra.run.smithi156.stdout: Preparing : 1/1 2023-11-05T07:57:30.585 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : rbd-nbd-2:18.0.0-6776.g420cd129.el9.x86_64 1/1 2023-11-05T07:57:30.775 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:01:48 ago on Sun 05 Nov 2023 07:55:42 AM UTC. 2023-11-05T07:57:30.928 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2023-11-05T07:57:30.929 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-11-05T07:57:30.929 INFO:teuthology.orchestra.run.smithi052.stdout: Package Arch Version Repo Size 2023-11-05T07:57:30.929 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-11-05T07:57:30.930 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2023-11-05T07:57:30.930 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-base-debuginfo x86_64 2:18.0.0-6776.g420cd129.el9 ceph 74 M 2023-11-05T07:57:30.930 INFO:teuthology.orchestra.run.smithi052.stdout:Installing dependencies: 2023-11-05T07:57:30.930 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-debuginfo x86_64 2:18.0.0-6776.g420cd129.el9 ceph 21 M 2023-11-05T07:57:30.930 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T07:57:30.931 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2023-11-05T07:57:30.931 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-11-05T07:57:30.931 INFO:teuthology.orchestra.run.smithi052.stdout:Install 2 Packages 2023-11-05T07:57:30.931 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T07:57:30.931 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 95 M 2023-11-05T07:57:30.932 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 515 M 2023-11-05T07:57:30.932 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2023-11-05T07:57:31.085 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: rbd-nbd-2:18.0.0-6776.g420cd129.el9.x86_64 1/1 2023-11-05T07:57:31.364 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : rbd-nbd-2:18.0.0-6776.g420cd129.el9.x86_64 1/1 2023-11-05T07:57:31.365 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T07:57:31.365 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2023-11-05T07:57:31.365 INFO:teuthology.orchestra.run.smithi156.stdout: rbd-nbd-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-05T07:57:31.365 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T07:57:31.365 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2023-11-05T07:57:31.603 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum -y install ceph-base-debuginfo 2023-11-05T07:57:32.162 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:01:53 ago on Sun 05 Nov 2023 07:55:39 AM UTC. 2023-11-05T07:57:32.309 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2023-11-05T07:57:32.310 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-05T07:57:32.310 INFO:teuthology.orchestra.run.smithi156.stdout: Package Arch Version Repo Size 2023-11-05T07:57:32.310 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-05T07:57:32.310 INFO:teuthology.orchestra.run.smithi156.stdout:Installing: 2023-11-05T07:57:32.311 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-base-debuginfo x86_64 2:18.0.0-6776.g420cd129.el9 ceph 74 M 2023-11-05T07:57:32.311 INFO:teuthology.orchestra.run.smithi156.stdout:Installing dependencies: 2023-11-05T07:57:32.311 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-debuginfo x86_64 2:18.0.0-6776.g420cd129.el9 ceph 21 M 2023-11-05T07:57:32.311 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T07:57:32.311 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2023-11-05T07:57:32.312 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-05T07:57:32.312 INFO:teuthology.orchestra.run.smithi156.stdout:Install 2 Packages 2023-11-05T07:57:32.312 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T07:57:32.313 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 95 M 2023-11-05T07:57:32.313 INFO:teuthology.orchestra.run.smithi156.stdout:Installed size: 515 M 2023-11-05T07:57:32.313 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading Packages: 2023-11-05T07:57:32.402 INFO:teuthology.orchestra.run.smithi052.stdout:(1/2): ceph-debuginfo-18.0.0-6776.g420cd129.el9 14 MB/s | 21 MB 00:01 2023-11-05T07:57:36.814 INFO:teuthology.orchestra.run.smithi156.stdout:(1/2): ceph-base-debuginfo-18.0.0-6776.g420cd12 16 MB/s | 74 MB 00:04 2023-11-05T07:57:38.268 INFO:teuthology.orchestra.run.smithi052.stdout:(2/2): ceph-base-debuginfo-18.0.0-6776.g420cd12 10 MB/s | 74 MB 00:07 2023-11-05T07:57:38.270 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2023-11-05T07:57:38.271 INFO:teuthology.orchestra.run.smithi052.stdout:Total 13 MB/s | 95 MB 00:07 2023-11-05T07:57:38.271 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2023-11-05T07:57:38.277 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2023-11-05T07:57:38.277 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2023-11-05T07:57:38.814 INFO:teuthology.orchestra.run.smithi156.stdout:(2/2): ceph-debuginfo-18.0.0-6776.g420cd129.el9 3.3 MB/s | 21 MB 00:06 2023-11-05T07:57:38.816 INFO:teuthology.orchestra.run.smithi156.stdout:-------------------------------------------------------------------------------- 2023-11-05T07:57:38.817 INFO:teuthology.orchestra.run.smithi156.stdout:Total 15 MB/s | 95 MB 00:06 2023-11-05T07:57:38.817 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2023-11-05T07:57:38.821 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction check succeeded. 2023-11-05T07:57:38.821 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2023-11-05T07:57:38.924 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2023-11-05T07:57:38.924 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2023-11-05T07:57:39.434 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded. 2023-11-05T07:57:39.435 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2023-11-05T07:57:42.098 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2023-11-05T07:57:42.499 INFO:teuthology.orchestra.run.smithi156.stdout: Preparing : 1/1 2023-11-05T07:57:50.173 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 1/2 2023-11-05T07:57:50.244 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 1/2 2023-11-05T07:57:50.305 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-base-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_ 2/2 2023-11-05T07:57:50.312 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-base-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_ 2/2 2023-11-05T07:57:53.775 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-base-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_ 2/2 2023-11-05T07:57:53.775 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-base-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_ 1/2 2023-11-05T07:57:53.794 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-base-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_ 2/2 2023-11-05T07:57:53.794 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-base-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_ 1/2 2023-11-05T07:57:54.066 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 2/2 2023-11-05T07:57:54.066 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T07:57:54.067 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2023-11-05T07:57:54.067 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-base-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-05T07:57:54.067 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-05T07:57:54.067 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T07:57:54.067 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2023-11-05T07:57:54.074 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 2/2 2023-11-05T07:57:54.075 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T07:57:54.075 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2023-11-05T07:57:54.075 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-base-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-05T07:57:54.075 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-05T07:57:54.075 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T07:57:54.076 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2023-11-05T07:57:54.293 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install ceph-common-debuginfo 2023-11-05T07:57:54.317 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum -y install ceph-common-debuginfo 2023-11-05T07:57:54.872 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:02:12 ago on Sun 05 Nov 2023 07:55:42 AM UTC. 2023-11-05T07:57:54.874 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:02:15 ago on Sun 05 Nov 2023 07:55:39 AM UTC. 2023-11-05T07:57:55.016 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2023-11-05T07:57:55.017 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-05T07:57:55.017 INFO:teuthology.orchestra.run.smithi156.stdout: Package Arch Version Repo Size 2023-11-05T07:57:55.017 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-05T07:57:55.017 INFO:teuthology.orchestra.run.smithi156.stdout:Installing: 2023-11-05T07:57:55.017 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-common-debuginfo x86_64 2:18.0.0-6776.g420cd129.el9 ceph 408 M 2023-11-05T07:57:55.018 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T07:57:55.018 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2023-11-05T07:57:55.018 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-05T07:57:55.018 INFO:teuthology.orchestra.run.smithi156.stdout:Install 1 Package 2023-11-05T07:57:55.019 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T07:57:55.019 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 408 M 2023-11-05T07:57:55.019 INFO:teuthology.orchestra.run.smithi156.stdout:Installed size: 1.6 G 2023-11-05T07:57:55.019 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading Packages: 2023-11-05T07:57:55.020 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2023-11-05T07:57:55.021 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-11-05T07:57:55.021 INFO:teuthology.orchestra.run.smithi052.stdout: Package Arch Version Repo Size 2023-11-05T07:57:55.021 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-11-05T07:57:55.021 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2023-11-05T07:57:55.021 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-common-debuginfo x86_64 2:18.0.0-6776.g420cd129.el9 ceph 408 M 2023-11-05T07:57:55.022 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T07:57:55.022 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2023-11-05T07:57:55.023 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-11-05T07:57:55.023 INFO:teuthology.orchestra.run.smithi052.stdout:Install 1 Package 2023-11-05T07:57:55.023 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T07:57:55.024 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 408 M 2023-11-05T07:57:55.024 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 1.6 G 2023-11-05T07:57:55.024 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2023-11-05T07:58:19.283 INFO:teuthology.orchestra.run.smithi156.stdout:ceph-common-debuginfo-18.0.0-6776.g420cd129.el9 17 MB/s | 408 MB 00:24 2023-11-05T07:58:19.284 INFO:teuthology.orchestra.run.smithi156.stdout:-------------------------------------------------------------------------------- 2023-11-05T07:58:19.284 INFO:teuthology.orchestra.run.smithi156.stdout:Total 17 MB/s | 408 MB 00:24 2023-11-05T07:58:19.285 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2023-11-05T07:58:19.288 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction check succeeded. 2023-11-05T07:58:19.289 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2023-11-05T07:58:21.730 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded. 2023-11-05T07:58:21.731 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2023-11-05T07:58:39.693 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-common-debuginfo-18.0.0-6776.g420cd129.el9 9.1 MB/s | 408 MB 00:44 2023-11-05T07:58:39.694 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2023-11-05T07:58:39.695 INFO:teuthology.orchestra.run.smithi052.stdout:Total 9.1 MB/s | 408 MB 00:44 2023-11-05T07:58:39.695 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2023-11-05T07:58:39.699 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2023-11-05T07:58:39.700 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2023-11-05T07:58:42.261 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2023-11-05T07:58:42.261 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2023-11-05T07:59:02.841 INFO:teuthology.orchestra.run.smithi156.stdout: Preparing : 1/1 2023-11-05T07:59:03.270 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-common-debuginfo-2:18.0.0-6776.g420cd129.el9.x8 1/1 2023-11-05T07:59:11.559 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-common-debuginfo-2:18.0.0-6776.g420cd129.el9.x8 1/1 2023-11-05T07:59:11.833 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-common-debuginfo-2:18.0.0-6776.g420cd129.el9.x8 1/1 2023-11-05T07:59:11.833 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T07:59:11.834 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2023-11-05T07:59:11.834 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-common-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-05T07:59:11.834 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T07:59:11.834 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2023-11-05T07:59:12.085 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum -y install ceph-immutable-object-cache-debuginfo 2023-11-05T07:59:12.666 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:03:33 ago on Sun 05 Nov 2023 07:55:39 AM UTC. 2023-11-05T07:59:12.815 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2023-11-05T07:59:12.816 INFO:teuthology.orchestra.run.smithi156.stdout:======================================================================================== 2023-11-05T07:59:12.816 INFO:teuthology.orchestra.run.smithi156.stdout: Package Arch Version Repo Size 2023-11-05T07:59:12.817 INFO:teuthology.orchestra.run.smithi156.stdout:======================================================================================== 2023-11-05T07:59:12.817 INFO:teuthology.orchestra.run.smithi156.stdout:Installing: 2023-11-05T07:59:12.817 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-immutable-object-cache-debuginfo x86_64 2:18.0.0-6776.g420cd129.el9 ceph 1.4 M 2023-11-05T07:59:12.817 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T07:59:12.817 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2023-11-05T07:59:12.818 INFO:teuthology.orchestra.run.smithi156.stdout:======================================================================================== 2023-11-05T07:59:12.818 INFO:teuthology.orchestra.run.smithi156.stdout:Install 1 Package 2023-11-05T07:59:12.818 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T07:59:12.818 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 1.4 M 2023-11-05T07:59:12.818 INFO:teuthology.orchestra.run.smithi156.stdout:Installed size: 6.3 M 2023-11-05T07:59:12.819 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading Packages: 2023-11-05T07:59:15.465 INFO:teuthology.orchestra.run.smithi156.stdout:ceph-immutable-object-cache-debuginfo-18.0.0-67 557 kB/s | 1.4 MB 00:02 2023-11-05T07:59:15.466 INFO:teuthology.orchestra.run.smithi156.stdout:-------------------------------------------------------------------------------- 2023-11-05T07:59:15.466 INFO:teuthology.orchestra.run.smithi156.stdout:Total 556 kB/s | 1.4 MB 00:02 2023-11-05T07:59:15.466 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2023-11-05T07:59:15.470 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction check succeeded. 2023-11-05T07:59:15.470 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2023-11-05T07:59:15.517 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded. 2023-11-05T07:59:15.518 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2023-11-05T07:59:15.774 INFO:teuthology.orchestra.run.smithi156.stdout: Preparing : 1/1 2023-11-05T07:59:15.863 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-immutable-object-cache-debuginfo-2:18.0.0-6776. 1/1 2023-11-05T07:59:16.264 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-immutable-object-cache-debuginfo-2:18.0.0-6776. 1/1 2023-11-05T07:59:16.534 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-immutable-object-cache-debuginfo-2:18.0.0-6776. 1/1 2023-11-05T07:59:16.534 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T07:59:16.534 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2023-11-05T07:59:16.534 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-immutable-object-cache-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-05T07:59:16.535 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T07:59:16.535 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2023-11-05T07:59:16.722 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum -y install ceph-radosgw-debuginfo 2023-11-05T07:59:17.274 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:03:38 ago on Sun 05 Nov 2023 07:55:39 AM UTC. 2023-11-05T07:59:17.415 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2023-11-05T07:59:17.416 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-05T07:59:17.417 INFO:teuthology.orchestra.run.smithi156.stdout: Package Arch Version Repo Size 2023-11-05T07:59:17.417 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-05T07:59:17.417 INFO:teuthology.orchestra.run.smithi156.stdout:Installing: 2023-11-05T07:59:17.418 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-radosgw-debuginfo x86_64 2:18.0.0-6776.g420cd129.el9 ceph 174 M 2023-11-05T07:59:17.418 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T07:59:17.418 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2023-11-05T07:59:17.418 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-05T07:59:17.418 INFO:teuthology.orchestra.run.smithi156.stdout:Install 1 Package 2023-11-05T07:59:17.419 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T07:59:17.419 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 174 M 2023-11-05T07:59:17.419 INFO:teuthology.orchestra.run.smithi156.stdout:Installed size: 732 M 2023-11-05T07:59:17.419 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading Packages: 2023-11-05T07:59:25.951 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2023-11-05T07:59:26.051 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-common-debuginfo-2:18.0.0-6776.g420cd129.el9.x8 1/1 2023-11-05T07:59:29.498 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-common-debuginfo-2:18.0.0-6776.g420cd129.el9.x8 1/1 2023-11-05T07:59:29.788 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-common-debuginfo-2:18.0.0-6776.g420cd129.el9.x8 1/1 2023-11-05T07:59:29.788 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T07:59:29.789 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2023-11-05T07:59:29.789 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-common-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-05T07:59:29.789 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T07:59:29.789 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2023-11-05T07:59:29.985 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install ceph-immutable-object-cache-debuginfo 2023-11-05T07:59:30.560 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:03:48 ago on Sun 05 Nov 2023 07:55:42 AM UTC. 2023-11-05T07:59:30.707 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2023-11-05T07:59:30.708 INFO:teuthology.orchestra.run.smithi052.stdout:======================================================================================== 2023-11-05T07:59:30.708 INFO:teuthology.orchestra.run.smithi052.stdout: Package Arch Version Repo Size 2023-11-05T07:59:30.709 INFO:teuthology.orchestra.run.smithi052.stdout:======================================================================================== 2023-11-05T07:59:30.709 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2023-11-05T07:59:30.709 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-immutable-object-cache-debuginfo x86_64 2:18.0.0-6776.g420cd129.el9 ceph 1.4 M 2023-11-05T07:59:30.709 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T07:59:30.709 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2023-11-05T07:59:30.710 INFO:teuthology.orchestra.run.smithi052.stdout:======================================================================================== 2023-11-05T07:59:30.710 INFO:teuthology.orchestra.run.smithi052.stdout:Install 1 Package 2023-11-05T07:59:30.710 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T07:59:30.710 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 1.4 M 2023-11-05T07:59:30.710 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 6.3 M 2023-11-05T07:59:30.711 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2023-11-05T07:59:31.060 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-immutable-object-cache-debuginfo-18.0.0-67 4.1 MB/s | 1.4 MB 00:00 2023-11-05T07:59:31.061 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2023-11-05T07:59:31.061 INFO:teuthology.orchestra.run.smithi052.stdout:Total 4.1 MB/s | 1.4 MB 00:00 2023-11-05T07:59:31.062 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2023-11-05T07:59:31.065 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2023-11-05T07:59:31.065 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2023-11-05T07:59:31.110 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2023-11-05T07:59:31.111 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2023-11-05T07:59:31.387 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2023-11-05T07:59:31.487 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-immutable-object-cache-debuginfo-2:18.0.0-6776. 1/1 2023-11-05T07:59:31.903 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-immutable-object-cache-debuginfo-2:18.0.0-6776. 1/1 2023-11-05T07:59:32.189 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-immutable-object-cache-debuginfo-2:18.0.0-6776. 1/1 2023-11-05T07:59:32.189 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T07:59:32.189 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2023-11-05T07:59:32.190 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-immutable-object-cache-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-05T07:59:32.190 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T07:59:32.190 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2023-11-05T07:59:32.370 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install ceph-radosgw-debuginfo 2023-11-05T07:59:32.946 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:03:50 ago on Sun 05 Nov 2023 07:55:42 AM UTC. 2023-11-05T07:59:33.092 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2023-11-05T07:59:33.093 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-11-05T07:59:33.093 INFO:teuthology.orchestra.run.smithi052.stdout: Package Arch Version Repo Size 2023-11-05T07:59:33.094 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-11-05T07:59:33.094 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2023-11-05T07:59:33.094 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-radosgw-debuginfo x86_64 2:18.0.0-6776.g420cd129.el9 ceph 174 M 2023-11-05T07:59:33.094 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T07:59:33.095 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2023-11-05T07:59:33.095 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-11-05T07:59:33.095 INFO:teuthology.orchestra.run.smithi052.stdout:Install 1 Package 2023-11-05T07:59:33.095 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T07:59:33.096 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 174 M 2023-11-05T07:59:33.096 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 732 M 2023-11-05T07:59:33.096 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2023-11-05T07:59:45.281 INFO:teuthology.orchestra.run.smithi156.stdout:ceph-radosgw-debuginfo-18.0.0-6776.g420cd129.el 6.2 MB/s | 174 MB 00:27 2023-11-05T07:59:45.282 INFO:teuthology.orchestra.run.smithi156.stdout:-------------------------------------------------------------------------------- 2023-11-05T07:59:45.283 INFO:teuthology.orchestra.run.smithi156.stdout:Total 6.2 MB/s | 174 MB 00:27 2023-11-05T07:59:45.283 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2023-11-05T07:59:45.287 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction check succeeded. 2023-11-05T07:59:45.287 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2023-11-05T07:59:46.341 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded. 2023-11-05T07:59:46.342 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2023-11-05T07:59:49.670 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-radosgw-debuginfo-18.0.0-6776.g420cd129.el 11 MB/s | 174 MB 00:16 2023-11-05T07:59:49.671 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2023-11-05T07:59:49.672 INFO:teuthology.orchestra.run.smithi052.stdout:Total 11 MB/s | 174 MB 00:16 2023-11-05T07:59:49.672 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2023-11-05T07:59:49.676 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2023-11-05T07:59:49.676 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2023-11-05T07:59:50.784 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2023-11-05T07:59:50.784 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2023-11-05T08:00:04.363 INFO:teuthology.orchestra.run.smithi156.stdout: Preparing : 1/1 2023-11-05T08:00:04.452 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-radosgw-debuginfo-2:18.0.0-6776.g420cd129.el9.x 1/1 2023-11-05T08:00:09.137 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-radosgw-debuginfo-2:18.0.0-6776.g420cd129.el9.x 1/1 2023-11-05T08:00:09.399 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-radosgw-debuginfo-2:18.0.0-6776.g420cd129.el9.x 1/1 2023-11-05T08:00:09.400 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T08:00:09.400 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2023-11-05T08:00:09.400 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-radosgw-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-05T08:00:09.401 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T08:00:09.401 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2023-11-05T08:00:09.588 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2023-11-05T08:00:09.619 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum -y install ceph-test-debuginfo 2023-11-05T08:00:09.686 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-radosgw-debuginfo-2:18.0.0-6776.g420cd129.el9.x 1/1 2023-11-05T08:00:10.177 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:04:31 ago on Sun 05 Nov 2023 07:55:39 AM UTC. 2023-11-05T08:00:10.318 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2023-11-05T08:00:10.319 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-05T08:00:10.319 INFO:teuthology.orchestra.run.smithi156.stdout: Package Arch Version Repo Size 2023-11-05T08:00:10.320 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-05T08:00:10.320 INFO:teuthology.orchestra.run.smithi156.stdout:Installing: 2023-11-05T08:00:10.320 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-test-debuginfo x86_64 2:18.0.0-6776.g420cd129.el9 ceph 630 M 2023-11-05T08:00:10.320 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T08:00:10.320 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2023-11-05T08:00:10.321 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-05T08:00:10.321 INFO:teuthology.orchestra.run.smithi156.stdout:Install 1 Package 2023-11-05T08:00:10.321 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T08:00:10.321 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 630 M 2023-11-05T08:00:10.321 INFO:teuthology.orchestra.run.smithi156.stdout:Installed size: 2.8 G 2023-11-05T08:00:10.321 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading Packages: 2023-11-05T08:00:14.242 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-radosgw-debuginfo-2:18.0.0-6776.g420cd129.el9.x 1/1 2023-11-05T08:00:14.651 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-radosgw-debuginfo-2:18.0.0-6776.g420cd129.el9.x 1/1 2023-11-05T08:00:14.651 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:00:14.652 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2023-11-05T08:00:14.652 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-radosgw-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-05T08:00:14.652 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:00:14.652 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2023-11-05T08:00:14.854 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install ceph-test-debuginfo 2023-11-05T08:00:15.432 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:04:33 ago on Sun 05 Nov 2023 07:55:42 AM UTC. 2023-11-05T08:00:15.581 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2023-11-05T08:00:15.582 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-11-05T08:00:15.582 INFO:teuthology.orchestra.run.smithi052.stdout: Package Arch Version Repo Size 2023-11-05T08:00:15.583 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-11-05T08:00:15.583 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2023-11-05T08:00:15.583 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-test-debuginfo x86_64 2:18.0.0-6776.g420cd129.el9 ceph 630 M 2023-11-05T08:00:15.583 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:00:15.584 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2023-11-05T08:00:15.584 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-11-05T08:00:15.584 INFO:teuthology.orchestra.run.smithi052.stdout:Install 1 Package 2023-11-05T08:00:15.584 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:00:15.584 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 630 M 2023-11-05T08:00:15.584 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 2.8 G 2023-11-05T08:00:15.585 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2023-11-05T08:00:51.003 INFO:teuthology.orchestra.run.smithi156.stdout:ceph-test-debuginfo-18.0.0-6776.g420cd129.el9.x 15 MB/s | 630 MB 00:40 2023-11-05T08:00:51.004 INFO:teuthology.orchestra.run.smithi156.stdout:-------------------------------------------------------------------------------- 2023-11-05T08:00:51.004 INFO:teuthology.orchestra.run.smithi156.stdout:Total 15 MB/s | 630 MB 00:40 2023-11-05T08:00:51.004 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2023-11-05T08:00:51.008 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction check succeeded. 2023-11-05T08:00:51.008 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2023-11-05T08:00:54.768 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded. 2023-11-05T08:00:54.769 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2023-11-05T08:00:59.658 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-test-debuginfo-18.0.0-6776.g420cd129.el9.x 14 MB/s | 630 MB 00:44 2023-11-05T08:00:59.659 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2023-11-05T08:00:59.660 INFO:teuthology.orchestra.run.smithi052.stdout:Total 14 MB/s | 630 MB 00:44 2023-11-05T08:00:59.660 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2023-11-05T08:00:59.666 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2023-11-05T08:00:59.666 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2023-11-05T08:01:03.587 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2023-11-05T08:01:03.588 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2023-11-05T08:02:00.676 INFO:teuthology.orchestra.run.smithi156.stdout: Preparing : 1/1 2023-11-05T08:02:00.786 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-test-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_ 1/1 2023-11-05T08:02:08.341 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-test-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_ 1/1 2023-11-05T08:02:08.624 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-test-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_ 1/1 2023-11-05T08:02:08.625 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T08:02:08.625 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2023-11-05T08:02:08.625 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-test-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-05T08:02:08.625 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T08:02:08.626 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2023-11-05T08:02:08.909 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum -y install ceph-base-debuginfo 2023-11-05T08:02:09.462 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:06:30 ago on Sun 05 Nov 2023 07:55:39 AM UTC. 2023-11-05T08:02:09.552 INFO:teuthology.orchestra.run.smithi156.stdout:Package ceph-base-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 is already installed. 2023-11-05T08:02:09.602 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2023-11-05T08:02:09.603 INFO:teuthology.orchestra.run.smithi156.stdout:Nothing to do. 2023-11-05T08:02:09.604 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2023-11-05T08:02:09.677 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum -y install ceph-mgr-debuginfo 2023-11-05T08:02:10.226 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:06:31 ago on Sun 05 Nov 2023 07:55:39 AM UTC. 2023-11-05T08:02:10.365 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2023-11-05T08:02:10.366 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-05T08:02:10.367 INFO:teuthology.orchestra.run.smithi156.stdout: Package Arch Version Repo Size 2023-11-05T08:02:10.367 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-05T08:02:10.367 INFO:teuthology.orchestra.run.smithi156.stdout:Installing: 2023-11-05T08:02:10.367 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-debuginfo x86_64 2:18.0.0-6776.g420cd129.el9 ceph 19 M 2023-11-05T08:02:10.368 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T08:02:10.368 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2023-11-05T08:02:10.368 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-05T08:02:10.368 INFO:teuthology.orchestra.run.smithi156.stdout:Install 1 Package 2023-11-05T08:02:10.368 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T08:02:10.368 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 19 M 2023-11-05T08:02:10.369 INFO:teuthology.orchestra.run.smithi156.stdout:Installed size: 101 M 2023-11-05T08:02:10.369 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading Packages: 2023-11-05T08:02:13.589 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2023-11-05T08:02:14.048 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-test-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_ 1/1 2023-11-05T08:02:14.672 INFO:teuthology.orchestra.run.smithi156.stdout:ceph-mgr-debuginfo-18.0.0-6776.g420cd129.el9.x8 4.5 MB/s | 19 MB 00:04 2023-11-05T08:02:14.673 INFO:teuthology.orchestra.run.smithi156.stdout:-------------------------------------------------------------------------------- 2023-11-05T08:02:14.674 INFO:teuthology.orchestra.run.smithi156.stdout:Total 4.5 MB/s | 19 MB 00:04 2023-11-05T08:02:14.674 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2023-11-05T08:02:14.678 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction check succeeded. 2023-11-05T08:02:14.678 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2023-11-05T08:02:14.826 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded. 2023-11-05T08:02:14.826 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2023-11-05T08:02:17.006 INFO:teuthology.orchestra.run.smithi156.stdout: Preparing : 1/1 2023-11-05T08:02:17.104 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-mgr-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_6 1/1 2023-11-05T08:02:18.128 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-mgr-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_6 1/1 2023-11-05T08:02:18.413 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mgr-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_6 1/1 2023-11-05T08:02:18.414 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T08:02:18.414 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2023-11-05T08:02:18.414 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-05T08:02:18.415 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T08:02:18.415 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2023-11-05T08:02:18.612 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum -y install ceph-mds-debuginfo 2023-11-05T08:02:19.161 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:06:40 ago on Sun 05 Nov 2023 07:55:39 AM UTC. 2023-11-05T08:02:19.302 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2023-11-05T08:02:19.303 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-05T08:02:19.303 INFO:teuthology.orchestra.run.smithi156.stdout: Package Arch Version Repo Size 2023-11-05T08:02:19.303 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-05T08:02:19.303 INFO:teuthology.orchestra.run.smithi156.stdout:Installing: 2023-11-05T08:02:19.304 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mds-debuginfo x86_64 2:18.0.0-6776.g420cd129.el9 ceph 47 M 2023-11-05T08:02:19.304 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T08:02:19.304 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2023-11-05T08:02:19.304 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-05T08:02:19.304 INFO:teuthology.orchestra.run.smithi156.stdout:Install 1 Package 2023-11-05T08:02:19.305 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T08:02:19.305 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 47 M 2023-11-05T08:02:19.305 INFO:teuthology.orchestra.run.smithi156.stdout:Installed size: 169 M 2023-11-05T08:02:19.305 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading Packages: 2023-11-05T08:02:21.328 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-test-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_ 1/1 2023-11-05T08:02:21.599 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-test-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_ 1/1 2023-11-05T08:02:21.599 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:02:21.600 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2023-11-05T08:02:21.600 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-test-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-05T08:02:21.600 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:02:21.600 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2023-11-05T08:02:21.856 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install ceph-base-debuginfo 2023-11-05T08:02:22.350 INFO:teuthology.orchestra.run.smithi156.stdout:ceph-mds-debuginfo-18.0.0-6776.g420cd129.el9.x8 15 MB/s | 47 MB 00:03 2023-11-05T08:02:22.351 INFO:teuthology.orchestra.run.smithi156.stdout:-------------------------------------------------------------------------------- 2023-11-05T08:02:22.352 INFO:teuthology.orchestra.run.smithi156.stdout:Total 15 MB/s | 47 MB 00:03 2023-11-05T08:02:22.352 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2023-11-05T08:02:22.356 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction check succeeded. 2023-11-05T08:02:22.356 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2023-11-05T08:02:22.435 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:06:40 ago on Sun 05 Nov 2023 07:55:42 AM UTC. 2023-11-05T08:02:22.529 INFO:teuthology.orchestra.run.smithi052.stdout:Package ceph-base-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 is already installed. 2023-11-05T08:02:22.581 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2023-11-05T08:02:22.583 INFO:teuthology.orchestra.run.smithi052.stdout:Nothing to do. 2023-11-05T08:02:22.583 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2023-11-05T08:02:22.660 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install ceph-mgr-debuginfo 2023-11-05T08:02:22.666 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded. 2023-11-05T08:02:22.667 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2023-11-05T08:02:23.238 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:06:41 ago on Sun 05 Nov 2023 07:55:42 AM UTC. 2023-11-05T08:02:23.385 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2023-11-05T08:02:23.386 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-11-05T08:02:23.386 INFO:teuthology.orchestra.run.smithi052.stdout: Package Arch Version Repo Size 2023-11-05T08:02:23.386 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-11-05T08:02:23.387 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2023-11-05T08:02:23.387 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-debuginfo x86_64 2:18.0.0-6776.g420cd129.el9 ceph 19 M 2023-11-05T08:02:23.387 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:02:23.387 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2023-11-05T08:02:23.387 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-11-05T08:02:23.388 INFO:teuthology.orchestra.run.smithi052.stdout:Install 1 Package 2023-11-05T08:02:23.388 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:02:23.388 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 19 M 2023-11-05T08:02:23.388 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 101 M 2023-11-05T08:02:23.388 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2023-11-05T08:02:24.488 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-mgr-debuginfo-18.0.0-6776.g420cd129.el9.x8 17 MB/s | 19 MB 00:01 2023-11-05T08:02:24.489 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2023-11-05T08:02:24.489 INFO:teuthology.orchestra.run.smithi052.stdout:Total 17 MB/s | 19 MB 00:01 2023-11-05T08:02:24.490 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2023-11-05T08:02:24.494 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2023-11-05T08:02:24.494 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2023-11-05T08:02:24.650 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2023-11-05T08:02:24.650 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2023-11-05T08:02:26.964 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2023-11-05T08:02:27.080 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_6 1/1 2023-11-05T08:02:27.307 INFO:teuthology.orchestra.run.smithi156.stdout: Preparing : 1/1 2023-11-05T08:02:27.398 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-mds-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_6 1/1 2023-11-05T08:02:28.034 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mgr-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_6 1/1 2023-11-05T08:02:28.307 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_6 1/1 2023-11-05T08:02:28.308 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:02:28.308 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2023-11-05T08:02:28.308 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-05T08:02:28.308 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:02:28.309 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2023-11-05T08:02:28.468 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install ceph-mds-debuginfo 2023-11-05T08:02:28.852 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-mds-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_6 1/1 2023-11-05T08:02:29.048 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:06:47 ago on Sun 05 Nov 2023 07:55:42 AM UTC. 2023-11-05T08:02:29.139 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mds-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_6 1/1 2023-11-05T08:02:29.139 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T08:02:29.139 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2023-11-05T08:02:29.139 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mds-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-05T08:02:29.140 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T08:02:29.140 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2023-11-05T08:02:29.195 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2023-11-05T08:02:29.196 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-11-05T08:02:29.196 INFO:teuthology.orchestra.run.smithi052.stdout: Package Arch Version Repo Size 2023-11-05T08:02:29.197 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-11-05T08:02:29.197 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2023-11-05T08:02:29.197 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mds-debuginfo x86_64 2:18.0.0-6776.g420cd129.el9 ceph 47 M 2023-11-05T08:02:29.197 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:02:29.197 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2023-11-05T08:02:29.198 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-11-05T08:02:29.198 INFO:teuthology.orchestra.run.smithi052.stdout:Install 1 Package 2023-11-05T08:02:29.198 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:02:29.198 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 47 M 2023-11-05T08:02:29.199 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 169 M 2023-11-05T08:02:29.199 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2023-11-05T08:02:29.350 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum -y install ceph-mon-debuginfo 2023-11-05T08:02:29.901 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:06:50 ago on Sun 05 Nov 2023 07:55:39 AM UTC. 2023-11-05T08:02:30.041 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2023-11-05T08:02:30.042 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-05T08:02:30.042 INFO:teuthology.orchestra.run.smithi156.stdout: Package Arch Version Repo Size 2023-11-05T08:02:30.043 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-05T08:02:30.043 INFO:teuthology.orchestra.run.smithi156.stdout:Installing: 2023-11-05T08:02:30.043 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mon-debuginfo x86_64 2:18.0.0-6776.g420cd129.el9 ceph 112 M 2023-11-05T08:02:30.043 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T08:02:30.043 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2023-11-05T08:02:30.044 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-05T08:02:30.044 INFO:teuthology.orchestra.run.smithi156.stdout:Install 1 Package 2023-11-05T08:02:30.044 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T08:02:30.044 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 112 M 2023-11-05T08:02:30.044 INFO:teuthology.orchestra.run.smithi156.stdout:Installed size: 508 M 2023-11-05T08:02:30.044 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading Packages: 2023-11-05T08:02:32.490 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-mds-debuginfo-18.0.0-6776.g420cd129.el9.x8 14 MB/s | 47 MB 00:03 2023-11-05T08:02:32.492 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2023-11-05T08:02:32.492 INFO:teuthology.orchestra.run.smithi052.stdout:Total 14 MB/s | 47 MB 00:03 2023-11-05T08:02:32.492 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2023-11-05T08:02:32.496 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2023-11-05T08:02:32.496 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2023-11-05T08:02:32.820 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2023-11-05T08:02:32.821 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2023-11-05T08:02:37.734 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2023-11-05T08:02:37.777 INFO:teuthology.orchestra.run.smithi156.stdout:ceph-mon-debuginfo-18.0.0-6776.g420cd129.el9.x8 14 MB/s | 112 MB 00:07 2023-11-05T08:02:37.778 INFO:teuthology.orchestra.run.smithi156.stdout:-------------------------------------------------------------------------------- 2023-11-05T08:02:37.778 INFO:teuthology.orchestra.run.smithi156.stdout:Total 14 MB/s | 112 MB 00:07 2023-11-05T08:02:37.779 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2023-11-05T08:02:37.782 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction check succeeded. 2023-11-05T08:02:37.783 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2023-11-05T08:02:37.825 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mds-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_6 1/1 2023-11-05T08:02:38.470 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded. 2023-11-05T08:02:38.471 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2023-11-05T08:02:39.295 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mds-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_6 1/1 2023-11-05T08:02:39.584 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mds-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_6 1/1 2023-11-05T08:02:39.584 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:02:39.585 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2023-11-05T08:02:39.585 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mds-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-05T08:02:39.585 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:02:39.585 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2023-11-05T08:02:39.755 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install ceph-mon-debuginfo 2023-11-05T08:02:40.333 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:06:58 ago on Sun 05 Nov 2023 07:55:42 AM UTC. 2023-11-05T08:02:40.480 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2023-11-05T08:02:40.481 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-11-05T08:02:40.481 INFO:teuthology.orchestra.run.smithi052.stdout: Package Arch Version Repo Size 2023-11-05T08:02:40.481 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-11-05T08:02:40.482 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2023-11-05T08:02:40.482 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mon-debuginfo x86_64 2:18.0.0-6776.g420cd129.el9 ceph 112 M 2023-11-05T08:02:40.482 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:02:40.482 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2023-11-05T08:02:40.482 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-11-05T08:02:40.483 INFO:teuthology.orchestra.run.smithi052.stdout:Install 1 Package 2023-11-05T08:02:40.483 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:02:40.483 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 112 M 2023-11-05T08:02:40.483 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 508 M 2023-11-05T08:02:40.483 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2023-11-05T08:02:45.676 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-mon-debuginfo-18.0.0-6776.g420cd129.el9.x8 22 MB/s | 112 MB 00:05 2023-11-05T08:02:45.676 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2023-11-05T08:02:45.677 INFO:teuthology.orchestra.run.smithi052.stdout:Total 22 MB/s | 112 MB 00:05 2023-11-05T08:02:45.677 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2023-11-05T08:02:45.681 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2023-11-05T08:02:45.681 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2023-11-05T08:02:46.407 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2023-11-05T08:02:46.408 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2023-11-05T08:02:50.119 INFO:teuthology.orchestra.run.smithi156.stdout: Preparing : 1/1 2023-11-05T08:02:50.290 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-mon-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_6 1/1 2023-11-05T08:02:53.591 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-mon-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_6 1/1 2023-11-05T08:02:53.875 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mon-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_6 1/1 2023-11-05T08:02:53.875 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T08:02:53.875 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2023-11-05T08:02:53.875 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mon-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-05T08:02:53.875 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T08:02:53.876 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2023-11-05T08:02:54.058 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum -y install ceph-osd-debuginfo 2023-11-05T08:02:54.610 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:07:15 ago on Sun 05 Nov 2023 07:55:39 AM UTC. 2023-11-05T08:02:54.745 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2023-11-05T08:02:54.746 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-05T08:02:54.746 INFO:teuthology.orchestra.run.smithi156.stdout: Package Arch Version Repo Size 2023-11-05T08:02:54.746 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-05T08:02:54.747 INFO:teuthology.orchestra.run.smithi156.stdout:Installing: 2023-11-05T08:02:54.747 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-osd-debuginfo x86_64 2:18.0.0-6776.g420cd129.el9 ceph 313 M 2023-11-05T08:02:54.747 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T08:02:54.747 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2023-11-05T08:02:54.748 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-05T08:02:54.748 INFO:teuthology.orchestra.run.smithi156.stdout:Install 1 Package 2023-11-05T08:02:54.748 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T08:02:54.748 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 313 M 2023-11-05T08:02:54.748 INFO:teuthology.orchestra.run.smithi156.stdout:Installed size: 1.3 G 2023-11-05T08:02:54.749 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading Packages: 2023-11-05T08:02:58.809 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2023-11-05T08:02:58.918 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mon-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_6 1/1 2023-11-05T08:03:02.128 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mon-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_6 1/1 2023-11-05T08:03:02.406 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mon-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_6 1/1 2023-11-05T08:03:02.406 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:03:02.406 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2023-11-05T08:03:02.406 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mon-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-05T08:03:02.407 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:03:02.407 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2023-11-05T08:03:02.557 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install ceph-osd-debuginfo 2023-11-05T08:03:03.131 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:07:21 ago on Sun 05 Nov 2023 07:55:42 AM UTC. 2023-11-05T08:03:03.276 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2023-11-05T08:03:03.277 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-11-05T08:03:03.277 INFO:teuthology.orchestra.run.smithi052.stdout: Package Arch Version Repo Size 2023-11-05T08:03:03.278 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-11-05T08:03:03.278 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2023-11-05T08:03:03.278 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-osd-debuginfo x86_64 2:18.0.0-6776.g420cd129.el9 ceph 313 M 2023-11-05T08:03:03.278 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:03:03.278 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2023-11-05T08:03:03.279 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-11-05T08:03:03.279 INFO:teuthology.orchestra.run.smithi052.stdout:Install 1 Package 2023-11-05T08:03:03.279 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:03:03.279 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 313 M 2023-11-05T08:03:03.279 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 1.3 G 2023-11-05T08:03:03.280 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2023-11-05T08:03:13.451 INFO:teuthology.orchestra.run.smithi156.stdout:ceph-osd-debuginfo-18.0.0-6776.g420cd129.el9.x8 17 MB/s | 313 MB 00:18 2023-11-05T08:03:13.452 INFO:teuthology.orchestra.run.smithi156.stdout:-------------------------------------------------------------------------------- 2023-11-05T08:03:13.452 INFO:teuthology.orchestra.run.smithi156.stdout:Total 17 MB/s | 313 MB 00:18 2023-11-05T08:03:13.452 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2023-11-05T08:03:13.456 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction check succeeded. 2023-11-05T08:03:13.456 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2023-11-05T08:03:15.322 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded. 2023-11-05T08:03:15.322 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2023-11-05T08:03:39.549 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-osd-debuginfo-18.0.0-6776.g420cd129.el9.x8 8.6 MB/s | 313 MB 00:36 2023-11-05T08:03:39.550 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2023-11-05T08:03:39.550 INFO:teuthology.orchestra.run.smithi052.stdout:Total 8.6 MB/s | 313 MB 00:36 2023-11-05T08:03:39.550 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2023-11-05T08:03:39.554 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2023-11-05T08:03:39.555 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2023-11-05T08:03:41.527 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2023-11-05T08:03:41.527 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2023-11-05T08:03:47.409 INFO:teuthology.orchestra.run.smithi156.stdout: Preparing : 1/1 2023-11-05T08:03:47.536 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-osd-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_6 1/1 2023-11-05T08:03:55.732 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-osd-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_6 1/1 2023-11-05T08:03:56.003 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-osd-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_6 1/1 2023-11-05T08:03:56.003 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T08:03:56.003 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2023-11-05T08:03:56.004 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-osd-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-05T08:03:56.004 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T08:03:56.004 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2023-11-05T08:03:56.216 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum -y install ceph-fuse-debuginfo 2023-11-05T08:03:56.766 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:08:17 ago on Sun 05 Nov 2023 07:55:39 AM UTC. 2023-11-05T08:03:56.906 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2023-11-05T08:03:56.907 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-05T08:03:56.908 INFO:teuthology.orchestra.run.smithi156.stdout: Package Arch Version Repo Size 2023-11-05T08:03:56.908 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-05T08:03:56.909 INFO:teuthology.orchestra.run.smithi156.stdout:Installing: 2023-11-05T08:03:56.909 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-fuse-debuginfo x86_64 2:18.0.0-6776.g420cd129.el9 ceph 5.8 M 2023-11-05T08:03:56.909 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T08:03:56.910 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2023-11-05T08:03:56.910 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-05T08:03:56.910 INFO:teuthology.orchestra.run.smithi156.stdout:Install 1 Package 2023-11-05T08:03:56.911 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T08:03:56.911 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 5.8 M 2023-11-05T08:03:56.912 INFO:teuthology.orchestra.run.smithi156.stdout:Installed size: 28 M 2023-11-05T08:03:56.912 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading Packages: 2023-11-05T08:03:59.590 INFO:teuthology.orchestra.run.smithi156.stdout:ceph-fuse-debuginfo-18.0.0-6776.g420cd129.el9.x 2.1 MB/s | 5.8 MB 00:02 2023-11-05T08:03:59.591 INFO:teuthology.orchestra.run.smithi156.stdout:-------------------------------------------------------------------------------- 2023-11-05T08:03:59.592 INFO:teuthology.orchestra.run.smithi156.stdout:Total 2.1 MB/s | 5.8 MB 00:02 2023-11-05T08:03:59.592 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2023-11-05T08:03:59.596 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction check succeeded. 2023-11-05T08:03:59.596 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2023-11-05T08:03:59.667 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded. 2023-11-05T08:03:59.667 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2023-11-05T08:04:00.383 INFO:teuthology.orchestra.run.smithi156.stdout: Preparing : 1/1 2023-11-05T08:04:00.488 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-fuse-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_ 1/1 2023-11-05T08:04:01.040 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-fuse-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_ 1/1 2023-11-05T08:04:01.320 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-fuse-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_ 1/1 2023-11-05T08:04:01.321 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T08:04:01.321 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2023-11-05T08:04:01.321 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-fuse-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-05T08:04:01.321 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T08:04:01.322 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2023-11-05T08:04:01.512 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum -y install librados-devel-debuginfo 2023-11-05T08:04:02.059 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:08:23 ago on Sun 05 Nov 2023 07:55:39 AM UTC. 2023-11-05T08:04:02.197 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2023-11-05T08:04:02.198 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-05T08:04:02.199 INFO:teuthology.orchestra.run.smithi156.stdout: Package Arch Version Repo Size 2023-11-05T08:04:02.199 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-05T08:04:02.199 INFO:teuthology.orchestra.run.smithi156.stdout:Installing: 2023-11-05T08:04:02.199 INFO:teuthology.orchestra.run.smithi156.stdout: librados-devel-debuginfo x86_64 2:18.0.0-6776.g420cd129.el9 ceph 108 k 2023-11-05T08:04:02.199 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T08:04:02.200 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2023-11-05T08:04:02.200 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-05T08:04:02.200 INFO:teuthology.orchestra.run.smithi156.stdout:Install 1 Package 2023-11-05T08:04:02.200 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T08:04:02.200 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 108 k 2023-11-05T08:04:02.201 INFO:teuthology.orchestra.run.smithi156.stdout:Installed size: 440 k 2023-11-05T08:04:02.201 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading Packages: 2023-11-05T08:04:02.518 INFO:teuthology.orchestra.run.smithi156.stdout:librados-devel-debuginfo-18.0.0-6776.g420cd129. 339 kB/s | 108 kB 00:00 2023-11-05T08:04:02.519 INFO:teuthology.orchestra.run.smithi156.stdout:-------------------------------------------------------------------------------- 2023-11-05T08:04:02.520 INFO:teuthology.orchestra.run.smithi156.stdout:Total 338 kB/s | 108 kB 00:00 2023-11-05T08:04:02.520 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2023-11-05T08:04:02.522 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction check succeeded. 2023-11-05T08:04:02.523 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2023-11-05T08:04:02.556 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded. 2023-11-05T08:04:02.556 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2023-11-05T08:04:02.667 INFO:teuthology.orchestra.run.smithi156.stdout: Preparing : 1/1 2023-11-05T08:04:02.757 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : librados-devel-debuginfo-2:18.0.0-6776.g420cd129.el9 1/1 2023-11-05T08:04:03.138 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: librados-devel-debuginfo-2:18.0.0-6776.g420cd129.el9 1/1 2023-11-05T08:04:03.435 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librados-devel-debuginfo-2:18.0.0-6776.g420cd129.el9 1/1 2023-11-05T08:04:03.436 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T08:04:03.436 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2023-11-05T08:04:03.436 INFO:teuthology.orchestra.run.smithi156.stdout: librados-devel-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-05T08:04:03.436 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T08:04:03.436 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2023-11-05T08:04:03.599 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum -y install libcephfs2-debuginfo 2023-11-05T08:04:04.147 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:08:25 ago on Sun 05 Nov 2023 07:55:39 AM UTC. 2023-11-05T08:04:04.286 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2023-11-05T08:04:04.287 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-05T08:04:04.288 INFO:teuthology.orchestra.run.smithi156.stdout: Package Arch Version Repo Size 2023-11-05T08:04:04.288 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-05T08:04:04.288 INFO:teuthology.orchestra.run.smithi156.stdout:Installing: 2023-11-05T08:04:04.288 INFO:teuthology.orchestra.run.smithi156.stdout: libcephfs2-debuginfo x86_64 2:18.0.0-6776.g420cd129.el9 ceph 5.1 M 2023-11-05T08:04:04.288 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T08:04:04.289 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2023-11-05T08:04:04.289 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-05T08:04:04.289 INFO:teuthology.orchestra.run.smithi156.stdout:Install 1 Package 2023-11-05T08:04:04.289 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T08:04:04.289 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 5.1 M 2023-11-05T08:04:04.290 INFO:teuthology.orchestra.run.smithi156.stdout:Installed size: 24 M 2023-11-05T08:04:04.290 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading Packages: 2023-11-05T08:04:04.780 INFO:teuthology.orchestra.run.smithi156.stdout:libcephfs2-debuginfo-18.0.0-6776.g420cd129.el9. 10 MB/s | 5.1 MB 00:00 2023-11-05T08:04:04.781 INFO:teuthology.orchestra.run.smithi156.stdout:-------------------------------------------------------------------------------- 2023-11-05T08:04:04.782 INFO:teuthology.orchestra.run.smithi156.stdout:Total 10 MB/s | 5.1 MB 00:00 2023-11-05T08:04:04.782 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2023-11-05T08:04:04.785 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction check succeeded. 2023-11-05T08:04:04.785 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2023-11-05T08:04:04.848 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded. 2023-11-05T08:04:04.849 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2023-11-05T08:04:05.491 INFO:teuthology.orchestra.run.smithi156.stdout: Preparing : 1/1 2023-11-05T08:04:05.578 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libcephfs2-debuginfo-2:18.0.0-6776.g420cd129.el9.x86 1/1 2023-11-05T08:04:06.086 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: libcephfs2-debuginfo-2:18.0.0-6776.g420cd129.el9.x86 1/1 2023-11-05T08:04:06.361 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libcephfs2-debuginfo-2:18.0.0-6776.g420cd129.el9.x86 1/1 2023-11-05T08:04:06.361 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T08:04:06.361 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2023-11-05T08:04:06.362 INFO:teuthology.orchestra.run.smithi156.stdout: libcephfs2-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-05T08:04:06.362 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T08:04:06.362 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2023-11-05T08:04:06.534 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum -y install librados2-debuginfo 2023-11-05T08:04:07.089 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:08:28 ago on Sun 05 Nov 2023 07:55:39 AM UTC. 2023-11-05T08:04:07.229 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2023-11-05T08:04:07.230 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-05T08:04:07.231 INFO:teuthology.orchestra.run.smithi156.stdout: Package Arch Version Repo Size 2023-11-05T08:04:07.231 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-05T08:04:07.231 INFO:teuthology.orchestra.run.smithi156.stdout:Installing: 2023-11-05T08:04:07.231 INFO:teuthology.orchestra.run.smithi156.stdout: librados2-debuginfo x86_64 2:18.0.0-6776.g420cd129.el9 ceph 44 M 2023-11-05T08:04:07.231 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T08:04:07.232 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2023-11-05T08:04:07.232 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-05T08:04:07.232 INFO:teuthology.orchestra.run.smithi156.stdout:Install 1 Package 2023-11-05T08:04:07.232 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T08:04:07.232 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 44 M 2023-11-05T08:04:07.233 INFO:teuthology.orchestra.run.smithi156.stdout:Installed size: 251 M 2023-11-05T08:04:07.233 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading Packages: 2023-11-05T08:04:09.375 INFO:teuthology.orchestra.run.smithi156.stdout:librados2-debuginfo-18.0.0-6776.g420cd129.el9.x 21 MB/s | 44 MB 00:02 2023-11-05T08:04:09.376 INFO:teuthology.orchestra.run.smithi156.stdout:-------------------------------------------------------------------------------- 2023-11-05T08:04:09.376 INFO:teuthology.orchestra.run.smithi156.stdout:Total 21 MB/s | 44 MB 00:02 2023-11-05T08:04:09.376 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2023-11-05T08:04:09.380 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction check succeeded. 2023-11-05T08:04:09.381 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2023-11-05T08:04:09.683 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded. 2023-11-05T08:04:09.683 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2023-11-05T08:04:14.734 INFO:teuthology.orchestra.run.smithi156.stdout: Preparing : 1/1 2023-11-05T08:04:14.841 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : librados2-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_ 1/1 2023-11-05T08:04:15.503 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2023-11-05T08:04:16.065 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-osd-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_6 1/1 2023-11-05T08:04:16.840 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: librados2-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_ 1/1 2023-11-05T08:04:17.128 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librados2-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_ 1/1 2023-11-05T08:04:17.128 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T08:04:17.128 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2023-11-05T08:04:17.128 INFO:teuthology.orchestra.run.smithi156.stdout: librados2-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-05T08:04:17.128 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T08:04:17.129 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2023-11-05T08:04:17.332 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum -y install librbd1-debuginfo 2023-11-05T08:04:17.886 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:08:38 ago on Sun 05 Nov 2023 07:55:39 AM UTC. 2023-11-05T08:04:18.028 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2023-11-05T08:04:18.029 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-05T08:04:18.029 INFO:teuthology.orchestra.run.smithi156.stdout: Package Arch Version Repo Size 2023-11-05T08:04:18.029 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-05T08:04:18.029 INFO:teuthology.orchestra.run.smithi156.stdout:Installing: 2023-11-05T08:04:18.030 INFO:teuthology.orchestra.run.smithi156.stdout: librbd1-debuginfo x86_64 2:18.0.0-6776.g420cd129.el9 ceph 51 M 2023-11-05T08:04:18.030 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T08:04:18.030 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2023-11-05T08:04:18.030 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-05T08:04:18.031 INFO:teuthology.orchestra.run.smithi156.stdout:Install 1 Package 2023-11-05T08:04:18.031 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T08:04:18.031 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 51 M 2023-11-05T08:04:18.031 INFO:teuthology.orchestra.run.smithi156.stdout:Installed size: 298 M 2023-11-05T08:04:18.031 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading Packages: 2023-11-05T08:04:20.686 INFO:teuthology.orchestra.run.smithi156.stdout:librbd1-debuginfo-18.0.0-6776.g420cd129.el9.x86 19 MB/s | 51 MB 00:02 2023-11-05T08:04:20.690 INFO:teuthology.orchestra.run.smithi156.stdout:-------------------------------------------------------------------------------- 2023-11-05T08:04:20.690 INFO:teuthology.orchestra.run.smithi156.stdout:Total 19 MB/s | 51 MB 00:02 2023-11-05T08:04:20.690 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2023-11-05T08:04:20.691 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction check succeeded. 2023-11-05T08:04:20.691 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2023-11-05T08:04:21.034 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded. 2023-11-05T08:04:21.035 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2023-11-05T08:04:23.743 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-osd-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_6 1/1 2023-11-05T08:04:24.008 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-osd-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_6 1/1 2023-11-05T08:04:24.009 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:04:24.009 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2023-11-05T08:04:24.009 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-osd-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-05T08:04:24.009 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:04:24.009 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2023-11-05T08:04:24.199 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install ceph-fuse-debuginfo 2023-11-05T08:04:24.779 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:08:42 ago on Sun 05 Nov 2023 07:55:42 AM UTC. 2023-11-05T08:04:24.924 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2023-11-05T08:04:24.925 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-11-05T08:04:24.925 INFO:teuthology.orchestra.run.smithi052.stdout: Package Arch Version Repo Size 2023-11-05T08:04:24.926 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-11-05T08:04:24.926 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2023-11-05T08:04:24.926 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-fuse-debuginfo x86_64 2:18.0.0-6776.g420cd129.el9 ceph 5.8 M 2023-11-05T08:04:24.926 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:04:24.926 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2023-11-05T08:04:24.927 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-11-05T08:04:24.927 INFO:teuthology.orchestra.run.smithi052.stdout:Install 1 Package 2023-11-05T08:04:24.927 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:04:24.927 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 5.8 M 2023-11-05T08:04:24.927 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 28 M 2023-11-05T08:04:24.928 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2023-11-05T08:04:25.415 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-fuse-debuginfo-18.0.0-6776.g420cd129.el9.x 12 MB/s | 5.8 MB 00:00 2023-11-05T08:04:25.416 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2023-11-05T08:04:25.416 INFO:teuthology.orchestra.run.smithi052.stdout:Total 12 MB/s | 5.8 MB 00:00 2023-11-05T08:04:25.416 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2023-11-05T08:04:25.420 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2023-11-05T08:04:25.420 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2023-11-05T08:04:25.492 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2023-11-05T08:04:25.493 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2023-11-05T08:04:26.250 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2023-11-05T08:04:26.350 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-fuse-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_ 1/1 2023-11-05T08:04:26.901 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-fuse-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_ 1/1 2023-11-05T08:04:26.901 INFO:teuthology.orchestra.run.smithi156.stdout: Preparing : 1/1 2023-11-05T08:04:27.009 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : librbd1-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 1/1 2023-11-05T08:04:27.176 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-fuse-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_ 1/1 2023-11-05T08:04:27.176 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:04:27.176 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2023-11-05T08:04:27.177 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-fuse-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-05T08:04:27.177 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:04:27.177 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2023-11-05T08:04:27.320 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install librados-devel-debuginfo 2023-11-05T08:04:27.895 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:08:45 ago on Sun 05 Nov 2023 07:55:42 AM UTC. 2023-11-05T08:04:28.040 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2023-11-05T08:04:28.041 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-11-05T08:04:28.042 INFO:teuthology.orchestra.run.smithi052.stdout: Package Arch Version Repo Size 2023-11-05T08:04:28.042 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-11-05T08:04:28.042 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2023-11-05T08:04:28.042 INFO:teuthology.orchestra.run.smithi052.stdout: librados-devel-debuginfo x86_64 2:18.0.0-6776.g420cd129.el9 ceph 108 k 2023-11-05T08:04:28.042 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:04:28.043 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2023-11-05T08:04:28.043 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-11-05T08:04:28.043 INFO:teuthology.orchestra.run.smithi052.stdout:Install 1 Package 2023-11-05T08:04:28.043 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:04:28.043 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 108 k 2023-11-05T08:04:28.044 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 440 k 2023-11-05T08:04:28.044 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2023-11-05T08:04:28.260 INFO:teuthology.orchestra.run.smithi052.stdout:librados-devel-debuginfo-18.0.0-6776.g420cd129. 499 kB/s | 108 kB 00:00 2023-11-05T08:04:28.260 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2023-11-05T08:04:28.261 INFO:teuthology.orchestra.run.smithi052.stdout:Total 495 kB/s | 108 kB 00:00 2023-11-05T08:04:28.261 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2023-11-05T08:04:28.265 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2023-11-05T08:04:28.265 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2023-11-05T08:04:28.300 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2023-11-05T08:04:28.300 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2023-11-05T08:04:28.417 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2023-11-05T08:04:28.502 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : librados-devel-debuginfo-2:18.0.0-6776.g420cd129.el9 1/1 2023-11-05T08:04:28.989 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: librados-devel-debuginfo-2:18.0.0-6776.g420cd129.el9 1/1 2023-11-05T08:04:29.181 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: librbd1-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 1/1 2023-11-05T08:04:29.280 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librados-devel-debuginfo-2:18.0.0-6776.g420cd129.el9 1/1 2023-11-05T08:04:29.280 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:04:29.281 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2023-11-05T08:04:29.281 INFO:teuthology.orchestra.run.smithi052.stdout: librados-devel-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-05T08:04:29.281 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:04:29.281 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2023-11-05T08:04:29.477 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librbd1-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 1/1 2023-11-05T08:04:29.477 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T08:04:29.477 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2023-11-05T08:04:29.477 INFO:teuthology.orchestra.run.smithi156.stdout: librbd1-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-05T08:04:29.478 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T08:04:29.478 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2023-11-05T08:04:29.571 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install libcephfs2-debuginfo 2023-11-05T08:04:29.694 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum -y install python3-cephfs-debuginfo 2023-11-05T08:04:30.147 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:08:48 ago on Sun 05 Nov 2023 07:55:42 AM UTC. 2023-11-05T08:04:30.246 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:08:51 ago on Sun 05 Nov 2023 07:55:39 AM UTC. 2023-11-05T08:04:30.292 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2023-11-05T08:04:30.293 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-11-05T08:04:30.293 INFO:teuthology.orchestra.run.smithi052.stdout: Package Arch Version Repo Size 2023-11-05T08:04:30.293 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-11-05T08:04:30.294 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2023-11-05T08:04:30.294 INFO:teuthology.orchestra.run.smithi052.stdout: libcephfs2-debuginfo x86_64 2:18.0.0-6776.g420cd129.el9 ceph 5.1 M 2023-11-05T08:04:30.294 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:04:30.294 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2023-11-05T08:04:30.294 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-11-05T08:04:30.295 INFO:teuthology.orchestra.run.smithi052.stdout:Install 1 Package 2023-11-05T08:04:30.295 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:04:30.295 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 5.1 M 2023-11-05T08:04:30.295 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 24 M 2023-11-05T08:04:30.295 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2023-11-05T08:04:30.386 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2023-11-05T08:04:30.387 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-05T08:04:30.387 INFO:teuthology.orchestra.run.smithi156.stdout: Package Arch Version Repo Size 2023-11-05T08:04:30.387 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-05T08:04:30.387 INFO:teuthology.orchestra.run.smithi156.stdout:Installing: 2023-11-05T08:04:30.387 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cephfs-debuginfo x86_64 2:18.0.0-6776.g420cd129.el9 ceph 615 k 2023-11-05T08:04:30.388 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T08:04:30.388 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2023-11-05T08:04:30.388 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-05T08:04:30.388 INFO:teuthology.orchestra.run.smithi156.stdout:Install 1 Package 2023-11-05T08:04:30.388 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T08:04:30.389 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 615 k 2023-11-05T08:04:30.389 INFO:teuthology.orchestra.run.smithi156.stdout:Installed size: 2.1 M 2023-11-05T08:04:30.389 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading Packages: 2023-11-05T08:04:30.771 INFO:teuthology.orchestra.run.smithi052.stdout:libcephfs2-debuginfo-18.0.0-6776.g420cd129.el9. 11 MB/s | 5.1 MB 00:00 2023-11-05T08:04:30.771 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2023-11-05T08:04:30.772 INFO:teuthology.orchestra.run.smithi052.stdout:Total 11 MB/s | 5.1 MB 00:00 2023-11-05T08:04:30.772 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2023-11-05T08:04:30.775 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2023-11-05T08:04:30.776 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2023-11-05T08:04:30.797 INFO:teuthology.orchestra.run.smithi156.stdout:python3-cephfs-debuginfo-18.0.0-6776.g420cd129. 1.5 MB/s | 615 kB 00:00 2023-11-05T08:04:30.798 INFO:teuthology.orchestra.run.smithi156.stdout:-------------------------------------------------------------------------------- 2023-11-05T08:04:30.798 INFO:teuthology.orchestra.run.smithi156.stdout:Total 1.5 MB/s | 615 kB 00:00 2023-11-05T08:04:30.799 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2023-11-05T08:04:30.801 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction check succeeded. 2023-11-05T08:04:30.801 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2023-11-05T08:04:30.837 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded. 2023-11-05T08:04:30.838 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2023-11-05T08:04:30.842 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2023-11-05T08:04:30.843 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2023-11-05T08:04:31.006 INFO:teuthology.orchestra.run.smithi156.stdout: Preparing : 1/1 2023-11-05T08:04:31.120 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-cephfs-debuginfo-2:18.0.0-6776.g420cd129.el9 1/1 2023-11-05T08:04:31.525 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2023-11-05T08:04:31.546 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: python3-cephfs-debuginfo-2:18.0.0-6776.g420cd129.el9 1/1 2023-11-05T08:04:31.656 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libcephfs2-debuginfo-2:18.0.0-6776.g420cd129.el9.x86 1/1 2023-11-05T08:04:31.838 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-cephfs-debuginfo-2:18.0.0-6776.g420cd129.el9 1/1 2023-11-05T08:04:31.838 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T08:04:31.838 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2023-11-05T08:04:31.839 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cephfs-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-05T08:04:31.839 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T08:04:31.839 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2023-11-05T08:04:32.035 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum -y install python3-rados-debuginfo 2023-11-05T08:04:32.185 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: libcephfs2-debuginfo-2:18.0.0-6776.g420cd129.el9.x86 1/1 2023-11-05T08:04:32.473 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libcephfs2-debuginfo-2:18.0.0-6776.g420cd129.el9.x86 1/1 2023-11-05T08:04:32.474 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:04:32.474 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2023-11-05T08:04:32.474 INFO:teuthology.orchestra.run.smithi052.stdout: libcephfs2-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-05T08:04:32.475 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:04:32.475 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2023-11-05T08:04:32.589 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:08:53 ago on Sun 05 Nov 2023 07:55:39 AM UTC. 2023-11-05T08:04:32.647 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install librados2-debuginfo 2023-11-05T08:04:32.728 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2023-11-05T08:04:32.729 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-05T08:04:32.729 INFO:teuthology.orchestra.run.smithi156.stdout: Package Arch Version Repo Size 2023-11-05T08:04:32.729 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-05T08:04:32.730 INFO:teuthology.orchestra.run.smithi156.stdout:Installing: 2023-11-05T08:04:32.730 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rados-debuginfo x86_64 2:18.0.0-6776.g420cd129.el9 ceph 770 k 2023-11-05T08:04:32.730 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T08:04:32.730 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2023-11-05T08:04:32.730 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-05T08:04:32.731 INFO:teuthology.orchestra.run.smithi156.stdout:Install 1 Package 2023-11-05T08:04:32.731 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T08:04:32.731 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 770 k 2023-11-05T08:04:32.731 INFO:teuthology.orchestra.run.smithi156.stdout:Installed size: 2.7 M 2023-11-05T08:04:32.731 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading Packages: 2023-11-05T08:04:33.108 INFO:teuthology.orchestra.run.smithi156.stdout:python3-rados-debuginfo-18.0.0-6776.g420cd129.e 2.0 MB/s | 770 kB 00:00 2023-11-05T08:04:33.109 INFO:teuthology.orchestra.run.smithi156.stdout:-------------------------------------------------------------------------------- 2023-11-05T08:04:33.109 INFO:teuthology.orchestra.run.smithi156.stdout:Total 2.0 MB/s | 770 kB 00:00 2023-11-05T08:04:33.110 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2023-11-05T08:04:33.112 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction check succeeded. 2023-11-05T08:04:33.113 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2023-11-05T08:04:33.150 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded. 2023-11-05T08:04:33.151 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2023-11-05T08:04:33.224 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:08:51 ago on Sun 05 Nov 2023 07:55:42 AM UTC. 2023-11-05T08:04:33.330 INFO:teuthology.orchestra.run.smithi156.stdout: Preparing : 1/1 2023-11-05T08:04:33.372 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2023-11-05T08:04:33.373 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-11-05T08:04:33.373 INFO:teuthology.orchestra.run.smithi052.stdout: Package Arch Version Repo Size 2023-11-05T08:04:33.373 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-11-05T08:04:33.373 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2023-11-05T08:04:33.373 INFO:teuthology.orchestra.run.smithi052.stdout: librados2-debuginfo x86_64 2:18.0.0-6776.g420cd129.el9 ceph 44 M 2023-11-05T08:04:33.374 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:04:33.374 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2023-11-05T08:04:33.374 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-11-05T08:04:33.374 INFO:teuthology.orchestra.run.smithi052.stdout:Install 1 Package 2023-11-05T08:04:33.375 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:04:33.375 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 44 M 2023-11-05T08:04:33.375 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 251 M 2023-11-05T08:04:33.375 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2023-11-05T08:04:33.449 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-rados-debuginfo-2:18.0.0-6776.g420cd129.el9. 1/1 2023-11-05T08:04:33.846 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: python3-rados-debuginfo-2:18.0.0-6776.g420cd129.el9. 1/1 2023-11-05T08:04:34.124 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-rados-debuginfo-2:18.0.0-6776.g420cd129.el9. 1/1 2023-11-05T08:04:34.125 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T08:04:34.125 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2023-11-05T08:04:34.125 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rados-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-05T08:04:34.126 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T08:04:34.126 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2023-11-05T08:04:34.303 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum -y install python3-rbd-debuginfo 2023-11-05T08:04:34.851 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:08:55 ago on Sun 05 Nov 2023 07:55:39 AM UTC. 2023-11-05T08:04:34.991 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2023-11-05T08:04:34.992 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-05T08:04:34.993 INFO:teuthology.orchestra.run.smithi156.stdout: Package Arch Version Repo Size 2023-11-05T08:04:34.993 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-05T08:04:34.994 INFO:teuthology.orchestra.run.smithi156.stdout:Installing: 2023-11-05T08:04:34.994 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rbd-debuginfo x86_64 2:18.0.0-6776.g420cd129.el9 ceph 1.1 M 2023-11-05T08:04:34.994 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T08:04:34.995 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2023-11-05T08:04:34.995 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-05T08:04:34.995 INFO:teuthology.orchestra.run.smithi156.stdout:Install 1 Package 2023-11-05T08:04:34.996 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T08:04:34.996 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 1.1 M 2023-11-05T08:04:34.996 INFO:teuthology.orchestra.run.smithi156.stdout:Installed size: 4.3 M 2023-11-05T08:04:34.997 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading Packages: 2023-11-05T08:04:35.412 INFO:teuthology.orchestra.run.smithi156.stdout:python3-rbd-debuginfo-18.0.0-6776.g420cd129.el9 2.7 MB/s | 1.1 MB 00:00 2023-11-05T08:04:35.412 INFO:teuthology.orchestra.run.smithi156.stdout:-------------------------------------------------------------------------------- 2023-11-05T08:04:35.413 INFO:teuthology.orchestra.run.smithi156.stdout:Total 2.7 MB/s | 1.1 MB 00:00 2023-11-05T08:04:35.413 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2023-11-05T08:04:35.416 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction check succeeded. 2023-11-05T08:04:35.416 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2023-11-05T08:04:35.455 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded. 2023-11-05T08:04:35.456 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2023-11-05T08:04:35.675 INFO:teuthology.orchestra.run.smithi156.stdout: Preparing : 1/1 2023-11-05T08:04:35.769 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-rbd-debuginfo-2:18.0.0-6776.g420cd129.el9.x8 1/1 2023-11-05T08:04:36.183 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: python3-rbd-debuginfo-2:18.0.0-6776.g420cd129.el9.x8 1/1 2023-11-05T08:04:36.465 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-rbd-debuginfo-2:18.0.0-6776.g420cd129.el9.x8 1/1 2023-11-05T08:04:36.466 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T08:04:36.466 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2023-11-05T08:04:36.466 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rbd-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-05T08:04:36.466 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T08:04:36.466 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2023-11-05T08:04:36.695 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum -y install python3-rgw-debuginfo 2023-11-05T08:04:37.245 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:08:58 ago on Sun 05 Nov 2023 07:55:39 AM UTC. 2023-11-05T08:04:37.385 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2023-11-05T08:04:37.386 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-05T08:04:37.387 INFO:teuthology.orchestra.run.smithi156.stdout: Package Arch Version Repo Size 2023-11-05T08:04:37.387 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-05T08:04:37.387 INFO:teuthology.orchestra.run.smithi156.stdout:Installing: 2023-11-05T08:04:37.387 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rgw-debuginfo x86_64 2:18.0.0-6776.g420cd129.el9 ceph 337 k 2023-11-05T08:04:37.387 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T08:04:37.388 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2023-11-05T08:04:37.388 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-05T08:04:37.388 INFO:teuthology.orchestra.run.smithi156.stdout:Install 1 Package 2023-11-05T08:04:37.388 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T08:04:37.389 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 337 k 2023-11-05T08:04:37.389 INFO:teuthology.orchestra.run.smithi156.stdout:Installed size: 1.0 M 2023-11-05T08:04:37.389 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading Packages: 2023-11-05T08:04:37.665 INFO:teuthology.orchestra.run.smithi156.stdout:python3-rgw-debuginfo-18.0.0-6776.g420cd129.el9 1.2 MB/s | 337 kB 00:00 2023-11-05T08:04:37.666 INFO:teuthology.orchestra.run.smithi156.stdout:-------------------------------------------------------------------------------- 2023-11-05T08:04:37.667 INFO:teuthology.orchestra.run.smithi156.stdout:Total 1.2 MB/s | 337 kB 00:00 2023-11-05T08:04:37.667 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2023-11-05T08:04:37.670 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction check succeeded. 2023-11-05T08:04:37.670 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2023-11-05T08:04:37.705 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded. 2023-11-05T08:04:37.706 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2023-11-05T08:04:37.756 INFO:teuthology.orchestra.run.smithi052.stdout:librados2-debuginfo-18.0.0-6776.g420cd129.el9.x 10 MB/s | 44 MB 00:04 2023-11-05T08:04:37.757 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2023-11-05T08:04:37.758 INFO:teuthology.orchestra.run.smithi052.stdout:Total 10 MB/s | 44 MB 00:04 2023-11-05T08:04:37.758 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2023-11-05T08:04:37.762 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2023-11-05T08:04:37.762 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2023-11-05T08:04:37.845 INFO:teuthology.orchestra.run.smithi156.stdout: Preparing : 1/1 2023-11-05T08:04:37.955 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-rgw-debuginfo-2:18.0.0-6776.g420cd129.el9.x8 1/1 2023-11-05T08:04:38.080 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2023-11-05T08:04:38.081 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2023-11-05T08:04:38.342 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: python3-rgw-debuginfo-2:18.0.0-6776.g420cd129.el9.x8 1/1 2023-11-05T08:04:38.626 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-rgw-debuginfo-2:18.0.0-6776.g420cd129.el9.x8 1/1 2023-11-05T08:04:38.627 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T08:04:38.627 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2023-11-05T08:04:38.627 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rgw-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-05T08:04:38.627 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T08:04:38.628 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2023-11-05T08:04:38.832 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum -y install rbd-fuse-debuginfo 2023-11-05T08:04:39.379 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:09:00 ago on Sun 05 Nov 2023 07:55:39 AM UTC. 2023-11-05T08:04:39.520 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2023-11-05T08:04:39.521 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-05T08:04:39.521 INFO:teuthology.orchestra.run.smithi156.stdout: Package Arch Version Repo Size 2023-11-05T08:04:39.521 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-05T08:04:39.522 INFO:teuthology.orchestra.run.smithi156.stdout:Installing: 2023-11-05T08:04:39.522 INFO:teuthology.orchestra.run.smithi156.stdout: rbd-fuse-debuginfo x86_64 2:18.0.0-6776.g420cd129.el9 ceph 506 k 2023-11-05T08:04:39.522 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T08:04:39.522 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2023-11-05T08:04:39.523 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-05T08:04:39.523 INFO:teuthology.orchestra.run.smithi156.stdout:Install 1 Package 2023-11-05T08:04:39.523 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T08:04:39.523 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 506 k 2023-11-05T08:04:39.523 INFO:teuthology.orchestra.run.smithi156.stdout:Installed size: 2.5 M 2023-11-05T08:04:39.524 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading Packages: 2023-11-05T08:04:39.927 INFO:teuthology.orchestra.run.smithi156.stdout:rbd-fuse-debuginfo-18.0.0-6776.g420cd129.el9.x8 1.2 MB/s | 506 kB 00:00 2023-11-05T08:04:39.928 INFO:teuthology.orchestra.run.smithi156.stdout:-------------------------------------------------------------------------------- 2023-11-05T08:04:39.928 INFO:teuthology.orchestra.run.smithi156.stdout:Total 1.2 MB/s | 506 kB 00:00 2023-11-05T08:04:39.928 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2023-11-05T08:04:39.931 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction check succeeded. 2023-11-05T08:04:39.931 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2023-11-05T08:04:39.966 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded. 2023-11-05T08:04:39.966 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2023-11-05T08:04:40.122 INFO:teuthology.orchestra.run.smithi156.stdout: Preparing : 1/1 2023-11-05T08:04:40.233 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : rbd-fuse-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_6 1/1 2023-11-05T08:04:40.622 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: rbd-fuse-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_6 1/1 2023-11-05T08:04:40.899 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : rbd-fuse-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_6 1/1 2023-11-05T08:04:40.899 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T08:04:40.899 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2023-11-05T08:04:40.899 INFO:teuthology.orchestra.run.smithi156.stdout: rbd-fuse-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-05T08:04:40.900 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T08:04:40.900 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2023-11-05T08:04:41.114 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum -y install rbd-mirror-debuginfo 2023-11-05T08:04:41.667 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:09:02 ago on Sun 05 Nov 2023 07:55:39 AM UTC. 2023-11-05T08:04:41.808 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2023-11-05T08:04:41.810 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-05T08:04:41.810 INFO:teuthology.orchestra.run.smithi156.stdout: Package Arch Version Repo Size 2023-11-05T08:04:41.810 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-05T08:04:41.810 INFO:teuthology.orchestra.run.smithi156.stdout:Installing: 2023-11-05T08:04:41.810 INFO:teuthology.orchestra.run.smithi156.stdout: rbd-mirror-debuginfo x86_64 2:18.0.0-6776.g420cd129.el9 ceph 51 M 2023-11-05T08:04:41.811 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T08:04:41.811 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2023-11-05T08:04:41.811 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-05T08:04:41.811 INFO:teuthology.orchestra.run.smithi156.stdout:Install 1 Package 2023-11-05T08:04:41.811 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T08:04:41.812 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 51 M 2023-11-05T08:04:41.812 INFO:teuthology.orchestra.run.smithi156.stdout:Installed size: 289 M 2023-11-05T08:04:41.812 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading Packages: 2023-11-05T08:04:43.393 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2023-11-05T08:04:43.498 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : librados2-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_ 1/1 2023-11-05T08:04:44.255 INFO:teuthology.orchestra.run.smithi156.stdout:rbd-mirror-debuginfo-18.0.0-6776.g420cd129.el9. 21 MB/s | 51 MB 00:02 2023-11-05T08:04:44.256 INFO:teuthology.orchestra.run.smithi156.stdout:-------------------------------------------------------------------------------- 2023-11-05T08:04:44.256 INFO:teuthology.orchestra.run.smithi156.stdout:Total 21 MB/s | 51 MB 00:02 2023-11-05T08:04:44.257 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2023-11-05T08:04:44.260 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction check succeeded. 2023-11-05T08:04:44.261 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2023-11-05T08:04:44.596 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded. 2023-11-05T08:04:44.596 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2023-11-05T08:04:45.319 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: librados2-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_ 1/1 2023-11-05T08:04:45.604 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librados2-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_ 1/1 2023-11-05T08:04:45.604 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:04:45.605 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2023-11-05T08:04:45.605 INFO:teuthology.orchestra.run.smithi052.stdout: librados2-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-05T08:04:45.605 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:04:45.605 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2023-11-05T08:04:45.787 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install librbd1-debuginfo 2023-11-05T08:04:46.368 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:09:04 ago on Sun 05 Nov 2023 07:55:42 AM UTC. 2023-11-05T08:04:46.524 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2023-11-05T08:04:46.525 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-11-05T08:04:46.526 INFO:teuthology.orchestra.run.smithi052.stdout: Package Arch Version Repo Size 2023-11-05T08:04:46.526 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-11-05T08:04:46.526 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2023-11-05T08:04:46.526 INFO:teuthology.orchestra.run.smithi052.stdout: librbd1-debuginfo x86_64 2:18.0.0-6776.g420cd129.el9 ceph 51 M 2023-11-05T08:04:46.527 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:04:46.527 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2023-11-05T08:04:46.527 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-11-05T08:04:46.527 INFO:teuthology.orchestra.run.smithi052.stdout:Install 1 Package 2023-11-05T08:04:46.527 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:04:46.527 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 51 M 2023-11-05T08:04:46.528 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 298 M 2023-11-05T08:04:46.528 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2023-11-05T08:04:48.934 INFO:teuthology.orchestra.run.smithi052.stdout:librbd1-debuginfo-18.0.0-6776.g420cd129.el9.x86 21 MB/s | 51 MB 00:02 2023-11-05T08:04:48.935 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2023-11-05T08:04:48.936 INFO:teuthology.orchestra.run.smithi052.stdout:Total 21 MB/s | 51 MB 00:02 2023-11-05T08:04:48.936 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2023-11-05T08:04:48.941 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2023-11-05T08:04:48.941 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2023-11-05T08:04:49.301 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2023-11-05T08:04:49.302 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2023-11-05T08:04:50.416 INFO:teuthology.orchestra.run.smithi156.stdout: Preparing : 1/1 2023-11-05T08:04:50.527 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : rbd-mirror-debuginfo-2:18.0.0-6776.g420cd129.el9.x86 1/1 2023-11-05T08:04:52.606 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: rbd-mirror-debuginfo-2:18.0.0-6776.g420cd129.el9.x86 1/1 2023-11-05T08:04:52.913 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : rbd-mirror-debuginfo-2:18.0.0-6776.g420cd129.el9.x86 1/1 2023-11-05T08:04:52.913 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T08:04:52.914 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2023-11-05T08:04:52.914 INFO:teuthology.orchestra.run.smithi156.stdout: rbd-mirror-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-05T08:04:52.914 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T08:04:52.914 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2023-11-05T08:04:53.146 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum -y install rbd-nbd-debuginfo 2023-11-05T08:04:53.782 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:09:14 ago on Sun 05 Nov 2023 07:55:39 AM UTC. 2023-11-05T08:04:53.924 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2023-11-05T08:04:53.925 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-05T08:04:53.925 INFO:teuthology.orchestra.run.smithi156.stdout: Package Arch Version Repo Size 2023-11-05T08:04:53.925 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-05T08:04:53.925 INFO:teuthology.orchestra.run.smithi156.stdout:Installing: 2023-11-05T08:04:53.925 INFO:teuthology.orchestra.run.smithi156.stdout: rbd-nbd-debuginfo x86_64 2:18.0.0-6776.g420cd129.el9 ceph 1.2 M 2023-11-05T08:04:53.926 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T08:04:53.926 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2023-11-05T08:04:53.926 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-11-05T08:04:53.926 INFO:teuthology.orchestra.run.smithi156.stdout:Install 1 Package 2023-11-05T08:04:53.926 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T08:04:53.927 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 1.2 M 2023-11-05T08:04:53.927 INFO:teuthology.orchestra.run.smithi156.stdout:Installed size: 5.4 M 2023-11-05T08:04:53.927 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading Packages: 2023-11-05T08:04:54.215 INFO:teuthology.orchestra.run.smithi156.stdout:rbd-nbd-debuginfo-18.0.0-6776.g420cd129.el9.x86 4.2 MB/s | 1.2 MB 00:00 2023-11-05T08:04:54.216 INFO:teuthology.orchestra.run.smithi156.stdout:-------------------------------------------------------------------------------- 2023-11-05T08:04:54.216 INFO:teuthology.orchestra.run.smithi156.stdout:Total 4.2 MB/s | 1.2 MB 00:00 2023-11-05T08:04:54.216 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2023-11-05T08:04:54.220 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction check succeeded. 2023-11-05T08:04:54.220 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2023-11-05T08:04:54.260 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded. 2023-11-05T08:04:54.260 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2023-11-05T08:04:54.498 INFO:teuthology.orchestra.run.smithi156.stdout: Preparing : 1/1 2023-11-05T08:04:54.605 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : rbd-nbd-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 1/1 2023-11-05T08:04:55.034 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: rbd-nbd-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 1/1 2023-11-05T08:04:55.313 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : rbd-nbd-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 1/1 2023-11-05T08:04:55.314 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T08:04:55.314 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2023-11-05T08:04:55.314 INFO:teuthology.orchestra.run.smithi156.stdout: rbd-nbd-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-05T08:04:55.314 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T08:04:55.314 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2023-11-05T08:04:55.492 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2023-11-05T08:04:55.528 DEBUG:teuthology.parallel:result is None 2023-11-05T08:04:55.618 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : librbd1-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 1/1 2023-11-05T08:04:57.858 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: librbd1-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 1/1 2023-11-05T08:04:58.145 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librbd1-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 1/1 2023-11-05T08:04:58.145 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:04:58.145 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2023-11-05T08:04:58.145 INFO:teuthology.orchestra.run.smithi052.stdout: librbd1-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-05T08:04:58.145 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:04:58.146 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2023-11-05T08:04:58.466 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install python3-cephfs-debuginfo 2023-11-05T08:04:59.043 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:09:17 ago on Sun 05 Nov 2023 07:55:42 AM UTC. 2023-11-05T08:04:59.190 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2023-11-05T08:04:59.191 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-11-05T08:04:59.191 INFO:teuthology.orchestra.run.smithi052.stdout: Package Arch Version Repo Size 2023-11-05T08:04:59.192 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-11-05T08:04:59.192 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2023-11-05T08:04:59.192 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cephfs-debuginfo x86_64 2:18.0.0-6776.g420cd129.el9 ceph 615 k 2023-11-05T08:04:59.192 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:04:59.192 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2023-11-05T08:04:59.193 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-11-05T08:04:59.193 INFO:teuthology.orchestra.run.smithi052.stdout:Install 1 Package 2023-11-05T08:04:59.193 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:04:59.193 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 615 k 2023-11-05T08:04:59.193 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 2.1 M 2023-11-05T08:04:59.194 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2023-11-05T08:04:59.445 INFO:teuthology.orchestra.run.smithi052.stdout:python3-cephfs-debuginfo-18.0.0-6776.g420cd129. 2.4 MB/s | 615 kB 00:00 2023-11-05T08:04:59.446 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2023-11-05T08:04:59.446 INFO:teuthology.orchestra.run.smithi052.stdout:Total 2.4 MB/s | 615 kB 00:00 2023-11-05T08:04:59.446 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2023-11-05T08:04:59.449 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2023-11-05T08:04:59.450 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2023-11-05T08:04:59.488 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2023-11-05T08:04:59.488 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2023-11-05T08:04:59.658 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2023-11-05T08:04:59.755 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cephfs-debuginfo-2:18.0.0-6776.g420cd129.el9 1/1 2023-11-05T08:05:00.167 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: python3-cephfs-debuginfo-2:18.0.0-6776.g420cd129.el9 1/1 2023-11-05T08:05:00.465 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cephfs-debuginfo-2:18.0.0-6776.g420cd129.el9 1/1 2023-11-05T08:05:00.465 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:05:00.465 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2023-11-05T08:05:00.465 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cephfs-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-05T08:05:00.466 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:05:00.466 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2023-11-05T08:05:00.677 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install python3-rados-debuginfo 2023-11-05T08:05:01.249 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:09:19 ago on Sun 05 Nov 2023 07:55:42 AM UTC. 2023-11-05T08:05:01.398 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2023-11-05T08:05:01.399 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-11-05T08:05:01.400 INFO:teuthology.orchestra.run.smithi052.stdout: Package Arch Version Repo Size 2023-11-05T08:05:01.400 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-11-05T08:05:01.400 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2023-11-05T08:05:01.400 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rados-debuginfo x86_64 2:18.0.0-6776.g420cd129.el9 ceph 770 k 2023-11-05T08:05:01.400 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:05:01.401 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2023-11-05T08:05:01.401 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-11-05T08:05:01.401 INFO:teuthology.orchestra.run.smithi052.stdout:Install 1 Package 2023-11-05T08:05:01.401 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:05:01.402 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 770 k 2023-11-05T08:05:01.402 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 2.7 M 2023-11-05T08:05:01.402 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2023-11-05T08:05:01.790 INFO:teuthology.orchestra.run.smithi052.stdout:python3-rados-debuginfo-18.0.0-6776.g420cd129.e 1.9 MB/s | 770 kB 00:00 2023-11-05T08:05:01.790 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2023-11-05T08:05:01.791 INFO:teuthology.orchestra.run.smithi052.stdout:Total 1.9 MB/s | 770 kB 00:00 2023-11-05T08:05:01.791 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2023-11-05T08:05:01.794 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2023-11-05T08:05:01.794 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2023-11-05T08:05:01.835 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2023-11-05T08:05:01.835 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2023-11-05T08:05:02.025 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2023-11-05T08:05:02.132 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-rados-debuginfo-2:18.0.0-6776.g420cd129.el9. 1/1 2023-11-05T08:05:02.535 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: python3-rados-debuginfo-2:18.0.0-6776.g420cd129.el9. 1/1 2023-11-05T08:05:02.812 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-rados-debuginfo-2:18.0.0-6776.g420cd129.el9. 1/1 2023-11-05T08:05:02.812 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:05:02.813 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2023-11-05T08:05:02.813 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rados-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-05T08:05:02.813 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:05:02.813 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2023-11-05T08:05:02.999 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install python3-rbd-debuginfo 2023-11-05T08:05:03.580 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:09:21 ago on Sun 05 Nov 2023 07:55:42 AM UTC. 2023-11-05T08:05:03.726 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2023-11-05T08:05:03.727 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-11-05T08:05:03.727 INFO:teuthology.orchestra.run.smithi052.stdout: Package Arch Version Repo Size 2023-11-05T08:05:03.728 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-11-05T08:05:03.728 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2023-11-05T08:05:03.728 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rbd-debuginfo x86_64 2:18.0.0-6776.g420cd129.el9 ceph 1.1 M 2023-11-05T08:05:03.728 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:05:03.728 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2023-11-05T08:05:03.729 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-11-05T08:05:03.729 INFO:teuthology.orchestra.run.smithi052.stdout:Install 1 Package 2023-11-05T08:05:03.729 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:05:03.729 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 1.1 M 2023-11-05T08:05:03.729 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 4.3 M 2023-11-05T08:05:03.730 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2023-11-05T08:05:04.026 INFO:teuthology.orchestra.run.smithi052.stdout:python3-rbd-debuginfo-18.0.0-6776.g420cd129.el9 3.8 MB/s | 1.1 MB 00:00 2023-11-05T08:05:04.027 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2023-11-05T08:05:04.027 INFO:teuthology.orchestra.run.smithi052.stdout:Total 3.8 MB/s | 1.1 MB 00:00 2023-11-05T08:05:04.027 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2023-11-05T08:05:04.030 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2023-11-05T08:05:04.031 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2023-11-05T08:05:04.073 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2023-11-05T08:05:04.073 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2023-11-05T08:05:04.298 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2023-11-05T08:05:04.411 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-rbd-debuginfo-2:18.0.0-6776.g420cd129.el9.x8 1/1 2023-11-05T08:05:04.813 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: python3-rbd-debuginfo-2:18.0.0-6776.g420cd129.el9.x8 1/1 2023-11-05T08:05:05.106 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-rbd-debuginfo-2:18.0.0-6776.g420cd129.el9.x8 1/1 2023-11-05T08:05:05.106 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:05:05.107 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2023-11-05T08:05:05.107 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rbd-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-05T08:05:05.107 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:05:05.107 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2023-11-05T08:05:05.290 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install python3-rgw-debuginfo 2023-11-05T08:05:05.869 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:09:23 ago on Sun 05 Nov 2023 07:55:42 AM UTC. 2023-11-05T08:05:06.017 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2023-11-05T08:05:06.017 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-11-05T08:05:06.018 INFO:teuthology.orchestra.run.smithi052.stdout: Package Arch Version Repo Size 2023-11-05T08:05:06.018 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-11-05T08:05:06.018 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2023-11-05T08:05:06.018 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rgw-debuginfo x86_64 2:18.0.0-6776.g420cd129.el9 ceph 337 k 2023-11-05T08:05:06.019 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:05:06.019 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2023-11-05T08:05:06.019 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-11-05T08:05:06.019 INFO:teuthology.orchestra.run.smithi052.stdout:Install 1 Package 2023-11-05T08:05:06.020 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:05:06.020 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 337 k 2023-11-05T08:05:06.020 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 1.0 M 2023-11-05T08:05:06.020 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2023-11-05T08:05:06.379 INFO:teuthology.orchestra.run.smithi052.stdout:python3-rgw-debuginfo-18.0.0-6776.g420cd129.el9 935 kB/s | 337 kB 00:00 2023-11-05T08:05:06.380 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2023-11-05T08:05:06.380 INFO:teuthology.orchestra.run.smithi052.stdout:Total 931 kB/s | 337 kB 00:00 2023-11-05T08:05:06.380 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2023-11-05T08:05:06.383 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2023-11-05T08:05:06.383 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2023-11-05T08:05:06.421 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2023-11-05T08:05:06.422 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2023-11-05T08:05:06.565 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2023-11-05T08:05:06.684 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-rgw-debuginfo-2:18.0.0-6776.g420cd129.el9.x8 1/1 2023-11-05T08:05:07.059 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: python3-rgw-debuginfo-2:18.0.0-6776.g420cd129.el9.x8 1/1 2023-11-05T08:05:07.347 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-rgw-debuginfo-2:18.0.0-6776.g420cd129.el9.x8 1/1 2023-11-05T08:05:07.347 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:05:07.347 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2023-11-05T08:05:07.347 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rgw-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-05T08:05:07.347 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:05:07.348 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2023-11-05T08:05:07.522 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install rbd-fuse-debuginfo 2023-11-05T08:05:08.101 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:09:26 ago on Sun 05 Nov 2023 07:55:42 AM UTC. 2023-11-05T08:05:08.247 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2023-11-05T08:05:08.248 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-11-05T08:05:08.248 INFO:teuthology.orchestra.run.smithi052.stdout: Package Arch Version Repo Size 2023-11-05T08:05:08.248 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-11-05T08:05:08.249 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2023-11-05T08:05:08.249 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-fuse-debuginfo x86_64 2:18.0.0-6776.g420cd129.el9 ceph 506 k 2023-11-05T08:05:08.249 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:05:08.249 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2023-11-05T08:05:08.249 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-11-05T08:05:08.250 INFO:teuthology.orchestra.run.smithi052.stdout:Install 1 Package 2023-11-05T08:05:08.250 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:05:08.250 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 506 k 2023-11-05T08:05:08.250 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 2.5 M 2023-11-05T08:05:08.250 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2023-11-05T08:05:08.532 INFO:teuthology.orchestra.run.smithi052.stdout:rbd-fuse-debuginfo-18.0.0-6776.g420cd129.el9.x8 1.7 MB/s | 506 kB 00:00 2023-11-05T08:05:08.533 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2023-11-05T08:05:08.533 INFO:teuthology.orchestra.run.smithi052.stdout:Total 1.7 MB/s | 506 kB 00:00 2023-11-05T08:05:08.534 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2023-11-05T08:05:08.536 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2023-11-05T08:05:08.537 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2023-11-05T08:05:08.577 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2023-11-05T08:05:08.577 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2023-11-05T08:05:08.744 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2023-11-05T08:05:08.850 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : rbd-fuse-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_6 1/1 2023-11-05T08:05:09.265 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: rbd-fuse-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_6 1/1 2023-11-05T08:05:09.556 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : rbd-fuse-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_6 1/1 2023-11-05T08:05:09.556 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:05:09.556 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2023-11-05T08:05:09.557 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-fuse-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-05T08:05:09.557 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:05:09.557 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2023-11-05T08:05:09.716 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install rbd-mirror-debuginfo 2023-11-05T08:05:10.294 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:09:28 ago on Sun 05 Nov 2023 07:55:42 AM UTC. 2023-11-05T08:05:10.442 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2023-11-05T08:05:10.442 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-11-05T08:05:10.442 INFO:teuthology.orchestra.run.smithi052.stdout: Package Arch Version Repo Size 2023-11-05T08:05:10.443 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-11-05T08:05:10.443 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2023-11-05T08:05:10.443 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-mirror-debuginfo x86_64 2:18.0.0-6776.g420cd129.el9 ceph 51 M 2023-11-05T08:05:10.443 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:05:10.443 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2023-11-05T08:05:10.444 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-11-05T08:05:10.444 INFO:teuthology.orchestra.run.smithi052.stdout:Install 1 Package 2023-11-05T08:05:10.444 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:05:10.444 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 51 M 2023-11-05T08:05:10.444 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 289 M 2023-11-05T08:05:10.445 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2023-11-05T08:05:13.101 INFO:teuthology.orchestra.run.smithi052.stdout:rbd-mirror-debuginfo-18.0.0-6776.g420cd129.el9. 19 MB/s | 51 MB 00:02 2023-11-05T08:05:13.102 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2023-11-05T08:05:13.103 INFO:teuthology.orchestra.run.smithi052.stdout:Total 19 MB/s | 51 MB 00:02 2023-11-05T08:05:13.103 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2023-11-05T08:05:13.107 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2023-11-05T08:05:13.107 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2023-11-05T08:05:13.457 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2023-11-05T08:05:13.457 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2023-11-05T08:05:19.585 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2023-11-05T08:05:19.676 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : rbd-mirror-debuginfo-2:18.0.0-6776.g420cd129.el9.x86 1/1 2023-11-05T08:05:21.637 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: rbd-mirror-debuginfo-2:18.0.0-6776.g420cd129.el9.x86 1/1 2023-11-05T08:05:21.920 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : rbd-mirror-debuginfo-2:18.0.0-6776.g420cd129.el9.x86 1/1 2023-11-05T08:05:21.921 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:05:21.921 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2023-11-05T08:05:21.921 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-mirror-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-05T08:05:21.921 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:05:21.921 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2023-11-05T08:05:22.123 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install rbd-nbd-debuginfo 2023-11-05T08:05:22.699 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:09:40 ago on Sun 05 Nov 2023 07:55:42 AM UTC. 2023-11-05T08:05:22.848 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2023-11-05T08:05:22.849 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-11-05T08:05:22.849 INFO:teuthology.orchestra.run.smithi052.stdout: Package Arch Version Repo Size 2023-11-05T08:05:22.849 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-11-05T08:05:22.849 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2023-11-05T08:05:22.850 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-nbd-debuginfo x86_64 2:18.0.0-6776.g420cd129.el9 ceph 1.2 M 2023-11-05T08:05:22.850 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:05:22.850 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2023-11-05T08:05:22.850 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-11-05T08:05:22.850 INFO:teuthology.orchestra.run.smithi052.stdout:Install 1 Package 2023-11-05T08:05:22.851 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:05:22.852 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 1.2 M 2023-11-05T08:05:22.852 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 5.4 M 2023-11-05T08:05:22.852 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2023-11-05T08:05:23.154 INFO:teuthology.orchestra.run.smithi052.stdout:rbd-nbd-debuginfo-18.0.0-6776.g420cd129.el9.x86 4.1 MB/s | 1.2 MB 00:00 2023-11-05T08:05:23.155 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2023-11-05T08:05:23.155 INFO:teuthology.orchestra.run.smithi052.stdout:Total 4.0 MB/s | 1.2 MB 00:00 2023-11-05T08:05:23.155 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2023-11-05T08:05:23.158 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2023-11-05T08:05:23.158 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2023-11-05T08:05:23.202 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2023-11-05T08:05:23.202 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2023-11-05T08:05:23.445 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2023-11-05T08:05:23.538 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : rbd-nbd-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 1/1 2023-11-05T08:05:23.952 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: rbd-nbd-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 1/1 2023-11-05T08:05:24.226 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : rbd-nbd-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 1/1 2023-11-05T08:05:24.227 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:05:24.227 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2023-11-05T08:05:24.227 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-nbd-debuginfo-2:18.0.0-6776.g420cd129.el9.x86_64 2023-11-05T08:05:24.227 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:05:24.227 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2023-11-05T08:05:24.392 DEBUG:teuthology.parallel:result is None 2023-11-05T08:05:24.393 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=420cd129397301b1521ceb74e1bdbd9b855d2189 2023-11-05T08:05:24.539 DEBUG:teuthology.orchestra.run.smithi052:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-11-05T08:05:24.562 INFO:teuthology.orchestra.run.smithi052.stdout:18.0.0-6776.g420cd129.el9 2023-11-05T08:05:24.562 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6776.g420cd129.el9 2023-11-05T08:05:24.563 INFO:teuthology.task.install:The correct ceph version 18.0.0-6776.g420cd129 is installed. 2023-11-05T08:05:24.563 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=420cd129397301b1521ceb74e1bdbd9b855d2189 2023-11-05T08:05:24.775 DEBUG:teuthology.orchestra.run.smithi156:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-11-05T08:05:24.800 INFO:teuthology.orchestra.run.smithi156.stdout:18.0.0-6776.g420cd129.el9 2023-11-05T08:05:24.800 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6776.g420cd129.el9 2023-11-05T08:05:24.801 INFO:teuthology.task.install:The correct ceph version 18.0.0-6776.g420cd129 is installed. 2023-11-05T08:05:24.801 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-11-05T08:05:24.802 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-11-05T08:05:24.802 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-05T08:05:24.834 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-11-05T08:05:24.834 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-05T08:05:24.870 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-11-05T08:05:24.871 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-11-05T08:05:24.871 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/usr/bin/daemon-helper 2023-11-05T08:05:24.905 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-05T08:05:24.976 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-11-05T08:05:24.976 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/usr/bin/daemon-helper 2023-11-05T08:05:25.006 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-05T08:05:25.076 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-11-05T08:05:25.077 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-11-05T08:05:25.077 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-05T08:05:25.107 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-05T08:05:25.178 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-11-05T08:05:25.178 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-05T08:05:25.208 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-05T08:05:25.276 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-11-05T08:05:25.277 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-11-05T08:05:25.277 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/usr/bin/stdin-killer 2023-11-05T08:05:25.308 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-05T08:05:25.378 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-11-05T08:05:25.379 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/usr/bin/stdin-killer 2023-11-05T08:05:25.407 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-05T08:05:25.475 INFO:teuthology.run_tasks:Running task ceph... 2023-11-05T08:05:25.546 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-11-05T08:05:25.546 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 777 /var/log/ceph 2023-11-05T08:05:25.549 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod 777 /var/log/ceph 2023-11-05T08:05:25.577 INFO:tasks.ceph:Disabling ceph logrotate... 2023-11-05T08:05:25.578 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-05T08:05:25.620 DEBUG:teuthology.orchestra.run.smithi156:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-05T08:05:25.649 INFO:tasks.ceph:Creating extra log directories... 2023-11-05T08:05:25.649 DEBUG:teuthology.orchestra.run.smithi052:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-05T08:05:25.692 DEBUG:teuthology.orchestra.run.smithi156:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-05T08:05:25.729 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-11-05T08:05:25.730 INFO:tasks.ceph:config {'conf': {'client': {'debug monc': 20, 'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms inject socket failures': 5000, 'ms type': 'async', 'osd heartbeat grace': 80}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osd crush smoke test': False, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub interval': 300, 'mon warn on pool no app': False, 'paxos service trim min': 10}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 1, 'debug bluestore': 1, 'debug monc': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd class default list': '*', 'osd class load list': '*', 'osd client watch timeout': 120, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'reached quota', 'overall HEALTH_', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(SLOW_OPS\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(OBJECT_MISPLACED\\)', 'slow request', 'overall HEALTH_', '\\(PG_', '\\(MON_DOWN\\)', '\\(SLOW_OPS\\)', 'slow request'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-11-05T08:05:25.730 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/benhanokh-2023-10-31_16:46:33-rados-DBG_maintain_prefix_itr_2-distro-default-smithi/7442385', 'branch': 'DBG_maintain_prefix_itr_2', 'description': 'rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/valgrind}', 'email': None, 'first_in_suite': False, 'job_id': '7442385', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'benhanokh-2023-10-31_16:46:33-rados-DBG_maintain_prefix_itr_2-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 10}}, {'volumes': {'count': 4, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'DBG_maintain_prefix_itr_2'}, 'ceph': {'conf': {'client': {'debug monc': 20, 'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms inject socket failures': 5000, 'ms type': 'async', 'osd heartbeat grace': 80}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osd crush smoke test': False, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub interval': 300, 'mon warn on pool no app': False, 'paxos service trim min': 10}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 1, 'debug bluestore': 1, 'debug monc': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd class default list': '*', 'osd class load list': '*', 'osd client watch timeout': 120, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'reached quota', 'overall HEALTH_', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(SLOW_OPS\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(OBJECT_MISPLACED\\)', 'slow request', 'overall HEALTH_', '\\(PG_', '\\(MON_DOWN\\)', '\\(SLOW_OPS\\)', 'slow request'], 'sha1': '420cd129397301b1521ceb74e1bdbd9b855d2189', 'valgrind': {'mds': ['--tool=memcheck'], 'mon': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes'], 'osd': ['--tool=memcheck']}}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': '420cd129397301b1521ceb74e1bdbd9b855d2189'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'DBG_maintain_prefix_itr_2', 'sha1': '420cd129397301b1521ceb74e1bdbd9b855d2189'}}, 'owner': 'scheduled_benhanokh@teuthology', 'priority': 100, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 9009, 'sha1': '420cd129397301b1521ceb74e1bdbd9b855d2189', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'rados', 'suite_branch': 'DBG_maintain_prefix_itr_2', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_420cd129397301b1521ceb74e1bdbd9b855d2189/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '420cd129397301b1521ceb74e1bdbd9b855d2189', 'targets': {'smithi052.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEnDpDiifinTJpL2PjgfOfqPw0mIrozR3cpuVohSdrZusZbneajbBvaY0GmuKnMds6oReCVH86Po0gxqygx6Zs4=', 'smithi156.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBjlaTh+P400Hnio2yqVR2ZsDZeYdz/ykjr62agH2TJg9XA0N+iYqmUCBbjM03GAMAR+MiFjR/S3l40LvJzmwTI='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'workunit': {'clients': {'client.0': ['rados/test.sh']}, 'env': {'ALLOW_TIMEOUTS': '1'}, 'timeout': '6h'}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '6899cd26fceddb2fec83dc1a1349394b28c8998e', 'timestamp': '2023-10-31_16:46:33', 'tube': 'smithi', 'user': 'benhanokh', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3084822'} 2023-11-05T08:05:25.731 DEBUG:teuthology.orchestra.run.smithi052:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-05T08:05:25.762 DEBUG:teuthology.orchestra.run.smithi156:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-05T08:05:25.778 DEBUG:teuthology.orchestra.run.smithi052:> sudo install -d -m0777 -- /var/run/ceph 2023-11-05T08:05:25.818 DEBUG:teuthology.orchestra.run.smithi156:> sudo install -d -m0777 -- /var/run/ceph 2023-11-05T08:05:25.845 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-11-05T08:05:25.846 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/scratch_devs of=/dev/stdout 2023-11-05T08:05:25.901 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-05T08:05:25.901 DEBUG:teuthology.orchestra.run.smithi052:> stat /dev/vg_nvme/lv_1 2023-11-05T08:05:25.956 INFO:teuthology.orchestra.run.smithi052.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-05T08:05:25.956 INFO:teuthology.orchestra.run.smithi052.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-05T08:05:25.957 INFO:teuthology.orchestra.run.smithi052.stdout:Device: 5h/5d Inode: 663 Links: 1 2023-11-05T08:05:25.957 INFO:teuthology.orchestra.run.smithi052.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-05T08:05:25.957 INFO:teuthology.orchestra.run.smithi052.stdout:Context: system_u:object_r:device_t:s0 2023-11-05T08:05:25.957 INFO:teuthology.orchestra.run.smithi052.stdout:Access: 2023-11-05 07:57:26.845461231 +0000 2023-11-05T08:05:25.957 INFO:teuthology.orchestra.run.smithi052.stdout:Modify: 2023-11-05 07:54:52.904513766 +0000 2023-11-05T08:05:25.958 INFO:teuthology.orchestra.run.smithi052.stdout:Change: 2023-11-05 07:54:52.904513766 +0000 2023-11-05T08:05:25.958 INFO:teuthology.orchestra.run.smithi052.stdout: Birth: 2023-11-05 07:54:52.904513766 +0000 2023-11-05T08:05:25.958 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-05T08:05:26.025 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2023-11-05T08:05:26.025 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2023-11-05T08:05:26.026 INFO:teuthology.orchestra.run.smithi052.stderr:512 bytes copied, 7.6886e-05 s, 6.7 MB/s 2023-11-05T08:05:26.027 DEBUG:teuthology.orchestra.run.smithi052:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-05T08:05:26.083 DEBUG:teuthology.orchestra.run.smithi052:> stat /dev/vg_nvme/lv_2 2023-11-05T08:05:26.138 INFO:teuthology.orchestra.run.smithi052.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-05T08:05:26.139 INFO:teuthology.orchestra.run.smithi052.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-05T08:05:26.139 INFO:teuthology.orchestra.run.smithi052.stdout:Device: 5h/5d Inode: 684 Links: 1 2023-11-05T08:05:26.139 INFO:teuthology.orchestra.run.smithi052.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-05T08:05:26.139 INFO:teuthology.orchestra.run.smithi052.stdout:Context: system_u:object_r:device_t:s0 2023-11-05T08:05:26.140 INFO:teuthology.orchestra.run.smithi052.stdout:Access: 2023-11-05 07:57:26.845461231 +0000 2023-11-05T08:05:26.140 INFO:teuthology.orchestra.run.smithi052.stdout:Modify: 2023-11-05 07:54:53.406507362 +0000 2023-11-05T08:05:26.140 INFO:teuthology.orchestra.run.smithi052.stdout:Change: 2023-11-05 07:54:53.406507362 +0000 2023-11-05T08:05:26.140 INFO:teuthology.orchestra.run.smithi052.stdout: Birth: 2023-11-05 07:54:53.406507362 +0000 2023-11-05T08:05:26.141 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-05T08:05:26.208 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2023-11-05T08:05:26.208 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2023-11-05T08:05:26.208 INFO:teuthology.orchestra.run.smithi052.stderr:512 bytes copied, 9.6468e-05 s, 5.3 MB/s 2023-11-05T08:05:26.210 DEBUG:teuthology.orchestra.run.smithi052:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-05T08:05:26.266 DEBUG:teuthology.orchestra.run.smithi052:> stat /dev/vg_nvme/lv_3 2023-11-05T08:05:26.321 INFO:teuthology.orchestra.run.smithi052.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-05T08:05:26.322 INFO:teuthology.orchestra.run.smithi052.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-05T08:05:26.322 INFO:teuthology.orchestra.run.smithi052.stdout:Device: 5h/5d Inode: 700 Links: 1 2023-11-05T08:05:26.322 INFO:teuthology.orchestra.run.smithi052.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-05T08:05:26.322 INFO:teuthology.orchestra.run.smithi052.stdout:Context: system_u:object_r:device_t:s0 2023-11-05T08:05:26.322 INFO:teuthology.orchestra.run.smithi052.stdout:Access: 2023-11-05 07:57:26.845461231 +0000 2023-11-05T08:05:26.323 INFO:teuthology.orchestra.run.smithi052.stdout:Modify: 2023-11-05 07:54:53.898501086 +0000 2023-11-05T08:05:26.323 INFO:teuthology.orchestra.run.smithi052.stdout:Change: 2023-11-05 07:54:53.898501086 +0000 2023-11-05T08:05:26.323 INFO:teuthology.orchestra.run.smithi052.stdout: Birth: 2023-11-05 07:54:53.898501086 +0000 2023-11-05T08:05:26.323 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-05T08:05:26.389 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2023-11-05T08:05:26.390 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2023-11-05T08:05:26.390 INFO:teuthology.orchestra.run.smithi052.stderr:512 bytes copied, 9.2775e-05 s, 5.5 MB/s 2023-11-05T08:05:26.391 DEBUG:teuthology.orchestra.run.smithi052:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-05T08:05:26.447 DEBUG:teuthology.orchestra.run.smithi052:> stat /dev/vg_nvme/lv_4 2023-11-05T08:05:26.502 INFO:teuthology.orchestra.run.smithi052.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-05T08:05:26.502 INFO:teuthology.orchestra.run.smithi052.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-05T08:05:26.503 INFO:teuthology.orchestra.run.smithi052.stdout:Device: 5h/5d Inode: 721 Links: 1 2023-11-05T08:05:26.503 INFO:teuthology.orchestra.run.smithi052.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-05T08:05:26.503 INFO:teuthology.orchestra.run.smithi052.stdout:Context: system_u:object_r:device_t:s0 2023-11-05T08:05:26.503 INFO:teuthology.orchestra.run.smithi052.stdout:Access: 2023-11-05 07:57:26.845461231 +0000 2023-11-05T08:05:26.503 INFO:teuthology.orchestra.run.smithi052.stdout:Modify: 2023-11-05 07:54:54.378494962 +0000 2023-11-05T08:05:26.504 INFO:teuthology.orchestra.run.smithi052.stdout:Change: 2023-11-05 07:54:54.378494962 +0000 2023-11-05T08:05:26.504 INFO:teuthology.orchestra.run.smithi052.stdout: Birth: 2023-11-05 07:54:54.378494962 +0000 2023-11-05T08:05:26.504 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-05T08:05:26.571 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2023-11-05T08:05:26.571 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2023-11-05T08:05:26.571 INFO:teuthology.orchestra.run.smithi052.stderr:512 bytes copied, 9.3433e-05 s, 5.5 MB/s 2023-11-05T08:05:26.572 DEBUG:teuthology.orchestra.run.smithi052:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-05T08:05:26.628 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-05T08:05:26.628 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-11-05T08:05:26.629 DEBUG:teuthology.orchestra.run.smithi156:> dd if=/scratch_devs of=/dev/stdout 2023-11-05T08:05:26.647 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-05T08:05:26.647 DEBUG:teuthology.orchestra.run.smithi156:> stat /dev/vg_nvme/lv_1 2023-11-05T08:05:26.704 INFO:teuthology.orchestra.run.smithi156.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-05T08:05:26.704 INFO:teuthology.orchestra.run.smithi156.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-05T08:05:26.704 INFO:teuthology.orchestra.run.smithi156.stdout:Device: 5h/5d Inode: 663 Links: 1 2023-11-05T08:05:26.704 INFO:teuthology.orchestra.run.smithi156.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-05T08:05:26.705 INFO:teuthology.orchestra.run.smithi156.stdout:Context: system_u:object_r:device_t:s0 2023-11-05T08:05:26.705 INFO:teuthology.orchestra.run.smithi156.stdout:Access: 2023-11-05 07:57:27.951218672 +0000 2023-11-05T08:05:26.705 INFO:teuthology.orchestra.run.smithi156.stdout:Modify: 2023-11-05 07:54:46.656989161 +0000 2023-11-05T08:05:26.705 INFO:teuthology.orchestra.run.smithi156.stdout:Change: 2023-11-05 07:54:46.656989161 +0000 2023-11-05T08:05:26.706 INFO:teuthology.orchestra.run.smithi156.stdout: Birth: 2023-11-05 07:54:46.656989161 +0000 2023-11-05T08:05:26.706 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-05T08:05:26.772 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records in 2023-11-05T08:05:26.772 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records out 2023-11-05T08:05:26.772 INFO:teuthology.orchestra.run.smithi156.stderr:512 bytes copied, 0.000115058 s, 4.4 MB/s 2023-11-05T08:05:26.773 DEBUG:teuthology.orchestra.run.smithi156:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-05T08:05:26.830 DEBUG:teuthology.orchestra.run.smithi156:> stat /dev/vg_nvme/lv_2 2023-11-05T08:05:26.886 INFO:teuthology.orchestra.run.smithi156.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-05T08:05:26.887 INFO:teuthology.orchestra.run.smithi156.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-05T08:05:26.887 INFO:teuthology.orchestra.run.smithi156.stdout:Device: 5h/5d Inode: 682 Links: 1 2023-11-05T08:05:26.887 INFO:teuthology.orchestra.run.smithi156.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-05T08:05:26.887 INFO:teuthology.orchestra.run.smithi156.stdout:Context: system_u:object_r:device_t:s0 2023-11-05T08:05:26.888 INFO:teuthology.orchestra.run.smithi156.stdout:Access: 2023-11-05 07:57:27.952218657 +0000 2023-11-05T08:05:26.888 INFO:teuthology.orchestra.run.smithi156.stdout:Modify: 2023-11-05 07:54:47.123982371 +0000 2023-11-05T08:05:26.888 INFO:teuthology.orchestra.run.smithi156.stdout:Change: 2023-11-05 07:54:47.123982371 +0000 2023-11-05T08:05:26.888 INFO:teuthology.orchestra.run.smithi156.stdout: Birth: 2023-11-05 07:54:47.123982371 +0000 2023-11-05T08:05:26.889 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-05T08:05:26.953 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records in 2023-11-05T08:05:26.954 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records out 2023-11-05T08:05:26.954 INFO:teuthology.orchestra.run.smithi156.stderr:512 bytes copied, 8.0819e-05 s, 6.3 MB/s 2023-11-05T08:05:26.955 DEBUG:teuthology.orchestra.run.smithi156:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-05T08:05:27.012 DEBUG:teuthology.orchestra.run.smithi156:> stat /dev/vg_nvme/lv_3 2023-11-05T08:05:27.068 INFO:teuthology.orchestra.run.smithi156.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-05T08:05:27.068 INFO:teuthology.orchestra.run.smithi156.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-05T08:05:27.068 INFO:teuthology.orchestra.run.smithi156.stdout:Device: 5h/5d Inode: 702 Links: 1 2023-11-05T08:05:27.069 INFO:teuthology.orchestra.run.smithi156.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-05T08:05:27.069 INFO:teuthology.orchestra.run.smithi156.stdout:Context: system_u:object_r:device_t:s0 2023-11-05T08:05:27.069 INFO:teuthology.orchestra.run.smithi156.stdout:Access: 2023-11-05 07:57:27.952218657 +0000 2023-11-05T08:05:27.070 INFO:teuthology.orchestra.run.smithi156.stdout:Modify: 2023-11-05 07:54:47.594975524 +0000 2023-11-05T08:05:27.070 INFO:teuthology.orchestra.run.smithi156.stdout:Change: 2023-11-05 07:54:47.594975524 +0000 2023-11-05T08:05:27.070 INFO:teuthology.orchestra.run.smithi156.stdout: Birth: 2023-11-05 07:54:47.594975524 +0000 2023-11-05T08:05:27.070 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-05T08:05:27.134 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records in 2023-11-05T08:05:27.134 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records out 2023-11-05T08:05:27.134 INFO:teuthology.orchestra.run.smithi156.stderr:512 bytes copied, 0.000104606 s, 4.9 MB/s 2023-11-05T08:05:27.135 DEBUG:teuthology.orchestra.run.smithi156:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-05T08:05:27.192 DEBUG:teuthology.orchestra.run.smithi156:> stat /dev/vg_nvme/lv_4 2023-11-05T08:05:27.247 INFO:teuthology.orchestra.run.smithi156.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-05T08:05:27.247 INFO:teuthology.orchestra.run.smithi156.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-05T08:05:27.247 INFO:teuthology.orchestra.run.smithi156.stdout:Device: 5h/5d Inode: 722 Links: 1 2023-11-05T08:05:27.247 INFO:teuthology.orchestra.run.smithi156.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-05T08:05:27.248 INFO:teuthology.orchestra.run.smithi156.stdout:Context: system_u:object_r:device_t:s0 2023-11-05T08:05:27.248 INFO:teuthology.orchestra.run.smithi156.stdout:Access: 2023-11-05 07:57:27.953218642 +0000 2023-11-05T08:05:27.248 INFO:teuthology.orchestra.run.smithi156.stdout:Modify: 2023-11-05 07:54:48.084968400 +0000 2023-11-05T08:05:27.248 INFO:teuthology.orchestra.run.smithi156.stdout:Change: 2023-11-05 07:54:48.084968400 +0000 2023-11-05T08:05:27.248 INFO:teuthology.orchestra.run.smithi156.stdout: Birth: 2023-11-05 07:54:48.084968400 +0000 2023-11-05T08:05:27.249 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-05T08:05:27.312 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records in 2023-11-05T08:05:27.312 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records out 2023-11-05T08:05:27.313 INFO:teuthology.orchestra.run.smithi156.stderr:512 bytes copied, 0.000100199 s, 5.1 MB/s 2023-11-05T08:05:27.314 DEBUG:teuthology.orchestra.run.smithi156:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-05T08:05:27.369 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-05T08:05:27.370 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi052.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi156.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-05T08:05:27.370 INFO:tasks.ceph:Generating config... 2023-11-05T08:05:27.371 INFO:tasks.ceph:[client] debug monc = 20 2023-11-05T08:05:27.372 INFO:tasks.ceph:[client] debug ms = 1 2023-11-05T08:05:27.372 INFO:tasks.ceph:[client] debug objecter = 20 2023-11-05T08:05:27.372 INFO:tasks.ceph:[client] debug rados = 20 2023-11-05T08:05:27.372 INFO:tasks.ceph:[global] mon client directed command retry = 5 2023-11-05T08:05:27.373 INFO:tasks.ceph:[global] mon election default strategy = 1 2023-11-05T08:05:27.373 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2023-11-05T08:05:27.373 INFO:tasks.ceph:[global] ms type = async 2023-11-05T08:05:27.373 INFO:tasks.ceph:[global] osd heartbeat grace = 80 2023-11-05T08:05:27.374 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-11-05T08:05:27.374 INFO:tasks.ceph:[mgr] debug ms = 1 2023-11-05T08:05:27.374 INFO:tasks.ceph:[mon] debug mon = 20 2023-11-05T08:05:27.374 INFO:tasks.ceph:[mon] debug ms = 1 2023-11-05T08:05:27.375 INFO:tasks.ceph:[mon] debug paxos = 20 2023-11-05T08:05:27.375 INFO:tasks.ceph:[mon] mon min osdmap epochs = 50 2023-11-05T08:05:27.375 INFO:tasks.ceph:[mon] mon osd crush smoke test = False 2023-11-05T08:05:27.375 INFO:tasks.ceph:[mon] mon osdmap full prune interval = 2 2023-11-05T08:05:27.376 INFO:tasks.ceph:[mon] mon osdmap full prune min = 15 2023-11-05T08:05:27.376 INFO:tasks.ceph:[mon] mon osdmap full prune txsize = 2 2023-11-05T08:05:27.376 INFO:tasks.ceph:[mon] mon scrub interval = 300 2023-11-05T08:05:27.376 INFO:tasks.ceph:[mon] mon warn on pool no app = False 2023-11-05T08:05:27.377 INFO:tasks.ceph:[mon] paxos service trim min = 10 2023-11-05T08:05:27.377 INFO:tasks.ceph:[osd] bdev async discard = True 2023-11-05T08:05:27.377 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-11-05T08:05:27.378 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-11-05T08:05:27.378 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-11-05T08:05:27.378 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-11-05T08:05:27.379 INFO:tasks.ceph:[osd] bluestore zero block detection = True 2023-11-05T08:05:27.379 INFO:tasks.ceph:[osd] debug bluefs = 1 2023-11-05T08:05:27.379 INFO:tasks.ceph:[osd] debug bluestore = 1 2023-11-05T08:05:27.379 INFO:tasks.ceph:[osd] debug monc = 20 2023-11-05T08:05:27.380 INFO:tasks.ceph:[osd] debug ms = 1 2023-11-05T08:05:27.380 INFO:tasks.ceph:[osd] debug osd = 20 2023-11-05T08:05:27.380 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-11-05T08:05:27.380 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-11-05T08:05:27.381 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-11-05T08:05:27.381 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-11-05T08:05:27.381 INFO:tasks.ceph:[osd] osd class default list = * 2023-11-05T08:05:27.382 INFO:tasks.ceph:[osd] osd class load list = * 2023-11-05T08:05:27.382 INFO:tasks.ceph:[osd] osd client watch timeout = 120 2023-11-05T08:05:27.382 INFO:tasks.ceph:[osd] osd debug verify cached snaps = True 2023-11-05T08:05:27.382 INFO:tasks.ceph:[osd] osd debug verify missing on start = True 2023-11-05T08:05:27.383 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-11-05T08:05:27.383 INFO:tasks.ceph:[osd] osd fast shutdown = False 2023-11-05T08:05:27.383 INFO:tasks.ceph:[osd] osd mclock override recovery settings = True 2023-11-05T08:05:27.383 INFO:tasks.ceph:[osd] osd mclock profile = high_recovery_ops 2023-11-05T08:05:27.384 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-11-05T08:05:27.384 INFO:tasks.ceph:[osd] osd op queue = debug_random 2023-11-05T08:05:27.384 INFO:tasks.ceph:[osd] osd op queue cut off = debug_random 2023-11-05T08:05:27.384 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2023-11-05T08:05:27.385 INFO:tasks.ceph:Setting up mon.a... 2023-11-05T08:05:27.385 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-11-05T08:05:27.441 INFO:teuthology.orchestra.run.smithi052.stdout:creating /etc/ceph/ceph.keyring 2023-11-05T08:05:27.444 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-11-05T08:05:27.495 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-05T08:05:27.526 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.52'), ('mon.c', '[v2:172.21.15.52:3301,v1:172.21.15.52:6790]'), ('mon.b', '172.21.15.156')] 2023-11-05T08:05:27.527 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.52,[v2:172.21.15.52:3301,v1:172.21.15.52:6790],172.21.15.156', 'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms inject socket failures': 5000, 'ms type': 'async', 'osd heartbeat grace': 80}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 1, 'debug bluestore': 1, 'debug monc': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd class default list': '*', 'osd class load list': '*', 'osd client watch timeout': 120, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd mclock override recovery settings': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon min osdmap epochs': 50, 'mon osd crush smoke test': False, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub interval': 300, 'mon warn on pool no app': False, 'paxos service trim min': 10}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug monc': 20, 'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2023-11-05T08:05:27.528 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-11-05T08:05:27.528 DEBUG:teuthology.orchestra.run.smithi052:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-11-05T08:05:27.581 DEBUG:teuthology.orchestra.run.smithi052:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.52 --addv c '[v2:172.21.15.52:3301,v1:172.21.15.52:6790]' --add b 172.21.15.156 --print /home/ubuntu/cephtest/ceph.monmap 2023-11-05T08:05:27.666 INFO:teuthology.orchestra.run.smithi052.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-11-05T08:05:27.666 INFO:teuthology.orchestra.run.smithi052.stdout:monmaptool: generated fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:05:27.667 INFO:teuthology.orchestra.run.smithi052.stdout:setting min_mon_release = pacific 2023-11-05T08:05:27.667 INFO:teuthology.orchestra.run.smithi052.stdout:epoch 0 2023-11-05T08:05:27.667 INFO:teuthology.orchestra.run.smithi052.stdout:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:05:27.667 INFO:teuthology.orchestra.run.smithi052.stdout:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:05:27.667 INFO:teuthology.orchestra.run.smithi052.stdout:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:05:27.668 INFO:teuthology.orchestra.run.smithi052.stdout:min_mon_release 16 (pacific) 2023-11-05T08:05:27.668 INFO:teuthology.orchestra.run.smithi052.stdout:election_strategy: 1 2023-11-05T08:05:27.668 INFO:teuthology.orchestra.run.smithi052.stdout:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:05:27.668 INFO:teuthology.orchestra.run.smithi052.stdout:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:05:27.668 INFO:teuthology.orchestra.run.smithi052.stdout:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:05:27.669 INFO:teuthology.orchestra.run.smithi052.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-11-05T08:05:27.670 DEBUG:teuthology.orchestra.run.smithi052:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-11-05T08:05:27.685 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID b7fdc914-b520-409f-b9d7-902b05a64252... 2023-11-05T08:05:27.686 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-05T08:05:27.727 DEBUG:teuthology.orchestra.run.smithi156:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-05T08:05:27.779 INFO:teuthology.orchestra.run.smithi156.stdout:[global] 2023-11-05T08:05:27.779 INFO:teuthology.orchestra.run.smithi156.stdout: chdir = "" 2023-11-05T08:05:27.779 INFO:teuthology.orchestra.run.smithi156.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-05T08:05:27.779 INFO:teuthology.orchestra.run.smithi156.stdout: auth supported = cephx 2023-11-05T08:05:27.780 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T08:05:27.780 INFO:teuthology.orchestra.run.smithi156.stdout: filestore xattr use omap = true 2023-11-05T08:05:27.780 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T08:05:27.780 INFO:teuthology.orchestra.run.smithi156.stdout: mon clock drift allowed = 1.000 2023-11-05T08:05:27.780 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T08:05:27.781 INFO:teuthology.orchestra.run.smithi156.stdout: osd crush chooseleaf type = 0 2023-11-05T08:05:27.781 INFO:teuthology.orchestra.run.smithi156.stdout: auth debug = true 2023-11-05T08:05:27.781 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T08:05:27.781 INFO:teuthology.orchestra.run.smithi156.stdout: ms die on old message = true 2023-11-05T08:05:27.781 INFO:teuthology.orchestra.run.smithi156.stdout: ms die on bug = true 2023-11-05T08:05:27.782 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T08:05:27.782 INFO:teuthology.orchestra.run.smithi156.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-05T08:05:27.782 INFO:teuthology.orchestra.run.smithi156.stdout: mon pg warn max object skew = 0 2023-11-05T08:05:27.782 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T08:05:27.782 INFO:teuthology.orchestra.run.smithi156.stdout: # disable pg_autoscaler by default for new pools 2023-11-05T08:05:27.782 INFO:teuthology.orchestra.run.smithi156.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-05T08:05:27.783 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T08:05:27.783 INFO:teuthology.orchestra.run.smithi156.stdout: osd pool default size = 2 2023-11-05T08:05:27.783 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T08:05:27.783 INFO:teuthology.orchestra.run.smithi156.stdout: mon osd allow primary affinity = true 2023-11-05T08:05:27.784 INFO:teuthology.orchestra.run.smithi156.stdout: mon osd allow pg remap = true 2023-11-05T08:05:27.784 INFO:teuthology.orchestra.run.smithi156.stdout: mon warn on legacy crush tunables = false 2023-11-05T08:05:27.785 INFO:teuthology.orchestra.run.smithi156.stdout: mon warn on crush straw calc version zero = false 2023-11-05T08:05:27.785 INFO:teuthology.orchestra.run.smithi156.stdout: mon warn on no sortbitwise = false 2023-11-05T08:05:27.785 INFO:teuthology.orchestra.run.smithi156.stdout: mon warn on osd down out interval zero = false 2023-11-05T08:05:27.785 INFO:teuthology.orchestra.run.smithi156.stdout: mon warn on too few osds = false 2023-11-05T08:05:27.786 INFO:teuthology.orchestra.run.smithi156.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-05T08:05:27.786 INFO:teuthology.orchestra.run.smithi156.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-05T08:05:27.786 INFO:teuthology.orchestra.run.smithi156.stdout: mon_allow_pool_size_one = true 2023-11-05T08:05:27.786 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T08:05:27.786 INFO:teuthology.orchestra.run.smithi156.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-05T08:05:27.787 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T08:05:27.787 INFO:teuthology.orchestra.run.smithi156.stdout: osd default data pool replay window = 5 2023-11-05T08:05:27.787 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T08:05:27.787 INFO:teuthology.orchestra.run.smithi156.stdout: mon allow pool delete = true 2023-11-05T08:05:27.787 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T08:05:27.787 INFO:teuthology.orchestra.run.smithi156.stdout: mon cluster log file level = debug 2023-11-05T08:05:27.788 INFO:teuthology.orchestra.run.smithi156.stdout: debug asserts on shutdown = true 2023-11-05T08:05:27.788 INFO:teuthology.orchestra.run.smithi156.stdout: mon health detail to clog = false 2023-11-05T08:05:27.788 INFO:teuthology.orchestra.run.smithi156.stdout: mon host = "172.21.15.52,[v2:172.21.15.52:3301,v1:172.21.15.52:6790],172.21.15.156" 2023-11-05T08:05:27.788 INFO:teuthology.orchestra.run.smithi156.stdout: mon client directed command retry = 5 2023-11-05T08:05:27.788 INFO:teuthology.orchestra.run.smithi156.stdout: mon election default strategy = 1 2023-11-05T08:05:27.789 INFO:teuthology.orchestra.run.smithi156.stdout: ms inject socket failures = 5000 2023-11-05T08:05:27.789 INFO:teuthology.orchestra.run.smithi156.stdout: ms type = async 2023-11-05T08:05:27.789 INFO:teuthology.orchestra.run.smithi156.stdout: osd heartbeat grace = 80 2023-11-05T08:05:27.789 INFO:teuthology.orchestra.run.smithi156.stdout: fsid = b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:05:27.789 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T08:05:27.789 INFO:teuthology.orchestra.run.smithi156.stdout:[osd] 2023-11-05T08:05:27.790 INFO:teuthology.orchestra.run.smithi156.stdout: osd journal size = 100 2023-11-05T08:05:27.790 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T08:05:27.790 INFO:teuthology.orchestra.run.smithi156.stdout: osd scrub load threshold = 5.0 2023-11-05T08:05:27.790 INFO:teuthology.orchestra.run.smithi156.stdout: osd scrub max interval = 600 2023-11-05T08:05:27.790 INFO:teuthology.orchestra.run.smithi156.stdout: osd mclock profile = high_recovery_ops 2023-11-05T08:05:27.791 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T08:05:27.791 INFO:teuthology.orchestra.run.smithi156.stdout: osd recover clone overlap = true 2023-11-05T08:05:27.791 INFO:teuthology.orchestra.run.smithi156.stdout: osd recovery max chunk = 1048576 2023-11-05T08:05:27.791 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T08:05:27.791 INFO:teuthology.orchestra.run.smithi156.stdout: osd debug shutdown = true 2023-11-05T08:05:27.792 INFO:teuthology.orchestra.run.smithi156.stdout: osd debug op order = true 2023-11-05T08:05:27.792 INFO:teuthology.orchestra.run.smithi156.stdout: osd debug verify stray on activate = true 2023-11-05T08:05:27.792 INFO:teuthology.orchestra.run.smithi156.stdout: osd debug trim objects = true 2023-11-05T08:05:27.792 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T08:05:27.792 INFO:teuthology.orchestra.run.smithi156.stdout: osd open classes on start = true 2023-11-05T08:05:27.793 INFO:teuthology.orchestra.run.smithi156.stdout: osd debug pg log writeout = true 2023-11-05T08:05:27.793 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T08:05:27.793 INFO:teuthology.orchestra.run.smithi156.stdout: osd deep scrub update digest min age = 30 2023-11-05T08:05:27.793 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T08:05:27.794 INFO:teuthology.orchestra.run.smithi156.stdout: osd map max advance = 10 2023-11-05T08:05:27.794 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T08:05:27.795 INFO:teuthology.orchestra.run.smithi156.stdout: journal zero on create = true 2023-11-05T08:05:27.795 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T08:05:27.795 INFO:teuthology.orchestra.run.smithi156.stdout: filestore ondisk finisher threads = 3 2023-11-05T08:05:27.795 INFO:teuthology.orchestra.run.smithi156.stdout: filestore apply finisher threads = 3 2023-11-05T08:05:27.795 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T08:05:27.796 INFO:teuthology.orchestra.run.smithi156.stdout: bdev debug aio = true 2023-11-05T08:05:27.796 INFO:teuthology.orchestra.run.smithi156.stdout: osd debug misdirected ops = true 2023-11-05T08:05:27.796 INFO:teuthology.orchestra.run.smithi156.stdout: bdev async discard = True 2023-11-05T08:05:27.796 INFO:teuthology.orchestra.run.smithi156.stdout: bdev enable discard = True 2023-11-05T08:05:27.796 INFO:teuthology.orchestra.run.smithi156.stdout: bluestore allocator = bitmap 2023-11-05T08:05:27.797 INFO:teuthology.orchestra.run.smithi156.stdout: bluestore block size = 96636764160 2023-11-05T08:05:27.797 INFO:teuthology.orchestra.run.smithi156.stdout: bluestore fsck on mount = True 2023-11-05T08:05:27.797 INFO:teuthology.orchestra.run.smithi156.stdout: bluestore zero block detection = True 2023-11-05T08:05:27.797 INFO:teuthology.orchestra.run.smithi156.stdout: debug bluefs = 1 2023-11-05T08:05:27.797 INFO:teuthology.orchestra.run.smithi156.stdout: debug bluestore = 1 2023-11-05T08:05:27.797 INFO:teuthology.orchestra.run.smithi156.stdout: debug monc = 20 2023-11-05T08:05:27.798 INFO:teuthology.orchestra.run.smithi156.stdout: debug ms = 1 2023-11-05T08:05:27.798 INFO:teuthology.orchestra.run.smithi156.stdout: debug osd = 20 2023-11-05T08:05:27.798 INFO:teuthology.orchestra.run.smithi156.stdout: debug rocksdb = 10 2023-11-05T08:05:27.798 INFO:teuthology.orchestra.run.smithi156.stdout: mon osd backfillfull_ratio = 0.85 2023-11-05T08:05:27.798 INFO:teuthology.orchestra.run.smithi156.stdout: mon osd full ratio = 0.9 2023-11-05T08:05:27.799 INFO:teuthology.orchestra.run.smithi156.stdout: mon osd nearfull ratio = 0.8 2023-11-05T08:05:27.799 INFO:teuthology.orchestra.run.smithi156.stdout: osd class default list = * 2023-11-05T08:05:27.799 INFO:teuthology.orchestra.run.smithi156.stdout: osd class load list = * 2023-11-05T08:05:27.799 INFO:teuthology.orchestra.run.smithi156.stdout: osd client watch timeout = 120 2023-11-05T08:05:27.799 INFO:teuthology.orchestra.run.smithi156.stdout: osd debug verify cached snaps = True 2023-11-05T08:05:27.800 INFO:teuthology.orchestra.run.smithi156.stdout: osd debug verify missing on start = True 2023-11-05T08:05:27.800 INFO:teuthology.orchestra.run.smithi156.stdout: osd failsafe full ratio = 0.95 2023-11-05T08:05:27.800 INFO:teuthology.orchestra.run.smithi156.stdout: osd fast shutdown = False 2023-11-05T08:05:27.800 INFO:teuthology.orchestra.run.smithi156.stdout: osd mclock override recovery settings = True 2023-11-05T08:05:27.800 INFO:teuthology.orchestra.run.smithi156.stdout: osd objectstore = bluestore 2023-11-05T08:05:27.801 INFO:teuthology.orchestra.run.smithi156.stdout: osd op queue = debug_random 2023-11-05T08:05:27.801 INFO:teuthology.orchestra.run.smithi156.stdout: osd op queue cut off = debug_random 2023-11-05T08:05:27.801 INFO:teuthology.orchestra.run.smithi156.stdout: osd shutdown pgref assert = True 2023-11-05T08:05:27.801 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T08:05:27.801 INFO:teuthology.orchestra.run.smithi156.stdout:[mgr] 2023-11-05T08:05:27.801 INFO:teuthology.orchestra.run.smithi156.stdout: debug ms = 1 2023-11-05T08:05:27.802 INFO:teuthology.orchestra.run.smithi156.stdout: debug mgr = 20 2023-11-05T08:05:27.802 INFO:teuthology.orchestra.run.smithi156.stdout: debug mon = 20 2023-11-05T08:05:27.802 INFO:teuthology.orchestra.run.smithi156.stdout: debug auth = 20 2023-11-05T08:05:27.802 INFO:teuthology.orchestra.run.smithi156.stdout: mon reweight min pgs per osd = 4 2023-11-05T08:05:27.803 INFO:teuthology.orchestra.run.smithi156.stdout: mon reweight min bytes per osd = 10 2023-11-05T08:05:27.803 INFO:teuthology.orchestra.run.smithi156.stdout: mgr/telemetry/nag = false 2023-11-05T08:05:27.803 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T08:05:27.803 INFO:teuthology.orchestra.run.smithi156.stdout:[mon] 2023-11-05T08:05:27.803 INFO:teuthology.orchestra.run.smithi156.stdout: debug ms = 1 2023-11-05T08:05:27.804 INFO:teuthology.orchestra.run.smithi156.stdout: debug mon = 20 2023-11-05T08:05:27.804 INFO:teuthology.orchestra.run.smithi156.stdout: debug paxos = 20 2023-11-05T08:05:27.804 INFO:teuthology.orchestra.run.smithi156.stdout: debug auth = 20 2023-11-05T08:05:27.804 INFO:teuthology.orchestra.run.smithi156.stdout: mon data avail warn = 5 2023-11-05T08:05:27.804 INFO:teuthology.orchestra.run.smithi156.stdout: mon mgr mkfs grace = 240 2023-11-05T08:05:27.805 INFO:teuthology.orchestra.run.smithi156.stdout: mon reweight min pgs per osd = 4 2023-11-05T08:05:27.805 INFO:teuthology.orchestra.run.smithi156.stdout: mon osd reporter subtree level = osd 2023-11-05T08:05:27.805 INFO:teuthology.orchestra.run.smithi156.stdout: mon osd prime pg temp = true 2023-11-05T08:05:27.805 INFO:teuthology.orchestra.run.smithi156.stdout: mon reweight min bytes per osd = 10 2023-11-05T08:05:27.805 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T08:05:27.806 INFO:teuthology.orchestra.run.smithi156.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-05T08:05:27.806 INFO:teuthology.orchestra.run.smithi156.stdout: auth mon ticket ttl = 660 # 11m 2023-11-05T08:05:27.806 INFO:teuthology.orchestra.run.smithi156.stdout: auth service ticket ttl = 240 # 4m 2023-11-05T08:05:27.806 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T08:05:27.806 INFO:teuthology.orchestra.run.smithi156.stdout: # don't complain about insecure global_id in the test suite 2023-11-05T08:05:27.807 INFO:teuthology.orchestra.run.smithi156.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-05T08:05:27.807 INFO:teuthology.orchestra.run.smithi156.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-05T08:05:27.807 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T08:05:27.807 INFO:teuthology.orchestra.run.smithi156.stdout: # 1m isn't quite enough 2023-11-05T08:05:27.807 INFO:teuthology.orchestra.run.smithi156.stdout: mon_down_mkfs_grace = 2m 2023-11-05T08:05:27.808 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T08:05:27.808 INFO:teuthology.orchestra.run.smithi156.stdout: mon_warn_on_filestore_osds = false 2023-11-05T08:05:27.808 INFO:teuthology.orchestra.run.smithi156.stdout: mon min osdmap epochs = 50 2023-11-05T08:05:27.808 INFO:teuthology.orchestra.run.smithi156.stdout: mon osd crush smoke test = False 2023-11-05T08:05:27.808 INFO:teuthology.orchestra.run.smithi156.stdout: mon osdmap full prune interval = 2 2023-11-05T08:05:27.808 INFO:teuthology.orchestra.run.smithi156.stdout: mon osdmap full prune min = 15 2023-11-05T08:05:27.809 INFO:teuthology.orchestra.run.smithi156.stdout: mon osdmap full prune txsize = 2 2023-11-05T08:05:27.809 INFO:teuthology.orchestra.run.smithi156.stdout: mon scrub interval = 300 2023-11-05T08:05:27.809 INFO:teuthology.orchestra.run.smithi156.stdout: mon warn on pool no app = False 2023-11-05T08:05:27.809 INFO:teuthology.orchestra.run.smithi156.stdout: paxos service trim min = 10 2023-11-05T08:05:27.809 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-05T08:05:27.810 INFO:teuthology.orchestra.run.smithi156.stdout:[client] 2023-11-05T08:05:27.810 INFO:teuthology.orchestra.run.smithi156.stdout: rgw cache enabled = true 2023-11-05T08:05:27.810 INFO:teuthology.orchestra.run.smithi156.stdout: rgw enable ops log = true 2023-11-05T08:05:27.810 INFO:teuthology.orchestra.run.smithi156.stdout: rgw enable usage log = true 2023-11-05T08:05:27.810 INFO:teuthology.orchestra.run.smithi156.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-05T08:05:27.811 INFO:teuthology.orchestra.run.smithi156.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-05T08:05:27.811 INFO:teuthology.orchestra.run.smithi156.stdout: debug monc = 20 2023-11-05T08:05:27.811 INFO:teuthology.orchestra.run.smithi156.stdout: debug ms = 1 2023-11-05T08:05:27.811 INFO:teuthology.orchestra.run.smithi156.stdout: debug objecter = 20 2023-11-05T08:05:27.811 INFO:teuthology.orchestra.run.smithi156.stdout: debug rados = 20 2023-11-05T08:05:27.811 INFO:teuthology.orchestra.run.smithi156.stdout:[mon.a] 2023-11-05T08:05:27.812 INFO:teuthology.orchestra.run.smithi156.stdout:[mon.c] 2023-11-05T08:05:27.812 INFO:teuthology.orchestra.run.smithi156.stdout:[mon.b] 2023-11-05T08:05:27.813 INFO:teuthology.orchestra.run.smithi052.stdout:[global] 2023-11-05T08:05:27.814 INFO:teuthology.orchestra.run.smithi052.stdout: chdir = "" 2023-11-05T08:05:27.814 INFO:teuthology.orchestra.run.smithi052.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-05T08:05:27.814 INFO:teuthology.orchestra.run.smithi052.stdout: auth supported = cephx 2023-11-05T08:05:27.814 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:05:27.814 INFO:teuthology.orchestra.run.smithi052.stdout: filestore xattr use omap = true 2023-11-05T08:05:27.815 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:05:27.815 INFO:teuthology.orchestra.run.smithi052.stdout: mon clock drift allowed = 1.000 2023-11-05T08:05:27.815 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:05:27.815 INFO:teuthology.orchestra.run.smithi052.stdout: osd crush chooseleaf type = 0 2023-11-05T08:05:27.815 INFO:teuthology.orchestra.run.smithi052.stdout: auth debug = true 2023-11-05T08:05:27.816 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:05:27.816 INFO:teuthology.orchestra.run.smithi052.stdout: ms die on old message = true 2023-11-05T08:05:27.816 INFO:teuthology.orchestra.run.smithi052.stdout: ms die on bug = true 2023-11-05T08:05:27.816 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:05:27.816 INFO:teuthology.orchestra.run.smithi052.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-05T08:05:27.817 INFO:teuthology.orchestra.run.smithi052.stdout: mon pg warn max object skew = 0 2023-11-05T08:05:27.817 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:05:27.817 INFO:teuthology.orchestra.run.smithi052.stdout: # disable pg_autoscaler by default for new pools 2023-11-05T08:05:27.817 INFO:teuthology.orchestra.run.smithi052.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-05T08:05:27.817 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:05:27.817 INFO:teuthology.orchestra.run.smithi052.stdout: osd pool default size = 2 2023-11-05T08:05:27.818 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:05:27.818 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd allow primary affinity = true 2023-11-05T08:05:27.818 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd allow pg remap = true 2023-11-05T08:05:27.818 INFO:teuthology.orchestra.run.smithi052.stdout: mon warn on legacy crush tunables = false 2023-11-05T08:05:27.818 INFO:teuthology.orchestra.run.smithi052.stdout: mon warn on crush straw calc version zero = false 2023-11-05T08:05:27.819 INFO:teuthology.orchestra.run.smithi052.stdout: mon warn on no sortbitwise = false 2023-11-05T08:05:27.819 INFO:teuthology.orchestra.run.smithi052.stdout: mon warn on osd down out interval zero = false 2023-11-05T08:05:27.819 INFO:teuthology.orchestra.run.smithi052.stdout: mon warn on too few osds = false 2023-11-05T08:05:27.819 INFO:teuthology.orchestra.run.smithi052.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-05T08:05:27.819 INFO:teuthology.orchestra.run.smithi052.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-05T08:05:27.820 INFO:teuthology.orchestra.run.smithi052.stdout: mon_allow_pool_size_one = true 2023-11-05T08:05:27.820 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:05:27.820 INFO:teuthology.orchestra.run.smithi052.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-05T08:05:27.820 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:05:27.820 INFO:teuthology.orchestra.run.smithi052.stdout: osd default data pool replay window = 5 2023-11-05T08:05:27.821 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:05:27.821 INFO:teuthology.orchestra.run.smithi052.stdout: mon allow pool delete = true 2023-11-05T08:05:27.821 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:05:27.821 INFO:teuthology.orchestra.run.smithi052.stdout: mon cluster log file level = debug 2023-11-05T08:05:27.821 INFO:teuthology.orchestra.run.smithi052.stdout: debug asserts on shutdown = true 2023-11-05T08:05:27.822 INFO:teuthology.orchestra.run.smithi052.stdout: mon health detail to clog = false 2023-11-05T08:05:27.822 INFO:teuthology.orchestra.run.smithi052.stdout: mon host = "172.21.15.52,[v2:172.21.15.52:3301,v1:172.21.15.52:6790],172.21.15.156" 2023-11-05T08:05:27.822 INFO:teuthology.orchestra.run.smithi052.stdout: mon client directed command retry = 5 2023-11-05T08:05:27.822 INFO:teuthology.orchestra.run.smithi052.stdout: mon election default strategy = 1 2023-11-05T08:05:27.822 INFO:teuthology.orchestra.run.smithi052.stdout: ms inject socket failures = 5000 2023-11-05T08:05:27.823 INFO:teuthology.orchestra.run.smithi052.stdout: ms type = async 2023-11-05T08:05:27.823 INFO:teuthology.orchestra.run.smithi052.stdout: osd heartbeat grace = 80 2023-11-05T08:05:27.823 INFO:teuthology.orchestra.run.smithi052.stdout: fsid = b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:05:27.823 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:05:27.823 INFO:teuthology.orchestra.run.smithi052.stdout:[osd] 2023-11-05T08:05:27.823 INFO:teuthology.orchestra.run.smithi052.stdout: osd journal size = 100 2023-11-05T08:05:27.824 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:05:27.824 INFO:teuthology.orchestra.run.smithi052.stdout: osd scrub load threshold = 5.0 2023-11-05T08:05:27.824 INFO:teuthology.orchestra.run.smithi052.stdout: osd scrub max interval = 600 2023-11-05T08:05:27.824 INFO:teuthology.orchestra.run.smithi052.stdout: osd mclock profile = high_recovery_ops 2023-11-05T08:05:27.824 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:05:27.825 INFO:teuthology.orchestra.run.smithi052.stdout: osd recover clone overlap = true 2023-11-05T08:05:27.825 INFO:teuthology.orchestra.run.smithi052.stdout: osd recovery max chunk = 1048576 2023-11-05T08:05:27.825 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:05:27.825 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug shutdown = true 2023-11-05T08:05:27.825 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug op order = true 2023-11-05T08:05:27.826 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug verify stray on activate = true 2023-11-05T08:05:27.826 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug trim objects = true 2023-11-05T08:05:27.826 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:05:27.826 INFO:teuthology.orchestra.run.smithi052.stdout: osd open classes on start = true 2023-11-05T08:05:27.827 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug pg log writeout = true 2023-11-05T08:05:27.827 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:05:27.827 INFO:teuthology.orchestra.run.smithi052.stdout: osd deep scrub update digest min age = 30 2023-11-05T08:05:27.827 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:05:27.827 INFO:teuthology.orchestra.run.smithi052.stdout: osd map max advance = 10 2023-11-05T08:05:27.828 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:05:27.828 INFO:teuthology.orchestra.run.smithi052.stdout: journal zero on create = true 2023-11-05T08:05:27.828 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:05:27.828 INFO:teuthology.orchestra.run.smithi052.stdout: filestore ondisk finisher threads = 3 2023-11-05T08:05:27.828 INFO:teuthology.orchestra.run.smithi052.stdout: filestore apply finisher threads = 3 2023-11-05T08:05:27.829 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:05:27.829 INFO:teuthology.orchestra.run.smithi052.stdout: bdev debug aio = true 2023-11-05T08:05:27.829 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug misdirected ops = true 2023-11-05T08:05:27.829 INFO:teuthology.orchestra.run.smithi052.stdout: bdev async discard = True 2023-11-05T08:05:27.829 INFO:teuthology.orchestra.run.smithi052.stdout: bdev enable discard = True 2023-11-05T08:05:27.829 INFO:teuthology.orchestra.run.smithi052.stdout: bluestore allocator = bitmap 2023-11-05T08:05:27.830 INFO:teuthology.orchestra.run.smithi052.stdout: bluestore block size = 96636764160 2023-11-05T08:05:27.830 INFO:teuthology.orchestra.run.smithi052.stdout: bluestore fsck on mount = True 2023-11-05T08:05:27.830 INFO:teuthology.orchestra.run.smithi052.stdout: bluestore zero block detection = True 2023-11-05T08:05:27.830 INFO:teuthology.orchestra.run.smithi052.stdout: debug bluefs = 1 2023-11-05T08:05:27.830 INFO:teuthology.orchestra.run.smithi052.stdout: debug bluestore = 1 2023-11-05T08:05:27.831 INFO:teuthology.orchestra.run.smithi052.stdout: debug monc = 20 2023-11-05T08:05:27.831 INFO:teuthology.orchestra.run.smithi052.stdout: debug ms = 1 2023-11-05T08:05:27.833 INFO:teuthology.orchestra.run.smithi052.stdout: debug osd = 20 2023-11-05T08:05:27.833 INFO:teuthology.orchestra.run.smithi052.stdout: debug rocksdb = 10 2023-11-05T08:05:27.833 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd backfillfull_ratio = 0.85 2023-11-05T08:05:27.834 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd full ratio = 0.9 2023-11-05T08:05:27.834 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd nearfull ratio = 0.8 2023-11-05T08:05:27.834 INFO:teuthology.orchestra.run.smithi052.stdout: osd class default list = * 2023-11-05T08:05:27.834 INFO:teuthology.orchestra.run.smithi052.stdout: osd class load list = * 2023-11-05T08:05:27.834 INFO:teuthology.orchestra.run.smithi052.stdout: osd client watch timeout = 120 2023-11-05T08:05:27.835 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug verify cached snaps = True 2023-11-05T08:05:27.835 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug verify missing on start = True 2023-11-05T08:05:27.835 INFO:teuthology.orchestra.run.smithi052.stdout: osd failsafe full ratio = 0.95 2023-11-05T08:05:27.835 INFO:teuthology.orchestra.run.smithi052.stdout: osd fast shutdown = False 2023-11-05T08:05:27.835 INFO:teuthology.orchestra.run.smithi052.stdout: osd mclock override recovery settings = True 2023-11-05T08:05:27.836 INFO:teuthology.orchestra.run.smithi052.stdout: osd objectstore = bluestore 2023-11-05T08:05:27.836 INFO:teuthology.orchestra.run.smithi052.stdout: osd op queue = debug_random 2023-11-05T08:05:27.836 INFO:teuthology.orchestra.run.smithi052.stdout: osd op queue cut off = debug_random 2023-11-05T08:05:27.836 INFO:teuthology.orchestra.run.smithi052.stdout: osd shutdown pgref assert = True 2023-11-05T08:05:27.836 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:05:27.837 INFO:teuthology.orchestra.run.smithi052.stdout:[mgr] 2023-11-05T08:05:27.837 INFO:teuthology.orchestra.run.smithi052.stdout: debug ms = 1 2023-11-05T08:05:27.838 INFO:teuthology.orchestra.run.smithi052.stdout: debug mgr = 20 2023-11-05T08:05:27.838 INFO:teuthology.orchestra.run.smithi052.stdout: debug mon = 20 2023-11-05T08:05:27.839 INFO:teuthology.orchestra.run.smithi052.stdout: debug auth = 20 2023-11-05T08:05:27.839 INFO:teuthology.orchestra.run.smithi052.stdout: mon reweight min pgs per osd = 4 2023-11-05T08:05:27.840 INFO:teuthology.orchestra.run.smithi052.stdout: mon reweight min bytes per osd = 10 2023-11-05T08:05:27.840 INFO:teuthology.orchestra.run.smithi052.stdout: mgr/telemetry/nag = false 2023-11-05T08:05:27.840 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:05:27.840 INFO:teuthology.orchestra.run.smithi052.stdout:[mon] 2023-11-05T08:05:27.841 INFO:teuthology.orchestra.run.smithi052.stdout: debug ms = 1 2023-11-05T08:05:27.841 INFO:teuthology.orchestra.run.smithi052.stdout: debug mon = 20 2023-11-05T08:05:27.841 INFO:teuthology.orchestra.run.smithi052.stdout: debug paxos = 20 2023-11-05T08:05:27.841 INFO:teuthology.orchestra.run.smithi052.stdout: debug auth = 20 2023-11-05T08:05:27.841 INFO:teuthology.orchestra.run.smithi052.stdout: mon data avail warn = 5 2023-11-05T08:05:27.842 INFO:teuthology.orchestra.run.smithi052.stdout: mon mgr mkfs grace = 240 2023-11-05T08:05:27.842 INFO:teuthology.orchestra.run.smithi052.stdout: mon reweight min pgs per osd = 4 2023-11-05T08:05:27.842 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd reporter subtree level = osd 2023-11-05T08:05:27.842 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd prime pg temp = true 2023-11-05T08:05:27.842 INFO:teuthology.orchestra.run.smithi052.stdout: mon reweight min bytes per osd = 10 2023-11-05T08:05:27.843 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:05:27.843 INFO:teuthology.orchestra.run.smithi052.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-05T08:05:27.843 INFO:teuthology.orchestra.run.smithi052.stdout: auth mon ticket ttl = 660 # 11m 2023-11-05T08:05:27.843 INFO:teuthology.orchestra.run.smithi052.stdout: auth service ticket ttl = 240 # 4m 2023-11-05T08:05:27.843 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:05:27.844 INFO:teuthology.orchestra.run.smithi052.stdout: # don't complain about insecure global_id in the test suite 2023-11-05T08:05:27.844 INFO:teuthology.orchestra.run.smithi052.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-05T08:05:27.844 INFO:teuthology.orchestra.run.smithi052.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-05T08:05:27.844 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:05:27.844 INFO:teuthology.orchestra.run.smithi052.stdout: # 1m isn't quite enough 2023-11-05T08:05:27.845 INFO:teuthology.orchestra.run.smithi052.stdout: mon_down_mkfs_grace = 2m 2023-11-05T08:05:27.845 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:05:27.845 INFO:teuthology.orchestra.run.smithi052.stdout: mon_warn_on_filestore_osds = false 2023-11-05T08:05:27.845 INFO:teuthology.orchestra.run.smithi052.stdout: mon min osdmap epochs = 50 2023-11-05T08:05:27.845 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd crush smoke test = False 2023-11-05T08:05:27.846 INFO:teuthology.orchestra.run.smithi052.stdout: mon osdmap full prune interval = 2 2023-11-05T08:05:27.846 INFO:teuthology.orchestra.run.smithi052.stdout: mon osdmap full prune min = 15 2023-11-05T08:05:27.846 INFO:teuthology.orchestra.run.smithi052.stdout: mon osdmap full prune txsize = 2 2023-11-05T08:05:27.846 INFO:teuthology.orchestra.run.smithi052.stdout: mon scrub interval = 300 2023-11-05T08:05:27.846 INFO:teuthology.orchestra.run.smithi052.stdout: mon warn on pool no app = False 2023-11-05T08:05:27.846 INFO:teuthology.orchestra.run.smithi052.stdout: paxos service trim min = 10 2023-11-05T08:05:27.847 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:05:27.847 INFO:teuthology.orchestra.run.smithi052.stdout:[client] 2023-11-05T08:05:27.847 INFO:teuthology.orchestra.run.smithi052.stdout: rgw cache enabled = true 2023-11-05T08:05:27.847 INFO:teuthology.orchestra.run.smithi052.stdout: rgw enable ops log = true 2023-11-05T08:05:27.847 INFO:teuthology.orchestra.run.smithi052.stdout: rgw enable usage log = true 2023-11-05T08:05:27.848 INFO:teuthology.orchestra.run.smithi052.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-05T08:05:27.848 INFO:teuthology.orchestra.run.smithi052.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-05T08:05:27.848 INFO:teuthology.orchestra.run.smithi052.stdout: debug monc = 20 2023-11-05T08:05:27.848 INFO:teuthology.orchestra.run.smithi052.stdout: debug ms = 1 2023-11-05T08:05:27.848 INFO:teuthology.orchestra.run.smithi052.stdout: debug objecter = 20 2023-11-05T08:05:27.849 INFO:teuthology.orchestra.run.smithi052.stdout: debug rados = 20 2023-11-05T08:05:27.849 INFO:teuthology.orchestra.run.smithi052.stdout:[mon.a] 2023-11-05T08:05:27.849 INFO:teuthology.orchestra.run.smithi052.stdout:[mon.c] 2023-11-05T08:05:27.849 INFO:teuthology.orchestra.run.smithi052.stdout:[mon.b] 2023-11-05T08:05:27.849 INFO:tasks.ceph:Creating admin key on mon.a... 2023-11-05T08:05:27.850 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-11-05T08:05:27.914 INFO:tasks.ceph:Copying monmap to all nodes... 2023-11-05T08:05:27.914 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-11-05T08:05:27.915 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-11-05T08:05:27.929 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-11-05T08:05:27.930 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-11-05T08:05:27.984 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi052.front.sepia.ceph.com 2023-11-05T08:05:27.984 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-11-05T08:05:27.985 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-05T08:05:27.985 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-05T08:05:28.070 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-11-05T08:05:28.071 DEBUG:teuthology.orchestra.run.smithi052:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-05T08:05:28.126 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi156.front.sepia.ceph.com 2023-11-05T08:05:28.126 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-11-05T08:05:28.127 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-05T08:05:28.127 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-05T08:05:28.168 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-11-05T08:05:28.168 DEBUG:teuthology.orchestra.run.smithi156:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-05T08:05:28.223 INFO:tasks.ceph:Setting up mon nodes... 2023-11-05T08:05:28.223 INFO:tasks.ceph:Setting up mgr nodes... 2023-11-05T08:05:28.224 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-11-05T08:05:28.285 INFO:teuthology.orchestra.run.smithi052.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-11-05T08:05:28.288 DEBUG:teuthology.orchestra.run.smithi156:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-11-05T08:05:28.357 INFO:teuthology.orchestra.run.smithi156.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-11-05T08:05:28.360 INFO:tasks.ceph:Setting up mds nodes... 2023-11-05T08:05:28.360 INFO:tasks.ceph_client:Setting up client nodes... 2023-11-05T08:05:28.361 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-11-05T08:05:28.408 INFO:teuthology.orchestra.run.smithi052.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-11-05T08:05:28.426 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-11-05T08:05:28.468 INFO:teuthology.orchestra.run.smithi156.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-11-05T08:05:28.483 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-11-05T08:05:28.484 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi052.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi156.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-05T08:05:28.484 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-11-05T08:05:28.514 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-05T08:05:28.515 INFO:tasks.ceph:role: osd.0 2023-11-05T08:05:28.515 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi052.front.sepia.ceph.com 2023-11-05T08:05:28.515 DEBUG:teuthology.orchestra.run.smithi052:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-05T08:05:28.585 INFO:teuthology.orchestra.run.smithi052.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-05T08:05:28.585 INFO:teuthology.orchestra.run.smithi052.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-05T08:05:28.586 INFO:teuthology.orchestra.run.smithi052.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-05T08:05:28.586 INFO:teuthology.orchestra.run.smithi052.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-05T08:05:28.586 INFO:teuthology.orchestra.run.smithi052.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-05T08:05:28.586 INFO:teuthology.orchestra.run.smithi052.stdout: = sunit=0 swidth=0 blks 2023-11-05T08:05:28.586 INFO:teuthology.orchestra.run.smithi052.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-05T08:05:28.587 INFO:teuthology.orchestra.run.smithi052.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-05T08:05:28.587 INFO:teuthology.orchestra.run.smithi052.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-05T08:05:28.587 INFO:teuthology.orchestra.run.smithi052.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-05T08:05:28.618 INFO:teuthology.orchestra.run.smithi052.stdout:Discarding blocks...Done. 2023-11-05T08:05:28.620 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi052.front.sepia.ceph.com -o noatime 2023-11-05T08:05:28.620 DEBUG:teuthology.orchestra.run.smithi052:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-11-05T08:05:28.695 DEBUG:teuthology.orchestra.run.smithi052:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-11-05T08:05:28.770 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-11-05T08:05:28.842 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-05T08:05:28.843 INFO:tasks.ceph:role: osd.1 2023-11-05T08:05:28.843 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi052.front.sepia.ceph.com 2023-11-05T08:05:28.843 DEBUG:teuthology.orchestra.run.smithi052:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-05T08:05:28.916 INFO:teuthology.orchestra.run.smithi052.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-05T08:05:28.916 INFO:teuthology.orchestra.run.smithi052.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-05T08:05:28.916 INFO:teuthology.orchestra.run.smithi052.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-05T08:05:28.917 INFO:teuthology.orchestra.run.smithi052.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-05T08:05:28.917 INFO:teuthology.orchestra.run.smithi052.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-05T08:05:28.917 INFO:teuthology.orchestra.run.smithi052.stdout: = sunit=0 swidth=0 blks 2023-11-05T08:05:28.917 INFO:teuthology.orchestra.run.smithi052.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-05T08:05:28.918 INFO:teuthology.orchestra.run.smithi052.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-05T08:05:28.918 INFO:teuthology.orchestra.run.smithi052.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-05T08:05:28.918 INFO:teuthology.orchestra.run.smithi052.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-05T08:05:28.948 INFO:teuthology.orchestra.run.smithi052.stdout:Discarding blocks...Done. 2023-11-05T08:05:28.950 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi052.front.sepia.ceph.com -o noatime 2023-11-05T08:05:28.951 DEBUG:teuthology.orchestra.run.smithi052:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-11-05T08:05:29.028 DEBUG:teuthology.orchestra.run.smithi052:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-11-05T08:05:29.102 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-11-05T08:05:29.172 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-05T08:05:29.173 INFO:tasks.ceph:role: osd.2 2023-11-05T08:05:29.173 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi052.front.sepia.ceph.com 2023-11-05T08:05:29.173 DEBUG:teuthology.orchestra.run.smithi052:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-05T08:05:29.242 INFO:teuthology.orchestra.run.smithi052.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-05T08:05:29.242 INFO:teuthology.orchestra.run.smithi052.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-05T08:05:29.242 INFO:teuthology.orchestra.run.smithi052.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-05T08:05:29.243 INFO:teuthology.orchestra.run.smithi052.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-05T08:05:29.243 INFO:teuthology.orchestra.run.smithi052.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-05T08:05:29.243 INFO:teuthology.orchestra.run.smithi052.stdout: = sunit=0 swidth=0 blks 2023-11-05T08:05:29.243 INFO:teuthology.orchestra.run.smithi052.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-05T08:05:29.243 INFO:teuthology.orchestra.run.smithi052.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-05T08:05:29.244 INFO:teuthology.orchestra.run.smithi052.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-05T08:05:29.244 INFO:teuthology.orchestra.run.smithi052.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-05T08:05:29.274 INFO:teuthology.orchestra.run.smithi052.stdout:Discarding blocks...Done. 2023-11-05T08:05:29.276 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi052.front.sepia.ceph.com -o noatime 2023-11-05T08:05:29.276 DEBUG:teuthology.orchestra.run.smithi052:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-11-05T08:05:29.352 DEBUG:teuthology.orchestra.run.smithi052:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-11-05T08:05:29.425 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-11-05T08:05:29.497 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-05T08:05:29.497 INFO:tasks.ceph:role: osd.3 2023-11-05T08:05:29.498 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi052.front.sepia.ceph.com 2023-11-05T08:05:29.498 DEBUG:teuthology.orchestra.run.smithi052:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-05T08:05:29.567 INFO:teuthology.orchestra.run.smithi052.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-05T08:05:29.568 INFO:teuthology.orchestra.run.smithi052.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-05T08:05:29.568 INFO:teuthology.orchestra.run.smithi052.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-05T08:05:29.568 INFO:teuthology.orchestra.run.smithi052.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-05T08:05:29.568 INFO:teuthology.orchestra.run.smithi052.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-05T08:05:29.568 INFO:teuthology.orchestra.run.smithi052.stdout: = sunit=0 swidth=0 blks 2023-11-05T08:05:29.569 INFO:teuthology.orchestra.run.smithi052.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-05T08:05:29.569 INFO:teuthology.orchestra.run.smithi052.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-05T08:05:29.569 INFO:teuthology.orchestra.run.smithi052.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-05T08:05:29.570 INFO:teuthology.orchestra.run.smithi052.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-05T08:05:29.599 INFO:teuthology.orchestra.run.smithi052.stdout:Discarding blocks...Done. 2023-11-05T08:05:29.601 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi052.front.sepia.ceph.com -o noatime 2023-11-05T08:05:29.602 DEBUG:teuthology.orchestra.run.smithi052:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-11-05T08:05:29.676 DEBUG:teuthology.orchestra.run.smithi052:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-11-05T08:05:29.751 DEBUG:teuthology.orchestra.run.smithi052:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-05T08:05:29.851 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:05:29.850+0000 7ff0fee07500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-11-05T08:05:29.851 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:05:29.850+0000 7ff0fee07500 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-11-05T08:05:29.852 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:05:29.850+0000 7ff0fee07500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-05T08:05:29.852 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:05:29.850+0000 7ff0fee07500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-05T08:05:29.852 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:05:29.850+0000 7ff0fee07500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-05T08:05:29.852 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:05:29.851+0000 7ff0fee07500 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-11-05T08:05:32.686 DEBUG:teuthology.orchestra.run.smithi052:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-11-05T08:05:32.722 DEBUG:teuthology.orchestra.run.smithi052:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-05T08:05:32.818 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:05:32.816+0000 7f75b2216500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-11-05T08:05:32.818 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:05:32.817+0000 7f75b2216500 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-11-05T08:05:32.818 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:05:32.817+0000 7f75b2216500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-05T08:05:32.819 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:05:32.817+0000 7f75b2216500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-05T08:05:32.819 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:05:32.817+0000 7f75b2216500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-05T08:05:32.819 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:05:32.817+0000 7f75b2216500 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-11-05T08:05:35.661 DEBUG:teuthology.orchestra.run.smithi052:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-11-05T08:05:35.697 DEBUG:teuthology.orchestra.run.smithi052:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-05T08:05:35.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:05:35.791+0000 7f5b34310500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-11-05T08:05:35.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:05:35.791+0000 7f5b34310500 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-11-05T08:05:35.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:05:35.791+0000 7f5b34310500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-05T08:05:35.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:05:35.791+0000 7f5b34310500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-05T08:05:35.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:05:35.791+0000 7f5b34310500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-05T08:05:35.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:05:35.792+0000 7f5b34310500 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-11-05T08:05:38.639 DEBUG:teuthology.orchestra.run.smithi052:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-11-05T08:05:38.675 DEBUG:teuthology.orchestra.run.smithi052:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-05T08:05:38.771 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:05:38.771+0000 7f69147be500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-11-05T08:05:38.772 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:05:38.771+0000 7f69147be500 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-11-05T08:05:38.772 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:05:38.771+0000 7f69147be500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-05T08:05:38.772 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:05:38.771+0000 7f69147be500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-05T08:05:38.772 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:05:38.771+0000 7f69147be500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-05T08:05:38.772 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:05:38.771+0000 7f69147be500 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-11-05T08:05:41.607 DEBUG:teuthology.orchestra.run.smithi052:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-11-05T08:05:41.643 DEBUG:teuthology.orchestra.run.smithi156:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-11-05T08:05:41.675 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-05T08:05:41.676 INFO:tasks.ceph:role: osd.4 2023-11-05T08:05:41.676 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi156.front.sepia.ceph.com 2023-11-05T08:05:41.676 DEBUG:teuthology.orchestra.run.smithi156:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-05T08:05:41.746 INFO:teuthology.orchestra.run.smithi156.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-05T08:05:41.746 INFO:teuthology.orchestra.run.smithi156.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-05T08:05:41.747 INFO:teuthology.orchestra.run.smithi156.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-05T08:05:41.747 INFO:teuthology.orchestra.run.smithi156.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-05T08:05:41.747 INFO:teuthology.orchestra.run.smithi156.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-05T08:05:41.747 INFO:teuthology.orchestra.run.smithi156.stdout: = sunit=0 swidth=0 blks 2023-11-05T08:05:41.748 INFO:teuthology.orchestra.run.smithi156.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-05T08:05:41.748 INFO:teuthology.orchestra.run.smithi156.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-05T08:05:41.748 INFO:teuthology.orchestra.run.smithi156.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-05T08:05:41.748 INFO:teuthology.orchestra.run.smithi156.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-05T08:05:41.781 INFO:teuthology.orchestra.run.smithi156.stdout:Discarding blocks...Done. 2023-11-05T08:05:41.783 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi156.front.sepia.ceph.com -o noatime 2023-11-05T08:05:41.783 DEBUG:teuthology.orchestra.run.smithi156:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-11-05T08:05:41.855 DEBUG:teuthology.orchestra.run.smithi156:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-11-05T08:05:41.929 DEBUG:teuthology.orchestra.run.smithi156:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-11-05T08:05:41.997 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-05T08:05:41.998 INFO:tasks.ceph:role: osd.5 2023-11-05T08:05:41.998 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi156.front.sepia.ceph.com 2023-11-05T08:05:41.998 DEBUG:teuthology.orchestra.run.smithi156:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-05T08:05:42.064 INFO:teuthology.orchestra.run.smithi156.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-05T08:05:42.064 INFO:teuthology.orchestra.run.smithi156.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-05T08:05:42.064 INFO:teuthology.orchestra.run.smithi156.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-05T08:05:42.065 INFO:teuthology.orchestra.run.smithi156.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-05T08:05:42.065 INFO:teuthology.orchestra.run.smithi156.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-05T08:05:42.065 INFO:teuthology.orchestra.run.smithi156.stdout: = sunit=0 swidth=0 blks 2023-11-05T08:05:42.065 INFO:teuthology.orchestra.run.smithi156.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-05T08:05:42.065 INFO:teuthology.orchestra.run.smithi156.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-05T08:05:42.066 INFO:teuthology.orchestra.run.smithi156.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-05T08:05:42.066 INFO:teuthology.orchestra.run.smithi156.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-05T08:05:42.096 INFO:teuthology.orchestra.run.smithi156.stdout:Discarding blocks...Done. 2023-11-05T08:05:42.098 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi156.front.sepia.ceph.com -o noatime 2023-11-05T08:05:42.099 DEBUG:teuthology.orchestra.run.smithi156:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-11-05T08:05:42.171 DEBUG:teuthology.orchestra.run.smithi156:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-11-05T08:05:42.243 DEBUG:teuthology.orchestra.run.smithi156:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-11-05T08:05:42.312 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-05T08:05:42.312 INFO:tasks.ceph:role: osd.6 2023-11-05T08:05:42.312 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi156.front.sepia.ceph.com 2023-11-05T08:05:42.313 DEBUG:teuthology.orchestra.run.smithi156:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-05T08:05:42.379 INFO:teuthology.orchestra.run.smithi156.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-05T08:05:42.379 INFO:teuthology.orchestra.run.smithi156.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-05T08:05:42.380 INFO:teuthology.orchestra.run.smithi156.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-05T08:05:42.380 INFO:teuthology.orchestra.run.smithi156.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-05T08:05:42.380 INFO:teuthology.orchestra.run.smithi156.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-05T08:05:42.380 INFO:teuthology.orchestra.run.smithi156.stdout: = sunit=0 swidth=0 blks 2023-11-05T08:05:42.381 INFO:teuthology.orchestra.run.smithi156.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-05T08:05:42.381 INFO:teuthology.orchestra.run.smithi156.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-05T08:05:42.381 INFO:teuthology.orchestra.run.smithi156.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-05T08:05:42.381 INFO:teuthology.orchestra.run.smithi156.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-05T08:05:42.413 INFO:teuthology.orchestra.run.smithi156.stdout:Discarding blocks...Done. 2023-11-05T08:05:42.415 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi156.front.sepia.ceph.com -o noatime 2023-11-05T08:05:42.415 DEBUG:teuthology.orchestra.run.smithi156:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-11-05T08:05:42.486 DEBUG:teuthology.orchestra.run.smithi156:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-11-05T08:05:42.557 DEBUG:teuthology.orchestra.run.smithi156:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-11-05T08:05:42.624 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-05T08:05:42.624 INFO:tasks.ceph:role: osd.7 2023-11-05T08:05:42.625 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi156.front.sepia.ceph.com 2023-11-05T08:05:42.625 DEBUG:teuthology.orchestra.run.smithi156:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-05T08:05:42.689 INFO:teuthology.orchestra.run.smithi156.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-05T08:05:42.690 INFO:teuthology.orchestra.run.smithi156.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-05T08:05:42.690 INFO:teuthology.orchestra.run.smithi156.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-05T08:05:42.690 INFO:teuthology.orchestra.run.smithi156.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-05T08:05:42.690 INFO:teuthology.orchestra.run.smithi156.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-05T08:05:42.691 INFO:teuthology.orchestra.run.smithi156.stdout: = sunit=0 swidth=0 blks 2023-11-05T08:05:42.691 INFO:teuthology.orchestra.run.smithi156.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-05T08:05:42.691 INFO:teuthology.orchestra.run.smithi156.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-05T08:05:42.691 INFO:teuthology.orchestra.run.smithi156.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-05T08:05:42.691 INFO:teuthology.orchestra.run.smithi156.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-05T08:05:42.722 INFO:teuthology.orchestra.run.smithi156.stdout:Discarding blocks...Done. 2023-11-05T08:05:42.724 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi156.front.sepia.ceph.com -o noatime 2023-11-05T08:05:42.724 DEBUG:teuthology.orchestra.run.smithi156:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-11-05T08:05:42.795 DEBUG:teuthology.orchestra.run.smithi156:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-11-05T08:05:42.866 DEBUG:teuthology.orchestra.run.smithi156:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-05T08:05:42.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:05:42.961+0000 7f7288609500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-11-05T08:05:42.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:05:42.962+0000 7f7288609500 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-11-05T08:05:42.962 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:05:42.962+0000 7f7288609500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-05T08:05:42.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:05:42.962+0000 7f7288609500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-05T08:05:42.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:05:42.962+0000 7f7288609500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-05T08:05:42.963 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:05:42.962+0000 7f7288609500 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-11-05T08:05:45.799 DEBUG:teuthology.orchestra.run.smithi156:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-11-05T08:05:45.830 DEBUG:teuthology.orchestra.run.smithi156:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-05T08:05:45.921 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:05:45.920+0000 7f12dc610500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-11-05T08:05:45.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:05:45.920+0000 7f12dc610500 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-11-05T08:05:45.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:05:45.920+0000 7f12dc610500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-05T08:05:45.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:05:45.920+0000 7f12dc610500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-05T08:05:45.922 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:05:45.920+0000 7f12dc610500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-05T08:05:45.923 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:05:45.921+0000 7f12dc610500 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-11-05T08:05:48.762 DEBUG:teuthology.orchestra.run.smithi156:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-11-05T08:05:48.793 DEBUG:teuthology.orchestra.run.smithi156:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-05T08:05:48.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:05:48.881+0000 7f770bfa9500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-11-05T08:05:48.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:05:48.881+0000 7f770bfa9500 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-11-05T08:05:48.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:05:48.881+0000 7f770bfa9500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-05T08:05:48.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:05:48.881+0000 7f770bfa9500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-05T08:05:48.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:05:48.881+0000 7f770bfa9500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-05T08:05:48.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:05:48.881+0000 7f770bfa9500 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-11-05T08:05:51.720 DEBUG:teuthology.orchestra.run.smithi156:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-11-05T08:05:51.751 DEBUG:teuthology.orchestra.run.smithi156:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-05T08:05:51.844 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:05:51.842+0000 7f53c8f92500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-11-05T08:05:51.844 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:05:51.842+0000 7f53c8f92500 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-11-05T08:05:51.844 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:05:51.842+0000 7f53c8f92500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-05T08:05:51.844 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:05:51.842+0000 7f53c8f92500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-05T08:05:51.845 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:05:51.842+0000 7f53c8f92500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-05T08:05:51.845 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:05:51.843+0000 7f53c8f92500 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-11-05T08:05:54.680 DEBUG:teuthology.orchestra.run.smithi156:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-11-05T08:05:54.712 INFO:tasks.ceph:Reading keys from all nodes... 2023-11-05T08:05:54.712 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-11-05T08:05:54.712 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-11-05T08:05:54.749 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-11-05T08:05:54.749 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-11-05T08:05:54.824 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-11-05T08:05:54.825 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-11-05T08:05:54.898 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-11-05T08:05:54.899 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-11-05T08:05:54.972 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-11-05T08:05:54.972 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-11-05T08:05:55.045 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-11-05T08:05:55.046 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-11-05T08:05:55.079 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-11-05T08:05:55.079 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-11-05T08:05:55.149 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-11-05T08:05:55.150 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-11-05T08:05:55.218 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-11-05T08:05:55.219 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-11-05T08:05:55.287 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-11-05T08:05:55.287 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-11-05T08:05:55.354 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-11-05T08:05:55.355 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-11-05T08:05:55.372 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-11-05T08:05:55.372 DEBUG:teuthology.orchestra.run.smithi156:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-11-05T08:05:55.410 INFO:tasks.ceph:Adding keys to all mons... 2023-11-05T08:05:55.411 DEBUG:teuthology.orchestra.run.smithi052:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-05T08:05:55.414 DEBUG:teuthology.orchestra.run.smithi156:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-05T08:05:55.454 INFO:teuthology.orchestra.run.smithi052.stdout:[mgr.y] 2023-11-05T08:05:55.454 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQDITEdleiUOERAAVgtXwFKi2/Eeaf4LsY0a2g== 2023-11-05T08:05:55.455 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.0] 2023-11-05T08:05:55.455 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQDJTEdlVVy6MhAASaBxdp8X5T/wMTWuF3QEkA== 2023-11-05T08:05:55.455 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.1] 2023-11-05T08:05:55.455 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQDMTEdlpXG5MBAAf5HMju3KJiUvQY+qE9zukA== 2023-11-05T08:05:55.455 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.2] 2023-11-05T08:05:55.456 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQDPTEdlOfA3LxAA8wqqsjTkA1aI7hTwJK3udA== 2023-11-05T08:05:55.456 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.3] 2023-11-05T08:05:55.456 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQDSTEdl9qD9LRAALv50tIA2mvSL73wYnuShJQ== 2023-11-05T08:05:55.456 INFO:teuthology.orchestra.run.smithi052.stdout:[mgr.x] 2023-11-05T08:05:55.456 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQDITEdlEwBXFRAAfuQfrEt1eWoAIQqPsKdd1A== 2023-11-05T08:05:55.457 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.4] 2023-11-05T08:05:55.457 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQDWTEdll2ZWORAAZctsxi9TzgEXN3OTPpIutA== 2023-11-05T08:05:55.457 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.5] 2023-11-05T08:05:55.457 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQDZTEdlpa7vNhAAk/+ZGiId1SO1vIg9ubHNcQ== 2023-11-05T08:05:55.457 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.6] 2023-11-05T08:05:55.458 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQDcTEdlccCUNBAA1D3ZikPImkpN05nyZV6y+g== 2023-11-05T08:05:55.458 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.7] 2023-11-05T08:05:55.458 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQDfTEdlySVLMhAAqAbIjVPzdNg6eVhykYFpOA== 2023-11-05T08:05:55.458 INFO:teuthology.orchestra.run.smithi052.stdout:[client.0] 2023-11-05T08:05:55.458 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQDITEdlzSFVGBAAzMEdX+dVAkKLxGHRHYQjEw== 2023-11-05T08:05:55.458 INFO:teuthology.orchestra.run.smithi052.stdout:[client.1] 2023-11-05T08:05:55.459 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQDITEdlw8fxGxAAnDTpMO+AT954il18OWeo4w== 2023-11-05T08:05:55.477 INFO:teuthology.orchestra.run.smithi156.stdout:[mgr.y] 2023-11-05T08:05:55.477 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQDITEdleiUOERAAVgtXwFKi2/Eeaf4LsY0a2g== 2023-11-05T08:05:55.478 INFO:teuthology.orchestra.run.smithi156.stdout:[osd.0] 2023-11-05T08:05:55.478 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQDJTEdlVVy6MhAASaBxdp8X5T/wMTWuF3QEkA== 2023-11-05T08:05:55.478 INFO:teuthology.orchestra.run.smithi156.stdout:[osd.1] 2023-11-05T08:05:55.478 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQDMTEdlpXG5MBAAf5HMju3KJiUvQY+qE9zukA== 2023-11-05T08:05:55.478 INFO:teuthology.orchestra.run.smithi156.stdout:[osd.2] 2023-11-05T08:05:55.479 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQDPTEdlOfA3LxAA8wqqsjTkA1aI7hTwJK3udA== 2023-11-05T08:05:55.479 INFO:teuthology.orchestra.run.smithi156.stdout:[osd.3] 2023-11-05T08:05:55.479 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQDSTEdl9qD9LRAALv50tIA2mvSL73wYnuShJQ== 2023-11-05T08:05:55.479 INFO:teuthology.orchestra.run.smithi156.stdout:[mgr.x] 2023-11-05T08:05:55.479 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQDITEdlEwBXFRAAfuQfrEt1eWoAIQqPsKdd1A== 2023-11-05T08:05:55.480 INFO:teuthology.orchestra.run.smithi156.stdout:[osd.4] 2023-11-05T08:05:55.480 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQDWTEdll2ZWORAAZctsxi9TzgEXN3OTPpIutA== 2023-11-05T08:05:55.480 INFO:teuthology.orchestra.run.smithi156.stdout:[osd.5] 2023-11-05T08:05:55.480 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQDZTEdlpa7vNhAAk/+ZGiId1SO1vIg9ubHNcQ== 2023-11-05T08:05:55.480 INFO:teuthology.orchestra.run.smithi156.stdout:[osd.6] 2023-11-05T08:05:55.481 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQDcTEdlccCUNBAA1D3ZikPImkpN05nyZV6y+g== 2023-11-05T08:05:55.481 INFO:teuthology.orchestra.run.smithi156.stdout:[osd.7] 2023-11-05T08:05:55.481 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQDfTEdlySVLMhAAqAbIjVPzdNg6eVhykYFpOA== 2023-11-05T08:05:55.481 INFO:teuthology.orchestra.run.smithi156.stdout:[client.0] 2023-11-05T08:05:55.481 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQDITEdlzSFVGBAAzMEdX+dVAkKLxGHRHYQjEw== 2023-11-05T08:05:55.481 INFO:teuthology.orchestra.run.smithi156.stdout:[client.1] 2023-11-05T08:05:55.482 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQDITEdlw8fxGxAAnDTpMO+AT954il18OWeo4w== 2023-11-05T08:05:55.483 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-05T08:05:55.503 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-05T08:05:55.575 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-05T08:05:55.577 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-05T08:05:55.634 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-05T08:05:55.636 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-05T08:05:55.690 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-05T08:05:55.692 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-05T08:05:55.746 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-05T08:05:55.749 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-05T08:05:55.803 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-05T08:05:55.806 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-05T08:05:55.861 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-05T08:05:55.865 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-05T08:05:55.917 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-05T08:05:55.920 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-05T08:05:55.973 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-05T08:05:55.976 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-05T08:05:56.029 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-05T08:05:56.031 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-05T08:05:56.084 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-05T08:05:56.086 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-05T08:05:56.143 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-05T08:05:56.146 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-05T08:05:56.203 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-11-05T08:05:56.203 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-11-05T08:05:56.234 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-05T08:05:56.334 DEBUG:teuthology.orchestra.run.smithi052:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-11-05T08:05:56.365 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-11-05T08:05:56.436 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-05T08:05:56.536 DEBUG:teuthology.orchestra.run.smithi052:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-11-05T08:05:56.567 DEBUG:teuthology.orchestra.run.smithi156:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-11-05T08:05:56.594 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-05T08:05:56.691 DEBUG:teuthology.orchestra.run.smithi156:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-11-05T08:05:56.719 DEBUG:teuthology.orchestra.run.smithi052:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-05T08:05:56.722 DEBUG:teuthology.orchestra.run.smithi156:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-05T08:05:56.773 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-11-05T08:05:56.774 DEBUG:tasks.ceph_manager:running mon.a under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.a.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2023-11-05T08:05:56.774 INFO:tasks.ceph.mon.a:Restarting daemon 2023-11-05T08:05:56.775 DEBUG:teuthology.orchestra.run.smithi052:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a 2023-11-05T08:05:56.777 INFO:tasks.ceph.mon.a:Started 2023-11-05T08:05:56.777 DEBUG:tasks.ceph_manager:running mon.c under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.c.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2023-11-05T08:05:56.778 INFO:tasks.ceph.mon.c:Restarting daemon 2023-11-05T08:05:56.778 DEBUG:teuthology.orchestra.run.smithi052:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c 2023-11-05T08:05:56.780 INFO:tasks.ceph.mon.c:Started 2023-11-05T08:05:56.781 DEBUG:tasks.ceph_manager:running mon.b under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.b.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2023-11-05T08:05:56.781 INFO:tasks.ceph.mon.b:Restarting daemon 2023-11-05T08:05:56.782 DEBUG:teuthology.orchestra.run.smithi156:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b 2023-11-05T08:05:56.816 INFO:tasks.ceph.mon.b:Started 2023-11-05T08:05:56.816 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-11-05T08:05:56.817 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-11-05T08:05:56.817 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i y 2023-11-05T08:05:56.820 INFO:tasks.ceph.mgr.y:Started 2023-11-05T08:05:56.820 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-11-05T08:05:56.820 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i x 2023-11-05T08:05:56.823 INFO:tasks.ceph.mgr.x:Started 2023-11-05T08:05:56.823 INFO:tasks.ceph:Setting crush tunables to default 2023-11-05T08:05:56.824 DEBUG:teuthology.orchestra.run.smithi052:> sudo ceph --cluster ceph osd crush tunables default 2023-11-05T08:05:56.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:05:56.931+0000 7f8ccb70f640 10 monclient: get_monmap_and_config 2023-11-05T08:05:56.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:05:56.931+0000 7f8ccb70f640 10 monclient: build_initial_monmap 2023-11-05T08:05:56.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:05:56.931+0000 7f8ccb70f640 10 monclient: monmap: 2023-11-05T08:05:56.933 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:05:56.933 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:05:56.934 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:56.932785+0000 2023-11-05T08:05:56.934 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:56.932785+0000 2023-11-05T08:05:56.934 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:05:56.934 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:05:56.935 INFO:teuthology.orchestra.run.smithi052.stderr:0: v1:172.21.15.52:6789/0 mon.noname-a-legacy 2023-11-05T08:05:56.935 INFO:teuthology.orchestra.run.smithi052.stderr:1: v1:172.21.15.156:6789/0 mon.noname-c-legacy 2023-11-05T08:05:56.935 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-b 2023-11-05T08:05:56.935 INFO:teuthology.orchestra.run.smithi052.stderr:3: v2:172.21.15.52:3300/0 mon.noname-a 2023-11-05T08:05:56.935 INFO:teuthology.orchestra.run.smithi052.stderr:4: v2:172.21.15.156:3300/0 mon.noname-c 2023-11-05T08:05:56.936 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:05:56.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:05:56.931+0000 7f8ccb70f640 1 Processor -- start 2023-11-05T08:05:56.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:05:56.932+0000 7f8ccb70f640 1 -- start start 2023-11-05T08:05:56.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:05:56.932+0000 7f8ccb70f640 10 monclient: init 2023-11-05T08:05:56.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:05:56.932+0000 7f8ccb70f640 10 monclient: _reopen_session rank -1 2023-11-05T08:05:56.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:05:56.932+0000 7f8ccb70f640 10 monclient: _add_conns ranks=[2,0,4,3,1] 2023-11-05T08:05:56.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:05:56.932+0000 7f8ccb70f640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8cc40a8b30 0x7f8cc40a8f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:05:56.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:05:56.932+0000 7f8ccb70f640 10 monclient(hunting): picked mon.noname-b con 0x7f8cc40a8b30 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:05:56.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:05:56.932+0000 7f8ccb70f640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f8cc413ea60 addr v1:172.21.15.52:6789/0 2023-11-05T08:05:56.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:05:56.932+0000 7f8ccb70f640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f8cc4141c60 0x7f8cc4142090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:05:56.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:05:56.932+0000 7f8ccb70f640 10 monclient(hunting): picked mon.noname-c con 0x7f8cc4141c60 addr v2:172.21.15.156:3300/0 2023-11-05T08:05:56.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:05:56.932+0000 7f8ccb70f640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cc413f5b0 con 0x7f8cc413ea60 2023-11-05T08:05:56.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:05:56.932+0000 7f8ccb70f640 10 monclient(hunting): start opening mon connection 2023-11-05T08:05:56.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:05:56.932+0000 7f8ccb70f640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cc40b1670 con 0x7f8cc4141c60 2023-11-05T08:05:56.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:05:56.932+0000 7f8ccb70f640 10 monclient(hunting): start opening mon connection 2023-11-05T08:05:56.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:05:56.932+0000 7f8ccb70f640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc40aa420 con 0x7f8cc40a8b30 2023-11-05T08:05:56.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:05:56.932+0000 7f8ccb70f640 10 monclient(hunting): _renew_subs 2023-11-05T08:05:56.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:05:56.932+0000 7f8ccb70f640 10 monclient(hunting): authenticate will time out at 1303.138593s 2023-11-05T08:05:56.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:05:56.932+0000 7f8cc94ab640 1 -- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8cc40a8b30 msgr2=0x7f8cc40a8f10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3301/0 2023-11-05T08:05:56.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:05:56.932+0000 7f8cc8caa640 1 -- >> v1:172.21.15.52:6789/0 conn(0x7f8cc413ea60 legacy=0x7f8cc413eea0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.52:6789/0 2023-11-05T08:05:56.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:05:56.932+0000 7f8cc94ab640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8cc40a8b30 0x7f8cc40a8f10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-05T08:05:56.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:05:56.932+0000 7f8cc9cac640 1 -- >> v2:172.21.15.156:3300/0 conn(0x7f8cc4141c60 msgr2=0x7f8cc4142090 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.156:3300/0 2023-11-05T08:05:56.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:05:56.932+0000 7f8cc9cac640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f8cc4141c60 0x7f8cc4142090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-05T08:05:57.134 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:05:57.133+0000 7f8cc94ab640 1 -- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8cc40a8b30 msgr2=0x7f8cc40a8f10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3301/0 2023-11-05T08:05:57.135 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:05:57.133+0000 7f8cc8caa640 1 -- >> v1:172.21.15.52:6789/0 conn(0x7f8cc413ea60 legacy=0x7f8cc413eea0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.52:6789/0 2023-11-05T08:05:57.137 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:05:57.133+0000 7f8cc94ab640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8cc40a8b30 0x7f8cc40a8f10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-05T08:05:57.137 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:05:57.133+0000 7f8cc9cac640 1 -- >> v2:172.21.15.156:3300/0 conn(0x7f8cc4141c60 msgr2=0x7f8cc4142090 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.156:3300/0 2023-11-05T08:05:57.137 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:05:57.133+0000 7f8cc9cac640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f8cc4141c60 0x7f8cc4142090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-05T08:05:57.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:05:57.534+0000 7f8cc8caa640 1 -- >> v1:172.21.15.52:6789/0 conn(0x7f8cc413ea60 legacy=0x7f8cc413eea0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.52:6789/0 2023-11-05T08:05:57.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:05:57.534+0000 7f8cc94ab640 1 -- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8cc40a8b30 msgr2=0x7f8cc40a8f10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3301/0 2023-11-05T08:05:57.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:05:57.534+0000 7f8cc94ab640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8cc40a8b30 0x7f8cc40a8f10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-05T08:05:57.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:05:57.534+0000 7f8cc9cac640 1 -- >> v2:172.21.15.156:3300/0 conn(0x7f8cc4141c60 msgr2=0x7f8cc4142090 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.156:3300/0 2023-11-05T08:05:57.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:05:57.534+0000 7f8cc9cac640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f8cc4141c60 0x7f8cc4142090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-05T08:05:58.336 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:05:58.335+0000 7f8cc8caa640 1 -- >> v1:172.21.15.52:6789/0 conn(0x7f8cc413ea60 legacy=0x7f8cc413eea0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.52:6789/0 2023-11-05T08:05:58.337 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:05:58.335+0000 7f8cc94ab640 1 -- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8cc40a8b30 msgr2=0x7f8cc40a8f10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3301/0 2023-11-05T08:05:58.337 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:05:58.335+0000 7f8cc94ab640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8cc40a8b30 0x7f8cc40a8f10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-05T08:05:58.337 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:05:58.335+0000 7f8cc9cac640 1 -- >> v2:172.21.15.156:3300/0 conn(0x7f8cc4141c60 msgr2=0x7f8cc4142090 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.156:3300/0 2023-11-05T08:05:58.338 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:05:58.335+0000 7f8cc9cac640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f8cc4141c60 0x7f8cc4142090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-05T08:05:59.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:05:59.932+0000 7f8cbaffd640 10 monclient(hunting): tick 2023-11-05T08:05:59.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:05:59.932+0000 7f8cbaffd640 10 monclient(hunting): _check_auth_tickets 2023-11-05T08:05:59.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:05:59.932+0000 7f8cbaffd640 1 monclient(hunting): continuing hunt 2023-11-05T08:05:59.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:05:59.932+0000 7f8cbaffd640 10 monclient(hunting): _reopen_session rank -1 2023-11-05T08:05:59.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:05:59.932+0000 7f8cbaffd640 1 -- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8cc40a8b30 msgr2=0x7f8cc40a8f10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-05T08:05:59.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:05:59.932+0000 7f8cbaffd640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8cc40a8b30 0x7f8cc40a8f10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:05:59.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:05:59.932+0000 7f8cbaffd640 1 -- >> v2:172.21.15.156:3300/0 conn(0x7f8cc4141c60 msgr2=0x7f8cc4142090 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-05T08:05:59.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:05:59.932+0000 7f8cbaffd640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f8cc4141c60 0x7f8cc4142090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:05:59.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:05:59.932+0000 7f8cbaffd640 1 -- >> v1:172.21.15.52:6789/0 conn(0x7f8cc413ea60 legacy=0x7f8cc413eea0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-05T08:05:59.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:05:59.932+0000 7f8cbaffd640 10 monclient: _add_conns ranks=[3,1] 2023-11-05T08:05:59.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:05:59.932+0000 7f8cbaffd640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8ca80036c0 0x7f8ca8005b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:05:59.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:05:59.932+0000 7f8cbaffd640 10 monclient(hunting): picked mon.noname-a con 0x7f8ca80036c0 addr v2:172.21.15.52:3300/0 2023-11-05T08:05:59.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:05:59.932+0000 7f8cbaffd640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f8ca8006190 addr v1:172.21.15.156:6789/0 2023-11-05T08:05:59.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:05:59.932+0000 7f8cbaffd640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cc40b80e0 con 0x7f8ca8006190 2023-11-05T08:05:59.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:05:59.932+0000 7f8cbaffd640 10 monclient(hunting): start opening mon connection 2023-11-05T08:05:59.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:05:59.932+0000 7f8cbaffd640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cc40b1670 con 0x7f8ca80036c0 2023-11-05T08:05:59.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:05:59.932+0000 7f8cbaffd640 10 monclient(hunting): _renew_subs 2023-11-05T08:05:59.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:05:59.932+0000 7f8cc94ab640 1 -- >> v2:172.21.15.52:3300/0 conn(0x7f8ca80036c0 msgr2=0x7f8ca8005b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3300/0 2023-11-05T08:05:59.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:05:59.932+0000 7f8cc94ab640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8ca80036c0 0x7f8ca8005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-05T08:05:59.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:05:59.932+0000 7f8cc8caa640 1 -- >> v1:172.21.15.156:6789/0 conn(0x7f8ca8006190 legacy=0x7f8ca8008650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.156:6789/0 2023-11-05T08:06:00.135 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:00.133+0000 7f8cc8caa640 1 -- >> v1:172.21.15.156:6789/0 conn(0x7f8ca8006190 legacy=0x7f8ca8008650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.156:6789/0 2023-11-05T08:06:00.135 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:00.133+0000 7f8cc94ab640 1 -- >> v2:172.21.15.52:3300/0 conn(0x7f8ca80036c0 msgr2=0x7f8ca8005b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3300/0 2023-11-05T08:06:00.135 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:00.133+0000 7f8cc94ab640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8ca80036c0 0x7f8ca8005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-05T08:06:00.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:00.534+0000 7f8cc94ab640 1 -- >> v2:172.21.15.52:3300/0 conn(0x7f8ca80036c0 msgr2=0x7f8ca8005b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3300/0 2023-11-05T08:06:00.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:00.534+0000 7f8cc94ab640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8ca80036c0 0x7f8ca8005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-05T08:06:00.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:00.534+0000 7f8cc8caa640 1 -- >> v1:172.21.15.156:6789/0 conn(0x7f8ca8006190 legacy=0x7f8ca8008650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.156:6789/0 2023-11-05T08:06:01.336 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:01.335+0000 7f8cc94ab640 1 -- >> v2:172.21.15.52:3300/0 conn(0x7f8ca80036c0 msgr2=0x7f8ca8005b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3300/0 2023-11-05T08:06:01.337 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:01.335+0000 7f8cc94ab640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8ca80036c0 0x7f8ca8005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-05T08:06:01.337 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:01.335+0000 7f8cc8caa640 1 -- >> v1:172.21.15.156:6789/0 conn(0x7f8ca8006190 legacy=0x7f8ca8008650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.156:6789/0 2023-11-05T08:06:02.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:02.932+0000 7f8cbaffd640 10 monclient(hunting): tick 2023-11-05T08:06:02.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:02.932+0000 7f8cbaffd640 10 monclient(hunting): _check_auth_tickets 2023-11-05T08:06:02.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:02.932+0000 7f8cbaffd640 1 monclient(hunting): continuing hunt 2023-11-05T08:06:02.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:02.932+0000 7f8cbaffd640 10 monclient(hunting): _reopen_session rank -1 2023-11-05T08:06:02.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:02.932+0000 7f8cbaffd640 1 -- >> v2:172.21.15.52:3300/0 conn(0x7f8ca80036c0 msgr2=0x7f8ca8005b40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-05T08:06:02.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:02.932+0000 7f8cbaffd640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8ca80036c0 0x7f8ca8005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:02.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:02.932+0000 7f8cbaffd640 1 -- >> v1:172.21.15.156:6789/0 conn(0x7f8ca8006190 legacy=0x7f8ca8008650 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-05T08:06:02.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:02.932+0000 7f8cbaffd640 10 monclient: _add_conns ranks=[0,2,3,1,4] 2023-11-05T08:06:02.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:02.932+0000 7f8cc9cac640 1 -- reap_dead start 2023-11-05T08:06:02.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:02.932+0000 7f8cbaffd640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f8cc413ea60 addr v1:172.21.15.52:6789/0 2023-11-05T08:06:02.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:02.932+0000 7f8cbaffd640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8ca800a5f0 0x7f8ca8005b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:06:02.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:02.933+0000 7f8cbaffd640 10 monclient(hunting): picked mon.noname-b con 0x7f8ca800a5f0 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:06:02.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:02.933+0000 7f8cbaffd640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8ca800aa70 0x7f8ca8008650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:06:02.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:02.933+0000 7f8cbaffd640 10 monclient(hunting): picked mon.noname-a con 0x7f8ca800aa70 addr v2:172.21.15.52:3300/0 2023-11-05T08:06:02.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:02.933+0000 7f8cbaffd640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ca800af00 con 0x7f8cc413ea60 2023-11-05T08:06:02.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:02.933+0000 7f8cbaffd640 10 monclient(hunting): start opening mon connection 2023-11-05T08:06:02.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:02.933+0000 7f8cbaffd640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cc40b1670 con 0x7f8ca800aa70 2023-11-05T08:06:02.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:02.933+0000 7f8cbaffd640 10 monclient(hunting): start opening mon connection 2023-11-05T08:06:02.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:02.933+0000 7f8cc94ab640 1 -- >> v1:172.21.15.52:6789/0 conn(0x7f8cc413ea60 legacy=0x7f8ca8009ee0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.52:6789/0 2023-11-05T08:06:02.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:02.933+0000 7f8cbaffd640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc40aa420 con 0x7f8ca800a5f0 2023-11-05T08:06:02.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:02.933+0000 7f8cbaffd640 10 monclient(hunting): _renew_subs 2023-11-05T08:06:02.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:02.933+0000 7f8cc9cac640 1 -- >> v2:172.21.15.52:3300/0 conn(0x7f8ca800aa70 msgr2=0x7f8ca8008650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3300/0 2023-11-05T08:06:02.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:02.933+0000 7f8cc8caa640 1 -- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8ca800a5f0 msgr2=0x7f8ca8005b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3301/0 2023-11-05T08:06:02.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:02.933+0000 7f8cc9cac640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8ca800aa70 0x7f8ca8008650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-05T08:06:02.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:02.933+0000 7f8cc8caa640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8ca800a5f0 0x7f8ca8005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-05T08:06:03.135 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:03.134+0000 7f8cc94ab640 1 -- >> v1:172.21.15.52:6789/0 conn(0x7f8cc413ea60 legacy=0x7f8ca8009ee0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.52:6789/0 2023-11-05T08:06:03.136 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:03.134+0000 7f8cc8caa640 1 -- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8ca800a5f0 msgr2=0x7f8ca8005b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3301/0 2023-11-05T08:06:03.136 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:03.134+0000 7f8cc9cac640 1 -- >> v2:172.21.15.52:3300/0 conn(0x7f8ca800aa70 msgr2=0x7f8ca8008650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3300/0 2023-11-05T08:06:03.136 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:03.134+0000 7f8cc9cac640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8ca800aa70 0x7f8ca8008650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-05T08:06:03.136 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:03.134+0000 7f8cc8caa640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8ca800a5f0 0x7f8ca8005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-05T08:06:03.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:03.535+0000 7f8cc9cac640 1 -- >> v2:172.21.15.52:3300/0 conn(0x7f8ca800aa70 msgr2=0x7f8ca8008650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3300/0 2023-11-05T08:06:03.537 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:03.535+0000 7f8cc8caa640 1 -- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8ca800a5f0 msgr2=0x7f8ca8005b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3301/0 2023-11-05T08:06:03.537 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:03.535+0000 7f8cc94ab640 1 -- >> v1:172.21.15.52:6789/0 conn(0x7f8cc413ea60 legacy=0x7f8ca8009ee0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.52:6789/0 2023-11-05T08:06:03.537 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:03.535+0000 7f8cc9cac640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8ca800aa70 0x7f8ca8008650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-05T08:06:03.537 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:03.535+0000 7f8cc8caa640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8ca800a5f0 0x7f8ca8005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-05T08:06:04.337 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:04.336+0000 7f8cc94ab640 1 -- >> v1:172.21.15.52:6789/0 conn(0x7f8cc413ea60 legacy=0x7f8ca8009ee0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.52:6789/0 2023-11-05T08:06:04.338 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:04.336+0000 7f8cc9cac640 1 -- >> v2:172.21.15.52:3300/0 conn(0x7f8ca800aa70 msgr2=0x7f8ca8008650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3300/0 2023-11-05T08:06:04.338 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:04.336+0000 7f8cc8caa640 1 -- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8ca800a5f0 msgr2=0x7f8ca8005b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.52:3301/0 2023-11-05T08:06:04.338 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:04.336+0000 7f8cc9cac640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8ca800aa70 0x7f8ca8008650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-05T08:06:04.339 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:04.336+0000 7f8cc8caa640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8ca800a5f0 0x7f8ca8005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-05T08:06:04.609 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:00:07.683 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:06:04.922 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:00:07.997 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:06:04.996 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:00:08.111 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:06:05.007 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:00:08.122 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:06:05.328 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:00:08.443 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:06:05.338 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:00:08.454 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:06:05.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:05.933+0000 7f8cbaffd640 10 monclient(hunting): tick 2023-11-05T08:06:05.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:05.933+0000 7f8cbaffd640 10 monclient(hunting): _check_auth_tickets 2023-11-05T08:06:05.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:05.933+0000 7f8cbaffd640 1 monclient(hunting): continuing hunt 2023-11-05T08:06:05.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:05.933+0000 7f8cbaffd640 10 monclient(hunting): _reopen_session rank -1 2023-11-05T08:06:05.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:05.933+0000 7f8cbaffd640 1 -- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8ca800a5f0 msgr2=0x7f8ca8005b40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-05T08:06:05.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:05.933+0000 7f8cbaffd640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8ca800a5f0 0x7f8ca8005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:05.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:05.933+0000 7f8cbaffd640 1 -- >> v2:172.21.15.52:3300/0 conn(0x7f8ca800aa70 msgr2=0x7f8ca8008650 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-05T08:06:05.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:05.933+0000 7f8cbaffd640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8ca800aa70 0x7f8ca8008650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:05.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:05.933+0000 7f8cbaffd640 1 -- >> v1:172.21.15.52:6789/0 conn(0x7f8cc413ea60 legacy=0x7f8ca8009ee0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-05T08:06:05.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:05.933+0000 7f8cbaffd640 10 monclient: _add_conns ranks=[1,4] 2023-11-05T08:06:05.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:05.933+0000 7f8cbaffd640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f8ca8008f80 addr v1:172.21.15.156:6789/0 2023-11-05T08:06:05.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:05.933+0000 7f8cbaffd640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f8ca8011230 0x7f8ca8013620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:06:05.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:05.933+0000 7f8cbaffd640 10 monclient(hunting): picked mon.noname-c con 0x7f8ca8011230 addr v2:172.21.15.156:3300/0 2023-11-05T08:06:05.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:05.933+0000 7f8cbaffd640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cc40b80e0 con 0x7f8ca8008f80 2023-11-05T08:06:05.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:05.933+0000 7f8cbaffd640 10 monclient(hunting): start opening mon connection 2023-11-05T08:06:05.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:05.933+0000 7f8cbaffd640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cc40b1670 con 0x7f8ca8011230 2023-11-05T08:06:05.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:05.933+0000 7f8cbaffd640 10 monclient(hunting): _renew_subs 2023-11-05T08:06:05.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:05.933+0000 7f8cc8caa640 1 -- >> v2:172.21.15.156:3300/0 conn(0x7f8ca8011230 msgr2=0x7f8ca8013620 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.156:3300/0 2023-11-05T08:06:05.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:05.933+0000 7f8cc94ab640 1 -- >> v1:172.21.15.156:6789/0 conn(0x7f8ca8008f80 legacy=0x7f8ca8009390 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.156:6789/0 2023-11-05T08:06:05.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:05.933+0000 7f8cc8caa640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f8ca8011230 0x7f8ca8013620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-05T08:06:06.400 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:06.398+0000 7f8cc94ab640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f8ca8008f80 0x7f8ca8009390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.52:42180/0 (socket says 172.21.15.52:42180) 2023-11-05T08:06:06.400 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:06.398+0000 7f8cc94ab640 1 -- 172.21.15.52:0/557495915 learned_addr learned my addr 172.21.15.52:0/557495915 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-11-05T08:06:06.422 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:06.421+0000 7f8cc8caa640 1 --2- 172.21.15.52:0/557495915 >> v2:172.21.15.156:3300/0 conn(0x7f8ca8011230 0x7f8ca8013620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:06:06.533 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:06.532+0000 7f8cc8caa640 10 monclient(hunting): get_auth_request con 0x7f8ca8011230 auth_method 0 2023-11-05T08:06:06.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:06.532+0000 7f8cc8caa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:06:06.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:06.532+0000 7f8cc8caa640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:06:06.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:06.532+0000 7f8cc8caa640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:06:06.554 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:06.553+0000 7f8cc94ab640 1 -- 172.21.15.52:0/557495915 >> v1:172.21.15.156:6789/0 conn(0x7f8ca8008f80 legacy=0x7f8ca8009390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2023-11-05T08:06:06.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:06.553+0000 7f8cc94ab640 1 -- 172.21.15.52:0/557495915 >> v1:172.21.15.156:6789/0 conn(0x7f8ca8008f80 legacy=0x7f8ca8009390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-05T08:06:06.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:06.553+0000 7f8cc94ab640 1 --1- 172.21.15.52:0/557495915 >> v1:172.21.15.156:6789/0 conn(0x7f8ca8008f80 0x7f8ca8009390 :-1 s=OPENED pgs=1 cs=1 l=1).handle_message read tag failed 2023-11-05T08:06:06.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:06.553+0000 7f8cc94ab640 1 --1- 172.21.15.52:0/557495915 >> v1:172.21.15.156:6789/0 conn(0x7f8ca8008f80 0x7f8ca8009390 :-1 s=OPENED pgs=1 cs=1 l=1).fault on lossy channel, failing 2023-11-05T08:06:06.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:06.553+0000 7f8cbbfff640 10 monclient(hunting): ms_handle_reset hunted mon v1:172.21.15.156:6789/0 2023-11-05T08:06:06.622 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:06.620+0000 7f8cc8caa640 1 -- 172.21.15.52:0/557495915 >> v2:172.21.15.156:3300/0 conn(0x7f8ca8011230 msgr2=0x7f8ca8013620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-05T08:06:06.622 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:06.620+0000 7f8cc8caa640 1 -- 172.21.15.52:0/557495915 >> v2:172.21.15.156:3300/0 conn(0x7f8ca8011230 msgr2=0x7f8ca8013620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-05T08:06:06.622 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:06.620+0000 7f8cc8caa640 1 --2- 172.21.15.52:0/557495915 >> v2:172.21.15.156:3300/0 conn(0x7f8ca8011230 0x7f8ca8013620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-05T08:06:06.623 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:06.620+0000 7f8cc8caa640 1 --2- 172.21.15.52:0/557495915 >> v2:172.21.15.156:3300/0 conn(0x7f8ca8011230 0x7f8ca8013620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-05T08:06:07.023 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:07.021+0000 7f8cc8caa640 1 --2- 172.21.15.52:0/557495915 >> v2:172.21.15.156:3300/0 conn(0x7f8ca8011230 0x7f8ca8013620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:06:07.023 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:07.022+0000 7f8cc8caa640 10 monclient(hunting): get_auth_request con 0x7f8ca8011230 auth_method 0 2023-11-05T08:06:07.024 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:07.022+0000 7f8cc8caa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:06:07.024 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:07.022+0000 7f8cc8caa640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:06:07.024 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:07.022+0000 7f8cc8caa640 10 monclient(hunting): _init_auth already have auth, reseting 2023-11-05T08:06:07.024 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:07.022+0000 7f8cc8caa640 1 -- 172.21.15.52:0/557495915 >> v2:172.21.15.156:3300/0 conn(0x7f8ca8011230 msgr2=0x7f8ca8013620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-05T08:06:07.025 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:07.022+0000 7f8cc8caa640 1 -- 172.21.15.52:0/557495915 >> v2:172.21.15.156:3300/0 conn(0x7f8ca8011230 msgr2=0x7f8ca8013620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-05T08:06:07.025 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:07.022+0000 7f8cc8caa640 1 --2- 172.21.15.52:0/557495915 >> v2:172.21.15.156:3300/0 conn(0x7f8ca8011230 0x7f8ca8013620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-05T08:06:07.025 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:07.022+0000 7f8cc8caa640 1 --2- 172.21.15.52:0/557495915 >> v2:172.21.15.156:3300/0 conn(0x7f8ca8011230 0x7f8ca8013620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-05T08:06:07.930 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:07.929+0000 7f8cc8caa640 1 --2- 172.21.15.52:0/557495915 >> v2:172.21.15.156:3300/0 conn(0x7f8ca8011230 0x7f8ca8013620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:06:07.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:07.931+0000 7f8cc8caa640 10 monclient(hunting): get_auth_request con 0x7f8ca8011230 auth_method 0 2023-11-05T08:06:07.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:07.931+0000 7f8cc8caa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:06:07.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:07.931+0000 7f8cc8caa640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:06:07.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:07.931+0000 7f8cc8caa640 10 monclient(hunting): _init_auth already have auth, reseting 2023-11-05T08:06:07.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:07.932+0000 7f8cc8caa640 1 -- 172.21.15.52:0/557495915 >> v2:172.21.15.156:3300/0 conn(0x7f8ca8011230 msgr2=0x7f8ca8013620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-05T08:06:07.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:07.932+0000 7f8cc8caa640 1 -- 172.21.15.52:0/557495915 >> v2:172.21.15.156:3300/0 conn(0x7f8ca8011230 msgr2=0x7f8ca8013620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-05T08:06:07.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:07.932+0000 7f8cc8caa640 1 --2- 172.21.15.52:0/557495915 >> v2:172.21.15.156:3300/0 conn(0x7f8ca8011230 0x7f8ca8013620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-05T08:06:07.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:07.932+0000 7f8cc8caa640 1 --2- 172.21.15.52:0/557495915 >> v2:172.21.15.156:3300/0 conn(0x7f8ca8011230 0x7f8ca8013620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-05T08:06:08.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:08.933+0000 7f8cbaffd640 10 monclient(hunting): tick 2023-11-05T08:06:08.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:08.933+0000 7f8cbaffd640 10 monclient(hunting): _check_auth_tickets 2023-11-05T08:06:08.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:08.933+0000 7f8cbaffd640 1 monclient(hunting): continuing hunt 2023-11-05T08:06:08.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:08.933+0000 7f8cbaffd640 10 monclient(hunting): _reopen_session rank -1 2023-11-05T08:06:08.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:08.933+0000 7f8cbaffd640 1 -- 172.21.15.52:0/557495915 >> v2:172.21.15.156:3300/0 conn(0x7f8ca8011230 msgr2=0x7f8ca8013620 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-05T08:06:08.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:08.933+0000 7f8cbaffd640 1 --2- 172.21.15.52:0/557495915 >> v2:172.21.15.156:3300/0 conn(0x7f8ca8011230 0x7f8ca8013620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:08.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:08.933+0000 7f8cbaffd640 1 -- 172.21.15.52:0/557495915 >> v1:172.21.15.156:6789/0 conn(0x7f8ca8008f80 legacy=0x7f8ca8009390 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-11-05T08:06:08.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:08.933+0000 7f8cc9cac640 1 -- 172.21.15.52:0/557495915 reap_dead start 2023-11-05T08:06:08.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:08.933+0000 7f8cbaffd640 10 monclient: _add_conns ranks=[2,1,4,3,0] 2023-11-05T08:06:08.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:08.933+0000 7f8cbaffd640 1 --2- 172.21.15.52:0/557495915 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8ca8008f80 0x7f8ca8008650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:06:08.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:08.933+0000 7f8cbaffd640 10 monclient(hunting): picked mon.noname-b con 0x7f8ca8008f80 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:06:08.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:08.933+0000 7f8cbaffd640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f8ca8009ec0 addr v1:172.21.15.156:6789/0 2023-11-05T08:06:08.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:08.933+0000 7f8cbaffd640 1 --2- 172.21.15.52:0/557495915 >> v2:172.21.15.156:3300/0 conn(0x7f8ca8005b40 0x7f8ca800e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:06:08.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:08.933+0000 7f8cbaffd640 10 monclient(hunting): picked mon.noname-c con 0x7f8ca8005b40 addr v2:172.21.15.156:3300/0 2023-11-05T08:06:08.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:08.933+0000 7f8cbaffd640 1 -- 172.21.15.52:0/557495915 --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ca800af00 con 0x7f8ca8009ec0 2023-11-05T08:06:08.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:08.933+0000 7f8cbaffd640 10 monclient(hunting): start opening mon connection 2023-11-05T08:06:08.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:08.933+0000 7f8cbaffd640 1 -- 172.21.15.52:0/557495915 --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cc40b1670 con 0x7f8ca8005b40 2023-11-05T08:06:08.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:08.933+0000 7f8cbaffd640 10 monclient(hunting): start opening mon connection 2023-11-05T08:06:08.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:08.933+0000 7f8cbaffd640 1 -- 172.21.15.52:0/557495915 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc40aa420 con 0x7f8ca8008f80 2023-11-05T08:06:08.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:08.933+0000 7f8cbaffd640 10 monclient(hunting): _renew_subs 2023-11-05T08:06:08.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:08.933+0000 7f8cc94ab640 1 --2- 172.21.15.52:0/557495915 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8ca8008f80 0x7f8ca8008650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:06:08.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:08.933+0000 7f8cc9cac640 1 --2- 172.21.15.52:0/557495915 >> v2:172.21.15.156:3300/0 conn(0x7f8ca8005b40 0x7f8ca800e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:06:08.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:08.934+0000 7f8cc94ab640 10 monclient(hunting): get_auth_request con 0x7f8ca8008f80 auth_method 0 2023-11-05T08:06:08.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:08.934+0000 7f8cc94ab640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:06:08.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:08.934+0000 7f8cc94ab640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:06:08.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:08.934+0000 7f8cc94ab640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:06:08.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:08.934+0000 7f8cc9cac640 10 monclient(hunting): get_auth_request con 0x7f8ca8005b40 auth_method 0 2023-11-05T08:06:08.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:08.934+0000 7f8cc9cac640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:06:08.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:08.934+0000 7f8cc9cac640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:06:08.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:08.934+0000 7f8cc9cac640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:06:08.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:08.935+0000 7f8cc94ab640 1 -- 172.21.15.52:0/557495915 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8ca8008f80 msgr2=0x7f8ca8008650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-05T08:06:08.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:08.935+0000 7f8cc94ab640 1 -- 172.21.15.52:0/557495915 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8ca8008f80 msgr2=0x7f8ca8008650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-05T08:06:08.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:08.935+0000 7f8cc94ab640 1 --2- 172.21.15.52:0/557495915 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8ca8008f80 0x7f8ca8008650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-05T08:06:08.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:08.935+0000 7f8cc94ab640 1 --2- 172.21.15.52:0/557495915 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8ca8008f80 0x7f8ca8008650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-05T08:06:08.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:08.936+0000 7f8cc9cac640 1 -- 172.21.15.52:0/557495915 >> v2:172.21.15.156:3300/0 conn(0x7f8ca8005b40 msgr2=0x7f8ca800e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-05T08:06:08.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:08.936+0000 7f8cc9cac640 1 -- 172.21.15.52:0/557495915 >> v2:172.21.15.156:3300/0 conn(0x7f8ca8005b40 msgr2=0x7f8ca800e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-05T08:06:08.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:08.936+0000 7f8cc9cac640 1 --2- 172.21.15.52:0/557495915 >> v2:172.21.15.156:3300/0 conn(0x7f8ca8005b40 0x7f8ca800e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-05T08:06:08.944 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:08.936+0000 7f8cc9cac640 1 --2- 172.21.15.52:0/557495915 >> v2:172.21.15.156:3300/0 conn(0x7f8ca8005b40 0x7f8ca800e210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-05T08:06:09.161 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:09.160+0000 7f8cc9cac640 1 --2- 172.21.15.52:0/557495915 >> v2:172.21.15.156:3300/0 conn(0x7f8ca8005b40 0x7f8ca800e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:06:09.162 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:09.160+0000 7f8cc9cac640 10 monclient(hunting): get_auth_request con 0x7f8ca8005b40 auth_method 0 2023-11-05T08:06:09.162 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:09.160+0000 7f8cc9cac640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:06:09.162 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:09.160+0000 7f8cc9cac640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:06:09.162 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:09.160+0000 7f8cc9cac640 10 monclient(hunting): _init_auth already have auth, reseting 2023-11-05T08:06:09.172 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:09.171+0000 7f8cc94ab640 1 --2- 172.21.15.52:0/557495915 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8ca8008f80 0x7f8ca8008650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:06:09.176 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:09.175+0000 7f8cc9cac640 1 -- 172.21.15.52:0/557495915 >> v2:172.21.15.156:3300/0 conn(0x7f8ca8005b40 msgr2=0x7f8ca800e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-05T08:06:09.176 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:09.175+0000 7f8cc9cac640 1 -- 172.21.15.52:0/557495915 >> v2:172.21.15.156:3300/0 conn(0x7f8ca8005b40 msgr2=0x7f8ca800e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-05T08:06:09.176 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:09.175+0000 7f8cc9cac640 1 --2- 172.21.15.52:0/557495915 >> v2:172.21.15.156:3300/0 conn(0x7f8ca8005b40 0x7f8ca800e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-05T08:06:09.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:09.175+0000 7f8cc9cac640 1 --2- 172.21.15.52:0/557495915 >> v2:172.21.15.156:3300/0 conn(0x7f8ca8005b40 0x7f8ca800e210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-05T08:06:09.188 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:09.187+0000 7f8cc94ab640 10 monclient(hunting): get_auth_request con 0x7f8ca8008f80 auth_method 0 2023-11-05T08:06:09.188 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:09.187+0000 7f8cc94ab640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:06:09.189 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:09.187+0000 7f8cc94ab640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:06:09.189 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:09.187+0000 7f8cc94ab640 10 monclient(hunting): _init_auth already have auth, reseting 2023-11-05T08:06:09.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:09.190+0000 7f8cc94ab640 1 -- 172.21.15.52:0/557495915 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8ca8008f80 msgr2=0x7f8ca8008650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-05T08:06:09.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:09.190+0000 7f8cc94ab640 1 -- 172.21.15.52:0/557495915 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8ca8008f80 msgr2=0x7f8ca8008650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-05T08:06:09.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:09.190+0000 7f8cc94ab640 1 --2- 172.21.15.52:0/557495915 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8ca8008f80 0x7f8ca8008650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-05T08:06:09.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:09.190+0000 7f8cc94ab640 1 --2- 172.21.15.52:0/557495915 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8ca8008f80 0x7f8ca8008650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-05T08:06:09.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:09.576+0000 7f8cc9cac640 1 --2- 172.21.15.52:0/557495915 >> v2:172.21.15.156:3300/0 conn(0x7f8ca8005b40 0x7f8ca800e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:06:09.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:09.577+0000 7f8cc9cac640 10 monclient(hunting): get_auth_request con 0x7f8ca8005b40 auth_method 0 2023-11-05T08:06:09.579 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:09.577+0000 7f8cc9cac640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:06:09.579 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:09.577+0000 7f8cc9cac640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:06:09.579 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:09.577+0000 7f8cc9cac640 10 monclient(hunting): _init_auth already have auth, reseting 2023-11-05T08:06:09.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:09.577+0000 7f8cc9cac640 1 -- 172.21.15.52:0/557495915 >> v2:172.21.15.156:3300/0 conn(0x7f8ca8005b40 msgr2=0x7f8ca800e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-05T08:06:09.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:09.577+0000 7f8cc9cac640 1 -- 172.21.15.52:0/557495915 >> v2:172.21.15.156:3300/0 conn(0x7f8ca8005b40 msgr2=0x7f8ca800e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-05T08:06:09.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:09.577+0000 7f8cc9cac640 1 --2- 172.21.15.52:0/557495915 >> v2:172.21.15.156:3300/0 conn(0x7f8ca8005b40 0x7f8ca800e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-05T08:06:09.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:09.577+0000 7f8cc9cac640 1 --2- 172.21.15.52:0/557495915 >> v2:172.21.15.156:3300/0 conn(0x7f8ca8005b40 0x7f8ca800e210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-05T08:06:09.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:09.591+0000 7f8cc94ab640 1 --2- 172.21.15.52:0/557495915 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8ca8008f80 0x7f8ca8008650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:06:09.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:09.592+0000 7f8cc94ab640 10 monclient(hunting): get_auth_request con 0x7f8ca8008f80 auth_method 0 2023-11-05T08:06:09.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:09.592+0000 7f8cc94ab640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:06:09.595 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:09.592+0000 7f8cc94ab640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:06:09.595 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:09.592+0000 7f8cc94ab640 10 monclient(hunting): _init_auth already have auth, reseting 2023-11-05T08:06:09.596 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:09.593+0000 7f8cc94ab640 1 -- 172.21.15.52:0/557495915 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8ca8008f80 msgr2=0x7f8ca8008650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-05T08:06:09.596 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:09.593+0000 7f8cc94ab640 1 -- 172.21.15.52:0/557495915 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8ca8008f80 msgr2=0x7f8ca8008650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-05T08:06:09.597 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:09.593+0000 7f8cc94ab640 1 --2- 172.21.15.52:0/557495915 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8ca8008f80 0x7f8ca8008650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-05T08:06:09.597 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:09.593+0000 7f8cc94ab640 1 --2- 172.21.15.52:0/557495915 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8ca8008f80 0x7f8ca8008650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-05T08:06:10.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.223+0000 7f8cbbfff640 1 -- 172.21.15.52:0/557495915 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 962614510 0 0) 0x7f8ca800af00 con 0x7f8ca8009ec0 2023-11-05T08:06:10.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.223+0000 7f8cbbfff640 10 monclient(hunting): _negotiate 2023-11-05T08:06:10.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.223+0000 7f8cbbfff640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:06:10.226 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.223+0000 7f8cbbfff640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:06:10.226 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.223+0000 7f8cbbfff640 10 monclient(hunting): my global_id is 4105 2023-11-05T08:06:10.226 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.223+0000 7f8cbbfff640 1 -- 172.21.15.52:0/557495915 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8cb0003520 con 0x7f8ca8009ec0 2023-11-05T08:06:10.316 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.314+0000 7f8cbbfff640 1 -- 172.21.15.52:0/557495915 <== mon.1 v1:172.21.15.156:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 194934732 0 0) 0x7f8cb0003520 con 0x7f8ca8009ec0 2023-11-05T08:06:10.317 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.314+0000 7f8cbbfff640 1 -- 172.21.15.52:0/557495915 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8ca8008f80 msgr2=0x7f8ca8008650 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-05T08:06:10.317 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.314+0000 7f8cbbfff640 1 --2- 172.21.15.52:0/557495915 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8ca8008f80 0x7f8ca8008650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:10.317 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.314+0000 7f8cbbfff640 1 -- 172.21.15.52:0/557495915 >> v2:172.21.15.156:3300/0 conn(0x7f8ca8005b40 msgr2=0x7f8ca800e210 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-05T08:06:10.317 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.314+0000 7f8cbbfff640 1 --2- 172.21.15.52:0/557495915 >> v2:172.21.15.156:3300/0 conn(0x7f8ca8005b40 0x7f8ca800e210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:10.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.314+0000 7f8cbbfff640 10 monclient: _finish_hunting 0 2023-11-05T08:06:10.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.314+0000 7f8cbbfff640 1 monclient: found mon.noname-c-legacy 2023-11-05T08:06:10.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.314+0000 7f8cbbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:06:10.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.314+0000 7f8cbbfff640 10 monclient: _send_mon_message to mon.noname-c-legacy at v1:172.21.15.156:6789/0 2023-11-05T08:06:10.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.314+0000 7f8cbbfff640 1 -- 172.21.15.52:0/557495915 --> v1:172.21.15.156:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ca800a310 con 0x7f8ca8009ec0 2023-11-05T08:06:10.319 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.314+0000 7f8cbbfff640 10 monclient: _finish_auth 0 2023-11-05T08:06:10.319 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.314+0000 7f8cbbfff640 10 monclient: _check_auth_tickets 2023-11-05T08:06:10.319 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.314+0000 7f8cbbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:06:10.319 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.314+0000 7f8cbbfff640 1 -- 172.21.15.52:0/557495915 <== mon.1 v1:172.21.15.156:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2979872170 0 0) 0x7f8cb4007650 con 0x7f8ca8009ec0 2023-11-05T08:06:10.319 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.314+0000 7f8ccb70f640 5 monclient: authenticate success, global_id 4105 2023-11-05T08:06:10.319 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.314+0000 7f8ccb70f640 20 monclient: get_monmap_and_config waiting for monmap|config 2023-11-05T08:06:10.320 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.314+0000 7f8cbbfff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:06:10.320 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.314+0000 7f8cbbfff640 10 monclient: got monmap 1 from mon.noname-c-legacy (according to old e1) 2023-11-05T08:06:10.320 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.314+0000 7f8cbbfff640 10 monclient: dump: 2023-11-05T08:06:10.320 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:06:10.320 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:06:10.321 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:10.321 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:10.321 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:06:10.321 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:06:10.321 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:06:10.321 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:06:10.322 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:06:10.322 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:06:10.322 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.314+0000 7f8cbbfff640 1 monclient: mon.b has (v2) addrs [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] but i'm connected to v1:172.21.15.156:6789/0, reconnecting 2023-11-05T08:06:10.322 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.314+0000 7f8cbbfff640 10 monclient: _reopen_session rank -1 2023-11-05T08:06:10.322 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.314+0000 7f8cbbfff640 1 -- 172.21.15.52:0/557495915 >> v1:172.21.15.156:6789/0 conn(0x7f8ca8009ec0 legacy=0x7f8ca8009360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:06:10.323 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.314+0000 7f8cbbfff640 10 monclient: _add_conns ranks=[2,1,0] 2023-11-05T08:06:10.323 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.314+0000 7f8cbbfff640 1 --2- 172.21.15.52:0/557495915 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8ca8008f80 0x7f8cb0003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:06:10.323 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.314+0000 7f8cbbfff640 10 monclient(hunting): picked mon.c con 0x7f8ca8008f80 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:06:10.323 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.314+0000 7f8cbbfff640 1 --2- 172.21.15.52:0/557495915 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8cb0003fa0 0x7f8cb00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:06:10.323 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.314+0000 7f8cbbfff640 10 monclient(hunting): picked mon.b con 0x7f8cb0003fa0 addr [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] 2023-11-05T08:06:10.324 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.314+0000 7f8cbbfff640 1 --2- 172.21.15.52:0/557495915 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8cb0004d00 0x7f8cb0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:06:10.324 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.314+0000 7f8cbbfff640 10 monclient(hunting): picked mon.a con 0x7f8cb0004d00 addr [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] 2023-11-05T08:06:10.324 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.314+0000 7f8cbbfff640 10 monclient(hunting): start opening mon connection 2023-11-05T08:06:10.324 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.314+0000 7f8cbbfff640 1 -- 172.21.15.52:0/557495915 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc40b1670 con 0x7f8cb0004d00 2023-11-05T08:06:10.324 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.314+0000 7f8cbbfff640 10 monclient(hunting): start opening mon connection 2023-11-05T08:06:10.325 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.314+0000 7f8cbbfff640 1 -- 172.21.15.52:0/557495915 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc40aa420 con 0x7f8cb0003fa0 2023-11-05T08:06:10.325 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.314+0000 7f8cbbfff640 10 monclient(hunting): start opening mon connection 2023-11-05T08:06:10.325 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.314+0000 7f8cbbfff640 1 -- 172.21.15.52:0/557495915 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb000bb90 con 0x7f8ca8008f80 2023-11-05T08:06:10.325 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.314+0000 7f8cbbfff640 10 monclient(hunting): _renew_subs 2023-11-05T08:06:10.325 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.314+0000 7f8cbbfff640 10 monclient(hunting): _finish_auth 0 2023-11-05T08:06:10.325 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.314+0000 7f8ccb70f640 20 monclient(hunting): get_monmap_and_config waiting for monmap|config 2023-11-05T08:06:10.326 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.322+0000 7f8cc94ab640 1 --2- 172.21.15.52:0/557495915 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8ca8008f80 0x7f8cb0003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:06:10.326 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.324+0000 7f8cc9cac640 1 --2- 172.21.15.52:0/557495915 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8cb0004d00 0x7f8cb0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:06:10.327 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.324+0000 7f8cc9cac640 10 monclient(hunting): get_auth_request con 0x7f8cb0004d00 auth_method 0 2023-11-05T08:06:10.327 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.324+0000 7f8cc9cac640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:06:10.327 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.324+0000 7f8cc9cac640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:06:10.327 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.324+0000 7f8cc9cac640 10 monclient(hunting): _init_auth already have auth, reseting 2023-11-05T08:06:10.369 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.368+0000 7f8cc8caa640 1 --2- 172.21.15.52:0/557495915 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8cb0003fa0 0x7f8cb00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:06:10.370 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.369+0000 7f8cc8caa640 10 monclient(hunting): get_auth_request con 0x7f8cb0003fa0 auth_method 0 2023-11-05T08:06:10.371 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.369+0000 7f8cc8caa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:06:10.371 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.369+0000 7f8cc8caa640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:06:10.371 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.369+0000 7f8cc8caa640 10 monclient(hunting): _init_auth already have auth, reseting 2023-11-05T08:06:10.372 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.371+0000 7f8cc8caa640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:06:10.372 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.371+0000 7f8cc8caa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:06:10.373 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.371+0000 7f8cc8caa640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2023-11-05T08:06:10.375 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.373+0000 7f8cc8caa640 10 monclient(hunting): handle_auth_done global_id 4105 payload 293 2023-11-05T08:06:10.375 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.373+0000 7f8cc8caa640 1 -- 172.21.15.52:0/557495915 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8ca8008f80 msgr2=0x7f8cb0003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-05T08:06:10.375 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.373+0000 7f8cc8caa640 1 --2- 172.21.15.52:0/557495915 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8ca8008f80 0x7f8cb0003970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:10.375 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.373+0000 7f8cc8caa640 1 -- 172.21.15.52:0/557495915 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8cb0004d00 msgr2=0x7f8cb0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-05T08:06:10.376 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.373+0000 7f8cc8caa640 1 --2- 172.21.15.52:0/557495915 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8cb0004d00 0x7f8cb0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:10.376 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.373+0000 7f8cc8caa640 10 monclient: _finish_hunting 0 2023-11-05T08:06:10.376 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.373+0000 7f8cc8caa640 1 monclient: found mon.b 2023-11-05T08:06:10.376 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.373+0000 7f8cc8caa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:06:10.376 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.373+0000 7f8cc8caa640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:06:10.377 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.373+0000 7f8cc8caa640 1 -- 172.21.15.52:0/557495915 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cb0003520 con 0x7f8cb0003fa0 2023-11-05T08:06:10.377 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.373+0000 7f8cc8caa640 10 monclient: _finish_auth 0 2023-11-05T08:06:10.377 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.373+0000 7f8cc8caa640 10 monclient: _check_auth_tickets 2023-11-05T08:06:10.377 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.373+0000 7f8cc8caa640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:06:10.378 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.376+0000 7f8cc8caa640 1 --2- 172.21.15.52:0/557495915 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8cb0003fa0 0x7f8cb00047c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f8cb4007090 tx=0x7f8cb00057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ab4672f68f57c0d server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:06:10.396 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.393+0000 7f8cbbfff640 1 -- 172.21.15.52:0/557495915 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cb400b2d0 con 0x7f8cb0003fa0 2023-11-05T08:06:10.397 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.393+0000 7f8cbbfff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:06:10.397 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.393+0000 7f8cbbfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-05T08:06:10.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.393+0000 7f8cbbfff640 10 monclient: dump: 2023-11-05T08:06:10.398 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:06:10.398 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:06:10.399 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:10.399 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:10.400 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:06:10.400 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:06:10.400 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:06:10.400 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:06:10.401 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:06:10.401 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:06:10.401 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.393+0000 7f8ccb70f640 20 monclient: get_monmap_and_config waiting for monmap|config 2023-11-05T08:06:10.402 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.393+0000 7f8cbbfff640 1 -- 172.21.15.52:0/557495915 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cb400f040 con 0x7f8cb0003fa0 2023-11-05T08:06:10.402 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.393+0000 7f8cbbfff640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:06:10.402 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.393+0000 7f8ccb70f640 10 monclient: get_monmap_and_config success 2023-11-05T08:06:10.402 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.393+0000 7f8ccb70f640 4 set_mon_vals no callback set 2023-11-05T08:06:10.403 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.393+0000 7f8cbbfff640 1 -- 172.21.15.52:0/557495915 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cb40097d0 con 0x7f8cb0003fa0 2023-11-05T08:06:10.403 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.393+0000 7f8cbbfff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:06:10.403 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.393+0000 7f8cbbfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-05T08:06:10.403 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.393+0000 7f8cbbfff640 10 monclient: dump: 2023-11-05T08:06:10.403 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:06:10.404 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:06:10.404 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:10.404 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:10.404 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:06:10.405 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:06:10.405 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:06:10.405 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:06:10.405 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:06:10.405 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:06:10.405 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.394+0000 7f8ccb70f640 10 monclient: shutdown 2023-11-05T08:06:10.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.394+0000 7f8ccb70f640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:06:10.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.394+0000 7f8ccb70f640 1 -- 172.21.15.52:0/557495915 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8cb0003fa0 msgr2=0x7f8cb00047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:06:10.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.394+0000 7f8ccb70f640 1 --2- 172.21.15.52:0/557495915 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8cb0003fa0 0x7f8cb00047c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f8cb4007090 tx=0x7f8cb00057f0 comp rx=0 tx=0).stop 2023-11-05T08:06:10.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.394+0000 7f8cc9cac640 1 -- 172.21.15.52:0/557495915 reap_dead start 2023-11-05T08:06:10.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.394+0000 7f8ccb70f640 1 -- 172.21.15.52:0/557495915 shutdown_connections 2023-11-05T08:06:10.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.394+0000 7f8ccb70f640 1 -- 172.21.15.52:0/557495915 >> 172.21.15.52:0/557495915 conn(0x7f8cc40b7230 msgr2=0x7f8cc40b7610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:06:10.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.394+0000 7f8ccb70f640 1 -- 172.21.15.52:0/557495915 shutdown_connections 2023-11-05T08:06:10.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.394+0000 7f8ccb70f640 1 -- 172.21.15.52:0/557495915 wait complete. 2023-11-05T08:06:10.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.395+0000 7f8ccb70f640 10 monclient: build_initial_monmap 2023-11-05T08:06:10.408 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.395+0000 7f8ccb70f640 10 monclient: monmap: 2023-11-05T08:06:10.408 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:06:10.408 INFO:teuthology.orchestra.run.smithi052.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-05T08:06:10.408 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 0.000000 2023-11-05T08:06:10.408 INFO:teuthology.orchestra.run.smithi052.stderr:created 0.000000 2023-11-05T08:06:10.408 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:06:10.409 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:06:10.409 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.noname-a 2023-11-05T08:06:10.409 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.noname-b 2023-11-05T08:06:10.409 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-c 2023-11-05T08:06:10.409 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:06:10.410 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.395+0000 7f8ccb70f640 1 librados: starting msgr at 2023-11-05T08:06:10.410 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.395+0000 7f8ccb70f640 1 librados: starting objecter 2023-11-05T08:06:10.410 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.395+0000 7f8ccb70f640 1 Processor -- start 2023-11-05T08:06:10.410 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.395+0000 7f8ccb70f640 1 -- start start 2023-11-05T08:06:10.410 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.395+0000 7f8ccb70f640 1 librados: setting wanted keys 2023-11-05T08:06:10.411 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.395+0000 7f8ccb70f640 1 librados: calling monclient init 2023-11-05T08:06:10.411 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.395+0000 7f8ccb70f640 10 monclient: init 2023-11-05T08:06:10.412 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.396+0000 7f8ccb70f640 10 monclient: _reopen_session rank -1 2023-11-05T08:06:10.412 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.396+0000 7f8ccb70f640 10 monclient: _add_conns ranks=[1,2,0] 2023-11-05T08:06:10.412 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.396+0000 7f8ccb70f640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8cb0003fa0 0x7f8cc4134cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:06:10.412 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.396+0000 7f8ccb70f640 10 monclient(hunting): picked mon.noname-b con 0x7f8cb0003fa0 addr [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] 2023-11-05T08:06:10.412 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.396+0000 7f8ccb70f640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8cc4139110 0x7f8cc41d6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:06:10.413 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.396+0000 7f8ccb70f640 10 monclient(hunting): picked mon.noname-c con 0x7f8cc4139110 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:06:10.413 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.396+0000 7f8ccb70f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8cc41d6660 0x7f8cc41d9620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:06:10.413 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.396+0000 7f8ccb70f640 10 monclient(hunting): picked mon.noname-a con 0x7f8cc41d6660 addr [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] 2023-11-05T08:06:10.413 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.396+0000 7f8ccb70f640 10 monclient(hunting): start opening mon connection 2023-11-05T08:06:10.413 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.396+0000 7f8ccb70f640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc41357f0 con 0x7f8cc41d6660 2023-11-05T08:06:10.414 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.396+0000 7f8ccb70f640 10 monclient(hunting): start opening mon connection 2023-11-05T08:06:10.414 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.396+0000 7f8ccb70f640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc4130010 con 0x7f8cb0003fa0 2023-11-05T08:06:10.414 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.396+0000 7f8ccb70f640 10 monclient(hunting): start opening mon connection 2023-11-05T08:06:10.414 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.396+0000 7f8ccb70f640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc4139850 con 0x7f8cc4139110 2023-11-05T08:06:10.414 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.396+0000 7f8ccb70f640 10 monclient(hunting): _renew_subs 2023-11-05T08:06:10.415 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.396+0000 7f8ccb70f640 10 monclient(hunting): authenticate will time out at 1316.602249s 2023-11-05T08:06:10.420 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.419+0000 7f8cc8caa640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8cc4139110 0x7f8cc41d6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:06:10.421 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.420+0000 7f8cc8caa640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8cc4139110 0x7f8cc41d6120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.52:58818/0 (socket says 172.21.15.52:58818) 2023-11-05T08:06:10.422 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.420+0000 7f8cc8caa640 1 -- 172.21.15.52:0/3694497672 learned_addr learned my addr 172.21.15.52:0/3694497672 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-11-05T08:06:10.422 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.420+0000 7f8cc8caa640 10 monclient(hunting): get_auth_request con 0x7f8cc4139110 auth_method 0 2023-11-05T08:06:10.422 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.420+0000 7f8cc8caa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:06:10.422 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.420+0000 7f8cc8caa640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:06:10.423 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.420+0000 7f8cc8caa640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:06:10.423 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.421+0000 7f8cc8caa640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:06:10.423 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.421+0000 7f8cc8caa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:06:10.424 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.421+0000 7f8cc8caa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:06:10.425 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.424+0000 7f8cc8caa640 10 monclient(hunting): handle_auth_done global_id 4103 payload 824 2023-11-05T08:06:10.426 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.424+0000 7f8cc8caa640 1 -- 172.21.15.52:0/3694497672 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8cb0003fa0 msgr2=0x7f8cc4134cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:06:10.426 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.424+0000 7f8cc8caa640 1 --2- 172.21.15.52:0/3694497672 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8cb0003fa0 0x7f8cc4134cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:10.426 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.424+0000 7f8cc8caa640 1 -- 172.21.15.52:0/3694497672 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8cc41d6660 msgr2=0x7f8cc41d9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:06:10.426 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.424+0000 7f8cc8caa640 1 --2- 172.21.15.52:0/3694497672 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8cc41d6660 0x7f8cc41d9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:10.427 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.424+0000 7f8cc8caa640 10 monclient: _finish_hunting 0 2023-11-05T08:06:10.427 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.424+0000 7f8cc8caa640 1 monclient: found mon.noname-c 2023-11-05T08:06:10.427 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.424+0000 7f8cc8caa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:06:10.427 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.424+0000 7f8cc8caa640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.52:3301/0 2023-11-05T08:06:10.427 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.424+0000 7f8cc8caa640 1 -- 172.21.15.52:0/3694497672 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cc4139550 con 0x7f8cc4139110 2023-11-05T08:06:10.428 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.427+0000 7f8cc8caa640 1 --2- 172.21.15.52:0/3694497672 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8cc4139110 0x7f8cc41d6120 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8cb4000ea0 tx=0x7f8cb4005c80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:06:10.428 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.427+0000 7f8cb9ffb640 10 client.?.objecter ms_handle_connect 0x7f8cc4139110 2023-11-05T08:06:10.428 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.427+0000 7f8cb9ffb640 10 client.?.objecter resend_mon_ops 2023-11-05T08:06:10.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.469+0000 7f8cb9ffb640 1 -- 172.21.15.52:0/3694497672 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cb4009770 con 0x7f8cc4139110 2023-11-05T08:06:10.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.469+0000 7f8cb9ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:06:10.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.469+0000 7f8cb9ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-11-05T08:06:10.472 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.469+0000 7f8cb9ffb640 10 monclient: dump: 2023-11-05T08:06:10.472 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:06:10.472 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:06:10.472 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:10.473 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:10.473 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:06:10.473 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:06:10.473 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:06:10.473 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:06:10.473 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:06:10.474 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:06:10.474 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.469+0000 7f8cb9ffb640 10 monclient: _finish_auth 0 2023-11-05T08:06:10.474 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.469+0000 7f8cb9ffb640 10 monclient: _check_auth_tickets 2023-11-05T08:06:10.474 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.469+0000 7f8cb9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:06:10.474 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.469+0000 7f8cb9ffb640 1 -- 172.21.15.52:0/3694497672 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cb4009910 con 0x7f8cc4139110 2023-11-05T08:06:10.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.469+0000 7f8cb9ffb640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:06:10.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.469+0000 7f8cb9ffb640 1 -- 172.21.15.52:0/3694497672 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cb4009cc0 con 0x7f8cc4139110 2023-11-05T08:06:10.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.469+0000 7f8ccb70f640 5 monclient: authenticate success, global_id 4103 2023-11-05T08:06:10.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.469+0000 7f8ccb70f640 10 monclient: _renew_subs 2023-11-05T08:06:10.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.469+0000 7f8ccb70f640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.52:3301/0 2023-11-05T08:06:10.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.469+0000 7f8ccb70f640 1 -- 172.21.15.52:0/3694497672 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cc4141550 con 0x7f8cc4139110 2023-11-05T08:06:10.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.469+0000 7f8cbb7fe640 4 set_mon_vals no callback set 2023-11-05T08:06:10.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.469+0000 7f8cb9ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:06:10.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.469+0000 7f8cb9ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-11-05T08:06:10.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.469+0000 7f8cb9ffb640 10 monclient: dump: 2023-11-05T08:06:10.476 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:06:10.477 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:06:10.477 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:10.477 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:10.478 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:06:10.478 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:06:10.478 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:06:10.478 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:06:10.478 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:06:10.479 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:06:10.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.469+0000 7f8ccb70f640 10 client.4103.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-05T08:06:10.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.469+0000 7f8ccb70f640 10 monclient: _renew_subs 2023-11-05T08:06:10.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.469+0000 7f8ccb70f640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.52:3301/0 2023-11-05T08:06:10.480 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.469+0000 7f8ccb70f640 1 -- 172.21.15.52:0/3694497672 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cc41d6cc0 con 0x7f8cc4139110 2023-11-05T08:06:10.480 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.469+0000 7f8ccb70f640 1 librados: init done 2023-11-05T08:06:10.481 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.470+0000 7f8ccb70f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-05T08:06:10.481 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.470+0000 7f8ccb70f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:06:10.482 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.470+0000 7f8ccb70f640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.52:3301/0 2023-11-05T08:06:10.482 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.470+0000 7f8ccb70f640 1 -- 172.21.15.52:0/3694497672 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cc4139a10 con 0x7f8cc4139110 2023-11-05T08:06:10.700 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.698+0000 7f8cb9ffb640 1 -- 172.21.15.52:0/3694497672 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f8cb402d570 con 0x7f8cc4139110 2023-11-05T08:06:10.700 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.698+0000 7f8cb9ffb640 1 -- 172.21.15.52:0/3694497672 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f8cb4009e20 con 0x7f8cc4139110 2023-11-05T08:06:10.700 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.698+0000 7f8cb9ffb640 10 client.4103.objecter ms_dispatch 0x7f8cc4000b90 osd_map(1..1 src has 1..1) v4 2023-11-05T08:06:10.700 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.698+0000 7f8cb9ffb640 3 client.4103.objecter handle_osd_map got epochs [1,1] > 0 2023-11-05T08:06:10.701 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.698+0000 7f8cb9ffb640 3 client.4103.objecter handle_osd_map decoding full epoch 1 2023-11-05T08:06:10.701 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.698+0000 7f8cb9ffb640 20 client.4103.objecter dump_active .. 0 homeless 2023-11-05T08:06:10.701 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.698+0000 7f8cb9ffb640 1 -- 172.21.15.52:0/3694497672 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f8cb4007d90 con 0x7f8cc4139110 2023-11-05T08:06:10.701 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.698+0000 7f8cb9ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:06:10.701 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.698+0000 7f8cb9ffb640 10 monclient: _finish_command 1 = system:0 2023-11-05T08:06:10.771 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.769+0000 7f8ccb70f640 10 start_mon_command cmd=[{"prefix": "osd crush tunables", "profile": "default"}] 2023-11-05T08:06:10.771 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.769+0000 7f8ccb70f640 10 monclient: _send_command 2 [{"prefix": "osd crush tunables", "profile": "default"}] 2023-11-05T08:06:10.772 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.769+0000 7f8ccb70f640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.52:3301/0 2023-11-05T08:06:10.772 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:10.769+0000 7f8ccb70f640 1 -- 172.21.15.52:0/3694497672 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f8cc41399e0 con 0x7f8cc4139110 2023-11-05T08:06:10.924 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-11-05T08:06:10.923+0000 7f1369430040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-05T08:06:10.974 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-11-05T08:06:10.973+0000 7f1369430040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-05T08:06:11.040 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-11-05T08:06:11.038+0000 7f4a6604a040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-05T08:06:11.096 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-11-05T08:06:11.094+0000 7f4a6604a040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-05T08:06:11.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:11.150+0000 7f8cb9ffb640 1 -- 172.21.15.52:0/3694497672 <== mon.2 v2:172.21.15.52:3301/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f8cb402d9b0 con 0x7f8cc4139110 2023-11-05T08:06:11.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:11.150+0000 7f8cb9ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush tunables", "profile": "default"}] 2023-11-05T08:06:11.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:11.150+0000 7f8cb9ffb640 10 monclient: _finish_command 2 = system:0 adjusted tunables profile to default 2023-11-05T08:06:11.152 INFO:teuthology.orchestra.run.smithi052.stderr:adjusted tunables profile to default 2023-11-05T08:06:11.154 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:11.151+0000 7f8ccb70f640 10 librados: watch_flush enter 2023-11-05T08:06:11.154 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:11.151+0000 7f8ccb70f640 10 librados: watch_flush exit 2023-11-05T08:06:11.154 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:11.151+0000 7f8ccb70f640 20 client.4103.objecter shutdown clearing up homeless session... 2023-11-05T08:06:11.154 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:11.151+0000 7f8ccb70f640 10 client.4103.objecter successfully canceled tick 2023-11-05T08:06:11.154 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:11.151+0000 7f8ccb70f640 10 monclient: shutdown 2023-11-05T08:06:11.155 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:11.151+0000 7f8ccb70f640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:06:11.155 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:11.151+0000 7f8ccb70f640 1 -- 172.21.15.52:0/3694497672 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8cc4139110 msgr2=0x7f8cc41d6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:06:11.155 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:11.151+0000 7f8ccb70f640 1 --2- 172.21.15.52:0/3694497672 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8cc4139110 0x7f8cc41d6120 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8cb4000ea0 tx=0x7f8cb4005c80 comp rx=0 tx=0).stop 2023-11-05T08:06:11.155 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:11.151+0000 7f8ccb70f640 1 -- 172.21.15.52:0/3694497672 shutdown_connections 2023-11-05T08:06:11.155 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:11.151+0000 7f8ccb70f640 1 --2- 172.21.15.52:0/3694497672 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8cc41d6660 0x7f8cc41d9620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:11.156 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:11.151+0000 7f8ccb70f640 1 --2- 172.21.15.52:0/3694497672 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8cc4139110 0x7f8cc41d6120 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:11.156 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:11.151+0000 7f8ccb70f640 1 --2- 172.21.15.52:0/3694497672 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8cb0003fa0 0x7f8cc4134cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:11.156 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:11.151+0000 7f8ccb70f640 1 -- 172.21.15.52:0/3694497672 >> 172.21.15.52:0/3694497672 conn(0x7f8cc40b7230 msgr2=0x7f8cc40b7610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:06:11.156 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:11.151+0000 7f8ccb70f640 1 -- 172.21.15.52:0/3694497672 shutdown_connections 2023-11-05T08:06:11.156 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:11.151+0000 7f8ccb70f640 1 -- 172.21.15.52:0/3694497672 wait complete. 2023-11-05T08:06:11.157 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:11.151+0000 7f8ccb70f640 1 librados: shutdown 2023-11-05T08:06:11.163 INFO:tasks.ceph:check_enable_crimson: False 2023-11-05T08:06:11.164 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-11-05T08:06:11.164 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-11-05T08:06:11.164 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-11-05T08:06:11.197 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-11-05T08:06:11.198 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-11-05T08:06:11.269 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-11-05T08:06:11.270 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-11-05T08:06:11.340 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-11-05T08:06:11.340 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-11-05T08:06:11.411 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-11-05T08:06:11.411 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-11-05T08:06:11.439 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-11-05T08:06:11.439 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-11-05T08:06:11.505 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-11-05T08:06:11.506 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-11-05T08:06:11.526 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-11-05T08:06:11.525+0000 7f1369430040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-05T08:06:11.553 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-11-05T08:06:11.553 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-11-05T08:06:11.582 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-11-05T08:06:11.581+0000 7f1369430040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-05T08:06:11.608 DEBUG:teuthology.orchestra.run.smithi156:> sudo ceph --cluster ceph osd new c95e48e9-832b-4950-b467-9f61d33decc6 0 2023-11-05T08:06:11.629 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-11-05T08:06:11.628+0000 7f1369430040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-05T08:06:11.686 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-11-05T08:06:11.685+0000 7f1369430040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-05T08:06:11.692 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-11-05T08:06:11.690+0000 7f4a6604a040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-05T08:06:11.728 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.727+0000 7fde5034e640 10 monclient: get_monmap_and_config 2023-11-05T08:06:11.729 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.727+0000 7fde5034e640 10 monclient: build_initial_monmap 2023-11-05T08:06:11.729 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.727+0000 7fde5034e640 10 monclient: monmap: 2023-11-05T08:06:11.729 INFO:teuthology.orchestra.run.smithi156.stderr:epoch 0 2023-11-05T08:06:11.729 INFO:teuthology.orchestra.run.smithi156.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:06:11.729 INFO:teuthology.orchestra.run.smithi156.stderr:last_changed 2023-11-05T08:06:11.728769+0000 2023-11-05T08:06:11.730 INFO:teuthology.orchestra.run.smithi156.stderr:created 2023-11-05T08:06:11.728769+0000 2023-11-05T08:06:11.730 INFO:teuthology.orchestra.run.smithi156.stderr:min_mon_release 0 (unknown) 2023-11-05T08:06:11.730 INFO:teuthology.orchestra.run.smithi156.stderr:election_strategy: 1 2023-11-05T08:06:11.730 INFO:teuthology.orchestra.run.smithi156.stderr:0: v1:172.21.15.52:6789/0 mon.noname-a-legacy 2023-11-05T08:06:11.730 INFO:teuthology.orchestra.run.smithi156.stderr:1: v1:172.21.15.156:6789/0 mon.noname-c-legacy 2023-11-05T08:06:11.731 INFO:teuthology.orchestra.run.smithi156.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-b 2023-11-05T08:06:11.731 INFO:teuthology.orchestra.run.smithi156.stderr:3: v2:172.21.15.52:3300/0 mon.noname-a 2023-11-05T08:06:11.731 INFO:teuthology.orchestra.run.smithi156.stderr:4: v2:172.21.15.156:3300/0 mon.noname-c 2023-11-05T08:06:11.731 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-05T08:06:11.732 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.728+0000 7fde5034e640 1 Processor -- start 2023-11-05T08:06:11.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.728+0000 7fde5034e640 1 -- start start 2023-11-05T08:06:11.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.728+0000 7fde5034e640 10 monclient: init 2023-11-05T08:06:11.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.728+0000 7fde5034e640 10 monclient: _reopen_session rank -1 2023-11-05T08:06:11.733 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.728+0000 7fde5034e640 10 monclient: _add_conns ranks=[3,0,2,1,4] 2023-11-05T08:06:11.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.729+0000 7fde5034e640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fde480a8d10 0x7fde4813eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:06:11.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.729+0000 7fde5034e640 10 monclient(hunting): picked mon.noname-a con 0x7fde480a8d10 addr v2:172.21.15.52:3300/0 2023-11-05T08:06:11.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.729+0000 7fde5034e640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fde480a90f0 addr v1:172.21.15.52:6789/0 2023-11-05T08:06:11.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.729+0000 7fde5034e640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fde48141da0 0x7fde48142210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:06:11.734 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.729+0000 7fde5034e640 10 monclient(hunting): picked mon.noname-b con 0x7fde48141da0 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:06:11.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.729+0000 7fde5034e640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde480b1410 con 0x7fde480a90f0 2023-11-05T08:06:11.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.729+0000 7fde5034e640 10 monclient(hunting): start opening mon connection 2023-11-05T08:06:11.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.729+0000 7fde5034e640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde480aa120 con 0x7fde480a8d10 2023-11-05T08:06:11.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.729+0000 7fde5034e640 10 monclient(hunting): start opening mon connection 2023-11-05T08:06:11.735 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.729+0000 7fde5034e640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde480aa400 con 0x7fde48141da0 2023-11-05T08:06:11.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.729+0000 7fde5034e640 10 monclient(hunting): _renew_subs 2023-11-05T08:06:11.736 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.729+0000 7fde5034e640 10 monclient(hunting): authenticate will time out at 1314.948966s 2023-11-05T08:06:11.736 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-11-05T08:06:11.729+0000 7f1369430040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-05T08:06:11.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.729+0000 7fde4e8eb640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fde48141da0 0x7fde48142210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:06:11.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.730+0000 7fde4e8eb640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fde48141da0 0x7fde48142210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.156:46806/0 (socket says 172.21.15.156:46806) 2023-11-05T08:06:11.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.730+0000 7fde4e8eb640 1 -- 172.21.15.156:0/3722378171 learned_addr learned my addr 172.21.15.156:0/3722378171 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-11-05T08:06:11.738 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.730+0000 7fde4e8eb640 10 monclient(hunting): get_auth_request con 0x7fde48141da0 auth_method 0 2023-11-05T08:06:11.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.730+0000 7fde4e8eb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:06:11.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.730+0000 7fde4e8eb640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:06:11.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.730+0000 7fde4e8eb640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:06:11.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.730+0000 7fde4e8eb640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:06:11.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.730+0000 7fde4e8eb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:06:11.739 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.730+0000 7fde4e8eb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:06:11.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.732+0000 7fde4e0ea640 1 --2- 172.21.15.156:0/3722378171 >> v2:172.21.15.52:3300/0 conn(0x7fde480a8d10 0x7fde4813eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:06:11.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.732+0000 7fde4e8eb640 10 monclient(hunting): handle_auth_done global_id 4106 payload 274 2023-11-05T08:06:11.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.732+0000 7fde4e8eb640 1 -- 172.21.15.156:0/3722378171 >> v2:172.21.15.52:3300/0 conn(0x7fde480a8d10 msgr2=0x7fde4813eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-05T08:06:11.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.732+0000 7fde4e8eb640 1 --2- 172.21.15.156:0/3722378171 >> v2:172.21.15.52:3300/0 conn(0x7fde480a8d10 0x7fde4813eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:11.740 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.732+0000 7fde4e8eb640 1 -- 172.21.15.156:0/3722378171 >> v1:172.21.15.52:6789/0 conn(0x7fde480a90f0 legacy=0x7fde4813f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-05T08:06:11.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.733+0000 7fde4e8eb640 10 monclient: _finish_hunting 0 2023-11-05T08:06:11.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.733+0000 7fde4e8eb640 1 monclient: found mon.noname-b 2023-11-05T08:06:11.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.733+0000 7fde4e8eb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:06:11.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.733+0000 7fde4e8eb640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.52:3301/0 2023-11-05T08:06:11.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.733+0000 7fde4e8eb640 1 -- 172.21.15.156:0/3722378171 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde480aa6e0 con 0x7fde48141da0 2023-11-05T08:06:11.741 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.736+0000 7fde4e8eb640 1 --2- 172.21.15.156:0/3722378171 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fde48141da0 0x7fde48142210 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fde40009e50 tx=0x7fde4002be40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a3c9c0899601f5b server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:06:11.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.742+0000 7fde4d0e8640 1 -- 172.21.15.156:0/3722378171 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4002c9e0 con 0x7fde48141da0 2023-11-05T08:06:11.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.742+0000 7fde4d0e8640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:06:11.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.742+0000 7fde4d0e8640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-05T08:06:11.743 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.742+0000 7fde4d0e8640 10 monclient: dump: 2023-11-05T08:06:11.744 INFO:teuthology.orchestra.run.smithi156.stderr:epoch 1 2023-11-05T08:06:11.744 INFO:teuthology.orchestra.run.smithi156.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:06:11.744 INFO:teuthology.orchestra.run.smithi156.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:11.744 INFO:teuthology.orchestra.run.smithi156.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:11.744 INFO:teuthology.orchestra.run.smithi156.stderr:min_mon_release 18 (reef) 2023-11-05T08:06:11.745 INFO:teuthology.orchestra.run.smithi156.stderr:election_strategy: 1 2023-11-05T08:06:11.745 INFO:teuthology.orchestra.run.smithi156.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:06:11.745 INFO:teuthology.orchestra.run.smithi156.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:06:11.745 INFO:teuthology.orchestra.run.smithi156.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:06:11.745 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-05T08:06:11.746 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.742+0000 7fde4d0e8640 10 monclient: _finish_auth 0 2023-11-05T08:06:11.746 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.742+0000 7fde4d0e8640 10 monclient: _check_auth_tickets 2023-11-05T08:06:11.746 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.742+0000 7fde4d0e8640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:06:11.746 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.742+0000 7fde4d0e8640 1 -- 172.21.15.156:0/3722378171 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde4002cb40 con 0x7fde48141da0 2023-11-05T08:06:11.746 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.742+0000 7fde4d0e8640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:06:11.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.742+0000 7fde4d0e8640 1 -- 172.21.15.156:0/3722378171 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde400343f0 con 0x7fde48141da0 2023-11-05T08:06:11.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.742+0000 7fde5034e640 5 monclient: authenticate success, global_id 4106 2023-11-05T08:06:11.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.742+0000 7fde5034e640 10 monclient: get_monmap_and_config success 2023-11-05T08:06:11.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.742+0000 7fde5034e640 4 set_mon_vals no callback set 2023-11-05T08:06:11.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.742+0000 7fde4d0e8640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:06:11.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.742+0000 7fde4d0e8640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-11-05T08:06:11.748 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.742+0000 7fde4d0e8640 10 monclient: dump: 2023-11-05T08:06:11.748 INFO:teuthology.orchestra.run.smithi156.stderr:epoch 1 2023-11-05T08:06:11.748 INFO:teuthology.orchestra.run.smithi156.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:06:11.748 INFO:teuthology.orchestra.run.smithi156.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:11.748 INFO:teuthology.orchestra.run.smithi156.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:11.749 INFO:teuthology.orchestra.run.smithi156.stderr:min_mon_release 18 (reef) 2023-11-05T08:06:11.749 INFO:teuthology.orchestra.run.smithi156.stderr:election_strategy: 1 2023-11-05T08:06:11.749 INFO:teuthology.orchestra.run.smithi156.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:06:11.749 INFO:teuthology.orchestra.run.smithi156.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:06:11.749 INFO:teuthology.orchestra.run.smithi156.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:06:11.750 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-05T08:06:11.751 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-11-05T08:06:11.748+0000 7f4a6604a040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-05T08:06:11.753 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.743+0000 7fde5034e640 10 monclient: shutdown 2023-11-05T08:06:11.754 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.743+0000 7fde5034e640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:06:11.754 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.743+0000 7fde5034e640 1 -- 172.21.15.156:0/3722378171 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fde48141da0 msgr2=0x7fde48142210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:06:11.754 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.743+0000 7fde5034e640 1 --2- 172.21.15.156:0/3722378171 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fde48141da0 0x7fde48142210 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fde40009e50 tx=0x7fde4002be40 comp rx=0 tx=0).stop 2023-11-05T08:06:11.754 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.743+0000 7fde5034e640 1 -- 172.21.15.156:0/3722378171 shutdown_connections 2023-11-05T08:06:11.755 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.743+0000 7fde5034e640 1 --2- 172.21.15.156:0/3722378171 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fde48141da0 0x7fde48142210 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:11.755 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.743+0000 7fde5034e640 1 --2- 172.21.15.156:0/3722378171 >> v2:172.21.15.52:3300/0 conn(0x7fde480a8d10 0x7fde4813eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:11.755 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.743+0000 7fde5034e640 1 -- 172.21.15.156:0/3722378171 >> 172.21.15.156:0/3722378171 conn(0x7fde480b7230 msgr2=0x7fde480b7640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:06:11.755 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.743+0000 7fde5034e640 1 -- 172.21.15.156:0/3722378171 shutdown_connections 2023-11-05T08:06:11.755 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.743+0000 7fde5034e640 1 -- 172.21.15.156:0/3722378171 wait complete. 2023-11-05T08:06:11.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.743+0000 7fde5034e640 10 monclient: build_initial_monmap 2023-11-05T08:06:11.756 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.743+0000 7fde5034e640 10 monclient: monmap: 2023-11-05T08:06:11.756 INFO:teuthology.orchestra.run.smithi156.stderr:epoch 0 2023-11-05T08:06:11.756 INFO:teuthology.orchestra.run.smithi156.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-05T08:06:11.756 INFO:teuthology.orchestra.run.smithi156.stderr:last_changed 0.000000 2023-11-05T08:06:11.756 INFO:teuthology.orchestra.run.smithi156.stderr:created 0.000000 2023-11-05T08:06:11.757 INFO:teuthology.orchestra.run.smithi156.stderr:min_mon_release 0 (unknown) 2023-11-05T08:06:11.757 INFO:teuthology.orchestra.run.smithi156.stderr:election_strategy: 1 2023-11-05T08:06:11.757 INFO:teuthology.orchestra.run.smithi156.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.noname-a 2023-11-05T08:06:11.757 INFO:teuthology.orchestra.run.smithi156.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.noname-b 2023-11-05T08:06:11.757 INFO:teuthology.orchestra.run.smithi156.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-c 2023-11-05T08:06:11.758 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-05T08:06:11.758 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.744+0000 7fde5034e640 1 librados: starting msgr at 2023-11-05T08:06:11.758 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.744+0000 7fde5034e640 1 librados: starting objecter 2023-11-05T08:06:11.758 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.744+0000 7fde5034e640 1 Processor -- start 2023-11-05T08:06:11.758 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.744+0000 7fde5034e640 1 -- start start 2023-11-05T08:06:11.759 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.744+0000 7fde5034e640 1 librados: setting wanted keys 2023-11-05T08:06:11.759 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.744+0000 7fde5034e640 1 librados: calling monclient init 2023-11-05T08:06:11.759 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.744+0000 7fde5034e640 10 monclient: init 2023-11-05T08:06:11.759 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.744+0000 7fde5034e640 10 monclient: _reopen_session rank -1 2023-11-05T08:06:11.759 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.744+0000 7fde5034e640 10 monclient: _add_conns ranks=[1,2,0] 2023-11-05T08:06:11.759 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.744+0000 7fde5034e640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fde480a8d10 0x7fde480ab410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:06:11.760 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.744+0000 7fde5034e640 10 monclient(hunting): picked mon.noname-b con 0x7fde480a8d10 addr [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] 2023-11-05T08:06:11.760 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.744+0000 7fde5034e640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fde480a90f0 0x7fde4813bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:06:11.760 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.744+0000 7fde5034e640 10 monclient(hunting): picked mon.noname-c con 0x7fde480a90f0 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:06:11.760 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.744+0000 7fde5034e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde48141da0 0x7fde481d70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:06:11.760 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.744+0000 7fde5034e640 10 monclient(hunting): picked mon.noname-a con 0x7fde48141da0 addr [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] 2023-11-05T08:06:11.761 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.744+0000 7fde5034e640 10 monclient(hunting): start opening mon connection 2023-11-05T08:06:11.761 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.744+0000 7fde5034e640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde481d6c40 con 0x7fde48141da0 2023-11-05T08:06:11.761 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.744+0000 7fde5034e640 10 monclient(hunting): start opening mon connection 2023-11-05T08:06:11.761 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.744+0000 7fde5034e640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde4813ae40 con 0x7fde480a8d10 2023-11-05T08:06:11.761 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.744+0000 7fde5034e640 10 monclient(hunting): start opening mon connection 2023-11-05T08:06:11.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.744+0000 7fde5034e640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde480aab00 con 0x7fde480a90f0 2023-11-05T08:06:11.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.744+0000 7fde5034e640 10 monclient(hunting): _renew_subs 2023-11-05T08:06:11.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.744+0000 7fde5034e640 10 monclient(hunting): authenticate will time out at 1314.964815s 2023-11-05T08:06:11.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.745+0000 7fde4e0ea640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fde480a8d10 0x7fde480ab410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:06:11.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.745+0000 7fde4d8e9640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fde480a90f0 0x7fde4813bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:06:11.762 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.745+0000 7fde4d8e9640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fde480a90f0 0x7fde4813bcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.156:46810/0 (socket says 172.21.15.156:46810) 2023-11-05T08:06:11.763 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.745+0000 7fde4d8e9640 1 -- 172.21.15.156:0/4071916023 learned_addr learned my addr 172.21.15.156:0/4071916023 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-11-05T08:06:11.763 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.745+0000 7fde4d8e9640 10 monclient(hunting): get_auth_request con 0x7fde480a90f0 auth_method 0 2023-11-05T08:06:11.763 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.745+0000 7fde4d8e9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:06:11.763 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.745+0000 7fde4d8e9640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:06:11.763 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.745+0000 7fde4d8e9640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:06:11.764 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.745+0000 7fde4e0ea640 10 monclient(hunting): get_auth_request con 0x7fde480a8d10 auth_method 0 2023-11-05T08:06:11.764 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.745+0000 7fde4e0ea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:06:11.764 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.745+0000 7fde4e0ea640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:06:11.764 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.745+0000 7fde4e0ea640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:06:11.764 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.746+0000 7fde4d8e9640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:06:11.764 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.746+0000 7fde4d8e9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:06:11.765 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.746+0000 7fde4d8e9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:06:11.765 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.746+0000 7fde4e0ea640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:06:11.765 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.746+0000 7fde4e0ea640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:06:11.765 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.746+0000 7fde4e0ea640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:06:11.765 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.749+0000 7fde4d8e9640 10 monclient(hunting): handle_auth_done global_id 4109 payload 824 2023-11-05T08:06:11.766 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.749+0000 7fde4d8e9640 1 -- 172.21.15.156:0/4071916023 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fde480a8d10 msgr2=0x7fde480ab410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:06:11.766 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.749+0000 7fde4d8e9640 1 --2- 172.21.15.156:0/4071916023 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fde480a8d10 0x7fde480ab410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:11.766 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.749+0000 7fde4d8e9640 1 -- 172.21.15.156:0/4071916023 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde48141da0 msgr2=0x7fde481d70d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:06:11.766 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.749+0000 7fde4d8e9640 1 --2- 172.21.15.156:0/4071916023 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde48141da0 0x7fde481d70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:11.766 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.749+0000 7fde4d8e9640 10 monclient: _finish_hunting 0 2023-11-05T08:06:11.767 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.749+0000 7fde4d8e9640 1 monclient: found mon.noname-c 2023-11-05T08:06:11.767 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.749+0000 7fde4d8e9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:06:11.767 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.749+0000 7fde4d8e9640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.52:3301/0 2023-11-05T08:06:11.767 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.749+0000 7fde4d8e9640 1 -- 172.21.15.156:0/4071916023 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde40009b30 con 0x7fde480a90f0 2023-11-05T08:06:11.767 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.751+0000 7fde4d8e9640 1 --2- 172.21.15.156:0/4071916023 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fde480a90f0 0x7fde4813bcd0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fde3800c410 tx=0x7fde3800c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:06:11.767 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.751+0000 7fde3effd640 10 client.?.objecter ms_handle_connect 0x7fde480a90f0 2023-11-05T08:06:11.768 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.751+0000 7fde3effd640 10 client.?.objecter resend_mon_ops 2023-11-05T08:06:11.769 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.755+0000 7fde3effd640 1 -- 172.21.15.156:0/4071916023 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde380035f0 con 0x7fde480a90f0 2023-11-05T08:06:11.769 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.755+0000 7fde3effd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:06:11.769 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.755+0000 7fde3effd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-11-05T08:06:11.770 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.755+0000 7fde3effd640 10 monclient: dump: 2023-11-05T08:06:11.770 INFO:teuthology.orchestra.run.smithi156.stderr:epoch 1 2023-11-05T08:06:11.770 INFO:teuthology.orchestra.run.smithi156.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:06:11.770 INFO:teuthology.orchestra.run.smithi156.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:11.770 INFO:teuthology.orchestra.run.smithi156.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:11.771 INFO:teuthology.orchestra.run.smithi156.stderr:min_mon_release 18 (reef) 2023-11-05T08:06:11.771 INFO:teuthology.orchestra.run.smithi156.stderr:election_strategy: 1 2023-11-05T08:06:11.771 INFO:teuthology.orchestra.run.smithi156.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:06:11.771 INFO:teuthology.orchestra.run.smithi156.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:06:11.771 INFO:teuthology.orchestra.run.smithi156.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:06:11.771 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-05T08:06:11.772 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.755+0000 7fde3effd640 10 monclient: _finish_auth 0 2023-11-05T08:06:11.772 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.755+0000 7fde3effd640 10 monclient: _check_auth_tickets 2023-11-05T08:06:11.772 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.755+0000 7fde3effd640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:06:11.772 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.755+0000 7fde3effd640 1 -- 172.21.15.156:0/4071916023 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde38003770 con 0x7fde480a90f0 2023-11-05T08:06:11.772 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.755+0000 7fde3effd640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:06:11.773 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.755+0000 7fde3effd640 1 -- 172.21.15.156:0/4071916023 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde38003b20 con 0x7fde480a90f0 2023-11-05T08:06:11.773 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.755+0000 7fde5034e640 5 monclient: authenticate success, global_id 4109 2023-11-05T08:06:11.773 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.755+0000 7fde5034e640 10 monclient: _renew_subs 2023-11-05T08:06:11.773 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.755+0000 7fde5034e640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.52:3301/0 2023-11-05T08:06:11.773 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.755+0000 7fde5034e640 1 -- 172.21.15.156:0/4071916023 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde48139110 con 0x7fde480a90f0 2023-11-05T08:06:11.773 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.755+0000 7fde4c8e7640 4 set_mon_vals no callback set 2023-11-05T08:06:11.774 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.755+0000 7fde3effd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:06:11.774 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.755+0000 7fde3effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-11-05T08:06:11.774 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.755+0000 7fde3effd640 10 monclient: dump: 2023-11-05T08:06:11.774 INFO:teuthology.orchestra.run.smithi156.stderr:epoch 1 2023-11-05T08:06:11.775 INFO:teuthology.orchestra.run.smithi156.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:06:11.775 INFO:teuthology.orchestra.run.smithi156.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:11.775 INFO:teuthology.orchestra.run.smithi156.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:11.775 INFO:teuthology.orchestra.run.smithi156.stderr:min_mon_release 18 (reef) 2023-11-05T08:06:11.775 INFO:teuthology.orchestra.run.smithi156.stderr:election_strategy: 1 2023-11-05T08:06:11.776 INFO:teuthology.orchestra.run.smithi156.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:06:11.776 INFO:teuthology.orchestra.run.smithi156.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:06:11.776 INFO:teuthology.orchestra.run.smithi156.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:06:11.776 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-05T08:06:11.776 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.755+0000 7fde5034e640 10 client.4109.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-05T08:06:11.776 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.755+0000 7fde5034e640 10 monclient: _renew_subs 2023-11-05T08:06:11.777 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.755+0000 7fde5034e640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.52:3301/0 2023-11-05T08:06:11.777 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.755+0000 7fde5034e640 1 -- 172.21.15.156:0/4071916023 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde481d77f0 con 0x7fde480a90f0 2023-11-05T08:06:11.777 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.755+0000 7fde5034e640 1 librados: init done 2023-11-05T08:06:11.777 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.756+0000 7fde5034e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-05T08:06:11.777 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.756+0000 7fde5034e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:06:11.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.756+0000 7fde5034e640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.52:3301/0 2023-11-05T08:06:11.778 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.756+0000 7fde5034e640 1 -- 172.21.15.156:0/4071916023 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde481392d0 con 0x7fde480a90f0 2023-11-05T08:06:11.799 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-11-05T08:06:11.798+0000 7f4a6604a040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-05T08:06:11.838 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-11-05T08:06:11.837+0000 7f1369430040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-11-05T08:06:11.855 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-11-05T08:06:11.854+0000 7f4a6604a040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-05T08:06:11.869 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.869+0000 7fde3effd640 1 -- 172.21.15.156:0/4071916023 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fde3801c440 con 0x7fde480a90f0 2023-11-05T08:06:11.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.876+0000 7fde3effd640 1 -- 172.21.15.156:0/4071916023 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7fde38012780 con 0x7fde480a90f0 2023-11-05T08:06:11.878 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.876+0000 7fde3effd640 10 client.4109.objecter ms_dispatch 0x7fde48000b90 osd_map(2..2 src has 1..2) v4 2023-11-05T08:06:11.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.876+0000 7fde3effd640 3 client.4109.objecter handle_osd_map got epochs [2,2] > 0 2023-11-05T08:06:11.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.876+0000 7fde3effd640 3 client.4109.objecter handle_osd_map decoding full epoch 2 2023-11-05T08:06:11.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.876+0000 7fde3effd640 20 client.4109.objecter dump_active .. 0 homeless 2023-11-05T08:06:11.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.876+0000 7fde3effd640 1 -- 172.21.15.156:0/4071916023 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fde38017070 con 0x7fde480a90f0 2023-11-05T08:06:11.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.876+0000 7fde3effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:06:11.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.876+0000 7fde3effd640 10 monclient: _finish_command 1 = system:0 2023-11-05T08:06:11.903 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-11-05T08:06:11.902+0000 7f4a6604a040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-05T08:06:11.908 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-11-05T08:06:11.908+0000 7f1369430040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-05T08:06:11.949 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.948+0000 7fde5034e640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "c95e48e9-832b-4950-b467-9f61d33decc6", "id": 0}] 2023-11-05T08:06:11.949 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.948+0000 7fde5034e640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "c95e48e9-832b-4950-b467-9f61d33decc6", "id": 0}] 2023-11-05T08:06:11.950 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.948+0000 7fde5034e640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.52:3301/0 2023-11-05T08:06:11.950 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:11.948+0000 7fde5034e640 1 -- 172.21.15.156:0/4071916023 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "osd new", "uuid": "c95e48e9-832b-4950-b467-9f61d33decc6", "id": 0} v 0) v1 -- 0x7fde4804e9f0 con 0x7fde480a90f0 2023-11-05T08:06:11.955 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-11-05T08:06:11.955+0000 7f1369430040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-05T08:06:12.007 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-11-05T08:06:12.006+0000 7f1369430040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-05T08:06:12.010 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-11-05T08:06:12.008+0000 7f4a6604a040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-11-05T08:06:12.054 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-11-05T08:06:12.053+0000 7f1369430040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-05T08:06:12.091 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-11-05T08:06:12.089+0000 7f4a6604a040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-05T08:06:12.113 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.112+0000 7fde3effd640 1 -- 172.21.15.156:0/4071916023 <== mon.2 v2:172.21.15.52:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c95e48e9-832b-4950-b467-9f61d33decc6", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fde38012a70 con 0x7fde480a90f0 2023-11-05T08:06:12.113 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.112+0000 7fde3effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "c95e48e9-832b-4950-b467-9f61d33decc6", "id": 0}] 2023-11-05T08:06:12.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.112+0000 7fde3effd640 10 monclient: _finish_command 2 = system:0 2023-11-05T08:06:12.114 INFO:teuthology.orchestra.run.smithi156.stdout:0 2023-11-05T08:06:12.116 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.112+0000 7fde5034e640 10 librados: watch_flush enter 2023-11-05T08:06:12.116 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.112+0000 7fde5034e640 10 librados: watch_flush exit 2023-11-05T08:06:12.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.112+0000 7fde5034e640 20 client.4109.objecter shutdown clearing up homeless session... 2023-11-05T08:06:12.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.112+0000 7fde5034e640 10 client.4109.objecter successfully canceled tick 2023-11-05T08:06:12.118 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.113+0000 7fde5034e640 10 monclient: shutdown 2023-11-05T08:06:12.118 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.113+0000 7fde5034e640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:06:12.118 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.113+0000 7fde5034e640 1 -- 172.21.15.156:0/4071916023 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fde480a90f0 msgr2=0x7fde4813bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:06:12.118 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.113+0000 7fde5034e640 1 --2- 172.21.15.156:0/4071916023 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fde480a90f0 0x7fde4813bcd0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fde3800c410 tx=0x7fde3800c8d0 comp rx=0 tx=0).stop 2023-11-05T08:06:12.119 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.113+0000 7fde5034e640 1 -- 172.21.15.156:0/4071916023 shutdown_connections 2023-11-05T08:06:12.119 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.113+0000 7fde5034e640 1 --2- 172.21.15.156:0/4071916023 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde48141da0 0x7fde481d70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:12.119 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.113+0000 7fde5034e640 1 --2- 172.21.15.156:0/4071916023 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fde480a90f0 0x7fde4813bcd0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:12.119 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.113+0000 7fde5034e640 1 --2- 172.21.15.156:0/4071916023 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fde480a8d10 0x7fde480ab410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:12.120 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.113+0000 7fde5034e640 1 -- 172.21.15.156:0/4071916023 >> 172.21.15.156:0/4071916023 conn(0x7fde480b7230 msgr2=0x7fde480b2a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:06:12.120 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.113+0000 7fde5034e640 1 -- 172.21.15.156:0/4071916023 shutdown_connections 2023-11-05T08:06:12.120 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.113+0000 7fde5034e640 1 -- 172.21.15.156:0/4071916023 wait complete. 2023-11-05T08:06:12.120 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.113+0000 7fde5034e640 1 librados: shutdown 2023-11-05T08:06:12.124 DEBUG:teuthology.orchestra.run.smithi156:> sudo ceph --cluster ceph osd new 82d5dd13-f1f5-4282-8ec8-4d6c273a42c7 1 2023-11-05T08:06:12.141 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-11-05T08:06:12.140+0000 7f4a6604a040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-05T08:06:12.197 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-11-05T08:06:12.195+0000 7f4a6604a040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-05T08:06:12.224 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.223+0000 7ff64b04f640 10 monclient: get_monmap_and_config 2023-11-05T08:06:12.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.223+0000 7ff64b04f640 10 monclient: build_initial_monmap 2023-11-05T08:06:12.225 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.223+0000 7ff64b04f640 10 monclient: monmap: 2023-11-05T08:06:12.225 INFO:teuthology.orchestra.run.smithi156.stderr:epoch 0 2023-11-05T08:06:12.225 INFO:teuthology.orchestra.run.smithi156.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:06:12.225 INFO:teuthology.orchestra.run.smithi156.stderr:last_changed 2023-11-05T08:06:12.224741+0000 2023-11-05T08:06:12.226 INFO:teuthology.orchestra.run.smithi156.stderr:created 2023-11-05T08:06:12.224741+0000 2023-11-05T08:06:12.226 INFO:teuthology.orchestra.run.smithi156.stderr:min_mon_release 0 (unknown) 2023-11-05T08:06:12.226 INFO:teuthology.orchestra.run.smithi156.stderr:election_strategy: 1 2023-11-05T08:06:12.226 INFO:teuthology.orchestra.run.smithi156.stderr:0: v1:172.21.15.52:6789/0 mon.noname-a-legacy 2023-11-05T08:06:12.226 INFO:teuthology.orchestra.run.smithi156.stderr:1: v1:172.21.15.156:6789/0 mon.noname-c-legacy 2023-11-05T08:06:12.227 INFO:teuthology.orchestra.run.smithi156.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-b 2023-11-05T08:06:12.227 INFO:teuthology.orchestra.run.smithi156.stderr:3: v2:172.21.15.52:3300/0 mon.noname-a 2023-11-05T08:06:12.227 INFO:teuthology.orchestra.run.smithi156.stderr:4: v2:172.21.15.156:3300/0 mon.noname-c 2023-11-05T08:06:12.227 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-05T08:06:12.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.224+0000 7ff64b04f640 1 Processor -- start 2023-11-05T08:06:12.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.224+0000 7ff64b04f640 1 -- start start 2023-11-05T08:06:12.229 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.224+0000 7ff64b04f640 10 monclient: init 2023-11-05T08:06:12.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.224+0000 7ff64b04f640 10 monclient: _reopen_session rank -1 2023-11-05T08:06:12.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.225+0000 7ff64b04f640 10 monclient: _add_conns ranks=[1,3,0,2,4] 2023-11-05T08:06:12.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.225+0000 7ff64b04f640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7ff6440a8b30 addr v1:172.21.15.156:6789/0 2023-11-05T08:06:12.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.225+0000 7ff64b04f640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff64413f170 0x7ff6440a8f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:06:12.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.225+0000 7ff64b04f640 10 monclient(hunting): picked mon.noname-a con 0x7ff64413f170 addr v2:172.21.15.52:3300/0 2023-11-05T08:06:12.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.225+0000 7ff64b04f640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7ff644141c60 addr v1:172.21.15.52:6789/0 2023-11-05T08:06:12.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.225+0000 7ff64b04f640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff64413f5c0 con 0x7ff644141c60 2023-11-05T08:06:12.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.225+0000 7ff64b04f640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6440b1670 con 0x7ff6440a8b30 2023-11-05T08:06:12.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.225+0000 7ff64b04f640 10 monclient(hunting): start opening mon connection 2023-11-05T08:06:12.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.225+0000 7ff64b04f640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6440aa420 con 0x7ff64413f170 2023-11-05T08:06:12.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.225+0000 7ff64b04f640 10 monclient(hunting): _renew_subs 2023-11-05T08:06:12.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.225+0000 7ff64b04f640 10 monclient(hunting): authenticate will time out at 1315.445012s 2023-11-05T08:06:12.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.226+0000 7ff643fff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff64413f170 0x7ff6440a8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:06:12.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.227+0000 7ff6495ec640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7ff644141c60 0x7ff6441420f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.156:58160/0 (socket says 172.21.15.156:58160) 2023-11-05T08:06:12.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.227+0000 7ff6495ec640 1 -- 172.21.15.156:0/3140002007 learned_addr learned my addr 172.21.15.156:0/3140002007 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-11-05T08:06:12.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.227+0000 7ff643fff640 10 monclient(hunting): get_auth_request con 0x7ff64413f170 auth_method 0 2023-11-05T08:06:12.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.227+0000 7ff643fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:06:12.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.227+0000 7ff643fff640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:06:12.234 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.227+0000 7ff643fff640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:06:12.235 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.234+0000 7ff6437fe640 1 -- 172.21.15.156:0/3140002007 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2771092018 0 0) 0x7ff6440b1670 con 0x7ff6440a8b30 2023-11-05T08:06:12.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.234+0000 7ff6437fe640 10 monclient(hunting): _negotiate 2023-11-05T08:06:12.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.234+0000 7ff6437fe640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:06:12.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.234+0000 7ff6437fe640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:06:12.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.234+0000 7ff6437fe640 10 monclient(hunting): my global_id is 4117 2023-11-05T08:06:12.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.234+0000 7ff6437fe640 1 -- 172.21.15.156:0/3140002007 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff634003520 con 0x7ff6440a8b30 2023-11-05T08:06:12.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.238+0000 7ff6437fe640 1 -- 172.21.15.156:0/3140002007 <== mon.1 v1:172.21.15.156:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2796647467 0 0) 0x7ff634003520 con 0x7ff6440a8b30 2023-11-05T08:06:12.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.238+0000 7ff6437fe640 1 -- 172.21.15.156:0/3140002007 >> v2:172.21.15.52:3300/0 conn(0x7ff64413f170 msgr2=0x7ff6440a8f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-05T08:06:12.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.238+0000 7ff6437fe640 1 --2- 172.21.15.156:0/3140002007 >> v2:172.21.15.52:3300/0 conn(0x7ff64413f170 0x7ff6440a8f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:12.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.238+0000 7ff6437fe640 1 -- 172.21.15.156:0/3140002007 >> v1:172.21.15.52:6789/0 conn(0x7ff644141c60 legacy=0x7ff6441420f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:06:12.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.238+0000 7ff6437fe640 10 monclient: _finish_hunting 0 2023-11-05T08:06:12.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.238+0000 7ff6437fe640 1 monclient: found mon.noname-c-legacy 2023-11-05T08:06:12.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.238+0000 7ff6437fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:06:12.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.238+0000 7ff6437fe640 10 monclient: _send_mon_message to mon.noname-c-legacy at v1:172.21.15.156:6789/0 2023-11-05T08:06:12.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.238+0000 7ff6437fe640 1 -- 172.21.15.156:0/3140002007 --> v1:172.21.15.156:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6440b80e0 con 0x7ff6440a8b30 2023-11-05T08:06:12.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.238+0000 7ff6437fe640 10 monclient: _finish_auth 0 2023-11-05T08:06:12.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.238+0000 7ff6437fe640 10 monclient: _check_auth_tickets 2023-11-05T08:06:12.243 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.238+0000 7ff6437fe640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:06:12.244 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.238+0000 7ff6437fe640 1 -- 172.21.15.156:0/3140002007 <== mon.1 v1:172.21.15.156:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2979872170 0 0) 0x7ff638001690 con 0x7ff6440a8b30 2023-11-05T08:06:12.244 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.238+0000 7ff64b04f640 5 monclient: authenticate success, global_id 4117 2023-11-05T08:06:12.244 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.238+0000 7ff64b04f640 20 monclient: get_monmap_and_config waiting for monmap|config 2023-11-05T08:06:12.245 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.238+0000 7ff6437fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:06:12.245 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.238+0000 7ff6437fe640 10 monclient: got monmap 1 from mon.noname-c-legacy (according to old e1) 2023-11-05T08:06:12.245 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.238+0000 7ff6437fe640 10 monclient: dump: 2023-11-05T08:06:12.246 INFO:teuthology.orchestra.run.smithi156.stderr:epoch 1 2023-11-05T08:06:12.246 INFO:teuthology.orchestra.run.smithi156.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:06:12.246 INFO:teuthology.orchestra.run.smithi156.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:12.246 INFO:teuthology.orchestra.run.smithi156.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:12.246 INFO:teuthology.orchestra.run.smithi156.stderr:min_mon_release 18 (reef) 2023-11-05T08:06:12.247 INFO:teuthology.orchestra.run.smithi156.stderr:election_strategy: 1 2023-11-05T08:06:12.247 INFO:teuthology.orchestra.run.smithi156.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:06:12.247 INFO:teuthology.orchestra.run.smithi156.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:06:12.247 INFO:teuthology.orchestra.run.smithi156.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:06:12.248 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-05T08:06:12.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.238+0000 7ff6437fe640 1 monclient: mon.b has (v2) addrs [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] but i'm connected to v1:172.21.15.156:6789/0, reconnecting 2023-11-05T08:06:12.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.238+0000 7ff6437fe640 10 monclient: _reopen_session rank -1 2023-11-05T08:06:12.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.238+0000 7ff6437fe640 1 -- 172.21.15.156:0/3140002007 >> v1:172.21.15.156:6789/0 conn(0x7ff6440a8b30 legacy=0x7ff64413ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:06:12.248 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.238+0000 7ff6437fe640 10 monclient: _add_conns ranks=[2,0,1] 2023-11-05T08:06:12.249 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.238+0000 7ff6437fe640 1 --2- 172.21.15.156:0/3140002007 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff6340039c0 0x7ff634003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:06:12.249 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.238+0000 7ff6437fe640 10 monclient(hunting): picked mon.c con 0x7ff6340039c0 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:06:12.249 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.238+0000 7ff6437fe640 1 --2- 172.21.15.156:0/3140002007 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff6340047c0 0x7ff634004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:06:12.249 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.238+0000 7ff6437fe640 10 monclient(hunting): picked mon.a con 0x7ff6340047c0 addr [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] 2023-11-05T08:06:12.249 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.238+0000 7ff6437fe640 1 --2- 172.21.15.156:0/3140002007 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff6340052a0 0x7ff63400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:06:12.250 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.238+0000 7ff6437fe640 10 monclient(hunting): picked mon.b con 0x7ff6340052a0 addr [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] 2023-11-05T08:06:12.250 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.238+0000 7ff6437fe640 10 monclient(hunting): start opening mon connection 2023-11-05T08:06:12.250 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.238+0000 7ff6437fe640 1 -- 172.21.15.156:0/3140002007 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6440aa420 con 0x7ff6340047c0 2023-11-05T08:06:12.250 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.238+0000 7ff6437fe640 10 monclient(hunting): start opening mon connection 2023-11-05T08:06:12.251 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.238+0000 7ff6437fe640 1 -- 172.21.15.156:0/3140002007 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff63400c1c0 con 0x7ff6340052a0 2023-11-05T08:06:12.251 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.238+0000 7ff6437fe640 10 monclient(hunting): start opening mon connection 2023-11-05T08:06:12.251 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.238+0000 7ff6437fe640 1 -- 172.21.15.156:0/3140002007 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff63400c380 con 0x7ff6340039c0 2023-11-05T08:06:12.251 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.238+0000 7ff6437fe640 10 monclient(hunting): _renew_subs 2023-11-05T08:06:12.251 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.238+0000 7ff6437fe640 10 monclient(hunting): _finish_auth 0 2023-11-05T08:06:12.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.238+0000 7ff64b04f640 20 monclient(hunting): get_monmap_and_config waiting for monmap|config 2023-11-05T08:06:12.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.238+0000 7ff648deb640 1 --2- 172.21.15.156:0/3140002007 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff6340039c0 0x7ff634003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:06:12.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.239+0000 7ff648deb640 10 monclient(hunting): get_auth_request con 0x7ff6340039c0 auth_method 0 2023-11-05T08:06:12.252 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.239+0000 7ff648deb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:06:12.253 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.239+0000 7ff648deb640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:06:12.253 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.239+0000 7ff648deb640 10 monclient(hunting): _init_auth already have auth, reseting 2023-11-05T08:06:12.253 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.240+0000 7ff648deb640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:06:12.254 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.240+0000 7ff648deb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:06:12.254 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.240+0000 7ff648deb640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2023-11-05T08:06:12.254 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.240+0000 7ff6495ec640 1 --2- 172.21.15.156:0/3140002007 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff6340052a0 0x7ff63400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:06:12.255 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-11-05T08:06:12.248+0000 7f4a6604a040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-05T08:06:12.260 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.241+0000 7ff6495ec640 10 monclient(hunting): get_auth_request con 0x7ff6340052a0 auth_method 0 2023-11-05T08:06:12.260 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.241+0000 7ff6495ec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:06:12.260 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.241+0000 7ff6495ec640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:06:12.260 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.241+0000 7ff6495ec640 10 monclient(hunting): _init_auth already have auth, reseting 2023-11-05T08:06:12.260 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.242+0000 7ff6495ec640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:06:12.261 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.242+0000 7ff6495ec640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:06:12.261 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.242+0000 7ff6495ec640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2023-11-05T08:06:12.261 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.242+0000 7ff648deb640 10 monclient(hunting): handle_auth_done global_id 4117 payload 293 2023-11-05T08:06:12.261 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.242+0000 7ff648deb640 1 -- 172.21.15.156:0/3140002007 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff6340052a0 msgr2=0x7ff63400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-05T08:06:12.261 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.242+0000 7ff648deb640 1 --2- 172.21.15.156:0/3140002007 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff6340052a0 0x7ff63400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:12.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.242+0000 7ff648deb640 1 -- 172.21.15.156:0/3140002007 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff6340047c0 msgr2=0x7ff634004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-05T08:06:12.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.242+0000 7ff648deb640 1 --2- 172.21.15.156:0/3140002007 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff6340047c0 0x7ff634004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:12.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.242+0000 7ff648deb640 10 monclient: _finish_hunting 0 2023-11-05T08:06:12.262 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.242+0000 7ff648deb640 1 monclient: found mon.c 2023-11-05T08:06:12.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.242+0000 7ff648deb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:06:12.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.242+0000 7ff648deb640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.52:3301/0 2023-11-05T08:06:12.263 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.242+0000 7ff648deb640 1 -- 172.21.15.156:0/3140002007 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff634003520 con 0x7ff6340039c0 2023-11-05T08:06:12.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.242+0000 7ff648deb640 10 monclient: _finish_auth 0 2023-11-05T08:06:12.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.242+0000 7ff648deb640 10 monclient: _check_auth_tickets 2023-11-05T08:06:12.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.242+0000 7ff648deb640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:06:12.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.242+0000 7ff6495ec640 1 -- 172.21.15.156:0/3140002007 reap_dead start 2023-11-05T08:06:12.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.244+0000 7ff648deb640 1 --2- 172.21.15.156:0/3140002007 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff6340039c0 0x7ff634003de0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff638007f00 tx=0x7ff6340057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eaf66a9803ca5b16 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:06:12.264 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.248+0000 7ff6437fe640 1 -- 172.21.15.156:0/3140002007 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff63802c8b0 con 0x7ff6340039c0 2023-11-05T08:06:12.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.248+0000 7ff6437fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:06:12.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.248+0000 7ff6437fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-11-05T08:06:12.265 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.248+0000 7ff6437fe640 10 monclient: dump: 2023-11-05T08:06:12.265 INFO:teuthology.orchestra.run.smithi156.stderr:epoch 1 2023-11-05T08:06:12.265 INFO:teuthology.orchestra.run.smithi156.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:06:12.265 INFO:teuthology.orchestra.run.smithi156.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:12.266 INFO:teuthology.orchestra.run.smithi156.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:12.266 INFO:teuthology.orchestra.run.smithi156.stderr:min_mon_release 18 (reef) 2023-11-05T08:06:12.266 INFO:teuthology.orchestra.run.smithi156.stderr:election_strategy: 1 2023-11-05T08:06:12.266 INFO:teuthology.orchestra.run.smithi156.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:06:12.267 INFO:teuthology.orchestra.run.smithi156.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:06:12.267 INFO:teuthology.orchestra.run.smithi156.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:06:12.267 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-05T08:06:12.267 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.248+0000 7ff64b04f640 20 monclient: get_monmap_and_config waiting for monmap|config 2023-11-05T08:06:12.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.248+0000 7ff6437fe640 1 -- 172.21.15.156:0/3140002007 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff63802ca30 con 0x7ff6340039c0 2023-11-05T08:06:12.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.248+0000 7ff6437fe640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:06:12.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.248+0000 7ff64b04f640 10 monclient: get_monmap_and_config success 2023-11-05T08:06:12.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.248+0000 7ff64b04f640 4 set_mon_vals no callback set 2023-11-05T08:06:12.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.248+0000 7ff6437fe640 1 -- 172.21.15.156:0/3140002007 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff63802cde0 con 0x7ff6340039c0 2023-11-05T08:06:12.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.248+0000 7ff6437fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:06:12.269 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.248+0000 7ff6437fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-11-05T08:06:12.270 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.248+0000 7ff6437fe640 10 monclient: dump: 2023-11-05T08:06:12.270 INFO:teuthology.orchestra.run.smithi156.stderr:epoch 1 2023-11-05T08:06:12.270 INFO:teuthology.orchestra.run.smithi156.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:06:12.271 INFO:teuthology.orchestra.run.smithi156.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:12.271 INFO:teuthology.orchestra.run.smithi156.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:12.272 INFO:teuthology.orchestra.run.smithi156.stderr:min_mon_release 18 (reef) 2023-11-05T08:06:12.272 INFO:teuthology.orchestra.run.smithi156.stderr:election_strategy: 1 2023-11-05T08:06:12.272 INFO:teuthology.orchestra.run.smithi156.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:06:12.273 INFO:teuthology.orchestra.run.smithi156.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:06:12.273 INFO:teuthology.orchestra.run.smithi156.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:06:12.273 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-05T08:06:12.273 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.249+0000 7ff64b04f640 10 monclient: shutdown 2023-11-05T08:06:12.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.249+0000 7ff64b04f640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:06:12.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.249+0000 7ff64b04f640 1 -- 172.21.15.156:0/3140002007 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff6340039c0 msgr2=0x7ff634003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:06:12.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.249+0000 7ff64b04f640 1 --2- 172.21.15.156:0/3140002007 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff6340039c0 0x7ff634003de0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff638007f00 tx=0x7ff6340057f0 comp rx=0 tx=0).stop 2023-11-05T08:06:12.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.249+0000 7ff64b04f640 1 -- 172.21.15.156:0/3140002007 shutdown_connections 2023-11-05T08:06:12.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.249+0000 7ff64b04f640 1 --2- 172.21.15.156:0/3140002007 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff6340039c0 0x7ff634003de0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:12.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.249+0000 7ff64b04f640 1 -- 172.21.15.156:0/3140002007 >> 172.21.15.156:0/3140002007 conn(0x7ff6440b7230 msgr2=0x7ff6440b7610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:06:12.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.249+0000 7ff64b04f640 1 -- 172.21.15.156:0/3140002007 shutdown_connections 2023-11-05T08:06:12.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.249+0000 7ff64b04f640 1 -- 172.21.15.156:0/3140002007 wait complete. 2023-11-05T08:06:12.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.249+0000 7ff64b04f640 10 monclient: build_initial_monmap 2023-11-05T08:06:12.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.249+0000 7ff64b04f640 10 monclient: monmap: 2023-11-05T08:06:12.277 INFO:teuthology.orchestra.run.smithi156.stderr:epoch 0 2023-11-05T08:06:12.277 INFO:teuthology.orchestra.run.smithi156.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-05T08:06:12.278 INFO:teuthology.orchestra.run.smithi156.stderr:last_changed 0.000000 2023-11-05T08:06:12.278 INFO:teuthology.orchestra.run.smithi156.stderr:created 0.000000 2023-11-05T08:06:12.278 INFO:teuthology.orchestra.run.smithi156.stderr:min_mon_release 0 (unknown) 2023-11-05T08:06:12.278 INFO:teuthology.orchestra.run.smithi156.stderr:election_strategy: 1 2023-11-05T08:06:12.279 INFO:teuthology.orchestra.run.smithi156.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.noname-a 2023-11-05T08:06:12.279 INFO:teuthology.orchestra.run.smithi156.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.noname-b 2023-11-05T08:06:12.279 INFO:teuthology.orchestra.run.smithi156.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-c 2023-11-05T08:06:12.280 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-05T08:06:12.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.250+0000 7ff64b04f640 1 librados: starting msgr at 2023-11-05T08:06:12.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.250+0000 7ff64b04f640 1 librados: starting objecter 2023-11-05T08:06:12.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.250+0000 7ff64b04f640 1 Processor -- start 2023-11-05T08:06:12.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.250+0000 7ff64b04f640 1 -- start start 2023-11-05T08:06:12.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.250+0000 7ff64b04f640 1 librados: setting wanted keys 2023-11-05T08:06:12.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.250+0000 7ff64b04f640 1 librados: calling monclient init 2023-11-05T08:06:12.281 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.250+0000 7ff64b04f640 10 monclient: init 2023-11-05T08:06:12.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.250+0000 7ff64b04f640 10 monclient: _reopen_session rank -1 2023-11-05T08:06:12.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.250+0000 7ff64b04f640 10 monclient: _add_conns ranks=[0,1,2] 2023-11-05T08:06:12.282 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.250+0000 7ff64b04f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff6340039c0 0x7ff644145770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:06:12.285 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.250+0000 7ff64b04f640 10 monclient(hunting): picked mon.noname-a con 0x7ff6340039c0 addr [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] 2023-11-05T08:06:12.285 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.250+0000 7ff64b04f640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff6440b06f0 0x7ff6441d9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:06:12.286 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.250+0000 7ff64b04f640 10 monclient(hunting): picked mon.noname-b con 0x7ff6440b06f0 addr [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] 2023-11-05T08:06:12.286 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.250+0000 7ff64b04f640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff6441da1e0 0x7ff6441d66f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:06:12.287 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.250+0000 7ff64b04f640 10 monclient(hunting): picked mon.noname-c con 0x7ff6441da1e0 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:06:12.287 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.250+0000 7ff64b04f640 10 monclient(hunting): start opening mon connection 2023-11-05T08:06:12.287 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.250+0000 7ff64b04f640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6440aadc0 con 0x7ff6340039c0 2023-11-05T08:06:12.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.251+0000 7ff64b04f640 10 monclient(hunting): start opening mon connection 2023-11-05T08:06:12.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.251+0000 7ff64b04f640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6440ab0a0 con 0x7ff6440b06f0 2023-11-05T08:06:12.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.251+0000 7ff64b04f640 10 monclient(hunting): start opening mon connection 2023-11-05T08:06:12.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.251+0000 7ff64b04f640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff644144250 con 0x7ff6441da1e0 2023-11-05T08:06:12.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.251+0000 7ff64b04f640 10 monclient(hunting): _renew_subs 2023-11-05T08:06:12.290 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.251+0000 7ff64b04f640 10 monclient(hunting): authenticate will time out at 1315.470918s 2023-11-05T08:06:12.290 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.251+0000 7ff6495ec640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff6441da1e0 0x7ff6441d66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:06:12.290 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.251+0000 7ff643fff640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff6440b06f0 0x7ff6441d9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:06:12.291 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.251+0000 7ff6495ec640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff6441da1e0 0x7ff6441d66f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.156:46830/0 (socket says 172.21.15.156:46830) 2023-11-05T08:06:12.291 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.251+0000 7ff6495ec640 1 -- 172.21.15.156:0/1842983675 learned_addr learned my addr 172.21.15.156:0/1842983675 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-11-05T08:06:12.291 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.251+0000 7ff6495ec640 10 monclient(hunting): get_auth_request con 0x7ff6441da1e0 auth_method 0 2023-11-05T08:06:12.292 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.251+0000 7ff6495ec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:06:12.292 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.251+0000 7ff6495ec640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:06:12.293 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.251+0000 7ff6495ec640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:06:12.293 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.251+0000 7ff643fff640 10 monclient(hunting): get_auth_request con 0x7ff6440b06f0 auth_method 0 2023-11-05T08:06:12.293 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.251+0000 7ff643fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:06:12.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.251+0000 7ff643fff640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:06:12.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.251+0000 7ff643fff640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:06:12.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.252+0000 7ff6495ec640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:06:12.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.252+0000 7ff6495ec640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:06:12.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.252+0000 7ff6495ec640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:06:12.295 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.252+0000 7ff643fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:06:12.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.252+0000 7ff643fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:06:12.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.252+0000 7ff643fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:06:12.296 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.255+0000 7ff6495ec640 10 monclient(hunting): handle_auth_done global_id 4112 payload 824 2023-11-05T08:06:12.297 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.255+0000 7ff6495ec640 1 -- 172.21.15.156:0/1842983675 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff6440b06f0 msgr2=0x7ff6441d9ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:06:12.297 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.255+0000 7ff6495ec640 1 --2- 172.21.15.156:0/1842983675 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff6440b06f0 0x7ff6441d9ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:12.298 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.255+0000 7ff6495ec640 1 -- 172.21.15.156:0/1842983675 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff6340039c0 msgr2=0x7ff644145770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:06:12.298 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.255+0000 7ff6495ec640 1 --2- 172.21.15.156:0/1842983675 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff6340039c0 0x7ff644145770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:12.298 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.255+0000 7ff6495ec640 10 monclient: _finish_hunting 0 2023-11-05T08:06:12.299 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.255+0000 7ff6495ec640 1 monclient: found mon.noname-c 2023-11-05T08:06:12.299 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.255+0000 7ff6495ec640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:06:12.299 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.255+0000 7ff6495ec640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.52:3301/0 2023-11-05T08:06:12.300 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.255+0000 7ff6495ec640 1 -- 172.21.15.156:0/1842983675 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff644145cb0 con 0x7ff6441da1e0 2023-11-05T08:06:12.300 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.257+0000 7ff6495ec640 1 --2- 172.21.15.156:0/1842983675 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff6441da1e0 0x7ff6441d66f0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff644066a80 tx=0x7ff63c007bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:06:12.300 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.257+0000 7ff6417fa640 10 client.?.objecter ms_handle_connect 0x7ff6441da1e0 2023-11-05T08:06:12.301 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.257+0000 7ff6417fa640 10 client.?.objecter resend_mon_ops 2023-11-05T08:06:12.304 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.261+0000 7ff6417fa640 1 -- 172.21.15.156:0/1842983675 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff63c00fa10 con 0x7ff6441da1e0 2023-11-05T08:06:12.304 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.261+0000 7ff6417fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:06:12.305 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.261+0000 7ff6417fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-11-05T08:06:12.305 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.261+0000 7ff6417fa640 10 monclient: dump: 2023-11-05T08:06:12.305 INFO:teuthology.orchestra.run.smithi156.stderr:epoch 1 2023-11-05T08:06:12.306 INFO:teuthology.orchestra.run.smithi156.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:06:12.306 INFO:teuthology.orchestra.run.smithi156.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:12.306 INFO:teuthology.orchestra.run.smithi156.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:12.307 INFO:teuthology.orchestra.run.smithi156.stderr:min_mon_release 18 (reef) 2023-11-05T08:06:12.307 INFO:teuthology.orchestra.run.smithi156.stderr:election_strategy: 1 2023-11-05T08:06:12.308 INFO:teuthology.orchestra.run.smithi156.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:06:12.308 INFO:teuthology.orchestra.run.smithi156.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:06:12.308 INFO:teuthology.orchestra.run.smithi156.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:06:12.309 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-05T08:06:12.309 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.261+0000 7ff6417fa640 10 monclient: _finish_auth 0 2023-11-05T08:06:12.309 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.261+0000 7ff6417fa640 10 monclient: _check_auth_tickets 2023-11-05T08:06:12.310 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.261+0000 7ff6417fa640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:06:12.310 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.261+0000 7ff6417fa640 1 -- 172.21.15.156:0/1842983675 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff63c00fb90 con 0x7ff6441da1e0 2023-11-05T08:06:12.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.261+0000 7ff6417fa640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:06:12.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.261+0000 7ff6417fa640 1 -- 172.21.15.156:0/1842983675 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff63c012350 con 0x7ff6441da1e0 2023-11-05T08:06:12.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.261+0000 7ff64b04f640 5 monclient: authenticate success, global_id 4112 2023-11-05T08:06:12.312 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.261+0000 7ff64b04f640 10 monclient: _renew_subs 2023-11-05T08:06:12.312 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.261+0000 7ff64b04f640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.52:3301/0 2023-11-05T08:06:12.312 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.261+0000 7ff64b04f640 1 -- 172.21.15.156:0/1842983675 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6441da660 con 0x7ff6441da1e0 2023-11-05T08:06:12.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.261+0000 7ff642ffd640 4 set_mon_vals no callback set 2023-11-05T08:06:12.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.261+0000 7ff6417fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:06:12.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.261+0000 7ff6417fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-11-05T08:06:12.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.261+0000 7ff6417fa640 10 monclient: dump: 2023-11-05T08:06:12.314 INFO:teuthology.orchestra.run.smithi156.stderr:epoch 1 2023-11-05T08:06:12.315 INFO:teuthology.orchestra.run.smithi156.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:06:12.315 INFO:teuthology.orchestra.run.smithi156.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:12.315 INFO:teuthology.orchestra.run.smithi156.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:12.316 INFO:teuthology.orchestra.run.smithi156.stderr:min_mon_release 18 (reef) 2023-11-05T08:06:12.316 INFO:teuthology.orchestra.run.smithi156.stderr:election_strategy: 1 2023-11-05T08:06:12.317 INFO:teuthology.orchestra.run.smithi156.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:06:12.317 INFO:teuthology.orchestra.run.smithi156.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:06:12.317 INFO:teuthology.orchestra.run.smithi156.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:06:12.318 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-05T08:06:12.318 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.261+0000 7ff64b04f640 10 client.4112.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-05T08:06:12.318 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.261+0000 7ff64b04f640 10 monclient: _renew_subs 2023-11-05T08:06:12.319 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.261+0000 7ff64b04f640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.52:3301/0 2023-11-05T08:06:12.319 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.261+0000 7ff64b04f640 1 -- 172.21.15.156:0/1842983675 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6441d6c30 con 0x7ff6441da1e0 2023-11-05T08:06:12.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.261+0000 7ff64b04f640 1 librados: init done 2023-11-05T08:06:12.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.262+0000 7ff64b04f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-05T08:06:12.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.262+0000 7ff64b04f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:06:12.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.262+0000 7ff64b04f640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.52:3301/0 2023-11-05T08:06:12.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.262+0000 7ff64b04f640 1 -- 172.21.15.156:0/1842983675 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6440aab20 con 0x7ff6441da1e0 2023-11-05T08:06:12.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.266+0000 7ff6417fa640 1 -- 172.21.15.156:0/1842983675 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ff63c0127b0 con 0x7ff6441da1e0 2023-11-05T08:06:12.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.266+0000 7ff6417fa640 1 -- 172.21.15.156:0/1842983675 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7ff63c014b90 con 0x7ff6441da1e0 2023-11-05T08:06:12.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.266+0000 7ff6417fa640 10 client.4112.objecter ms_dispatch 0x7ff644000b90 osd_map(3..3 src has 1..3) v4 2023-11-05T08:06:12.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.266+0000 7ff6417fa640 3 client.4112.objecter handle_osd_map got epochs [3,3] > 0 2023-11-05T08:06:12.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.266+0000 7ff6417fa640 3 client.4112.objecter handle_osd_map decoding full epoch 3 2023-11-05T08:06:12.323 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.266+0000 7ff6417fa640 20 client.4112.objecter dump_active .. 0 homeless 2023-11-05T08:06:12.382 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.381+0000 7ff6417fa640 1 -- 172.21.15.156:0/1842983675 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7ff6440aab20 con 0x7ff6441da1e0 2023-11-05T08:06:12.382 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.381+0000 7ff6417fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:06:12.383 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.381+0000 7ff6417fa640 10 monclient: _finish_command 1 = system:0 2023-11-05T08:06:12.452 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-11-05T08:06:12.451+0000 7f1369430040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-05T08:06:12.453 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.452+0000 7ff64b04f640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "82d5dd13-f1f5-4282-8ec8-4d6c273a42c7", "id": 1}] 2023-11-05T08:06:12.454 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.453+0000 7ff64b04f640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "82d5dd13-f1f5-4282-8ec8-4d6c273a42c7", "id": 1}] 2023-11-05T08:06:12.454 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.453+0000 7ff64b04f640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.52:3301/0 2023-11-05T08:06:12.454 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.453+0000 7ff64b04f640 1 -- 172.21.15.156:0/1842983675 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "osd new", "uuid": "82d5dd13-f1f5-4282-8ec8-4d6c273a42c7", "id": 1} v 0) v1 -- 0x7ff6440aaf00 con 0x7ff6441da1e0 2023-11-05T08:06:12.558 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.557+0000 7ff6417fa640 1 -- 172.21.15.156:0/1842983675 <== mon.2 v2:172.21.15.52:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "82d5dd13-f1f5-4282-8ec8-4d6c273a42c7", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff6440aaf00 con 0x7ff6441da1e0 2023-11-05T08:06:12.558 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.557+0000 7ff6417fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "82d5dd13-f1f5-4282-8ec8-4d6c273a42c7", "id": 1}] 2023-11-05T08:06:12.558 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.557+0000 7ff6417fa640 10 monclient: _finish_command 2 = system:0 2023-11-05T08:06:12.559 INFO:teuthology.orchestra.run.smithi156.stdout:1 2023-11-05T08:06:12.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.557+0000 7ff64b04f640 10 librados: watch_flush enter 2023-11-05T08:06:12.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.557+0000 7ff64b04f640 10 librados: watch_flush exit 2023-11-05T08:06:12.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.557+0000 7ff64b04f640 20 client.4112.objecter shutdown clearing up homeless session... 2023-11-05T08:06:12.560 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.557+0000 7ff64b04f640 10 client.4112.objecter successfully canceled tick 2023-11-05T08:06:12.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.558+0000 7ff64b04f640 10 monclient: shutdown 2023-11-05T08:06:12.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.558+0000 7ff64b04f640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:06:12.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.558+0000 7ff64b04f640 1 -- 172.21.15.156:0/1842983675 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff6441da1e0 msgr2=0x7ff6441d66f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:06:12.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.558+0000 7ff64b04f640 1 --2- 172.21.15.156:0/1842983675 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff6441da1e0 0x7ff6441d66f0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff644066a80 tx=0x7ff63c007bd0 comp rx=0 tx=0).stop 2023-11-05T08:06:12.561 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.558+0000 7ff64b04f640 1 -- 172.21.15.156:0/1842983675 shutdown_connections 2023-11-05T08:06:12.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.558+0000 7ff64b04f640 1 --2- 172.21.15.156:0/1842983675 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff6441da1e0 0x7ff6441d66f0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:12.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.558+0000 7ff64b04f640 1 --2- 172.21.15.156:0/1842983675 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff6440b06f0 0x7ff6441d9ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:12.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.558+0000 7ff64b04f640 1 --2- 172.21.15.156:0/1842983675 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff6340039c0 0x7ff644145770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:12.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.558+0000 7ff64b04f640 1 -- 172.21.15.156:0/1842983675 >> 172.21.15.156:0/1842983675 conn(0x7ff6440b7230 msgr2=0x7ff6440b0bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:06:12.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.558+0000 7ff64b04f640 1 -- 172.21.15.156:0/1842983675 shutdown_connections 2023-11-05T08:06:12.562 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.558+0000 7ff64b04f640 1 -- 172.21.15.156:0/1842983675 wait complete. 2023-11-05T08:06:12.563 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.558+0000 7ff64b04f640 1 librados: shutdown 2023-11-05T08:06:12.569 DEBUG:teuthology.orchestra.run.smithi156:> sudo ceph --cluster ceph osd new 2c5ea82d-5534-4437-a76f-e3769d798b17 2 2023-11-05T08:06:12.594 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-11-05T08:06:12.593+0000 7f1369430040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-05T08:06:12.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.668+0000 7fe84bfe2640 10 monclient: get_monmap_and_config 2023-11-05T08:06:12.669 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.668+0000 7fe84bfe2640 10 monclient: build_initial_monmap 2023-11-05T08:06:12.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.668+0000 7fe84bfe2640 10 monclient: monmap: 2023-11-05T08:06:12.670 INFO:teuthology.orchestra.run.smithi156.stderr:epoch 0 2023-11-05T08:06:12.670 INFO:teuthology.orchestra.run.smithi156.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:06:12.670 INFO:teuthology.orchestra.run.smithi156.stderr:last_changed 2023-11-05T08:06:12.669470+0000 2023-11-05T08:06:12.670 INFO:teuthology.orchestra.run.smithi156.stderr:created 2023-11-05T08:06:12.669470+0000 2023-11-05T08:06:12.671 INFO:teuthology.orchestra.run.smithi156.stderr:min_mon_release 0 (unknown) 2023-11-05T08:06:12.671 INFO:teuthology.orchestra.run.smithi156.stderr:election_strategy: 1 2023-11-05T08:06:12.671 INFO:teuthology.orchestra.run.smithi156.stderr:0: v1:172.21.15.52:6789/0 mon.noname-a-legacy 2023-11-05T08:06:12.671 INFO:teuthology.orchestra.run.smithi156.stderr:1: v1:172.21.15.156:6789/0 mon.noname-c-legacy 2023-11-05T08:06:12.671 INFO:teuthology.orchestra.run.smithi156.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-b 2023-11-05T08:06:12.671 INFO:teuthology.orchestra.run.smithi156.stderr:3: v2:172.21.15.52:3300/0 mon.noname-a 2023-11-05T08:06:12.672 INFO:teuthology.orchestra.run.smithi156.stderr:4: v2:172.21.15.156:3300/0 mon.noname-c 2023-11-05T08:06:12.672 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-05T08:06:12.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.668+0000 7fe84bfe2640 1 Processor -- start 2023-11-05T08:06:12.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.669+0000 7fe84bfe2640 1 -- start start 2023-11-05T08:06:12.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.669+0000 7fe84bfe2640 10 monclient: init 2023-11-05T08:06:12.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.669+0000 7fe84bfe2640 10 monclient: _reopen_session rank -1 2023-11-05T08:06:12.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.669+0000 7fe84bfe2640 10 monclient: _add_conns ranks=[3,1,4,2,0] 2023-11-05T08:06:12.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.669+0000 7fe84bfe2640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe8440b4240 0x7fe8440b1150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:06:12.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.669+0000 7fe84bfe2640 10 monclient(hunting): picked mon.noname-a con 0x7fe8440b4240 addr v2:172.21.15.52:3300/0 2023-11-05T08:06:12.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.669+0000 7fe84bfe2640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fe8440b38d0 addr v1:172.21.15.156:6789/0 2023-11-05T08:06:12.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.669+0000 7fe84bfe2640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe8440ade00 0x7fe84413b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:06:12.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.669+0000 7fe84bfe2640 10 monclient(hunting): picked mon.noname-c con 0x7fe8440ade00 addr v2:172.21.15.156:3300/0 2023-11-05T08:06:12.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.669+0000 7fe84bfe2640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8440b0cc0 con 0x7fe8440b38d0 2023-11-05T08:06:12.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.669+0000 7fe84bfe2640 10 monclient(hunting): start opening mon connection 2023-11-05T08:06:12.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.669+0000 7fe84bfe2640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8440b4620 con 0x7fe8440b4240 2023-11-05T08:06:12.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.669+0000 7fe84bfe2640 10 monclient(hunting): start opening mon connection 2023-11-05T08:06:12.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.669+0000 7fe84bfe2640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8440b1690 con 0x7fe8440ade00 2023-11-05T08:06:12.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.669+0000 7fe84bfe2640 10 monclient(hunting): _renew_subs 2023-11-05T08:06:12.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.669+0000 7fe84bfe2640 10 monclient(hunting): authenticate will time out at 1315.889689s 2023-11-05T08:06:12.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.670+0000 7fe84a57f640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe8440ade00 0x7fe84413b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:06:12.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.670+0000 7fe849d7e640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe8440b4240 0x7fe8440b1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:06:12.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.670+0000 7fe84a57f640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe8440ade00 0x7fe84413b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:56092/0 (socket says 172.21.15.156:56092) 2023-11-05T08:06:12.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.670+0000 7fe84a57f640 1 -- 172.21.15.156:0/4238820032 learned_addr learned my addr 172.21.15.156:0/4238820032 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-11-05T08:06:12.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.670+0000 7fe84a57f640 10 monclient(hunting): get_auth_request con 0x7fe8440ade00 auth_method 0 2023-11-05T08:06:12.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.670+0000 7fe84a57f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:06:12.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.670+0000 7fe84a57f640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:06:12.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.670+0000 7fe84a57f640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:06:12.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.670+0000 7fe849d7e640 10 monclient(hunting): get_auth_request con 0x7fe8440b4240 auth_method 0 2023-11-05T08:06:12.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.670+0000 7fe849d7e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:06:12.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.670+0000 7fe849d7e640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:06:12.680 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.670+0000 7fe849d7e640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:06:12.680 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.671+0000 7fe849d7e640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:06:12.680 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.671+0000 7fe849d7e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:06:12.680 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.671+0000 7fe849d7e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:06:12.680 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.671+0000 7fe84a57f640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:06:12.681 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.671+0000 7fe84a57f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:06:12.681 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.671+0000 7fe84a57f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:06:12.681 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.673+0000 7fe849d7e640 10 monclient(hunting): handle_auth_done global_id 4104 payload 274 2023-11-05T08:06:12.681 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.673+0000 7fe849d7e640 1 -- 172.21.15.156:0/4238820032 >> v2:172.21.15.156:3300/0 conn(0x7fe8440ade00 msgr2=0x7fe84413b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-05T08:06:12.681 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.673+0000 7fe849d7e640 1 --2- 172.21.15.156:0/4238820032 >> v2:172.21.15.156:3300/0 conn(0x7fe8440ade00 0x7fe84413b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:12.682 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.673+0000 7fe849d7e640 1 -- 172.21.15.156:0/4238820032 >> v1:172.21.15.156:6789/0 conn(0x7fe8440b38d0 legacy=0x7fe8440ae640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:06:12.682 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.673+0000 7fe849d7e640 10 monclient: _finish_hunting 0 2023-11-05T08:06:12.682 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.673+0000 7fe849d7e640 1 monclient: found mon.noname-a 2023-11-05T08:06:12.682 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.673+0000 7fe849d7e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:06:12.682 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.673+0000 7fe849d7e640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.52:3300/0 2023-11-05T08:06:12.683 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.673+0000 7fe849d7e640 1 -- 172.21.15.156:0/4238820032 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe84413f5f0 con 0x7fe8440b4240 2023-11-05T08:06:12.683 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-11-05T08:06:12.673+0000 7f4a6604a040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-05T08:06:12.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.675+0000 7fe849d7e640 1 --2- 172.21.15.156:0/4238820032 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8440b4240 0x7fe8440b1150 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe8400097a0 tx=0x7fe84002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b32485ccf9095934 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:06:12.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.679+0000 7fe848d7c640 1 -- 172.21.15.156:0/4238820032 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe84002e070 con 0x7fe8440b4240 2023-11-05T08:06:12.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.679+0000 7fe848d7c640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:06:12.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.680+0000 7fe848d7c640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-11-05T08:06:12.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.680+0000 7fe848d7c640 10 monclient: dump: 2023-11-05T08:06:12.688 INFO:teuthology.orchestra.run.smithi156.stderr:epoch 1 2023-11-05T08:06:12.688 INFO:teuthology.orchestra.run.smithi156.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:06:12.688 INFO:teuthology.orchestra.run.smithi156.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:12.688 INFO:teuthology.orchestra.run.smithi156.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:12.689 INFO:teuthology.orchestra.run.smithi156.stderr:min_mon_release 18 (reef) 2023-11-05T08:06:12.689 INFO:teuthology.orchestra.run.smithi156.stderr:election_strategy: 1 2023-11-05T08:06:12.689 INFO:teuthology.orchestra.run.smithi156.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:06:12.689 INFO:teuthology.orchestra.run.smithi156.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:06:12.689 INFO:teuthology.orchestra.run.smithi156.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:06:12.689 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-05T08:06:12.690 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.680+0000 7fe848d7c640 10 monclient: _finish_auth 0 2023-11-05T08:06:12.690 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.680+0000 7fe848d7c640 10 monclient: _check_auth_tickets 2023-11-05T08:06:12.690 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.680+0000 7fe848d7c640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:06:12.690 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.680+0000 7fe848d7c640 1 -- 172.21.15.156:0/4238820032 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8400315a0 con 0x7fe8440b4240 2023-11-05T08:06:12.690 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.680+0000 7fe848d7c640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:06:12.691 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.680+0000 7fe848d7c640 1 -- 172.21.15.156:0/4238820032 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe840031930 con 0x7fe8440b4240 2023-11-05T08:06:12.691 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.680+0000 7fe84bfe2640 5 monclient: authenticate success, global_id 4104 2023-11-05T08:06:12.691 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.680+0000 7fe84bfe2640 10 monclient: get_monmap_and_config success 2023-11-05T08:06:12.691 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.680+0000 7fe84bfe2640 4 set_mon_vals no callback set 2023-11-05T08:06:12.691 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.680+0000 7fe848d7c640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:06:12.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.680+0000 7fe848d7c640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-11-05T08:06:12.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.680+0000 7fe848d7c640 10 monclient: dump: 2023-11-05T08:06:12.692 INFO:teuthology.orchestra.run.smithi156.stderr:epoch 1 2023-11-05T08:06:12.693 INFO:teuthology.orchestra.run.smithi156.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:06:12.693 INFO:teuthology.orchestra.run.smithi156.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:12.693 INFO:teuthology.orchestra.run.smithi156.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:12.693 INFO:teuthology.orchestra.run.smithi156.stderr:min_mon_release 18 (reef) 2023-11-05T08:06:12.693 INFO:teuthology.orchestra.run.smithi156.stderr:election_strategy: 1 2023-11-05T08:06:12.694 INFO:teuthology.orchestra.run.smithi156.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:06:12.694 INFO:teuthology.orchestra.run.smithi156.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:06:12.694 INFO:teuthology.orchestra.run.smithi156.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:06:12.694 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-05T08:06:12.694 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.680+0000 7fe84bfe2640 10 monclient: shutdown 2023-11-05T08:06:12.695 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.680+0000 7fe84bfe2640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:06:12.695 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.680+0000 7fe84bfe2640 1 -- 172.21.15.156:0/4238820032 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8440b4240 msgr2=0x7fe8440b1150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:06:12.695 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.680+0000 7fe84bfe2640 1 --2- 172.21.15.156:0/4238820032 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8440b4240 0x7fe8440b1150 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe8400097a0 tx=0x7fe84002b840 comp rx=0 tx=0).stop 2023-11-05T08:06:12.695 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.680+0000 7fe84bfe2640 1 -- 172.21.15.156:0/4238820032 shutdown_connections 2023-11-05T08:06:12.695 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.680+0000 7fe84bfe2640 1 --2- 172.21.15.156:0/4238820032 >> v2:172.21.15.156:3300/0 conn(0x7fe8440ade00 0x7fe84413b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:12.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.680+0000 7fe84bfe2640 1 --2- 172.21.15.156:0/4238820032 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8440b4240 0x7fe8440b1150 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:12.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.680+0000 7fe84bfe2640 1 -- 172.21.15.156:0/4238820032 >> 172.21.15.156:0/4238820032 conn(0x7fe844065cd0 msgr2=0x7fe8440660e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:06:12.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.680+0000 7fe84bfe2640 1 -- 172.21.15.156:0/4238820032 shutdown_connections 2023-11-05T08:06:12.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.680+0000 7fe84bfe2640 1 -- 172.21.15.156:0/4238820032 wait complete. 2023-11-05T08:06:12.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.681+0000 7fe84bfe2640 10 monclient: build_initial_monmap 2023-11-05T08:06:12.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.681+0000 7fe84bfe2640 10 monclient: monmap: 2023-11-05T08:06:12.697 INFO:teuthology.orchestra.run.smithi156.stderr:epoch 0 2023-11-05T08:06:12.697 INFO:teuthology.orchestra.run.smithi156.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-05T08:06:12.697 INFO:teuthology.orchestra.run.smithi156.stderr:last_changed 0.000000 2023-11-05T08:06:12.697 INFO:teuthology.orchestra.run.smithi156.stderr:created 0.000000 2023-11-05T08:06:12.697 INFO:teuthology.orchestra.run.smithi156.stderr:min_mon_release 0 (unknown) 2023-11-05T08:06:12.698 INFO:teuthology.orchestra.run.smithi156.stderr:election_strategy: 1 2023-11-05T08:06:12.698 INFO:teuthology.orchestra.run.smithi156.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.noname-a 2023-11-05T08:06:12.698 INFO:teuthology.orchestra.run.smithi156.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.noname-b 2023-11-05T08:06:12.698 INFO:teuthology.orchestra.run.smithi156.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-c 2023-11-05T08:06:12.698 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-05T08:06:12.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.681+0000 7fe84bfe2640 1 librados: starting msgr at 2023-11-05T08:06:12.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.681+0000 7fe84bfe2640 1 librados: starting objecter 2023-11-05T08:06:12.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.682+0000 7fe84bfe2640 1 Processor -- start 2023-11-05T08:06:12.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.682+0000 7fe84bfe2640 1 -- start start 2023-11-05T08:06:12.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.682+0000 7fe84bfe2640 1 librados: setting wanted keys 2023-11-05T08:06:12.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.682+0000 7fe84bfe2640 1 librados: calling monclient init 2023-11-05T08:06:12.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.682+0000 7fe84bfe2640 10 monclient: init 2023-11-05T08:06:12.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.682+0000 7fe84bfe2640 10 monclient: _reopen_session rank -1 2023-11-05T08:06:12.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.682+0000 7fe84bfe2640 10 monclient: _add_conns ranks=[0,2,1] 2023-11-05T08:06:12.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.682+0000 7fe84bfe2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8440ade00 0x7fe8441d9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:06:12.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.682+0000 7fe84bfe2640 10 monclient(hunting): picked mon.noname-a con 0x7fe8440ade00 addr [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] 2023-11-05T08:06:12.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.682+0000 7fe84bfe2640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe8440b4240 0x7fe8440a8720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:06:12.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.682+0000 7fe84bfe2640 10 monclient(hunting): picked mon.noname-c con 0x7fe8440b4240 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:06:12.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.682+0000 7fe84bfe2640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe8441da3e0 0x7fe8440a8c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:06:12.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.682+0000 7fe84bfe2640 10 monclient(hunting): picked mon.noname-b con 0x7fe8441da3e0 addr [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] 2023-11-05T08:06:12.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.682+0000 7fe84bfe2640 10 monclient(hunting): start opening mon connection 2023-11-05T08:06:12.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.682+0000 7fe84bfe2640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8440aa880 con 0x7fe8440ade00 2023-11-05T08:06:12.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.682+0000 7fe84bfe2640 10 monclient(hunting): start opening mon connection 2023-11-05T08:06:12.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.682+0000 7fe84bfe2640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8441d9a10 con 0x7fe8441da3e0 2023-11-05T08:06:12.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.682+0000 7fe84bfe2640 10 monclient(hunting): start opening mon connection 2023-11-05T08:06:12.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.682+0000 7fe84bfe2640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8440aaa60 con 0x7fe8440b4240 2023-11-05T08:06:12.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.682+0000 7fe84bfe2640 10 monclient(hunting): _renew_subs 2023-11-05T08:06:12.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.682+0000 7fe84bfe2640 10 monclient(hunting): authenticate will time out at 1315.902573s 2023-11-05T08:06:12.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.683+0000 7fe84a57f640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe8441da3e0 0x7fe8440a8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:06:12.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.683+0000 7fe84957d640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe8440b4240 0x7fe8440a8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:06:12.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.683+0000 7fe84957d640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe8440b4240 0x7fe8440a8720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.156:46844/0 (socket says 172.21.15.156:46844) 2023-11-05T08:06:12.704 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.683+0000 7fe84957d640 1 -- 172.21.15.156:0/2016180460 learned_addr learned my addr 172.21.15.156:0/2016180460 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-11-05T08:06:12.704 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.683+0000 7fe84957d640 10 monclient(hunting): get_auth_request con 0x7fe8440b4240 auth_method 0 2023-11-05T08:06:12.704 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.683+0000 7fe84957d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:06:12.704 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.683+0000 7fe84957d640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:06:12.704 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.683+0000 7fe84957d640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:06:12.704 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.683+0000 7fe84a57f640 10 monclient(hunting): get_auth_request con 0x7fe8441da3e0 auth_method 0 2023-11-05T08:06:12.705 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.683+0000 7fe84a57f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:06:12.705 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.683+0000 7fe84a57f640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:06:12.705 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.683+0000 7fe84a57f640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:06:12.705 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.684+0000 7fe84957d640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:06:12.705 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.684+0000 7fe84957d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:06:12.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.684+0000 7fe84957d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:06:12.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.684+0000 7fe84a57f640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:06:12.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.684+0000 7fe84a57f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:06:12.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.684+0000 7fe84a57f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:06:12.706 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.686+0000 7fe849d7e640 1 --2- 172.21.15.156:0/2016180460 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8440ade00 0x7fe8441d9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:06:12.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.686+0000 7fe849d7e640 10 monclient(hunting): get_auth_request con 0x7fe8440ade00 auth_method 0 2023-11-05T08:06:12.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.686+0000 7fe849d7e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:06:12.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.686+0000 7fe849d7e640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:06:12.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.686+0000 7fe849d7e640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:06:12.710 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.687+0000 7fe84957d640 10 monclient(hunting): handle_auth_done global_id 4115 payload 824 2023-11-05T08:06:12.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.687+0000 7fe84957d640 1 -- 172.21.15.156:0/2016180460 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe8441da3e0 msgr2=0x7fe8440a8c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:06:12.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.687+0000 7fe84957d640 1 --2- 172.21.15.156:0/2016180460 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe8441da3e0 0x7fe8440a8c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:12.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.687+0000 7fe84957d640 1 -- 172.21.15.156:0/2016180460 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8440ade00 msgr2=0x7fe8441d9ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:06:12.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.687+0000 7fe84957d640 1 --2- 172.21.15.156:0/2016180460 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8440ade00 0x7fe8441d9ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:12.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.687+0000 7fe84957d640 10 monclient: _finish_hunting 0 2023-11-05T08:06:12.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.687+0000 7fe84957d640 1 monclient: found mon.noname-c 2023-11-05T08:06:12.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.687+0000 7fe84957d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:06:12.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.687+0000 7fe84957d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.52:3301/0 2023-11-05T08:06:12.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.687+0000 7fe84957d640 1 -- 172.21.15.156:0/2016180460 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe840009400 con 0x7fe8440b4240 2023-11-05T08:06:12.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.689+0000 7fe84957d640 1 --2- 172.21.15.156:0/2016180460 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe8440b4240 0x7fe8440a8720 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe83400c400 tx=0x7fe83400c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:06:12.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.689+0000 7fe83a7fc640 10 client.?.objecter ms_handle_connect 0x7fe8440b4240 2023-11-05T08:06:12.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.689+0000 7fe83a7fc640 10 client.?.objecter resend_mon_ops 2023-11-05T08:06:12.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.693+0000 7fe83a7fc640 1 -- 172.21.15.156:0/2016180460 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8340052d0 con 0x7fe8440b4240 2023-11-05T08:06:12.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.693+0000 7fe83a7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:06:12.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.693+0000 7fe83a7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-11-05T08:06:12.714 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.693+0000 7fe83a7fc640 10 monclient: dump: 2023-11-05T08:06:12.714 INFO:teuthology.orchestra.run.smithi156.stderr:epoch 1 2023-11-05T08:06:12.714 INFO:teuthology.orchestra.run.smithi156.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:06:12.714 INFO:teuthology.orchestra.run.smithi156.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:12.715 INFO:teuthology.orchestra.run.smithi156.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:12.715 INFO:teuthology.orchestra.run.smithi156.stderr:min_mon_release 18 (reef) 2023-11-05T08:06:12.715 INFO:teuthology.orchestra.run.smithi156.stderr:election_strategy: 1 2023-11-05T08:06:12.715 INFO:teuthology.orchestra.run.smithi156.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:06:12.715 INFO:teuthology.orchestra.run.smithi156.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:06:12.715 INFO:teuthology.orchestra.run.smithi156.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:06:12.716 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-05T08:06:12.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.693+0000 7fe83a7fc640 10 monclient: _finish_auth 0 2023-11-05T08:06:12.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.693+0000 7fe83a7fc640 10 monclient: _check_auth_tickets 2023-11-05T08:06:12.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.693+0000 7fe83a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:06:12.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.693+0000 7fe83a7fc640 1 -- 172.21.15.156:0/2016180460 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe834005450 con 0x7fe8440b4240 2023-11-05T08:06:12.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.693+0000 7fe84bfe2640 5 monclient: authenticate success, global_id 4115 2023-11-05T08:06:12.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.693+0000 7fe84bfe2640 10 monclient: _renew_subs 2023-11-05T08:06:12.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.693+0000 7fe84bfe2640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.52:3301/0 2023-11-05T08:06:12.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.693+0000 7fe84bfe2640 1 -- 172.21.15.156:0/2016180460 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8440a91a0 con 0x7fe8440b4240 2023-11-05T08:06:12.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.693+0000 7fe83a7fc640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:06:12.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.693+0000 7fe83a7fc640 1 -- 172.21.15.156:0/2016180460 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe834007260 con 0x7fe8440b4240 2023-11-05T08:06:12.718 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.693+0000 7fe83a7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:06:12.718 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.693+0000 7fe83a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-11-05T08:06:12.718 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.693+0000 7fe83a7fc640 10 monclient: dump: 2023-11-05T08:06:12.718 INFO:teuthology.orchestra.run.smithi156.stderr:epoch 1 2023-11-05T08:06:12.718 INFO:teuthology.orchestra.run.smithi156.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:06:12.719 INFO:teuthology.orchestra.run.smithi156.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:12.719 INFO:teuthology.orchestra.run.smithi156.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:12.719 INFO:teuthology.orchestra.run.smithi156.stderr:min_mon_release 18 (reef) 2023-11-05T08:06:12.719 INFO:teuthology.orchestra.run.smithi156.stderr:election_strategy: 1 2023-11-05T08:06:12.719 INFO:teuthology.orchestra.run.smithi156.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:06:12.720 INFO:teuthology.orchestra.run.smithi156.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:06:12.720 INFO:teuthology.orchestra.run.smithi156.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:06:12.720 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-05T08:06:12.720 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.693+0000 7fe83b7fe640 4 set_mon_vals no callback set 2023-11-05T08:06:12.720 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.693+0000 7fe84bfe2640 10 client.4115.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-05T08:06:12.721 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.693+0000 7fe84bfe2640 10 monclient: _renew_subs 2023-11-05T08:06:12.721 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.693+0000 7fe84bfe2640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.52:3301/0 2023-11-05T08:06:12.721 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.693+0000 7fe84bfe2640 1 -- 172.21.15.156:0/2016180460 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe84413d300 con 0x7fe8440b4240 2023-11-05T08:06:12.721 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.693+0000 7fe84bfe2640 1 librados: init done 2023-11-05T08:06:12.721 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.694+0000 7fe84bfe2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-05T08:06:12.722 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.694+0000 7fe84bfe2640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:06:12.722 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.694+0000 7fe84bfe2640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.52:3301/0 2023-11-05T08:06:12.722 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.694+0000 7fe84bfe2640 1 -- 172.21.15.156:0/2016180460 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe84404e9f0 con 0x7fe8440b4240 2023-11-05T08:06:12.722 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.695+0000 7fe83a7fc640 1 -- 172.21.15.156:0/2016180460 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fe8340067d0 con 0x7fe8440b4240 2023-11-05T08:06:12.722 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.696+0000 7fe83a7fc640 1 -- 172.21.15.156:0/2016180460 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7fe834003870 con 0x7fe8440b4240 2023-11-05T08:06:12.723 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.696+0000 7fe83a7fc640 10 client.4115.objecter ms_dispatch 0x7fe844000b90 osd_map(4..4 src has 1..4) v4 2023-11-05T08:06:12.723 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.696+0000 7fe83a7fc640 3 client.4115.objecter handle_osd_map got epochs [4,4] > 0 2023-11-05T08:06:12.723 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.696+0000 7fe83a7fc640 3 client.4115.objecter handle_osd_map decoding full epoch 4 2023-11-05T08:06:12.723 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.697+0000 7fe83a7fc640 20 client.4115.objecter dump_active .. 0 homeless 2023-11-05T08:06:12.724 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-11-05T08:06:12.715+0000 7f1369430040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-05T08:06:12.761 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-11-05T08:06:12.760+0000 7f1369430040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-05T08:06:12.802 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.801+0000 7fe83a7fc640 1 -- 172.21.15.156:0/2016180460 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fe834020060 con 0x7fe8440b4240 2023-11-05T08:06:12.802 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.801+0000 7fe83a7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:06:12.802 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.801+0000 7fe83a7fc640 10 monclient: _finish_command 1 = system:0 2023-11-05T08:06:12.818 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-11-05T08:06:12.816+0000 7f4a6604a040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-05T08:06:12.860 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-11-05T08:06:12.859+0000 7f1369430040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-05T08:06:12.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.872+0000 7fe84bfe2640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "2c5ea82d-5534-4437-a76f-e3769d798b17", "id": 2}] 2023-11-05T08:06:12.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.872+0000 7fe84bfe2640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "2c5ea82d-5534-4437-a76f-e3769d798b17", "id": 2}] 2023-11-05T08:06:12.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.872+0000 7fe84bfe2640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.52:3301/0 2023-11-05T08:06:12.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.872+0000 7fe84bfe2640 1 -- 172.21.15.156:0/2016180460 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "osd new", "uuid": "2c5ea82d-5534-4437-a76f-e3769d798b17", "id": 2} v 0) v1 -- 0x7fe844069510 con 0x7fe8440b4240 2023-11-05T08:06:12.947 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.946+0000 7fe83a7fc640 1 -- 172.21.15.156:0/2016180460 <== mon.2 v2:172.21.15.52:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2c5ea82d-5534-4437-a76f-e3769d798b17", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe834006a80 con 0x7fe8440b4240 2023-11-05T08:06:12.947 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.946+0000 7fe83a7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "2c5ea82d-5534-4437-a76f-e3769d798b17", "id": 2}] 2023-11-05T08:06:12.948 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.946+0000 7fe83a7fc640 10 monclient: _finish_command 2 = system:0 2023-11-05T08:06:12.948 INFO:teuthology.orchestra.run.smithi156.stdout:2 2023-11-05T08:06:12.950 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.947+0000 7fe84bfe2640 10 librados: watch_flush enter 2023-11-05T08:06:12.950 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.947+0000 7fe84bfe2640 10 librados: watch_flush exit 2023-11-05T08:06:12.950 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.947+0000 7fe84bfe2640 20 client.4115.objecter shutdown clearing up homeless session... 2023-11-05T08:06:12.950 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.947+0000 7fe84bfe2640 10 client.4115.objecter successfully canceled tick 2023-11-05T08:06:12.951 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.947+0000 7fe84bfe2640 10 monclient: shutdown 2023-11-05T08:06:12.951 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.947+0000 7fe84bfe2640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:06:12.951 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.947+0000 7fe84bfe2640 1 -- 172.21.15.156:0/2016180460 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe8440b4240 msgr2=0x7fe8440a8720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:06:12.951 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.947+0000 7fe84bfe2640 1 --2- 172.21.15.156:0/2016180460 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe8440b4240 0x7fe8440a8720 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe83400c400 tx=0x7fe83400c8c0 comp rx=0 tx=0).stop 2023-11-05T08:06:12.952 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.947+0000 7fe84bfe2640 1 -- 172.21.15.156:0/2016180460 shutdown_connections 2023-11-05T08:06:12.952 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.947+0000 7fe84bfe2640 1 --2- 172.21.15.156:0/2016180460 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe8441da3e0 0x7fe8440a8c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:12.952 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.947+0000 7fe84bfe2640 1 --2- 172.21.15.156:0/2016180460 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe8440b4240 0x7fe8440a8720 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:12.953 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.947+0000 7fe84bfe2640 1 --2- 172.21.15.156:0/2016180460 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8440ade00 0x7fe8441d9ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:12.953 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.947+0000 7fe84bfe2640 1 -- 172.21.15.156:0/2016180460 >> 172.21.15.156:0/2016180460 conn(0x7fe844065cd0 msgr2=0x7fe8440b2a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:06:12.953 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.947+0000 7fe84bfe2640 1 -- 172.21.15.156:0/2016180460 shutdown_connections 2023-11-05T08:06:12.953 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.947+0000 7fe84bfe2640 1 -- 172.21.15.156:0/2016180460 wait complete. 2023-11-05T08:06:12.953 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:12.947+0000 7fe84bfe2640 1 librados: shutdown 2023-11-05T08:06:12.954 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-11-05T08:06:12.952+0000 7f4a6604a040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-05T08:06:12.958 DEBUG:teuthology.orchestra.run.smithi156:> sudo ceph --cluster ceph osd new 9ffcbf5b-1afd-4777-825f-c5fb551b9d88 3 2023-11-05T08:06:12.960 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-11-05T08:06:12.959+0000 7f1369430040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-05T08:06:13.001 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-11-05T08:06:12.999+0000 7f4a6604a040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-05T08:06:13.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.058+0000 7f92ed209640 10 monclient: get_monmap_and_config 2023-11-05T08:06:13.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.058+0000 7f92ed209640 10 monclient: build_initial_monmap 2023-11-05T08:06:13.059 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.058+0000 7f92ed209640 10 monclient: monmap: 2023-11-05T08:06:13.060 INFO:teuthology.orchestra.run.smithi156.stderr:epoch 0 2023-11-05T08:06:13.060 INFO:teuthology.orchestra.run.smithi156.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:06:13.060 INFO:teuthology.orchestra.run.smithi156.stderr:last_changed 2023-11-05T08:06:13.059153+0000 2023-11-05T08:06:13.061 INFO:teuthology.orchestra.run.smithi156.stderr:created 2023-11-05T08:06:13.059153+0000 2023-11-05T08:06:13.061 INFO:teuthology.orchestra.run.smithi156.stderr:min_mon_release 0 (unknown) 2023-11-05T08:06:13.061 INFO:teuthology.orchestra.run.smithi156.stderr:election_strategy: 1 2023-11-05T08:06:13.061 INFO:teuthology.orchestra.run.smithi156.stderr:0: v1:172.21.15.52:6789/0 mon.noname-a-legacy 2023-11-05T08:06:13.062 INFO:teuthology.orchestra.run.smithi156.stderr:1: v1:172.21.15.156:6789/0 mon.noname-c-legacy 2023-11-05T08:06:13.062 INFO:teuthology.orchestra.run.smithi156.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-b 2023-11-05T08:06:13.062 INFO:teuthology.orchestra.run.smithi156.stderr:3: v2:172.21.15.52:3300/0 mon.noname-a 2023-11-05T08:06:13.063 INFO:teuthology.orchestra.run.smithi156.stderr:4: v2:172.21.15.156:3300/0 mon.noname-c 2023-11-05T08:06:13.063 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-05T08:06:13.063 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.058+0000 7f92ed209640 1 Processor -- start 2023-11-05T08:06:13.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.058+0000 7f92ed209640 1 -- start start 2023-11-05T08:06:13.064 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.058+0000 7f92ed209640 10 monclient: init 2023-11-05T08:06:13.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.059+0000 7f92ed209640 10 monclient: _reopen_session rank -1 2023-11-05T08:06:13.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.059+0000 7f92ed209640 10 monclient: _add_conns ranks=[3,0,4,2,1] 2023-11-05T08:06:13.068 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.059+0000 7f92ed209640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f92e80b4240 0x7f92e80b1150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:06:13.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.059+0000 7f92ed209640 10 monclient(hunting): picked mon.noname-a con 0x7f92e80b4240 addr v2:172.21.15.52:3300/0 2023-11-05T08:06:13.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.059+0000 7f92ed209640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f92e80b38d0 addr v1:172.21.15.52:6789/0 2023-11-05T08:06:13.069 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.059+0000 7f92ed209640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f92e80ade00 0x7f92e813b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:06:13.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.059+0000 7f92ed209640 10 monclient(hunting): picked mon.noname-c con 0x7f92e80ade00 addr v2:172.21.15.156:3300/0 2023-11-05T08:06:13.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.059+0000 7f92ed209640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92e80b0cc0 con 0x7f92e80b38d0 2023-11-05T08:06:13.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.059+0000 7f92ed209640 10 monclient(hunting): start opening mon connection 2023-11-05T08:06:13.070 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.059+0000 7f92ed209640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92e80b4620 con 0x7f92e80b4240 2023-11-05T08:06:13.071 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.059+0000 7f92ed209640 10 monclient(hunting): start opening mon connection 2023-11-05T08:06:13.071 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.059+0000 7f92ed209640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92e80b1690 con 0x7f92e80ade00 2023-11-05T08:06:13.071 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.059+0000 7f92ed209640 10 monclient(hunting): _renew_subs 2023-11-05T08:06:13.072 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.059+0000 7f92ed209640 10 monclient(hunting): authenticate will time out at 1316.279232s 2023-11-05T08:06:13.072 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.060+0000 7f92e759e640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f92e80ade00 0x7f92e813b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:06:13.072 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.060+0000 7f92e6d9d640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f92e80b4240 0x7f92e80b1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:06:13.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.060+0000 7f92e759e640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f92e80ade00 0x7f92e813b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:56110/0 (socket says 172.21.15.156:56110) 2023-11-05T08:06:13.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.060+0000 7f92e759e640 1 -- 172.21.15.156:0/3879418943 learned_addr learned my addr 172.21.15.156:0/3879418943 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-11-05T08:06:13.073 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.060+0000 7f92e759e640 10 monclient(hunting): get_auth_request con 0x7f92e80ade00 auth_method 0 2023-11-05T08:06:13.074 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.060+0000 7f92e759e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:06:13.074 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.060+0000 7f92e759e640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:06:13.074 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.060+0000 7f92e759e640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:06:13.075 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.060+0000 7f92e6d9d640 10 monclient(hunting): get_auth_request con 0x7f92e80b4240 auth_method 0 2023-11-05T08:06:13.075 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.060+0000 7f92e6d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:06:13.075 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.060+0000 7f92e6d9d640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:06:13.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.060+0000 7f92e6d9d640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:06:13.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.061+0000 7f92e6d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:06:13.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.061+0000 7f92e6d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:06:13.076 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.061+0000 7f92e6d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:06:13.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.061+0000 7f92e759e640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:06:13.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.061+0000 7f92e759e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:06:13.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.061+0000 7f92e759e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:06:13.077 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.063+0000 7f92e759e640 10 monclient(hunting): handle_auth_done global_id 4132 payload 274 2023-11-05T08:06:13.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.063+0000 7f92e759e640 1 -- 172.21.15.156:0/3879418943 >> v2:172.21.15.52:3300/0 conn(0x7f92e80b4240 msgr2=0x7f92e80b1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-05T08:06:13.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.063+0000 7f92e759e640 1 --2- 172.21.15.156:0/3879418943 >> v2:172.21.15.52:3300/0 conn(0x7f92e80b4240 0x7f92e80b1150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:13.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.063+0000 7f92e759e640 1 -- 172.21.15.156:0/3879418943 >> v1:172.21.15.52:6789/0 conn(0x7f92e80b38d0 legacy=0x7f92e80ae640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:06:13.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.063+0000 7f92e759e640 10 monclient: _finish_hunting 0 2023-11-05T08:06:13.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.063+0000 7f92e759e640 1 monclient: found mon.noname-c 2023-11-05T08:06:13.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.063+0000 7f92e759e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:06:13.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.063+0000 7f92e759e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.156:3300/0 2023-11-05T08:06:13.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.063+0000 7f92e759e640 1 -- 172.21.15.156:0/3879418943 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92e813f5f0 con 0x7f92e80ade00 2023-11-05T08:06:13.080 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.066+0000 7f92e759e640 1 --2- 172.21.15.156:0/3879418943 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f92e80ade00 0x7f92e813b420 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f92e0009e50 tx=0x7f92e002bee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ab1d6f50067ad9d6 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:06:13.086 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.070+0000 7f92e5d9b640 1 -- 172.21.15.156:0/3879418943 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92e002ca80 con 0x7f92e80ade00 2023-11-05T08:06:13.086 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.070+0000 7f92e5d9b640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:06:13.086 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.070+0000 7f92e5d9b640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-11-05T08:06:13.086 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.070+0000 7f92e5d9b640 10 monclient: dump: 2023-11-05T08:06:13.087 INFO:teuthology.orchestra.run.smithi156.stderr:epoch 1 2023-11-05T08:06:13.087 INFO:teuthology.orchestra.run.smithi156.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:06:13.087 INFO:teuthology.orchestra.run.smithi156.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:13.087 INFO:teuthology.orchestra.run.smithi156.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:13.087 INFO:teuthology.orchestra.run.smithi156.stderr:min_mon_release 18 (reef) 2023-11-05T08:06:13.088 INFO:teuthology.orchestra.run.smithi156.stderr:election_strategy: 1 2023-11-05T08:06:13.088 INFO:teuthology.orchestra.run.smithi156.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:06:13.088 INFO:teuthology.orchestra.run.smithi156.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:06:13.088 INFO:teuthology.orchestra.run.smithi156.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:06:13.088 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-05T08:06:13.088 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.070+0000 7f92e5d9b640 10 monclient: _finish_auth 0 2023-11-05T08:06:13.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.070+0000 7f92e5d9b640 10 monclient: _check_auth_tickets 2023-11-05T08:06:13.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.070+0000 7f92e5d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:06:13.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.070+0000 7f92e5d9b640 1 -- 172.21.15.156:0/3879418943 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92e002cbe0 con 0x7f92e80ade00 2023-11-05T08:06:13.089 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.070+0000 7f92e5d9b640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:06:13.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.070+0000 7f92e5d9b640 1 -- 172.21.15.156:0/3879418943 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92e00343f0 con 0x7f92e80ade00 2023-11-05T08:06:13.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.070+0000 7f92ed209640 5 monclient: authenticate success, global_id 4132 2023-11-05T08:06:13.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.070+0000 7f92e5d9b640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:06:13.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.070+0000 7f92e5d9b640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-05T08:06:13.091 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.070+0000 7f92e5d9b640 10 monclient: dump: 2023-11-05T08:06:13.091 INFO:teuthology.orchestra.run.smithi156.stderr:epoch 1 2023-11-05T08:06:13.091 INFO:teuthology.orchestra.run.smithi156.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:06:13.091 INFO:teuthology.orchestra.run.smithi156.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:13.091 INFO:teuthology.orchestra.run.smithi156.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:13.092 INFO:teuthology.orchestra.run.smithi156.stderr:min_mon_release 18 (reef) 2023-11-05T08:06:13.092 INFO:teuthology.orchestra.run.smithi156.stderr:election_strategy: 1 2023-11-05T08:06:13.092 INFO:teuthology.orchestra.run.smithi156.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:06:13.092 INFO:teuthology.orchestra.run.smithi156.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:06:13.093 INFO:teuthology.orchestra.run.smithi156.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:06:13.093 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-05T08:06:13.093 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.070+0000 7f92ed209640 10 monclient: get_monmap_and_config success 2023-11-05T08:06:13.093 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.070+0000 7f92ed209640 4 set_mon_vals no callback set 2023-11-05T08:06:13.093 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.071+0000 7f92ed209640 10 monclient: shutdown 2023-11-05T08:06:13.093 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.071+0000 7f92ed209640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:06:13.094 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.071+0000 7f92ed209640 1 -- 172.21.15.156:0/3879418943 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f92e80ade00 msgr2=0x7f92e813b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:06:13.094 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.071+0000 7f92ed209640 1 --2- 172.21.15.156:0/3879418943 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f92e80ade00 0x7f92e813b420 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f92e0009e50 tx=0x7f92e002bee0 comp rx=0 tx=0).stop 2023-11-05T08:06:13.094 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.071+0000 7f92ed209640 1 -- 172.21.15.156:0/3879418943 shutdown_connections 2023-11-05T08:06:13.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.071+0000 7f92ed209640 1 --2- 172.21.15.156:0/3879418943 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f92e80ade00 0x7f92e813b420 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:13.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.071+0000 7f92ed209640 1 --2- 172.21.15.156:0/3879418943 >> v2:172.21.15.52:3300/0 conn(0x7f92e80b4240 0x7f92e80b1150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:13.095 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.071+0000 7f92ed209640 1 -- 172.21.15.156:0/3879418943 >> 172.21.15.156:0/3879418943 conn(0x7f92e8065cd0 msgr2=0x7f92e80660e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:06:13.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.071+0000 7f92ed209640 1 -- 172.21.15.156:0/3879418943 shutdown_connections 2023-11-05T08:06:13.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.071+0000 7f92ed209640 1 -- 172.21.15.156:0/3879418943 wait complete. 2023-11-05T08:06:13.096 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.072+0000 7f92ed209640 10 monclient: build_initial_monmap 2023-11-05T08:06:13.097 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.072+0000 7f92ed209640 10 monclient: monmap: 2023-11-05T08:06:13.097 INFO:teuthology.orchestra.run.smithi156.stderr:epoch 0 2023-11-05T08:06:13.098 INFO:teuthology.orchestra.run.smithi156.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-05T08:06:13.098 INFO:teuthology.orchestra.run.smithi156.stderr:last_changed 0.000000 2023-11-05T08:06:13.098 INFO:teuthology.orchestra.run.smithi156.stderr:created 0.000000 2023-11-05T08:06:13.099 INFO:teuthology.orchestra.run.smithi156.stderr:min_mon_release 0 (unknown) 2023-11-05T08:06:13.099 INFO:teuthology.orchestra.run.smithi156.stderr:election_strategy: 1 2023-11-05T08:06:13.099 INFO:teuthology.orchestra.run.smithi156.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.noname-a 2023-11-05T08:06:13.100 INFO:teuthology.orchestra.run.smithi156.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.noname-b 2023-11-05T08:06:13.100 INFO:teuthology.orchestra.run.smithi156.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-c 2023-11-05T08:06:13.100 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-05T08:06:13.101 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.072+0000 7f92ed209640 1 librados: starting msgr at 2023-11-05T08:06:13.101 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.072+0000 7f92ed209640 1 librados: starting objecter 2023-11-05T08:06:13.101 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.072+0000 7f92ed209640 1 Processor -- start 2023-11-05T08:06:13.102 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.073+0000 7f92ed209640 1 -- start start 2023-11-05T08:06:13.102 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.073+0000 7f92ed209640 1 librados: setting wanted keys 2023-11-05T08:06:13.102 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.073+0000 7f92ed209640 1 librados: calling monclient init 2023-11-05T08:06:13.102 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.073+0000 7f92ed209640 10 monclient: init 2023-11-05T08:06:13.102 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.073+0000 7f92ed209640 10 monclient: _reopen_session rank -1 2023-11-05T08:06:13.103 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.073+0000 7f92ed209640 10 monclient: _add_conns ranks=[0,1,2] 2023-11-05T08:06:13.103 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.073+0000 7f92ed209640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f92e80ade00 0x7f92e8144b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:06:13.103 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.073+0000 7f92ed209640 10 monclient(hunting): picked mon.noname-a con 0x7f92e80ade00 addr [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] 2023-11-05T08:06:13.103 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.073+0000 7f92ed209640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f92e80b4240 0x7f92e813db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:06:13.103 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.073+0000 7f92ed209640 10 monclient(hunting): picked mon.noname-b con 0x7f92e80b4240 addr [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] 2023-11-05T08:06:13.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.073+0000 7f92ed209640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f92e81d6580 0x7f92e81d6a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:06:13.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.073+0000 7f92ed209640 10 monclient(hunting): picked mon.noname-c con 0x7f92e81d6580 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:06:13.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.073+0000 7f92ed209640 10 monclient(hunting): start opening mon connection 2023-11-05T08:06:13.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.073+0000 7f92ed209640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92e813e4b0 con 0x7f92e80ade00 2023-11-05T08:06:13.104 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.073+0000 7f92ed209640 10 monclient(hunting): start opening mon connection 2023-11-05T08:06:13.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.073+0000 7f92ed209640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92e813e0d0 con 0x7f92e80b4240 2023-11-05T08:06:13.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.073+0000 7f92ed209640 10 monclient(hunting): start opening mon connection 2023-11-05T08:06:13.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.073+0000 7f92ed209640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92e813d260 con 0x7f92e81d6580 2023-11-05T08:06:13.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.073+0000 7f92ed209640 10 monclient(hunting): _renew_subs 2023-11-05T08:06:13.105 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.073+0000 7f92ed209640 10 monclient(hunting): authenticate will time out at 1316.293449s 2023-11-05T08:06:13.106 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.074+0000 7f92e659c640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f92e80b4240 0x7f92e813db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:06:13.106 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.074+0000 7f92e759e640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f92e81d6580 0x7f92e81d6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:06:13.106 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.074+0000 7f92e6d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f92e80ade00 0x7f92e8144b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:06:13.106 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.074+0000 7f92e759e640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f92e81d6580 0x7f92e81d6a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.156:46860/0 (socket says 172.21.15.156:46860) 2023-11-05T08:06:13.106 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.074+0000 7f92e759e640 1 -- 172.21.15.156:0/666122951 learned_addr learned my addr 172.21.15.156:0/666122951 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-11-05T08:06:13.107 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.074+0000 7f92e759e640 10 monclient(hunting): get_auth_request con 0x7f92e81d6580 auth_method 0 2023-11-05T08:06:13.107 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.074+0000 7f92e759e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:06:13.107 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.074+0000 7f92e759e640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:06:13.107 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.074+0000 7f92e759e640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:06:13.109 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.074+0000 7f92e659c640 10 monclient(hunting): get_auth_request con 0x7f92e80b4240 auth_method 0 2023-11-05T08:06:13.109 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.074+0000 7f92e659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:06:13.110 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.074+0000 7f92e659c640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:06:13.110 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.074+0000 7f92e659c640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:06:13.110 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.074+0000 7f92e6d9d640 10 monclient(hunting): get_auth_request con 0x7f92e80ade00 auth_method 0 2023-11-05T08:06:13.110 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.074+0000 7f92e6d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:06:13.111 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.074+0000 7f92e6d9d640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:06:13.111 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.074+0000 7f92e6d9d640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:06:13.111 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.075+0000 7f92e759e640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:06:13.111 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.075+0000 7f92e759e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:06:13.111 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.075+0000 7f92e759e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:06:13.111 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.075+0000 7f92e6d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:06:13.112 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.075+0000 7f92e6d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:06:13.112 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.075+0000 7f92e6d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:06:13.112 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.075+0000 7f92e659c640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:06:13.113 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.075+0000 7f92e659c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:06:13.113 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.075+0000 7f92e659c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:06:13.113 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.077+0000 7f92e759e640 10 monclient(hunting): handle_auth_done global_id 4118 payload 824 2023-11-05T08:06:13.113 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.077+0000 7f92e759e640 1 -- 172.21.15.156:0/666122951 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f92e80b4240 msgr2=0x7f92e813db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:06:13.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.077+0000 7f92e759e640 1 --2- 172.21.15.156:0/666122951 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f92e80b4240 0x7f92e813db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:13.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.077+0000 7f92e759e640 1 -- 172.21.15.156:0/666122951 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f92e80ade00 msgr2=0x7f92e8144b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:06:13.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.077+0000 7f92e759e640 1 --2- 172.21.15.156:0/666122951 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f92e80ade00 0x7f92e8144b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:13.114 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.077+0000 7f92e759e640 10 monclient: _finish_hunting 0 2023-11-05T08:06:13.115 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.077+0000 7f92e759e640 1 monclient: found mon.noname-c 2023-11-05T08:06:13.115 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.077+0000 7f92e759e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:06:13.115 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.077+0000 7f92e759e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.52:3301/0 2023-11-05T08:06:13.116 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.077+0000 7f92e759e640 1 -- 172.21.15.156:0/666122951 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92e0009b30 con 0x7f92e81d6580 2023-11-05T08:06:13.116 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.080+0000 7f92e759e640 1 --2- 172.21.15.156:0/666122951 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f92e81d6580 0x7f92e81d6a30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f92e0009e50 tx=0x7f92e0004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:06:13.116 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.080+0000 7f92cf7fe640 10 client.?.objecter ms_handle_connect 0x7f92e81d6580 2023-11-05T08:06:13.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.080+0000 7f92cf7fe640 10 client.?.objecter resend_mon_ops 2023-11-05T08:06:13.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.083+0000 7f92cf7fe640 1 -- 172.21.15.156:0/666122951 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92e003e450 con 0x7f92e81d6580 2023-11-05T08:06:13.117 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.083+0000 7f92cf7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:06:13.118 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.083+0000 7f92cf7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-11-05T08:06:13.118 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.083+0000 7f92cf7fe640 10 monclient: dump: 2023-11-05T08:06:13.118 INFO:teuthology.orchestra.run.smithi156.stderr:epoch 1 2023-11-05T08:06:13.119 INFO:teuthology.orchestra.run.smithi156.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:06:13.119 INFO:teuthology.orchestra.run.smithi156.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:13.119 INFO:teuthology.orchestra.run.smithi156.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:13.119 INFO:teuthology.orchestra.run.smithi156.stderr:min_mon_release 18 (reef) 2023-11-05T08:06:13.120 INFO:teuthology.orchestra.run.smithi156.stderr:election_strategy: 1 2023-11-05T08:06:13.120 INFO:teuthology.orchestra.run.smithi156.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:06:13.120 INFO:teuthology.orchestra.run.smithi156.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:06:13.120 INFO:teuthology.orchestra.run.smithi156.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:06:13.121 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-05T08:06:13.121 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.083+0000 7f92cf7fe640 10 monclient: _finish_auth 0 2023-11-05T08:06:13.121 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.083+0000 7f92cf7fe640 10 monclient: _check_auth_tickets 2023-11-05T08:06:13.121 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.083+0000 7f92cf7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:06:13.121 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.083+0000 7f92cf7fe640 1 -- 172.21.15.156:0/666122951 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92e003e5b0 con 0x7f92e81d6580 2023-11-05T08:06:13.122 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.083+0000 7f92ed209640 5 monclient: authenticate success, global_id 4118 2023-11-05T08:06:13.122 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.083+0000 7f92cf7fe640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:06:13.122 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.083+0000 7f92cf7fe640 1 -- 172.21.15.156:0/666122951 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92e003e960 con 0x7f92e81d6580 2023-11-05T08:06:13.122 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.083+0000 7f92ed209640 10 monclient: _renew_subs 2023-11-05T08:06:13.122 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.083+0000 7f92ed209640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.52:3301/0 2023-11-05T08:06:13.123 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.083+0000 7f92ed209640 1 -- 172.21.15.156:0/666122951 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92e813d480 con 0x7f92e81d6580 2023-11-05T08:06:13.123 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.083+0000 7f92e559a640 4 set_mon_vals no callback set 2023-11-05T08:06:13.123 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.083+0000 7f92cf7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:06:13.123 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.083+0000 7f92cf7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-11-05T08:06:13.123 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.083+0000 7f92cf7fe640 10 monclient: dump: 2023-11-05T08:06:13.124 INFO:teuthology.orchestra.run.smithi156.stderr:epoch 1 2023-11-05T08:06:13.124 INFO:teuthology.orchestra.run.smithi156.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:06:13.124 INFO:teuthology.orchestra.run.smithi156.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:13.124 INFO:teuthology.orchestra.run.smithi156.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:13.124 INFO:teuthology.orchestra.run.smithi156.stderr:min_mon_release 18 (reef) 2023-11-05T08:06:13.124 INFO:teuthology.orchestra.run.smithi156.stderr:election_strategy: 1 2023-11-05T08:06:13.125 INFO:teuthology.orchestra.run.smithi156.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:06:13.125 INFO:teuthology.orchestra.run.smithi156.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:06:13.125 INFO:teuthology.orchestra.run.smithi156.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:06:13.125 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-05T08:06:13.125 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.083+0000 7f92ed209640 10 client.4118.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-05T08:06:13.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.083+0000 7f92ed209640 10 monclient: _renew_subs 2023-11-05T08:06:13.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.083+0000 7f92ed209640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.52:3301/0 2023-11-05T08:06:13.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.083+0000 7f92ed209640 1 -- 172.21.15.156:0/666122951 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92e81d7150 con 0x7f92e81d6580 2023-11-05T08:06:13.126 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.083+0000 7f92ed209640 1 librados: init done 2023-11-05T08:06:13.127 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.084+0000 7f92ed209640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-05T08:06:13.127 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.084+0000 7f92ed209640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:06:13.127 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.084+0000 7f92ed209640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.52:3301/0 2023-11-05T08:06:13.127 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.084+0000 7f92ed209640 1 -- 172.21.15.156:0/666122951 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92e813e5f0 con 0x7f92e81d6580 2023-11-05T08:06:13.128 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-11-05T08:06:13.103+0000 7f4a6604a040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-05T08:06:13.128 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-11-05T08:06:13.113+0000 7f1369430040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-05T08:06:13.155 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-11-05T08:06:13.154+0000 7f1369430040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-05T08:06:13.185 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.184+0000 7f92cf7fe640 1 -- 172.21.15.156:0/666122951 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f92e002cd50 con 0x7f92e81d6580 2023-11-05T08:06:13.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.188+0000 7f92cf7fe640 1 -- 172.21.15.156:0/666122951 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f92e0051b90 con 0x7f92e81d6580 2023-11-05T08:06:13.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.188+0000 7f92cf7fe640 10 client.4118.objecter ms_dispatch 0x7f92e8000b90 osd_map(5..5 src has 1..5) v4 2023-11-05T08:06:13.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.188+0000 7f92cf7fe640 3 client.4118.objecter handle_osd_map got epochs [5,5] > 0 2023-11-05T08:06:13.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.188+0000 7f92cf7fe640 3 client.4118.objecter handle_osd_map decoding full epoch 5 2023-11-05T08:06:13.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.188+0000 7f92cf7fe640 20 client.4118.objecter dump_active .. 0 homeless 2023-11-05T08:06:13.190 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.188+0000 7f92cf7fe640 1 -- 172.21.15.156:0/666122951 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f92e813e5f0 con 0x7f92e81d6580 2023-11-05T08:06:13.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.188+0000 7f92cf7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:06:13.191 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.188+0000 7f92cf7fe640 10 monclient: _finish_command 1 = system:0 2023-11-05T08:06:13.205 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-11-05T08:06:13.204+0000 7f4a6604a040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-05T08:06:13.266 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.265+0000 7f92ed209640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "9ffcbf5b-1afd-4777-825f-c5fb551b9d88", "id": 3}] 2023-11-05T08:06:13.267 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.265+0000 7f92ed209640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "9ffcbf5b-1afd-4777-825f-c5fb551b9d88", "id": 3}] 2023-11-05T08:06:13.267 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.265+0000 7f92ed209640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.52:3301/0 2023-11-05T08:06:13.267 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.265+0000 7f92ed209640 1 -- 172.21.15.156:0/666122951 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "osd new", "uuid": "9ffcbf5b-1afd-4777-825f-c5fb551b9d88", "id": 3} v 0) v1 -- 0x7f92e804e9f0 con 0x7f92e81d6580 2023-11-05T08:06:13.303 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-11-05T08:06:13.302+0000 7f1369430040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-05T08:06:13.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.353+0000 7f92cf7fe640 1 -- 172.21.15.156:0/666122951 <== mon.2 v2:172.21.15.52:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9ffcbf5b-1afd-4777-825f-c5fb551b9d88", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f92e0055020 con 0x7f92e81d6580 2023-11-05T08:06:13.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.353+0000 7f92cf7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "9ffcbf5b-1afd-4777-825f-c5fb551b9d88", "id": 3}] 2023-11-05T08:06:13.354 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.353+0000 7f92cf7fe640 10 monclient: _finish_command 2 = system:0 2023-11-05T08:06:13.355 INFO:teuthology.orchestra.run.smithi156.stdout:3 2023-11-05T08:06:13.356 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.353+0000 7f92ed209640 10 librados: watch_flush enter 2023-11-05T08:06:13.356 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.353+0000 7f92ed209640 10 librados: watch_flush exit 2023-11-05T08:06:13.357 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.353+0000 7f92ed209640 20 client.4118.objecter shutdown clearing up homeless session... 2023-11-05T08:06:13.357 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.353+0000 7f92ed209640 10 client.4118.objecter successfully canceled tick 2023-11-05T08:06:13.357 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.354+0000 7f92ed209640 10 monclient: shutdown 2023-11-05T08:06:13.357 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.354+0000 7f92ed209640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:06:13.357 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.354+0000 7f92ed209640 1 -- 172.21.15.156:0/666122951 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f92e81d6580 msgr2=0x7f92e81d6a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:06:13.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.354+0000 7f92ed209640 1 --2- 172.21.15.156:0/666122951 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f92e81d6580 0x7f92e81d6a30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f92e0009e50 tx=0x7f92e0004a40 comp rx=0 tx=0).stop 2023-11-05T08:06:13.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.354+0000 7f92ed209640 1 -- 172.21.15.156:0/666122951 shutdown_connections 2023-11-05T08:06:13.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.354+0000 7f92ed209640 1 --2- 172.21.15.156:0/666122951 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f92e81d6580 0x7f92e81d6a30 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:13.358 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.354+0000 7f92ed209640 1 --2- 172.21.15.156:0/666122951 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f92e80b4240 0x7f92e813db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:13.359 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.354+0000 7f92ed209640 1 --2- 172.21.15.156:0/666122951 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f92e80ade00 0x7f92e8144b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:13.359 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.354+0000 7f92ed209640 1 -- 172.21.15.156:0/666122951 >> 172.21.15.156:0/666122951 conn(0x7f92e8065cd0 msgr2=0x7f92e80b2a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:06:13.359 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.354+0000 7f92ed209640 1 -- 172.21.15.156:0/666122951 shutdown_connections 2023-11-05T08:06:13.359 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.354+0000 7f92ed209640 1 -- 172.21.15.156:0/666122951 wait complete. 2023-11-05T08:06:13.360 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.354+0000 7f92ed209640 1 librados: shutdown 2023-11-05T08:06:13.365 DEBUG:teuthology.orchestra.run.smithi156:> sudo ceph --cluster ceph osd new 3f5f9aa4-2015-4835-9b39-faf459a35a49 4 2023-11-05T08:06:13.368 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-11-05T08:06:13.366+0000 7f4a6604a040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-05T08:06:13.412 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-11-05T08:06:13.410+0000 7f4a6604a040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-05T08:06:13.464 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.463+0000 7f28d6010640 10 monclient: get_monmap_and_config 2023-11-05T08:06:13.465 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.463+0000 7f28d6010640 10 monclient: build_initial_monmap 2023-11-05T08:06:13.465 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.463+0000 7f28d6010640 10 monclient: monmap: 2023-11-05T08:06:13.465 INFO:teuthology.orchestra.run.smithi156.stderr:epoch 0 2023-11-05T08:06:13.465 INFO:teuthology.orchestra.run.smithi156.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:06:13.466 INFO:teuthology.orchestra.run.smithi156.stderr:last_changed 2023-11-05T08:06:13.464934+0000 2023-11-05T08:06:13.466 INFO:teuthology.orchestra.run.smithi156.stderr:created 2023-11-05T08:06:13.464934+0000 2023-11-05T08:06:13.466 INFO:teuthology.orchestra.run.smithi156.stderr:min_mon_release 0 (unknown) 2023-11-05T08:06:13.466 INFO:teuthology.orchestra.run.smithi156.stderr:election_strategy: 1 2023-11-05T08:06:13.467 INFO:teuthology.orchestra.run.smithi156.stderr:0: v1:172.21.15.52:6789/0 mon.noname-a-legacy 2023-11-05T08:06:13.467 INFO:teuthology.orchestra.run.smithi156.stderr:1: v1:172.21.15.156:6789/0 mon.noname-c-legacy 2023-11-05T08:06:13.467 INFO:teuthology.orchestra.run.smithi156.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-b 2023-11-05T08:06:13.467 INFO:teuthology.orchestra.run.smithi156.stderr:3: v2:172.21.15.52:3300/0 mon.noname-a 2023-11-05T08:06:13.467 INFO:teuthology.orchestra.run.smithi156.stderr:4: v2:172.21.15.156:3300/0 mon.noname-c 2023-11-05T08:06:13.468 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-05T08:06:13.470 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.464+0000 7f28d6010640 1 Processor -- start 2023-11-05T08:06:13.470 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.464+0000 7f28d6010640 1 -- start start 2023-11-05T08:06:13.470 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.464+0000 7f28d6010640 10 monclient: init 2023-11-05T08:06:13.470 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.465+0000 7f28d6010640 10 monclient: _reopen_session rank -1 2023-11-05T08:06:13.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.465+0000 7f28d6010640 10 monclient: _add_conns ranks=[1,0,2,4,3] 2023-11-05T08:06:13.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.465+0000 7f28d6010640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f28d00b4240 addr v1:172.21.15.156:6789/0 2023-11-05T08:06:13.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.465+0000 7f28d6010640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f28d00b38d0 addr v1:172.21.15.52:6789/0 2023-11-05T08:06:13.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.465+0000 7f28d6010640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f28d00ade00 0x7f28d013b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:06:13.471 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.465+0000 7f28d6010640 10 monclient(hunting): picked mon.noname-b con 0x7f28d00ade00 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:06:13.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.465+0000 7f28d6010640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28d00b0cc0 con 0x7f28d00b38d0 2023-11-05T08:06:13.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.465+0000 7f28d6010640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28d013f5f0 con 0x7f28d00b4240 2023-11-05T08:06:13.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.465+0000 7f28d6010640 10 monclient(hunting): start opening mon connection 2023-11-05T08:06:13.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.465+0000 7f28d6010640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28d00b4620 con 0x7f28d00ade00 2023-11-05T08:06:13.472 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.465+0000 7f28d6010640 10 monclient(hunting): _renew_subs 2023-11-05T08:06:13.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.465+0000 7f28d6010640 10 monclient(hunting): authenticate will time out at 1316.685238s 2023-11-05T08:06:13.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.465+0000 7f28cffff640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f28d00ade00 0x7f28d013b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:06:13.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.466+0000 7f28ceffd640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f28d00b38d0 0x7f28d00ae640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.156:58176/0 (socket says 172.21.15.156:58176) 2023-11-05T08:06:13.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.466+0000 7f28ceffd640 1 -- 172.21.15.156:0/1303159375 learned_addr learned my addr 172.21.15.156:0/1303159375 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-11-05T08:06:13.473 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.466+0000 7f28cffff640 10 monclient(hunting): get_auth_request con 0x7f28d00ade00 auth_method 0 2023-11-05T08:06:13.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.466+0000 7f28cffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:06:13.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.466+0000 7f28cffff640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:06:13.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.466+0000 7f28cffff640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:06:13.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.466+0000 7f28cffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:06:13.474 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.466+0000 7f28cffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:06:13.475 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.466+0000 7f28cffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:06:13.475 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.468+0000 7f28cffff640 10 monclient(hunting): handle_auth_done global_id 4121 payload 274 2023-11-05T08:06:13.475 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.468+0000 7f28cffff640 1 -- 172.21.15.156:0/1303159375 >> v1:172.21.15.156:6789/0 conn(0x7f28d00b4240 legacy=0x7f28d00b1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:06:13.475 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.468+0000 7f28cffff640 1 -- 172.21.15.156:0/1303159375 >> v1:172.21.15.52:6789/0 conn(0x7f28d00b38d0 legacy=0x7f28d00ae640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:06:13.475 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.468+0000 7f28cffff640 10 monclient: _finish_hunting 0 2023-11-05T08:06:13.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.468+0000 7f28cffff640 1 monclient: found mon.noname-b 2023-11-05T08:06:13.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.468+0000 7f28cffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:06:13.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.468+0000 7f28cffff640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.52:3301/0 2023-11-05T08:06:13.476 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.468+0000 7f28cffff640 1 -- 172.21.15.156:0/1303159375 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28d013b960 con 0x7f28d00ade00 2023-11-05T08:06:13.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.470+0000 7f28cffff640 1 --2- 172.21.15.156:0/1303159375 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f28d00ade00 0x7f28d013b420 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f28c8009df0 tx=0x7f28c802be70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da6a85dea54f3ffe server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:06:13.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.474+0000 7f28ce7fc640 1 -- 172.21.15.156:0/1303159375 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c802cc20 con 0x7f28d00ade00 2023-11-05T08:06:13.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.474+0000 7f28ce7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:06:13.481 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.474+0000 7f28ce7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-05T08:06:13.481 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.474+0000 7f28ce7fc640 10 monclient: dump: 2023-11-05T08:06:13.481 INFO:teuthology.orchestra.run.smithi156.stderr:epoch 1 2023-11-05T08:06:13.481 INFO:teuthology.orchestra.run.smithi156.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:06:13.481 INFO:teuthology.orchestra.run.smithi156.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:13.482 INFO:teuthology.orchestra.run.smithi156.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:13.482 INFO:teuthology.orchestra.run.smithi156.stderr:min_mon_release 18 (reef) 2023-11-05T08:06:13.482 INFO:teuthology.orchestra.run.smithi156.stderr:election_strategy: 1 2023-11-05T08:06:13.482 INFO:teuthology.orchestra.run.smithi156.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:06:13.482 INFO:teuthology.orchestra.run.smithi156.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:06:13.483 INFO:teuthology.orchestra.run.smithi156.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:06:13.483 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-05T08:06:13.483 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.474+0000 7f28ce7fc640 10 monclient: _finish_auth 0 2023-11-05T08:06:13.483 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.474+0000 7f28ce7fc640 10 monclient: _check_auth_tickets 2023-11-05T08:06:13.483 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.474+0000 7f28ce7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:06:13.483 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.474+0000 7f28ce7fc640 1 -- 172.21.15.156:0/1303159375 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28c802cd80 con 0x7f28d00ade00 2023-11-05T08:06:13.484 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.474+0000 7f28ce7fc640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:06:13.484 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.474+0000 7f28ce7fc640 1 -- 172.21.15.156:0/1303159375 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c8034660 con 0x7f28d00ade00 2023-11-05T08:06:13.484 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.474+0000 7f28d6010640 5 monclient: authenticate success, global_id 4121 2023-11-05T08:06:13.484 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.474+0000 7f28d6010640 10 monclient: get_monmap_and_config success 2023-11-05T08:06:13.484 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.474+0000 7f28d6010640 4 set_mon_vals no callback set 2023-11-05T08:06:13.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.474+0000 7f28ce7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:06:13.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.474+0000 7f28ce7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-11-05T08:06:13.485 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.474+0000 7f28ce7fc640 10 monclient: dump: 2023-11-05T08:06:13.485 INFO:teuthology.orchestra.run.smithi156.stderr:epoch 1 2023-11-05T08:06:13.485 INFO:teuthology.orchestra.run.smithi156.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:06:13.486 INFO:teuthology.orchestra.run.smithi156.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:13.486 INFO:teuthology.orchestra.run.smithi156.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:13.486 INFO:teuthology.orchestra.run.smithi156.stderr:min_mon_release 18 (reef) 2023-11-05T08:06:13.486 INFO:teuthology.orchestra.run.smithi156.stderr:election_strategy: 1 2023-11-05T08:06:13.486 INFO:teuthology.orchestra.run.smithi156.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:06:13.487 INFO:teuthology.orchestra.run.smithi156.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:06:13.487 INFO:teuthology.orchestra.run.smithi156.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:06:13.487 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-05T08:06:13.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.475+0000 7f28d6010640 10 monclient: shutdown 2023-11-05T08:06:13.487 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.475+0000 7f28d6010640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:06:13.488 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.475+0000 7f28d6010640 1 -- 172.21.15.156:0/1303159375 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f28d00ade00 msgr2=0x7f28d013b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:06:13.488 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.475+0000 7f28d6010640 1 --2- 172.21.15.156:0/1303159375 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f28d00ade00 0x7f28d013b420 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f28c8009df0 tx=0x7f28c802be70 comp rx=0 tx=0).stop 2023-11-05T08:06:13.488 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.475+0000 7f28d6010640 1 -- 172.21.15.156:0/1303159375 shutdown_connections 2023-11-05T08:06:13.488 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.475+0000 7f28d6010640 1 --2- 172.21.15.156:0/1303159375 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f28d00ade00 0x7f28d013b420 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:13.488 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.475+0000 7f28d6010640 1 -- 172.21.15.156:0/1303159375 >> 172.21.15.156:0/1303159375 conn(0x7f28d0065cd0 msgr2=0x7f28d00660e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:06:13.489 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.475+0000 7f28d6010640 1 -- 172.21.15.156:0/1303159375 shutdown_connections 2023-11-05T08:06:13.489 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.475+0000 7f28d6010640 1 -- 172.21.15.156:0/1303159375 wait complete. 2023-11-05T08:06:13.489 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.475+0000 7f28d6010640 10 monclient: build_initial_monmap 2023-11-05T08:06:13.489 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.475+0000 7f28d6010640 10 monclient: monmap: 2023-11-05T08:06:13.489 INFO:teuthology.orchestra.run.smithi156.stderr:epoch 0 2023-11-05T08:06:13.490 INFO:teuthology.orchestra.run.smithi156.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-05T08:06:13.490 INFO:teuthology.orchestra.run.smithi156.stderr:last_changed 0.000000 2023-11-05T08:06:13.490 INFO:teuthology.orchestra.run.smithi156.stderr:created 0.000000 2023-11-05T08:06:13.490 INFO:teuthology.orchestra.run.smithi156.stderr:min_mon_release 0 (unknown) 2023-11-05T08:06:13.490 INFO:teuthology.orchestra.run.smithi156.stderr:election_strategy: 1 2023-11-05T08:06:13.491 INFO:teuthology.orchestra.run.smithi156.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.noname-a 2023-11-05T08:06:13.491 INFO:teuthology.orchestra.run.smithi156.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.noname-b 2023-11-05T08:06:13.491 INFO:teuthology.orchestra.run.smithi156.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-c 2023-11-05T08:06:13.491 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-05T08:06:13.491 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.476+0000 7f28d6010640 1 librados: starting msgr at 2023-11-05T08:06:13.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.476+0000 7f28d6010640 1 librados: starting objecter 2023-11-05T08:06:13.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.476+0000 7f28d6010640 1 Processor -- start 2023-11-05T08:06:13.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.476+0000 7f28d6010640 1 -- start start 2023-11-05T08:06:13.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.476+0000 7f28d6010640 1 librados: setting wanted keys 2023-11-05T08:06:13.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.476+0000 7f28d6010640 1 librados: calling monclient init 2023-11-05T08:06:13.492 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.476+0000 7f28d6010640 10 monclient: init 2023-11-05T08:06:13.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.476+0000 7f28d6010640 10 monclient: _reopen_session rank -1 2023-11-05T08:06:13.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.476+0000 7f28d6010640 10 monclient: _add_conns ranks=[1,2,0] 2023-11-05T08:06:13.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.476+0000 7f28d6010640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f28d00ade00 0x7f28d013d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:06:13.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.476+0000 7f28d6010640 10 monclient(hunting): picked mon.noname-b con 0x7f28d00ade00 addr [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] 2023-11-05T08:06:13.493 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.476+0000 7f28d6010640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f28d00b4240 0x7f28d01da280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:06:13.494 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.476+0000 7f28d6010640 10 monclient(hunting): picked mon.noname-c con 0x7f28d00b4240 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:06:13.494 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.476+0000 7f28d6010640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f28d0143d50 0x7f28d0133510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:06:13.494 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.476+0000 7f28d6010640 10 monclient(hunting): picked mon.noname-a con 0x7f28d0143d50 addr [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] 2023-11-05T08:06:13.494 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.476+0000 7f28d6010640 10 monclient(hunting): start opening mon connection 2023-11-05T08:06:13.494 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.476+0000 7f28d6010640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28d01d9d80 con 0x7f28d0143d50 2023-11-05T08:06:13.495 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.476+0000 7f28d6010640 10 monclient(hunting): start opening mon connection 2023-11-05T08:06:13.495 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.476+0000 7f28d6010640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28d0145be0 con 0x7f28d00ade00 2023-11-05T08:06:13.495 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.476+0000 7f28d6010640 10 monclient(hunting): start opening mon connection 2023-11-05T08:06:13.495 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.476+0000 7f28d6010640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28d013c050 con 0x7f28d00b4240 2023-11-05T08:06:13.495 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.476+0000 7f28d6010640 10 monclient(hunting): _renew_subs 2023-11-05T08:06:13.496 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.476+0000 7f28d6010640 10 monclient(hunting): authenticate will time out at 1316.696769s 2023-11-05T08:06:13.496 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.477+0000 7f28ceffd640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f28d00b4240 0x7f28d01da280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:06:13.496 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.477+0000 7f28cf7fe640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f28d00ade00 0x7f28d013d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:06:13.496 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.477+0000 7f28ceffd640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f28d00b4240 0x7f28d01da280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.156:46876/0 (socket says 172.21.15.156:46876) 2023-11-05T08:06:13.496 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.477+0000 7f28ceffd640 1 -- 172.21.15.156:0/3474425028 learned_addr learned my addr 172.21.15.156:0/3474425028 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-11-05T08:06:13.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.477+0000 7f28ceffd640 10 monclient(hunting): get_auth_request con 0x7f28d00b4240 auth_method 0 2023-11-05T08:06:13.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.477+0000 7f28ceffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:06:13.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.477+0000 7f28ceffd640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:06:13.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.477+0000 7f28ceffd640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:06:13.497 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.477+0000 7f28cf7fe640 10 monclient(hunting): get_auth_request con 0x7f28d00ade00 auth_method 0 2023-11-05T08:06:13.498 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.477+0000 7f28cf7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:06:13.498 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.477+0000 7f28cf7fe640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:06:13.498 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.477+0000 7f28cf7fe640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:06:13.498 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.478+0000 7f28ceffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:06:13.498 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.478+0000 7f28ceffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:06:13.499 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.478+0000 7f28ceffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:06:13.499 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.478+0000 7f28cf7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:06:13.499 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.478+0000 7f28cf7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:06:13.499 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.478+0000 7f28cf7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:06:13.499 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.478+0000 7f28cffff640 1 --2- 172.21.15.156:0/3474425028 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f28d0143d50 0x7f28d0133510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:06:13.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.478+0000 7f28cffff640 10 monclient(hunting): get_auth_request con 0x7f28d0143d50 auth_method 0 2023-11-05T08:06:13.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.478+0000 7f28cffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:06:13.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.478+0000 7f28cffff640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:06:13.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.478+0000 7f28cffff640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:06:13.500 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.479+0000 7f28cffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:06:13.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.479+0000 7f28cffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:06:13.501 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.479+0000 7f28cffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:06:13.502 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.480+0000 7f28ceffd640 10 monclient(hunting): handle_auth_done global_id 4124 payload 824 2023-11-05T08:06:13.503 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.480+0000 7f28ceffd640 1 -- 172.21.15.156:0/3474425028 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f28d00ade00 msgr2=0x7f28d013d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:06:13.503 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.480+0000 7f28ceffd640 1 --2- 172.21.15.156:0/3474425028 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f28d00ade00 0x7f28d013d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:13.503 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.481+0000 7f28ceffd640 1 -- 172.21.15.156:0/3474425028 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f28d0143d50 msgr2=0x7f28d0133510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:06:13.503 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.481+0000 7f28ceffd640 1 --2- 172.21.15.156:0/3474425028 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f28d0143d50 0x7f28d0133510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:13.504 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.481+0000 7f28ceffd640 10 monclient: _finish_hunting 0 2023-11-05T08:06:13.504 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.481+0000 7f28ceffd640 1 monclient: found mon.noname-c 2023-11-05T08:06:13.504 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.481+0000 7f28ceffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:06:13.504 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.481+0000 7f28ceffd640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.52:3301/0 2023-11-05T08:06:13.505 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.481+0000 7f28ceffd640 1 -- 172.21.15.156:0/3474425028 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28c8009a70 con 0x7f28d00b4240 2023-11-05T08:06:13.505 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.483+0000 7f28ceffd640 1 --2- 172.21.15.156:0/3474425028 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f28d00b4240 0x7f28d01da280 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f28c000c4a0 tx=0x7f28c000c960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:06:13.505 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.483+0000 7f28b7fff640 10 client.?.objecter ms_handle_connect 0x7f28d00b4240 2023-11-05T08:06:13.505 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.483+0000 7f28b7fff640 10 client.?.objecter resend_mon_ops 2023-11-05T08:06:13.505 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.487+0000 7f28b7fff640 1 -- 172.21.15.156:0/3474425028 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c0005ce0 con 0x7f28d00b4240 2023-11-05T08:06:13.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.487+0000 7f28b7fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:06:13.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.487+0000 7f28b7fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-11-05T08:06:13.506 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.487+0000 7f28b7fff640 10 monclient: dump: 2023-11-05T08:06:13.506 INFO:teuthology.orchestra.run.smithi156.stderr:epoch 1 2023-11-05T08:06:13.506 INFO:teuthology.orchestra.run.smithi156.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:06:13.507 INFO:teuthology.orchestra.run.smithi156.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:13.507 INFO:teuthology.orchestra.run.smithi156.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:13.507 INFO:teuthology.orchestra.run.smithi156.stderr:min_mon_release 18 (reef) 2023-11-05T08:06:13.507 INFO:teuthology.orchestra.run.smithi156.stderr:election_strategy: 1 2023-11-05T08:06:13.507 INFO:teuthology.orchestra.run.smithi156.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:06:13.507 INFO:teuthology.orchestra.run.smithi156.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:06:13.508 INFO:teuthology.orchestra.run.smithi156.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:06:13.508 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-05T08:06:13.508 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.487+0000 7f28b7fff640 10 monclient: _finish_auth 0 2023-11-05T08:06:13.508 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.487+0000 7f28b7fff640 10 monclient: _check_auth_tickets 2023-11-05T08:06:13.508 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.487+0000 7f28b7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:06:13.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.487+0000 7f28b7fff640 1 -- 172.21.15.156:0/3474425028 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28c0005e40 con 0x7f28d00b4240 2023-11-05T08:06:13.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.487+0000 7f28b7fff640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:06:13.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.487+0000 7f28b7fff640 1 -- 172.21.15.156:0/3474425028 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c0007270 con 0x7f28d00b4240 2023-11-05T08:06:13.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.487+0000 7f28d6010640 5 monclient: authenticate success, global_id 4124 2023-11-05T08:06:13.509 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.487+0000 7f28d6010640 10 monclient: _renew_subs 2023-11-05T08:06:13.510 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.487+0000 7f28d6010640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.52:3301/0 2023-11-05T08:06:13.510 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.487+0000 7f28d6010640 1 -- 172.21.15.156:0/3474425028 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28d01da7c0 con 0x7f28d00b4240 2023-11-05T08:06:13.510 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.487+0000 7f28b7fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:06:13.510 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.487+0000 7f28b7fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-11-05T08:06:13.510 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.487+0000 7f28cdffb640 4 set_mon_vals no callback set 2023-11-05T08:06:13.511 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.487+0000 7f28b7fff640 10 monclient: dump: 2023-11-05T08:06:13.511 INFO:teuthology.orchestra.run.smithi156.stderr:epoch 1 2023-11-05T08:06:13.511 INFO:teuthology.orchestra.run.smithi156.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:06:13.511 INFO:teuthology.orchestra.run.smithi156.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:13.511 INFO:teuthology.orchestra.run.smithi156.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:13.512 INFO:teuthology.orchestra.run.smithi156.stderr:min_mon_release 18 (reef) 2023-11-05T08:06:13.512 INFO:teuthology.orchestra.run.smithi156.stderr:election_strategy: 1 2023-11-05T08:06:13.512 INFO:teuthology.orchestra.run.smithi156.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:06:13.512 INFO:teuthology.orchestra.run.smithi156.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:06:13.512 INFO:teuthology.orchestra.run.smithi156.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:06:13.512 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-05T08:06:13.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.487+0000 7f28d6010640 10 client.4124.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-05T08:06:13.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.487+0000 7f28d6010640 10 monclient: _renew_subs 2023-11-05T08:06:13.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.487+0000 7f28d6010640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.52:3301/0 2023-11-05T08:06:13.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.487+0000 7f28d6010640 1 -- 172.21.15.156:0/3474425028 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28d013db40 con 0x7f28d00b4240 2023-11-05T08:06:13.513 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.487+0000 7f28d6010640 1 librados: init done 2023-11-05T08:06:13.514 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.488+0000 7f28d6010640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-05T08:06:13.514 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.488+0000 7f28d6010640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:06:13.514 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.488+0000 7f28d6010640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.52:3301/0 2023-11-05T08:06:13.514 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.488+0000 7f28d6010640 1 -- 172.21.15.156:0/3474425028 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28d004e9f0 con 0x7f28d00b4240 2023-11-05T08:06:13.561 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-11-05T08:06:13.560+0000 7f4a6604a040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-05T08:06:13.588 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.587+0000 7f28b7fff640 1 -- 172.21.15.156:0/3474425028 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f28c001c440 con 0x7f28d00b4240 2023-11-05T08:06:13.592 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.591+0000 7f28b7fff640 1 -- 172.21.15.156:0/3474425028 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f28c001b8c0 con 0x7f28d00b4240 2023-11-05T08:06:13.593 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.591+0000 7f28b7fff640 10 client.4124.objecter ms_dispatch 0x7f28d0000b90 osd_map(6..6 src has 1..6) v4 2023-11-05T08:06:13.593 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.591+0000 7f28b7fff640 3 client.4124.objecter handle_osd_map got epochs [6,6] > 0 2023-11-05T08:06:13.593 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.591+0000 7f28b7fff640 3 client.4124.objecter handle_osd_map decoding full epoch 6 2023-11-05T08:06:13.593 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.591+0000 7f28b7fff640 20 client.4124.objecter dump_active .. 0 homeless 2023-11-05T08:06:13.593 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.592+0000 7f28b7fff640 1 -- 172.21.15.156:0/3474425028 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f28c0021060 con 0x7f28d00b4240 2023-11-05T08:06:13.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.592+0000 7f28b7fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:06:13.594 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.592+0000 7f28b7fff640 10 monclient: _finish_command 1 = system:0 2023-11-05T08:06:13.665 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.663+0000 7f28d6010640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "3f5f9aa4-2015-4835-9b39-faf459a35a49", "id": 4}] 2023-11-05T08:06:13.665 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.663+0000 7f28d6010640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "3f5f9aa4-2015-4835-9b39-faf459a35a49", "id": 4}] 2023-11-05T08:06:13.665 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.664+0000 7f28d6010640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.52:3301/0 2023-11-05T08:06:13.665 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.664+0000 7f28d6010640 1 -- 172.21.15.156:0/3474425028 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "osd new", "uuid": "3f5f9aa4-2015-4835-9b39-faf459a35a49", "id": 4} v 0) v1 -- 0x7f28d0069510 con 0x7f28d00b4240 2023-11-05T08:06:13.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.745+0000 7f28b7fff640 1 -- 172.21.15.156:0/3474425028 <== mon.2 v2:172.21.15.52:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3f5f9aa4-2015-4835-9b39-faf459a35a49", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f28c0017070 con 0x7f28d00b4240 2023-11-05T08:06:13.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.745+0000 7f28b7fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "3f5f9aa4-2015-4835-9b39-faf459a35a49", "id": 4}] 2023-11-05T08:06:13.747 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.745+0000 7f28b7fff640 10 monclient: _finish_command 2 = system:0 2023-11-05T08:06:13.748 INFO:teuthology.orchestra.run.smithi156.stdout:4 2023-11-05T08:06:13.749 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.746+0000 7f28d6010640 10 librados: watch_flush enter 2023-11-05T08:06:13.749 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.746+0000 7f28d6010640 10 librados: watch_flush exit 2023-11-05T08:06:13.750 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.746+0000 7f28d6010640 20 client.4124.objecter shutdown clearing up homeless session... 2023-11-05T08:06:13.750 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.746+0000 7f28d6010640 10 client.4124.objecter successfully canceled tick 2023-11-05T08:06:13.750 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.746+0000 7f28d6010640 10 monclient: shutdown 2023-11-05T08:06:13.750 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.746+0000 7f28d6010640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:06:13.751 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.746+0000 7f28d6010640 1 -- 172.21.15.156:0/3474425028 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f28d00b4240 msgr2=0x7f28d01da280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:06:13.751 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.746+0000 7f28d6010640 1 --2- 172.21.15.156:0/3474425028 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f28d00b4240 0x7f28d01da280 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f28c000c4a0 tx=0x7f28c000c960 comp rx=0 tx=0).stop 2023-11-05T08:06:13.751 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.746+0000 7f28d6010640 1 -- 172.21.15.156:0/3474425028 shutdown_connections 2023-11-05T08:06:13.751 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.746+0000 7f28d6010640 1 --2- 172.21.15.156:0/3474425028 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f28d0143d50 0x7f28d0133510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:13.751 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.746+0000 7f28d6010640 1 --2- 172.21.15.156:0/3474425028 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f28d00b4240 0x7f28d01da280 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:13.752 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.746+0000 7f28d6010640 1 --2- 172.21.15.156:0/3474425028 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f28d00ade00 0x7f28d013d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:13.752 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.746+0000 7f28d6010640 1 -- 172.21.15.156:0/3474425028 >> 172.21.15.156:0/3474425028 conn(0x7f28d0065cd0 msgr2=0x7f28d00b1150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:06:13.752 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.747+0000 7f28d6010640 1 -- 172.21.15.156:0/3474425028 shutdown_connections 2023-11-05T08:06:13.752 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.747+0000 7f28d6010640 1 -- 172.21.15.156:0/3474425028 wait complete. 2023-11-05T08:06:13.752 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.747+0000 7f28d6010640 1 librados: shutdown 2023-11-05T08:06:13.758 DEBUG:teuthology.orchestra.run.smithi156:> sudo ceph --cluster ceph osd new cf781fb3-83fb-40e0-86a3-f895d7824edb 5 2023-11-05T08:06:13.858 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.857+0000 7f8e27600640 10 monclient: get_monmap_and_config 2023-11-05T08:06:13.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.857+0000 7f8e27600640 10 monclient: build_initial_monmap 2023-11-05T08:06:13.859 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.857+0000 7f8e27600640 10 monclient: monmap: 2023-11-05T08:06:13.859 INFO:teuthology.orchestra.run.smithi156.stderr:epoch 0 2023-11-05T08:06:13.860 INFO:teuthology.orchestra.run.smithi156.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:06:13.860 INFO:teuthology.orchestra.run.smithi156.stderr:last_changed 2023-11-05T08:06:13.858577+0000 2023-11-05T08:06:13.860 INFO:teuthology.orchestra.run.smithi156.stderr:created 2023-11-05T08:06:13.858577+0000 2023-11-05T08:06:13.860 INFO:teuthology.orchestra.run.smithi156.stderr:min_mon_release 0 (unknown) 2023-11-05T08:06:13.860 INFO:teuthology.orchestra.run.smithi156.stderr:election_strategy: 1 2023-11-05T08:06:13.861 INFO:teuthology.orchestra.run.smithi156.stderr:0: v1:172.21.15.52:6789/0 mon.noname-a-legacy 2023-11-05T08:06:13.861 INFO:teuthology.orchestra.run.smithi156.stderr:1: v1:172.21.15.156:6789/0 mon.noname-c-legacy 2023-11-05T08:06:13.861 INFO:teuthology.orchestra.run.smithi156.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-b 2023-11-05T08:06:13.861 INFO:teuthology.orchestra.run.smithi156.stderr:3: v2:172.21.15.52:3300/0 mon.noname-a 2023-11-05T08:06:13.862 INFO:teuthology.orchestra.run.smithi156.stderr:4: v2:172.21.15.156:3300/0 mon.noname-c 2023-11-05T08:06:13.862 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-05T08:06:13.862 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.858+0000 7f8e27600640 1 Processor -- start 2023-11-05T08:06:13.862 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.858+0000 7f8e27600640 1 -- start start 2023-11-05T08:06:13.862 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.858+0000 7f8e27600640 10 monclient: init 2023-11-05T08:06:13.865 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.858+0000 7f8e27600640 10 monclient: _reopen_session rank -1 2023-11-05T08:06:13.866 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.858+0000 7f8e27600640 10 monclient: _add_conns ranks=[0,2,4,3,1] 2023-11-05T08:06:13.866 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.858+0000 7f8e27600640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f8e200a8b30 addr v1:172.21.15.52:6789/0 2023-11-05T08:06:13.866 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.858+0000 7f8e27600640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8e2013f170 0x7f8e200a8f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:06:13.866 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.858+0000 7f8e27600640 10 monclient(hunting): picked mon.noname-b con 0x7f8e2013f170 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:06:13.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.858+0000 7f8e27600640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f8e20141c60 0x7f8e20142060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:06:13.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.858+0000 7f8e27600640 10 monclient(hunting): picked mon.noname-c con 0x7f8e20141c60 addr v2:172.21.15.156:3300/0 2023-11-05T08:06:13.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.858+0000 7f8e27600640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e200b1670 con 0x7f8e200a8b30 2023-11-05T08:06:13.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.858+0000 7f8e27600640 10 monclient(hunting): start opening mon connection 2023-11-05T08:06:13.867 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.858+0000 7f8e27600640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e2013f5e0 con 0x7f8e20141c60 2023-11-05T08:06:13.868 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.858+0000 7f8e27600640 10 monclient(hunting): start opening mon connection 2023-11-05T08:06:13.868 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.858+0000 7f8e27600640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e200aa420 con 0x7f8e2013f170 2023-11-05T08:06:13.868 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.858+0000 7f8e27600640 10 monclient(hunting): _renew_subs 2023-11-05T08:06:13.868 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.858+0000 7f8e27600640 10 monclient(hunting): authenticate will time out at 1317.078801s 2023-11-05T08:06:13.868 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.859+0000 7f8e25b9d640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f8e20141c60 0x7f8e20142060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:06:13.869 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.859+0000 7f8e24b9b640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8e2013f170 0x7f8e200a8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:06:13.869 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.859+0000 7f8e2539c640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f8e200a8b30 0x7f8e2013ea60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.156:58186/0 (socket says 172.21.15.156:58186) 2023-11-05T08:06:13.869 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.859+0000 7f8e2539c640 1 -- 172.21.15.156:0/3747998320 learned_addr learned my addr 172.21.15.156:0/3747998320 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-11-05T08:06:13.869 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.859+0000 7f8e24b9b640 10 monclient(hunting): get_auth_request con 0x7f8e2013f170 auth_method 0 2023-11-05T08:06:13.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.859+0000 7f8e24b9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:06:13.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.859+0000 7f8e24b9b640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:06:13.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.859+0000 7f8e24b9b640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:06:13.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.859+0000 7f8e25b9d640 10 monclient(hunting): get_auth_request con 0x7f8e20141c60 auth_method 0 2023-11-05T08:06:13.870 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.859+0000 7f8e25b9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:06:13.871 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.859+0000 7f8e25b9d640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:06:13.871 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.859+0000 7f8e25b9d640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:06:13.871 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.860+0000 7f8e24b9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:06:13.871 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.860+0000 7f8e24b9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:06:13.871 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.860+0000 7f8e24b9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:06:13.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.860+0000 7f8e25b9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:06:13.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.860+0000 7f8e25b9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:06:13.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.860+0000 7f8e25b9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:06:13.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.861+0000 7f8e24b9b640 10 monclient(hunting): handle_auth_done global_id 4127 payload 274 2023-11-05T08:06:13.872 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.861+0000 7f8e24b9b640 1 -- 172.21.15.156:0/3747998320 >> v2:172.21.15.156:3300/0 conn(0x7f8e20141c60 msgr2=0x7f8e20142060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-05T08:06:13.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.861+0000 7f8e24b9b640 1 --2- 172.21.15.156:0/3747998320 >> v2:172.21.15.156:3300/0 conn(0x7f8e20141c60 0x7f8e20142060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:13.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.862+0000 7f8e24b9b640 1 -- 172.21.15.156:0/3747998320 >> v1:172.21.15.52:6789/0 conn(0x7f8e200a8b30 legacy=0x7f8e2013ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:06:13.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.862+0000 7f8e24b9b640 10 monclient: _finish_hunting 0 2023-11-05T08:06:13.873 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.862+0000 7f8e24b9b640 1 monclient: found mon.noname-b 2023-11-05T08:06:13.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.862+0000 7f8e24b9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:06:13.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.862+0000 7f8e24b9b640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.52:3301/0 2023-11-05T08:06:13.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.862+0000 7f8e24b9b640 1 -- 172.21.15.156:0/3747998320 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e200b80e0 con 0x7f8e2013f170 2023-11-05T08:06:13.874 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.863+0000 7f8e24b9b640 1 --2- 172.21.15.156:0/3747998320 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8e2013f170 0x7f8e200a8f10 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f8e100097a0 tx=0x7f8e1002b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6b276b8825a799b server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:06:13.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.867+0000 7f8e17fff640 1 -- 172.21.15.156:0/3747998320 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e1002e070 con 0x7f8e2013f170 2023-11-05T08:06:13.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.867+0000 7f8e17fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:06:13.879 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.867+0000 7f8e17fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-05T08:06:13.880 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.867+0000 7f8e17fff640 10 monclient: dump: 2023-11-05T08:06:13.880 INFO:teuthology.orchestra.run.smithi156.stderr:epoch 1 2023-11-05T08:06:13.880 INFO:teuthology.orchestra.run.smithi156.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:06:13.880 INFO:teuthology.orchestra.run.smithi156.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:13.880 INFO:teuthology.orchestra.run.smithi156.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:13.881 INFO:teuthology.orchestra.run.smithi156.stderr:min_mon_release 18 (reef) 2023-11-05T08:06:13.881 INFO:teuthology.orchestra.run.smithi156.stderr:election_strategy: 1 2023-11-05T08:06:13.881 INFO:teuthology.orchestra.run.smithi156.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:06:13.881 INFO:teuthology.orchestra.run.smithi156.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:06:13.881 INFO:teuthology.orchestra.run.smithi156.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:06:13.882 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-05T08:06:13.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.867+0000 7f8e17fff640 10 monclient: _finish_auth 0 2023-11-05T08:06:13.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.867+0000 7f8e17fff640 10 monclient: _check_auth_tickets 2023-11-05T08:06:13.882 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.867+0000 7f8e17fff640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:06:13.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.867+0000 7f8e17fff640 1 -- 172.21.15.156:0/3747998320 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e100315a0 con 0x7f8e2013f170 2023-11-05T08:06:13.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.867+0000 7f8e17fff640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:06:13.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.867+0000 7f8e17fff640 1 -- 172.21.15.156:0/3747998320 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e10031930 con 0x7f8e2013f170 2023-11-05T08:06:13.883 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.867+0000 7f8e27600640 5 monclient: authenticate success, global_id 4127 2023-11-05T08:06:13.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.867+0000 7f8e27600640 10 monclient: get_monmap_and_config success 2023-11-05T08:06:13.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.867+0000 7f8e27600640 4 set_mon_vals no callback set 2023-11-05T08:06:13.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.867+0000 7f8e17fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:06:13.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.867+0000 7f8e17fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-11-05T08:06:13.884 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.867+0000 7f8e17fff640 10 monclient: dump: 2023-11-05T08:06:13.885 INFO:teuthology.orchestra.run.smithi156.stderr:epoch 1 2023-11-05T08:06:13.885 INFO:teuthology.orchestra.run.smithi156.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:06:13.885 INFO:teuthology.orchestra.run.smithi156.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:13.885 INFO:teuthology.orchestra.run.smithi156.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:13.885 INFO:teuthology.orchestra.run.smithi156.stderr:min_mon_release 18 (reef) 2023-11-05T08:06:13.886 INFO:teuthology.orchestra.run.smithi156.stderr:election_strategy: 1 2023-11-05T08:06:13.886 INFO:teuthology.orchestra.run.smithi156.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:06:13.886 INFO:teuthology.orchestra.run.smithi156.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:06:13.886 INFO:teuthology.orchestra.run.smithi156.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:06:13.887 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-05T08:06:13.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.868+0000 7f8e27600640 10 monclient: shutdown 2023-11-05T08:06:13.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.868+0000 7f8e27600640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:06:13.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.868+0000 7f8e27600640 1 -- 172.21.15.156:0/3747998320 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8e2013f170 msgr2=0x7f8e200a8f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:06:13.887 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.868+0000 7f8e27600640 1 --2- 172.21.15.156:0/3747998320 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8e2013f170 0x7f8e200a8f10 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f8e100097a0 tx=0x7f8e1002b840 comp rx=0 tx=0).stop 2023-11-05T08:06:13.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.868+0000 7f8e27600640 1 -- 172.21.15.156:0/3747998320 shutdown_connections 2023-11-05T08:06:13.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.868+0000 7f8e27600640 1 --2- 172.21.15.156:0/3747998320 >> v2:172.21.15.156:3300/0 conn(0x7f8e20141c60 0x7f8e20142060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:13.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.868+0000 7f8e27600640 1 --2- 172.21.15.156:0/3747998320 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8e2013f170 0x7f8e200a8f10 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:13.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.868+0000 7f8e27600640 1 -- 172.21.15.156:0/3747998320 >> 172.21.15.156:0/3747998320 conn(0x7f8e200b7230 msgr2=0x7f8e200b7610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:06:13.888 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.868+0000 7f8e27600640 1 -- 172.21.15.156:0/3747998320 shutdown_connections 2023-11-05T08:06:13.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.868+0000 7f8e27600640 1 -- 172.21.15.156:0/3747998320 wait complete. 2023-11-05T08:06:13.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.869+0000 7f8e27600640 10 monclient: build_initial_monmap 2023-11-05T08:06:13.889 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.869+0000 7f8e27600640 10 monclient: monmap: 2023-11-05T08:06:13.889 INFO:teuthology.orchestra.run.smithi156.stderr:epoch 0 2023-11-05T08:06:13.889 INFO:teuthology.orchestra.run.smithi156.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-05T08:06:13.890 INFO:teuthology.orchestra.run.smithi156.stderr:last_changed 0.000000 2023-11-05T08:06:13.890 INFO:teuthology.orchestra.run.smithi156.stderr:created 0.000000 2023-11-05T08:06:13.890 INFO:teuthology.orchestra.run.smithi156.stderr:min_mon_release 0 (unknown) 2023-11-05T08:06:13.890 INFO:teuthology.orchestra.run.smithi156.stderr:election_strategy: 1 2023-11-05T08:06:13.891 INFO:teuthology.orchestra.run.smithi156.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.noname-a 2023-11-05T08:06:13.891 INFO:teuthology.orchestra.run.smithi156.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.noname-b 2023-11-05T08:06:13.891 INFO:teuthology.orchestra.run.smithi156.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-c 2023-11-05T08:06:13.891 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-05T08:06:13.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.869+0000 7f8e27600640 1 librados: starting msgr at 2023-11-05T08:06:13.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.869+0000 7f8e27600640 1 librados: starting objecter 2023-11-05T08:06:13.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.869+0000 7f8e27600640 1 Processor -- start 2023-11-05T08:06:13.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.869+0000 7f8e27600640 1 -- start start 2023-11-05T08:06:13.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.869+0000 7f8e27600640 1 librados: setting wanted keys 2023-11-05T08:06:13.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.869+0000 7f8e27600640 1 librados: calling monclient init 2023-11-05T08:06:13.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.869+0000 7f8e27600640 10 monclient: init 2023-11-05T08:06:13.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.870+0000 7f8e27600640 10 monclient: _reopen_session rank -1 2023-11-05T08:06:13.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.870+0000 7f8e27600640 10 monclient: _add_conns ranks=[1,2,0] 2023-11-05T08:06:13.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.870+0000 7f8e27600640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8e200a8b30 0x7f8e201457d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:06:13.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.870+0000 7f8e27600640 10 monclient(hunting): picked mon.noname-b con 0x7f8e200a8b30 addr [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] 2023-11-05T08:06:13.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.870+0000 7f8e27600640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8e2013f170 0x7f8e20144e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:06:13.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.870+0000 7f8e27600640 10 monclient(hunting): picked mon.noname-c con 0x7f8e2013f170 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:06:13.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.870+0000 7f8e27600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8e20141c60 0x7f8e201d7160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:06:13.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.870+0000 7f8e27600640 10 monclient(hunting): picked mon.noname-a con 0x7f8e20141c60 addr [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] 2023-11-05T08:06:13.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.870+0000 7f8e27600640 10 monclient(hunting): start opening mon connection 2023-11-05T08:06:13.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.870+0000 7f8e27600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e201453c0 con 0x7f8e20141c60 2023-11-05T08:06:13.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.870+0000 7f8e27600640 10 monclient(hunting): start opening mon connection 2023-11-05T08:06:13.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.870+0000 7f8e27600640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e201d76a0 con 0x7f8e200a8b30 2023-11-05T08:06:13.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.870+0000 7f8e27600640 10 monclient(hunting): start opening mon connection 2023-11-05T08:06:13.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.870+0000 7f8e27600640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e201d6c40 con 0x7f8e2013f170 2023-11-05T08:06:13.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.870+0000 7f8e27600640 10 monclient(hunting): _renew_subs 2023-11-05T08:06:13.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.870+0000 7f8e27600640 10 monclient(hunting): authenticate will time out at 1317.090112s 2023-11-05T08:06:13.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.870+0000 7f8e2539c640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8e200a8b30 0x7f8e201457d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:06:13.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.870+0000 7f8e24b9b640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8e2013f170 0x7f8e20144e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:06:13.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.870+0000 7f8e25b9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8e20141c60 0x7f8e201d7160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:06:13.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.871+0000 7f8e24b9b640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8e2013f170 0x7f8e20144e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.156:46890/0 (socket says 172.21.15.156:46890) 2023-11-05T08:06:13.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.871+0000 7f8e24b9b640 1 -- 172.21.15.156:0/4039000122 learned_addr learned my addr 172.21.15.156:0/4039000122 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-11-05T08:06:13.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.871+0000 7f8e24b9b640 10 monclient(hunting): get_auth_request con 0x7f8e2013f170 auth_method 0 2023-11-05T08:06:13.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.871+0000 7f8e24b9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:06:13.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.871+0000 7f8e24b9b640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:06:13.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.871+0000 7f8e24b9b640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:06:13.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.871+0000 7f8e2539c640 10 monclient(hunting): get_auth_request con 0x7f8e200a8b30 auth_method 0 2023-11-05T08:06:13.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.871+0000 7f8e2539c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:06:13.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.871+0000 7f8e2539c640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:06:13.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.871+0000 7f8e2539c640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:06:13.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.871+0000 7f8e25b9d640 10 monclient(hunting): get_auth_request con 0x7f8e20141c60 auth_method 0 2023-11-05T08:06:13.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.871+0000 7f8e25b9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:06:13.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.871+0000 7f8e25b9d640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:06:13.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.871+0000 7f8e25b9d640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:06:13.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.871+0000 7f8e24b9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:06:13.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.871+0000 7f8e24b9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:06:13.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.871+0000 7f8e24b9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:06:13.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.871+0000 7f8e2539c640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:06:13.901 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.871+0000 7f8e2539c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:06:13.901 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.871+0000 7f8e2539c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:06:13.901 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.871+0000 7f8e25b9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:06:13.901 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.871+0000 7f8e25b9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:06:13.902 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.871+0000 7f8e25b9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:06:13.902 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.874+0000 7f8e24b9b640 10 monclient(hunting): handle_auth_done global_id 4130 payload 824 2023-11-05T08:06:13.902 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.874+0000 7f8e24b9b640 1 -- 172.21.15.156:0/4039000122 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8e200a8b30 msgr2=0x7f8e201457d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:06:13.902 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.874+0000 7f8e24b9b640 1 --2- 172.21.15.156:0/4039000122 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8e200a8b30 0x7f8e201457d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:13.902 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.874+0000 7f8e24b9b640 1 -- 172.21.15.156:0/4039000122 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8e20141c60 msgr2=0x7f8e201d7160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:06:13.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.874+0000 7f8e24b9b640 1 --2- 172.21.15.156:0/4039000122 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8e20141c60 0x7f8e201d7160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:13.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.874+0000 7f8e24b9b640 10 monclient: _finish_hunting 0 2023-11-05T08:06:13.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.874+0000 7f8e24b9b640 1 monclient: found mon.noname-c 2023-11-05T08:06:13.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.874+0000 7f8e24b9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:06:13.903 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.874+0000 7f8e24b9b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.52:3301/0 2023-11-05T08:06:13.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.874+0000 7f8e24b9b640 1 -- 172.21.15.156:0/4039000122 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e10009400 con 0x7f8e2013f170 2023-11-05T08:06:13.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.876+0000 7f8e24b9b640 1 --2- 172.21.15.156:0/4039000122 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8e2013f170 0x7f8e20144e80 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f8e100098c0 tx=0x7f8e100046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:06:13.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.876+0000 7f8e15ffb640 10 client.?.objecter ms_handle_connect 0x7f8e2013f170 2023-11-05T08:06:13.904 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.876+0000 7f8e15ffb640 10 client.?.objecter resend_mon_ops 2023-11-05T08:06:13.906 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.880+0000 7f8e15ffb640 1 -- 172.21.15.156:0/4039000122 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e10032840 con 0x7f8e2013f170 2023-11-05T08:06:13.907 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.880+0000 7f8e15ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:06:13.907 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.880+0000 7f8e15ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-11-05T08:06:13.907 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.880+0000 7f8e15ffb640 10 monclient: dump: 2023-11-05T08:06:13.907 INFO:teuthology.orchestra.run.smithi156.stderr:epoch 1 2023-11-05T08:06:13.907 INFO:teuthology.orchestra.run.smithi156.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:06:13.908 INFO:teuthology.orchestra.run.smithi156.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:13.908 INFO:teuthology.orchestra.run.smithi156.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:13.908 INFO:teuthology.orchestra.run.smithi156.stderr:min_mon_release 18 (reef) 2023-11-05T08:06:13.908 INFO:teuthology.orchestra.run.smithi156.stderr:election_strategy: 1 2023-11-05T08:06:13.908 INFO:teuthology.orchestra.run.smithi156.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:06:13.909 INFO:teuthology.orchestra.run.smithi156.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:06:13.909 INFO:teuthology.orchestra.run.smithi156.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:06:13.909 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-05T08:06:13.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.880+0000 7f8e15ffb640 10 monclient: _finish_auth 0 2023-11-05T08:06:13.909 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.880+0000 7f8e15ffb640 10 monclient: _check_auth_tickets 2023-11-05T08:06:13.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.880+0000 7f8e15ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:06:13.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.880+0000 7f8e15ffb640 1 -- 172.21.15.156:0/4039000122 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e10031f00 con 0x7f8e2013f170 2023-11-05T08:06:13.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.880+0000 7f8e15ffb640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:06:13.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.880+0000 7f8e15ffb640 1 -- 172.21.15.156:0/4039000122 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e10032be0 con 0x7f8e2013f170 2023-11-05T08:06:13.910 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.880+0000 7f8e27600640 5 monclient: authenticate success, global_id 4130 2023-11-05T08:06:13.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.880+0000 7f8e27600640 10 monclient: _renew_subs 2023-11-05T08:06:13.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.880+0000 7f8e27600640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.52:3301/0 2023-11-05T08:06:13.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.880+0000 7f8e27600640 1 -- 172.21.15.156:0/4039000122 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e201d6760 con 0x7f8e2013f170 2023-11-05T08:06:13.911 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.880+0000 7f8e15ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:06:13.912 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.880+0000 7f8e177fe640 4 set_mon_vals no callback set 2023-11-05T08:06:13.912 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.880+0000 7f8e15ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-11-05T08:06:13.912 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.880+0000 7f8e15ffb640 10 monclient: dump: 2023-11-05T08:06:13.912 INFO:teuthology.orchestra.run.smithi156.stderr:epoch 1 2023-11-05T08:06:13.912 INFO:teuthology.orchestra.run.smithi156.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:06:13.913 INFO:teuthology.orchestra.run.smithi156.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:13.913 INFO:teuthology.orchestra.run.smithi156.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:13.913 INFO:teuthology.orchestra.run.smithi156.stderr:min_mon_release 18 (reef) 2023-11-05T08:06:13.913 INFO:teuthology.orchestra.run.smithi156.stderr:election_strategy: 1 2023-11-05T08:06:13.913 INFO:teuthology.orchestra.run.smithi156.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:06:13.914 INFO:teuthology.orchestra.run.smithi156.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:06:13.914 INFO:teuthology.orchestra.run.smithi156.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:06:13.914 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-05T08:06:13.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.880+0000 7f8e27600640 10 client.4130.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-05T08:06:13.914 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.880+0000 7f8e27600640 10 monclient: _renew_subs 2023-11-05T08:06:13.915 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.880+0000 7f8e27600640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.52:3301/0 2023-11-05T08:06:13.915 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.880+0000 7f8e27600640 1 -- 172.21.15.156:0/4039000122 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e20142c40 con 0x7f8e2013f170 2023-11-05T08:06:13.915 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.880+0000 7f8e27600640 1 librados: init done 2023-11-05T08:06:13.915 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.881+0000 7f8e27600640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-05T08:06:13.916 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.881+0000 7f8e27600640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:06:13.916 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.881+0000 7f8e27600640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.52:3301/0 2023-11-05T08:06:13.916 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.881+0000 7f8e27600640 1 -- 172.21.15.156:0/4039000122 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e201d6a90 con 0x7f8e2013f170 2023-11-05T08:06:13.916 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.882+0000 7f8e15ffb640 1 -- 172.21.15.156:0/4039000122 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f8e10005c90 con 0x7f8e2013f170 2023-11-05T08:06:13.916 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.882+0000 7f8e15ffb640 1 -- 172.21.15.156:0/4039000122 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f8e10006750 con 0x7f8e2013f170 2023-11-05T08:06:13.917 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.882+0000 7f8e15ffb640 10 client.4130.objecter ms_dispatch 0x7f8e20000b90 osd_map(7..7 src has 1..7) v4 2023-11-05T08:06:13.917 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.882+0000 7f8e15ffb640 3 client.4130.objecter handle_osd_map got epochs [7,7] > 0 2023-11-05T08:06:13.917 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.882+0000 7f8e15ffb640 3 client.4130.objecter handle_osd_map decoding full epoch 7 2023-11-05T08:06:13.917 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.883+0000 7f8e15ffb640 20 client.4130.objecter dump_active .. 0 homeless 2023-11-05T08:06:13.988 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.987+0000 7f8e15ffb640 1 -- 172.21.15.156:0/4039000122 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f8e10032d40 con 0x7f8e2013f170 2023-11-05T08:06:13.988 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.987+0000 7f8e15ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:06:13.988 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:13.987+0000 7f8e15ffb640 10 monclient: _finish_command 1 = system:0 2023-11-05T08:06:14.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.077+0000 7f8e27600640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "cf781fb3-83fb-40e0-86a3-f895d7824edb", "id": 5}] 2023-11-05T08:06:14.078 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.077+0000 7f8e27600640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "cf781fb3-83fb-40e0-86a3-f895d7824edb", "id": 5}] 2023-11-05T08:06:14.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.077+0000 7f8e27600640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.52:3301/0 2023-11-05T08:06:14.079 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.077+0000 7f8e27600640 1 -- 172.21.15.156:0/4039000122 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "osd new", "uuid": "cf781fb3-83fb-40e0-86a3-f895d7824edb", "id": 5} v 0) v1 -- 0x7f8e2004e9f0 con 0x7f8e2013f170 2023-11-05T08:06:14.140 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-11-05T08:06:14.139+0000 7f1369430040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-05T08:06:14.155 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.154+0000 7f8e15ffb640 1 -- 172.21.15.156:0/4039000122 <== mon.2 v2:172.21.15.52:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "cf781fb3-83fb-40e0-86a3-f895d7824edb", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8e10006030 con 0x7f8e2013f170 2023-11-05T08:06:14.155 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.154+0000 7f8e15ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "cf781fb3-83fb-40e0-86a3-f895d7824edb", "id": 5}] 2023-11-05T08:06:14.155 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.154+0000 7f8e15ffb640 10 monclient: _finish_command 2 = system:0 2023-11-05T08:06:14.156 INFO:teuthology.orchestra.run.smithi156.stdout:5 2023-11-05T08:06:14.157 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.155+0000 7f8e27600640 10 librados: watch_flush enter 2023-11-05T08:06:14.158 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.155+0000 7f8e27600640 10 librados: watch_flush exit 2023-11-05T08:06:14.158 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.155+0000 7f8e27600640 20 client.4130.objecter shutdown clearing up homeless session... 2023-11-05T08:06:14.158 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.155+0000 7f8e27600640 10 client.4130.objecter successfully canceled tick 2023-11-05T08:06:14.158 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.155+0000 7f8e27600640 10 monclient: shutdown 2023-11-05T08:06:14.158 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.155+0000 7f8e27600640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:06:14.159 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.155+0000 7f8e27600640 1 -- 172.21.15.156:0/4039000122 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8e2013f170 msgr2=0x7f8e20144e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:06:14.159 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.155+0000 7f8e27600640 1 --2- 172.21.15.156:0/4039000122 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8e2013f170 0x7f8e20144e80 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f8e100098c0 tx=0x7f8e100046c0 comp rx=0 tx=0).stop 2023-11-05T08:06:14.159 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.155+0000 7f8e27600640 1 -- 172.21.15.156:0/4039000122 shutdown_connections 2023-11-05T08:06:14.159 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.155+0000 7f8e27600640 1 --2- 172.21.15.156:0/4039000122 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8e20141c60 0x7f8e201d7160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:14.159 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.155+0000 7f8e27600640 1 --2- 172.21.15.156:0/4039000122 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8e2013f170 0x7f8e20144e80 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:14.160 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.155+0000 7f8e27600640 1 --2- 172.21.15.156:0/4039000122 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8e200a8b30 0x7f8e201457d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:14.160 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.155+0000 7f8e27600640 1 -- 172.21.15.156:0/4039000122 >> 172.21.15.156:0/4039000122 conn(0x7f8e200b7230 msgr2=0x7f8e200b25c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:06:14.160 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.155+0000 7f8e27600640 1 -- 172.21.15.156:0/4039000122 shutdown_connections 2023-11-05T08:06:14.160 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.155+0000 7f8e27600640 1 -- 172.21.15.156:0/4039000122 wait complete. 2023-11-05T08:06:14.160 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.155+0000 7f8e27600640 1 librados: shutdown 2023-11-05T08:06:14.167 DEBUG:teuthology.orchestra.run.smithi156:> sudo ceph --cluster ceph osd new d2787c11-d907-4924-b9cf-69db95ad35c2 6 2023-11-05T08:06:14.267 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.266+0000 7fad108e5640 10 monclient: get_monmap_and_config 2023-11-05T08:06:14.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.266+0000 7fad108e5640 10 monclient: build_initial_monmap 2023-11-05T08:06:14.268 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.266+0000 7fad108e5640 10 monclient: monmap: 2023-11-05T08:06:14.268 INFO:teuthology.orchestra.run.smithi156.stderr:epoch 0 2023-11-05T08:06:14.269 INFO:teuthology.orchestra.run.smithi156.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:06:14.269 INFO:teuthology.orchestra.run.smithi156.stderr:last_changed 2023-11-05T08:06:14.267782+0000 2023-11-05T08:06:14.269 INFO:teuthology.orchestra.run.smithi156.stderr:created 2023-11-05T08:06:14.267782+0000 2023-11-05T08:06:14.269 INFO:teuthology.orchestra.run.smithi156.stderr:min_mon_release 0 (unknown) 2023-11-05T08:06:14.269 INFO:teuthology.orchestra.run.smithi156.stderr:election_strategy: 1 2023-11-05T08:06:14.270 INFO:teuthology.orchestra.run.smithi156.stderr:0: v1:172.21.15.52:6789/0 mon.noname-a-legacy 2023-11-05T08:06:14.270 INFO:teuthology.orchestra.run.smithi156.stderr:1: v1:172.21.15.156:6789/0 mon.noname-c-legacy 2023-11-05T08:06:14.270 INFO:teuthology.orchestra.run.smithi156.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-b 2023-11-05T08:06:14.270 INFO:teuthology.orchestra.run.smithi156.stderr:3: v2:172.21.15.52:3300/0 mon.noname-a 2023-11-05T08:06:14.270 INFO:teuthology.orchestra.run.smithi156.stderr:4: v2:172.21.15.156:3300/0 mon.noname-c 2023-11-05T08:06:14.271 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-05T08:06:14.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.267+0000 7fad108e5640 1 Processor -- start 2023-11-05T08:06:14.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.267+0000 7fad108e5640 1 -- start start 2023-11-05T08:06:14.271 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.267+0000 7fad108e5640 10 monclient: init 2023-11-05T08:06:14.273 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.268+0000 7fad108e5640 10 monclient: _reopen_session rank -1 2023-11-05T08:06:14.273 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.268+0000 7fad108e5640 10 monclient: _add_conns ranks=[4,2,1,3,0] 2023-11-05T08:06:14.273 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.268+0000 7fad108e5640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fad0c0b4240 0x7fad0c0b1150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:06:14.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.268+0000 7fad108e5640 10 monclient(hunting): picked mon.noname-c con 0x7fad0c0b4240 addr v2:172.21.15.156:3300/0 2023-11-05T08:06:14.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.268+0000 7fad108e5640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fad0c0b38d0 0x7fad0c0ae640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:06:14.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.268+0000 7fad108e5640 10 monclient(hunting): picked mon.noname-b con 0x7fad0c0b38d0 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:06:14.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.268+0000 7fad108e5640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fad0c0ade00 addr v1:172.21.15.156:6789/0 2023-11-05T08:06:14.274 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.268+0000 7fad108e5640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad0c0b0cc0 con 0x7fad0c0ade00 2023-11-05T08:06:14.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.268+0000 7fad108e5640 10 monclient(hunting): start opening mon connection 2023-11-05T08:06:14.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.268+0000 7fad108e5640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad0c0b4620 con 0x7fad0c0b4240 2023-11-05T08:06:14.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.268+0000 7fad108e5640 10 monclient(hunting): start opening mon connection 2023-11-05T08:06:14.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.268+0000 7fad108e5640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad0c0b1690 con 0x7fad0c0b38d0 2023-11-05T08:06:14.275 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.268+0000 7fad108e5640 10 monclient(hunting): _renew_subs 2023-11-05T08:06:14.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.268+0000 7fad108e5640 10 monclient(hunting): authenticate will time out at 1317.488089s 2023-11-05T08:06:14.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.269+0000 7fad0a59c640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fad0c0b4240 0x7fad0c0b1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:06:14.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.270+0000 7fad0a59c640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fad0c0b4240 0x7fad0c0b1150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:56152/0 (socket says 172.21.15.156:56152) 2023-11-05T08:06:14.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.270+0000 7fad0a59c640 1 -- 172.21.15.156:0/1250853987 learned_addr learned my addr 172.21.15.156:0/1250853987 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-11-05T08:06:14.276 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.270+0000 7fad0a59c640 10 monclient(hunting): get_auth_request con 0x7fad0c0b4240 auth_method 0 2023-11-05T08:06:14.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.270+0000 7fad0a59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:06:14.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.270+0000 7fad0a59c640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:06:14.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.270+0000 7fad0a59c640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:06:14.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.270+0000 7fad0a59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:06:14.277 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.270+0000 7fad0a59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:06:14.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.270+0000 7fad0a59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:06:14.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.272+0000 7fad0a59c640 10 monclient(hunting): handle_auth_done global_id 4150 payload 274 2023-11-05T08:06:14.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.272+0000 7fad0a59c640 1 -- 172.21.15.156:0/1250853987 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fad0c0b38d0 msgr2=0x7fad0c0ae640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-05T08:06:14.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.272+0000 7fad0a59c640 1 --2- 172.21.15.156:0/1250853987 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fad0c0b38d0 0x7fad0c0ae640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:14.278 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.272+0000 7fad0a59c640 1 -- 172.21.15.156:0/1250853987 >> v1:172.21.15.156:6789/0 conn(0x7fad0c0ade00 legacy=0x7fad0c13b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-05T08:06:14.279 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.272+0000 7fad0a59c640 10 monclient: _finish_hunting 0 2023-11-05T08:06:14.279 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.272+0000 7fad0a59c640 1 monclient: found mon.noname-c 2023-11-05T08:06:14.279 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.272+0000 7fad0a59c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:06:14.279 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.272+0000 7fad0a59c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.156:3300/0 2023-11-05T08:06:14.279 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.272+0000 7fad0a59c640 1 -- 172.21.15.156:0/1250853987 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad0c0aeb80 con 0x7fad0c0b4240 2023-11-05T08:06:14.280 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.275+0000 7fad0a59c640 1 --2- 172.21.15.156:0/1250853987 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fad0c0b4240 0x7fad0c0b1150 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7facfc009870 tx=0x7facfc02b860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=37149d3ff86df04c server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:06:14.288 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.287+0000 7fad0959a640 1 -- 172.21.15.156:0/1250853987 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facfc0317c0 con 0x7fad0c0b4240 2023-11-05T08:06:14.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.287+0000 7fad0959a640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:06:14.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.287+0000 7fad0959a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-11-05T08:06:14.289 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.287+0000 7fad0959a640 10 monclient: dump: 2023-11-05T08:06:14.289 INFO:teuthology.orchestra.run.smithi156.stderr:epoch 1 2023-11-05T08:06:14.289 INFO:teuthology.orchestra.run.smithi156.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:06:14.290 INFO:teuthology.orchestra.run.smithi156.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:14.290 INFO:teuthology.orchestra.run.smithi156.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:14.290 INFO:teuthology.orchestra.run.smithi156.stderr:min_mon_release 18 (reef) 2023-11-05T08:06:14.290 INFO:teuthology.orchestra.run.smithi156.stderr:election_strategy: 1 2023-11-05T08:06:14.290 INFO:teuthology.orchestra.run.smithi156.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:06:14.291 INFO:teuthology.orchestra.run.smithi156.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:06:14.291 INFO:teuthology.orchestra.run.smithi156.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:06:14.291 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-05T08:06:14.291 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.287+0000 7fad0959a640 10 monclient: _finish_auth 0 2023-11-05T08:06:14.291 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.287+0000 7fad0959a640 10 monclient: _check_auth_tickets 2023-11-05T08:06:14.292 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.287+0000 7fad0959a640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:06:14.292 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.287+0000 7fad0959a640 1 -- 172.21.15.156:0/1250853987 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facfc031920 con 0x7fad0c0b4240 2023-11-05T08:06:14.292 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.287+0000 7fad108e5640 5 monclient: authenticate success, global_id 4150 2023-11-05T08:06:14.292 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.287+0000 7fad108e5640 20 monclient: get_monmap_and_config waiting for monmap|config 2023-11-05T08:06:14.292 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.287+0000 7fad0959a640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:06:14.293 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.287+0000 7fad108e5640 10 monclient: get_monmap_and_config success 2023-11-05T08:06:14.293 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.287+0000 7fad108e5640 4 set_mon_vals no callback set 2023-11-05T08:06:14.293 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.287+0000 7fad0959a640 1 -- 172.21.15.156:0/1250853987 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facfc031cb0 con 0x7fad0c0b4240 2023-11-05T08:06:14.293 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.287+0000 7fad0959a640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:06:14.293 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.287+0000 7fad0959a640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-05T08:06:14.293 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.287+0000 7fad0959a640 10 monclient: dump: 2023-11-05T08:06:14.294 INFO:teuthology.orchestra.run.smithi156.stderr:epoch 1 2023-11-05T08:06:14.294 INFO:teuthology.orchestra.run.smithi156.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:06:14.294 INFO:teuthology.orchestra.run.smithi156.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:14.294 INFO:teuthology.orchestra.run.smithi156.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:14.294 INFO:teuthology.orchestra.run.smithi156.stderr:min_mon_release 18 (reef) 2023-11-05T08:06:14.295 INFO:teuthology.orchestra.run.smithi156.stderr:election_strategy: 1 2023-11-05T08:06:14.295 INFO:teuthology.orchestra.run.smithi156.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:06:14.295 INFO:teuthology.orchestra.run.smithi156.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:06:14.295 INFO:teuthology.orchestra.run.smithi156.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:06:14.295 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-05T08:06:14.299 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.288+0000 7fad108e5640 10 monclient: shutdown 2023-11-05T08:06:14.299 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.288+0000 7fad108e5640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:06:14.300 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.288+0000 7fad108e5640 1 -- 172.21.15.156:0/1250853987 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fad0c0b4240 msgr2=0x7fad0c0b1150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:06:14.300 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.288+0000 7fad108e5640 1 --2- 172.21.15.156:0/1250853987 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fad0c0b4240 0x7fad0c0b1150 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7facfc009870 tx=0x7facfc02b860 comp rx=0 tx=0).stop 2023-11-05T08:06:14.300 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.288+0000 7fad108e5640 1 -- 172.21.15.156:0/1250853987 shutdown_connections 2023-11-05T08:06:14.300 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.288+0000 7fad108e5640 1 --2- 172.21.15.156:0/1250853987 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fad0c0b38d0 0x7fad0c0ae640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:14.300 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.288+0000 7fad108e5640 1 --2- 172.21.15.156:0/1250853987 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fad0c0b4240 0x7fad0c0b1150 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:14.301 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.288+0000 7fad108e5640 1 -- 172.21.15.156:0/1250853987 >> 172.21.15.156:0/1250853987 conn(0x7fad0c065cd0 msgr2=0x7fad0c0660e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:06:14.301 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.288+0000 7fad108e5640 1 -- 172.21.15.156:0/1250853987 shutdown_connections 2023-11-05T08:06:14.301 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.288+0000 7fad108e5640 1 -- 172.21.15.156:0/1250853987 wait complete. 2023-11-05T08:06:14.301 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.289+0000 7fad108e5640 10 monclient: build_initial_monmap 2023-11-05T08:06:14.301 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.289+0000 7fad108e5640 10 monclient: monmap: 2023-11-05T08:06:14.302 INFO:teuthology.orchestra.run.smithi156.stderr:epoch 0 2023-11-05T08:06:14.302 INFO:teuthology.orchestra.run.smithi156.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-05T08:06:14.302 INFO:teuthology.orchestra.run.smithi156.stderr:last_changed 0.000000 2023-11-05T08:06:14.302 INFO:teuthology.orchestra.run.smithi156.stderr:created 0.000000 2023-11-05T08:06:14.302 INFO:teuthology.orchestra.run.smithi156.stderr:min_mon_release 0 (unknown) 2023-11-05T08:06:14.303 INFO:teuthology.orchestra.run.smithi156.stderr:election_strategy: 1 2023-11-05T08:06:14.303 INFO:teuthology.orchestra.run.smithi156.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.noname-a 2023-11-05T08:06:14.303 INFO:teuthology.orchestra.run.smithi156.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.noname-b 2023-11-05T08:06:14.303 INFO:teuthology.orchestra.run.smithi156.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-c 2023-11-05T08:06:14.303 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-05T08:06:14.304 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.289+0000 7fad108e5640 1 librados: starting msgr at 2023-11-05T08:06:14.304 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.289+0000 7fad108e5640 1 librados: starting objecter 2023-11-05T08:06:14.304 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.289+0000 7fad108e5640 1 Processor -- start 2023-11-05T08:06:14.304 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.290+0000 7fad108e5640 1 -- start start 2023-11-05T08:06:14.304 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.290+0000 7fad108e5640 1 librados: setting wanted keys 2023-11-05T08:06:14.305 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.290+0000 7fad108e5640 1 librados: calling monclient init 2023-11-05T08:06:14.305 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.290+0000 7fad108e5640 10 monclient: init 2023-11-05T08:06:14.305 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.290+0000 7fad108e5640 10 monclient: _reopen_session rank -1 2023-11-05T08:06:14.305 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.290+0000 7fad108e5640 10 monclient: _add_conns ranks=[1,2,0] 2023-11-05T08:06:14.305 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.290+0000 7fad108e5640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fad0c0ade00 0x7fad0c145190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:06:14.306 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.290+0000 7fad108e5640 10 monclient(hunting): picked mon.noname-b con 0x7fad0c0ade00 addr [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] 2023-11-05T08:06:14.306 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.290+0000 7fad108e5640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fad0c0b4240 0x7fad0c13e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:06:14.306 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.290+0000 7fad108e5640 10 monclient(hunting): picked mon.noname-c con 0x7fad0c0b4240 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:06:14.306 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.290+0000 7fad108e5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad0c137610 0x7fad0c137a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:06:14.306 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.290+0000 7fad108e5640 10 monclient(hunting): picked mon.noname-a con 0x7fad0c137610 addr [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] 2023-11-05T08:06:14.307 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.290+0000 7fad108e5640 10 monclient(hunting): start opening mon connection 2023-11-05T08:06:14.307 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.290+0000 7fad108e5640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad0c13efc0 con 0x7fad0c137610 2023-11-05T08:06:14.307 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.290+0000 7fad108e5640 10 monclient(hunting): start opening mon connection 2023-11-05T08:06:14.307 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.290+0000 7fad108e5640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad0c13eaa0 con 0x7fad0c0ade00 2023-11-05T08:06:14.307 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.290+0000 7fad108e5640 10 monclient(hunting): start opening mon connection 2023-11-05T08:06:14.308 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.290+0000 7fad108e5640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad0c145d40 con 0x7fad0c0b4240 2023-11-05T08:06:14.308 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.290+0000 7fad108e5640 10 monclient(hunting): _renew_subs 2023-11-05T08:06:14.308 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.290+0000 7fad108e5640 10 monclient(hunting): authenticate will time out at 1317.510518s 2023-11-05T08:06:14.308 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.291+0000 7fad0a59c640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fad0c0ade00 0x7fad0c145190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:06:14.308 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.291+0000 7fad09d9b640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fad0c0b4240 0x7fad0c13e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:06:14.308 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.291+0000 7fad09d9b640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fad0c0b4240 0x7fad0c13e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.156:46906/0 (socket says 172.21.15.156:46906) 2023-11-05T08:06:14.309 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.291+0000 7fad09d9b640 1 -- 172.21.15.156:0/2240271519 learned_addr learned my addr 172.21.15.156:0/2240271519 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-11-05T08:06:14.309 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.291+0000 7fad09d9b640 10 monclient(hunting): get_auth_request con 0x7fad0c0b4240 auth_method 0 2023-11-05T08:06:14.309 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.291+0000 7fad09d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:06:14.309 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.291+0000 7fad09d9b640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:06:14.309 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.291+0000 7fad09d9b640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:06:14.310 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.291+0000 7fad0a59c640 10 monclient(hunting): get_auth_request con 0x7fad0c0ade00 auth_method 0 2023-11-05T08:06:14.310 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.291+0000 7fad0a59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:06:14.310 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.291+0000 7fad0a59c640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:06:14.310 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.291+0000 7fad0a59c640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:06:14.310 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.292+0000 7fad09d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:06:14.310 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.292+0000 7fad09d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:06:14.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.292+0000 7fad09d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:06:14.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.292+0000 7fad0a59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:06:14.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.292+0000 7fad0a59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:06:14.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.292+0000 7fad0a59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:06:14.311 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.293+0000 7fad0ad9d640 1 --2- 172.21.15.156:0/2240271519 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad0c137610 0x7fad0c137a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:06:14.312 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.294+0000 7fad0ad9d640 10 monclient(hunting): get_auth_request con 0x7fad0c137610 auth_method 0 2023-11-05T08:06:14.312 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.294+0000 7fad0ad9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:06:14.312 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.294+0000 7fad0ad9d640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:06:14.312 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.294+0000 7fad0ad9d640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:06:14.312 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.294+0000 7fad0ad9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:06:14.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.294+0000 7fad0ad9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:06:14.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.294+0000 7fad0ad9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:06:14.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.295+0000 7fad09d9b640 10 monclient(hunting): handle_auth_done global_id 4133 payload 824 2023-11-05T08:06:14.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.295+0000 7fad09d9b640 1 -- 172.21.15.156:0/2240271519 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fad0c0ade00 msgr2=0x7fad0c145190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:06:14.313 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.295+0000 7fad09d9b640 1 --2- 172.21.15.156:0/2240271519 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fad0c0ade00 0x7fad0c145190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:14.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.295+0000 7fad09d9b640 1 -- 172.21.15.156:0/2240271519 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad0c137610 msgr2=0x7fad0c137a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:06:14.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.295+0000 7fad09d9b640 1 --2- 172.21.15.156:0/2240271519 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad0c137610 0x7fad0c137a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:14.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.295+0000 7fad09d9b640 10 monclient: _finish_hunting 0 2023-11-05T08:06:14.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.295+0000 7fad09d9b640 1 monclient: found mon.noname-c 2023-11-05T08:06:14.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.295+0000 7fad09d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:06:14.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.295+0000 7fad09d9b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.52:3301/0 2023-11-05T08:06:14.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.295+0000 7fad09d9b640 1 -- 172.21.15.156:0/2240271519 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facfc0094d0 con 0x7fad0c0b4240 2023-11-05T08:06:14.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.297+0000 7fad09d9b640 1 --2- 172.21.15.156:0/2240271519 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fad0c0b4240 0x7fad0c13e100 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fad0000b4a0 tx=0x7fad0000b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:06:14.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.297+0000 7facfaffd640 10 client.?.objecter ms_handle_connect 0x7fad0c0b4240 2023-11-05T08:06:14.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.297+0000 7facfaffd640 10 client.?.objecter resend_mon_ops 2023-11-05T08:06:14.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.301+0000 7facfaffd640 1 -- 172.21.15.156:0/2240271519 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad00010610 con 0x7fad0c0b4240 2023-11-05T08:06:14.317 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.301+0000 7facfaffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:06:14.318 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.301+0000 7facfaffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-11-05T08:06:14.318 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.301+0000 7facfaffd640 10 monclient: dump: 2023-11-05T08:06:14.318 INFO:teuthology.orchestra.run.smithi156.stderr:epoch 1 2023-11-05T08:06:14.318 INFO:teuthology.orchestra.run.smithi156.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:06:14.318 INFO:teuthology.orchestra.run.smithi156.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:14.319 INFO:teuthology.orchestra.run.smithi156.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:14.319 INFO:teuthology.orchestra.run.smithi156.stderr:min_mon_release 18 (reef) 2023-11-05T08:06:14.319 INFO:teuthology.orchestra.run.smithi156.stderr:election_strategy: 1 2023-11-05T08:06:14.319 INFO:teuthology.orchestra.run.smithi156.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:06:14.319 INFO:teuthology.orchestra.run.smithi156.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:06:14.320 INFO:teuthology.orchestra.run.smithi156.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:06:14.320 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-05T08:06:14.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.301+0000 7facfaffd640 10 monclient: _finish_auth 0 2023-11-05T08:06:14.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.301+0000 7facfaffd640 10 monclient: _check_auth_tickets 2023-11-05T08:06:14.320 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.301+0000 7facfaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:06:14.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.301+0000 7facfaffd640 1 -- 172.21.15.156:0/2240271519 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad00010770 con 0x7fad0c0b4240 2023-11-05T08:06:14.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.301+0000 7fad108e5640 5 monclient: authenticate success, global_id 4133 2023-11-05T08:06:14.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.301+0000 7fad108e5640 10 monclient: _renew_subs 2023-11-05T08:06:14.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.301+0000 7fad108e5640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.52:3301/0 2023-11-05T08:06:14.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.301+0000 7fad108e5640 1 -- 172.21.15.156:0/2240271519 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad0c137fd0 con 0x7fad0c0b4240 2023-11-05T08:06:14.321 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.301+0000 7facfaffd640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:06:14.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.301+0000 7facfaffd640 1 -- 172.21.15.156:0/2240271519 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad00010b20 con 0x7fad0c0b4240 2023-11-05T08:06:14.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.301+0000 7facfaffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:06:14.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.301+0000 7facfaffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-11-05T08:06:14.322 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.301+0000 7facfaffd640 10 monclient: dump: 2023-11-05T08:06:14.322 INFO:teuthology.orchestra.run.smithi156.stderr:epoch 1 2023-11-05T08:06:14.323 INFO:teuthology.orchestra.run.smithi156.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:06:14.323 INFO:teuthology.orchestra.run.smithi156.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:14.323 INFO:teuthology.orchestra.run.smithi156.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:14.323 INFO:teuthology.orchestra.run.smithi156.stderr:min_mon_release 18 (reef) 2023-11-05T08:06:14.323 INFO:teuthology.orchestra.run.smithi156.stderr:election_strategy: 1 2023-11-05T08:06:14.323 INFO:teuthology.orchestra.run.smithi156.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:06:14.324 INFO:teuthology.orchestra.run.smithi156.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:06:14.324 INFO:teuthology.orchestra.run.smithi156.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:06:14.324 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-05T08:06:14.324 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.301+0000 7fad08d99640 4 set_mon_vals no callback set 2023-11-05T08:06:14.324 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.301+0000 7fad108e5640 10 client.4133.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-05T08:06:14.325 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.301+0000 7fad108e5640 10 monclient: _renew_subs 2023-11-05T08:06:14.325 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.301+0000 7fad108e5640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.52:3301/0 2023-11-05T08:06:14.325 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.301+0000 7fad108e5640 1 -- 172.21.15.156:0/2240271519 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad0c13e820 con 0x7fad0c0b4240 2023-11-05T08:06:14.325 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.301+0000 7fad108e5640 1 librados: init done 2023-11-05T08:06:14.325 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.302+0000 7fad108e5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-05T08:06:14.326 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.302+0000 7fad108e5640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:06:14.326 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.302+0000 7fad108e5640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.52:3301/0 2023-11-05T08:06:14.326 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.302+0000 7fad108e5640 1 -- 172.21.15.156:0/2240271519 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad0c04e9f0 con 0x7fad0c0b4240 2023-11-05T08:06:14.326 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.303+0000 7facfaffd640 1 -- 172.21.15.156:0/2240271519 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fad00023480 con 0x7fad0c0b4240 2023-11-05T08:06:14.326 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.304+0000 7facfaffd640 1 -- 172.21.15.156:0/2240271519 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7fad000229d0 con 0x7fad0c0b4240 2023-11-05T08:06:14.327 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.304+0000 7facfaffd640 10 client.4133.objecter ms_dispatch 0x7fad0c000b90 osd_map(8..8 src has 1..8) v4 2023-11-05T08:06:14.327 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.304+0000 7facfaffd640 3 client.4133.objecter handle_osd_map got epochs [8,8] > 0 2023-11-05T08:06:14.327 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.304+0000 7facfaffd640 3 client.4133.objecter handle_osd_map decoding full epoch 8 2023-11-05T08:06:14.327 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.304+0000 7facfaffd640 20 client.4133.objecter dump_active .. 0 homeless 2023-11-05T08:06:14.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.407+0000 7facfaffd640 1 -- 172.21.15.156:0/2240271519 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fad0001e060 con 0x7fad0c0b4240 2023-11-05T08:06:14.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.407+0000 7facfaffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:06:14.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.407+0000 7facfaffd640 10 monclient: _finish_command 1 = system:0 2023-11-05T08:06:14.409 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-11-05T08:06:14.407+0000 7f4a6604a040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-05T08:06:14.432 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-11-05T08:06:14.431+0000 7f1369430040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-05T08:06:14.479 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.478+0000 7fad108e5640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "d2787c11-d907-4924-b9cf-69db95ad35c2", "id": 6}] 2023-11-05T08:06:14.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.478+0000 7fad108e5640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "d2787c11-d907-4924-b9cf-69db95ad35c2", "id": 6}] 2023-11-05T08:06:14.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.478+0000 7fad108e5640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.52:3301/0 2023-11-05T08:06:14.480 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.478+0000 7fad108e5640 1 -- 172.21.15.156:0/2240271519 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "osd new", "uuid": "d2787c11-d907-4924-b9cf-69db95ad35c2", "id": 6} v 0) v1 -- 0x7fad0c0b3130 con 0x7fad0c0b4240 2023-11-05T08:06:14.484 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-11-05T08:06:14.484+0000 7f1369430040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-05T08:06:14.542 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.541+0000 7facfaffd640 1 -- 172.21.15.156:0/2240271519 <== mon.2 v2:172.21.15.52:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d2787c11-d907-4924-b9cf-69db95ad35c2", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fad000280b0 con 0x7fad0c0b4240 2023-11-05T08:06:14.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.541+0000 7facfaffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "d2787c11-d907-4924-b9cf-69db95ad35c2", "id": 6}] 2023-11-05T08:06:14.543 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.541+0000 7facfaffd640 10 monclient: _finish_command 2 = system:0 2023-11-05T08:06:14.543 INFO:teuthology.orchestra.run.smithi156.stdout:6 2023-11-05T08:06:14.545 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.542+0000 7fad108e5640 10 librados: watch_flush enter 2023-11-05T08:06:14.545 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.542+0000 7fad108e5640 10 librados: watch_flush exit 2023-11-05T08:06:14.545 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.542+0000 7fad108e5640 20 client.4133.objecter shutdown clearing up homeless session... 2023-11-05T08:06:14.545 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.542+0000 7fad108e5640 10 client.4133.objecter successfully canceled tick 2023-11-05T08:06:14.545 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.542+0000 7fad108e5640 10 monclient: shutdown 2023-11-05T08:06:14.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.542+0000 7fad108e5640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:06:14.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.542+0000 7fad108e5640 1 -- 172.21.15.156:0/2240271519 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fad0c0b4240 msgr2=0x7fad0c13e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:06:14.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.542+0000 7fad108e5640 1 --2- 172.21.15.156:0/2240271519 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fad0c0b4240 0x7fad0c13e100 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fad0000b4a0 tx=0x7fad0000b960 comp rx=0 tx=0).stop 2023-11-05T08:06:14.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.542+0000 7fad108e5640 1 -- 172.21.15.156:0/2240271519 shutdown_connections 2023-11-05T08:06:14.546 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.542+0000 7fad108e5640 1 --2- 172.21.15.156:0/2240271519 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad0c137610 0x7fad0c137a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:14.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.542+0000 7fad108e5640 1 --2- 172.21.15.156:0/2240271519 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fad0c0b4240 0x7fad0c13e100 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:14.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.542+0000 7fad108e5640 1 --2- 172.21.15.156:0/2240271519 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fad0c0ade00 0x7fad0c145190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:14.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.542+0000 7fad108e5640 1 -- 172.21.15.156:0/2240271519 >> 172.21.15.156:0/2240271519 conn(0x7fad0c065cd0 msgr2=0x7fad0c0b1aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:06:14.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.542+0000 7fad108e5640 1 -- 172.21.15.156:0/2240271519 shutdown_connections 2023-11-05T08:06:14.547 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.543+0000 7fad108e5640 1 -- 172.21.15.156:0/2240271519 wait complete. 2023-11-05T08:06:14.548 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.543+0000 7fad108e5640 1 librados: shutdown 2023-11-05T08:06:14.557 DEBUG:teuthology.orchestra.run.smithi156:> sudo ceph --cluster ceph osd new e9e51eb8-2a9d-4cd0-9158-a00eea2a5614 7 2023-11-05T08:06:14.591 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-11-05T08:06:14.590+0000 7f1369430040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-05T08:06:14.666 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.665+0000 7f3cab790640 10 monclient: get_monmap_and_config 2023-11-05T08:06:14.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.665+0000 7f3cab790640 10 monclient: build_initial_monmap 2023-11-05T08:06:14.667 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.665+0000 7f3cab790640 10 monclient: monmap: 2023-11-05T08:06:14.667 INFO:teuthology.orchestra.run.smithi156.stderr:epoch 0 2023-11-05T08:06:14.668 INFO:teuthology.orchestra.run.smithi156.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:06:14.668 INFO:teuthology.orchestra.run.smithi156.stderr:last_changed 2023-11-05T08:06:14.666812+0000 2023-11-05T08:06:14.668 INFO:teuthology.orchestra.run.smithi156.stderr:created 2023-11-05T08:06:14.666812+0000 2023-11-05T08:06:14.668 INFO:teuthology.orchestra.run.smithi156.stderr:min_mon_release 0 (unknown) 2023-11-05T08:06:14.668 INFO:teuthology.orchestra.run.smithi156.stderr:election_strategy: 1 2023-11-05T08:06:14.669 INFO:teuthology.orchestra.run.smithi156.stderr:0: v1:172.21.15.52:6789/0 mon.noname-a-legacy 2023-11-05T08:06:14.669 INFO:teuthology.orchestra.run.smithi156.stderr:1: v1:172.21.15.156:6789/0 mon.noname-c-legacy 2023-11-05T08:06:14.669 INFO:teuthology.orchestra.run.smithi156.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-b 2023-11-05T08:06:14.669 INFO:teuthology.orchestra.run.smithi156.stderr:3: v2:172.21.15.52:3300/0 mon.noname-a 2023-11-05T08:06:14.669 INFO:teuthology.orchestra.run.smithi156.stderr:4: v2:172.21.15.156:3300/0 mon.noname-c 2023-11-05T08:06:14.670 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-05T08:06:14.670 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.666+0000 7f3cab790640 1 Processor -- start 2023-11-05T08:06:14.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.666+0000 7f3cab790640 1 -- start start 2023-11-05T08:06:14.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.666+0000 7f3cab790640 10 monclient: init 2023-11-05T08:06:14.672 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.667+0000 7f3cab790640 10 monclient: _reopen_session rank -1 2023-11-05T08:06:14.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.667+0000 7f3cab790640 10 monclient: _add_conns ranks=[3,1,2,4,0] 2023-11-05T08:06:14.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.667+0000 7f3cab790640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3ca40a8b30 0x7f3ca40a8f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:06:14.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.667+0000 7f3cab790640 10 monclient(hunting): picked mon.noname-a con 0x7f3ca40a8b30 addr v2:172.21.15.52:3300/0 2023-11-05T08:06:14.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.667+0000 7f3cab790640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f3ca413ea60 addr v1:172.21.15.156:6789/0 2023-11-05T08:06:14.673 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.667+0000 7f3cab790640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3ca4141c60 0x7f3ca41420f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:06:14.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.667+0000 7f3cab790640 10 monclient(hunting): picked mon.noname-b con 0x7f3ca4141c60 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:06:14.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.667+0000 7f3cab790640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ca413f5c0 con 0x7f3ca413ea60 2023-11-05T08:06:14.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.667+0000 7f3cab790640 10 monclient(hunting): start opening mon connection 2023-11-05T08:06:14.674 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.667+0000 7f3cab790640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ca40b1670 con 0x7f3ca40a8b30 2023-11-05T08:06:14.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.667+0000 7f3cab790640 10 monclient(hunting): start opening mon connection 2023-11-05T08:06:14.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.667+0000 7f3cab790640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca40aa420 con 0x7f3ca4141c60 2023-11-05T08:06:14.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.667+0000 7f3cab790640 10 monclient(hunting): _renew_subs 2023-11-05T08:06:14.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.667+0000 7f3cab790640 10 monclient(hunting): authenticate will time out at 1317.886996s 2023-11-05T08:06:14.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.667+0000 7f3ca8d2b640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f3ca413ea60 0x7f3ca413eeb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.156:57032/0 (socket says 172.21.15.156:57032) 2023-11-05T08:06:14.675 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.667+0000 7f3ca8d2b640 1 -- 172.21.15.156:0/908002832 learned_addr learned my addr 172.21.15.156:0/908002832 (peer_addr_for_me v1:172.21.15.156:0/0) 2023-11-05T08:06:14.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.667+0000 7f3ca9d2d640 1 --2- 172.21.15.156:0/908002832 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3ca4141c60 0x7f3ca41420f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:06:14.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.668+0000 7f3ca9d2d640 10 monclient(hunting): get_auth_request con 0x7f3ca4141c60 auth_method 0 2023-11-05T08:06:14.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.668+0000 7f3ca9d2d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:06:14.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.668+0000 7f3ca9d2d640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:06:14.676 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.668+0000 7f3ca9d2d640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:06:14.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.668+0000 7f3ca9d2d640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:06:14.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.668+0000 7f3ca9d2d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:06:14.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.668+0000 7f3ca9d2d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:06:14.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.670+0000 7f3ca9d2d640 10 monclient(hunting): handle_auth_done global_id 4136 payload 274 2023-11-05T08:06:14.677 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.670+0000 7f3ca9d2d640 1 -- 172.21.15.156:0/908002832 >> v2:172.21.15.52:3300/0 conn(0x7f3ca40a8b30 msgr2=0x7f3ca40a8f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-05T08:06:14.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.670+0000 7f3ca9d2d640 1 --2- 172.21.15.156:0/908002832 >> v2:172.21.15.52:3300/0 conn(0x7f3ca40a8b30 0x7f3ca40a8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:14.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.670+0000 7f3ca9d2d640 1 -- 172.21.15.156:0/908002832 >> v1:172.21.15.156:6789/0 conn(0x7f3ca413ea60 legacy=0x7f3ca413eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:06:14.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.670+0000 7f3ca9d2d640 10 monclient: _finish_hunting 0 2023-11-05T08:06:14.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.670+0000 7f3ca9d2d640 1 monclient: found mon.noname-b 2023-11-05T08:06:14.678 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.670+0000 7f3ca9d2d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:06:14.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.670+0000 7f3ca9d2d640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.52:3301/0 2023-11-05T08:06:14.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.670+0000 7f3ca9d2d640 1 -- 172.21.15.156:0/908002832 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ca40b80e0 con 0x7f3ca4141c60 2023-11-05T08:06:14.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.670+0000 7f3c9bfff640 1 -- 172.21.15.156:0/908002832 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2012800827 0 0) 0x7f3ca413f5c0 con 0x7f3ca413ea60 2023-11-05T08:06:14.679 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.670+0000 7f3c9bfff640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) v1 2023-11-05T08:06:14.683 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.672+0000 7f3ca9d2d640 1 --2- 172.21.15.156:0/908002832 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3ca4141c60 0x7f3ca41420f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c009d90 tx=0x7f3c9c02be10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff6a5115bc3d8a7d server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:06:14.684 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.675+0000 7f3c9bfff640 1 -- 172.21.15.156:0/908002832 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c9c02cbc0 con 0x7f3ca4141c60 2023-11-05T08:06:14.684 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.675+0000 7f3c9bfff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:06:14.684 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.675+0000 7f3c9bfff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-05T08:06:14.684 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.675+0000 7f3c9bfff640 10 monclient: dump: 2023-11-05T08:06:14.685 INFO:teuthology.orchestra.run.smithi156.stderr:epoch 1 2023-11-05T08:06:14.685 INFO:teuthology.orchestra.run.smithi156.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:06:14.685 INFO:teuthology.orchestra.run.smithi156.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:14.685 INFO:teuthology.orchestra.run.smithi156.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:14.685 INFO:teuthology.orchestra.run.smithi156.stderr:min_mon_release 18 (reef) 2023-11-05T08:06:14.686 INFO:teuthology.orchestra.run.smithi156.stderr:election_strategy: 1 2023-11-05T08:06:14.686 INFO:teuthology.orchestra.run.smithi156.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:06:14.686 INFO:teuthology.orchestra.run.smithi156.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:06:14.686 INFO:teuthology.orchestra.run.smithi156.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:06:14.686 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-05T08:06:14.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.675+0000 7f3c9bfff640 10 monclient: _finish_auth 0 2023-11-05T08:06:14.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.675+0000 7f3c9bfff640 10 monclient: _check_auth_tickets 2023-11-05T08:06:14.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.675+0000 7f3c9bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:06:14.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.675+0000 7f3c9bfff640 1 -- 172.21.15.156:0/908002832 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c9c02cd20 con 0x7f3ca4141c60 2023-11-05T08:06:14.687 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.675+0000 7f3cab790640 5 monclient: authenticate success, global_id 4136 2023-11-05T08:06:14.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.675+0000 7f3cab790640 20 monclient: get_monmap_and_config waiting for monmap|config 2023-11-05T08:06:14.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.675+0000 7f3c9bfff640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:06:14.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.675+0000 7f3cab790640 10 monclient: get_monmap_and_config success 2023-11-05T08:06:14.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.675+0000 7f3cab790640 4 set_mon_vals no callback set 2023-11-05T08:06:14.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.675+0000 7f3c9bfff640 1 -- 172.21.15.156:0/908002832 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c9c034660 con 0x7f3ca4141c60 2023-11-05T08:06:14.688 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.675+0000 7f3c9bfff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:06:14.689 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.675+0000 7f3c9bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-11-05T08:06:14.689 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.675+0000 7f3c9bfff640 10 monclient: dump: 2023-11-05T08:06:14.689 INFO:teuthology.orchestra.run.smithi156.stderr:epoch 1 2023-11-05T08:06:14.689 INFO:teuthology.orchestra.run.smithi156.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:06:14.689 INFO:teuthology.orchestra.run.smithi156.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:14.690 INFO:teuthology.orchestra.run.smithi156.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:14.690 INFO:teuthology.orchestra.run.smithi156.stderr:min_mon_release 18 (reef) 2023-11-05T08:06:14.690 INFO:teuthology.orchestra.run.smithi156.stderr:election_strategy: 1 2023-11-05T08:06:14.690 INFO:teuthology.orchestra.run.smithi156.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:06:14.690 INFO:teuthology.orchestra.run.smithi156.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:06:14.691 INFO:teuthology.orchestra.run.smithi156.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:06:14.691 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-05T08:06:14.691 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.676+0000 7f3cab790640 10 monclient: shutdown 2023-11-05T08:06:14.691 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.676+0000 7f3cab790640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:06:14.691 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.676+0000 7f3cab790640 1 -- 172.21.15.156:0/908002832 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3ca4141c60 msgr2=0x7f3ca41420f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:06:14.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.676+0000 7f3cab790640 1 --2- 172.21.15.156:0/908002832 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3ca4141c60 0x7f3ca41420f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c009d90 tx=0x7f3c9c02be10 comp rx=0 tx=0).stop 2023-11-05T08:06:14.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.676+0000 7f3cab790640 1 -- 172.21.15.156:0/908002832 shutdown_connections 2023-11-05T08:06:14.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.676+0000 7f3cab790640 1 --2- 172.21.15.156:0/908002832 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3ca4141c60 0x7f3ca41420f0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:14.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.676+0000 7f3cab790640 1 --2- 172.21.15.156:0/908002832 >> v2:172.21.15.52:3300/0 conn(0x7f3ca40a8b30 0x7f3ca40a8f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:14.692 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.676+0000 7f3cab790640 1 -- 172.21.15.156:0/908002832 >> 172.21.15.156:0/908002832 conn(0x7f3ca40b7230 msgr2=0x7f3ca40b7610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:06:14.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.676+0000 7f3cab790640 1 -- 172.21.15.156:0/908002832 shutdown_connections 2023-11-05T08:06:14.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.676+0000 7f3cab790640 1 -- 172.21.15.156:0/908002832 wait complete. 2023-11-05T08:06:14.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.677+0000 7f3cab790640 10 monclient: build_initial_monmap 2023-11-05T08:06:14.693 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.677+0000 7f3cab790640 10 monclient: monmap: 2023-11-05T08:06:14.693 INFO:teuthology.orchestra.run.smithi156.stderr:epoch 0 2023-11-05T08:06:14.693 INFO:teuthology.orchestra.run.smithi156.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-05T08:06:14.694 INFO:teuthology.orchestra.run.smithi156.stderr:last_changed 0.000000 2023-11-05T08:06:14.694 INFO:teuthology.orchestra.run.smithi156.stderr:created 0.000000 2023-11-05T08:06:14.694 INFO:teuthology.orchestra.run.smithi156.stderr:min_mon_release 0 (unknown) 2023-11-05T08:06:14.694 INFO:teuthology.orchestra.run.smithi156.stderr:election_strategy: 1 2023-11-05T08:06:14.694 INFO:teuthology.orchestra.run.smithi156.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.noname-a 2023-11-05T08:06:14.695 INFO:teuthology.orchestra.run.smithi156.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.noname-b 2023-11-05T08:06:14.695 INFO:teuthology.orchestra.run.smithi156.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-c 2023-11-05T08:06:14.695 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-05T08:06:14.695 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.677+0000 7f3cab790640 1 librados: starting msgr at 2023-11-05T08:06:14.695 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.677+0000 7f3cab790640 1 librados: starting objecter 2023-11-05T08:06:14.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.677+0000 7f3cab790640 1 Processor -- start 2023-11-05T08:06:14.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.677+0000 7f3cab790640 1 -- start start 2023-11-05T08:06:14.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.677+0000 7f3cab790640 1 librados: setting wanted keys 2023-11-05T08:06:14.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.677+0000 7f3cab790640 1 librados: calling monclient init 2023-11-05T08:06:14.696 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.677+0000 7f3cab790640 10 monclient: init 2023-11-05T08:06:14.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.678+0000 7f3cab790640 10 monclient: _reopen_session rank -1 2023-11-05T08:06:14.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.678+0000 7f3cab790640 10 monclient: _add_conns ranks=[2,1,0] 2023-11-05T08:06:14.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.678+0000 7f3cab790640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3ca40a8b30 0x7f3ca413ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:06:14.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.678+0000 7f3cab790640 10 monclient(hunting): picked mon.noname-c con 0x7f3ca40a8b30 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:06:14.697 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.678+0000 7f3cab790640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3ca413ea60 0x7f3ca4140390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:06:14.698 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.678+0000 7f3cab790640 10 monclient(hunting): picked mon.noname-b con 0x7f3ca413ea60 addr [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] 2023-11-05T08:06:14.698 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.678+0000 7f3cab790640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ca4141c60 0x7f3ca41d9f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:06:14.698 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.678+0000 7f3cab790640 10 monclient(hunting): picked mon.noname-a con 0x7f3ca4141c60 addr [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] 2023-11-05T08:06:14.698 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.678+0000 7f3cab790640 10 monclient(hunting): start opening mon connection 2023-11-05T08:06:14.698 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.678+0000 7f3cab790640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca41437b0 con 0x7f3ca4141c60 2023-11-05T08:06:14.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.678+0000 7f3cab790640 10 monclient(hunting): start opening mon connection 2023-11-05T08:06:14.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.678+0000 7f3cab790640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca4140f80 con 0x7f3ca413ea60 2023-11-05T08:06:14.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.678+0000 7f3cab790640 10 monclient(hunting): start opening mon connection 2023-11-05T08:06:14.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.678+0000 7f3cab790640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca41410f0 con 0x7f3ca40a8b30 2023-11-05T08:06:14.699 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.678+0000 7f3cab790640 10 monclient(hunting): _renew_subs 2023-11-05T08:06:14.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.678+0000 7f3cab790640 10 monclient(hunting): authenticate will time out at 1317.898117s 2023-11-05T08:06:14.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.678+0000 7f3ca8d2b640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3ca413ea60 0x7f3ca4140390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:06:14.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.678+0000 7f3ca952c640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3ca40a8b30 0x7f3ca413ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:06:14.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.678+0000 7f3ca952c640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3ca40a8b30 0x7f3ca413ad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.156:46936/0 (socket says 172.21.15.156:46936) 2023-11-05T08:06:14.700 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.678+0000 7f3ca952c640 1 -- 172.21.15.156:0/1967421403 learned_addr learned my addr 172.21.15.156:0/1967421403 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-11-05T08:06:14.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.678+0000 7f3ca952c640 10 monclient(hunting): get_auth_request con 0x7f3ca40a8b30 auth_method 0 2023-11-05T08:06:14.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.678+0000 7f3ca952c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:06:14.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.678+0000 7f3ca952c640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:06:14.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.678+0000 7f3ca952c640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:06:14.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.678+0000 7f3ca8d2b640 10 monclient(hunting): get_auth_request con 0x7f3ca413ea60 auth_method 0 2023-11-05T08:06:14.701 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.678+0000 7f3ca8d2b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:06:14.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.678+0000 7f3ca8d2b640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:06:14.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.678+0000 7f3ca8d2b640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:06:14.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.679+0000 7f3ca8d2b640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:06:14.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.679+0000 7f3ca8d2b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:06:14.702 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.679+0000 7f3ca8d2b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:06:14.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.679+0000 7f3ca952c640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:06:14.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.679+0000 7f3ca952c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:06:14.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.679+0000 7f3ca952c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:06:14.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.682+0000 7f3ca8d2b640 10 monclient(hunting): handle_auth_done global_id 4159 payload 824 2023-11-05T08:06:14.703 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.682+0000 7f3ca8d2b640 1 -- 172.21.15.156:0/1967421403 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3ca40a8b30 msgr2=0x7f3ca413ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:06:14.704 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.682+0000 7f3ca8d2b640 1 --2- 172.21.15.156:0/1967421403 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3ca40a8b30 0x7f3ca413ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:14.704 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.682+0000 7f3ca8d2b640 1 -- 172.21.15.156:0/1967421403 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ca4141c60 msgr2=0x7f3ca41d9f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:06:14.704 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.682+0000 7f3ca8d2b640 1 --2- 172.21.15.156:0/1967421403 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ca4141c60 0x7f3ca41d9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:14.704 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.682+0000 7f3ca8d2b640 10 monclient: _finish_hunting 0 2023-11-05T08:06:14.704 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.682+0000 7f3ca8d2b640 1 monclient: found mon.noname-b 2023-11-05T08:06:14.705 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.682+0000 7f3ca8d2b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:06:14.705 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.682+0000 7f3ca8d2b640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.156:3300/0 2023-11-05T08:06:14.705 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.682+0000 7f3ca8d2b640 1 -- 172.21.15.156:0/1967421403 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c9c009a70 con 0x7f3ca413ea60 2023-11-05T08:06:14.706 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-11-05T08:06:14.700+0000 7f4a6604a040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-05T08:06:14.707 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.684+0000 7f3ca8d2b640 1 --2- 172.21.15.156:0/1967421403 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3ca413ea60 0x7f3ca4140390 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3c9400c480 tx=0x7f3c9400c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:06:14.708 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.684+0000 7f3c99ffb640 10 client.?.objecter ms_handle_connect 0x7f3ca413ea60 2023-11-05T08:06:14.708 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.684+0000 7f3c99ffb640 10 client.?.objecter resend_mon_ops 2023-11-05T08:06:14.708 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.687+0000 7f3c99ffb640 1 -- 172.21.15.156:0/1967421403 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c940074e0 con 0x7f3ca413ea60 2023-11-05T08:06:14.708 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.687+0000 7f3c99ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:06:14.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.687+0000 7f3c99ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-05T08:06:14.709 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.687+0000 7f3c99ffb640 10 monclient: dump: 2023-11-05T08:06:14.709 INFO:teuthology.orchestra.run.smithi156.stderr:epoch 1 2023-11-05T08:06:14.709 INFO:teuthology.orchestra.run.smithi156.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:06:14.709 INFO:teuthology.orchestra.run.smithi156.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:14.710 INFO:teuthology.orchestra.run.smithi156.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:14.710 INFO:teuthology.orchestra.run.smithi156.stderr:min_mon_release 18 (reef) 2023-11-05T08:06:14.710 INFO:teuthology.orchestra.run.smithi156.stderr:election_strategy: 1 2023-11-05T08:06:14.710 INFO:teuthology.orchestra.run.smithi156.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:06:14.710 INFO:teuthology.orchestra.run.smithi156.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:06:14.711 INFO:teuthology.orchestra.run.smithi156.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:06:14.711 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-05T08:06:14.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.687+0000 7f3c99ffb640 10 monclient: _finish_auth 0 2023-11-05T08:06:14.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.687+0000 7f3c99ffb640 10 monclient: _check_auth_tickets 2023-11-05T08:06:14.711 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.687+0000 7f3c99ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:06:14.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.687+0000 7f3c99ffb640 1 -- 172.21.15.156:0/1967421403 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c94007640 con 0x7f3ca413ea60 2023-11-05T08:06:14.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.687+0000 7f3cab790640 5 monclient: authenticate success, global_id 4159 2023-11-05T08:06:14.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.687+0000 7f3cab790640 10 monclient: _renew_subs 2023-11-05T08:06:14.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.687+0000 7f3cab790640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:06:14.712 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.687+0000 7f3cab790640 1 -- 172.21.15.156:0/1967421403 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ca41da4b0 con 0x7f3ca413ea60 2023-11-05T08:06:14.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.687+0000 7f3c99ffb640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:06:14.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.687+0000 7f3c99ffb640 1 -- 172.21.15.156:0/1967421403 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c94004a20 con 0x7f3ca413ea60 2023-11-05T08:06:14.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.687+0000 7f3c99ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:06:14.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.687+0000 7f3c99ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-05T08:06:14.713 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.687+0000 7f3c99ffb640 10 monclient: dump: 2023-11-05T08:06:14.714 INFO:teuthology.orchestra.run.smithi156.stderr:epoch 1 2023-11-05T08:06:14.714 INFO:teuthology.orchestra.run.smithi156.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:06:14.714 INFO:teuthology.orchestra.run.smithi156.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:14.714 INFO:teuthology.orchestra.run.smithi156.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:14.714 INFO:teuthology.orchestra.run.smithi156.stderr:min_mon_release 18 (reef) 2023-11-05T08:06:14.715 INFO:teuthology.orchestra.run.smithi156.stderr:election_strategy: 1 2023-11-05T08:06:14.715 INFO:teuthology.orchestra.run.smithi156.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:06:14.715 INFO:teuthology.orchestra.run.smithi156.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:06:14.715 INFO:teuthology.orchestra.run.smithi156.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:06:14.715 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-05T08:06:14.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.687+0000 7f3c9b7fe640 4 set_mon_vals no callback set 2023-11-05T08:06:14.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.688+0000 7f3cab790640 10 client.4159.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-05T08:06:14.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.688+0000 7f3cab790640 10 monclient: _renew_subs 2023-11-05T08:06:14.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.688+0000 7f3cab790640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:06:14.716 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.688+0000 7f3cab790640 1 -- 172.21.15.156:0/1967421403 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ca4145ce0 con 0x7f3ca413ea60 2023-11-05T08:06:14.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.688+0000 7f3cab790640 1 librados: init done 2023-11-05T08:06:14.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.689+0000 7f3cab790640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-05T08:06:14.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.689+0000 7f3cab790640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:06:14.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.689+0000 7f3cab790640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:06:14.717 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.689+0000 7f3cab790640 1 -- 172.21.15.156:0/1967421403 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ca404e9f0 con 0x7f3ca413ea60 2023-11-05T08:06:14.758 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-11-05T08:06:14.757+0000 7f4a6604a040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-05T08:06:14.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.859+0000 7f3c99ffb640 1 -- 172.21.15.156:0/1967421403 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f3c9401d3f0 con 0x7f3ca413ea60 2023-11-05T08:06:14.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.860+0000 7f3c99ffb640 1 -- 172.21.15.156:0/1967421403 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f3c94013a20 con 0x7f3ca413ea60 2023-11-05T08:06:14.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.860+0000 7f3c99ffb640 10 client.4159.objecter ms_dispatch 0x7f3ca4000b90 osd_map(9..9 src has 1..9) v4 2023-11-05T08:06:14.861 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.860+0000 7f3c99ffb640 3 client.4159.objecter handle_osd_map got epochs [9,9] > 0 2023-11-05T08:06:14.862 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.860+0000 7f3c99ffb640 3 client.4159.objecter handle_osd_map decoding full epoch 9 2023-11-05T08:06:14.862 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.860+0000 7f3c99ffb640 20 client.4159.objecter dump_active .. 0 homeless 2023-11-05T08:06:14.862 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.860+0000 7f3c99ffb640 1 -- 172.21.15.156:0/1967421403 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f3c94013cf0 con 0x7f3ca413ea60 2023-11-05T08:06:14.862 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.860+0000 7f3c99ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:06:14.862 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.860+0000 7f3c99ffb640 10 monclient: _finish_command 1 = system:0 2023-11-05T08:06:14.863 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-11-05T08:06:14.862+0000 7f4a6604a040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-05T08:06:14.934 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.933+0000 7f3cab790640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "e9e51eb8-2a9d-4cd0-9158-a00eea2a5614", "id": 7}] 2023-11-05T08:06:14.935 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.933+0000 7f3cab790640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "e9e51eb8-2a9d-4cd0-9158-a00eea2a5614", "id": 7}] 2023-11-05T08:06:14.935 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.933+0000 7f3cab790640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:06:14.935 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:14.933+0000 7f3cab790640 1 -- 172.21.15.156:0/1967421403 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e9e51eb8-2a9d-4cd0-9158-a00eea2a5614", "id": 7} v 0) v1 -- 0x7f3ca40a9270 con 0x7f3ca413ea60 2023-11-05T08:06:15.090 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:15.089+0000 7f3c99ffb640 1 -- 172.21.15.156:0/1967421403 <== mon.1 v2:172.21.15.156:3300/0 7 ==== mgrmap(e 2) v1 ==== 44566+0+0 (secure 0 0 0) 0x7f3c940133c0 con 0x7f3ca413ea60 2023-11-05T08:06:15.447 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:15.446+0000 7f3c99ffb640 1 -- 172.21.15.156:0/1967421403 <== mon.1 v2:172.21.15.156:3300/0 8 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e9e51eb8-2a9d-4cd0-9158-a00eea2a5614", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3c9401b700 con 0x7f3ca413ea60 2023-11-05T08:06:15.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:15.446+0000 7f3c99ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "e9e51eb8-2a9d-4cd0-9158-a00eea2a5614", "id": 7}] 2023-11-05T08:06:15.448 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:15.446+0000 7f3c99ffb640 10 monclient: _finish_command 2 = system:0 2023-11-05T08:06:15.449 INFO:teuthology.orchestra.run.smithi156.stdout:7 2023-11-05T08:06:15.450 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:15.447+0000 7f3cab790640 10 librados: watch_flush enter 2023-11-05T08:06:15.450 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:15.447+0000 7f3cab790640 10 librados: watch_flush exit 2023-11-05T08:06:15.450 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:15.447+0000 7f3cab790640 20 client.4159.objecter shutdown clearing up homeless session... 2023-11-05T08:06:15.451 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:15.447+0000 7f3cab790640 10 client.4159.objecter successfully canceled tick 2023-11-05T08:06:15.451 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:15.447+0000 7f3cab790640 10 monclient: shutdown 2023-11-05T08:06:15.451 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:15.447+0000 7f3cab790640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:06:15.451 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:15.447+0000 7f3cab790640 1 -- 172.21.15.156:0/1967421403 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3ca413ea60 msgr2=0x7f3ca4140390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:06:15.451 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:15.447+0000 7f3cab790640 1 --2- 172.21.15.156:0/1967421403 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3ca413ea60 0x7f3ca4140390 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3c9400c480 tx=0x7f3c9400c940 comp rx=0 tx=0).stop 2023-11-05T08:06:15.452 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:15.448+0000 7f3cab790640 1 -- 172.21.15.156:0/1967421403 shutdown_connections 2023-11-05T08:06:15.452 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:15.448+0000 7f3cab790640 1 --2- 172.21.15.156:0/1967421403 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ca4141c60 0x7f3ca41d9f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:15.452 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:15.448+0000 7f3cab790640 1 --2- 172.21.15.156:0/1967421403 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3ca413ea60 0x7f3ca4140390 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:15.452 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:15.448+0000 7f3cab790640 1 --2- 172.21.15.156:0/1967421403 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3ca40a8b30 0x7f3ca413ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:15.452 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:15.448+0000 7f3cab790640 1 -- 172.21.15.156:0/1967421403 >> 172.21.15.156:0/1967421403 conn(0x7f3ca40b7230 msgr2=0x7f3ca41386d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:06:15.453 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:15.448+0000 7f3cab790640 1 -- 172.21.15.156:0/1967421403 shutdown_connections 2023-11-05T08:06:15.453 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:15.448+0000 7f3cab790640 1 -- 172.21.15.156:0/1967421403 wait complete. 2023-11-05T08:06:15.453 INFO:teuthology.orchestra.run.smithi156.stderr:2023-11-05T08:06:15.448+0000 7f3cab790640 1 librados: shutdown 2023-11-05T08:06:15.459 DEBUG:tasks.ceph_manager:running osd.0 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.0.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2023-11-05T08:06:15.460 INFO:tasks.ceph.osd.0:Restarting daemon 2023-11-05T08:06:15.460 DEBUG:teuthology.orchestra.run.smithi052:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.0.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 0 2023-11-05T08:06:15.464 INFO:tasks.ceph.osd.0:Started 2023-11-05T08:06:15.464 DEBUG:tasks.ceph_manager:running osd.1 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.1.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2023-11-05T08:06:15.464 INFO:tasks.ceph.osd.1:Restarting daemon 2023-11-05T08:06:15.465 DEBUG:teuthology.orchestra.run.smithi052:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.1.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 1 2023-11-05T08:06:15.467 INFO:tasks.ceph.osd.1:Started 2023-11-05T08:06:15.467 DEBUG:tasks.ceph_manager:running osd.2 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.2.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2023-11-05T08:06:15.467 INFO:tasks.ceph.osd.2:Restarting daemon 2023-11-05T08:06:15.468 DEBUG:teuthology.orchestra.run.smithi052:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.2.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 2 2023-11-05T08:06:15.470 INFO:tasks.ceph.osd.2:Started 2023-11-05T08:06:15.470 DEBUG:tasks.ceph_manager:running osd.3 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.3.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2023-11-05T08:06:15.470 INFO:tasks.ceph.osd.3:Restarting daemon 2023-11-05T08:06:15.471 DEBUG:teuthology.orchestra.run.smithi052:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.3.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 3 2023-11-05T08:06:15.473 INFO:tasks.ceph.osd.3:Started 2023-11-05T08:06:15.473 DEBUG:tasks.ceph_manager:running osd.4 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.4.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2023-11-05T08:06:15.474 INFO:tasks.ceph.osd.4:Restarting daemon 2023-11-05T08:06:15.474 DEBUG:teuthology.orchestra.run.smithi156:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.4.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 4 2023-11-05T08:06:15.502 INFO:tasks.ceph.osd.4:Started 2023-11-05T08:06:15.503 DEBUG:tasks.ceph_manager:running osd.5 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.5.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2023-11-05T08:06:15.503 INFO:tasks.ceph.osd.5:Restarting daemon 2023-11-05T08:06:15.504 DEBUG:teuthology.orchestra.run.smithi156:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.5.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 5 2023-11-05T08:06:15.506 INFO:tasks.ceph.osd.5:Started 2023-11-05T08:06:15.506 DEBUG:tasks.ceph_manager:running osd.6 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.6.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2023-11-05T08:06:15.507 INFO:tasks.ceph.osd.6:Restarting daemon 2023-11-05T08:06:15.507 DEBUG:teuthology.orchestra.run.smithi156:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.6.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 6 2023-11-05T08:06:15.509 INFO:tasks.ceph.osd.6:Started 2023-11-05T08:06:15.510 DEBUG:tasks.ceph_manager:running osd.7 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.7.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2023-11-05T08:06:15.510 INFO:tasks.ceph.osd.7:Restarting daemon 2023-11-05T08:06:15.510 DEBUG:teuthology.orchestra.run.smithi156:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.7.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 7 2023-11-05T08:06:15.513 INFO:tasks.ceph.osd.7:Started 2023-11-05T08:06:15.513 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-05T08:06:15.643 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.641+0000 7fe0983ce640 10 monclient: get_monmap_and_config 2023-11-05T08:06:15.643 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.641+0000 7fe0983ce640 10 monclient: build_initial_monmap 2023-11-05T08:06:15.643 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.641+0000 7fe0983ce640 10 monclient: monmap: 2023-11-05T08:06:15.644 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:06:15.644 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:06:15.644 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:06:15.643159+0000 2023-11-05T08:06:15.644 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:06:15.643159+0000 2023-11-05T08:06:15.644 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:06:15.645 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:06:15.645 INFO:teuthology.orchestra.run.smithi052.stderr:0: v1:172.21.15.52:6789/0 mon.noname-a-legacy 2023-11-05T08:06:15.645 INFO:teuthology.orchestra.run.smithi052.stderr:1: v1:172.21.15.156:6789/0 mon.noname-c-legacy 2023-11-05T08:06:15.645 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-b 2023-11-05T08:06:15.645 INFO:teuthology.orchestra.run.smithi052.stderr:3: v2:172.21.15.52:3300/0 mon.noname-a 2023-11-05T08:06:15.645 INFO:teuthology.orchestra.run.smithi052.stderr:4: v2:172.21.15.156:3300/0 mon.noname-c 2023-11-05T08:06:15.646 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:06:15.650 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.642+0000 7fe0983ce640 1 Processor -- start 2023-11-05T08:06:15.650 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.642+0000 7fe0983ce640 1 -- start start 2023-11-05T08:06:15.650 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.642+0000 7fe0983ce640 10 monclient: init 2023-11-05T08:06:15.650 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.643+0000 7fe0983ce640 10 monclient: _reopen_session rank -1 2023-11-05T08:06:15.651 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.643+0000 7fe0983ce640 10 monclient: _add_conns ranks=[1,4,2,0,3] 2023-11-05T08:06:15.651 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.643+0000 7fe0983ce640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fe0900b4240 addr v1:172.21.15.156:6789/0 2023-11-05T08:06:15.651 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.643+0000 7fe0983ce640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe0900b38d0 0x7fe0900ae640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:06:15.651 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.643+0000 7fe0983ce640 10 monclient(hunting): picked mon.noname-c con 0x7fe0900b38d0 addr v2:172.21.15.156:3300/0 2023-11-05T08:06:15.651 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.643+0000 7fe0983ce640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe0900ade00 0x7fe09013b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:06:15.652 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.643+0000 7fe0983ce640 10 monclient(hunting): picked mon.noname-b con 0x7fe0900ade00 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:06:15.652 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.643+0000 7fe0983ce640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0900b0cc0 con 0x7fe0900b4240 2023-11-05T08:06:15.652 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.643+0000 7fe0983ce640 10 monclient(hunting): start opening mon connection 2023-11-05T08:06:15.652 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.643+0000 7fe0983ce640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0900b4620 con 0x7fe0900b38d0 2023-11-05T08:06:15.652 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.643+0000 7fe0983ce640 10 monclient(hunting): start opening mon connection 2023-11-05T08:06:15.653 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.643+0000 7fe0983ce640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0900aeb80 con 0x7fe0900ade00 2023-11-05T08:06:15.653 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.643+0000 7fe0983ce640 10 monclient(hunting): _renew_subs 2023-11-05T08:06:15.653 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.643+0000 7fe0983ce640 10 monclient(hunting): authenticate will time out at 1321.849745s 2023-11-05T08:06:15.653 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.644+0000 7fe09696b640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe0900ade00 0x7fe09013b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:06:15.653 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.644+0000 7fe095969640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe0900b38d0 0x7fe0900ae640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:06:15.653 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.645+0000 7fe09696b640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe0900ade00 0x7fe09013b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.52:58836/0 (socket says 172.21.15.52:58836) 2023-11-05T08:06:15.654 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.645+0000 7fe09696b640 1 -- 172.21.15.52:0/719864649 learned_addr learned my addr 172.21.15.52:0/719864649 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-11-05T08:06:15.654 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.645+0000 7fe09696b640 10 monclient(hunting): get_auth_request con 0x7fe0900ade00 auth_method 0 2023-11-05T08:06:15.654 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.645+0000 7fe09696b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:06:15.654 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.645+0000 7fe09696b640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:06:15.654 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.645+0000 7fe09696b640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:06:15.655 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.645+0000 7fe095969640 10 monclient(hunting): get_auth_request con 0x7fe0900b38d0 auth_method 0 2023-11-05T08:06:15.655 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.645+0000 7fe095969640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:06:15.655 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.645+0000 7fe095969640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:06:15.655 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.645+0000 7fe095969640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:06:15.655 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.645+0000 7fe09696b640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:06:15.656 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.645+0000 7fe09696b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:06:15.656 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.645+0000 7fe09696b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:06:15.656 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.646+0000 7fe095969640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:06:15.656 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.646+0000 7fe095969640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:06:15.656 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.646+0000 7fe095969640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:06:15.656 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.647+0000 7fe09696b640 10 monclient(hunting): handle_auth_done global_id 4142 payload 274 2023-11-05T08:06:15.657 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.648+0000 7fe09696b640 1 -- 172.21.15.52:0/719864649 >> v2:172.21.15.156:3300/0 conn(0x7fe0900b38d0 msgr2=0x7fe0900ae640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-05T08:06:15.657 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.648+0000 7fe09696b640 1 --2- 172.21.15.52:0/719864649 >> v2:172.21.15.156:3300/0 conn(0x7fe0900b38d0 0x7fe0900ae640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:15.657 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.648+0000 7fe09696b640 1 -- 172.21.15.52:0/719864649 >> v1:172.21.15.156:6789/0 conn(0x7fe0900b4240 legacy=0x7fe0900b1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:06:15.657 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.648+0000 7fe09696b640 10 monclient: _finish_hunting 0 2023-11-05T08:06:15.657 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.648+0000 7fe09696b640 1 monclient: found mon.noname-b 2023-11-05T08:06:15.658 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.648+0000 7fe09696b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:06:15.658 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.648+0000 7fe09696b640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.52:3301/0 2023-11-05T08:06:15.658 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.648+0000 7fe09696b640 1 -- 172.21.15.52:0/719864649 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe09013f5f0 con 0x7fe0900ade00 2023-11-05T08:06:15.658 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.651+0000 7fe09696b640 1 --2- 172.21.15.52:0/719864649 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe0900ade00 0x7fe09013b420 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe088009e80 tx=0x7fe08802bec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=26f4e13c920bbc3f server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:06:15.740 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.739+0000 7fe095168640 1 -- 172.21.15.52:0/719864649 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe08802ca60 con 0x7fe0900ade00 2023-11-05T08:06:15.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.739+0000 7fe095168640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:06:15.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.739+0000 7fe095168640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-05T08:06:15.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.739+0000 7fe095168640 10 monclient: dump: 2023-11-05T08:06:15.741 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:06:15.742 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:06:15.742 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:15.742 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:15.742 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:06:15.742 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:06:15.743 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:06:15.743 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:06:15.743 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:06:15.743 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:06:15.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.739+0000 7fe095168640 10 monclient: _finish_auth 0 2023-11-05T08:06:15.744 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.739+0000 7fe095168640 10 monclient: _check_auth_tickets 2023-11-05T08:06:15.744 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.739+0000 7fe095168640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:06:15.744 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.739+0000 7fe095168640 1 -- 172.21.15.52:0/719864649 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe08802cbc0 con 0x7fe0900ade00 2023-11-05T08:06:15.744 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.739+0000 7fe095168640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:06:15.744 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.739+0000 7fe095168640 1 -- 172.21.15.52:0/719864649 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0880343f0 con 0x7fe0900ade00 2023-11-05T08:06:15.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.739+0000 7fe095168640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:06:15.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.739+0000 7fe095168640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-11-05T08:06:15.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.739+0000 7fe095168640 10 monclient: dump: 2023-11-05T08:06:15.745 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:06:15.745 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:06:15.745 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:15.746 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:15.746 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:06:15.746 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:06:15.746 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:06:15.746 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:06:15.747 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:06:15.747 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:06:15.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.739+0000 7fe0983ce640 5 monclient: authenticate success, global_id 4142 2023-11-05T08:06:15.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.739+0000 7fe0983ce640 10 monclient: get_monmap_and_config success 2023-11-05T08:06:15.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.739+0000 7fe0983ce640 4 set_mon_vals no callback set 2023-11-05T08:06:15.753 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.740+0000 7fe0983ce640 10 monclient: shutdown 2023-11-05T08:06:15.753 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.740+0000 7fe0983ce640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:06:15.753 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.740+0000 7fe0983ce640 1 -- 172.21.15.52:0/719864649 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe0900ade00 msgr2=0x7fe09013b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:06:15.754 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.740+0000 7fe0983ce640 1 --2- 172.21.15.52:0/719864649 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe0900ade00 0x7fe09013b420 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe088009e80 tx=0x7fe08802bec0 comp rx=0 tx=0).stop 2023-11-05T08:06:15.754 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.740+0000 7fe0983ce640 1 -- 172.21.15.52:0/719864649 shutdown_connections 2023-11-05T08:06:15.754 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.740+0000 7fe0983ce640 1 --2- 172.21.15.52:0/719864649 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe0900ade00 0x7fe09013b420 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:15.754 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.740+0000 7fe0983ce640 1 --2- 172.21.15.52:0/719864649 >> v2:172.21.15.156:3300/0 conn(0x7fe0900b38d0 0x7fe0900ae640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:15.754 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.740+0000 7fe0983ce640 1 -- 172.21.15.52:0/719864649 >> 172.21.15.52:0/719864649 conn(0x7fe090065cd0 msgr2=0x7fe0900660e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:06:15.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.740+0000 7fe0983ce640 1 -- 172.21.15.52:0/719864649 shutdown_connections 2023-11-05T08:06:15.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.740+0000 7fe0983ce640 1 -- 172.21.15.52:0/719864649 wait complete. 2023-11-05T08:06:15.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.741+0000 7fe0983ce640 10 monclient: build_initial_monmap 2023-11-05T08:06:15.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.741+0000 7fe0983ce640 10 monclient: monmap: 2023-11-05T08:06:15.755 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:06:15.756 INFO:teuthology.orchestra.run.smithi052.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-05T08:06:15.756 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 0.000000 2023-11-05T08:06:15.756 INFO:teuthology.orchestra.run.smithi052.stderr:created 0.000000 2023-11-05T08:06:15.756 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:06:15.756 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:06:15.756 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.noname-a 2023-11-05T08:06:15.757 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.noname-b 2023-11-05T08:06:15.757 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-c 2023-11-05T08:06:15.757 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:06:15.757 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.741+0000 7fe0983ce640 1 librados: starting msgr at 2023-11-05T08:06:15.757 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.741+0000 7fe0983ce640 1 librados: starting objecter 2023-11-05T08:06:15.758 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.742+0000 7fe0983ce640 1 Processor -- start 2023-11-05T08:06:15.758 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.742+0000 7fe0983ce640 1 -- start start 2023-11-05T08:06:15.758 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.742+0000 7fe0983ce640 1 librados: setting wanted keys 2023-11-05T08:06:15.758 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.742+0000 7fe0983ce640 1 librados: calling monclient init 2023-11-05T08:06:15.759 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.742+0000 7fe0983ce640 10 monclient: init 2023-11-05T08:06:15.759 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.742+0000 7fe0983ce640 10 monclient: _reopen_session rank -1 2023-11-05T08:06:15.759 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.742+0000 7fe0983ce640 10 monclient: _add_conns ranks=[1,0,2] 2023-11-05T08:06:15.759 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.742+0000 7fe0983ce640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe0900ade00 0x7fe09006fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:06:15.759 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.743+0000 7fe0983ce640 10 monclient(hunting): picked mon.noname-b con 0x7fe0900ade00 addr [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] 2023-11-05T08:06:15.760 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.743+0000 7fe0983ce640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe0900b4240 0x7fe0901de350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:06:15.760 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.743+0000 7fe0983ce640 10 monclient(hunting): picked mon.noname-a con 0x7fe0900b4240 addr [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] 2023-11-05T08:06:15.760 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.743+0000 7fe0983ce640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe0901de890 0x7fe090139d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:06:15.760 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.743+0000 7fe0983ce640 10 monclient(hunting): picked mon.noname-c con 0x7fe0901de890 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:06:15.761 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.743+0000 7fe0983ce640 10 monclient(hunting): start opening mon connection 2023-11-05T08:06:15.761 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.743+0000 7fe0983ce640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe090070240 con 0x7fe0900b4240 2023-11-05T08:06:15.761 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.743+0000 7fe0983ce640 10 monclient(hunting): start opening mon connection 2023-11-05T08:06:15.761 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.743+0000 7fe0983ce640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe09006f990 con 0x7fe0900ade00 2023-11-05T08:06:15.761 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.743+0000 7fe0983ce640 10 monclient(hunting): start opening mon connection 2023-11-05T08:06:15.762 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.743+0000 7fe0983ce640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0901ddb50 con 0x7fe0901de890 2023-11-05T08:06:15.762 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.743+0000 7fe0983ce640 10 monclient(hunting): _renew_subs 2023-11-05T08:06:15.762 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.743+0000 7fe0983ce640 10 monclient(hunting): authenticate will time out at 1321.949132s 2023-11-05T08:06:15.762 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.743+0000 7fe09616a640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe0900ade00 0x7fe09006fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:06:15.762 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.743+0000 7fe095969640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe0900b4240 0x7fe0901de350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:06:15.763 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.744+0000 7fe09616a640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe0900ade00 0x7fe09006fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.52:50666/0 (socket says 172.21.15.52:50666) 2023-11-05T08:06:15.763 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.744+0000 7fe09616a640 1 -- 172.21.15.52:0/1210119344 learned_addr learned my addr 172.21.15.52:0/1210119344 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-11-05T08:06:15.763 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.744+0000 7fe09616a640 10 monclient(hunting): get_auth_request con 0x7fe0900ade00 auth_method 0 2023-11-05T08:06:15.763 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.744+0000 7fe09616a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:06:15.763 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.744+0000 7fe09616a640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:06:15.764 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.744+0000 7fe09616a640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:06:15.764 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.744+0000 7fe095969640 10 monclient(hunting): get_auth_request con 0x7fe0900b4240 auth_method 0 2023-11-05T08:06:15.764 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.744+0000 7fe095969640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:06:15.764 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.744+0000 7fe095969640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:06:15.764 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.744+0000 7fe095969640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:06:15.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.744+0000 7fe09616a640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:06:15.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.744+0000 7fe09616a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:06:15.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.744+0000 7fe09616a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:06:15.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.745+0000 7fe095969640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:06:15.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.745+0000 7fe095969640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:06:15.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.745+0000 7fe095969640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:06:15.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.748+0000 7fe09616a640 10 monclient(hunting): handle_auth_done global_id 4177 payload 824 2023-11-05T08:06:15.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.748+0000 7fe09616a640 1 -- 172.21.15.52:0/1210119344 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe0901de890 msgr2=0x7fe090139d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:06:15.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.748+0000 7fe09616a640 1 --2- 172.21.15.52:0/1210119344 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe0901de890 0x7fe090139d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:15.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.748+0000 7fe09616a640 1 -- 172.21.15.52:0/1210119344 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe0900b4240 msgr2=0x7fe0901de350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:06:15.767 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.748+0000 7fe09616a640 1 --2- 172.21.15.52:0/1210119344 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe0900b4240 0x7fe0901de350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:15.767 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.748+0000 7fe09616a640 10 monclient: _finish_hunting 0 2023-11-05T08:06:15.767 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.748+0000 7fe09616a640 1 monclient: found mon.noname-b 2023-11-05T08:06:15.767 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.748+0000 7fe09616a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:06:15.768 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.749+0000 7fe09616a640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.156:3300/0 2023-11-05T08:06:15.768 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.749+0000 7fe09616a640 1 -- 172.21.15.52:0/1210119344 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe088009b30 con 0x7fe0900ade00 2023-11-05T08:06:15.771 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.752+0000 7fe09616a640 1 --2- 172.21.15.52:0/1210119344 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe0900ade00 0x7fe09006fd00 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe08c00c450 tx=0x7fe08c00c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:06:15.771 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.752+0000 7fe086ffd640 10 client.?.objecter ms_handle_connect 0x7fe0900ade00 2023-11-05T08:06:15.772 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.752+0000 7fe086ffd640 10 client.?.objecter resend_mon_ops 2023-11-05T08:06:15.772 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.757+0000 7fe086ffd640 1 -- 172.21.15.52:0/1210119344 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe08c0052d0 con 0x7fe0900ade00 2023-11-05T08:06:15.772 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.757+0000 7fe086ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:06:15.772 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.757+0000 7fe086ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-05T08:06:15.772 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.757+0000 7fe086ffd640 10 monclient: dump: 2023-11-05T08:06:15.773 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:06:15.773 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:06:15.773 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:15.774 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:15.774 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:06:15.774 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:06:15.775 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:06:15.775 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:06:15.775 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:06:15.776 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:06:15.776 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.757+0000 7fe086ffd640 10 monclient: _finish_auth 0 2023-11-05T08:06:15.777 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.757+0000 7fe086ffd640 10 monclient: _check_auth_tickets 2023-11-05T08:06:15.777 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.757+0000 7fe086ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:06:15.777 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.757+0000 7fe086ffd640 1 -- 172.21.15.52:0/1210119344 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe08c005430 con 0x7fe0900ade00 2023-11-05T08:06:15.778 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.757+0000 7fe086ffd640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:06:15.778 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.757+0000 7fe086ffd640 1 -- 172.21.15.52:0/1210119344 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe08c012870 con 0x7fe0900ade00 2023-11-05T08:06:15.778 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.757+0000 7fe086ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:06:15.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.757+0000 7fe086ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-05T08:06:15.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.757+0000 7fe086ffd640 10 monclient: dump: 2023-11-05T08:06:15.779 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:06:15.780 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:06:15.780 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:15.780 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:15.781 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:06:15.781 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:06:15.782 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:06:15.782 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:06:15.782 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:06:15.782 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:06:15.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.757+0000 7fe094967640 4 set_mon_vals no callback set 2023-11-05T08:06:15.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.757+0000 7fe0983ce640 5 monclient: authenticate success, global_id 4177 2023-11-05T08:06:15.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.757+0000 7fe0983ce640 10 monclient: _renew_subs 2023-11-05T08:06:15.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.757+0000 7fe0983ce640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:06:15.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.757+0000 7fe0983ce640 1 -- 172.21.15.52:0/1210119344 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0901dde30 con 0x7fe0900ade00 2023-11-05T08:06:15.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.758+0000 7fe0983ce640 10 client.4177.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-05T08:06:15.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.758+0000 7fe0983ce640 10 monclient: _renew_subs 2023-11-05T08:06:15.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.758+0000 7fe0983ce640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:06:15.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.758+0000 7fe0983ce640 1 -- 172.21.15.52:0/1210119344 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe09013a240 con 0x7fe0900ade00 2023-11-05T08:06:15.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.758+0000 7fe0983ce640 1 librados: init done 2023-11-05T08:06:15.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.759+0000 7fe0983ce640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-05T08:06:15.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.759+0000 7fe0983ce640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:06:15.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.759+0000 7fe0983ce640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:06:15.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.759+0000 7fe0983ce640 1 -- 172.21.15.52:0/1210119344 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0901de020 con 0x7fe0900ade00 2023-11-05T08:06:15.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.776+0000 7fe086ffd640 1 -- 172.21.15.52:0/1210119344 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 2) v1 ==== 44566+0+0 (secure 0 0 0) 0x7fe08c0129d0 con 0x7fe0900ade00 2023-11-05T08:06:15.954 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.952+0000 7fe086ffd640 1 -- 172.21.15.52:0/1210119344 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fe08c0243e0 con 0x7fe0900ade00 2023-11-05T08:06:15.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.952+0000 7fe086ffd640 10 client.4177.objecter ms_dispatch 0x7fe090000b90 osd_map(10..10 src has 1..10) v4 2023-11-05T08:06:15.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.952+0000 7fe086ffd640 3 client.4177.objecter handle_osd_map got epochs [10,10] > 0 2023-11-05T08:06:15.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.952+0000 7fe086ffd640 3 client.4177.objecter handle_osd_map decoding full epoch 10 2023-11-05T08:06:15.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.953+0000 7fe086ffd640 20 client.4177.objecter dump_active .. 0 homeless 2023-11-05T08:06:15.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.953+0000 7fe086ffd640 1 -- 172.21.15.52:0/1210119344 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fe08c003b10 con 0x7fe0900ade00 2023-11-05T08:06:15.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.953+0000 7fe086ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:06:15.956 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:15.953+0000 7fe086ffd640 10 monclient: _finish_command 1 = system:0 2023-11-05T08:06:16.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:16.069+0000 7fe0983ce640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2023-11-05T08:06:16.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:16.069+0000 7fe0983ce640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2023-11-05T08:06:16.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:16.069+0000 7fe0983ce640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:06:16.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:16.069+0000 7fe0983ce640 1 -- 172.21.15.52:0/1210119344 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe09004e9f0 con 0x7fe0900ade00 2023-11-05T08:06:16.185 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:16.184+0000 7fe086ffd640 1 -- 172.21.15.52:0/1210119344 <== mon.1 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fe08c029090 con 0x7fe0900ade00 2023-11-05T08:06:16.186 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:16.184+0000 7fe086ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2023-11-05T08:06:16.186 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:16.184+0000 7fe086ffd640 10 monclient: _finish_command 2 = system:0 2023-11-05T08:06:16.186 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:06:16.187 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":10,"fsid":"b7fdc914-b520-409f-b9d7-902b05a64252","created":"2023-11-05T08:06:09.361414+0000","modified":"2023-11-05T08:06:15.124773+0000","last_up_change":"0.000000","last_in_change":"2023-11-05T08:06:15.124773+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c95e48e9-832b-4950-b467-9f61d33decc6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"82d5dd13-f1f5-4282-8ec8-4d6c273a42c7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"2c5ea82d-5534-4437-a76f-e3769d798b17","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9ffcbf5b-1afd-4777-825f-c5fb551b9d88","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"3f5f9aa4-2015-4835-9b39-faf459a35a49","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"cf781fb3-83fb-40e0-86a3-f895d7824edb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d2787c11-d907-4924-b9cf-69db95ad35c2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"e9e51eb8-2a9d-4cd0-9158-a00eea2a5614","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-05T08:06:16.188 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:16.185+0000 7fe0983ce640 10 librados: watch_flush enter 2023-11-05T08:06:16.188 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:16.185+0000 7fe0983ce640 10 librados: watch_flush exit 2023-11-05T08:06:16.188 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:16.185+0000 7fe0983ce640 20 client.4177.objecter shutdown clearing up homeless session... 2023-11-05T08:06:16.188 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:16.185+0000 7fe0983ce640 10 client.4177.objecter successfully canceled tick 2023-11-05T08:06:16.189 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:16.185+0000 7fe0983ce640 10 monclient: shutdown 2023-11-05T08:06:16.189 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:16.185+0000 7fe0983ce640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:06:16.189 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:16.185+0000 7fe0983ce640 1 -- 172.21.15.52:0/1210119344 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe0900ade00 msgr2=0x7fe09006fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:06:16.189 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:16.185+0000 7fe0983ce640 1 --2- 172.21.15.52:0/1210119344 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe0900ade00 0x7fe09006fd00 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe08c00c450 tx=0x7fe08c00c910 comp rx=0 tx=0).stop 2023-11-05T08:06:16.189 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:16.185+0000 7fe0983ce640 1 -- 172.21.15.52:0/1210119344 shutdown_connections 2023-11-05T08:06:16.190 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:16.185+0000 7fe0983ce640 1 --2- 172.21.15.52:0/1210119344 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe0901de890 0x7fe090139d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:16.190 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:16.185+0000 7fe0983ce640 1 --2- 172.21.15.52:0/1210119344 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe0900b4240 0x7fe0901de350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:16.190 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:16.185+0000 7fe0983ce640 1 --2- 172.21.15.52:0/1210119344 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe0900ade00 0x7fe09006fd00 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:16.190 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:16.185+0000 7fe0983ce640 1 -- 172.21.15.52:0/1210119344 >> 172.21.15.52:0/1210119344 conn(0x7fe090065cd0 msgr2=0x7fe0900b7990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:06:16.190 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:16.185+0000 7fe0983ce640 1 -- 172.21.15.52:0/1210119344 shutdown_connections 2023-11-05T08:06:16.191 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:16.185+0000 7fe0983ce640 1 -- 172.21.15.52:0/1210119344 wait complete. 2023-11-05T08:06:16.191 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:06:16.185+0000 7fe0983ce640 1 librados: shutdown 2023-11-05T08:06:16.199 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-11-05T08:06:16.199 INFO:tasks.ceph:Waiting for OSDs to come up 2023-11-05T08:06:16.675 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-11-05T08:06:16.674+0000 7f1309f9a640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-11-05T08:06:16.811 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-11-05T08:06:16.810+0000 7f1309f9a640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-11-05T08:06:17.005 DEBUG:teuthology.orchestra.run.smithi052:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-05T08:06:17.156 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.155+0000 7fa7d249b640 10 monclient: get_monmap_and_config 2023-11-05T08:06:17.157 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.155+0000 7fa7d249b640 10 monclient: build_initial_monmap 2023-11-05T08:06:17.157 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.155+0000 7fa7d249b640 10 monclient: monmap: 2023-11-05T08:06:17.157 INFO:teuthology.misc.health.smithi052.stderr:epoch 0 2023-11-05T08:06:17.157 INFO:teuthology.misc.health.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:06:17.157 INFO:teuthology.misc.health.smithi052.stderr:last_changed 2023-11-05T08:06:17.156598+0000 2023-11-05T08:06:17.158 INFO:teuthology.misc.health.smithi052.stderr:created 2023-11-05T08:06:17.156598+0000 2023-11-05T08:06:17.158 INFO:teuthology.misc.health.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:06:17.158 INFO:teuthology.misc.health.smithi052.stderr:election_strategy: 1 2023-11-05T08:06:17.158 INFO:teuthology.misc.health.smithi052.stderr:0: v1:172.21.15.52:6789/0 mon.noname-a-legacy 2023-11-05T08:06:17.158 INFO:teuthology.misc.health.smithi052.stderr:1: v1:172.21.15.156:6789/0 mon.noname-c-legacy 2023-11-05T08:06:17.159 INFO:teuthology.misc.health.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-b 2023-11-05T08:06:17.159 INFO:teuthology.misc.health.smithi052.stderr:3: v2:172.21.15.52:3300/0 mon.noname-a 2023-11-05T08:06:17.159 INFO:teuthology.misc.health.smithi052.stderr:4: v2:172.21.15.156:3300/0 mon.noname-c 2023-11-05T08:06:17.159 INFO:teuthology.misc.health.smithi052.stderr: 2023-11-05T08:06:17.161 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.156+0000 7fa7d249b640 1 Processor -- start 2023-11-05T08:06:17.162 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.156+0000 7fa7d249b640 1 -- start start 2023-11-05T08:06:17.162 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.156+0000 7fa7d249b640 10 monclient: init 2023-11-05T08:06:17.162 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.157+0000 7fa7d249b640 10 monclient: _reopen_session rank -1 2023-11-05T08:06:17.162 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.157+0000 7fa7d249b640 10 monclient: _add_conns ranks=[4,2,1,0,3] 2023-11-05T08:06:17.162 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.157+0000 7fa7d249b640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa7cc13eea0 0x7fa7cc0aea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:06:17.163 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.157+0000 7fa7d249b640 10 monclient(hunting): picked mon.noname-c con 0x7fa7cc13eea0 addr v2:172.21.15.156:3300/0 2023-11-05T08:06:17.163 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.157+0000 7fa7d249b640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa7cc0b3e50 0x7fa7cc0b0da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:06:17.163 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.157+0000 7fa7d249b640 10 monclient(hunting): picked mon.noname-b con 0x7fa7cc0b3e50 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:06:17.163 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.157+0000 7fa7d249b640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fa7cc0b19e0 addr v1:172.21.15.156:6789/0 2023-11-05T08:06:17.163 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.157+0000 7fa7d249b640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7cc0aef70 con 0x7fa7cc0b19e0 2023-11-05T08:06:17.164 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.157+0000 7fa7d249b640 10 monclient(hunting): start opening mon connection 2023-11-05T08:06:17.164 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.157+0000 7fa7d249b640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7cc145180 con 0x7fa7cc13eea0 2023-11-05T08:06:17.164 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.157+0000 7fa7d249b640 10 monclient(hunting): start opening mon connection 2023-11-05T08:06:17.164 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.157+0000 7fa7d249b640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7cc0affe0 con 0x7fa7cc0b3e50 2023-11-05T08:06:17.164 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.157+0000 7fa7d249b640 10 monclient(hunting): _renew_subs 2023-11-05T08:06:17.165 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.157+0000 7fa7d249b640 10 monclient(hunting): authenticate will time out at 1323.363709s 2023-11-05T08:06:17.165 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.158+0000 7fa7cbfff640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa7cc13eea0 0x7fa7cc0aea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:06:17.165 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.158+0000 7fa7d0a38640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fa7cc0b19e0 0x7fa7cc0b1e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.52:50526/0 (socket says 172.21.15.52:50526) 2023-11-05T08:06:17.165 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.158+0000 7fa7d0a38640 1 -- 172.21.15.52:0/244397738 learned_addr learned my addr 172.21.15.52:0/244397738 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-11-05T08:06:17.165 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.159+0000 7fa7cbfff640 10 monclient(hunting): get_auth_request con 0x7fa7cc13eea0 auth_method 0 2023-11-05T08:06:17.166 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.159+0000 7fa7cbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:06:17.166 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.159+0000 7fa7cbfff640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:06:17.166 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.159+0000 7fa7cbfff640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:06:17.166 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.160+0000 7fa7cbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:06:17.167 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.160+0000 7fa7cbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:06:17.167 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.160+0000 7fa7cbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:06:17.167 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.162+0000 7fa7cbfff640 10 monclient(hunting): handle_auth_done global_id 4180 payload 274 2023-11-05T08:06:17.168 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.162+0000 7fa7cbfff640 1 -- 172.21.15.52:0/244397738 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa7cc0b3e50 msgr2=0x7fa7cc0b0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-05T08:06:17.168 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.162+0000 7fa7cbfff640 1 --2- 172.21.15.52:0/244397738 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa7cc0b3e50 0x7fa7cc0b0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:17.168 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.162+0000 7fa7cbfff640 1 -- 172.21.15.52:0/244397738 >> v1:172.21.15.156:6789/0 conn(0x7fa7cc0b19e0 legacy=0x7fa7cc0b1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:06:17.168 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.162+0000 7fa7cbfff640 10 monclient: _finish_hunting 0 2023-11-05T08:06:17.168 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.162+0000 7fa7cbfff640 1 monclient: found mon.noname-c 2023-11-05T08:06:17.169 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.162+0000 7fa7cbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:06:17.169 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.162+0000 7fa7cbfff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.156:3300/0 2023-11-05T08:06:17.169 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.162+0000 7fa7cbfff640 1 -- 172.21.15.52:0/244397738 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7cc0b0880 con 0x7fa7cc13eea0 2023-11-05T08:06:17.171 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.170+0000 7fa7cbfff640 1 --2- 172.21.15.52:0/244397738 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa7cc13eea0 0x7fa7cc0aea30 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc0097a0 tx=0x7fa7bc02b790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c1c9e116d28ceb45 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:06:17.177 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.175+0000 7fa7caffd640 1 -- 172.21.15.52:0/244397738 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7bc0316f0 con 0x7fa7cc13eea0 2023-11-05T08:06:17.177 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.175+0000 7fa7caffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:06:17.177 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.175+0000 7fa7caffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-11-05T08:06:17.178 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.175+0000 7fa7caffd640 10 monclient: dump: 2023-11-05T08:06:17.178 INFO:teuthology.misc.health.smithi052.stderr:epoch 1 2023-11-05T08:06:17.178 INFO:teuthology.misc.health.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:06:17.178 INFO:teuthology.misc.health.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:17.178 INFO:teuthology.misc.health.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:17.179 INFO:teuthology.misc.health.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:06:17.179 INFO:teuthology.misc.health.smithi052.stderr:election_strategy: 1 2023-11-05T08:06:17.179 INFO:teuthology.misc.health.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:06:17.179 INFO:teuthology.misc.health.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:06:17.179 INFO:teuthology.misc.health.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:06:17.180 INFO:teuthology.misc.health.smithi052.stderr: 2023-11-05T08:06:17.180 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.175+0000 7fa7caffd640 10 monclient: _finish_auth 0 2023-11-05T08:06:17.180 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.175+0000 7fa7caffd640 10 monclient: _check_auth_tickets 2023-11-05T08:06:17.180 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.175+0000 7fa7caffd640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:06:17.180 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.175+0000 7fa7caffd640 1 -- 172.21.15.52:0/244397738 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7bc031850 con 0x7fa7cc13eea0 2023-11-05T08:06:17.181 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.175+0000 7fa7caffd640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:06:17.181 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.175+0000 7fa7caffd640 1 -- 172.21.15.52:0/244397738 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7bc031be0 con 0x7fa7cc13eea0 2023-11-05T08:06:17.181 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.175+0000 7fa7caffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:06:17.181 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.175+0000 7fa7caffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-05T08:06:17.181 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.175+0000 7fa7caffd640 10 monclient: dump: 2023-11-05T08:06:17.182 INFO:teuthology.misc.health.smithi052.stderr:epoch 1 2023-11-05T08:06:17.182 INFO:teuthology.misc.health.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:06:17.182 INFO:teuthology.misc.health.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:17.182 INFO:teuthology.misc.health.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:17.182 INFO:teuthology.misc.health.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:06:17.182 INFO:teuthology.misc.health.smithi052.stderr:election_strategy: 1 2023-11-05T08:06:17.183 INFO:teuthology.misc.health.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:06:17.183 INFO:teuthology.misc.health.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:06:17.183 INFO:teuthology.misc.health.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:06:17.183 INFO:teuthology.misc.health.smithi052.stderr: 2023-11-05T08:06:17.183 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.175+0000 7fa7d249b640 5 monclient: authenticate success, global_id 4180 2023-11-05T08:06:17.184 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.175+0000 7fa7d249b640 10 monclient: get_monmap_and_config success 2023-11-05T08:06:17.184 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.175+0000 7fa7d249b640 4 set_mon_vals no callback set 2023-11-05T08:06:17.187 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.176+0000 7fa7d249b640 10 monclient: shutdown 2023-11-05T08:06:17.188 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.176+0000 7fa7d249b640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:06:17.188 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.176+0000 7fa7d249b640 1 -- 172.21.15.52:0/244397738 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa7cc13eea0 msgr2=0x7fa7cc0aea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:06:17.188 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.176+0000 7fa7d249b640 1 --2- 172.21.15.52:0/244397738 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa7cc13eea0 0x7fa7cc0aea30 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc0097a0 tx=0x7fa7bc02b790 comp rx=0 tx=0).stop 2023-11-05T08:06:17.188 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.176+0000 7fa7d249b640 1 -- 172.21.15.52:0/244397738 shutdown_connections 2023-11-05T08:06:17.188 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.176+0000 7fa7d249b640 1 --2- 172.21.15.52:0/244397738 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa7cc0b3e50 0x7fa7cc0b0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:17.188 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.176+0000 7fa7d249b640 1 --2- 172.21.15.52:0/244397738 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa7cc13eea0 0x7fa7cc0aea30 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:17.189 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.176+0000 7fa7d249b640 1 -- 172.21.15.52:0/244397738 >> 172.21.15.52:0/244397738 conn(0x7fa7cc0716e0 msgr2=0x7fa7cc071af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:06:17.189 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.177+0000 7fa7d249b640 1 -- 172.21.15.52:0/244397738 shutdown_connections 2023-11-05T08:06:17.189 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.177+0000 7fa7d249b640 1 -- 172.21.15.52:0/244397738 wait complete. 2023-11-05T08:06:17.189 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.178+0000 7fa7d249b640 10 monclient: build_initial_monmap 2023-11-05T08:06:17.189 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.178+0000 7fa7d249b640 10 monclient: monmap: 2023-11-05T08:06:17.190 INFO:teuthology.misc.health.smithi052.stderr:epoch 0 2023-11-05T08:06:17.190 INFO:teuthology.misc.health.smithi052.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-05T08:06:17.190 INFO:teuthology.misc.health.smithi052.stderr:last_changed 0.000000 2023-11-05T08:06:17.190 INFO:teuthology.misc.health.smithi052.stderr:created 0.000000 2023-11-05T08:06:17.191 INFO:teuthology.misc.health.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:06:17.191 INFO:teuthology.misc.health.smithi052.stderr:election_strategy: 1 2023-11-05T08:06:17.191 INFO:teuthology.misc.health.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.noname-a 2023-11-05T08:06:17.191 INFO:teuthology.misc.health.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.noname-b 2023-11-05T08:06:17.191 INFO:teuthology.misc.health.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-c 2023-11-05T08:06:17.191 INFO:teuthology.misc.health.smithi052.stderr: 2023-11-05T08:06:17.192 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.178+0000 7fa7d249b640 1 librados: starting msgr at 2023-11-05T08:06:17.192 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.178+0000 7fa7d249b640 1 librados: starting objecter 2023-11-05T08:06:17.192 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.179+0000 7fa7d249b640 1 Processor -- start 2023-11-05T08:06:17.192 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.179+0000 7fa7d249b640 1 -- start start 2023-11-05T08:06:17.192 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.179+0000 7fa7d249b640 1 librados: setting wanted keys 2023-11-05T08:06:17.193 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.179+0000 7fa7d249b640 1 librados: calling monclient init 2023-11-05T08:06:17.193 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.179+0000 7fa7d249b640 10 monclient: init 2023-11-05T08:06:17.193 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.180+0000 7fa7d249b640 10 monclient: _reopen_session rank -1 2023-11-05T08:06:17.193 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.180+0000 7fa7d249b640 10 monclient: _add_conns ranks=[1,2,0] 2023-11-05T08:06:17.193 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.180+0000 7fa7d249b640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa7cc0b19e0 0x7fa7cc142060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:06:17.194 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.180+0000 7fa7d249b640 10 monclient(hunting): picked mon.noname-b con 0x7fa7cc0b19e0 addr [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] 2023-11-05T08:06:17.194 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.180+0000 7fa7d249b640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa7cc0b3e50 0x7fa7cc1d6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:06:17.194 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.180+0000 7fa7d249b640 10 monclient(hunting): picked mon.noname-c con 0x7fa7cc0b3e50 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:06:17.194 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.180+0000 7fa7d249b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7cc13eea0 0x7fa7cc1d74f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:06:17.194 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.180+0000 7fa7d249b640 10 monclient(hunting): picked mon.noname-a con 0x7fa7cc13eea0 addr [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] 2023-11-05T08:06:17.194 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.180+0000 7fa7d249b640 10 monclient(hunting): start opening mon connection 2023-11-05T08:06:17.195 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.180+0000 7fa7d249b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7cc1d6b20 con 0x7fa7cc13eea0 2023-11-05T08:06:17.195 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.181+0000 7fa7d249b640 10 monclient(hunting): start opening mon connection 2023-11-05T08:06:17.195 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.181+0000 7fa7d249b640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7cc1cc300 con 0x7fa7cc0b19e0 2023-11-05T08:06:17.195 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.181+0000 7fa7d249b640 10 monclient(hunting): start opening mon connection 2023-11-05T08:06:17.195 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.181+0000 7fa7d249b640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7cc13f630 con 0x7fa7cc0b3e50 2023-11-05T08:06:17.196 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.181+0000 7fa7d249b640 10 monclient(hunting): _renew_subs 2023-11-05T08:06:17.196 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.181+0000 7fa7d249b640 10 monclient(hunting): authenticate will time out at 1323.387037s 2023-11-05T08:06:17.196 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.181+0000 7fa7cbfff640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa7cc0b19e0 0x7fa7cc142060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:06:17.196 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.181+0000 7fa7cbfff640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa7cc0b19e0 0x7fa7cc142060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.52:41438/0 (socket says 172.21.15.52:41438) 2023-11-05T08:06:17.196 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.181+0000 7fa7cbfff640 1 -- 172.21.15.52:0/3230440784 learned_addr learned my addr 172.21.15.52:0/3230440784 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-11-05T08:06:17.197 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.181+0000 7fa7cbfff640 10 monclient(hunting): get_auth_request con 0x7fa7cc0b19e0 auth_method 0 2023-11-05T08:06:17.197 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.181+0000 7fa7cbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:06:17.197 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.181+0000 7fa7cbfff640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:06:17.197 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.181+0000 7fa7cbfff640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:06:17.197 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.182+0000 7fa7d0a38640 1 --2- 172.21.15.52:0/3230440784 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7cc13eea0 0x7fa7cc1d74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:06:17.197 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.182+0000 7fa7cbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:06:17.198 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.182+0000 7fa7cbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:06:17.198 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.182+0000 7fa7cbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:06:17.198 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.182+0000 7fa7d0a38640 10 monclient(hunting): get_auth_request con 0x7fa7cc13eea0 auth_method 0 2023-11-05T08:06:17.198 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.182+0000 7fa7d0a38640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:06:17.198 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.182+0000 7fa7d0a38640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:06:17.199 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.182+0000 7fa7d0a38640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:06:17.199 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.183+0000 7fa7d0a38640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:06:17.199 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.183+0000 7fa7d0a38640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:06:17.199 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.183+0000 7fa7d0a38640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:06:17.202 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.188+0000 7fa7d0a38640 10 monclient(hunting): handle_auth_done global_id 4146 payload 824 2023-11-05T08:06:17.202 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.188+0000 7fa7d0a38640 1 -- 172.21.15.52:0/3230440784 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa7cc0b3e50 msgr2=0x7fa7cc1d6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:06:17.202 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.188+0000 7fa7d0a38640 1 --2- 172.21.15.52:0/3230440784 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa7cc0b3e50 0x7fa7cc1d6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:17.202 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.188+0000 7fa7d0a38640 1 -- 172.21.15.52:0/3230440784 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa7cc0b19e0 msgr2=0x7fa7cc142060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:06:17.202 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.188+0000 7fa7d0a38640 1 --2- 172.21.15.52:0/3230440784 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa7cc0b19e0 0x7fa7cc142060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:17.203 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.188+0000 7fa7d0a38640 10 monclient: _finish_hunting 0 2023-11-05T08:06:17.203 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.188+0000 7fa7d0a38640 1 monclient: found mon.noname-a 2023-11-05T08:06:17.203 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.188+0000 7fa7d0a38640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:06:17.203 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.188+0000 7fa7d0a38640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.52:3300/0 2023-11-05T08:06:17.203 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.188+0000 7fa7d0a38640 1 -- 172.21.15.52:0/3230440784 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7bc009400 con 0x7fa7cc13eea0 2023-11-05T08:06:17.203 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.192+0000 7fa7d0a38640 1 --2- 172.21.15.52:0/3230440784 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7cc13eea0 0x7fa7cc1d74f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa7c400caa0 tx=0x7fa7c400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:06:17.204 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.192+0000 7fa7c8ff9640 10 client.?.objecter ms_handle_connect 0x7fa7cc13eea0 2023-11-05T08:06:17.204 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.192+0000 7fa7c8ff9640 10 client.?.objecter resend_mon_ops 2023-11-05T08:06:17.204 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.198+0000 7fa7c8ff9640 1 -- 172.21.15.52:0/3230440784 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c400ab40 con 0x7fa7cc13eea0 2023-11-05T08:06:17.204 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.198+0000 7fa7c8ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:06:17.204 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.198+0000 7fa7c8ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-11-05T08:06:17.205 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.198+0000 7fa7c8ff9640 10 monclient: dump: 2023-11-05T08:06:17.205 INFO:teuthology.misc.health.smithi052.stderr:epoch 1 2023-11-05T08:06:17.205 INFO:teuthology.misc.health.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:06:17.205 INFO:teuthology.misc.health.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:17.205 INFO:teuthology.misc.health.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:17.205 INFO:teuthology.misc.health.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:06:17.206 INFO:teuthology.misc.health.smithi052.stderr:election_strategy: 1 2023-11-05T08:06:17.206 INFO:teuthology.misc.health.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:06:17.206 INFO:teuthology.misc.health.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:06:17.206 INFO:teuthology.misc.health.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:06:17.206 INFO:teuthology.misc.health.smithi052.stderr: 2023-11-05T08:06:17.207 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.198+0000 7fa7c8ff9640 10 monclient: _finish_auth 0 2023-11-05T08:06:17.207 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.198+0000 7fa7c8ff9640 10 monclient: _check_auth_tickets 2023-11-05T08:06:17.207 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.198+0000 7fa7c8ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:06:17.207 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.198+0000 7fa7c8ff9640 1 -- 172.21.15.52:0/3230440784 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7c400aca0 con 0x7fa7cc13eea0 2023-11-05T08:06:17.207 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.198+0000 7fa7c8ff9640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:06:17.207 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.198+0000 7fa7c8ff9640 1 -- 172.21.15.52:0/3230440784 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c4012600 con 0x7fa7cc13eea0 2023-11-05T08:06:17.208 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.198+0000 7fa7c8ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:06:17.208 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.198+0000 7fa7c8ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-11-05T08:06:17.208 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.198+0000 7fa7c8ff9640 10 monclient: dump: 2023-11-05T08:06:17.208 INFO:teuthology.misc.health.smithi052.stderr:epoch 1 2023-11-05T08:06:17.208 INFO:teuthology.misc.health.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:06:17.209 INFO:teuthology.misc.health.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:17.209 INFO:teuthology.misc.health.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:17.209 INFO:teuthology.misc.health.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:06:17.209 INFO:teuthology.misc.health.smithi052.stderr:election_strategy: 1 2023-11-05T08:06:17.209 INFO:teuthology.misc.health.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:06:17.209 INFO:teuthology.misc.health.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:06:17.210 INFO:teuthology.misc.health.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:06:17.210 INFO:teuthology.misc.health.smithi052.stderr: 2023-11-05T08:06:17.210 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.198+0000 7fa7ca7fc640 4 set_mon_vals no callback set 2023-11-05T08:06:17.210 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.199+0000 7fa7d249b640 5 monclient: authenticate success, global_id 4146 2023-11-05T08:06:17.210 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.199+0000 7fa7d249b640 10 monclient: _renew_subs 2023-11-05T08:06:17.211 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.199+0000 7fa7d249b640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.52:3300/0 2023-11-05T08:06:17.211 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.199+0000 7fa7d249b640 1 -- 172.21.15.52:0/3230440784 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7cc0aca40 con 0x7fa7cc13eea0 2023-11-05T08:06:17.211 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.199+0000 7fa7d249b640 10 client.4146.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-05T08:06:17.211 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.199+0000 7fa7d249b640 10 monclient: _renew_subs 2023-11-05T08:06:17.211 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.199+0000 7fa7d249b640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.52:3300/0 2023-11-05T08:06:17.213 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.199+0000 7fa7d249b640 1 -- 172.21.15.52:0/3230440784 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7cc1ccf40 con 0x7fa7cc13eea0 2023-11-05T08:06:17.213 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.200+0000 7fa7d249b640 1 librados: init done 2023-11-05T08:06:17.214 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.201+0000 7fa7d249b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-05T08:06:17.214 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.201+0000 7fa7d249b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:06:17.214 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.201+0000 7fa7d249b640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.52:3300/0 2023-11-05T08:06:17.214 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.201+0000 7fa7d249b640 1 -- 172.21.15.52:0/3230440784 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7cc0b6910 con 0x7fa7cc13eea0 2023-11-05T08:06:17.236 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.235+0000 7fa7c8ff9640 1 -- 172.21.15.52:0/3230440784 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 3) v1 ==== 89067+0+0 (secure 0 0 0) 0x7fa7c4012760 con 0x7fa7cc13eea0 2023-11-05T08:06:17.237 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.235+0000 7fa7c8ff9640 1 --2- 172.21.15.52:0/3230440784 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7fa7b806c6a0 0x7fa7b806eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:06:17.237 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.236+0000 7fa7cbfff640 1 --2- 172.21.15.52:0/3230440784 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7fa7b806c6a0 0x7fa7b806eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:06:17.238 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.236+0000 7fa7cbfff640 10 monclient: get_auth_request con 0x7fa7b806c6a0 auth_method 0 2023-11-05T08:06:17.238 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.236+0000 7fa7cbfff640 1 --2- 172.21.15.52:0/3230440784 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7fa7b806c6a0 0x7fa7b806eb60 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc0097a0 tx=0x7fa7bc008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:06:17.238 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.236+0000 7fa7c8ff9640 10 client.4146.objecter ms_handle_connect 0x7fa7b806c6a0 2023-11-05T08:06:17.715 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.713+0000 7fa7c8ff9640 1 -- 172.21.15.52:0/3230440784 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fa7c4058980 con 0x7fa7cc13eea0 2023-11-05T08:06:17.715 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.713+0000 7fa7c8ff9640 10 client.4146.objecter ms_dispatch 0x7fa7cc000b90 osd_map(10..10 src has 1..10) v4 2023-11-05T08:06:17.715 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.713+0000 7fa7c8ff9640 3 client.4146.objecter handle_osd_map got epochs [10,10] > 0 2023-11-05T08:06:17.715 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.713+0000 7fa7c8ff9640 3 client.4146.objecter handle_osd_map decoding full epoch 10 2023-11-05T08:06:17.716 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.713+0000 7fa7c8ff9640 20 client.4146.objecter dump_active .. 0 homeless 2023-11-05T08:06:17.716 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.713+0000 7fa7c8ff9640 1 -- 172.21.15.52:0/3230440784 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa7c4054cc0 con 0x7fa7cc13eea0 2023-11-05T08:06:17.716 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.713+0000 7fa7c8ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:06:17.716 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:17.713+0000 7fa7c8ff9640 10 monclient: _finish_command 1 = system:0 2023-11-05T08:06:18.081 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:18.079+0000 7fa7d249b640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2023-11-05T08:06:18.081 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:18.079+0000 7fa7d249b640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2023-11-05T08:06:18.081 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:18.079+0000 7fa7d249b640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.52:3300/0 2023-11-05T08:06:18.084 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:18.079+0000 7fa7d249b640 1 -- 172.21.15.52:0/3230440784 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa7cc1d6c60 con 0x7fa7cc13eea0 2023-11-05T08:06:18.453 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:18.451+0000 7fa7c8ff9640 1 -- 172.21.15.52:0/3230440784 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mgrmap(e 4) v1 ==== 89173+0+0 (secure 0 0 0) 0x7fa7c4055090 con 0x7fa7cc13eea0 2023-11-05T08:06:18.464 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:18.462+0000 7fa7c8ff9640 1 -- 172.21.15.52:0/3230440784 <== mon.0 v2:172.21.15.52:3300/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fa7c403d890 con 0x7fa7cc13eea0 2023-11-05T08:06:18.464 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:18.462+0000 7fa7c8ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2023-11-05T08:06:18.464 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:18.462+0000 7fa7c8ff9640 10 monclient: _finish_command 2 = system:0 2023-11-05T08:06:18.465 INFO:teuthology.misc.health.smithi052.stdout: 2023-11-05T08:06:18.465 INFO:teuthology.misc.health.smithi052.stdout:{"epoch":10,"fsid":"b7fdc914-b520-409f-b9d7-902b05a64252","created":"2023-11-05T08:06:09.361414+0000","modified":"2023-11-05T08:06:15.124773+0000","last_up_change":"0.000000","last_in_change":"2023-11-05T08:06:15.124773+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c95e48e9-832b-4950-b467-9f61d33decc6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"82d5dd13-f1f5-4282-8ec8-4d6c273a42c7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"2c5ea82d-5534-4437-a76f-e3769d798b17","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9ffcbf5b-1afd-4777-825f-c5fb551b9d88","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"3f5f9aa4-2015-4835-9b39-faf459a35a49","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"cf781fb3-83fb-40e0-86a3-f895d7824edb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d2787c11-d907-4924-b9cf-69db95ad35c2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"e9e51eb8-2a9d-4cd0-9158-a00eea2a5614","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-05T08:06:18.469 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:18.466+0000 7fa7d249b640 10 librados: watch_flush enter 2023-11-05T08:06:18.469 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:18.467+0000 7fa7d249b640 10 librados: watch_flush exit 2023-11-05T08:06:18.470 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:18.467+0000 7fa7d249b640 20 client.4146.objecter shutdown clearing up homeless session... 2023-11-05T08:06:18.470 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:18.467+0000 7fa7d249b640 10 client.4146.objecter successfully canceled tick 2023-11-05T08:06:18.470 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:18.467+0000 7fa7d249b640 1 -- 172.21.15.52:0/3230440784 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7fa7b806c6a0 msgr2=0x7fa7b806eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:06:18.470 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:18.467+0000 7fa7d249b640 1 --2- 172.21.15.52:0/3230440784 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7fa7b806c6a0 0x7fa7b806eb60 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc0097a0 tx=0x7fa7bc008030 comp rx=0 tx=0).stop 2023-11-05T08:06:18.471 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:18.467+0000 7fa7d249b640 10 monclient: shutdown 2023-11-05T08:06:18.471 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:18.467+0000 7fa7d249b640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:06:18.471 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:18.467+0000 7fa7d249b640 1 -- 172.21.15.52:0/3230440784 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7cc13eea0 msgr2=0x7fa7cc1d74f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:06:18.471 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:18.467+0000 7fa7d249b640 1 --2- 172.21.15.52:0/3230440784 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7cc13eea0 0x7fa7cc1d74f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa7c400caa0 tx=0x7fa7c400cf60 comp rx=0 tx=0).stop 2023-11-05T08:06:18.471 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:18.467+0000 7fa7d249b640 1 -- 172.21.15.52:0/3230440784 shutdown_connections 2023-11-05T08:06:18.471 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:18.467+0000 7fa7d249b640 1 --2- 172.21.15.52:0/3230440784 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7fa7b806c6a0 0x7fa7b806eb60 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:18.472 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:18.467+0000 7fa7d249b640 1 --2- 172.21.15.52:0/3230440784 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7cc13eea0 0x7fa7cc1d74f0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:18.472 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:18.467+0000 7fa7d249b640 1 --2- 172.21.15.52:0/3230440784 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa7cc0b3e50 0x7fa7cc1d6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:18.472 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:18.467+0000 7fa7d249b640 1 --2- 172.21.15.52:0/3230440784 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa7cc0b19e0 0x7fa7cc142060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:18.472 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:18.467+0000 7fa7d249b640 1 -- 172.21.15.52:0/3230440784 >> 172.21.15.52:0/3230440784 conn(0x7fa7cc0716e0 msgr2=0x7fa7cc0b1e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:06:18.472 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:18.467+0000 7fa7d249b640 1 -- 172.21.15.52:0/3230440784 shutdown_connections 2023-11-05T08:06:18.473 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:18.467+0000 7fa7d249b640 1 -- 172.21.15.52:0/3230440784 wait complete. 2023-11-05T08:06:18.473 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:18.468+0000 7fa7d249b640 1 librados: shutdown 2023-11-05T08:06:18.491 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-11-05T08:06:23.575 INFO:tasks.ceph.osd.7.smithi156.stderr:==00:00:00:07.995 86246== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:23.635 INFO:tasks.ceph.osd.7.smithi156.stderr:==00:00:00:08.057 86246== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:23.711 INFO:tasks.ceph.osd.5.smithi156.stderr:==00:00:00:08.141 86244== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:23.715 INFO:tasks.ceph.osd.4.smithi156.stderr:==00:00:00:08.147 86243== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:23.775 INFO:tasks.ceph.osd.4.smithi156.stderr:==00:00:00:08.208 86243== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:23.786 INFO:tasks.ceph.osd.5.smithi156.stderr:==00:00:00:08.217 86244== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:23.883 INFO:tasks.ceph.osd.6.smithi156.stderr:==00:00:00:08.313 86245== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:23.942 INFO:tasks.ceph.osd.6.smithi156.stderr:==00:00:00:08.371 86245== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:24.064 INFO:tasks.ceph.osd.2.smithi052.stderr:==00:00:00:08.518 86235== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:24.125 INFO:tasks.ceph.osd.2.smithi052.stderr:==00:00:00:08.580 86235== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:24.185 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:06:24.179+0000 5dc2340 -1 Falling back to public interface 2023-11-05T08:06:24.237 INFO:tasks.ceph.osd.3.smithi052.stderr:==00:00:00:08.678 86237== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:24.301 INFO:tasks.ceph.osd.3.smithi052.stderr:==00:00:00:08.742 86237== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:24.346 INFO:tasks.ceph.osd.5.smithi156.stderr:2023-11-05T08:06:24.339+0000 5dc2340 -1 Falling back to public interface 2023-11-05T08:06:24.361 INFO:tasks.ceph.osd.4.smithi156.stderr:2023-11-05T08:06:24.354+0000 5dc2340 -1 Falling back to public interface 2023-11-05T08:06:24.482 INFO:tasks.ceph.osd.0.smithi052.stderr:==00:00:00:08.940 86232== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:24.516 INFO:tasks.ceph.osd.6.smithi156.stderr:2023-11-05T08:06:24.506+0000 5dc2340 -1 Falling back to public interface 2023-11-05T08:06:24.545 INFO:tasks.ceph.osd.0.smithi052.stderr:==00:00:00:09.003 86232== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:24.633 INFO:tasks.ceph.osd.7.smithi156.stderr:==00:00:00:09.056 86246== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:24.680 INFO:tasks.ceph.osd.2.smithi052.stderr:2023-11-05T08:06:24.672+0000 5dc2340 -1 Falling back to public interface 2023-11-05T08:06:24.784 INFO:tasks.ceph.osd.1.smithi052.stderr:==00:00:00:09.241 86234== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:24.798 INFO:tasks.ceph.osd.5.smithi156.stderr:==00:00:00:09.228 86244== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:24.818 INFO:tasks.ceph.osd.4.smithi156.stderr:==00:00:00:09.250 86243== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:24.845 INFO:tasks.ceph.osd.1.smithi052.stderr:==00:00:00:09.302 86234== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:24.885 INFO:tasks.ceph.osd.3.smithi052.stderr:2023-11-05T08:06:24.878+0000 5dc2340 -1 Falling back to public interface 2023-11-05T08:06:24.974 INFO:tasks.ceph.osd.6.smithi156.stderr:==00:00:00:09.403 86245== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:24.994 INFO:tasks.ceph.osd.7.smithi156.stderr:==00:00:00:09.417 86246== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:25.105 INFO:tasks.ceph.osd.0.smithi052.stderr:2023-11-05T08:06:25.095+0000 5dc2340 -1 Falling back to public interface 2023-11-05T08:06:25.140 INFO:tasks.ceph.osd.2.smithi052.stderr:==00:00:00:09.594 86235== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:25.151 INFO:tasks.ceph.osd.5.smithi156.stderr:==00:00:00:09.582 86244== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:25.172 INFO:tasks.ceph.osd.4.smithi156.stderr:==00:00:00:09.605 86243== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:25.295 DEBUG:teuthology.orchestra.run.smithi052:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-05T08:06:25.315 INFO:tasks.ceph.osd.7.smithi156.stderr:==00:00:00:09.738 86246== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:25.326 INFO:tasks.ceph.osd.6.smithi156.stderr:==00:00:00:09.756 86245== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:25.346 INFO:tasks.ceph.osd.3.smithi052.stderr:==00:00:00:09.787 86237== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:25.390 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.388+0000 7f2f15583640 10 monclient: get_monmap_and_config 2023-11-05T08:06:25.390 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.388+0000 7f2f15583640 10 monclient: build_initial_monmap 2023-11-05T08:06:25.390 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.388+0000 7f2f15583640 10 monclient: monmap: 2023-11-05T08:06:25.391 INFO:teuthology.misc.health.smithi052.stderr:epoch 0 2023-11-05T08:06:25.391 INFO:teuthology.misc.health.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:06:25.391 INFO:teuthology.misc.health.smithi052.stderr:last_changed 2023-11-05T08:06:25.389970+0000 2023-11-05T08:06:25.392 INFO:teuthology.misc.health.smithi052.stderr:created 2023-11-05T08:06:25.389970+0000 2023-11-05T08:06:25.392 INFO:teuthology.misc.health.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:06:25.392 INFO:teuthology.misc.health.smithi052.stderr:election_strategy: 1 2023-11-05T08:06:25.392 INFO:teuthology.misc.health.smithi052.stderr:0: v1:172.21.15.52:6789/0 mon.noname-a-legacy 2023-11-05T08:06:25.393 INFO:teuthology.misc.health.smithi052.stderr:1: v1:172.21.15.156:6789/0 mon.noname-c-legacy 2023-11-05T08:06:25.393 INFO:teuthology.misc.health.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-b 2023-11-05T08:06:25.393 INFO:teuthology.misc.health.smithi052.stderr:3: v2:172.21.15.52:3300/0 mon.noname-a 2023-11-05T08:06:25.393 INFO:teuthology.misc.health.smithi052.stderr:4: v2:172.21.15.156:3300/0 mon.noname-c 2023-11-05T08:06:25.393 INFO:teuthology.misc.health.smithi052.stderr: 2023-11-05T08:06:25.397 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.389+0000 7f2f15583640 1 Processor -- start 2023-11-05T08:06:25.397 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.389+0000 7f2f15583640 1 -- start start 2023-11-05T08:06:25.398 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.389+0000 7f2f15583640 10 monclient: init 2023-11-05T08:06:25.398 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.389+0000 7f2f15583640 10 monclient: _reopen_session rank -1 2023-11-05T08:06:25.398 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.389+0000 7f2f15583640 10 monclient: _add_conns ranks=[2,3,4,0,1] 2023-11-05T08:06:25.398 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.389+0000 7f2f15583640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2f10071a00 0x7f2f100aa150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:06:25.399 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.389+0000 7f2f15583640 10 monclient(hunting): picked mon.noname-b con 0x7f2f10071a00 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:06:25.399 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.389+0000 7f2f15583640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2f1013eab0 0x7f2f1013eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:06:25.399 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.389+0000 7f2f15583640 10 monclient(hunting): picked mon.noname-a con 0x7f2f1013eab0 addr v2:172.21.15.52:3300/0 2023-11-05T08:06:25.399 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.389+0000 7f2f15583640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f2f100ac7e0 0x7f2f100acc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:06:25.399 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.389+0000 7f2f15583640 10 monclient(hunting): picked mon.noname-c con 0x7f2f100ac7e0 addr v2:172.21.15.156:3300/0 2023-11-05T08:06:25.400 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.389+0000 7f2f15583640 10 monclient(hunting): start opening mon connection 2023-11-05T08:06:25.400 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.389+0000 7f2f15583640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f1013f410 con 0x7f2f1013eab0 2023-11-05T08:06:25.400 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.389+0000 7f2f15583640 10 monclient(hunting): start opening mon connection 2023-11-05T08:06:25.400 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.389+0000 7f2f15583640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f100aac80 con 0x7f2f100ac7e0 2023-11-05T08:06:25.401 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.389+0000 7f2f15583640 10 monclient(hunting): start opening mon connection 2023-11-05T08:06:25.401 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.389+0000 7f2f15583640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f10071de0 con 0x7f2f10071a00 2023-11-05T08:06:25.401 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.389+0000 7f2f15583640 10 monclient(hunting): _renew_subs 2023-11-05T08:06:25.401 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.389+0000 7f2f15583640 10 monclient(hunting): authenticate will time out at 1331.595746s 2023-11-05T08:06:25.402 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.390+0000 7f2f0effd640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2f10071a00 0x7f2f100aa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:06:25.402 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.390+0000 7f2f0e7fc640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2f1013eab0 0x7f2f1013eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:06:25.402 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.390+0000 7f2f0f7fe640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f2f100ac7e0 0x7f2f100acc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:06:25.402 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.390+0000 7f2f0effd640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2f10071a00 0x7f2f100aa150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.52:46096/0 (socket says 172.21.15.52:46096) 2023-11-05T08:06:25.402 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.390+0000 7f2f0effd640 1 -- 172.21.15.52:0/1935301592 learned_addr learned my addr 172.21.15.52:0/1935301592 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-11-05T08:06:25.403 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.390+0000 7f2f0effd640 10 monclient(hunting): get_auth_request con 0x7f2f10071a00 auth_method 0 2023-11-05T08:06:25.403 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.390+0000 7f2f0effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:06:25.403 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.390+0000 7f2f0effd640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:06:25.403 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.390+0000 7f2f0effd640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:06:25.403 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.390+0000 7f2f0f7fe640 10 monclient(hunting): get_auth_request con 0x7f2f100ac7e0 auth_method 0 2023-11-05T08:06:25.404 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.390+0000 7f2f0f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:06:25.404 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.390+0000 7f2f0f7fe640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:06:25.404 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.390+0000 7f2f0f7fe640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:06:25.404 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.391+0000 7f2f0e7fc640 10 monclient(hunting): get_auth_request con 0x7f2f1013eab0 auth_method 0 2023-11-05T08:06:25.404 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.391+0000 7f2f0e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:06:25.405 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.391+0000 7f2f0e7fc640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:06:25.405 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.391+0000 7f2f0e7fc640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:06:25.405 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.391+0000 7f2f0f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:06:25.405 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.391+0000 7f2f0f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:06:25.405 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.391+0000 7f2f0f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:06:25.406 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.391+0000 7f2f0effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:06:25.406 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.391+0000 7f2f0effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:06:25.406 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.391+0000 7f2f0effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:06:25.406 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.391+0000 7f2f0e7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:06:25.406 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.391+0000 7f2f0e7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:06:25.407 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.391+0000 7f2f0e7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:06:25.407 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.392+0000 7f2f0f7fe640 10 monclient(hunting): handle_auth_done global_id 4204 payload 274 2023-11-05T08:06:25.407 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.392+0000 7f2f0f7fe640 1 -- 172.21.15.52:0/1935301592 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2f10071a00 msgr2=0x7f2f100aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-05T08:06:25.407 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.392+0000 7f2f0f7fe640 1 --2- 172.21.15.52:0/1935301592 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2f10071a00 0x7f2f100aa150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:25.407 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.392+0000 7f2f0f7fe640 1 -- 172.21.15.52:0/1935301592 >> v2:172.21.15.52:3300/0 conn(0x7f2f1013eab0 msgr2=0x7f2f1013eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-05T08:06:25.407 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.392+0000 7f2f0f7fe640 1 --2- 172.21.15.52:0/1935301592 >> v2:172.21.15.52:3300/0 conn(0x7f2f1013eab0 0x7f2f1013eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:25.408 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.392+0000 7f2f0f7fe640 10 monclient: _finish_hunting 0 2023-11-05T08:06:25.408 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.392+0000 7f2f0f7fe640 1 monclient: found mon.noname-c 2023-11-05T08:06:25.408 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.392+0000 7f2f0f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:06:25.408 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.392+0000 7f2f0f7fe640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.156:3300/0 2023-11-05T08:06:25.408 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.392+0000 7f2f0f7fe640 1 -- 172.21.15.52:0/1935301592 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f100aaf20 con 0x7f2f100ac7e0 2023-11-05T08:06:25.409 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.395+0000 7f2f0f7fe640 1 --2- 172.21.15.52:0/1935301592 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2f100ac7e0 0x7f2f100acc70 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2f08009dc0 tx=0x7f2f0802bce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fdca8be282252d6f server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:06:25.418 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.398+0000 7f2f0dffb640 1 -- 172.21.15.52:0/1935301592 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f0802ca90 con 0x7f2f100ac7e0 2023-11-05T08:06:25.418 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.398+0000 7f2f0dffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:06:25.418 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.398+0000 7f2f0dffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-11-05T08:06:25.418 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.398+0000 7f2f0dffb640 10 monclient: dump: 2023-11-05T08:06:25.419 INFO:teuthology.misc.health.smithi052.stderr:epoch 1 2023-11-05T08:06:25.419 INFO:teuthology.misc.health.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:06:25.419 INFO:teuthology.misc.health.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:25.419 INFO:teuthology.misc.health.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:25.419 INFO:teuthology.misc.health.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:06:25.420 INFO:teuthology.misc.health.smithi052.stderr:election_strategy: 1 2023-11-05T08:06:25.420 INFO:teuthology.misc.health.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:06:25.420 INFO:teuthology.misc.health.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:06:25.420 INFO:teuthology.misc.health.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:06:25.420 INFO:teuthology.misc.health.smithi052.stderr: 2023-11-05T08:06:25.421 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.398+0000 7f2f0dffb640 10 monclient: _finish_auth 0 2023-11-05T08:06:25.421 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.398+0000 7f2f0dffb640 10 monclient: _check_auth_tickets 2023-11-05T08:06:25.421 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.398+0000 7f2f0dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:06:25.421 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.398+0000 7f2f0dffb640 1 -- 172.21.15.52:0/1935301592 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f0802cbf0 con 0x7f2f100ac7e0 2023-11-05T08:06:25.421 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.398+0000 7f2f0dffb640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:06:25.422 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.398+0000 7f2f0dffb640 1 -- 172.21.15.52:0/1935301592 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f08034440 con 0x7f2f100ac7e0 2023-11-05T08:06:25.422 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.398+0000 7f2f15583640 5 monclient: authenticate success, global_id 4204 2023-11-05T08:06:25.422 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.398+0000 7f2f15583640 10 monclient: get_monmap_and_config success 2023-11-05T08:06:25.422 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.398+0000 7f2f15583640 4 set_mon_vals no callback set 2023-11-05T08:06:25.423 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.398+0000 7f2f0dffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:06:25.423 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.398+0000 7f2f0dffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-05T08:06:25.423 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.398+0000 7f2f0dffb640 10 monclient: dump: 2023-11-05T08:06:25.423 INFO:teuthology.misc.health.smithi052.stderr:epoch 1 2023-11-05T08:06:25.423 INFO:teuthology.misc.health.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:06:25.424 INFO:teuthology.misc.health.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:25.424 INFO:teuthology.misc.health.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:25.424 INFO:teuthology.misc.health.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:06:25.424 INFO:teuthology.misc.health.smithi052.stderr:election_strategy: 1 2023-11-05T08:06:25.424 INFO:teuthology.misc.health.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:06:25.425 INFO:teuthology.misc.health.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:06:25.425 INFO:teuthology.misc.health.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:06:25.425 INFO:teuthology.misc.health.smithi052.stderr: 2023-11-05T08:06:25.425 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.399+0000 7f2f15583640 10 monclient: shutdown 2023-11-05T08:06:25.426 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.399+0000 7f2f15583640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:06:25.427 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.399+0000 7f2f15583640 1 -- 172.21.15.52:0/1935301592 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2f100ac7e0 msgr2=0x7f2f100acc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:06:25.427 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.399+0000 7f2f15583640 1 --2- 172.21.15.52:0/1935301592 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2f100ac7e0 0x7f2f100acc70 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2f08009dc0 tx=0x7f2f0802bce0 comp rx=0 tx=0).stop 2023-11-05T08:06:25.427 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.399+0000 7f2f15583640 1 -- 172.21.15.52:0/1935301592 shutdown_connections 2023-11-05T08:06:25.427 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.399+0000 7f2f15583640 1 --2- 172.21.15.52:0/1935301592 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2f100ac7e0 0x7f2f100acc70 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:25.428 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.399+0000 7f2f15583640 1 --2- 172.21.15.52:0/1935301592 >> v2:172.21.15.52:3300/0 conn(0x7f2f1013eab0 0x7f2f1013eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:25.428 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.399+0000 7f2f15583640 1 --2- 172.21.15.52:0/1935301592 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2f10071a00 0x7f2f100aa150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:25.428 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.399+0000 7f2f15583640 1 -- 172.21.15.52:0/1935301592 >> 172.21.15.52:0/1935301592 conn(0x7f2f100b3260 msgr2=0x7f2f100b3670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:06:25.428 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.399+0000 7f2f15583640 1 -- 172.21.15.52:0/1935301592 shutdown_connections 2023-11-05T08:06:25.428 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.399+0000 7f2f15583640 1 -- 172.21.15.52:0/1935301592 wait complete. 2023-11-05T08:06:25.429 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.400+0000 7f2f15583640 10 monclient: build_initial_monmap 2023-11-05T08:06:25.429 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.400+0000 7f2f15583640 10 monclient: monmap: 2023-11-05T08:06:25.429 INFO:teuthology.misc.health.smithi052.stderr:epoch 0 2023-11-05T08:06:25.429 INFO:teuthology.misc.health.smithi052.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-05T08:06:25.429 INFO:teuthology.misc.health.smithi052.stderr:last_changed 0.000000 2023-11-05T08:06:25.430 INFO:teuthology.misc.health.smithi052.stderr:created 0.000000 2023-11-05T08:06:25.430 INFO:teuthology.misc.health.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:06:25.430 INFO:teuthology.misc.health.smithi052.stderr:election_strategy: 1 2023-11-05T08:06:25.430 INFO:teuthology.misc.health.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.noname-a 2023-11-05T08:06:25.430 INFO:teuthology.misc.health.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.noname-b 2023-11-05T08:06:25.431 INFO:teuthology.misc.health.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-c 2023-11-05T08:06:25.431 INFO:teuthology.misc.health.smithi052.stderr: 2023-11-05T08:06:25.431 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.400+0000 7f2f15583640 1 librados: starting msgr at 2023-11-05T08:06:25.431 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.400+0000 7f2f15583640 1 librados: starting objecter 2023-11-05T08:06:25.431 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.400+0000 7f2f15583640 1 Processor -- start 2023-11-05T08:06:25.432 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.400+0000 7f2f15583640 1 -- start start 2023-11-05T08:06:25.432 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.400+0000 7f2f15583640 1 librados: setting wanted keys 2023-11-05T08:06:25.432 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.400+0000 7f2f15583640 1 librados: calling monclient init 2023-11-05T08:06:25.432 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.400+0000 7f2f15583640 10 monclient: init 2023-11-05T08:06:25.432 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.401+0000 7f2f15583640 10 monclient: _reopen_session rank -1 2023-11-05T08:06:25.432 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.401+0000 7f2f15583640 10 monclient: _add_conns ranks=[1,2,0] 2023-11-05T08:06:25.433 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.401+0000 7f2f15583640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2f10071a00 0x7f2f10143e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:06:25.433 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.401+0000 7f2f15583640 10 monclient(hunting): picked mon.noname-b con 0x7f2f10071a00 addr [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] 2023-11-05T08:06:25.433 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.401+0000 7f2f15583640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2f100ac7e0 0x7f2f101d7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:06:25.433 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.401+0000 7f2f15583640 10 monclient(hunting): picked mon.noname-c con 0x7f2f100ac7e0 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:06:25.433 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.401+0000 7f2f15583640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2f1013eab0 0x7f2f101da730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:06:25.434 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.401+0000 7f2f15583640 10 monclient(hunting): picked mon.noname-a con 0x7f2f1013eab0 addr [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] 2023-11-05T08:06:25.434 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.401+0000 7f2f15583640 10 monclient(hunting): start opening mon connection 2023-11-05T08:06:25.434 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.401+0000 7f2f15583640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f101439a0 con 0x7f2f1013eab0 2023-11-05T08:06:25.434 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.401+0000 7f2f15583640 10 monclient(hunting): start opening mon connection 2023-11-05T08:06:25.434 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.401+0000 7f2f15583640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f10143610 con 0x7f2f10071a00 2023-11-05T08:06:25.435 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.401+0000 7f2f15583640 10 monclient(hunting): start opening mon connection 2023-11-05T08:06:25.435 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.401+0000 7f2f15583640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f101420b0 con 0x7f2f100ac7e0 2023-11-05T08:06:25.435 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.401+0000 7f2f15583640 10 monclient(hunting): _renew_subs 2023-11-05T08:06:25.435 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.401+0000 7f2f15583640 10 monclient(hunting): authenticate will time out at 1331.607334s 2023-11-05T08:06:25.436 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.401+0000 7f2f0effd640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2f10071a00 0x7f2f10143e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:06:25.436 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.402+0000 7f2f0e7fc640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2f100ac7e0 0x7f2f101d7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:06:25.436 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.402+0000 7f2f0f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2f1013eab0 0x7f2f101da730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:06:25.436 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.402+0000 7f2f0effd640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2f10071a00 0x7f2f10143e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.52:41466/0 (socket says 172.21.15.52:41466) 2023-11-05T08:06:25.437 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.402+0000 7f2f0effd640 1 -- 172.21.15.52:0/2983383567 learned_addr learned my addr 172.21.15.52:0/2983383567 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-11-05T08:06:25.437 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.402+0000 7f2f0effd640 10 monclient(hunting): get_auth_request con 0x7f2f10071a00 auth_method 0 2023-11-05T08:06:25.437 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.402+0000 7f2f0effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:06:25.437 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.402+0000 7f2f0effd640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:06:25.437 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.402+0000 7f2f0effd640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:06:25.438 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.402+0000 7f2f0e7fc640 10 monclient(hunting): get_auth_request con 0x7f2f100ac7e0 auth_method 0 2023-11-05T08:06:25.438 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.402+0000 7f2f0e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:06:25.438 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.402+0000 7f2f0e7fc640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:06:25.438 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.402+0000 7f2f0e7fc640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:06:25.439 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.402+0000 7f2f0f7fe640 10 monclient(hunting): get_auth_request con 0x7f2f1013eab0 auth_method 0 2023-11-05T08:06:25.439 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.402+0000 7f2f0f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:06:25.439 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.402+0000 7f2f0f7fe640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:06:25.439 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.402+0000 7f2f0f7fe640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:06:25.439 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.402+0000 7f2f0effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:06:25.440 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.402+0000 7f2f0effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:06:25.440 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.402+0000 7f2f0effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:06:25.440 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.403+0000 7f2f0e7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:06:25.440 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.403+0000 7f2f0e7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:06:25.440 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.403+0000 7f2f0e7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:06:25.441 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.403+0000 7f2f0f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:06:25.441 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.403+0000 7f2f0f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:06:25.441 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.403+0000 7f2f0f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:06:25.441 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.405+0000 7f2f0effd640 10 monclient(hunting): handle_auth_done global_id 4207 payload 824 2023-11-05T08:06:25.441 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.405+0000 7f2f0effd640 1 -- 172.21.15.52:0/2983383567 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2f100ac7e0 msgr2=0x7f2f101d7230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:06:25.442 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.405+0000 7f2f0effd640 1 --2- 172.21.15.52:0/2983383567 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2f100ac7e0 0x7f2f101d7230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:25.442 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.405+0000 7f2f0effd640 1 -- 172.21.15.52:0/2983383567 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2f1013eab0 msgr2=0x7f2f101da730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:06:25.442 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.405+0000 7f2f0effd640 1 --2- 172.21.15.52:0/2983383567 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2f1013eab0 0x7f2f101da730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:25.442 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.405+0000 7f2f0effd640 10 monclient: _finish_hunting 0 2023-11-05T08:06:25.442 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.405+0000 7f2f0effd640 1 monclient: found mon.noname-b 2023-11-05T08:06:25.443 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.405+0000 7f2f0effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:06:25.443 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.405+0000 7f2f0effd640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.156:3300/0 2023-11-05T08:06:25.443 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.405+0000 7f2f0effd640 1 -- 172.21.15.52:0/2983383567 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f08009a70 con 0x7f2f10071a00 2023-11-05T08:06:25.443 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.407+0000 7f2f0effd640 1 --2- 172.21.15.52:0/2983383567 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2f10071a00 0x7f2f10143e30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2f0000e8d0 tx=0x7f2f0000ed90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:06:25.443 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.407+0000 7f2ef77fe640 10 client.?.objecter ms_handle_connect 0x7f2f10071a00 2023-11-05T08:06:25.444 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.407+0000 7f2ef77fe640 10 client.?.objecter resend_mon_ops 2023-11-05T08:06:25.444 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.410+0000 7f2ef77fe640 1 -- 172.21.15.52:0/2983383567 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f0000c940 con 0x7f2f10071a00 2023-11-05T08:06:25.444 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.410+0000 7f2ef77fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:06:25.444 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.410+0000 7f2ef77fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-05T08:06:25.444 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.410+0000 7f2ef77fe640 10 monclient: dump: 2023-11-05T08:06:25.445 INFO:teuthology.misc.health.smithi052.stderr:epoch 1 2023-11-05T08:06:25.445 INFO:teuthology.misc.health.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:06:25.445 INFO:teuthology.misc.health.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:25.445 INFO:teuthology.misc.health.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:25.445 INFO:teuthology.misc.health.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:06:25.445 INFO:teuthology.misc.health.smithi052.stderr:election_strategy: 1 2023-11-05T08:06:25.446 INFO:teuthology.misc.health.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:06:25.446 INFO:teuthology.misc.health.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:06:25.446 INFO:teuthology.misc.health.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:06:25.446 INFO:teuthology.misc.health.smithi052.stderr: 2023-11-05T08:06:25.446 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.410+0000 7f2ef77fe640 10 monclient: _finish_auth 0 2023-11-05T08:06:25.447 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.410+0000 7f2ef77fe640 10 monclient: _check_auth_tickets 2023-11-05T08:06:25.447 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.410+0000 7f2ef77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:06:25.447 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.410+0000 7f2ef77fe640 1 -- 172.21.15.52:0/2983383567 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f0000caa0 con 0x7f2f10071a00 2023-11-05T08:06:25.447 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.410+0000 7f2f15583640 5 monclient: authenticate success, global_id 4207 2023-11-05T08:06:25.447 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.410+0000 7f2f15583640 10 monclient: _renew_subs 2023-11-05T08:06:25.448 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.410+0000 7f2f15583640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:06:25.448 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.410+0000 7f2f15583640 1 -- 172.21.15.52:0/2983383567 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f10142d20 con 0x7f2f10071a00 2023-11-05T08:06:25.448 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.410+0000 7f2ef77fe640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:06:25.448 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.410+0000 7f2ef77fe640 1 -- 172.21.15.52:0/2983383567 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f0000ce10 con 0x7f2f10071a00 2023-11-05T08:06:25.448 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.410+0000 7f2ef77fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:06:25.449 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.410+0000 7f2ef77fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-05T08:06:25.449 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.410+0000 7f2ef77fe640 10 monclient: dump: 2023-11-05T08:06:25.449 INFO:teuthology.misc.health.smithi052.stderr:epoch 1 2023-11-05T08:06:25.449 INFO:teuthology.misc.health.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:06:25.449 INFO:teuthology.misc.health.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:25.450 INFO:teuthology.misc.health.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:25.450 INFO:teuthology.misc.health.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:06:25.450 INFO:teuthology.misc.health.smithi052.stderr:election_strategy: 1 2023-11-05T08:06:25.450 INFO:teuthology.misc.health.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:06:25.450 INFO:teuthology.misc.health.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:06:25.451 INFO:teuthology.misc.health.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:06:25.451 INFO:teuthology.misc.health.smithi052.stderr: 2023-11-05T08:06:25.451 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.410+0000 7f2f15583640 10 client.4207.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-05T08:06:25.451 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.410+0000 7f2f15583640 10 monclient: _renew_subs 2023-11-05T08:06:25.451 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.410+0000 7f2f15583640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:06:25.452 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.410+0000 7f2f15583640 1 -- 172.21.15.52:0/2983383567 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f101459f0 con 0x7f2f10071a00 2023-11-05T08:06:25.452 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.410+0000 7f2f15583640 1 librados: init done 2023-11-05T08:06:25.452 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.410+0000 7f2f0d7fa640 4 set_mon_vals no callback set 2023-11-05T08:06:25.452 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.412+0000 7f2f15583640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-05T08:06:25.452 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.412+0000 7f2f15583640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:06:25.453 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.412+0000 7f2f15583640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:06:25.453 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.412+0000 7f2f15583640 1 -- 172.21.15.52:0/2983383567 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f10075530 con 0x7f2f10071a00 2023-11-05T08:06:25.454 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.429+0000 7f2ef77fe640 1 -- 172.21.15.52:0/2983383567 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 4) v1 ==== 89173+0+0 (secure 0 0 0) 0x7f2f00013470 con 0x7f2f10071a00 2023-11-05T08:06:25.454 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.429+0000 7f2ef77fe640 1 --2- 172.21.15.52:0/2983383567 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f2efc06c770 0x7f2efc06ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:06:25.455 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.430+0000 7f2f0e7fc640 1 --2- 172.21.15.52:0/2983383567 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f2efc06c770 0x7f2efc06ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:06:25.455 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.430+0000 7f2f0e7fc640 10 monclient: get_auth_request con 0x7f2efc06c770 auth_method 0 2023-11-05T08:06:25.455 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.430+0000 7f2f0e7fc640 1 --2- 172.21.15.52:0/2983383567 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f2efc06c770 0x7f2efc06ec30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2f101d5000 tx=0x7f2f04009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:06:25.455 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.430+0000 7f2ef77fe640 10 client.4207.objecter ms_handle_connect 0x7f2efc06c770 2023-11-05T08:06:25.455 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.431+0000 7f2ef77fe640 1 -- 172.21.15.52:0/2983383567 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f2f00058d00 con 0x7f2f10071a00 2023-11-05T08:06:25.456 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.431+0000 7f2ef77fe640 10 client.4207.objecter ms_dispatch 0x7f2f10000b90 osd_map(10..10 src has 1..10) v4 2023-11-05T08:06:25.456 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.431+0000 7f2ef77fe640 3 client.4207.objecter handle_osd_map got epochs [10,10] > 0 2023-11-05T08:06:25.456 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.431+0000 7f2ef77fe640 3 client.4207.objecter handle_osd_map decoding full epoch 10 2023-11-05T08:06:25.456 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.431+0000 7f2ef77fe640 20 client.4207.objecter dump_active .. 0 homeless 2023-11-05T08:06:25.457 INFO:tasks.ceph.osd.1.smithi052.stderr:2023-11-05T08:06:25.426+0000 5dc2340 -1 Falling back to public interface 2023-11-05T08:06:25.472 INFO:tasks.ceph.osd.5.smithi156.stderr:==00:00:00:09.903 86244== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:25.500 INFO:tasks.ceph.osd.2.smithi052.stderr:==00:00:00:09.954 86235== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:25.506 INFO:tasks.ceph.osd.4.smithi156.stderr:==00:00:00:09.939 86243== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:25.568 INFO:tasks.ceph.osd.2.smithi052.stderr:==00:00:00:10.022 86235== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:25.584 INFO:tasks.ceph.osd.7.smithi156.stderr:==00:00:00:10.007 86246== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:25.605 INFO:tasks.ceph.osd.0.smithi052.stderr:==00:00:00:10.064 86232== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:25.642 INFO:tasks.ceph.osd.6.smithi156.stderr:==00:00:00:10.072 86245== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:25.671 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.669+0000 7f2ef77fe640 1 -- 172.21.15.52:0/2983383567 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2f00055040 con 0x7f2f10071a00 2023-11-05T08:06:25.671 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.669+0000 7f2ef77fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:06:25.672 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.669+0000 7f2ef77fe640 10 monclient: _finish_command 1 = system:0 2023-11-05T08:06:25.741 INFO:tasks.ceph.osd.3.smithi052.stderr:==00:00:00:10.182 86237== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:25.746 INFO:tasks.ceph.osd.5.smithi156.stderr:==00:00:00:10.176 86244== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:25.781 INFO:tasks.ceph.osd.4.smithi156.stderr:==00:00:00:10.214 86243== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:25.837 INFO:tasks.ceph.osd.2.smithi052.stderr:==00:00:00:10.291 86235== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:25.849 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.847+0000 7f2f15583640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2023-11-05T08:06:25.850 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.847+0000 7f2f15583640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2023-11-05T08:06:25.850 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.847+0000 7f2f15583640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:06:25.850 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.847+0000 7f2f15583640 1 -- 172.21.15.52:0/2983383567 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2f100a9990 con 0x7f2f10071a00 2023-11-05T08:06:25.851 INFO:tasks.ceph.osd.7.smithi156.stderr:==00:00:00:10.274 86246== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:25.865 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.864+0000 7f2ef77fe640 1 -- 172.21.15.52:0/2983383567 <== mon.1 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f2f00021090 con 0x7f2f10071a00 2023-11-05T08:06:25.865 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.864+0000 7f2ef77fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2023-11-05T08:06:25.866 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.864+0000 7f2ef77fe640 10 monclient: _finish_command 2 = system:0 2023-11-05T08:06:25.866 INFO:teuthology.misc.health.smithi052.stdout: 2023-11-05T08:06:25.866 INFO:teuthology.misc.health.smithi052.stdout:{"epoch":10,"fsid":"b7fdc914-b520-409f-b9d7-902b05a64252","created":"2023-11-05T08:06:09.361414+0000","modified":"2023-11-05T08:06:15.124773+0000","last_up_change":"0.000000","last_in_change":"2023-11-05T08:06:15.124773+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c95e48e9-832b-4950-b467-9f61d33decc6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"82d5dd13-f1f5-4282-8ec8-4d6c273a42c7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"2c5ea82d-5534-4437-a76f-e3769d798b17","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9ffcbf5b-1afd-4777-825f-c5fb551b9d88","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"3f5f9aa4-2015-4835-9b39-faf459a35a49","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"cf781fb3-83fb-40e0-86a3-f895d7824edb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d2787c11-d907-4924-b9cf-69db95ad35c2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"e9e51eb8-2a9d-4cd0-9158-a00eea2a5614","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-05T08:06:25.868 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.865+0000 7f2f15583640 10 librados: watch_flush enter 2023-11-05T08:06:25.868 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.865+0000 7f2f15583640 10 librados: watch_flush exit 2023-11-05T08:06:25.869 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.865+0000 7f2f15583640 20 client.4207.objecter shutdown clearing up homeless session... 2023-11-05T08:06:25.869 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.865+0000 7f2f15583640 10 client.4207.objecter successfully canceled tick 2023-11-05T08:06:25.869 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.866+0000 7f2f15583640 1 -- 172.21.15.52:0/2983383567 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f2efc06c770 msgr2=0x7f2efc06ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:06:25.869 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.866+0000 7f2f15583640 1 --2- 172.21.15.52:0/2983383567 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f2efc06c770 0x7f2efc06ec30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2f101d5000 tx=0x7f2f04009190 comp rx=0 tx=0).stop 2023-11-05T08:06:25.869 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.866+0000 7f2f15583640 10 monclient: shutdown 2023-11-05T08:06:25.870 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.866+0000 7f2f15583640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:06:25.870 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.866+0000 7f2f15583640 1 -- 172.21.15.52:0/2983383567 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2f10071a00 msgr2=0x7f2f10143e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:06:25.870 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.866+0000 7f2f15583640 1 --2- 172.21.15.52:0/2983383567 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2f10071a00 0x7f2f10143e30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2f0000e8d0 tx=0x7f2f0000ed90 comp rx=0 tx=0).stop 2023-11-05T08:06:25.870 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.866+0000 7f2f15583640 1 -- 172.21.15.52:0/2983383567 shutdown_connections 2023-11-05T08:06:25.870 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.866+0000 7f2f15583640 1 --2- 172.21.15.52:0/2983383567 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f2efc06c770 0x7f2efc06ec30 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:25.871 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.866+0000 7f2f15583640 1 --2- 172.21.15.52:0/2983383567 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2f1013eab0 0x7f2f101da730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:25.871 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.866+0000 7f2f15583640 1 --2- 172.21.15.52:0/2983383567 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2f100ac7e0 0x7f2f101d7230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:25.871 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.866+0000 7f2f15583640 1 --2- 172.21.15.52:0/2983383567 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2f10071a00 0x7f2f10143e30 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:25.871 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.866+0000 7f2f15583640 1 -- 172.21.15.52:0/2983383567 >> 172.21.15.52:0/2983383567 conn(0x7f2f100b3260 msgr2=0x7f2f101390c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:06:25.871 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.866+0000 7f2f15583640 1 -- 172.21.15.52:0/2983383567 shutdown_connections 2023-11-05T08:06:25.872 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.866+0000 7f2f15583640 1 -- 172.21.15.52:0/2983383567 wait complete. 2023-11-05T08:06:25.872 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:25.866+0000 7f2f15583640 1 librados: shutdown 2023-11-05T08:06:25.877 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-11-05T08:06:25.906 INFO:tasks.ceph.osd.6.smithi156.stderr:==00:00:00:10.336 86245== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:25.965 INFO:tasks.ceph.osd.0.smithi052.stderr:==00:00:00:10.423 86232== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:26.012 INFO:tasks.ceph.osd.1.smithi052.stderr:==00:00:00:10.469 86234== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:26.014 INFO:tasks.ceph.osd.5.smithi156.stderr:==00:00:00:10.444 86244== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:26.051 INFO:tasks.ceph.osd.4.smithi156.stderr:==00:00:00:10.484 86243== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:26.080 INFO:tasks.ceph.osd.3.smithi052.stderr:==00:00:00:10.521 86237== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:26.105 INFO:tasks.ceph.osd.2.smithi052.stderr:==00:00:00:10.559 86235== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:26.117 INFO:tasks.ceph.osd.7.smithi156.stderr:==00:00:00:10.540 86246== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:26.171 INFO:tasks.ceph.osd.6.smithi156.stderr:==00:00:00:10.601 86245== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:26.282 INFO:tasks.ceph.osd.5.smithi156.stderr:==00:00:00:10.712 86244== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:26.283 INFO:tasks.ceph.osd.0.smithi052.stderr:==00:00:00:10.741 86232== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:26.314 INFO:tasks.ceph.osd.4.smithi156.stderr:==00:00:00:10.747 86243== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:26.350 INFO:tasks.ceph.osd.3.smithi052.stderr:==00:00:00:10.791 86237== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:26.376 INFO:tasks.ceph.osd.1.smithi052.stderr:==00:00:00:10.833 86234== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:26.379 INFO:tasks.ceph.osd.2.smithi052.stderr:==00:00:00:10.834 86235== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:26.382 INFO:tasks.ceph.osd.7.smithi156.stderr:==00:00:00:10.805 86246== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:26.435 INFO:tasks.ceph.osd.6.smithi156.stderr:==00:00:00:10.865 86245== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:26.550 INFO:tasks.ceph.osd.5.smithi156.stderr:==00:00:00:10.980 86244== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:26.551 INFO:tasks.ceph.osd.0.smithi052.stderr:==00:00:00:11.009 86232== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:26.579 INFO:tasks.ceph.osd.4.smithi156.stderr:==00:00:00:11.012 86243== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:26.616 INFO:tasks.ceph.osd.3.smithi052.stderr:==00:00:00:11.057 86237== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:26.648 INFO:tasks.ceph.osd.2.smithi052.stderr:==00:00:00:11.102 86235== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:26.651 INFO:tasks.ceph.osd.7.smithi156.stderr:==00:00:00:11.074 86246== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:26.695 INFO:tasks.ceph.osd.1.smithi052.stderr:==00:00:00:11.152 86234== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:26.700 INFO:tasks.ceph.osd.6.smithi156.stderr:==00:00:00:11.130 86245== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:26.817 INFO:tasks.ceph.osd.5.smithi156.stderr:==00:00:00:11.247 86244== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:26.823 INFO:tasks.ceph.osd.0.smithi052.stderr:==00:00:00:11.281 86232== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:26.849 INFO:tasks.ceph.osd.4.smithi156.stderr:==00:00:00:11.281 86243== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:26.882 INFO:tasks.ceph.osd.3.smithi052.stderr:==00:00:00:11.322 86237== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:26.920 INFO:tasks.ceph.osd.2.smithi052.stderr:==00:00:00:11.374 86235== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:26.923 INFO:tasks.ceph.osd.7.smithi156.stderr:==00:00:00:11.346 86246== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:26.967 INFO:tasks.ceph.osd.1.smithi052.stderr:==00:00:00:11.424 86234== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:26.968 INFO:tasks.ceph.osd.6.smithi156.stderr:==00:00:00:11.398 86245== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:27.085 INFO:tasks.ceph.osd.5.smithi156.stderr:==00:00:00:11.515 86244== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:27.088 INFO:tasks.ceph.osd.0.smithi052.stderr:==00:00:00:11.547 86232== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:27.124 INFO:tasks.ceph.osd.4.smithi156.stderr:==00:00:00:11.557 86243== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:27.147 INFO:tasks.ceph.osd.3.smithi052.stderr:==00:00:00:11.587 86237== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:27.185 INFO:tasks.ceph.osd.2.smithi052.stderr:==00:00:00:11.639 86235== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:27.233 INFO:tasks.ceph.osd.1.smithi052.stderr:==00:00:00:11.690 86234== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:27.248 INFO:tasks.ceph.osd.6.smithi156.stderr:==00:00:00:11.678 86245== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:27.353 INFO:tasks.ceph.osd.0.smithi052.stderr:==00:00:00:11.811 86232== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:27.393 INFO:tasks.ceph.osd.7.smithi156.stderr:==00:00:00:11.816 86246== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:27.421 INFO:tasks.ceph.osd.3.smithi052.stderr:==00:00:00:11.861 86237== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:27.447 INFO:tasks.ceph.osd.7.smithi156.stderr:==00:00:00:11.870 86246== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:27.502 INFO:tasks.ceph.osd.1.smithi052.stderr:==00:00:00:11.959 86234== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:27.568 INFO:tasks.ceph.osd.5.smithi156.stderr:==00:00:00:11.998 86244== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:27.618 INFO:tasks.ceph.osd.0.smithi052.stderr:==00:00:00:12.076 86232== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:27.622 INFO:tasks.ceph.osd.5.smithi156.stderr:==00:00:00:12.052 86244== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:27.624 INFO:tasks.ceph.osd.4.smithi156.stderr:==00:00:00:12.058 86243== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:27.666 INFO:tasks.ceph.osd.2.smithi052.stderr:==00:00:00:12.120 86235== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:27.685 INFO:tasks.ceph.osd.3.smithi052.stderr:==00:00:00:12.125 86237== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:27.706 INFO:tasks.ceph.osd.4.smithi156.stderr:==00:00:00:12.139 86243== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:27.720 INFO:tasks.ceph.osd.6.smithi156.stderr:==00:00:00:12.150 86245== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:27.721 INFO:tasks.ceph.osd.2.smithi052.stderr:==00:00:00:12.176 86235== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:27.771 INFO:tasks.ceph.osd.1.smithi052.stderr:==00:00:00:12.228 86234== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:27.775 INFO:tasks.ceph.osd.6.smithi156.stderr:==00:00:00:12.205 86245== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:27.883 INFO:tasks.ceph.osd.0.smithi052.stderr:==00:00:00:12.341 86232== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:28.040 INFO:tasks.ceph.osd.1.smithi052.stderr:==00:00:00:12.497 86234== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:28.159 INFO:tasks.ceph.osd.3.smithi052.stderr:==00:00:00:12.599 86237== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:28.215 INFO:tasks.ceph.osd.3.smithi052.stderr:==00:00:00:12.655 86237== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:28.315 INFO:tasks.ceph.osd.1.smithi052.stderr:==00:00:00:12.772 86234== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:28.362 INFO:tasks.ceph.osd.0.smithi052.stderr:==00:00:00:12.820 86232== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:28.430 INFO:tasks.ceph.osd.0.smithi052.stderr:==00:00:00:12.889 86232== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:28.846 INFO:tasks.ceph.osd.1.smithi052.stderr:==00:00:00:13.303 86234== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:28.902 INFO:tasks.ceph.osd.1.smithi052.stderr:==00:00:00:13.359 86234== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:32.684 DEBUG:teuthology.orchestra.run.smithi052:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-05T08:06:32.794 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.793+0000 7f0877fa5640 10 monclient: get_monmap_and_config 2023-11-05T08:06:32.794 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.793+0000 7f0877fa5640 10 monclient: build_initial_monmap 2023-11-05T08:06:32.795 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.793+0000 7f0877fa5640 10 monclient: monmap: 2023-11-05T08:06:32.795 INFO:teuthology.misc.health.smithi052.stderr:epoch 0 2023-11-05T08:06:32.795 INFO:teuthology.misc.health.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:06:32.795 INFO:teuthology.misc.health.smithi052.stderr:last_changed 2023-11-05T08:06:32.794415+0000 2023-11-05T08:06:32.795 INFO:teuthology.misc.health.smithi052.stderr:created 2023-11-05T08:06:32.794415+0000 2023-11-05T08:06:32.796 INFO:teuthology.misc.health.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:06:32.796 INFO:teuthology.misc.health.smithi052.stderr:election_strategy: 1 2023-11-05T08:06:32.796 INFO:teuthology.misc.health.smithi052.stderr:0: v1:172.21.15.52:6789/0 mon.noname-a-legacy 2023-11-05T08:06:32.796 INFO:teuthology.misc.health.smithi052.stderr:1: v1:172.21.15.156:6789/0 mon.noname-c-legacy 2023-11-05T08:06:32.796 INFO:teuthology.misc.health.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-b 2023-11-05T08:06:32.797 INFO:teuthology.misc.health.smithi052.stderr:3: v2:172.21.15.52:3300/0 mon.noname-a 2023-11-05T08:06:32.797 INFO:teuthology.misc.health.smithi052.stderr:4: v2:172.21.15.156:3300/0 mon.noname-c 2023-11-05T08:06:32.797 INFO:teuthology.misc.health.smithi052.stderr: 2023-11-05T08:06:32.799 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.794+0000 7f0877fa5640 1 Processor -- start 2023-11-05T08:06:32.800 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.794+0000 7f0877fa5640 1 -- start start 2023-11-05T08:06:32.800 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.794+0000 7f0877fa5640 10 monclient: init 2023-11-05T08:06:32.800 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.795+0000 7f0877fa5640 10 monclient: _reopen_session rank -1 2023-11-05T08:06:32.800 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.795+0000 7f0877fa5640 10 monclient: _add_conns ranks=[3,2,1,0,4] 2023-11-05T08:06:32.800 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.795+0000 7f0877fa5640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f08700ae6f0 0x7f087013eec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:06:32.801 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.795+0000 7f0877fa5640 10 monclient(hunting): picked mon.noname-a con 0x7f08700ae6f0 addr v2:172.21.15.52:3300/0 2023-11-05T08:06:32.801 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.795+0000 7f0877fa5640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f087013f400 0x7f08700b0770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:06:32.801 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.795+0000 7f0877fa5640 10 monclient(hunting): picked mon.noname-b con 0x7f087013f400 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:06:32.801 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.795+0000 7f0877fa5640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f08700b0cb0 addr v1:172.21.15.156:6789/0 2023-11-05T08:06:32.801 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.795+0000 7f0877fa5640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08700af110 con 0x7f08700b0cb0 2023-11-05T08:06:32.802 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.795+0000 7f0877fa5640 10 monclient(hunting): start opening mon connection 2023-11-05T08:06:32.802 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.795+0000 7f0877fa5640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08700b1310 con 0x7f08700ae6f0 2023-11-05T08:06:32.802 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.795+0000 7f0877fa5640 10 monclient(hunting): start opening mon connection 2023-11-05T08:06:32.802 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.795+0000 7f0877fa5640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08700aead0 con 0x7f087013f400 2023-11-05T08:06:32.803 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.795+0000 7f0877fa5640 10 monclient(hunting): _renew_subs 2023-11-05T08:06:32.803 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.795+0000 7f0877fa5640 10 monclient(hunting): authenticate will time out at 1339.000693s 2023-11-05T08:06:32.803 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.796+0000 7f0875d41640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f08700ae6f0 0x7f087013eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:06:32.803 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.796+0000 7f0876542640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f08700b0cb0 0x7f0870141af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.52:59694/0 (socket says 172.21.15.52:59694) 2023-11-05T08:06:32.803 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.796+0000 7f0876542640 1 -- 172.21.15.52:0/3267813345 learned_addr learned my addr 172.21.15.52:0/3267813345 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-11-05T08:06:32.803 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.796+0000 7f0875d41640 10 monclient(hunting): get_auth_request con 0x7f08700ae6f0 auth_method 0 2023-11-05T08:06:32.804 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.796+0000 7f0875d41640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:06:32.804 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.796+0000 7f0875540640 1 --2- 172.21.15.52:0/3267813345 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f087013f400 0x7f08700b0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:06:32.804 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.796+0000 7f0875d41640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:06:32.804 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.796+0000 7f0875d41640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:06:32.804 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.796+0000 7f0875540640 10 monclient(hunting): get_auth_request con 0x7f087013f400 auth_method 0 2023-11-05T08:06:32.805 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.796+0000 7f0875540640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:06:32.805 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.796+0000 7f0875540640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:06:32.805 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.796+0000 7f0875540640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:06:32.805 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.797+0000 7f0875d41640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:06:32.805 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.797+0000 7f0875d41640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:06:32.806 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.797+0000 7f0875d41640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:06:32.806 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.797+0000 7f0875540640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:06:32.806 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.797+0000 7f0875540640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:06:32.806 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.797+0000 7f0875540640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:06:32.806 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.798+0000 7f0875d41640 10 monclient(hunting): handle_auth_done global_id 4200 payload 274 2023-11-05T08:06:32.807 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.798+0000 7f0875d41640 1 -- 172.21.15.52:0/3267813345 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f087013f400 msgr2=0x7f08700b0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-05T08:06:32.807 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.798+0000 7f0875d41640 1 --2- 172.21.15.52:0/3267813345 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f087013f400 0x7f08700b0770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:32.807 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.798+0000 7f0875d41640 1 -- 172.21.15.52:0/3267813345 >> v1:172.21.15.156:6789/0 conn(0x7f08700b0cb0 legacy=0x7f0870141af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-05T08:06:32.807 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.798+0000 7f0875d41640 10 monclient: _finish_hunting 0 2023-11-05T08:06:32.807 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.798+0000 7f0875d41640 1 monclient: found mon.noname-a 2023-11-05T08:06:32.807 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.798+0000 7f0875d41640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:06:32.808 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.798+0000 7f0875d41640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.52:3300/0 2023-11-05T08:06:32.808 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.798+0000 7f0875d41640 1 -- 172.21.15.52:0/3267813345 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08700af2a0 con 0x7f08700ae6f0 2023-11-05T08:06:32.813 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.801+0000 7f0875d41640 1 --2- 172.21.15.52:0/3267813345 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08700ae6f0 0x7f087013eec0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f086c0097a0 tx=0x7f086c02b710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a7e7049fc030247 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:06:32.814 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.805+0000 7f0874d3f640 1 -- 172.21.15.52:0/3267813345 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f086c030710 con 0x7f08700ae6f0 2023-11-05T08:06:32.814 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.805+0000 7f0874d3f640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:06:32.814 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.805+0000 7f0874d3f640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-11-05T08:06:32.815 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.805+0000 7f0874d3f640 10 monclient: dump: 2023-11-05T08:06:32.815 INFO:teuthology.misc.health.smithi052.stderr:epoch 1 2023-11-05T08:06:32.815 INFO:teuthology.misc.health.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:06:32.816 INFO:teuthology.misc.health.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:32.816 INFO:teuthology.misc.health.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:32.816 INFO:teuthology.misc.health.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:06:32.816 INFO:teuthology.misc.health.smithi052.stderr:election_strategy: 1 2023-11-05T08:06:32.817 INFO:teuthology.misc.health.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:06:32.817 INFO:teuthology.misc.health.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:06:32.817 INFO:teuthology.misc.health.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:06:32.818 INFO:teuthology.misc.health.smithi052.stderr: 2023-11-05T08:06:32.818 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.805+0000 7f0874d3f640 10 monclient: _finish_auth 0 2023-11-05T08:06:32.819 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.805+0000 7f0874d3f640 10 monclient: _check_auth_tickets 2023-11-05T08:06:32.819 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.805+0000 7f0874d3f640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:06:32.819 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.805+0000 7f0874d3f640 1 -- 172.21.15.52:0/3267813345 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f086c02e050 con 0x7f08700ae6f0 2023-11-05T08:06:32.820 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.805+0000 7f0874d3f640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:06:32.820 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.805+0000 7f0874d3f640 1 -- 172.21.15.52:0/3267813345 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f086c030a90 con 0x7f08700ae6f0 2023-11-05T08:06:32.820 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.805+0000 7f0874d3f640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:06:32.820 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.805+0000 7f0874d3f640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-11-05T08:06:32.821 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.805+0000 7f0874d3f640 10 monclient: dump: 2023-11-05T08:06:32.821 INFO:teuthology.misc.health.smithi052.stderr:epoch 1 2023-11-05T08:06:32.821 INFO:teuthology.misc.health.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:06:32.822 INFO:teuthology.misc.health.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:32.822 INFO:teuthology.misc.health.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:32.822 INFO:teuthology.misc.health.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:06:32.822 INFO:teuthology.misc.health.smithi052.stderr:election_strategy: 1 2023-11-05T08:06:32.822 INFO:teuthology.misc.health.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:06:32.823 INFO:teuthology.misc.health.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:06:32.823 INFO:teuthology.misc.health.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:06:32.823 INFO:teuthology.misc.health.smithi052.stderr: 2023-11-05T08:06:32.823 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.805+0000 7f0877fa5640 5 monclient: authenticate success, global_id 4200 2023-11-05T08:06:32.823 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.805+0000 7f0877fa5640 10 monclient: get_monmap_and_config success 2023-11-05T08:06:32.824 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.805+0000 7f0877fa5640 4 set_mon_vals no callback set 2023-11-05T08:06:32.824 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.806+0000 7f0877fa5640 10 monclient: shutdown 2023-11-05T08:06:32.824 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.806+0000 7f0877fa5640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:06:32.824 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.806+0000 7f0877fa5640 1 -- 172.21.15.52:0/3267813345 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08700ae6f0 msgr2=0x7f087013eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:06:32.824 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.806+0000 7f0877fa5640 1 --2- 172.21.15.52:0/3267813345 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08700ae6f0 0x7f087013eec0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f086c0097a0 tx=0x7f086c02b710 comp rx=0 tx=0).stop 2023-11-05T08:06:32.825 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.806+0000 7f0877fa5640 1 -- 172.21.15.52:0/3267813345 shutdown_connections 2023-11-05T08:06:32.825 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.806+0000 7f0877fa5640 1 --2- 172.21.15.52:0/3267813345 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f087013f400 0x7f08700b0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:32.825 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.806+0000 7f0877fa5640 1 --2- 172.21.15.52:0/3267813345 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08700ae6f0 0x7f087013eec0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:32.825 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.806+0000 7f0877fa5640 1 -- 172.21.15.52:0/3267813345 >> 172.21.15.52:0/3267813345 conn(0x7f08700b7080 msgr2=0x7f08700b7490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:06:32.825 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.806+0000 7f0877fa5640 1 -- 172.21.15.52:0/3267813345 shutdown_connections 2023-11-05T08:06:32.826 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.806+0000 7f0877fa5640 1 -- 172.21.15.52:0/3267813345 wait complete. 2023-11-05T08:06:32.826 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.807+0000 7f0877fa5640 10 monclient: build_initial_monmap 2023-11-05T08:06:32.826 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.807+0000 7f0877fa5640 10 monclient: monmap: 2023-11-05T08:06:32.827 INFO:teuthology.misc.health.smithi052.stderr:epoch 0 2023-11-05T08:06:32.827 INFO:teuthology.misc.health.smithi052.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-05T08:06:32.827 INFO:teuthology.misc.health.smithi052.stderr:last_changed 0.000000 2023-11-05T08:06:32.828 INFO:teuthology.misc.health.smithi052.stderr:created 0.000000 2023-11-05T08:06:32.828 INFO:teuthology.misc.health.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:06:32.828 INFO:teuthology.misc.health.smithi052.stderr:election_strategy: 1 2023-11-05T08:06:32.828 INFO:teuthology.misc.health.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.noname-a 2023-11-05T08:06:32.828 INFO:teuthology.misc.health.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.noname-b 2023-11-05T08:06:32.829 INFO:teuthology.misc.health.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-c 2023-11-05T08:06:32.829 INFO:teuthology.misc.health.smithi052.stderr: 2023-11-05T08:06:32.829 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.808+0000 7f0877fa5640 1 librados: starting msgr at 2023-11-05T08:06:32.829 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.808+0000 7f0877fa5640 1 librados: starting objecter 2023-11-05T08:06:32.829 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.808+0000 7f0877fa5640 1 Processor -- start 2023-11-05T08:06:32.830 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.808+0000 7f0877fa5640 1 -- start start 2023-11-05T08:06:32.830 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.808+0000 7f0877fa5640 1 librados: setting wanted keys 2023-11-05T08:06:32.830 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.808+0000 7f0877fa5640 1 librados: calling monclient init 2023-11-05T08:06:32.830 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.808+0000 7f0877fa5640 10 monclient: init 2023-11-05T08:06:32.830 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.809+0000 7f0877fa5640 10 monclient: _reopen_session rank -1 2023-11-05T08:06:32.831 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.809+0000 7f0877fa5640 10 monclient: _add_conns ranks=[1,0,2] 2023-11-05T08:06:32.831 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.809+0000 7f0877fa5640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f08700ae6f0 0x7f087013c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:06:32.831 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.809+0000 7f0877fa5640 10 monclient(hunting): picked mon.noname-b con 0x7f08700ae6f0 addr [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] 2023-11-05T08:06:32.831 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.809+0000 7f0877fa5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08700b0cb0 0x7f08700a84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:06:32.831 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.809+0000 7f0877fa5640 10 monclient(hunting): picked mon.noname-a con 0x7f08700b0cb0 addr [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] 2023-11-05T08:06:32.832 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.809+0000 7f0877fa5640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f087013f400 0x7f08701de540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:06:32.832 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.809+0000 7f0877fa5640 10 monclient(hunting): picked mon.noname-c con 0x7f087013f400 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:06:32.832 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.809+0000 7f0877fa5640 10 monclient(hunting): start opening mon connection 2023-11-05T08:06:32.832 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.809+0000 7f0877fa5640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08700abd70 con 0x7f08700b0cb0 2023-11-05T08:06:32.832 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.809+0000 7f0877fa5640 10 monclient(hunting): start opening mon connection 2023-11-05T08:06:32.833 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.809+0000 7f0877fa5640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08700ad120 con 0x7f08700ae6f0 2023-11-05T08:06:32.833 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.809+0000 7f0877fa5640 10 monclient(hunting): start opening mon connection 2023-11-05T08:06:32.833 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.809+0000 7f0877fa5640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08700a9e80 con 0x7f087013f400 2023-11-05T08:06:32.833 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.809+0000 7f0877fa5640 10 monclient(hunting): _renew_subs 2023-11-05T08:06:32.833 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.809+0000 7f0877fa5640 10 monclient(hunting): authenticate will time out at 1339.014513s 2023-11-05T08:06:32.834 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.809+0000 7f0876542640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f087013f400 0x7f08701de540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:06:32.834 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.809+0000 7f0875d41640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f08700ae6f0 0x7f087013c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:06:32.834 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.810+0000 7f0876542640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f087013f400 0x7f08701de540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.52:33964/0 (socket says 172.21.15.52:33964) 2023-11-05T08:06:32.835 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.810+0000 7f0876542640 1 -- 172.21.15.52:0/1279831820 learned_addr learned my addr 172.21.15.52:0/1279831820 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-11-05T08:06:32.835 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.810+0000 7f0876542640 10 monclient(hunting): get_auth_request con 0x7f087013f400 auth_method 0 2023-11-05T08:06:32.835 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.810+0000 7f0876542640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:06:32.836 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.810+0000 7f0876542640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:06:32.836 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.810+0000 7f0876542640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:06:32.836 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.810+0000 7f0875d41640 10 monclient(hunting): get_auth_request con 0x7f08700ae6f0 auth_method 0 2023-11-05T08:06:32.837 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.810+0000 7f0875d41640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:06:32.837 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.810+0000 7f0875d41640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:06:32.837 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.810+0000 7f0875d41640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:06:32.838 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.810+0000 7f0875540640 1 --2- 172.21.15.52:0/1279831820 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08700b0cb0 0x7f08700a84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:06:32.838 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.810+0000 7f0875540640 10 monclient(hunting): get_auth_request con 0x7f08700b0cb0 auth_method 0 2023-11-05T08:06:32.839 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.810+0000 7f0875540640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:06:32.839 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.810+0000 7f0875540640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:06:32.839 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.810+0000 7f0875540640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:06:32.839 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.810+0000 7f0876542640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:06:32.840 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.810+0000 7f0876542640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:06:32.840 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.810+0000 7f0876542640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:06:32.840 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.810+0000 7f0875d41640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:06:32.841 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.810+0000 7f0875d41640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:06:32.841 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.810+0000 7f0875d41640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:06:32.842 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.811+0000 7f0875540640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:06:32.842 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.811+0000 7f0875540640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:06:32.842 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.811+0000 7f0875540640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:06:32.845 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.814+0000 7f0876542640 10 monclient(hunting): handle_auth_done global_id 4160 payload 824 2023-11-05T08:06:32.845 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.814+0000 7f0876542640 1 -- 172.21.15.52:0/1279831820 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f08700ae6f0 msgr2=0x7f087013c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:06:32.846 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.814+0000 7f0876542640 1 --2- 172.21.15.52:0/1279831820 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f08700ae6f0 0x7f087013c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:32.846 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.814+0000 7f0876542640 1 -- 172.21.15.52:0/1279831820 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08700b0cb0 msgr2=0x7f08700a84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:06:32.846 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.814+0000 7f0876542640 1 --2- 172.21.15.52:0/1279831820 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08700b0cb0 0x7f08700a84b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:32.846 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.814+0000 7f0876542640 10 monclient: _finish_hunting 0 2023-11-05T08:06:32.847 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.814+0000 7f0876542640 1 monclient: found mon.noname-c 2023-11-05T08:06:32.847 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.814+0000 7f0876542640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:06:32.847 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.814+0000 7f0876542640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.52:3301/0 2023-11-05T08:06:32.847 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.814+0000 7f0876542640 1 -- 172.21.15.52:0/1279831820 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f086c009400 con 0x7f087013f400 2023-11-05T08:06:32.847 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.818+0000 7f0876542640 1 --2- 172.21.15.52:0/1279831820 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f087013f400 0x7f08701de540 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f086800caf0 tx=0x7f086800a060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:06:32.848 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.818+0000 7f08667fc640 10 client.?.objecter ms_handle_connect 0x7f087013f400 2023-11-05T08:06:32.848 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.818+0000 7f08667fc640 10 client.?.objecter resend_mon_ops 2023-11-05T08:06:32.848 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.822+0000 7f08667fc640 1 -- 172.21.15.52:0/1279831820 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f086800aca0 con 0x7f087013f400 2023-11-05T08:06:32.848 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.822+0000 7f08667fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:06:32.848 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.822+0000 7f08667fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-11-05T08:06:32.849 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.822+0000 7f08667fc640 10 monclient: dump: 2023-11-05T08:06:32.849 INFO:teuthology.misc.health.smithi052.stderr:epoch 1 2023-11-05T08:06:32.849 INFO:teuthology.misc.health.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:06:32.849 INFO:teuthology.misc.health.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:32.849 INFO:teuthology.misc.health.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:32.849 INFO:teuthology.misc.health.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:06:32.850 INFO:teuthology.misc.health.smithi052.stderr:election_strategy: 1 2023-11-05T08:06:32.850 INFO:teuthology.misc.health.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:06:32.850 INFO:teuthology.misc.health.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:06:32.850 INFO:teuthology.misc.health.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:06:32.850 INFO:teuthology.misc.health.smithi052.stderr: 2023-11-05T08:06:32.851 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.822+0000 7f08667fc640 10 monclient: _finish_auth 0 2023-11-05T08:06:32.851 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.822+0000 7f08667fc640 10 monclient: _check_auth_tickets 2023-11-05T08:06:32.851 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.822+0000 7f08667fc640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:06:32.851 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.822+0000 7f08667fc640 1 -- 172.21.15.52:0/1279831820 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f086800ae20 con 0x7f087013f400 2023-11-05T08:06:32.851 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.822+0000 7f08667fc640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:06:32.851 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.822+0000 7f08667fc640 1 -- 172.21.15.52:0/1279831820 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0868012640 con 0x7f087013f400 2023-11-05T08:06:32.852 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.822+0000 7f08667fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:06:32.852 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.822+0000 7f08667fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-11-05T08:06:32.852 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.822+0000 7f08667fc640 10 monclient: dump: 2023-11-05T08:06:32.852 INFO:teuthology.misc.health.smithi052.stderr:epoch 1 2023-11-05T08:06:32.852 INFO:teuthology.misc.health.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:06:32.853 INFO:teuthology.misc.health.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:32.853 INFO:teuthology.misc.health.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:32.853 INFO:teuthology.misc.health.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:06:32.853 INFO:teuthology.misc.health.smithi052.stderr:election_strategy: 1 2023-11-05T08:06:32.853 INFO:teuthology.misc.health.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:06:32.853 INFO:teuthology.misc.health.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:06:32.854 INFO:teuthology.misc.health.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:06:32.854 INFO:teuthology.misc.health.smithi052.stderr: 2023-11-05T08:06:32.854 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.822+0000 7f0877fa5640 5 monclient: authenticate success, global_id 4160 2023-11-05T08:06:32.854 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.822+0000 7f0877fa5640 10 monclient: _renew_subs 2023-11-05T08:06:32.854 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.822+0000 7f0877fa5640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.52:3301/0 2023-11-05T08:06:32.855 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.822+0000 7f0877fa5640 1 -- 172.21.15.52:0/1279831820 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08701dea80 con 0x7f087013f400 2023-11-05T08:06:32.855 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.822+0000 7f0867fff640 4 set_mon_vals no callback set 2023-11-05T08:06:32.855 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.822+0000 7f0877fa5640 10 client.4160.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-05T08:06:32.855 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.822+0000 7f0877fa5640 10 monclient: _renew_subs 2023-11-05T08:06:32.856 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.822+0000 7f0877fa5640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.52:3301/0 2023-11-05T08:06:32.856 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.822+0000 7f0877fa5640 1 -- 172.21.15.52:0/1279831820 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08701def40 con 0x7f087013f400 2023-11-05T08:06:32.856 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.822+0000 7f0877fa5640 1 librados: init done 2023-11-05T08:06:32.856 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.823+0000 7f0877fa5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-05T08:06:32.856 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.823+0000 7f0877fa5640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:06:32.857 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.823+0000 7f0877fa5640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.52:3301/0 2023-11-05T08:06:32.857 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.823+0000 7f0877fa5640 1 -- 172.21.15.52:0/1279831820 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08701df1c0 con 0x7f087013f400 2023-11-05T08:06:32.858 INFO:tasks.ceph.osd.5.smithi156.stderr:==00:00:00:17.284 86244== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:32.859 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.854+0000 7f08667fc640 1 -- 172.21.15.52:0/1279831820 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 4) v1 ==== 89173+0+0 (secure 0 0 0) 0x7f08680127a0 con 0x7f087013f400 2023-11-05T08:06:32.859 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.854+0000 7f08667fc640 1 --2- 172.21.15.52:0/1279831820 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f085406c7c0 0x7f085406ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:06:32.859 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.855+0000 7f0875d41640 1 --2- 172.21.15.52:0/1279831820 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f085406c7c0 0x7f085406ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:06:32.860 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.855+0000 7f0875d41640 10 monclient: get_auth_request con 0x7f085406c7c0 auth_method 0 2023-11-05T08:06:32.860 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.855+0000 7f0875d41640 1 --2- 172.21.15.52:0/1279831820 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f085406c7c0 0x7f085406ec80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f086c034000 tx=0x7f086c02f000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:06:32.860 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.855+0000 7f08667fc640 10 client.4160.objecter ms_handle_connect 0x7f085406c7c0 2023-11-05T08:06:32.988 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.988+0000 7f08667fc640 1 -- 172.21.15.52:0/1279831820 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f0868059370 con 0x7f087013f400 2023-11-05T08:06:32.989 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.988+0000 7f08667fc640 10 client.4160.objecter ms_dispatch 0x7f0870000b90 osd_map(10..10 src has 1..10) v4 2023-11-05T08:06:32.989 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.988+0000 7f08667fc640 3 client.4160.objecter handle_osd_map got epochs [10,10] > 0 2023-11-05T08:06:32.989 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.988+0000 7f08667fc640 3 client.4160.objecter handle_osd_map decoding full epoch 10 2023-11-05T08:06:32.989 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:32.988+0000 7f08667fc640 20 client.4160.objecter dump_active .. 0 homeless 2023-11-05T08:06:33.021 INFO:tasks.ceph.osd.7.smithi156.stderr:==00:00:00:17.443 86246== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:33.029 INFO:tasks.ceph.osd.4.smithi156.stderr:==00:00:00:17.462 86243== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:33.073 INFO:tasks.ceph.osd.6.smithi156.stderr:==00:00:00:17.502 86245== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:33.187 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:33.187+0000 7f08667fc640 1 -- 172.21.15.52:0/1279831820 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f08680556b0 con 0x7f087013f400 2023-11-05T08:06:33.188 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:33.187+0000 7f08667fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:06:33.188 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:33.187+0000 7f08667fc640 10 monclient: _finish_command 1 = system:0 2023-11-05T08:06:33.370 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:33.370+0000 7f0877fa5640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2023-11-05T08:06:33.371 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:33.370+0000 7f0877fa5640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2023-11-05T08:06:33.371 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:33.370+0000 7f0877fa5640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.52:3301/0 2023-11-05T08:06:33.371 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:33.370+0000 7f0877fa5640 1 -- 172.21.15.52:0/1279831820 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f08700abee0 con 0x7f087013f400 2023-11-05T08:06:33.436 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:33.435+0000 7f08667fc640 1 -- 172.21.15.52:0/1279831820 <== mon.2 v2:172.21.15.52:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f0868058cd0 con 0x7f087013f400 2023-11-05T08:06:33.436 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:33.435+0000 7f08667fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2023-11-05T08:06:33.436 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:33.435+0000 7f08667fc640 10 monclient: _finish_command 2 = system:0 2023-11-05T08:06:33.437 INFO:teuthology.misc.health.smithi052.stdout: 2023-11-05T08:06:33.437 INFO:teuthology.misc.health.smithi052.stdout:{"epoch":10,"fsid":"b7fdc914-b520-409f-b9d7-902b05a64252","created":"2023-11-05T08:06:09.361414+0000","modified":"2023-11-05T08:06:15.124773+0000","last_up_change":"0.000000","last_in_change":"2023-11-05T08:06:15.124773+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c95e48e9-832b-4950-b467-9f61d33decc6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"82d5dd13-f1f5-4282-8ec8-4d6c273a42c7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"2c5ea82d-5534-4437-a76f-e3769d798b17","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9ffcbf5b-1afd-4777-825f-c5fb551b9d88","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"3f5f9aa4-2015-4835-9b39-faf459a35a49","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"cf781fb3-83fb-40e0-86a3-f895d7824edb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d2787c11-d907-4924-b9cf-69db95ad35c2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"e9e51eb8-2a9d-4cd0-9158-a00eea2a5614","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-05T08:06:33.438 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:33.438+0000 7f0877fa5640 10 librados: watch_flush enter 2023-11-05T08:06:33.439 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:33.438+0000 7f0877fa5640 10 librados: watch_flush exit 2023-11-05T08:06:33.439 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:33.438+0000 7f0877fa5640 20 client.4160.objecter shutdown clearing up homeless session... 2023-11-05T08:06:33.439 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:33.438+0000 7f0877fa5640 10 client.4160.objecter successfully canceled tick 2023-11-05T08:06:33.440 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:33.439+0000 7f0877fa5640 1 -- 172.21.15.52:0/1279831820 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f085406c7c0 msgr2=0x7f085406ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:06:33.440 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:33.439+0000 7f0877fa5640 1 --2- 172.21.15.52:0/1279831820 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f085406c7c0 0x7f085406ec80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f086c034000 tx=0x7f086c02f000 comp rx=0 tx=0).stop 2023-11-05T08:06:33.441 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:33.439+0000 7f0877fa5640 10 monclient: shutdown 2023-11-05T08:06:33.441 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:33.439+0000 7f0877fa5640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:06:33.441 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:33.439+0000 7f0877fa5640 1 -- 172.21.15.52:0/1279831820 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f087013f400 msgr2=0x7f08701de540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:06:33.441 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:33.439+0000 7f0877fa5640 1 --2- 172.21.15.52:0/1279831820 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f087013f400 0x7f08701de540 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f086800caf0 tx=0x7f086800a060 comp rx=0 tx=0).stop 2023-11-05T08:06:33.441 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:33.439+0000 7f0877fa5640 1 -- 172.21.15.52:0/1279831820 shutdown_connections 2023-11-05T08:06:33.442 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:33.439+0000 7f0877fa5640 1 --2- 172.21.15.52:0/1279831820 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f085406c7c0 0x7f085406ec80 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:33.442 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:33.439+0000 7f0877fa5640 1 --2- 172.21.15.52:0/1279831820 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f087013f400 0x7f08701de540 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:33.442 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:33.439+0000 7f0877fa5640 1 --2- 172.21.15.52:0/1279831820 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08700b0cb0 0x7f08700a84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:33.442 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:33.439+0000 7f0877fa5640 1 --2- 172.21.15.52:0/1279831820 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f08700ae6f0 0x7f087013c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:33.442 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:33.439+0000 7f0877fa5640 1 -- 172.21.15.52:0/1279831820 >> 172.21.15.52:0/1279831820 conn(0x7f08700b7080 msgr2=0x7f08700b6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:06:33.443 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:33.439+0000 7f0877fa5640 1 -- 172.21.15.52:0/1279831820 shutdown_connections 2023-11-05T08:06:33.443 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:33.439+0000 7f0877fa5640 1 -- 172.21.15.52:0/1279831820 wait complete. 2023-11-05T08:06:33.443 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:33.439+0000 7f0877fa5640 1 librados: shutdown 2023-11-05T08:06:33.450 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-11-05T08:06:33.461 INFO:tasks.ceph.osd.2.smithi052.stderr:==00:00:00:17.916 86235== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:34.015 INFO:tasks.ceph.osd.3.smithi052.stderr:==00:00:00:18.456 86237== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:34.051 INFO:tasks.ceph.osd.0.smithi052.stderr:==00:00:00:18.510 86232== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:34.465 INFO:tasks.ceph.osd.1.smithi052.stderr:==00:00:00:18.922 86234== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:38.361 INFO:tasks.ceph.osd.5.smithi156.stderr:==00:00:00:22.791 86244== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:38.365 INFO:tasks.ceph.osd.5.smithi156.stderr:==00:00:00:22.796 86244== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:38.443 INFO:tasks.ceph.osd.6.smithi156.stderr:==00:00:00:22.873 86245== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:38.447 INFO:tasks.ceph.osd.6.smithi156.stderr:==00:00:00:22.877 86245== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:38.568 INFO:tasks.ceph.osd.7.smithi156.stderr:==00:00:00:22.990 86246== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:38.571 INFO:tasks.ceph.osd.4.smithi156.stderr:==00:00:00:23.004 86243== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:38.572 INFO:tasks.ceph.osd.7.smithi156.stderr:==00:00:00:22.995 86246== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:38.575 INFO:tasks.ceph.osd.4.smithi156.stderr:==00:00:00:23.008 86243== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:39.363 INFO:tasks.ceph.osd.2.smithi052.stderr:==00:00:00:23.817 86235== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:39.369 INFO:tasks.ceph.osd.2.smithi052.stderr:==00:00:00:23.823 86235== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:39.982 INFO:tasks.ceph.osd.3.smithi052.stderr:==00:00:00:24.422 86237== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:39.986 INFO:tasks.ceph.osd.3.smithi052.stderr:==00:00:00:24.427 86237== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:40.076 INFO:tasks.ceph.osd.0.smithi052.stderr:==00:00:00:24.534 86232== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:40.082 INFO:tasks.ceph.osd.0.smithi052.stderr:==00:00:00:24.541 86232== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:40.256 DEBUG:teuthology.orchestra.run.smithi052:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-05T08:06:40.368 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.368+0000 7f0527516640 10 monclient: get_monmap_and_config 2023-11-05T08:06:40.369 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.368+0000 7f0527516640 10 monclient: build_initial_monmap 2023-11-05T08:06:40.369 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.368+0000 7f0527516640 10 monclient: monmap: 2023-11-05T08:06:40.369 INFO:teuthology.misc.health.smithi052.stderr:epoch 0 2023-11-05T08:06:40.369 INFO:teuthology.misc.health.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:06:40.370 INFO:teuthology.misc.health.smithi052.stderr:last_changed 2023-11-05T08:06:40.368843+0000 2023-11-05T08:06:40.370 INFO:teuthology.misc.health.smithi052.stderr:created 2023-11-05T08:06:40.368843+0000 2023-11-05T08:06:40.370 INFO:teuthology.misc.health.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:06:40.370 INFO:teuthology.misc.health.smithi052.stderr:election_strategy: 1 2023-11-05T08:06:40.370 INFO:teuthology.misc.health.smithi052.stderr:0: v1:172.21.15.52:6789/0 mon.noname-a-legacy 2023-11-05T08:06:40.371 INFO:teuthology.misc.health.smithi052.stderr:1: v1:172.21.15.156:6789/0 mon.noname-c-legacy 2023-11-05T08:06:40.371 INFO:teuthology.misc.health.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-b 2023-11-05T08:06:40.371 INFO:teuthology.misc.health.smithi052.stderr:3: v2:172.21.15.52:3300/0 mon.noname-a 2023-11-05T08:06:40.371 INFO:teuthology.misc.health.smithi052.stderr:4: v2:172.21.15.156:3300/0 mon.noname-c 2023-11-05T08:06:40.371 INFO:teuthology.misc.health.smithi052.stderr: 2023-11-05T08:06:40.375 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.368+0000 7f0527516640 1 Processor -- start 2023-11-05T08:06:40.375 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.369+0000 7f0527516640 1 -- start start 2023-11-05T08:06:40.375 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.369+0000 7f0527516640 10 monclient: init 2023-11-05T08:06:40.376 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.369+0000 7f0527516640 10 monclient: _reopen_session rank -1 2023-11-05T08:06:40.376 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.369+0000 7f0527516640 10 monclient: _add_conns ranks=[2,1,4,0,3] 2023-11-05T08:06:40.376 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.369+0000 7f0527516640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f052013eea0 0x7f05200aea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:06:40.376 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.369+0000 7f0527516640 10 monclient(hunting): picked mon.noname-b con 0x7f052013eea0 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:06:40.376 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.369+0000 7f0527516640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f05200b3e50 addr v1:172.21.15.156:6789/0 2023-11-05T08:06:40.377 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.369+0000 7f0527516640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f052014a130 0x7f052014c520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:06:40.377 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.369+0000 7f0527516640 10 monclient(hunting): picked mon.noname-c con 0x7f052014a130 addr v2:172.21.15.156:3300/0 2023-11-05T08:06:40.377 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.369+0000 7f0527516640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05200b14b0 con 0x7f05200b3e50 2023-11-05T08:06:40.377 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.369+0000 7f0527516640 10 monclient(hunting): start opening mon connection 2023-11-05T08:06:40.377 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.369+0000 7f0527516640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05200aef70 con 0x7f052014a130 2023-11-05T08:06:40.378 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.369+0000 7f0527516640 10 monclient(hunting): start opening mon connection 2023-11-05T08:06:40.378 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.369+0000 7f0527516640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0520145180 con 0x7f052013eea0 2023-11-05T08:06:40.378 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.369+0000 7f0527516640 10 monclient(hunting): _renew_subs 2023-11-05T08:06:40.378 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.369+0000 7f0527516640 10 monclient(hunting): authenticate will time out at 1346.574811s 2023-11-05T08:06:40.379 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.370+0000 7f05252b2640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f052013eea0 0x7f05200aea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:06:40.379 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.370+0000 7f0525ab3640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f052014a130 0x7f052014c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:06:40.379 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.370+0000 7f05252b2640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f052013eea0 0x7f05200aea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.52:52704/0 (socket says 172.21.15.52:52704) 2023-11-05T08:06:40.379 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.370+0000 7f05252b2640 1 -- 172.21.15.52:0/2301202556 learned_addr learned my addr 172.21.15.52:0/2301202556 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-11-05T08:06:40.379 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.370+0000 7f05252b2640 10 monclient(hunting): get_auth_request con 0x7f052013eea0 auth_method 0 2023-11-05T08:06:40.379 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.370+0000 7f05252b2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:06:40.380 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.370+0000 7f05252b2640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:06:40.380 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.370+0000 7f05252b2640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:06:40.380 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.371+0000 7f0525ab3640 10 monclient(hunting): get_auth_request con 0x7f052014a130 auth_method 0 2023-11-05T08:06:40.380 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.371+0000 7f0525ab3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:06:40.380 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.371+0000 7f0525ab3640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:06:40.381 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.371+0000 7f0525ab3640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:06:40.381 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.371+0000 7f05252b2640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:06:40.381 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.371+0000 7f05252b2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:06:40.381 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.371+0000 7f05252b2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:06:40.381 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.372+0000 7f0525ab3640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:06:40.382 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.372+0000 7f0525ab3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:06:40.382 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.372+0000 7f0525ab3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:06:40.382 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.373+0000 7f05252b2640 10 monclient(hunting): handle_auth_done global_id 4163 payload 274 2023-11-05T08:06:40.382 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.373+0000 7f05252b2640 1 -- 172.21.15.52:0/2301202556 >> v2:172.21.15.156:3300/0 conn(0x7f052014a130 msgr2=0x7f052014c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-05T08:06:40.382 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.373+0000 7f05252b2640 1 --2- 172.21.15.52:0/2301202556 >> v2:172.21.15.156:3300/0 conn(0x7f052014a130 0x7f052014c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:40.382 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.373+0000 7f05252b2640 1 -- 172.21.15.52:0/2301202556 >> v1:172.21.15.156:6789/0 conn(0x7f05200b3e50 legacy=0x7f05200b0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:06:40.383 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.373+0000 7f05252b2640 10 monclient: _finish_hunting 0 2023-11-05T08:06:40.383 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.373+0000 7f05252b2640 1 monclient: found mon.noname-b 2023-11-05T08:06:40.383 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.373+0000 7f05252b2640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:06:40.383 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.373+0000 7f05252b2640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.52:3301/0 2023-11-05T08:06:40.383 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.373+0000 7f05252b2640 1 -- 172.21.15.52:0/2301202556 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05200affe0 con 0x7f052013eea0 2023-11-05T08:06:40.384 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.375+0000 7f05252b2640 1 --2- 172.21.15.52:0/2301202556 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f052013eea0 0x7f05200aea30 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f051c009870 tx=0x7f051c02b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aecbd11952ed3e5c server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:06:40.390 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.379+0000 7f0517fff640 1 -- 172.21.15.52:0/2301202556 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f051c0317c0 con 0x7f052013eea0 2023-11-05T08:06:40.390 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.379+0000 7f0517fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:06:40.391 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.379+0000 7f0517fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-05T08:06:40.391 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.379+0000 7f0517fff640 10 monclient: dump: 2023-11-05T08:06:40.391 INFO:teuthology.misc.health.smithi052.stderr:epoch 1 2023-11-05T08:06:40.391 INFO:teuthology.misc.health.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:06:40.391 INFO:teuthology.misc.health.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:40.391 INFO:teuthology.misc.health.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:40.392 INFO:teuthology.misc.health.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:06:40.392 INFO:teuthology.misc.health.smithi052.stderr:election_strategy: 1 2023-11-05T08:06:40.392 INFO:teuthology.misc.health.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:06:40.392 INFO:teuthology.misc.health.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:06:40.392 INFO:teuthology.misc.health.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:06:40.393 INFO:teuthology.misc.health.smithi052.stderr: 2023-11-05T08:06:40.393 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.379+0000 7f0517fff640 10 monclient: _finish_auth 0 2023-11-05T08:06:40.393 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.379+0000 7f0517fff640 10 monclient: _check_auth_tickets 2023-11-05T08:06:40.393 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.379+0000 7f0517fff640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:06:40.393 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.379+0000 7f0517fff640 1 -- 172.21.15.52:0/2301202556 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f051c031920 con 0x7f052013eea0 2023-11-05T08:06:40.394 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.379+0000 7f0527516640 5 monclient: authenticate success, global_id 4163 2023-11-05T08:06:40.394 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.379+0000 7f0527516640 20 monclient: get_monmap_and_config waiting for monmap|config 2023-11-05T08:06:40.394 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.379+0000 7f0517fff640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:06:40.394 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.379+0000 7f0527516640 10 monclient: get_monmap_and_config success 2023-11-05T08:06:40.394 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.379+0000 7f0527516640 4 set_mon_vals no callback set 2023-11-05T08:06:40.395 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.379+0000 7f0517fff640 1 -- 172.21.15.52:0/2301202556 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f051c031cb0 con 0x7f052013eea0 2023-11-05T08:06:40.395 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.379+0000 7f0517fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:06:40.395 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.379+0000 7f0517fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-11-05T08:06:40.395 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.379+0000 7f0517fff640 10 monclient: dump: 2023-11-05T08:06:40.395 INFO:teuthology.misc.health.smithi052.stderr:epoch 1 2023-11-05T08:06:40.395 INFO:teuthology.misc.health.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:06:40.396 INFO:teuthology.misc.health.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:40.396 INFO:teuthology.misc.health.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:40.396 INFO:teuthology.misc.health.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:06:40.396 INFO:teuthology.misc.health.smithi052.stderr:election_strategy: 1 2023-11-05T08:06:40.396 INFO:teuthology.misc.health.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:06:40.397 INFO:teuthology.misc.health.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:06:40.397 INFO:teuthology.misc.health.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:06:40.397 INFO:teuthology.misc.health.smithi052.stderr: 2023-11-05T08:06:40.397 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.380+0000 7f0527516640 10 monclient: shutdown 2023-11-05T08:06:40.397 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.380+0000 7f0527516640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:06:40.398 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.380+0000 7f0527516640 1 -- 172.21.15.52:0/2301202556 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f052013eea0 msgr2=0x7f05200aea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:06:40.398 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.380+0000 7f0527516640 1 --2- 172.21.15.52:0/2301202556 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f052013eea0 0x7f05200aea30 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f051c009870 tx=0x7f051c02b860 comp rx=0 tx=0).stop 2023-11-05T08:06:40.398 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.380+0000 7f0527516640 1 -- 172.21.15.52:0/2301202556 shutdown_connections 2023-11-05T08:06:40.398 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.380+0000 7f0527516640 1 --2- 172.21.15.52:0/2301202556 >> v2:172.21.15.156:3300/0 conn(0x7f052014a130 0x7f052014c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:40.398 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.380+0000 7f0527516640 1 --2- 172.21.15.52:0/2301202556 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f052013eea0 0x7f05200aea30 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:40.398 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.380+0000 7f0527516640 1 -- 172.21.15.52:0/2301202556 >> 172.21.15.52:0/2301202556 conn(0x7f05200716e0 msgr2=0x7f0520071af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:06:40.399 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.380+0000 7f0527516640 1 -- 172.21.15.52:0/2301202556 shutdown_connections 2023-11-05T08:06:40.399 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.380+0000 7f0527516640 1 -- 172.21.15.52:0/2301202556 wait complete. 2023-11-05T08:06:40.399 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.382+0000 7f0527516640 10 monclient: build_initial_monmap 2023-11-05T08:06:40.399 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.382+0000 7f0527516640 10 monclient: monmap: 2023-11-05T08:06:40.399 INFO:teuthology.misc.health.smithi052.stderr:epoch 0 2023-11-05T08:06:40.400 INFO:teuthology.misc.health.smithi052.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-05T08:06:40.400 INFO:teuthology.misc.health.smithi052.stderr:last_changed 0.000000 2023-11-05T08:06:40.400 INFO:teuthology.misc.health.smithi052.stderr:created 0.000000 2023-11-05T08:06:40.400 INFO:teuthology.misc.health.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:06:40.400 INFO:teuthology.misc.health.smithi052.stderr:election_strategy: 1 2023-11-05T08:06:40.400 INFO:teuthology.misc.health.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.noname-a 2023-11-05T08:06:40.401 INFO:teuthology.misc.health.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.noname-b 2023-11-05T08:06:40.401 INFO:teuthology.misc.health.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-c 2023-11-05T08:06:40.401 INFO:teuthology.misc.health.smithi052.stderr: 2023-11-05T08:06:40.401 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.382+0000 7f0527516640 1 librados: starting msgr at 2023-11-05T08:06:40.401 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.382+0000 7f0527516640 1 librados: starting objecter 2023-11-05T08:06:40.401 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.382+0000 7f0527516640 1 Processor -- start 2023-11-05T08:06:40.402 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.382+0000 7f0527516640 1 -- start start 2023-11-05T08:06:40.402 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.383+0000 7f0527516640 1 librados: setting wanted keys 2023-11-05T08:06:40.402 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.383+0000 7f0527516640 1 librados: calling monclient init 2023-11-05T08:06:40.402 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.383+0000 7f0527516640 10 monclient: init 2023-11-05T08:06:40.402 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.383+0000 7f0527516640 10 monclient: _reopen_session rank -1 2023-11-05T08:06:40.403 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.384+0000 7f0527516640 10 monclient: _add_conns ranks=[2,1,0] 2023-11-05T08:06:40.403 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.384+0000 7f0527516640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f05200b3e50 0x7f05201343c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:06:40.403 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.384+0000 7f0527516640 10 monclient(hunting): picked mon.noname-c con 0x7f05200b3e50 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:06:40.403 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.384+0000 7f0527516640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f052013eea0 0x7f05201412f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:06:40.403 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.384+0000 7f0527516640 10 monclient(hunting): picked mon.noname-b con 0x7f052013eea0 addr [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] 2023-11-05T08:06:40.404 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.384+0000 7f0527516640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f052014a130 0x7f0520141830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:06:40.404 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.384+0000 7f0527516640 10 monclient(hunting): picked mon.noname-a con 0x7f052014a130 addr [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] 2023-11-05T08:06:40.404 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.384+0000 7f05252b2640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f05200b3e50 0x7f05201343c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:06:40.404 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.384+0000 7f0527516640 10 monclient(hunting): start opening mon connection 2023-11-05T08:06:40.404 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.384+0000 7f0527516640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0520130c00 con 0x7f052014a130 2023-11-05T08:06:40.404 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.384+0000 7f0527516640 10 monclient(hunting): start opening mon connection 2023-11-05T08:06:40.405 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.384+0000 7f0527516640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f052012fe20 con 0x7f052013eea0 2023-11-05T08:06:40.405 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.384+0000 7f05252b2640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f05200b3e50 0x7f05201343c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.52:52718/0 (socket says 172.21.15.52:52718) 2023-11-05T08:06:40.405 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.384+0000 7f05252b2640 1 -- 172.21.15.52:0/1016139308 learned_addr learned my addr 172.21.15.52:0/1016139308 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-11-05T08:06:40.405 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.385+0000 7f0527516640 10 monclient(hunting): start opening mon connection 2023-11-05T08:06:40.405 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.385+0000 7f0525ab3640 1 --2- 172.21.15.52:0/1016139308 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f052014a130 0x7f0520141830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:06:40.406 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.385+0000 7f0524ab1640 1 --2- 172.21.15.52:0/1016139308 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f052013eea0 0x7f05201412f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:06:40.406 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.385+0000 7f0527516640 1 -- 172.21.15.52:0/1016139308 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0520140e60 con 0x7f05200b3e50 2023-11-05T08:06:40.406 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.385+0000 7f0527516640 10 monclient(hunting): _renew_subs 2023-11-05T08:06:40.406 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.385+0000 7f0527516640 10 monclient(hunting): authenticate will time out at 1346.590196s 2023-11-05T08:06:40.406 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.385+0000 7f05252b2640 10 monclient(hunting): get_auth_request con 0x7f05200b3e50 auth_method 0 2023-11-05T08:06:40.407 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.385+0000 7f05252b2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:06:40.407 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.385+0000 7f05252b2640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:06:40.407 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.385+0000 7f05252b2640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:06:40.407 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.385+0000 7f0524ab1640 10 monclient(hunting): get_auth_request con 0x7f052013eea0 auth_method 0 2023-11-05T08:06:40.407 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.385+0000 7f0524ab1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:06:40.407 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.385+0000 7f0524ab1640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:06:40.408 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.385+0000 7f0524ab1640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:06:40.408 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.385+0000 7f0525ab3640 10 monclient(hunting): get_auth_request con 0x7f052014a130 auth_method 0 2023-11-05T08:06:40.408 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.385+0000 7f0525ab3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:06:40.408 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.385+0000 7f0525ab3640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:06:40.408 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.385+0000 7f0525ab3640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:06:40.409 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.385+0000 7f05252b2640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:06:40.409 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.385+0000 7f05252b2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:06:40.409 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.385+0000 7f05252b2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:06:40.409 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.385+0000 7f0525ab3640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:06:40.409 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.385+0000 7f0525ab3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:06:40.409 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.386+0000 7f0525ab3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:06:40.410 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.386+0000 7f0524ab1640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:06:40.410 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.386+0000 7f0524ab1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:06:40.410 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.386+0000 7f0524ab1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:06:40.410 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.388+0000 7f05252b2640 10 monclient(hunting): handle_auth_done global_id 4166 payload 824 2023-11-05T08:06:40.410 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.388+0000 7f05252b2640 1 -- 172.21.15.52:0/1016139308 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f052013eea0 msgr2=0x7f05201412f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:06:40.411 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.388+0000 7f05252b2640 1 --2- 172.21.15.52:0/1016139308 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f052013eea0 0x7f05201412f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:40.411 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.388+0000 7f05252b2640 1 -- 172.21.15.52:0/1016139308 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f052014a130 msgr2=0x7f0520141830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:06:40.411 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.388+0000 7f05252b2640 1 --2- 172.21.15.52:0/1016139308 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f052014a130 0x7f0520141830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:40.411 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.388+0000 7f05252b2640 10 monclient: _finish_hunting 0 2023-11-05T08:06:40.411 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.388+0000 7f05252b2640 1 monclient: found mon.noname-c 2023-11-05T08:06:40.411 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.388+0000 7f05252b2640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:06:40.412 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.388+0000 7f05252b2640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.52:3301/0 2023-11-05T08:06:40.412 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.388+0000 7f05252b2640 1 -- 172.21.15.52:0/1016139308 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f051c0094d0 con 0x7f05200b3e50 2023-11-05T08:06:40.415 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.391+0000 7f05252b2640 1 --2- 172.21.15.52:0/1016139308 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f05200b3e50 0x7f05201343c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f051c02b8a0 tx=0x7f051c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:06:40.415 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.391+0000 7f0515ffb640 10 client.?.objecter ms_handle_connect 0x7f05200b3e50 2023-11-05T08:06:40.415 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.391+0000 7f0515ffb640 10 client.?.objecter resend_mon_ops 2023-11-05T08:06:40.415 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.395+0000 7f0515ffb640 1 -- 172.21.15.52:0/1016139308 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f051c032860 con 0x7f05200b3e50 2023-11-05T08:06:40.415 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.395+0000 7f0515ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:06:40.416 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.395+0000 7f0515ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-11-05T08:06:40.416 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.395+0000 7f0515ffb640 10 monclient: dump: 2023-11-05T08:06:40.416 INFO:teuthology.misc.health.smithi052.stderr:epoch 1 2023-11-05T08:06:40.416 INFO:teuthology.misc.health.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:06:40.416 INFO:teuthology.misc.health.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:40.417 INFO:teuthology.misc.health.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:40.417 INFO:teuthology.misc.health.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:06:40.417 INFO:teuthology.misc.health.smithi052.stderr:election_strategy: 1 2023-11-05T08:06:40.417 INFO:teuthology.misc.health.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:06:40.417 INFO:teuthology.misc.health.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:06:40.418 INFO:teuthology.misc.health.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:06:40.418 INFO:teuthology.misc.health.smithi052.stderr: 2023-11-05T08:06:40.418 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.395+0000 7f0515ffb640 10 monclient: _finish_auth 0 2023-11-05T08:06:40.418 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.395+0000 7f0515ffb640 10 monclient: _check_auth_tickets 2023-11-05T08:06:40.418 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.395+0000 7f0515ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:06:40.421 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.395+0000 7f0515ffb640 1 -- 172.21.15.52:0/1016139308 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f051c0329c0 con 0x7f05200b3e50 2023-11-05T08:06:40.421 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.395+0000 7f0515ffb640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:06:40.421 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.395+0000 7f0515ffb640 1 -- 172.21.15.52:0/1016139308 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f051c032d70 con 0x7f05200b3e50 2023-11-05T08:06:40.422 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.395+0000 7f0515ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:06:40.422 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.395+0000 7f0515ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-11-05T08:06:40.422 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.395+0000 7f0515ffb640 10 monclient: dump: 2023-11-05T08:06:40.422 INFO:teuthology.misc.health.smithi052.stderr:epoch 1 2023-11-05T08:06:40.422 INFO:teuthology.misc.health.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:06:40.422 INFO:teuthology.misc.health.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:40.423 INFO:teuthology.misc.health.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:40.423 INFO:teuthology.misc.health.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:06:40.423 INFO:teuthology.misc.health.smithi052.stderr:election_strategy: 1 2023-11-05T08:06:40.423 INFO:teuthology.misc.health.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:06:40.423 INFO:teuthology.misc.health.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:06:40.424 INFO:teuthology.misc.health.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:06:40.424 INFO:teuthology.misc.health.smithi052.stderr: 2023-11-05T08:06:40.424 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.395+0000 7f0527516640 5 monclient: authenticate success, global_id 4166 2023-11-05T08:06:40.424 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.395+0000 7f05177fe640 4 set_mon_vals no callback set 2023-11-05T08:06:40.424 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.395+0000 7f0527516640 10 monclient: _renew_subs 2023-11-05T08:06:40.424 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.395+0000 7f0527516640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.52:3301/0 2023-11-05T08:06:40.425 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.395+0000 7f0527516640 1 -- 172.21.15.52:0/1016139308 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0520130220 con 0x7f05200b3e50 2023-11-05T08:06:40.425 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.395+0000 7f0527516640 10 client.4166.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-05T08:06:40.425 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.395+0000 7f0527516640 10 monclient: _renew_subs 2023-11-05T08:06:40.425 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.395+0000 7f0527516640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.52:3301/0 2023-11-05T08:06:40.425 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.395+0000 7f0527516640 1 -- 172.21.15.52:0/1016139308 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0520071230 con 0x7f05200b3e50 2023-11-05T08:06:40.426 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.395+0000 7f0527516640 1 librados: init done 2023-11-05T08:06:40.426 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.396+0000 7f0527516640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-05T08:06:40.426 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.396+0000 7f0527516640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:06:40.426 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.396+0000 7f0527516640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.52:3301/0 2023-11-05T08:06:40.427 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.396+0000 7f0527516640 1 -- 172.21.15.52:0/1016139308 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05200b6230 con 0x7f05200b3e50 2023-11-05T08:06:40.428 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.417+0000 7f0515ffb640 1 -- 172.21.15.52:0/1016139308 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 4) v1 ==== 89173+0+0 (secure 0 0 0) 0x7f051c04e450 con 0x7f05200b3e50 2023-11-05T08:06:40.428 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.417+0000 7f0515ffb640 1 --2- 172.21.15.52:0/1016139308 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f050406c7f0 0x7f050406ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:06:40.428 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.417+0000 7f0524ab1640 1 --2- 172.21.15.52:0/1016139308 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f050406c7f0 0x7f050406ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:06:40.428 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.417+0000 7f0524ab1640 10 monclient: get_auth_request con 0x7f050406c7f0 auth_method 0 2023-11-05T08:06:40.428 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.418+0000 7f0524ab1640 1 --2- 172.21.15.52:0/1016139308 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f050406c7f0 0x7f050406ecb0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f0520134bc0 tx=0x7f0510009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:06:40.429 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.418+0000 7f0515ffb640 10 client.4166.objecter ms_handle_connect 0x7f050406c7f0 2023-11-05T08:06:40.441 INFO:tasks.ceph.osd.1.smithi052.stderr:==00:00:00:24.898 86234== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:40.446 INFO:tasks.ceph.osd.1.smithi052.stderr:==00:00:00:24.903 86234== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:40.477 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.476+0000 7f0515ffb640 1 -- 172.21.15.52:0/1016139308 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f051c07a820 con 0x7f05200b3e50 2023-11-05T08:06:40.477 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.476+0000 7f0515ffb640 10 client.4166.objecter ms_dispatch 0x7f0520000b90 osd_map(10..10 src has 1..10) v4 2023-11-05T08:06:40.477 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.476+0000 7f0515ffb640 3 client.4166.objecter handle_osd_map got epochs [10,10] > 0 2023-11-05T08:06:40.477 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.476+0000 7f0515ffb640 3 client.4166.objecter handle_osd_map decoding full epoch 10 2023-11-05T08:06:40.478 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.476+0000 7f0515ffb640 20 client.4166.objecter dump_active .. 0 homeless 2023-11-05T08:06:40.803 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.803+0000 7f0515ffb640 1 -- 172.21.15.52:0/1016139308 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f051c076b60 con 0x7f05200b3e50 2023-11-05T08:06:40.804 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.803+0000 7f0515ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:06:40.804 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:40.803+0000 7f0515ffb640 10 monclient: _finish_command 1 = system:0 2023-11-05T08:06:41.032 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:41.031+0000 7f0527516640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2023-11-05T08:06:41.032 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:41.031+0000 7f0527516640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2023-11-05T08:06:41.032 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:41.031+0000 7f0527516640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.52:3301/0 2023-11-05T08:06:41.032 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:41.031+0000 7f0527516640 1 -- 172.21.15.52:0/1016139308 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f05200b37a0 con 0x7f05200b3e50 2023-11-05T08:06:41.048 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:41.047+0000 7f0515ffb640 1 -- 172.21.15.52:0/1016139308 <== mon.2 v2:172.21.15.52:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f051c07a180 con 0x7f05200b3e50 2023-11-05T08:06:41.048 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:41.047+0000 7f0515ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2023-11-05T08:06:41.049 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:41.047+0000 7f0515ffb640 10 monclient: _finish_command 2 = system:0 2023-11-05T08:06:41.049 INFO:teuthology.misc.health.smithi052.stdout: 2023-11-05T08:06:41.049 INFO:teuthology.misc.health.smithi052.stdout:{"epoch":10,"fsid":"b7fdc914-b520-409f-b9d7-902b05a64252","created":"2023-11-05T08:06:09.361414+0000","modified":"2023-11-05T08:06:15.124773+0000","last_up_change":"0.000000","last_in_change":"2023-11-05T08:06:15.124773+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c95e48e9-832b-4950-b467-9f61d33decc6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"82d5dd13-f1f5-4282-8ec8-4d6c273a42c7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"2c5ea82d-5534-4437-a76f-e3769d798b17","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9ffcbf5b-1afd-4777-825f-c5fb551b9d88","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"3f5f9aa4-2015-4835-9b39-faf459a35a49","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"cf781fb3-83fb-40e0-86a3-f895d7824edb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d2787c11-d907-4924-b9cf-69db95ad35c2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"e9e51eb8-2a9d-4cd0-9158-a00eea2a5614","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-05T08:06:41.051 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:41.050+0000 7f0527516640 10 librados: watch_flush enter 2023-11-05T08:06:41.052 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:41.050+0000 7f0527516640 10 librados: watch_flush exit 2023-11-05T08:06:41.052 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:41.050+0000 7f0527516640 20 client.4166.objecter shutdown clearing up homeless session... 2023-11-05T08:06:41.052 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:41.050+0000 7f0527516640 10 client.4166.objecter successfully canceled tick 2023-11-05T08:06:41.052 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:41.050+0000 7f0527516640 1 -- 172.21.15.52:0/1016139308 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f050406c7f0 msgr2=0x7f050406ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:06:41.052 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:41.050+0000 7f0527516640 1 --2- 172.21.15.52:0/1016139308 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f050406c7f0 0x7f050406ecb0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f0520134bc0 tx=0x7f0510009040 comp rx=0 tx=0).stop 2023-11-05T08:06:41.053 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:41.050+0000 7f0527516640 10 monclient: shutdown 2023-11-05T08:06:41.053 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:41.050+0000 7f0527516640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:06:41.053 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:41.050+0000 7f0527516640 1 -- 172.21.15.52:0/1016139308 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f05200b3e50 msgr2=0x7f05201343c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:06:41.053 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:41.050+0000 7f0527516640 1 --2- 172.21.15.52:0/1016139308 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f05200b3e50 0x7f05201343c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f051c02b8a0 tx=0x7f051c0046c0 comp rx=0 tx=0).stop 2023-11-05T08:06:41.053 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:41.050+0000 7f0527516640 1 -- 172.21.15.52:0/1016139308 shutdown_connections 2023-11-05T08:06:41.054 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:41.050+0000 7f0527516640 1 --2- 172.21.15.52:0/1016139308 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f050406c7f0 0x7f050406ecb0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:41.054 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:41.050+0000 7f0527516640 1 --2- 172.21.15.52:0/1016139308 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f052014a130 0x7f0520141830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:41.054 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:41.050+0000 7f0527516640 1 --2- 172.21.15.52:0/1016139308 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f052013eea0 0x7f05201412f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:41.054 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:41.050+0000 7f0527516640 1 --2- 172.21.15.52:0/1016139308 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f05200b3e50 0x7f05201343c0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:41.054 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:41.050+0000 7f0527516640 1 -- 172.21.15.52:0/1016139308 >> 172.21.15.52:0/1016139308 conn(0x7f05200716e0 msgr2=0x7f05200ae340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:06:41.055 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:41.051+0000 7f0527516640 1 -- 172.21.15.52:0/1016139308 shutdown_connections 2023-11-05T08:06:41.055 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:41.051+0000 7f0527516640 1 -- 172.21.15.52:0/1016139308 wait complete. 2023-11-05T08:06:41.055 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:41.052+0000 7f0527516640 1 librados: shutdown 2023-11-05T08:06:41.063 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-11-05T08:06:42.725 INFO:tasks.ceph.osd.6.smithi156.stderr:==00:00:00:27.155 86245== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:43.003 INFO:tasks.ceph.osd.4.smithi156.stderr:==00:00:00:27.436 86243== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:43.003 INFO:tasks.ceph.osd.7.smithi156.stderr:==00:00:00:27.426 86246== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:43.033 INFO:tasks.ceph.osd.5.smithi156.stderr:==00:00:00:27.463 86244== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:43.798 INFO:tasks.ceph.osd.2.smithi052.stderr:==00:00:00:28.252 86235== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:44.504 INFO:tasks.ceph.osd.3.smithi052.stderr:==00:00:00:28.944 86237== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:44.632 INFO:tasks.ceph.osd.0.smithi052.stderr:==00:00:00:29.090 86232== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:44.917 INFO:tasks.ceph.osd.1.smithi052.stderr:==00:00:00:29.374 86234== Warning: unimplemented fcntl command: 1038 2023-11-05T08:06:47.869 DEBUG:teuthology.orchestra.run.smithi052:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-05T08:06:48.001 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.001+0000 7f4de5d33640 10 monclient: get_monmap_and_config 2023-11-05T08:06:48.001 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.001+0000 7f4de5d33640 10 monclient: build_initial_monmap 2023-11-05T08:06:48.002 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.001+0000 7f4de5d33640 10 monclient: monmap: 2023-11-05T08:06:48.002 INFO:teuthology.misc.health.smithi052.stderr:epoch 0 2023-11-05T08:06:48.002 INFO:teuthology.misc.health.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:06:48.002 INFO:teuthology.misc.health.smithi052.stderr:last_changed 2023-11-05T08:06:48.001624+0000 2023-11-05T08:06:48.003 INFO:teuthology.misc.health.smithi052.stderr:created 2023-11-05T08:06:48.001624+0000 2023-11-05T08:06:48.003 INFO:teuthology.misc.health.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:06:48.003 INFO:teuthology.misc.health.smithi052.stderr:election_strategy: 1 2023-11-05T08:06:48.003 INFO:teuthology.misc.health.smithi052.stderr:0: v1:172.21.15.52:6789/0 mon.noname-a-legacy 2023-11-05T08:06:48.003 INFO:teuthology.misc.health.smithi052.stderr:1: v1:172.21.15.156:6789/0 mon.noname-c-legacy 2023-11-05T08:06:48.004 INFO:teuthology.misc.health.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-b 2023-11-05T08:06:48.004 INFO:teuthology.misc.health.smithi052.stderr:3: v2:172.21.15.52:3300/0 mon.noname-a 2023-11-05T08:06:48.004 INFO:teuthology.misc.health.smithi052.stderr:4: v2:172.21.15.156:3300/0 mon.noname-c 2023-11-05T08:06:48.004 INFO:teuthology.misc.health.smithi052.stderr: 2023-11-05T08:06:48.006 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.002+0000 7f4de5d33640 1 Processor -- start 2023-11-05T08:06:48.007 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.002+0000 7f4de5d33640 1 -- start start 2023-11-05T08:06:48.007 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.002+0000 7f4de5d33640 10 monclient: init 2023-11-05T08:06:48.007 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.003+0000 7f4de5d33640 10 monclient: _reopen_session rank -1 2023-11-05T08:06:48.007 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.003+0000 7f4de5d33640 10 monclient: _add_conns ranks=[0,4,2,3,1] 2023-11-05T08:06:48.007 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.003+0000 7f4de5d33640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f4de00b4230 addr v1:172.21.15.52:6789/0 2023-11-05T08:06:48.008 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.003+0000 7f4de5d33640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f4de013f160 0x7f4de0141770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:06:48.008 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.003+0000 7f4de5d33640 10 monclient(hunting): picked mon.noname-c con 0x7f4de013f160 addr v2:172.21.15.156:3300/0 2023-11-05T08:06:48.008 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.003+0000 7f4de5d33640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4de00b1390 0x7f4de0141cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:06:48.008 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.003+0000 7f4de5d33640 10 monclient(hunting): picked mon.noname-b con 0x7f4de00b1390 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:06:48.008 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.003+0000 7f4de5d33640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4de00a9370 con 0x7f4de00b4230 2023-11-05T08:06:48.009 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.003+0000 7f4de5d33640 10 monclient(hunting): start opening mon connection 2023-11-05T08:06:48.009 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.003+0000 7f4de5d33640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4de00b4610 con 0x7f4de013f160 2023-11-05T08:06:48.009 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.004+0000 7f4de5d33640 10 monclient(hunting): start opening mon connection 2023-11-05T08:06:48.009 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.004+0000 7f4de5d33640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4de00a9010 con 0x7f4de00b1390 2023-11-05T08:06:48.009 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.004+0000 7f4de5d33640 10 monclient(hunting): _renew_subs 2023-11-05T08:06:48.010 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.004+0000 7f4de5d33640 10 monclient(hunting): authenticate will time out at 1354.209131s 2023-11-05T08:06:48.010 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.004+0000 7f4ddf7fe640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f4de00b4230 0x7f4de013ea50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:32940/0 (socket says 172.21.15.52:32940) 2023-11-05T08:06:48.010 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.004+0000 7f4ddf7fe640 1 -- 172.21.15.52:0/3391616200 learned_addr learned my addr 172.21.15.52:0/3391616200 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-11-05T08:06:48.011 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.011+0000 7f4dde7fc640 1 -- 172.21.15.52:0/3391616200 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1875006468 0 0) 0x7f4de00a9370 con 0x7f4de00b4230 2023-11-05T08:06:48.012 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.011+0000 7f4dde7fc640 10 monclient(hunting): _negotiate 2023-11-05T08:06:48.012 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.011+0000 7f4dde7fc640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:06:48.012 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.011+0000 7f4dde7fc640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:06:48.012 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.011+0000 7f4dde7fc640 10 monclient(hunting): my global_id is 4209 2023-11-05T08:06:48.012 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.011+0000 7f4dde7fc640 1 -- 172.21.15.52:0/3391616200 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4dc8003520 con 0x7f4de00b4230 2023-11-05T08:06:48.021 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.016+0000 7f4dde7fc640 1 -- 172.21.15.52:0/3391616200 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1377253514 0 0) 0x7f4dc8003520 con 0x7f4de00b4230 2023-11-05T08:06:48.021 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.016+0000 7f4dde7fc640 1 -- 172.21.15.52:0/3391616200 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4de00b1390 msgr2=0x7f4de0141cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-05T08:06:48.021 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.016+0000 7f4dde7fc640 1 --2- 172.21.15.52:0/3391616200 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4de00b1390 0x7f4de0141cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:48.021 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.016+0000 7f4dde7fc640 1 -- 172.21.15.52:0/3391616200 >> v2:172.21.15.156:3300/0 conn(0x7f4de013f160 msgr2=0x7f4de0141770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-05T08:06:48.022 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.016+0000 7f4dde7fc640 1 --2- 172.21.15.52:0/3391616200 >> v2:172.21.15.156:3300/0 conn(0x7f4de013f160 0x7f4de0141770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:48.022 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.016+0000 7f4dde7fc640 10 monclient: _finish_hunting 0 2023-11-05T08:06:48.022 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.016+0000 7f4dde7fc640 1 monclient: found mon.noname-a-legacy 2023-11-05T08:06:48.022 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.016+0000 7f4dde7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:06:48.022 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.016+0000 7f4dde7fc640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:172.21.15.52:6789/0 2023-11-05T08:06:48.023 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.016+0000 7f4dde7fc640 1 -- 172.21.15.52:0/3391616200 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4de00aa4b0 con 0x7f4de00b4230 2023-11-05T08:06:48.023 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.016+0000 7f4dde7fc640 10 monclient: _finish_auth 0 2023-11-05T08:06:48.023 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.016+0000 7f4dde7fc640 10 monclient: _check_auth_tickets 2023-11-05T08:06:48.023 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.016+0000 7f4dde7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:06:48.023 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.017+0000 7f4dde7fc640 1 -- 172.21.15.52:0/3391616200 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2979872170 0 0) 0x7f4dd0001670 con 0x7f4de00b4230 2023-11-05T08:06:48.024 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.017+0000 7f4dde7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:06:48.024 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.017+0000 7f4dde7fc640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2023-11-05T08:06:48.024 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.017+0000 7f4dde7fc640 10 monclient: dump: 2023-11-05T08:06:48.024 INFO:teuthology.misc.health.smithi052.stderr:epoch 1 2023-11-05T08:06:48.024 INFO:teuthology.misc.health.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:06:48.025 INFO:teuthology.misc.health.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:48.025 INFO:teuthology.misc.health.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:48.025 INFO:teuthology.misc.health.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:06:48.025 INFO:teuthology.misc.health.smithi052.stderr:election_strategy: 1 2023-11-05T08:06:48.025 INFO:teuthology.misc.health.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:06:48.026 INFO:teuthology.misc.health.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:06:48.026 INFO:teuthology.misc.health.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:06:48.026 INFO:teuthology.misc.health.smithi052.stderr: 2023-11-05T08:06:48.026 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.017+0000 7f4dde7fc640 1 monclient: mon.a has (v2) addrs [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] but i'm connected to v1:172.21.15.52:6789/0, reconnecting 2023-11-05T08:06:48.026 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.017+0000 7f4dde7fc640 10 monclient: _reopen_session rank -1 2023-11-05T08:06:48.026 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.017+0000 7f4dde7fc640 1 -- 172.21.15.52:0/3391616200 >> v1:172.21.15.52:6789/0 conn(0x7f4de00b4230 legacy=0x7f4de013ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:06:48.027 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.017+0000 7f4dde7fc640 10 monclient: _add_conns ranks=[2,1,0] 2023-11-05T08:06:48.027 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.017+0000 7f4dde7fc640 1 --2- 172.21.15.52:0/3391616200 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4dc8003970 0x7f4dc8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:06:48.027 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.017+0000 7f4dde7fc640 10 monclient(hunting): picked mon.c con 0x7f4dc8003970 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:06:48.027 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.017+0000 7f4dde7fc640 1 --2- 172.21.15.52:0/3391616200 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4dc80047c0 0x7f4dc8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:06:48.027 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.017+0000 7f4dde7fc640 10 monclient(hunting): picked mon.b con 0x7f4dc80047c0 addr [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] 2023-11-05T08:06:48.028 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.017+0000 7f4dde7fc640 1 --2- 172.21.15.52:0/3391616200 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4dc8005380 0x7f4dc8014190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:06:48.028 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.017+0000 7f4dde7fc640 10 monclient(hunting): picked mon.a con 0x7f4dc8005380 addr [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] 2023-11-05T08:06:48.028 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.017+0000 7f4dde7fc640 10 monclient(hunting): start opening mon connection 2023-11-05T08:06:48.028 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.017+0000 7f4dde7fc640 1 -- 172.21.15.52:0/3391616200 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4de00b4610 con 0x7f4dc8005380 2023-11-05T08:06:48.028 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.017+0000 7f4dde7fc640 10 monclient(hunting): start opening mon connection 2023-11-05T08:06:48.029 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.017+0000 7f4dde7fc640 1 -- 172.21.15.52:0/3391616200 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4de00a9010 con 0x7f4dc80047c0 2023-11-05T08:06:48.029 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.017+0000 7f4dde7fc640 10 monclient(hunting): start opening mon connection 2023-11-05T08:06:48.029 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.017+0000 7f4dde7fc640 1 -- 172.21.15.52:0/3391616200 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc8014a80 con 0x7f4dc8003970 2023-11-05T08:06:48.029 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.017+0000 7f4dde7fc640 10 monclient(hunting): _renew_subs 2023-11-05T08:06:48.029 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.017+0000 7f4dde7fc640 10 monclient(hunting): _finish_auth 0 2023-11-05T08:06:48.030 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.019+0000 7f4ddffff640 1 --2- 172.21.15.52:0/3391616200 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4dc8005380 0x7f4dc8014190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:06:48.030 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.019+0000 7f4ddffff640 10 monclient(hunting): get_auth_request con 0x7f4dc8005380 auth_method 0 2023-11-05T08:06:48.030 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.019+0000 7f4ddffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:06:48.030 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.019+0000 7f4ddffff640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:06:48.030 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.019+0000 7f4ddffff640 10 monclient(hunting): _init_auth already have auth, reseting 2023-11-05T08:06:48.031 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.019+0000 7f4ddffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:06:48.031 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.019+0000 7f4ddffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:06:48.031 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.020+0000 7f4ddffff640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2023-11-05T08:06:48.031 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.022+0000 7f4ddffff640 10 monclient(hunting): handle_auth_done global_id 4209 payload 293 2023-11-05T08:06:48.032 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.022+0000 7f4ddffff640 1 -- 172.21.15.52:0/3391616200 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4dc8003970 msgr2=0x7f4dc8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-05T08:06:48.032 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.022+0000 7f4ddffff640 1 --2- 172.21.15.52:0/3391616200 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4dc8003970 0x7f4dc8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:48.032 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.022+0000 7f4ddffff640 1 -- 172.21.15.52:0/3391616200 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4dc80047c0 msgr2=0x7f4dc8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-05T08:06:48.032 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.022+0000 7f4ddffff640 1 --2- 172.21.15.52:0/3391616200 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4dc80047c0 0x7f4dc8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:48.033 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.022+0000 7f4ddffff640 10 monclient: _finish_hunting 0 2023-11-05T08:06:48.033 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.022+0000 7f4ddffff640 1 monclient: found mon.a 2023-11-05T08:06:48.033 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.022+0000 7f4ddffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:06:48.033 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.022+0000 7f4ddffff640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.52:3300/0 2023-11-05T08:06:48.033 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.022+0000 7f4ddffff640 1 -- 172.21.15.52:0/3391616200 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dc8003520 con 0x7f4dc8005380 2023-11-05T08:06:48.033 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.022+0000 7f4ddffff640 10 monclient: _finish_auth 0 2023-11-05T08:06:48.034 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.022+0000 7f4ddffff640 10 monclient: _check_auth_tickets 2023-11-05T08:06:48.034 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.022+0000 7f4ddffff640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:06:48.034 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.022+0000 7f4de5d33640 5 monclient: authenticate success, global_id 4209 2023-11-05T08:06:48.034 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.022+0000 7f4de5d33640 20 monclient: get_monmap_and_config waiting for monmap|config 2023-11-05T08:06:48.034 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.028+0000 7f4ddffff640 1 --2- 172.21.15.52:0/3391616200 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4dc8005380 0x7f4dc8014190 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f4de00b1770 tx=0x7f4dc80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e7e85230eb614e2 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:06:48.035 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.034+0000 7f4dde7fc640 1 -- 172.21.15.52:0/3391616200 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd802cd10 con 0x7f4dc8005380 2023-11-05T08:06:48.036 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.034+0000 7f4dde7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:06:48.036 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.034+0000 7f4dde7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-11-05T08:06:48.036 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.034+0000 7f4dde7fc640 10 monclient: dump: 2023-11-05T08:06:48.036 INFO:teuthology.misc.health.smithi052.stderr:epoch 1 2023-11-05T08:06:48.036 INFO:teuthology.misc.health.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:06:48.037 INFO:teuthology.misc.health.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:48.037 INFO:teuthology.misc.health.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:48.037 INFO:teuthology.misc.health.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:06:48.037 INFO:teuthology.misc.health.smithi052.stderr:election_strategy: 1 2023-11-05T08:06:48.037 INFO:teuthology.misc.health.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:06:48.038 INFO:teuthology.misc.health.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:06:48.038 INFO:teuthology.misc.health.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:06:48.038 INFO:teuthology.misc.health.smithi052.stderr: 2023-11-05T08:06:48.038 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.034+0000 7f4dde7fc640 1 -- 172.21.15.52:0/3391616200 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dd802ce90 con 0x7f4dc8005380 2023-11-05T08:06:48.038 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.034+0000 7f4dde7fc640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:06:48.039 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.034+0000 7f4dde7fc640 1 -- 172.21.15.52:0/3391616200 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd8034680 con 0x7f4dc8005380 2023-11-05T08:06:48.039 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.034+0000 7f4dde7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:06:48.039 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.034+0000 7f4dde7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-11-05T08:06:48.039 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.034+0000 7f4dde7fc640 10 monclient: dump: 2023-11-05T08:06:48.039 INFO:teuthology.misc.health.smithi052.stderr:epoch 1 2023-11-05T08:06:48.040 INFO:teuthology.misc.health.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:06:48.040 INFO:teuthology.misc.health.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:48.040 INFO:teuthology.misc.health.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:48.040 INFO:teuthology.misc.health.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:06:48.040 INFO:teuthology.misc.health.smithi052.stderr:election_strategy: 1 2023-11-05T08:06:48.040 INFO:teuthology.misc.health.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:06:48.041 INFO:teuthology.misc.health.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:06:48.041 INFO:teuthology.misc.health.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:06:48.041 INFO:teuthology.misc.health.smithi052.stderr: 2023-11-05T08:06:48.041 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.034+0000 7f4de5d33640 10 monclient: get_monmap_and_config success 2023-11-05T08:06:48.041 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.034+0000 7f4de5d33640 4 set_mon_vals no callback set 2023-11-05T08:06:48.042 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.035+0000 7f4de5d33640 10 monclient: shutdown 2023-11-05T08:06:48.042 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.035+0000 7f4de5d33640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:06:48.042 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.035+0000 7f4de5d33640 1 -- 172.21.15.52:0/3391616200 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4dc8005380 msgr2=0x7f4dc8014190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:06:48.042 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.035+0000 7f4de5d33640 1 --2- 172.21.15.52:0/3391616200 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4dc8005380 0x7f4dc8014190 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f4de00b1770 tx=0x7f4dc80057f0 comp rx=0 tx=0).stop 2023-11-05T08:06:48.042 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.035+0000 7f4ddffff640 1 -- 172.21.15.52:0/3391616200 reap_dead start 2023-11-05T08:06:48.046 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.037+0000 7f4de5d33640 1 -- 172.21.15.52:0/3391616200 shutdown_connections 2023-11-05T08:06:48.046 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.037+0000 7f4de5d33640 1 -- 172.21.15.52:0/3391616200 >> 172.21.15.52:0/3391616200 conn(0x7f4de0071920 msgr2=0x7f4de0071d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:06:48.047 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.037+0000 7f4de5d33640 1 -- 172.21.15.52:0/3391616200 shutdown_connections 2023-11-05T08:06:48.047 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.037+0000 7f4de5d33640 1 -- 172.21.15.52:0/3391616200 wait complete. 2023-11-05T08:06:48.047 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.038+0000 7f4de5d33640 10 monclient: build_initial_monmap 2023-11-05T08:06:48.047 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.038+0000 7f4de5d33640 10 monclient: monmap: 2023-11-05T08:06:48.047 INFO:teuthology.misc.health.smithi052.stderr:epoch 0 2023-11-05T08:06:48.048 INFO:teuthology.misc.health.smithi052.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-05T08:06:48.048 INFO:teuthology.misc.health.smithi052.stderr:last_changed 0.000000 2023-11-05T08:06:48.048 INFO:teuthology.misc.health.smithi052.stderr:created 0.000000 2023-11-05T08:06:48.048 INFO:teuthology.misc.health.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:06:48.048 INFO:teuthology.misc.health.smithi052.stderr:election_strategy: 1 2023-11-05T08:06:48.048 INFO:teuthology.misc.health.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.noname-a 2023-11-05T08:06:48.049 INFO:teuthology.misc.health.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.noname-b 2023-11-05T08:06:48.049 INFO:teuthology.misc.health.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-c 2023-11-05T08:06:48.049 INFO:teuthology.misc.health.smithi052.stderr: 2023-11-05T08:06:48.049 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.039+0000 7f4de5d33640 1 librados: starting msgr at 2023-11-05T08:06:48.049 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.039+0000 7f4de5d33640 1 librados: starting objecter 2023-11-05T08:06:48.050 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.039+0000 7f4de5d33640 1 Processor -- start 2023-11-05T08:06:48.050 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.039+0000 7f4de5d33640 1 -- start start 2023-11-05T08:06:48.050 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.039+0000 7f4de5d33640 1 librados: setting wanted keys 2023-11-05T08:06:48.050 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.040+0000 7f4de5d33640 1 librados: calling monclient init 2023-11-05T08:06:48.050 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.040+0000 7f4de5d33640 10 monclient: init 2023-11-05T08:06:48.051 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.041+0000 7f4de5d33640 10 monclient: _reopen_session rank -1 2023-11-05T08:06:48.051 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.041+0000 7f4de5d33640 10 monclient: _add_conns ranks=[2,0,1] 2023-11-05T08:06:48.051 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.041+0000 7f4de5d33640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4dc8005380 0x7f4de00b02f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:06:48.051 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.041+0000 7f4de5d33640 10 monclient(hunting): picked mon.noname-c con 0x7f4dc8005380 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:06:48.051 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.041+0000 7f4de5d33640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4de01d1f50 0x7f4de006fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:06:48.052 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.041+0000 7f4de5d33640 10 monclient(hunting): picked mon.noname-a con 0x7f4de01d1f50 addr [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] 2023-11-05T08:06:48.052 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.041+0000 7f4de5d33640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4de01d23d0 0x7f4de00700e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:06:48.052 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.041+0000 7f4de5d33640 10 monclient(hunting): picked mon.noname-b con 0x7f4de01d23d0 addr [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] 2023-11-05T08:06:48.052 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.041+0000 7f4de5d33640 10 monclient(hunting): start opening mon connection 2023-11-05T08:06:48.052 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.041+0000 7f4de5d33640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4de01d2920 con 0x7f4de01d1f50 2023-11-05T08:06:48.053 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.042+0000 7f4de5d33640 10 monclient(hunting): start opening mon connection 2023-11-05T08:06:48.053 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.042+0000 7f4de5d33640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4de006ef60 con 0x7f4de01d23d0 2023-11-05T08:06:48.053 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.042+0000 7f4de5d33640 10 monclient(hunting): start opening mon connection 2023-11-05T08:06:48.053 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.042+0000 7f4de5d33640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4de006f0a0 con 0x7f4dc8005380 2023-11-05T08:06:48.053 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.042+0000 7f4de5d33640 10 monclient(hunting): _renew_subs 2023-11-05T08:06:48.053 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.042+0000 7f4de5d33640 10 monclient(hunting): authenticate will time out at 1354.247223s 2023-11-05T08:06:48.054 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.042+0000 7f4ddeffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4de01d1f50 0x7f4de006fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:06:48.054 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.042+0000 7f4ddeffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4de01d1f50 0x7f4de006fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40104/0 (socket says 172.21.15.52:40104) 2023-11-05T08:06:48.054 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.042+0000 7f4ddeffd640 1 -- 172.21.15.52:0/4261508961 learned_addr learned my addr 172.21.15.52:0/4261508961 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-11-05T08:06:48.054 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.042+0000 7f4ddeffd640 10 monclient(hunting): get_auth_request con 0x7f4de01d1f50 auth_method 0 2023-11-05T08:06:48.054 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.042+0000 7f4ddeffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:06:48.055 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.042+0000 7f4ddeffd640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:06:48.055 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.042+0000 7f4ddeffd640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:06:48.055 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.043+0000 7f4ddeffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:06:48.055 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.043+0000 7f4ddeffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:06:48.055 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.043+0000 7f4ddeffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:06:48.058 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.047+0000 7f4ddeffd640 10 monclient(hunting): handle_auth_done global_id 4212 payload 824 2023-11-05T08:06:48.058 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.047+0000 7f4ddeffd640 1 -- 172.21.15.52:0/4261508961 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4dc8005380 msgr2=0x7f4de00b02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:06:48.059 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.047+0000 7f4ddeffd640 1 --2- 172.21.15.52:0/4261508961 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4dc8005380 0x7f4de00b02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:48.059 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.047+0000 7f4ddeffd640 1 -- 172.21.15.52:0/4261508961 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4de01d23d0 msgr2=0x7f4de00700e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:06:48.059 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.047+0000 7f4ddeffd640 1 --2- 172.21.15.52:0/4261508961 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4de01d23d0 0x7f4de00700e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:48.059 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.047+0000 7f4ddeffd640 10 monclient: _finish_hunting 0 2023-11-05T08:06:48.059 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.047+0000 7f4ddeffd640 1 monclient: found mon.noname-a 2023-11-05T08:06:48.060 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.047+0000 7f4ddeffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:06:48.060 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.047+0000 7f4ddeffd640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.52:3300/0 2023-11-05T08:06:48.060 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.047+0000 7f4ddeffd640 1 -- 172.21.15.52:0/4261508961 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4de0070620 con 0x7f4de01d1f50 2023-11-05T08:06:48.060 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.051+0000 7f4ddeffd640 1 --2- 172.21.15.52:0/4261508961 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4de01d1f50 0x7f4de006fba0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f4dd400b3f0 tx=0x7f4dd400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:06:48.060 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.051+0000 7f4dc7fff640 10 client.?.objecter ms_handle_connect 0x7f4de01d1f50 2023-11-05T08:06:48.061 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.051+0000 7f4dc7fff640 10 client.?.objecter resend_mon_ops 2023-11-05T08:06:48.061 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.057+0000 7f4dc7fff640 1 -- 172.21.15.52:0/4261508961 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd4011830 con 0x7f4de01d1f50 2023-11-05T08:06:48.061 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.057+0000 7f4dc7fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:06:48.061 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.057+0000 7f4dc7fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-11-05T08:06:48.061 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.057+0000 7f4dc7fff640 10 monclient: dump: 2023-11-05T08:06:48.062 INFO:teuthology.misc.health.smithi052.stderr:epoch 1 2023-11-05T08:06:48.062 INFO:teuthology.misc.health.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:06:48.062 INFO:teuthology.misc.health.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:48.062 INFO:teuthology.misc.health.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:48.062 INFO:teuthology.misc.health.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:06:48.063 INFO:teuthology.misc.health.smithi052.stderr:election_strategy: 1 2023-11-05T08:06:48.063 INFO:teuthology.misc.health.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:06:48.063 INFO:teuthology.misc.health.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:06:48.063 INFO:teuthology.misc.health.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:06:48.063 INFO:teuthology.misc.health.smithi052.stderr: 2023-11-05T08:06:48.063 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.057+0000 7f4dc7fff640 10 monclient: _finish_auth 0 2023-11-05T08:06:48.064 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.057+0000 7f4dc7fff640 10 monclient: _check_auth_tickets 2023-11-05T08:06:48.064 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.057+0000 7f4dc7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:06:48.064 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.057+0000 7f4dc7fff640 1 -- 172.21.15.52:0/4261508961 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dd4011990 con 0x7f4de01d1f50 2023-11-05T08:06:48.064 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.057+0000 7f4dc7fff640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:06:48.064 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.057+0000 7f4dc7fff640 1 -- 172.21.15.52:0/4261508961 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd4011d40 con 0x7f4de01d1f50 2023-11-05T08:06:48.065 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.057+0000 7f4dc7fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:06:48.065 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.057+0000 7f4dc7fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-11-05T08:06:48.065 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.057+0000 7f4dc7fff640 10 monclient: dump: 2023-11-05T08:06:48.065 INFO:teuthology.misc.health.smithi052.stderr:epoch 1 2023-11-05T08:06:48.065 INFO:teuthology.misc.health.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:06:48.066 INFO:teuthology.misc.health.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:48.066 INFO:teuthology.misc.health.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:48.066 INFO:teuthology.misc.health.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:06:48.066 INFO:teuthology.misc.health.smithi052.stderr:election_strategy: 1 2023-11-05T08:06:48.066 INFO:teuthology.misc.health.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:06:48.067 INFO:teuthology.misc.health.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:06:48.067 INFO:teuthology.misc.health.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:06:48.067 INFO:teuthology.misc.health.smithi052.stderr: 2023-11-05T08:06:48.067 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.057+0000 7f4de5d33640 5 monclient: authenticate success, global_id 4212 2023-11-05T08:06:48.067 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.057+0000 7f4de5d33640 10 monclient: _renew_subs 2023-11-05T08:06:48.067 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.057+0000 7f4de5d33640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.52:3300/0 2023-11-05T08:06:48.068 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.057+0000 7f4de5d33640 1 -- 172.21.15.52:0/4261508961 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4de0070870 con 0x7f4de01d1f50 2023-11-05T08:06:48.068 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.057+0000 7f4de5d33640 10 client.4212.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-05T08:06:48.068 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.057+0000 7f4de5d33640 10 monclient: _renew_subs 2023-11-05T08:06:48.068 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.057+0000 7f4de5d33640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.52:3300/0 2023-11-05T08:06:48.068 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.057+0000 7f4de5d33640 1 -- 172.21.15.52:0/4261508961 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4de01d53c0 con 0x7f4de01d1f50 2023-11-05T08:06:48.069 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.057+0000 7f4dddffb640 4 set_mon_vals no callback set 2023-11-05T08:06:48.069 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.057+0000 7f4de5d33640 1 librados: init done 2023-11-05T08:06:48.070 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.059+0000 7f4de5d33640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-05T08:06:48.070 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.059+0000 7f4de5d33640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:06:48.070 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.059+0000 7f4de5d33640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.52:3300/0 2023-11-05T08:06:48.070 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.059+0000 7f4de5d33640 1 -- 172.21.15.52:0/4261508961 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4de01d2a60 con 0x7f4de01d1f50 2023-11-05T08:06:48.081 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.080+0000 7f4dc7fff640 1 -- 172.21.15.52:0/4261508961 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 89173+0+0 (secure 0 0 0) 0x7f4dd401a400 con 0x7f4de01d1f50 2023-11-05T08:06:48.081 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.081+0000 7f4dc7fff640 1 --2- 172.21.15.52:0/4261508961 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f4dcc06c7c0 0x7f4dcc06ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:06:48.082 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.081+0000 7f4ddf7fe640 1 --2- 172.21.15.52:0/4261508961 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f4dcc06c7c0 0x7f4dcc06ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:06:48.082 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.081+0000 7f4ddf7fe640 10 monclient: get_auth_request con 0x7f4dcc06c7c0 auth_method 0 2023-11-05T08:06:48.082 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.082+0000 7f4dc7fff640 10 client.4212.objecter ms_handle_connect 0x7f4dcc06c7c0 2023-11-05T08:06:48.083 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.082+0000 7f4ddf7fe640 1 --2- 172.21.15.52:0/4261508961 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f4dcc06c7c0 0x7f4dcc06ec80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f4dd0001eb0 tx=0x7f4dd00015c0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:06:48.405 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.405+0000 7f4dc7fff640 1 -- 172.21.15.52:0/4261508961 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f4dd40589e0 con 0x7f4de01d1f50 2023-11-05T08:06:48.406 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.405+0000 7f4dc7fff640 10 client.4212.objecter ms_dispatch 0x7f4de0000b90 osd_map(10..10 src has 1..10) v4 2023-11-05T08:06:48.406 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.405+0000 7f4dc7fff640 3 client.4212.objecter handle_osd_map got epochs [10,10] > 0 2023-11-05T08:06:48.406 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.405+0000 7f4dc7fff640 3 client.4212.objecter handle_osd_map decoding full epoch 10 2023-11-05T08:06:48.406 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.405+0000 7f4dc7fff640 20 client.4212.objecter dump_active .. 0 homeless 2023-11-05T08:06:48.420 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.420+0000 7f4dc7fff640 1 -- 172.21.15.52:0/4261508961 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4dd4054d20 con 0x7f4de01d1f50 2023-11-05T08:06:48.421 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.420+0000 7f4dc7fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:06:48.421 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.420+0000 7f4dc7fff640 10 monclient: _finish_command 1 = system:0 2023-11-05T08:06:48.643 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.642+0000 7f4de5d33640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2023-11-05T08:06:48.643 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.642+0000 7f4de5d33640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2023-11-05T08:06:48.643 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.642+0000 7f4de5d33640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.52:3300/0 2023-11-05T08:06:48.644 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.642+0000 7f4de5d33640 1 -- 172.21.15.52:0/4261508961 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4de00707b0 con 0x7f4de01d1f50 2023-11-05T08:06:48.658 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.657+0000 7f4dc7fff640 1 -- 172.21.15.52:0/4261508961 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f4dd4015020 con 0x7f4de01d1f50 2023-11-05T08:06:48.659 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.657+0000 7f4dc7fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2023-11-05T08:06:48.659 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.657+0000 7f4dc7fff640 10 monclient: _finish_command 2 = system:0 2023-11-05T08:06:48.659 INFO:teuthology.misc.health.smithi052.stdout: 2023-11-05T08:06:48.660 INFO:teuthology.misc.health.smithi052.stdout:{"epoch":10,"fsid":"b7fdc914-b520-409f-b9d7-902b05a64252","created":"2023-11-05T08:06:09.361414+0000","modified":"2023-11-05T08:06:15.124773+0000","last_up_change":"0.000000","last_in_change":"2023-11-05T08:06:15.124773+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c95e48e9-832b-4950-b467-9f61d33decc6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"82d5dd13-f1f5-4282-8ec8-4d6c273a42c7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"2c5ea82d-5534-4437-a76f-e3769d798b17","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9ffcbf5b-1afd-4777-825f-c5fb551b9d88","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"3f5f9aa4-2015-4835-9b39-faf459a35a49","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"cf781fb3-83fb-40e0-86a3-f895d7824edb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d2787c11-d907-4924-b9cf-69db95ad35c2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"e9e51eb8-2a9d-4cd0-9158-a00eea2a5614","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-05T08:06:48.662 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.659+0000 7f4de5d33640 10 librados: watch_flush enter 2023-11-05T08:06:48.662 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.659+0000 7f4de5d33640 10 librados: watch_flush exit 2023-11-05T08:06:48.662 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.659+0000 7f4de5d33640 20 client.4212.objecter shutdown clearing up homeless session... 2023-11-05T08:06:48.662 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.659+0000 7f4de5d33640 10 client.4212.objecter successfully canceled tick 2023-11-05T08:06:48.663 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.660+0000 7f4de5d33640 1 -- 172.21.15.52:0/4261508961 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f4dcc06c7c0 msgr2=0x7f4dcc06ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:06:48.663 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.660+0000 7f4de5d33640 1 --2- 172.21.15.52:0/4261508961 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f4dcc06c7c0 0x7f4dcc06ec80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f4dd0001eb0 tx=0x7f4dd00015c0 comp rx=0 tx=0).stop 2023-11-05T08:06:48.663 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.660+0000 7f4de5d33640 10 monclient: shutdown 2023-11-05T08:06:48.663 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.660+0000 7f4de5d33640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:06:48.663 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.660+0000 7f4de5d33640 1 -- 172.21.15.52:0/4261508961 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4de01d1f50 msgr2=0x7f4de006fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:06:48.664 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.660+0000 7f4de5d33640 1 --2- 172.21.15.52:0/4261508961 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4de01d1f50 0x7f4de006fba0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f4dd400b3f0 tx=0x7f4dd400b8b0 comp rx=0 tx=0).stop 2023-11-05T08:06:48.664 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.660+0000 7f4de5d33640 1 -- 172.21.15.52:0/4261508961 shutdown_connections 2023-11-05T08:06:48.664 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.660+0000 7f4de5d33640 1 --2- 172.21.15.52:0/4261508961 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f4dcc06c7c0 0x7f4dcc06ec80 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:48.664 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.660+0000 7f4de5d33640 1 --2- 172.21.15.52:0/4261508961 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4de01d23d0 0x7f4de00700e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:48.665 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.660+0000 7f4de5d33640 1 --2- 172.21.15.52:0/4261508961 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4de01d1f50 0x7f4de006fba0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:48.665 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.660+0000 7f4de5d33640 1 --2- 172.21.15.52:0/4261508961 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4dc8005380 0x7f4de00b02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:48.665 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.660+0000 7f4de5d33640 1 -- 172.21.15.52:0/4261508961 >> 172.21.15.52:0/4261508961 conn(0x7f4de0071920 msgr2=0x7f4de0141430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:06:48.665 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.660+0000 7f4de5d33640 1 -- 172.21.15.52:0/4261508961 shutdown_connections 2023-11-05T08:06:48.665 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.660+0000 7f4de5d33640 1 -- 172.21.15.52:0/4261508961 wait complete. 2023-11-05T08:06:48.666 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:48.660+0000 7f4de5d33640 1 librados: shutdown 2023-11-05T08:06:48.670 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-11-05T08:06:50.897 INFO:tasks.ceph.osd.6.smithi156.stderr:2023-11-05T08:06:50.892+0000 5dc2340 -1 osd.6 0 log_to_monitors true 2023-11-05T08:06:51.092 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:06:51.090+0000 5dc2340 -1 osd.7 0 log_to_monitors true 2023-11-05T08:06:51.408 INFO:tasks.ceph.osd.5.smithi156.stderr:2023-11-05T08:06:51.401+0000 5dc2340 -1 osd.5 0 log_to_monitors true 2023-11-05T08:06:51.434 INFO:tasks.ceph.osd.4.smithi156.stderr:2023-11-05T08:06:51.431+0000 5dc2340 -1 osd.4 0 log_to_monitors true 2023-11-05T08:06:52.367 INFO:tasks.ceph.osd.2.smithi052.stderr:2023-11-05T08:06:52.363+0000 5dc2340 -1 osd.2 0 log_to_monitors true 2023-11-05T08:06:53.283 INFO:tasks.ceph.osd.3.smithi052.stderr:2023-11-05T08:06:53.280+0000 5dc2340 -1 osd.3 0 log_to_monitors true 2023-11-05T08:06:53.348 INFO:tasks.ceph.osd.0.smithi052.stderr:2023-11-05T08:06:53.345+0000 5dc2340 -1 osd.0 0 log_to_monitors true 2023-11-05T08:06:53.839 INFO:tasks.ceph.osd.1.smithi052.stderr:2023-11-05T08:06:53.835+0000 5dc2340 -1 osd.1 0 log_to_monitors true 2023-11-05T08:06:54.337 INFO:tasks.ceph.osd.6.smithi156.stderr:2023-11-05T08:06:54.334+0000 c495640 -1 osd.6 0 waiting for initial osdmap 2023-11-05T08:06:54.382 INFO:tasks.ceph.osd.4.smithi156.stderr:2023-11-05T08:06:54.377+0000 c495640 -1 osd.4 0 waiting for initial osdmap 2023-11-05T08:06:54.512 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:06:54.507+0000 c495640 -1 osd.7 0 waiting for initial osdmap 2023-11-05T08:06:54.571 INFO:tasks.ceph.osd.5.smithi156.stderr:2023-11-05T08:06:54.566+0000 c495640 -1 osd.5 0 waiting for initial osdmap 2023-11-05T08:06:54.773 INFO:tasks.ceph.osd.6.smithi156.stderr:2023-11-05T08:06:54.759+0000 1025b640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-05T08:06:54.914 INFO:tasks.ceph.osd.4.smithi156.stderr:2023-11-05T08:06:54.895+0000 1025b640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-05T08:06:54.935 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:06:54.915+0000 1025b640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-05T08:06:55.006 INFO:tasks.ceph.osd.5.smithi156.stderr:2023-11-05T08:06:54.992+0000 1025b640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-05T08:06:55.476 DEBUG:teuthology.orchestra.run.smithi052:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-05T08:06:55.553 INFO:tasks.ceph.osd.2.smithi052.stderr:2023-11-05T08:06:55.548+0000 c495640 -1 osd.2 0 waiting for initial osdmap 2023-11-05T08:06:55.580 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.579+0000 7ff826dc5640 10 monclient: get_monmap_and_config 2023-11-05T08:06:55.580 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.579+0000 7ff826dc5640 10 monclient: build_initial_monmap 2023-11-05T08:06:55.580 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.579+0000 7ff826dc5640 10 monclient: monmap: 2023-11-05T08:06:55.580 INFO:teuthology.misc.health.smithi052.stderr:epoch 0 2023-11-05T08:06:55.580 INFO:teuthology.misc.health.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:06:55.581 INFO:teuthology.misc.health.smithi052.stderr:last_changed 2023-11-05T08:06:55.580310+0000 2023-11-05T08:06:55.581 INFO:teuthology.misc.health.smithi052.stderr:created 2023-11-05T08:06:55.580310+0000 2023-11-05T08:06:55.581 INFO:teuthology.misc.health.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:06:55.581 INFO:teuthology.misc.health.smithi052.stderr:election_strategy: 1 2023-11-05T08:06:55.581 INFO:teuthology.misc.health.smithi052.stderr:0: v1:172.21.15.52:6789/0 mon.noname-a-legacy 2023-11-05T08:06:55.582 INFO:teuthology.misc.health.smithi052.stderr:1: v1:172.21.15.156:6789/0 mon.noname-c-legacy 2023-11-05T08:06:55.582 INFO:teuthology.misc.health.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-b 2023-11-05T08:06:55.582 INFO:teuthology.misc.health.smithi052.stderr:3: v2:172.21.15.52:3300/0 mon.noname-a 2023-11-05T08:06:55.582 INFO:teuthology.misc.health.smithi052.stderr:4: v2:172.21.15.156:3300/0 mon.noname-c 2023-11-05T08:06:55.582 INFO:teuthology.misc.health.smithi052.stderr: 2023-11-05T08:06:55.584 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.580+0000 7ff826dc5640 1 Processor -- start 2023-11-05T08:06:55.585 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.580+0000 7ff826dc5640 1 -- start start 2023-11-05T08:06:55.585 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.580+0000 7ff826dc5640 10 monclient: init 2023-11-05T08:06:55.585 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.581+0000 7ff826dc5640 10 monclient: _reopen_session rank -1 2023-11-05T08:06:55.585 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.581+0000 7ff826dc5640 10 monclient: _add_conns ranks=[4,3,1,2,0] 2023-11-05T08:06:55.586 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.581+0000 7ff826dc5640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff82013eea0 0x7ff8200aea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:06:55.586 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.581+0000 7ff826dc5640 10 monclient(hunting): picked mon.noname-c con 0x7ff82013eea0 addr v2:172.21.15.156:3300/0 2023-11-05T08:06:55.586 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.581+0000 7ff826dc5640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff8200b3e50 0x7ff8200b0da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:06:55.586 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.581+0000 7ff826dc5640 10 monclient(hunting): picked mon.noname-a con 0x7ff8200b3e50 addr v2:172.21.15.52:3300/0 2023-11-05T08:06:55.586 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.581+0000 7ff826dc5640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7ff8200b19e0 addr v1:172.21.15.156:6789/0 2023-11-05T08:06:55.587 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.581+0000 7ff826dc5640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8200aef70 con 0x7ff8200b19e0 2023-11-05T08:06:55.587 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.581+0000 7ff826dc5640 10 monclient(hunting): start opening mon connection 2023-11-05T08:06:55.587 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.581+0000 7ff826dc5640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff820145180 con 0x7ff8200b3e50 2023-11-05T08:06:55.587 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.581+0000 7ff826dc5640 10 monclient(hunting): start opening mon connection 2023-11-05T08:06:55.587 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.581+0000 7ff826dc5640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8200affe0 con 0x7ff82013eea0 2023-11-05T08:06:55.587 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.581+0000 7ff826dc5640 10 monclient(hunting): _renew_subs 2023-11-05T08:06:55.588 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.581+0000 7ff826dc5640 10 monclient(hunting): authenticate will time out at 1361.786164s 2023-11-05T08:06:55.588 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.581+0000 7ff824b61640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff82013eea0 0x7ff8200aea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:06:55.588 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.581+0000 7ff81ffff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff8200b3e50 0x7ff8200b0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:06:55.588 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.582+0000 7ff824b61640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff82013eea0 0x7ff8200aea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.52:52088/0 (socket says 172.21.15.52:52088) 2023-11-05T08:06:55.588 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.582+0000 7ff824b61640 1 -- 172.21.15.52:0/1164272362 learned_addr learned my addr 172.21.15.52:0/1164272362 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-11-05T08:06:55.589 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.582+0000 7ff824b61640 10 monclient(hunting): get_auth_request con 0x7ff82013eea0 auth_method 0 2023-11-05T08:06:55.589 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.582+0000 7ff824b61640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:06:55.589 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.582+0000 7ff824b61640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:06:55.589 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.582+0000 7ff824b61640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:06:55.589 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.582+0000 7ff81ffff640 10 monclient(hunting): get_auth_request con 0x7ff8200b3e50 auth_method 0 2023-11-05T08:06:55.590 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.582+0000 7ff81ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:06:55.590 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.582+0000 7ff81ffff640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:06:55.590 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.582+0000 7ff81ffff640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:06:55.590 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.582+0000 7ff81ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:06:55.590 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.582+0000 7ff81ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:06:55.591 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.582+0000 7ff81ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:06:55.591 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.583+0000 7ff824b61640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:06:55.591 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.583+0000 7ff824b61640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:06:55.591 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.583+0000 7ff824b61640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:06:55.591 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.584+0000 7ff81ffff640 10 monclient(hunting): handle_auth_done global_id 4233 payload 274 2023-11-05T08:06:55.591 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.584+0000 7ff81ffff640 1 -- 172.21.15.52:0/1164272362 >> v2:172.21.15.156:3300/0 conn(0x7ff82013eea0 msgr2=0x7ff8200aea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-05T08:06:55.592 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.584+0000 7ff81ffff640 1 --2- 172.21.15.52:0/1164272362 >> v2:172.21.15.156:3300/0 conn(0x7ff82013eea0 0x7ff8200aea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:55.592 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.584+0000 7ff81ffff640 1 -- 172.21.15.52:0/1164272362 >> v1:172.21.15.156:6789/0 conn(0x7ff8200b19e0 legacy=0x7ff8200b1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:06:55.592 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.584+0000 7ff81ffff640 10 monclient: _finish_hunting 0 2023-11-05T08:06:55.592 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.584+0000 7ff81ffff640 1 monclient: found mon.noname-a 2023-11-05T08:06:55.592 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.584+0000 7ff81ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:06:55.593 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.584+0000 7ff81ffff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.52:3300/0 2023-11-05T08:06:55.593 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.584+0000 7ff81ffff640 1 -- 172.21.15.52:0/1164272362 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8200b0880 con 0x7ff8200b3e50 2023-11-05T08:06:55.596 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.586+0000 7ff81ffff640 1 --2- 172.21.15.52:0/1164272362 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8200b3e50 0x7ff8200b0da0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff8200b4910 tx=0x7ff81402b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d65ae2f7f86df00d server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:06:55.597 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.590+0000 7ff81f7fe640 1 -- 172.21.15.52:0/1164272362 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff814031710 con 0x7ff8200b3e50 2023-11-05T08:06:55.597 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.590+0000 7ff81f7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:06:55.597 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.590+0000 7ff81f7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-11-05T08:06:55.597 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.590+0000 7ff81f7fe640 10 monclient: dump: 2023-11-05T08:06:55.597 INFO:teuthology.misc.health.smithi052.stderr:epoch 1 2023-11-05T08:06:55.598 INFO:teuthology.misc.health.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:06:55.598 INFO:teuthology.misc.health.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:55.598 INFO:teuthology.misc.health.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:55.598 INFO:teuthology.misc.health.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:06:55.598 INFO:teuthology.misc.health.smithi052.stderr:election_strategy: 1 2023-11-05T08:06:55.599 INFO:teuthology.misc.health.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:06:55.599 INFO:teuthology.misc.health.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:06:55.599 INFO:teuthology.misc.health.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:06:55.599 INFO:teuthology.misc.health.smithi052.stderr: 2023-11-05T08:06:55.599 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.590+0000 7ff81f7fe640 10 monclient: _finish_auth 0 2023-11-05T08:06:55.600 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.590+0000 7ff81f7fe640 10 monclient: _check_auth_tickets 2023-11-05T08:06:55.600 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.590+0000 7ff81f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:06:55.600 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.590+0000 7ff826dc5640 5 monclient: authenticate success, global_id 4233 2023-11-05T08:06:55.600 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.590+0000 7ff81f7fe640 1 -- 172.21.15.52:0/1164272362 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff81402f050 con 0x7ff8200b3e50 2023-11-05T08:06:55.600 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.590+0000 7ff826dc5640 20 monclient: get_monmap_and_config waiting for monmap|config 2023-11-05T08:06:55.601 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.590+0000 7ff81f7fe640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:06:55.601 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.590+0000 7ff826dc5640 10 monclient: get_monmap_and_config success 2023-11-05T08:06:55.601 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.590+0000 7ff826dc5640 4 set_mon_vals no callback set 2023-11-05T08:06:55.601 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.590+0000 7ff81f7fe640 1 -- 172.21.15.52:0/1164272362 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff814031a90 con 0x7ff8200b3e50 2023-11-05T08:06:55.601 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.590+0000 7ff81f7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:06:55.602 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.590+0000 7ff81f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-11-05T08:06:55.602 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.590+0000 7ff81f7fe640 10 monclient: dump: 2023-11-05T08:06:55.602 INFO:teuthology.misc.health.smithi052.stderr:epoch 1 2023-11-05T08:06:55.602 INFO:teuthology.misc.health.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:06:55.603 INFO:teuthology.misc.health.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:55.603 INFO:teuthology.misc.health.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:55.603 INFO:teuthology.misc.health.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:06:55.603 INFO:teuthology.misc.health.smithi052.stderr:election_strategy: 1 2023-11-05T08:06:55.603 INFO:teuthology.misc.health.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:06:55.604 INFO:teuthology.misc.health.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:06:55.604 INFO:teuthology.misc.health.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:06:55.604 INFO:teuthology.misc.health.smithi052.stderr: 2023-11-05T08:06:55.604 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.590+0000 7ff826dc5640 10 monclient: shutdown 2023-11-05T08:06:55.604 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.590+0000 7ff826dc5640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:06:55.605 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.590+0000 7ff826dc5640 1 -- 172.21.15.52:0/1164272362 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8200b3e50 msgr2=0x7ff8200b0da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:06:55.605 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.590+0000 7ff826dc5640 1 --2- 172.21.15.52:0/1164272362 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8200b3e50 0x7ff8200b0da0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff8200b4910 tx=0x7ff81402b7b0 comp rx=0 tx=0).stop 2023-11-05T08:06:55.605 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.590+0000 7ff826dc5640 1 -- 172.21.15.52:0/1164272362 shutdown_connections 2023-11-05T08:06:55.605 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.590+0000 7ff826dc5640 1 --2- 172.21.15.52:0/1164272362 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8200b3e50 0x7ff8200b0da0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:55.605 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.590+0000 7ff826dc5640 1 --2- 172.21.15.52:0/1164272362 >> v2:172.21.15.156:3300/0 conn(0x7ff82013eea0 0x7ff8200aea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:55.606 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.590+0000 7ff826dc5640 1 -- 172.21.15.52:0/1164272362 >> 172.21.15.52:0/1164272362 conn(0x7ff8200716e0 msgr2=0x7ff820071af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:06:55.606 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.590+0000 7ff826dc5640 1 -- 172.21.15.52:0/1164272362 shutdown_connections 2023-11-05T08:06:55.606 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.591+0000 7ff826dc5640 1 -- 172.21.15.52:0/1164272362 wait complete. 2023-11-05T08:06:55.606 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.591+0000 7ff826dc5640 10 monclient: build_initial_monmap 2023-11-05T08:06:55.606 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.591+0000 7ff826dc5640 10 monclient: monmap: 2023-11-05T08:06:55.607 INFO:teuthology.misc.health.smithi052.stderr:epoch 0 2023-11-05T08:06:55.607 INFO:teuthology.misc.health.smithi052.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-05T08:06:55.607 INFO:teuthology.misc.health.smithi052.stderr:last_changed 0.000000 2023-11-05T08:06:55.607 INFO:teuthology.misc.health.smithi052.stderr:created 0.000000 2023-11-05T08:06:55.607 INFO:teuthology.misc.health.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:06:55.608 INFO:teuthology.misc.health.smithi052.stderr:election_strategy: 1 2023-11-05T08:06:55.608 INFO:teuthology.misc.health.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.noname-a 2023-11-05T08:06:55.608 INFO:teuthology.misc.health.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.noname-b 2023-11-05T08:06:55.608 INFO:teuthology.misc.health.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-c 2023-11-05T08:06:55.608 INFO:teuthology.misc.health.smithi052.stderr: 2023-11-05T08:06:55.608 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.591+0000 7ff826dc5640 1 librados: starting msgr at 2023-11-05T08:06:55.609 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.591+0000 7ff826dc5640 1 librados: starting objecter 2023-11-05T08:06:55.609 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.591+0000 7ff826dc5640 1 Processor -- start 2023-11-05T08:06:55.609 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.592+0000 7ff826dc5640 1 -- start start 2023-11-05T08:06:55.609 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.592+0000 7ff826dc5640 1 librados: setting wanted keys 2023-11-05T08:06:55.609 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.592+0000 7ff826dc5640 1 librados: calling monclient init 2023-11-05T08:06:55.610 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.592+0000 7ff826dc5640 10 monclient: init 2023-11-05T08:06:55.610 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.592+0000 7ff826dc5640 10 monclient: _reopen_session rank -1 2023-11-05T08:06:55.610 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.592+0000 7ff826dc5640 10 monclient: _add_conns ranks=[0,2,1] 2023-11-05T08:06:55.610 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.592+0000 7ff826dc5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8200b19e0 0x7ff8200abf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:06:55.610 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.592+0000 7ff826dc5640 10 monclient(hunting): picked mon.noname-a con 0x7ff8200b19e0 addr [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] 2023-11-05T08:06:55.611 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.592+0000 7ff826dc5640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff8200b3e50 0x7ff8201da120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:06:55.611 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.592+0000 7ff826dc5640 10 monclient(hunting): picked mon.noname-c con 0x7ff8200b3e50 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:06:55.611 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.592+0000 7ff826dc5640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff82013eea0 0x7ff8200ac820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:06:55.611 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.592+0000 7ff826dc5640 10 monclient(hunting): picked mon.noname-b con 0x7ff82013eea0 addr [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] 2023-11-05T08:06:55.611 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.592+0000 7ff826dc5640 10 monclient(hunting): start opening mon connection 2023-11-05T08:06:55.611 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.592+0000 7ff826dc5640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8201d9c90 con 0x7ff8200b19e0 2023-11-05T08:06:55.612 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.592+0000 7ff826dc5640 10 monclient(hunting): start opening mon connection 2023-11-05T08:06:55.612 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.592+0000 7ff826dc5640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8200ac440 con 0x7ff82013eea0 2023-11-05T08:06:55.612 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.592+0000 7ff826dc5640 10 monclient(hunting): start opening mon connection 2023-11-05T08:06:55.612 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.592+0000 7ff826dc5640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8201d9920 con 0x7ff8200b3e50 2023-11-05T08:06:55.612 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.592+0000 7ff826dc5640 10 monclient(hunting): _renew_subs 2023-11-05T08:06:55.613 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.592+0000 7ff826dc5640 10 monclient(hunting): authenticate will time out at 1361.797822s 2023-11-05T08:06:55.613 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.593+0000 7ff824b61640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8200b19e0 0x7ff8200abf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:06:55.613 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.593+0000 7ff81ffff640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff8200b3e50 0x7ff8201da120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:06:55.613 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.593+0000 7ff825362640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff82013eea0 0x7ff8200ac820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:06:55.613 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.593+0000 7ff824b61640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8200b19e0 0x7ff8200abf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40160/0 (socket says 172.21.15.52:40160) 2023-11-05T08:06:55.614 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.593+0000 7ff824b61640 1 -- 172.21.15.52:0/3603800607 learned_addr learned my addr 172.21.15.52:0/3603800607 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-11-05T08:06:55.614 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.593+0000 7ff824b61640 10 monclient(hunting): get_auth_request con 0x7ff8200b19e0 auth_method 0 2023-11-05T08:06:55.614 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.593+0000 7ff824b61640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:06:55.614 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.593+0000 7ff824b61640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:06:55.614 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.593+0000 7ff824b61640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:06:55.615 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.594+0000 7ff81ffff640 10 monclient(hunting): get_auth_request con 0x7ff8200b3e50 auth_method 0 2023-11-05T08:06:55.615 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.594+0000 7ff81ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:06:55.615 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.594+0000 7ff81ffff640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:06:55.615 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.594+0000 7ff81ffff640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:06:55.615 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.594+0000 7ff825362640 10 monclient(hunting): get_auth_request con 0x7ff82013eea0 auth_method 0 2023-11-05T08:06:55.616 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.594+0000 7ff825362640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:06:55.616 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.594+0000 7ff825362640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:06:55.616 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.594+0000 7ff825362640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:06:55.616 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.594+0000 7ff824b61640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:06:55.616 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.594+0000 7ff824b61640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:06:55.617 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.594+0000 7ff824b61640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:06:55.617 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.594+0000 7ff825362640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:06:55.617 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.594+0000 7ff825362640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:06:55.617 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.594+0000 7ff825362640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:06:55.617 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.594+0000 7ff81ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:06:55.617 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.594+0000 7ff81ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:06:55.618 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.594+0000 7ff81ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:06:55.620 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.597+0000 7ff825362640 10 monclient(hunting): handle_auth_done global_id 4252 payload 824 2023-11-05T08:06:55.620 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.597+0000 7ff825362640 1 -- 172.21.15.52:0/3603800607 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff8200b3e50 msgr2=0x7ff8201da120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:06:55.620 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.597+0000 7ff825362640 1 --2- 172.21.15.52:0/3603800607 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff8200b3e50 0x7ff8201da120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:55.620 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.597+0000 7ff825362640 1 -- 172.21.15.52:0/3603800607 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8200b19e0 msgr2=0x7ff8200abf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:06:55.621 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.597+0000 7ff825362640 1 --2- 172.21.15.52:0/3603800607 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8200b19e0 0x7ff8200abf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:55.621 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.597+0000 7ff825362640 10 monclient: _finish_hunting 0 2023-11-05T08:06:55.621 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.597+0000 7ff825362640 1 monclient: found mon.noname-b 2023-11-05T08:06:55.621 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.597+0000 7ff825362640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:06:55.621 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.597+0000 7ff825362640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.156:3300/0 2023-11-05T08:06:55.621 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.597+0000 7ff825362640 1 -- 172.21.15.52:0/3603800607 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff814009400 con 0x7ff82013eea0 2023-11-05T08:06:55.622 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.599+0000 7ff825362640 1 --2- 172.21.15.52:0/3603800607 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff82013eea0 0x7ff8200ac820 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff81800c700 tx=0x7ff81800cbc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:06:55.622 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.599+0000 7ff81d7fa640 10 client.?.objecter ms_handle_connect 0x7ff82013eea0 2023-11-05T08:06:55.622 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.599+0000 7ff81d7fa640 10 client.?.objecter resend_mon_ops 2023-11-05T08:06:55.622 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.602+0000 7ff81d7fa640 1 -- 172.21.15.52:0/3603800607 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff818003b70 con 0x7ff82013eea0 2023-11-05T08:06:55.622 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.603+0000 7ff81d7fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:06:55.623 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.603+0000 7ff81d7fa640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-05T08:06:55.623 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.603+0000 7ff81d7fa640 10 monclient: dump: 2023-11-05T08:06:55.623 INFO:teuthology.misc.health.smithi052.stderr:epoch 1 2023-11-05T08:06:55.623 INFO:teuthology.misc.health.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:06:55.623 INFO:teuthology.misc.health.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:55.624 INFO:teuthology.misc.health.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:55.624 INFO:teuthology.misc.health.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:06:55.624 INFO:teuthology.misc.health.smithi052.stderr:election_strategy: 1 2023-11-05T08:06:55.624 INFO:teuthology.misc.health.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:06:55.624 INFO:teuthology.misc.health.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:06:55.624 INFO:teuthology.misc.health.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:06:55.625 INFO:teuthology.misc.health.smithi052.stderr: 2023-11-05T08:06:55.625 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.603+0000 7ff81d7fa640 10 monclient: _finish_auth 0 2023-11-05T08:06:55.625 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.603+0000 7ff81d7fa640 10 monclient: _check_auth_tickets 2023-11-05T08:06:55.625 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.603+0000 7ff81d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:06:55.625 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.603+0000 7ff81d7fa640 1 -- 172.21.15.52:0/3603800607 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff818003cd0 con 0x7ff82013eea0 2023-11-05T08:06:55.626 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.603+0000 7ff81d7fa640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:06:55.626 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.603+0000 7ff81d7fa640 1 -- 172.21.15.52:0/3603800607 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff818005310 con 0x7ff82013eea0 2023-11-05T08:06:55.626 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.603+0000 7ff81d7fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:06:55.626 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.603+0000 7ff81d7fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-05T08:06:55.626 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.603+0000 7ff81d7fa640 10 monclient: dump: 2023-11-05T08:06:55.627 INFO:teuthology.misc.health.smithi052.stderr:epoch 1 2023-11-05T08:06:55.627 INFO:teuthology.misc.health.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:06:55.627 INFO:teuthology.misc.health.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:55.627 INFO:teuthology.misc.health.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:06:55.627 INFO:teuthology.misc.health.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:06:55.628 INFO:teuthology.misc.health.smithi052.stderr:election_strategy: 1 2023-11-05T08:06:55.628 INFO:teuthology.misc.health.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:06:55.628 INFO:teuthology.misc.health.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:06:55.628 INFO:teuthology.misc.health.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:06:55.628 INFO:teuthology.misc.health.smithi052.stderr: 2023-11-05T08:06:55.628 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.603+0000 7ff826dc5640 5 monclient: authenticate success, global_id 4252 2023-11-05T08:06:55.629 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.603+0000 7ff826dc5640 10 monclient: _renew_subs 2023-11-05T08:06:55.629 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.603+0000 7ff826dc5640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:06:55.629 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.603+0000 7ff826dc5640 1 -- 172.21.15.52:0/3603800607 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8201da660 con 0x7ff82013eea0 2023-11-05T08:06:55.629 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.603+0000 7ff81effd640 4 set_mon_vals no callback set 2023-11-05T08:06:55.629 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.603+0000 7ff826dc5640 10 client.4252.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-05T08:06:55.629 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.603+0000 7ff826dc5640 10 monclient: _renew_subs 2023-11-05T08:06:55.630 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.603+0000 7ff826dc5640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:06:55.630 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.603+0000 7ff826dc5640 1 -- 172.21.15.52:0/3603800607 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8200acf40 con 0x7ff82013eea0 2023-11-05T08:06:55.630 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.603+0000 7ff826dc5640 1 librados: init done 2023-11-05T08:06:55.630 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.603+0000 7ff826dc5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-05T08:06:55.630 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.603+0000 7ff826dc5640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:06:55.631 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.603+0000 7ff826dc5640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:06:55.631 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.603+0000 7ff826dc5640 1 -- 172.21.15.52:0/3603800607 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8201d9ae0 con 0x7ff82013eea0 2023-11-05T08:06:55.632 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.620+0000 7ff81d7fa640 1 -- 172.21.15.52:0/3603800607 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 4) v1 ==== 89173+0+0 (secure 0 0 0) 0x7ff818005470 con 0x7ff82013eea0 2023-11-05T08:06:55.632 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.621+0000 7ff81d7fa640 1 --2- 172.21.15.52:0/3603800607 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7ff80c06c770 0x7ff80c06ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:06:55.632 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.621+0000 7ff824b61640 1 --2- 172.21.15.52:0/3603800607 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7ff80c06c770 0x7ff80c06ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:06:55.632 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.621+0000 7ff824b61640 10 monclient: get_auth_request con 0x7ff80c06c770 auth_method 0 2023-11-05T08:06:55.633 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.622+0000 7ff81d7fa640 10 client.4252.objecter ms_handle_connect 0x7ff80c06c770 2023-11-05T08:06:55.633 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.622+0000 7ff824b61640 1 --2- 172.21.15.52:0/3603800607 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7ff80c06c770 0x7ff80c06ec30 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff8100094a0 tx=0x7ff810009240 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:06:55.633 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.623+0000 7ff81d7fa640 1 -- 172.21.15.52:0/3603800607 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2463+0+0 (secure 0 0 0) 0x7ff818058af0 con 0x7ff82013eea0 2023-11-05T08:06:55.633 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.623+0000 7ff81d7fa640 10 client.4252.objecter ms_dispatch 0x7ff820000b90 osd_map(13..13 src has 1..13) v4 2023-11-05T08:06:55.633 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.623+0000 7ff81d7fa640 3 client.4252.objecter handle_osd_map got epochs [13,13] > 0 2023-11-05T08:06:55.634 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.623+0000 7ff81d7fa640 3 client.4252.objecter handle_osd_map decoding full epoch 13 2023-11-05T08:06:55.634 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.624+0000 7ff81d7fa640 20 client.4252.objecter dump_active .. 0 homeless 2023-11-05T08:06:55.864 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.863+0000 7ff81d7fa640 1 -- 172.21.15.52:0/3603800607 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff818054e30 con 0x7ff82013eea0 2023-11-05T08:06:55.864 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.863+0000 7ff81d7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:06:55.864 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:55.863+0000 7ff81d7fa640 10 monclient: _finish_command 1 = system:0 2023-11-05T08:06:55.979 INFO:tasks.ceph.osd.2.smithi052.stderr:2023-11-05T08:06:55.966+0000 1025b640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-05T08:06:56.066 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:56.065+0000 7ff826dc5640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2023-11-05T08:06:56.066 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:56.065+0000 7ff826dc5640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2023-11-05T08:06:56.066 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:56.065+0000 7ff826dc5640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:06:56.067 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:56.065+0000 7ff826dc5640 1 -- 172.21.15.52:0/3603800607 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff8201da7f0 con 0x7ff82013eea0 2023-11-05T08:06:56.082 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:56.081+0000 7ff81d7fa640 1 -- 172.21.15.52:0/3603800607 <== mon.1 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+7566 (secure 0 0 0) 0x7ff818058450 con 0x7ff82013eea0 2023-11-05T08:06:56.082 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:56.081+0000 7ff81d7fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2023-11-05T08:06:56.082 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:56.081+0000 7ff81d7fa640 10 monclient: _finish_command 2 = system:0 2023-11-05T08:06:56.083 INFO:teuthology.misc.health.smithi052.stdout: 2023-11-05T08:06:56.083 INFO:teuthology.misc.health.smithi052.stdout:{"epoch":13,"fsid":"b7fdc914-b520-409f-b9d7-902b05a64252","created":"2023-11-05T08:06:09.361414+0000","modified":"2023-11-05T08:06:55.059944+0000","last_up_change":"2023-11-05T08:06:55.059944+0000","last_in_change":"2023-11-05T08:06:15.124773+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c95e48e9-832b-4950-b467-9f61d33decc6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"82d5dd13-f1f5-4282-8ec8-4d6c273a42c7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"2c5ea82d-5534-4437-a76f-e3769d798b17","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9ffcbf5b-1afd-4777-825f-c5fb551b9d88","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"3f5f9aa4-2015-4835-9b39-faf459a35a49","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"cf781fb3-83fb-40e0-86a3-f895d7824edb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d2787c11-d907-4924-b9cf-69db95ad35c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":2586579514},{"type":"v1","addr":"172.21.15.156:6827","nonce":2586579514}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":2586579514},{"type":"v1","addr":"172.21.15.156:6829","nonce":2586579514}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":2586579514},{"type":"v1","addr":"172.21.15.156:6833","nonce":2586579514}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":2586579514},{"type":"v1","addr":"172.21.15.156:6831","nonce":2586579514}]},"public_addr":"172.21.15.156:6827/2586579514","cluster_addr":"172.21.15.156:6829/2586579514","heartbeat_back_addr":"172.21.15.156:6833/2586579514","heartbeat_front_addr":"172.21.15.156:6831/2586579514","state":["exists","up"]},{"osd":7,"uuid":"e9e51eb8-2a9d-4cd0-9158-a00eea2a5614","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-05T08:06:56.084 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:56.083+0000 7ff826dc5640 10 librados: watch_flush enter 2023-11-05T08:06:56.085 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:56.083+0000 7ff826dc5640 10 librados: watch_flush exit 2023-11-05T08:06:56.085 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:56.083+0000 7ff826dc5640 20 client.4252.objecter shutdown clearing up homeless session... 2023-11-05T08:06:56.085 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:56.083+0000 7ff826dc5640 10 client.4252.objecter successfully canceled tick 2023-11-05T08:06:56.085 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:56.083+0000 7ff826dc5640 1 -- 172.21.15.52:0/3603800607 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7ff80c06c770 msgr2=0x7ff80c06ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:06:56.085 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:56.083+0000 7ff826dc5640 1 --2- 172.21.15.52:0/3603800607 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7ff80c06c770 0x7ff80c06ec30 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff8100094a0 tx=0x7ff810009240 comp rx=0 tx=0).stop 2023-11-05T08:06:56.086 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:56.083+0000 7ff826dc5640 10 monclient: shutdown 2023-11-05T08:06:56.086 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:56.083+0000 7ff826dc5640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:06:56.086 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:56.083+0000 7ff826dc5640 1 -- 172.21.15.52:0/3603800607 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff82013eea0 msgr2=0x7ff8200ac820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:06:56.086 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:56.083+0000 7ff826dc5640 1 --2- 172.21.15.52:0/3603800607 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff82013eea0 0x7ff8200ac820 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff81800c700 tx=0x7ff81800cbc0 comp rx=0 tx=0).stop 2023-11-05T08:06:56.086 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:56.084+0000 7ff826dc5640 1 -- 172.21.15.52:0/3603800607 shutdown_connections 2023-11-05T08:06:56.087 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:56.084+0000 7ff826dc5640 1 --2- 172.21.15.52:0/3603800607 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7ff80c06c770 0x7ff80c06ec30 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:56.087 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:56.084+0000 7ff826dc5640 1 --2- 172.21.15.52:0/3603800607 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff82013eea0 0x7ff8200ac820 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:56.087 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:56.084+0000 7ff826dc5640 1 --2- 172.21.15.52:0/3603800607 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff8200b3e50 0x7ff8201da120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:56.087 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:56.084+0000 7ff826dc5640 1 --2- 172.21.15.52:0/3603800607 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8200b19e0 0x7ff8200abf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:06:56.087 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:56.084+0000 7ff826dc5640 1 -- 172.21.15.52:0/3603800607 >> 172.21.15.52:0/3603800607 conn(0x7ff8200716e0 msgr2=0x7ff820071ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:06:56.088 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:56.084+0000 7ff826dc5640 1 -- 172.21.15.52:0/3603800607 shutdown_connections 2023-11-05T08:06:56.088 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:56.084+0000 7ff826dc5640 1 -- 172.21.15.52:0/3603800607 wait complete. 2023-11-05T08:06:56.088 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:06:56.084+0000 7ff826dc5640 1 librados: shutdown 2023-11-05T08:06:56.094 DEBUG:teuthology.misc:1 of 8 OSDs are up 2023-11-05T08:06:56.556 INFO:tasks.ceph.osd.1.smithi052.stderr:2023-11-05T08:06:56.550+0000 ac7d640 -1 osd.1 0 waiting for initial osdmap 2023-11-05T08:06:56.583 INFO:tasks.ceph.osd.3.smithi052.stderr:2023-11-05T08:06:56.579+0000 ac7d640 -1 osd.3 0 waiting for initial osdmap 2023-11-05T08:06:56.734 INFO:tasks.ceph.osd.0.smithi052.stderr:2023-11-05T08:06:56.729+0000 c495640 -1 osd.0 0 waiting for initial osdmap 2023-11-05T08:06:57.042 INFO:tasks.ceph.osd.1.smithi052.stderr:2023-11-05T08:06:57.029+0000 1025b640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-05T08:06:57.056 INFO:tasks.ceph.osd.3.smithi052.stderr:2023-11-05T08:06:57.042+0000 1025b640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-05T08:06:57.212 INFO:tasks.ceph.osd.0.smithi052.stderr:2023-11-05T08:06:57.198+0000 1025b640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-05T08:07:02.900 DEBUG:teuthology.orchestra.run.smithi052:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-05T08:07:02.999 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:02.999+0000 7fa0ef456640 10 monclient: get_monmap_and_config 2023-11-05T08:07:02.999 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:02.999+0000 7fa0ef456640 10 monclient: build_initial_monmap 2023-11-05T08:07:03.000 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:02.999+0000 7fa0ef456640 10 monclient: monmap: 2023-11-05T08:07:03.000 INFO:teuthology.misc.health.smithi052.stderr:epoch 0 2023-11-05T08:07:03.000 INFO:teuthology.misc.health.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:03.000 INFO:teuthology.misc.health.smithi052.stderr:last_changed 2023-11-05T08:07:02.999601+0000 2023-11-05T08:07:03.000 INFO:teuthology.misc.health.smithi052.stderr:created 2023-11-05T08:07:02.999601+0000 2023-11-05T08:07:03.001 INFO:teuthology.misc.health.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:07:03.001 INFO:teuthology.misc.health.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:03.001 INFO:teuthology.misc.health.smithi052.stderr:0: v1:172.21.15.52:6789/0 mon.noname-a-legacy 2023-11-05T08:07:03.001 INFO:teuthology.misc.health.smithi052.stderr:1: v1:172.21.15.156:6789/0 mon.noname-c-legacy 2023-11-05T08:07:03.001 INFO:teuthology.misc.health.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-b 2023-11-05T08:07:03.002 INFO:teuthology.misc.health.smithi052.stderr:3: v2:172.21.15.52:3300/0 mon.noname-a 2023-11-05T08:07:03.002 INFO:teuthology.misc.health.smithi052.stderr:4: v2:172.21.15.156:3300/0 mon.noname-c 2023-11-05T08:07:03.002 INFO:teuthology.misc.health.smithi052.stderr: 2023-11-05T08:07:03.004 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:02.999+0000 7fa0ef456640 1 Processor -- start 2023-11-05T08:07:03.004 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:02.999+0000 7fa0ef456640 1 -- start start 2023-11-05T08:07:03.004 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:02.999+0000 7fa0ef456640 10 monclient: init 2023-11-05T08:07:03.005 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.000+0000 7fa0ef456640 10 monclient: _reopen_session rank -1 2023-11-05T08:07:03.005 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.000+0000 7fa0ef456640 10 monclient: _add_conns ranks=[0,4,2,1,3] 2023-11-05T08:07:03.005 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.000+0000 7fa0ef456640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fa0e80b4230 addr v1:172.21.15.52:6789/0 2023-11-05T08:07:03.005 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.000+0000 7fa0ef456640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa0e813f160 0x7fa0e8141770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:03.005 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.000+0000 7fa0ef456640 10 monclient(hunting): picked mon.noname-c con 0x7fa0e813f160 addr v2:172.21.15.156:3300/0 2023-11-05T08:07:03.006 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.000+0000 7fa0ef456640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa0e80b1390 0x7fa0e8141cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:03.006 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.000+0000 7fa0ef456640 10 monclient(hunting): picked mon.noname-b con 0x7fa0e80b1390 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:07:03.006 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.000+0000 7fa0ef456640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0e80a9370 con 0x7fa0e80b4230 2023-11-05T08:07:03.006 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.000+0000 7fa0ef456640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:03.006 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.000+0000 7fa0ef456640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0e80b4610 con 0x7fa0e813f160 2023-11-05T08:07:03.007 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.000+0000 7fa0ef456640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:03.007 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.000+0000 7fa0ef456640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e80a9010 con 0x7fa0e80b1390 2023-11-05T08:07:03.007 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.000+0000 7fa0ef456640 10 monclient(hunting): _renew_subs 2023-11-05T08:07:03.007 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.000+0000 7fa0ef456640 10 monclient(hunting): authenticate will time out at 1369.205459s 2023-11-05T08:07:03.007 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.001+0000 7fa0ec9f1640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa0e813f160 0x7fa0e8141770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:03.008 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.001+0000 7fa0ec9f1640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa0e813f160 0x7fa0e8141770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.52:47372/0 (socket says 172.21.15.52:47372) 2023-11-05T08:07:03.008 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.001+0000 7fa0ec9f1640 1 -- 172.21.15.52:0/73925903 learned_addr learned my addr 172.21.15.52:0/73925903 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-11-05T08:07:03.008 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.001+0000 7fa0ec9f1640 10 monclient(hunting): get_auth_request con 0x7fa0e813f160 auth_method 0 2023-11-05T08:07:03.008 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.001+0000 7fa0ec9f1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:03.008 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.001+0000 7fa0ec9f1640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:03.009 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.001+0000 7fa0ec9f1640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:03.009 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.002+0000 7fa0ec9f1640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:03.009 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.002+0000 7fa0ec9f1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:03.009 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.002+0000 7fa0ec9f1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:03.009 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.003+0000 7fa0ed9f3640 1 --2- 172.21.15.52:0/73925903 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa0e80b1390 0x7fa0e8141cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:03.009 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.003+0000 7fa0ed9f3640 10 monclient(hunting): get_auth_request con 0x7fa0e80b1390 auth_method 0 2023-11-05T08:07:03.010 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.003+0000 7fa0ed9f3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:03.010 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.003+0000 7fa0ed9f3640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:03.010 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.003+0000 7fa0ed9f3640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:03.010 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.003+0000 7fa0ec9f1640 10 monclient(hunting): handle_auth_done global_id 4255 payload 274 2023-11-05T08:07:03.010 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.003+0000 7fa0ec9f1640 1 -- 172.21.15.52:0/73925903 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa0e80b1390 msgr2=0x7fa0e8141cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-05T08:07:03.011 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.003+0000 7fa0ec9f1640 1 --2- 172.21.15.52:0/73925903 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa0e80b1390 0x7fa0e8141cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:03.011 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.003+0000 7fa0ec9f1640 1 -- 172.21.15.52:0/73925903 >> v1:172.21.15.52:6789/0 conn(0x7fa0e80b4230 legacy=0x7fa0e813ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-05T08:07:03.011 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.003+0000 7fa0ec9f1640 10 monclient: _finish_hunting 0 2023-11-05T08:07:03.011 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.003+0000 7fa0ec9f1640 1 monclient: found mon.noname-c 2023-11-05T08:07:03.011 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.003+0000 7fa0ec9f1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:07:03.012 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.003+0000 7fa0ec9f1640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.156:3300/0 2023-11-05T08:07:03.012 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.003+0000 7fa0ec9f1640 1 -- 172.21.15.52:0/73925903 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0e80aa4b0 con 0x7fa0e813f160 2023-11-05T08:07:03.015 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.006+0000 7fa0ec9f1640 1 --2- 172.21.15.52:0/73925903 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa0e813f160 0x7fa0e8141770 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa0d8009870 tx=0x7fa0d802b860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=77eeab99ccd0f76 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:03.016 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.009+0000 7fa0dffff640 1 -- 172.21.15.52:0/73925903 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d80317c0 con 0x7fa0e813f160 2023-11-05T08:07:03.016 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.009+0000 7fa0dffff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:03.016 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.009+0000 7fa0dffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-11-05T08:07:03.016 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.009+0000 7fa0dffff640 10 monclient: dump: 2023-11-05T08:07:03.016 INFO:teuthology.misc.health.smithi052.stderr:epoch 1 2023-11-05T08:07:03.017 INFO:teuthology.misc.health.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:03.017 INFO:teuthology.misc.health.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:03.017 INFO:teuthology.misc.health.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:03.017 INFO:teuthology.misc.health.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:03.017 INFO:teuthology.misc.health.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:03.018 INFO:teuthology.misc.health.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:03.018 INFO:teuthology.misc.health.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:03.018 INFO:teuthology.misc.health.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:03.018 INFO:teuthology.misc.health.smithi052.stderr: 2023-11-05T08:07:03.018 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.009+0000 7fa0dffff640 10 monclient: _finish_auth 0 2023-11-05T08:07:03.019 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.009+0000 7fa0dffff640 10 monclient: _check_auth_tickets 2023-11-05T08:07:03.019 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.009+0000 7fa0dffff640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:07:03.019 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.009+0000 7fa0ef456640 5 monclient: authenticate success, global_id 4255 2023-11-05T08:07:03.019 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.010+0000 7fa0ef456640 20 monclient: get_monmap_and_config waiting for monmap|config 2023-11-05T08:07:03.019 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.009+0000 7fa0dffff640 1 -- 172.21.15.52:0/73925903 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0d8031920 con 0x7fa0e813f160 2023-11-05T08:07:03.019 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.010+0000 7fa0dffff640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:07:03.020 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.010+0000 7fa0ef456640 10 monclient: get_monmap_and_config success 2023-11-05T08:07:03.020 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.010+0000 7fa0ef456640 4 set_mon_vals no callback set 2023-11-05T08:07:03.020 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.010+0000 7fa0dffff640 1 -- 172.21.15.52:0/73925903 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d8031cb0 con 0x7fa0e813f160 2023-11-05T08:07:03.020 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.010+0000 7fa0dffff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:03.020 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.010+0000 7fa0dffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-05T08:07:03.021 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.010+0000 7fa0dffff640 10 monclient: dump: 2023-11-05T08:07:03.021 INFO:teuthology.misc.health.smithi052.stderr:epoch 1 2023-11-05T08:07:03.021 INFO:teuthology.misc.health.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:03.021 INFO:teuthology.misc.health.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:03.022 INFO:teuthology.misc.health.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:03.022 INFO:teuthology.misc.health.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:03.022 INFO:teuthology.misc.health.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:03.022 INFO:teuthology.misc.health.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:03.022 INFO:teuthology.misc.health.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:03.023 INFO:teuthology.misc.health.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:03.023 INFO:teuthology.misc.health.smithi052.stderr: 2023-11-05T08:07:03.023 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.010+0000 7fa0ef456640 10 monclient: shutdown 2023-11-05T08:07:03.023 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.010+0000 7fa0ef456640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:07:03.023 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.010+0000 7fa0ef456640 1 -- 172.21.15.52:0/73925903 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa0e813f160 msgr2=0x7fa0e8141770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:03.024 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.010+0000 7fa0ef456640 1 --2- 172.21.15.52:0/73925903 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa0e813f160 0x7fa0e8141770 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa0d8009870 tx=0x7fa0d802b860 comp rx=0 tx=0).stop 2023-11-05T08:07:03.024 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.010+0000 7fa0ef456640 1 -- 172.21.15.52:0/73925903 shutdown_connections 2023-11-05T08:07:03.024 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.010+0000 7fa0ef456640 1 --2- 172.21.15.52:0/73925903 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa0e80b1390 0x7fa0e8141cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:03.024 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.010+0000 7fa0ef456640 1 --2- 172.21.15.52:0/73925903 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa0e813f160 0x7fa0e8141770 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:03.024 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.010+0000 7fa0ef456640 1 -- 172.21.15.52:0/73925903 >> 172.21.15.52:0/73925903 conn(0x7fa0e8071920 msgr2=0x7fa0e8071d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:07:03.024 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.010+0000 7fa0ef456640 1 -- 172.21.15.52:0/73925903 shutdown_connections 2023-11-05T08:07:03.025 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.010+0000 7fa0ef456640 1 -- 172.21.15.52:0/73925903 wait complete. 2023-11-05T08:07:03.025 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.011+0000 7fa0ef456640 10 monclient: build_initial_monmap 2023-11-05T08:07:03.025 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.011+0000 7fa0ef456640 10 monclient: monmap: 2023-11-05T08:07:03.025 INFO:teuthology.misc.health.smithi052.stderr:epoch 0 2023-11-05T08:07:03.026 INFO:teuthology.misc.health.smithi052.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-05T08:07:03.026 INFO:teuthology.misc.health.smithi052.stderr:last_changed 0.000000 2023-11-05T08:07:03.026 INFO:teuthology.misc.health.smithi052.stderr:created 0.000000 2023-11-05T08:07:03.026 INFO:teuthology.misc.health.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:07:03.026 INFO:teuthology.misc.health.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:03.027 INFO:teuthology.misc.health.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.noname-a 2023-11-05T08:07:03.027 INFO:teuthology.misc.health.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.noname-b 2023-11-05T08:07:03.027 INFO:teuthology.misc.health.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-c 2023-11-05T08:07:03.027 INFO:teuthology.misc.health.smithi052.stderr: 2023-11-05T08:07:03.027 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.011+0000 7fa0ef456640 1 librados: starting msgr at 2023-11-05T08:07:03.028 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.011+0000 7fa0ef456640 1 librados: starting objecter 2023-11-05T08:07:03.028 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.011+0000 7fa0ef456640 1 Processor -- start 2023-11-05T08:07:03.028 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.011+0000 7fa0ef456640 1 -- start start 2023-11-05T08:07:03.028 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.011+0000 7fa0ef456640 1 librados: setting wanted keys 2023-11-05T08:07:03.028 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.011+0000 7fa0ef456640 1 librados: calling monclient init 2023-11-05T08:07:03.029 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.011+0000 7fa0ef456640 10 monclient: init 2023-11-05T08:07:03.029 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.012+0000 7fa0ef456640 10 monclient: _reopen_session rank -1 2023-11-05T08:07:03.029 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.012+0000 7fa0ef456640 10 monclient: _add_conns ranks=[2,1,0] 2023-11-05T08:07:03.029 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.012+0000 7fa0ef456640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa0e80b1390 0x7fa0e8135390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:03.029 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.012+0000 7fa0ef456640 10 monclient(hunting): picked mon.noname-c con 0x7fa0e80b1390 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:07:03.030 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.012+0000 7fa0ef456640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa0e80b4230 0x7fa0e81d9800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:03.030 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.012+0000 7fa0ef456640 10 monclient(hunting): picked mon.noname-b con 0x7fa0e80b4230 addr [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] 2023-11-05T08:07:03.030 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.012+0000 7fa0ef456640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa0e813f160 0x7fa0e81323b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:03.030 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.012+0000 7fa0ef456640 10 monclient(hunting): picked mon.noname-a con 0x7fa0e813f160 addr [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] 2023-11-05T08:07:03.030 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.012+0000 7fa0ef456640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:03.031 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.012+0000 7fa0ef456640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e813b810 con 0x7fa0e813f160 2023-11-05T08:07:03.031 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.012+0000 7fa0ef456640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:03.031 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.012+0000 7fa0ef456640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e813be30 con 0x7fa0e80b4230 2023-11-05T08:07:03.031 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.012+0000 7fa0ef456640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:03.031 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.012+0000 7fa0ef456640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e813a0b0 con 0x7fa0e80b1390 2023-11-05T08:07:03.031 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.012+0000 7fa0ef456640 10 monclient(hunting): _renew_subs 2023-11-05T08:07:03.032 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.012+0000 7fa0ef456640 10 monclient(hunting): authenticate will time out at 1369.217424s 2023-11-05T08:07:03.032 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.012+0000 7fa0ec9f1640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa0e80b4230 0x7fa0e81d9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:03.032 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.013+0000 7fa0ed9f3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa0e813f160 0x7fa0e81323b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:03.032 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.013+0000 7fa0ed1f2640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa0e80b1390 0x7fa0e8135390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:03.033 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.013+0000 7fa0ec9f1640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa0e80b4230 0x7fa0e81d9800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.52:47388/0 (socket says 172.21.15.52:47388) 2023-11-05T08:07:03.033 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.013+0000 7fa0ec9f1640 1 -- 172.21.15.52:0/4118673003 learned_addr learned my addr 172.21.15.52:0/4118673003 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-11-05T08:07:03.033 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.013+0000 7fa0ec9f1640 10 monclient(hunting): get_auth_request con 0x7fa0e80b4230 auth_method 0 2023-11-05T08:07:03.033 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.013+0000 7fa0ec9f1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:03.033 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.013+0000 7fa0ec9f1640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:03.033 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.013+0000 7fa0ec9f1640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:03.034 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.013+0000 7fa0ed9f3640 10 monclient(hunting): get_auth_request con 0x7fa0e813f160 auth_method 0 2023-11-05T08:07:03.034 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.013+0000 7fa0ed9f3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:03.034 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.013+0000 7fa0ed9f3640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:03.034 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.013+0000 7fa0ed9f3640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:03.034 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.013+0000 7fa0ed1f2640 10 monclient(hunting): get_auth_request con 0x7fa0e80b1390 auth_method 0 2023-11-05T08:07:03.035 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.013+0000 7fa0ed1f2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:03.035 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.013+0000 7fa0ed1f2640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:03.035 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.013+0000 7fa0ed1f2640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:03.035 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.013+0000 7fa0ec9f1640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:03.035 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.013+0000 7fa0ec9f1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:03.035 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.013+0000 7fa0ec9f1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:03.036 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.014+0000 7fa0ed9f3640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:03.036 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.014+0000 7fa0ed9f3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:03.036 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.014+0000 7fa0ed9f3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:03.036 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.014+0000 7fa0ed1f2640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:03.036 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.014+0000 7fa0ed1f2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:03.037 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.014+0000 7fa0ed1f2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:03.038 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.016+0000 7fa0ec9f1640 10 monclient(hunting): handle_auth_done global_id 4258 payload 824 2023-11-05T08:07:03.038 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.016+0000 7fa0ec9f1640 1 -- 172.21.15.52:0/4118673003 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa0e80b1390 msgr2=0x7fa0e8135390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:03.039 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.016+0000 7fa0ec9f1640 1 --2- 172.21.15.52:0/4118673003 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa0e80b1390 0x7fa0e8135390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:03.039 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.016+0000 7fa0ec9f1640 1 -- 172.21.15.52:0/4118673003 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa0e813f160 msgr2=0x7fa0e81323b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:03.039 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.016+0000 7fa0ec9f1640 1 --2- 172.21.15.52:0/4118673003 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa0e813f160 0x7fa0e81323b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:03.039 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.016+0000 7fa0ec9f1640 10 monclient: _finish_hunting 0 2023-11-05T08:07:03.039 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.016+0000 7fa0ec9f1640 1 monclient: found mon.noname-b 2023-11-05T08:07:03.040 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.016+0000 7fa0ec9f1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:07:03.040 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.016+0000 7fa0ec9f1640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.156:3300/0 2023-11-05T08:07:03.040 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.016+0000 7fa0ec9f1640 1 -- 172.21.15.52:0/4118673003 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0d80094d0 con 0x7fa0e80b4230 2023-11-05T08:07:03.040 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.018+0000 7fa0ec9f1640 1 --2- 172.21.15.52:0/4118673003 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa0e80b4230 0x7fa0e81d9800 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa0d8009870 tx=0x7fa0d80046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:03.040 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.018+0000 7fa0ddffb640 10 client.?.objecter ms_handle_connect 0x7fa0e80b4230 2023-11-05T08:07:03.041 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.018+0000 7fa0ddffb640 10 client.?.objecter resend_mon_ops 2023-11-05T08:07:03.041 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.022+0000 7fa0ddffb640 1 -- 172.21.15.52:0/4118673003 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d8032860 con 0x7fa0e80b4230 2023-11-05T08:07:03.041 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.022+0000 7fa0ddffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:03.041 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.022+0000 7fa0ddffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-05T08:07:03.041 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.022+0000 7fa0ddffb640 10 monclient: dump: 2023-11-05T08:07:03.042 INFO:teuthology.misc.health.smithi052.stderr:epoch 1 2023-11-05T08:07:03.042 INFO:teuthology.misc.health.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:03.042 INFO:teuthology.misc.health.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:03.042 INFO:teuthology.misc.health.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:03.042 INFO:teuthology.misc.health.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:03.043 INFO:teuthology.misc.health.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:03.043 INFO:teuthology.misc.health.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:03.043 INFO:teuthology.misc.health.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:03.043 INFO:teuthology.misc.health.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:03.043 INFO:teuthology.misc.health.smithi052.stderr: 2023-11-05T08:07:03.044 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.022+0000 7fa0ddffb640 10 monclient: _finish_auth 0 2023-11-05T08:07:03.044 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.022+0000 7fa0ddffb640 10 monclient: _check_auth_tickets 2023-11-05T08:07:03.044 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.022+0000 7fa0ddffb640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:07:03.044 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.022+0000 7fa0ddffb640 1 -- 172.21.15.52:0/4118673003 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0d80329c0 con 0x7fa0e80b4230 2023-11-05T08:07:03.044 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.022+0000 7fa0ddffb640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:07:03.044 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.022+0000 7fa0ddffb640 1 -- 172.21.15.52:0/4118673003 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d8032d70 con 0x7fa0e80b4230 2023-11-05T08:07:03.045 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.022+0000 7fa0ddffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:03.045 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.022+0000 7fa0ddffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-05T08:07:03.045 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.022+0000 7fa0ddffb640 10 monclient: dump: 2023-11-05T08:07:03.045 INFO:teuthology.misc.health.smithi052.stderr:epoch 1 2023-11-05T08:07:03.045 INFO:teuthology.misc.health.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:03.046 INFO:teuthology.misc.health.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:03.046 INFO:teuthology.misc.health.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:03.046 INFO:teuthology.misc.health.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:03.046 INFO:teuthology.misc.health.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:03.046 INFO:teuthology.misc.health.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:03.047 INFO:teuthology.misc.health.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:03.047 INFO:teuthology.misc.health.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:03.047 INFO:teuthology.misc.health.smithi052.stderr: 2023-11-05T08:07:03.047 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.022+0000 7fa0ef456640 5 monclient: authenticate success, global_id 4258 2023-11-05T08:07:03.047 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.022+0000 7fa0ef456640 10 monclient: _renew_subs 2023-11-05T08:07:03.048 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.022+0000 7fa0ef456640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:07:03.048 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.022+0000 7fa0df7fe640 4 set_mon_vals no callback set 2023-11-05T08:07:03.048 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.022+0000 7fa0ef456640 1 -- 172.21.15.52:0/4118673003 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0e8136010 con 0x7fa0e80b4230 2023-11-05T08:07:03.048 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.022+0000 7fa0ef456640 10 client.4258.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-05T08:07:03.048 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.022+0000 7fa0ef456640 10 monclient: _renew_subs 2023-11-05T08:07:03.048 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.022+0000 7fa0ef456640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:07:03.049 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.022+0000 7fa0ef456640 1 -- 172.21.15.52:0/4118673003 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0e8137fb0 con 0x7fa0e80b4230 2023-11-05T08:07:03.049 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.022+0000 7fa0ef456640 1 librados: init done 2023-11-05T08:07:03.049 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.023+0000 7fa0ef456640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-05T08:07:03.049 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.023+0000 7fa0ef456640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:07:03.049 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.023+0000 7fa0ef456640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:07:03.049 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.023+0000 7fa0ef456640 1 -- 172.21.15.52:0/4118673003 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0e813a240 con 0x7fa0e80b4230 2023-11-05T08:07:03.051 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.042+0000 7fa0ddffb640 1 -- 172.21.15.52:0/4118673003 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 4) v1 ==== 89173+0+0 (secure 0 0 0) 0x7fa0d804d3f0 con 0x7fa0e80b4230 2023-11-05T08:07:03.051 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.043+0000 7fa0ddffb640 1 --2- 172.21.15.52:0/4118673003 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7fa0cc06c7c0 0x7fa0cc06ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:03.051 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.043+0000 7fa0ed1f2640 1 --2- 172.21.15.52:0/4118673003 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7fa0cc06c7c0 0x7fa0cc06ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:03.051 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.043+0000 7fa0ed1f2640 10 monclient: get_auth_request con 0x7fa0cc06c7c0 auth_method 0 2023-11-05T08:07:03.051 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.043+0000 7fa0ddffb640 10 client.4258.objecter ms_handle_connect 0x7fa0cc06c7c0 2023-11-05T08:07:03.052 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.043+0000 7fa0ed1f2640 1 --2- 172.21.15.52:0/4118673003 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7fa0cc06c7c0 0x7fa0cc06ec80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa0e40017f0 tx=0x7fa0e4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:03.052 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.044+0000 7fa0ddffb640 1 -- 172.21.15.52:0/4118673003 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa0d807a260 con 0x7fa0e80b4230 2023-11-05T08:07:03.052 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.044+0000 7fa0ddffb640 10 client.4258.objecter ms_dispatch 0x7fa0e8000b90 osd_map(19..19 src has 1..19) v4 2023-11-05T08:07:03.052 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.044+0000 7fa0ddffb640 3 client.4258.objecter handle_osd_map got epochs [19,19] > 0 2023-11-05T08:07:03.052 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.044+0000 7fa0ddffb640 3 client.4258.objecter handle_osd_map decoding full epoch 19 2023-11-05T08:07:03.052 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.044+0000 7fa0ddffb640 20 client.4258.objecter dump_active .. 0 homeless 2023-11-05T08:07:03.296 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.296+0000 7fa0ddffb640 1 -- 172.21.15.52:0/4118673003 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa0d80765a0 con 0x7fa0e80b4230 2023-11-05T08:07:03.297 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.296+0000 7fa0ddffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:07:03.297 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.296+0000 7fa0ddffb640 10 monclient: _finish_command 1 = system:0 2023-11-05T08:07:03.513 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.512+0000 7fa0ef456640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2023-11-05T08:07:03.513 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.512+0000 7fa0ef456640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2023-11-05T08:07:03.513 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.512+0000 7fa0ef456640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:07:03.513 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.512+0000 7fa0ef456640 1 -- 172.21.15.52:0/4118673003 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa0e81381a0 con 0x7fa0e80b4230 2023-11-05T08:07:03.609 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.609+0000 7fa0ddffb640 1 -- 172.21.15.52:0/4118673003 <== mon.1 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+12802 (secure 0 0 0) 0x7fa0d8079bc0 con 0x7fa0e80b4230 2023-11-05T08:07:03.609 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.609+0000 7fa0ddffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2023-11-05T08:07:03.610 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.609+0000 7fa0ddffb640 10 monclient: _finish_command 2 = system:0 2023-11-05T08:07:03.610 INFO:teuthology.misc.health.smithi052.stdout: 2023-11-05T08:07:03.610 INFO:teuthology.misc.health.smithi052.stdout:{"epoch":19,"fsid":"b7fdc914-b520-409f-b9d7-902b05a64252","created":"2023-11-05T08:06:09.361414+0000","modified":"2023-11-05T08:07:01.835791+0000","last_up_change":"2023-11-05T08:06:58.242946+0000","last_in_change":"2023-11-05T08:06:15.124773+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-05T08:06:57.428817+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c95e48e9-832b-4950-b467-9f61d33decc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":61703536},{"type":"v1","addr":"172.21.15.52:6817","nonce":61703536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6818","nonce":61703536},{"type":"v1","addr":"172.21.15.52:6819","nonce":61703536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":61703536},{"type":"v1","addr":"172.21.15.52:6823","nonce":61703536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":61703536},{"type":"v1","addr":"172.21.15.52:6821","nonce":61703536}]},"public_addr":"172.21.15.52:6817/61703536","cluster_addr":"172.21.15.52:6819/61703536","heartbeat_back_addr":"172.21.15.52:6823/61703536","heartbeat_front_addr":"172.21.15.52:6821/61703536","state":["exists","up"]},{"osd":1,"uuid":"82d5dd13-f1f5-4282-8ec8-4d6c273a42c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":544646809},{"type":"v1","addr":"172.21.15.52:6825","nonce":544646809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":544646809},{"type":"v1","addr":"172.21.15.52:6827","nonce":544646809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":544646809},{"type":"v1","addr":"172.21.15.52:6831","nonce":544646809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":544646809},{"type":"v1","addr":"172.21.15.52:6829","nonce":544646809}]},"public_addr":"172.21.15.52:6825/544646809","cluster_addr":"172.21.15.52:6827/544646809","heartbeat_back_addr":"172.21.15.52:6831/544646809","heartbeat_front_addr":"172.21.15.52:6829/544646809","state":["exists","up"]},{"osd":2,"uuid":"2c5ea82d-5534-4437-a76f-e3769d798b17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":495294409},{"type":"v1","addr":"172.21.15.52:6801","nonce":495294409}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":495294409},{"type":"v1","addr":"172.21.15.52:6803","nonce":495294409}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":495294409},{"type":"v1","addr":"172.21.15.52:6807","nonce":495294409}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":495294409},{"type":"v1","addr":"172.21.15.52:6805","nonce":495294409}]},"public_addr":"172.21.15.52:6801/495294409","cluster_addr":"172.21.15.52:6803/495294409","heartbeat_back_addr":"172.21.15.52:6807/495294409","heartbeat_front_addr":"172.21.15.52:6805/495294409","state":["exists","up"]},{"osd":3,"uuid":"9ffcbf5b-1afd-4777-825f-c5fb551b9d88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":3439629566},{"type":"v1","addr":"172.21.15.52:6809","nonce":3439629566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":3439629566},{"type":"v1","addr":"172.21.15.52:6811","nonce":3439629566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":3439629566},{"type":"v1","addr":"172.21.15.52:6815","nonce":3439629566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3439629566},{"type":"v1","addr":"172.21.15.52:6813","nonce":3439629566}]},"public_addr":"172.21.15.52:6809/3439629566","cluster_addr":"172.21.15.52:6811/3439629566","heartbeat_back_addr":"172.21.15.52:6815/3439629566","heartbeat_front_addr":"172.21.15.52:6813/3439629566","state":["exists","up"]},{"osd":4,"uuid":"3f5f9aa4-2015-4835-9b39-faf459a35a49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":3458684008},{"type":"v1","addr":"172.21.15.156:6816","nonce":3458684008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":3458684008},{"type":"v1","addr":"172.21.15.156:6820","nonce":3458684008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":3458684008},{"type":"v1","addr":"172.21.15.156:6825","nonce":3458684008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":3458684008},{"type":"v1","addr":"172.21.15.156:6823","nonce":3458684008}]},"public_addr":"172.21.15.156:6816/3458684008","cluster_addr":"172.21.15.156:6820/3458684008","heartbeat_back_addr":"172.21.15.156:6825/3458684008","heartbeat_front_addr":"172.21.15.156:6823/3458684008","state":["exists","up"]},{"osd":5,"uuid":"cf781fb3-83fb-40e0-86a3-f895d7824edb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":2755763872},{"type":"v1","addr":"172.21.15.156:6811","nonce":2755763872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":2755763872},{"type":"v1","addr":"172.21.15.156:6813","nonce":2755763872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6819","nonce":2755763872},{"type":"v1","addr":"172.21.15.156:6821","nonce":2755763872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6815","nonce":2755763872},{"type":"v1","addr":"172.21.15.156:6817","nonce":2755763872}]},"public_addr":"172.21.15.156:6811/2755763872","cluster_addr":"172.21.15.156:6813/2755763872","heartbeat_back_addr":"172.21.15.156:6821/2755763872","heartbeat_front_addr":"172.21.15.156:6817/2755763872","state":["exists","up"]},{"osd":6,"uuid":"d2787c11-d907-4924-b9cf-69db95ad35c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":2586579514},{"type":"v1","addr":"172.21.15.156:6827","nonce":2586579514}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":2586579514},{"type":"v1","addr":"172.21.15.156:6829","nonce":2586579514}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":2586579514},{"type":"v1","addr":"172.21.15.156:6833","nonce":2586579514}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":2586579514},{"type":"v1","addr":"172.21.15.156:6831","nonce":2586579514}]},"public_addr":"172.21.15.156:6827/2586579514","cluster_addr":"172.21.15.156:6829/2586579514","heartbeat_back_addr":"172.21.15.156:6833/2586579514","heartbeat_front_addr":"172.21.15.156:6831/2586579514","state":["exists","up"]},{"osd":7,"uuid":"e9e51eb8-2a9d-4cd0-9158-a00eea2a5614","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":617205919},{"type":"v1","addr":"172.21.15.156:6803","nonce":617205919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":617205919},{"type":"v1","addr":"172.21.15.156:6805","nonce":617205919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":617205919},{"type":"v1","addr":"172.21.15.156:6809","nonce":617205919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":617205919},{"type":"v1","addr":"172.21.15.156:6807","nonce":617205919}]},"public_addr":"172.21.15.156:6803/617205919","cluster_addr":"172.21.15.156:6805/617205919","heartbeat_back_addr":"172.21.15.156:6809/617205919","heartbeat_front_addr":"172.21.15.156:6807/617205919","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-05T08:06:55.502291+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-05T08:06:55.933520+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-05T08:06:54.412766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-05T08:06:55.414534+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-05T08:06:53.487778+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-05T08:06:53.398349+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-05T08:06:53.054197+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-05T08:06:53.155612+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-05T08:07:03.612 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.611+0000 7fa0ef456640 10 librados: watch_flush enter 2023-11-05T08:07:03.612 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.611+0000 7fa0ef456640 10 librados: watch_flush exit 2023-11-05T08:07:03.612 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.611+0000 7fa0ef456640 20 client.4258.objecter shutdown clearing up homeless session... 2023-11-05T08:07:03.612 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.611+0000 7fa0ef456640 10 client.4258.objecter successfully canceled tick 2023-11-05T08:07:03.612 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.611+0000 7fa0ef456640 1 -- 172.21.15.52:0/4118673003 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7fa0cc06c7c0 msgr2=0x7fa0cc06ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:03.613 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.611+0000 7fa0ef456640 1 --2- 172.21.15.52:0/4118673003 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7fa0cc06c7c0 0x7fa0cc06ec80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa0e40017f0 tx=0x7fa0e4009040 comp rx=0 tx=0).stop 2023-11-05T08:07:03.613 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.611+0000 7fa0ef456640 10 monclient: shutdown 2023-11-05T08:07:03.613 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.611+0000 7fa0ef456640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:07:03.613 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.611+0000 7fa0ef456640 1 -- 172.21.15.52:0/4118673003 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa0e80b4230 msgr2=0x7fa0e81d9800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:03.613 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.611+0000 7fa0ef456640 1 --2- 172.21.15.52:0/4118673003 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa0e80b4230 0x7fa0e81d9800 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa0d8009870 tx=0x7fa0d80046c0 comp rx=0 tx=0).stop 2023-11-05T08:07:03.614 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.611+0000 7fa0ef456640 1 -- 172.21.15.52:0/4118673003 shutdown_connections 2023-11-05T08:07:03.614 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.611+0000 7fa0ef456640 1 --2- 172.21.15.52:0/4118673003 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7fa0cc06c7c0 0x7fa0cc06ec80 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:03.614 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.611+0000 7fa0ef456640 1 --2- 172.21.15.52:0/4118673003 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa0e813f160 0x7fa0e81323b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:03.614 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.611+0000 7fa0ef456640 1 --2- 172.21.15.52:0/4118673003 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa0e80b4230 0x7fa0e81d9800 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:03.614 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.611+0000 7fa0ef456640 1 --2- 172.21.15.52:0/4118673003 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa0e80b1390 0x7fa0e8135390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:03.615 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.611+0000 7fa0ef456640 1 -- 172.21.15.52:0/4118673003 >> 172.21.15.52:0/4118673003 conn(0x7fa0e8071920 msgr2=0x7fa0e8141a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:07:03.615 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.611+0000 7fa0ef456640 1 -- 172.21.15.52:0/4118673003 shutdown_connections 2023-11-05T08:07:03.615 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.611+0000 7fa0ef456640 1 -- 172.21.15.52:0/4118673003 wait complete. 2023-11-05T08:07:03.615 INFO:teuthology.misc.health.smithi052.stderr:2023-11-05T08:07:03.611+0000 7fa0ef456640 1 librados: shutdown 2023-11-05T08:07:03.622 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-11-05T08:07:03.622 INFO:tasks.ceph:Creating RBD pool 2023-11-05T08:07:03.622 DEBUG:teuthology.orchestra.run.smithi052:> sudo ceph --cluster ceph osd pool create rbd 8 2023-11-05T08:07:03.732 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.731+0000 7ff6737f0640 10 monclient: get_monmap_and_config 2023-11-05T08:07:03.732 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.731+0000 7ff6737f0640 10 monclient: build_initial_monmap 2023-11-05T08:07:03.732 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.732+0000 7ff6737f0640 10 monclient: monmap: 2023-11-05T08:07:03.733 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:07:03.733 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:03.733 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:07:03.732522+0000 2023-11-05T08:07:03.733 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:07:03.732522+0000 2023-11-05T08:07:03.733 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:07:03.734 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:03.734 INFO:teuthology.orchestra.run.smithi052.stderr:0: v1:172.21.15.52:6789/0 mon.noname-a-legacy 2023-11-05T08:07:03.734 INFO:teuthology.orchestra.run.smithi052.stderr:1: v1:172.21.15.156:6789/0 mon.noname-c-legacy 2023-11-05T08:07:03.734 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-b 2023-11-05T08:07:03.734 INFO:teuthology.orchestra.run.smithi052.stderr:3: v2:172.21.15.52:3300/0 mon.noname-a 2023-11-05T08:07:03.734 INFO:teuthology.orchestra.run.smithi052.stderr:4: v2:172.21.15.156:3300/0 mon.noname-c 2023-11-05T08:07:03.735 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:03.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.732+0000 7ff6737f0640 1 Processor -- start 2023-11-05T08:07:03.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.732+0000 7ff6737f0640 1 -- start start 2023-11-05T08:07:03.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.732+0000 7ff6737f0640 10 monclient: init 2023-11-05T08:07:03.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.733+0000 7ff6737f0640 10 monclient: _reopen_session rank -1 2023-11-05T08:07:03.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.733+0000 7ff6737f0640 10 monclient: _add_conns ranks=[1,0,3,2,4] 2023-11-05T08:07:03.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.733+0000 7ff6737f0640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7ff66c0b0af0 addr v1:172.21.15.156:6789/0 2023-11-05T08:07:03.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.733+0000 7ff6737f0640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7ff66c0b0ed0 addr v1:172.21.15.52:6789/0 2023-11-05T08:07:03.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.733+0000 7ff6737f0640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff66c0adf00 0x7ff66c0ae7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:03.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.733+0000 7ff6737f0640 10 monclient(hunting): picked mon.noname-a con 0x7ff66c0adf00 addr v2:172.21.15.52:3300/0 2023-11-05T08:07:03.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.733+0000 7ff6737f0640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff66c13f6b0 con 0x7ff66c0b0ed0 2023-11-05T08:07:03.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.733+0000 7ff6737f0640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff66c0b3aa0 con 0x7ff66c0b0af0 2023-11-05T08:07:03.739 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.733+0000 7ff6737f0640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:03.739 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.733+0000 7ff6737f0640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff66c0adda0 con 0x7ff66c0adf00 2023-11-05T08:07:03.739 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.733+0000 7ff6737f0640 10 monclient(hunting): _renew_subs 2023-11-05T08:07:03.739 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.733+0000 7ff6737f0640 10 monclient(hunting): authenticate will time out at 1369.938340s 2023-11-05T08:07:03.739 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.734+0000 7ff67158c640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7ff66c0b0af0 0x7ff66c0ad690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.52:39006/0 (socket says 172.21.15.52:39006) 2023-11-05T08:07:03.739 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.734+0000 7ff67158c640 1 -- 172.21.15.52:0/2567854256 learned_addr learned my addr 172.21.15.52:0/2567854256 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-11-05T08:07:03.740 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.734+0000 7ff671d8d640 1 --2- 172.21.15.52:0/2567854256 >> v2:172.21.15.52:3300/0 conn(0x7ff66c0adf00 0x7ff66c0ae7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:03.740 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.734+0000 7ff671d8d640 10 monclient(hunting): get_auth_request con 0x7ff66c0adf00 auth_method 0 2023-11-05T08:07:03.740 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.734+0000 7ff671d8d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:03.740 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.734+0000 7ff671d8d640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:03.740 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.734+0000 7ff671d8d640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:03.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.735+0000 7ff671d8d640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:03.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.735+0000 7ff671d8d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:03.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.735+0000 7ff671d8d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:03.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.736+0000 7ff663fff640 1 -- 172.21.15.52:0/2567854256 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1459588279 0 0) 0x7ff66c0b3aa0 con 0x7ff66c0b0af0 2023-11-05T08:07:03.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.736+0000 7ff663fff640 10 monclient(hunting): _negotiate 2023-11-05T08:07:03.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.736+0000 7ff663fff640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:03.742 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.736+0000 7ff663fff640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:03.742 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.736+0000 7ff663fff640 10 monclient(hunting): my global_id is 4267 2023-11-05T08:07:03.742 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.736+0000 7ff663fff640 1 -- 172.21.15.52:0/2567854256 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff658003520 con 0x7ff66c0b0af0 2023-11-05T08:07:03.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.738+0000 7ff671d8d640 10 monclient(hunting): handle_auth_done global_id 4248 payload 274 2023-11-05T08:07:03.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.738+0000 7ff671d8d640 1 -- 172.21.15.52:0/2567854256 >> v1:172.21.15.156:6789/0 conn(0x7ff66c0b0af0 legacy=0x7ff66c0ad690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:03.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.738+0000 7ff671d8d640 1 -- 172.21.15.52:0/2567854256 >> v1:172.21.15.52:6789/0 conn(0x7ff66c0b0ed0 legacy=0x7ff66c141ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:03.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.738+0000 7ff671d8d640 10 monclient: _finish_hunting 0 2023-11-05T08:07:03.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.738+0000 7ff671d8d640 1 monclient: found mon.noname-a 2023-11-05T08:07:03.744 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.738+0000 7ff671d8d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:07:03.744 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.738+0000 7ff671d8d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.52:3300/0 2023-11-05T08:07:03.744 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.738+0000 7ff671d8d640 1 -- 172.21.15.52:0/2567854256 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff66c0aee70 con 0x7ff66c0adf00 2023-11-05T08:07:03.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.744+0000 7ff671d8d640 1 --2- 172.21.15.52:0/2567854256 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff66c0adf00 0x7ff66c0ae7e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff664009d90 tx=0x7ff66402beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=815726affbff8f17 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:03.749 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.748+0000 7ff663fff640 1 -- 172.21.15.52:0/2567854256 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff66402cc60 con 0x7ff66c0adf00 2023-11-05T08:07:03.749 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.748+0000 7ff663fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:03.749 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.748+0000 7ff663fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-11-05T08:07:03.749 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.748+0000 7ff663fff640 10 monclient: dump: 2023-11-05T08:07:03.750 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:03.750 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:03.750 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:03.750 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:03.750 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:03.751 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:03.751 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:03.751 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:03.751 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:03.751 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:03.752 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.748+0000 7ff663fff640 10 monclient: _finish_auth 0 2023-11-05T08:07:03.752 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.748+0000 7ff663fff640 10 monclient: _check_auth_tickets 2023-11-05T08:07:03.752 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.748+0000 7ff663fff640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:07:03.752 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.748+0000 7ff663fff640 1 -- 172.21.15.52:0/2567854256 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff66402cdc0 con 0x7ff66c0adf00 2023-11-05T08:07:03.752 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.748+0000 7ff6737f0640 5 monclient: authenticate success, global_id 4248 2023-11-05T08:07:03.753 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.748+0000 7ff6737f0640 20 monclient: get_monmap_and_config waiting for monmap|config 2023-11-05T08:07:03.753 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.748+0000 7ff663fff640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:07:03.753 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.748+0000 7ff6737f0640 10 monclient: get_monmap_and_config success 2023-11-05T08:07:03.753 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.748+0000 7ff663fff640 1 -- 172.21.15.52:0/2567854256 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff664034660 con 0x7ff66c0adf00 2023-11-05T08:07:03.753 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.748+0000 7ff6737f0640 4 set_mon_vals no callback set 2023-11-05T08:07:03.754 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.748+0000 7ff663fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:03.754 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.748+0000 7ff663fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-11-05T08:07:03.754 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.748+0000 7ff663fff640 10 monclient: dump: 2023-11-05T08:07:03.754 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:03.754 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:03.755 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:03.755 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:03.755 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:03.755 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:03.755 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:03.756 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:03.756 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:03.756 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:03.759 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.749+0000 7ff6737f0640 10 monclient: shutdown 2023-11-05T08:07:03.760 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.749+0000 7ff6737f0640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:07:03.760 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.749+0000 7ff6737f0640 1 -- 172.21.15.52:0/2567854256 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff66c0adf00 msgr2=0x7ff66c0ae7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:03.760 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.749+0000 7ff6737f0640 1 --2- 172.21.15.52:0/2567854256 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff66c0adf00 0x7ff66c0ae7e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff664009d90 tx=0x7ff66402beb0 comp rx=0 tx=0).stop 2023-11-05T08:07:03.760 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.749+0000 7ff6737f0640 1 -- 172.21.15.52:0/2567854256 shutdown_connections 2023-11-05T08:07:03.761 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.749+0000 7ff6737f0640 1 --2- 172.21.15.52:0/2567854256 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff66c0adf00 0x7ff66c0ae7e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:03.761 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.749+0000 7ff6737f0640 1 -- 172.21.15.52:0/2567854256 >> 172.21.15.52:0/2567854256 conn(0x7ff66c0b7240 msgr2=0x7ff66c0b7620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:07:03.761 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.749+0000 7ff6737f0640 1 -- 172.21.15.52:0/2567854256 shutdown_connections 2023-11-05T08:07:03.761 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.749+0000 7ff6737f0640 1 -- 172.21.15.52:0/2567854256 wait complete. 2023-11-05T08:07:03.761 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.750+0000 7ff6737f0640 10 monclient: build_initial_monmap 2023-11-05T08:07:03.762 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.750+0000 7ff6737f0640 10 monclient: monmap: 2023-11-05T08:07:03.762 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:07:03.762 INFO:teuthology.orchestra.run.smithi052.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-05T08:07:03.762 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 0.000000 2023-11-05T08:07:03.762 INFO:teuthology.orchestra.run.smithi052.stderr:created 0.000000 2023-11-05T08:07:03.762 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:07:03.763 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:03.763 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.noname-a 2023-11-05T08:07:03.763 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.noname-b 2023-11-05T08:07:03.763 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-c 2023-11-05T08:07:03.763 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:03.764 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.750+0000 7ff6737f0640 1 librados: starting msgr at 2023-11-05T08:07:03.764 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.750+0000 7ff6737f0640 1 librados: starting objecter 2023-11-05T08:07:03.764 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.750+0000 7ff6737f0640 1 Processor -- start 2023-11-05T08:07:03.764 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.750+0000 7ff6737f0640 1 -- start start 2023-11-05T08:07:03.764 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.750+0000 7ff6737f0640 1 librados: setting wanted keys 2023-11-05T08:07:03.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.750+0000 7ff6737f0640 1 librados: calling monclient init 2023-11-05T08:07:03.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.750+0000 7ff6737f0640 10 monclient: init 2023-11-05T08:07:03.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.751+0000 7ff6737f0640 10 monclient: _reopen_session rank -1 2023-11-05T08:07:03.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.751+0000 7ff6737f0640 10 monclient: _add_conns ranks=[1,2,0] 2023-11-05T08:07:03.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.751+0000 7ff6737f0640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff66c0b0af0 0x7ff66c0aca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:03.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.751+0000 7ff6737f0640 10 monclient(hunting): picked mon.noname-b con 0x7ff66c0b0af0 addr [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] 2023-11-05T08:07:03.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.751+0000 7ff6737f0640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff66c1da7f0 0x7ff66c145520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:03.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.751+0000 7ff6737f0640 10 monclient(hunting): picked mon.noname-c con 0x7ff66c1da7f0 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:07:03.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.751+0000 7ff6737f0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff66c1d9b90 0x7ff66c1d6690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:03.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.751+0000 7ff6737f0640 10 monclient(hunting): picked mon.noname-a con 0x7ff66c1d9b90 addr [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] 2023-11-05T08:07:03.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.751+0000 7ff6737f0640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:03.767 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.751+0000 7ff6737f0640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff66c1da010 con 0x7ff66c1d9b90 2023-11-05T08:07:03.767 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.751+0000 7ff6737f0640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:03.767 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.751+0000 7ff6737f0640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff66c1da2d0 con 0x7ff66c0b0af0 2023-11-05T08:07:03.767 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.751+0000 7ff6737f0640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:03.768 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.751+0000 7ff6737f0640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff66c1d6bd0 con 0x7ff66c1da7f0 2023-11-05T08:07:03.768 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.751+0000 7ff6737f0640 10 monclient(hunting): _renew_subs 2023-11-05T08:07:03.768 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.751+0000 7ff6737f0640 10 monclient(hunting): authenticate will time out at 1369.956166s 2023-11-05T08:07:03.768 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.751+0000 7ff670d8b640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff66c1da7f0 0x7ff66c145520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:03.768 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.752+0000 7ff67158c640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff66c0b0af0 0x7ff66c0aca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:03.769 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.752+0000 7ff670d8b640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff66c1da7f0 0x7ff66c145520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.52:47126/0 (socket says 172.21.15.52:47126) 2023-11-05T08:07:03.769 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.752+0000 7ff670d8b640 1 -- 172.21.15.52:0/2827871961 learned_addr learned my addr 172.21.15.52:0/2827871961 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-11-05T08:07:03.769 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.752+0000 7ff670d8b640 10 monclient(hunting): get_auth_request con 0x7ff66c1da7f0 auth_method 0 2023-11-05T08:07:03.769 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.752+0000 7ff670d8b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:03.769 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.752+0000 7ff67158c640 1 --2- 172.21.15.52:0/2827871961 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff66c0b0af0 0x7ff66c0aca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.52:47394/0 (socket says 172.21.15.52:47394) 2023-11-05T08:07:03.770 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.752+0000 7ff670d8b640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:03.770 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.752+0000 7ff670d8b640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:03.770 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.752+0000 7ff67158c640 10 monclient(hunting): get_auth_request con 0x7ff66c0b0af0 auth_method 0 2023-11-05T08:07:03.770 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.752+0000 7ff67158c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:03.770 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.752+0000 7ff67158c640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:03.771 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.752+0000 7ff67158c640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:03.771 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.752+0000 7ff671d8d640 1 --2- 172.21.15.52:0/2827871961 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff66c1d9b90 0x7ff66c1d6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:03.771 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.752+0000 7ff671d8d640 10 monclient(hunting): get_auth_request con 0x7ff66c1d9b90 auth_method 0 2023-11-05T08:07:03.771 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.752+0000 7ff671d8d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:03.771 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.752+0000 7ff671d8d640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:03.772 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.752+0000 7ff671d8d640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:03.772 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.752+0000 7ff67158c640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:03.772 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.752+0000 7ff67158c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:03.772 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.752+0000 7ff67158c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:03.772 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.752+0000 7ff670d8b640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:03.773 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.752+0000 7ff670d8b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:03.773 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.752+0000 7ff670d8b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:03.773 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.753+0000 7ff671d8d640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:03.773 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.753+0000 7ff671d8d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:03.773 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.753+0000 7ff671d8d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:03.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.755+0000 7ff67158c640 10 monclient(hunting): handle_auth_done global_id 4270 payload 824 2023-11-05T08:07:03.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.755+0000 7ff67158c640 1 -- 172.21.15.52:0/2827871961 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff66c1da7f0 msgr2=0x7ff66c145520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:03.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.755+0000 7ff67158c640 1 --2- 172.21.15.52:0/2827871961 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff66c1da7f0 0x7ff66c145520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:03.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.755+0000 7ff67158c640 1 -- 172.21.15.52:0/2827871961 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff66c1d9b90 msgr2=0x7ff66c1d6690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:03.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.755+0000 7ff67158c640 1 --2- 172.21.15.52:0/2827871961 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff66c1d9b90 0x7ff66c1d6690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:03.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.755+0000 7ff67158c640 10 monclient: _finish_hunting 0 2023-11-05T08:07:03.775 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.755+0000 7ff67158c640 1 monclient: found mon.noname-b 2023-11-05T08:07:03.777 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.755+0000 7ff67158c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:07:03.777 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.755+0000 7ff67158c640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.156:3300/0 2023-11-05T08:07:03.778 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.755+0000 7ff67158c640 1 -- 172.21.15.52:0/2827871961 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff664009a70 con 0x7ff66c0b0af0 2023-11-05T08:07:03.778 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.758+0000 7ff67158c640 1 --2- 172.21.15.52:0/2827871961 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff66c0b0af0 0x7ff66c0aca20 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff65c00c430 tx=0x7ff65c00c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:03.778 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.758+0000 7ff661ffb640 10 client.?.objecter ms_handle_connect 0x7ff66c0b0af0 2023-11-05T08:07:03.778 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.758+0000 7ff661ffb640 10 client.?.objecter resend_mon_ops 2023-11-05T08:07:03.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.760+0000 7ff661ffb640 1 -- 172.21.15.52:0/2827871961 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff65c005ce0 con 0x7ff66c0b0af0 2023-11-05T08:07:03.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.760+0000 7ff661ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:03.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.760+0000 7ff661ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-05T08:07:03.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.760+0000 7ff661ffb640 10 monclient: dump: 2023-11-05T08:07:03.780 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:03.781 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:03.781 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:03.781 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:03.781 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:03.781 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:03.782 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:03.782 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:03.782 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:03.782 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:03.782 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.760+0000 7ff661ffb640 10 monclient: _finish_auth 0 2023-11-05T08:07:03.782 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.760+0000 7ff661ffb640 10 monclient: _check_auth_tickets 2023-11-05T08:07:03.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.760+0000 7ff661ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:07:03.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.760+0000 7ff6737f0640 5 monclient: authenticate success, global_id 4270 2023-11-05T08:07:03.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.760+0000 7ff6737f0640 10 monclient: _renew_subs 2023-11-05T08:07:03.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.760+0000 7ff6737f0640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:07:03.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.760+0000 7ff6737f0640 1 -- 172.21.15.52:0/2827871961 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff66c0af510 con 0x7ff66c0b0af0 2023-11-05T08:07:03.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.760+0000 7ff6737f0640 10 client.4270.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-05T08:07:03.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.760+0000 7ff6737f0640 10 monclient: _renew_subs 2023-11-05T08:07:03.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.760+0000 7ff6737f0640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:07:03.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.760+0000 7ff6737f0640 1 -- 172.21.15.52:0/2827871961 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff66c13c580 con 0x7ff66c0b0af0 2023-11-05T08:07:03.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.760+0000 7ff6737f0640 1 librados: init done 2023-11-05T08:07:03.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.761+0000 7ff6737f0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-05T08:07:03.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.761+0000 7ff6737f0640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:07:03.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.761+0000 7ff6737f0640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:07:03.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:03.761+0000 7ff6737f0640 1 -- 172.21.15.52:0/2827871961 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff66c04e9f0 con 0x7ff66c0b0af0 2023-11-05T08:07:04.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:04.009+0000 7ff661ffb640 1 -- 172.21.15.52:0/2827871961 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff65c005e40 con 0x7ff66c0b0af0 2023-11-05T08:07:04.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:04.009+0000 7ff661ffb640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:07:04.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:04.009+0000 7ff661ffb640 1 -- 172.21.15.52:0/2827871961 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff65c007270 con 0x7ff66c0b0af0 2023-11-05T08:07:04.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:04.009+0000 7ff661ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:04.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:04.009+0000 7ff661ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-05T08:07:04.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:04.009+0000 7ff661ffb640 10 monclient: dump: 2023-11-05T08:07:04.011 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:04.011 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:04.012 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:04.012 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:04.012 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:04.012 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:04.012 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:04.013 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:04.013 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:04.013 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:04.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:04.009+0000 7ff6637fe640 4 set_mon_vals no callback set 2023-11-05T08:07:04.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:04.010+0000 7ff661ffb640 1 -- 172.21.15.52:0/2827871961 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 4) v1 ==== 89173+0+0 (secure 0 0 0) 0x7ff65c007490 con 0x7ff66c0b0af0 2023-11-05T08:07:04.015 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:04.010+0000 7ff661ffb640 1 --2- 172.21.15.52:0/2827871961 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7ff65006c770 0x7ff65006ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:04.015 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:04.011+0000 7ff670d8b640 1 --2- 172.21.15.52:0/2827871961 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7ff65006c770 0x7ff65006ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:04.015 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:04.011+0000 7ff670d8b640 10 monclient: get_auth_request con 0x7ff65006c770 auth_method 0 2023-11-05T08:07:04.015 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:04.011+0000 7ff670d8b640 1 --2- 172.21.15.52:0/2827871961 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7ff65006c770 0x7ff65006ec30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff66c0ad570 tx=0x7ff668009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:04.015 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:04.011+0000 7ff661ffb640 10 client.4270.objecter ms_handle_connect 0x7ff65006c770 2023-11-05T08:07:04.016 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:04.013+0000 7ff661ffb640 1 -- 172.21.15.52:0/2827871961 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff65c0581d0 con 0x7ff66c0b0af0 2023-11-05T08:07:04.016 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:04.013+0000 7ff661ffb640 10 client.4270.objecter ms_dispatch 0x7ff66c000b90 osd_map(19..19 src has 1..19) v4 2023-11-05T08:07:04.016 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:04.013+0000 7ff661ffb640 3 client.4270.objecter handle_osd_map got epochs [19,19] > 0 2023-11-05T08:07:04.016 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:04.013+0000 7ff661ffb640 3 client.4270.objecter handle_osd_map decoding full epoch 19 2023-11-05T08:07:04.016 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:04.013+0000 7ff661ffb640 20 client.4270.objecter dump_active .. 0 homeless 2023-11-05T08:07:04.023 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:04.023+0000 7ff661ffb640 1 -- 172.21.15.52:0/2827871961 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff65c054510 con 0x7ff66c0b0af0 2023-11-05T08:07:04.023 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:04.023+0000 7ff661ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:07:04.024 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:04.023+0000 7ff661ffb640 10 monclient: _finish_command 1 = system:0 2023-11-05T08:07:04.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:04.217+0000 7ff6737f0640 10 start_mon_command cmd=[{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}] 2023-11-05T08:07:04.218 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:04.217+0000 7ff6737f0640 10 monclient: _send_command 2 [{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}] 2023-11-05T08:07:04.218 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:04.217+0000 7ff6737f0640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:07:04.218 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:04.217+0000 7ff6737f0640 1 -- 172.21.15.52:0/2827871961 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7ff66c0b0310 con 0x7ff66c0b0af0 2023-11-05T08:07:05.453 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.453+0000 7ff661ffb640 1 -- 172.21.15.52:0/2827871961 <== mon.1 v2:172.21.15.156:3300/0 7 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff65c0548e0 con 0x7ff66c0b0af0 2023-11-05T08:07:05.654 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.653+0000 7ff661ffb640 1 -- 172.21.15.52:0/2827871961 <== mon.1 v2:172.21.15.156:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v20) v1 ==== 109+0+0 (secure 0 0 0) 0x7ff65c076610 con 0x7ff66c0b0af0 2023-11-05T08:07:05.654 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.653+0000 7ff661ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}] 2023-11-05T08:07:05.654 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.653+0000 7ff661ffb640 10 monclient: _finish_command 2 = system:0 pool 'rbd' created 2023-11-05T08:07:05.655 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'rbd' created 2023-11-05T08:07:05.657 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.656+0000 7ff6737f0640 10 librados: watch_flush enter 2023-11-05T08:07:05.657 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.656+0000 7ff6737f0640 10 librados: watch_flush exit 2023-11-05T08:07:05.657 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.656+0000 7ff6737f0640 20 client.4270.objecter shutdown clearing up homeless session... 2023-11-05T08:07:05.658 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.656+0000 7ff6737f0640 10 client.4270.objecter successfully canceled tick 2023-11-05T08:07:05.658 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.656+0000 7ff6737f0640 1 -- 172.21.15.52:0/2827871961 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7ff65006c770 msgr2=0x7ff65006ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:05.658 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.656+0000 7ff6737f0640 1 --2- 172.21.15.52:0/2827871961 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7ff65006c770 0x7ff65006ec30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff66c0ad570 tx=0x7ff668009040 comp rx=0 tx=0).stop 2023-11-05T08:07:05.658 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.656+0000 7ff6737f0640 10 monclient: shutdown 2023-11-05T08:07:05.658 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.656+0000 7ff6737f0640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:07:05.659 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.656+0000 7ff6737f0640 1 -- 172.21.15.52:0/2827871961 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff66c0b0af0 msgr2=0x7ff66c0aca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:05.659 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.656+0000 7ff6737f0640 1 --2- 172.21.15.52:0/2827871961 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff66c0b0af0 0x7ff66c0aca20 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff65c00c430 tx=0x7ff65c00c8f0 comp rx=0 tx=0).stop 2023-11-05T08:07:05.659 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.656+0000 7ff6737f0640 1 -- 172.21.15.52:0/2827871961 shutdown_connections 2023-11-05T08:07:05.659 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.656+0000 7ff6737f0640 1 --2- 172.21.15.52:0/2827871961 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7ff65006c770 0x7ff65006ec30 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:05.659 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.656+0000 7ff6737f0640 1 --2- 172.21.15.52:0/2827871961 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff66c1d9b90 0x7ff66c1d6690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:05.660 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.656+0000 7ff6737f0640 1 --2- 172.21.15.52:0/2827871961 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff66c1da7f0 0x7ff66c145520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:05.660 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.656+0000 7ff6737f0640 1 --2- 172.21.15.52:0/2827871961 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff66c0b0af0 0x7ff66c0aca20 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:05.660 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.656+0000 7ff6737f0640 1 -- 172.21.15.52:0/2827871961 >> 172.21.15.52:0/2827871961 conn(0x7ff66c0b7240 msgr2=0x7ff66c1413c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:07:05.660 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.656+0000 7ff6737f0640 1 -- 172.21.15.52:0/2827871961 shutdown_connections 2023-11-05T08:07:05.660 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.656+0000 7ff6737f0640 1 -- 172.21.15.52:0/2827871961 wait complete. 2023-11-05T08:07:05.661 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.656+0000 7ff6737f0640 1 librados: shutdown 2023-11-05T08:07:05.671 DEBUG:teuthology.orchestra.run.smithi052:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-11-05T08:07:05.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.787+0000 7f8650cbb640 10 monclient: get_monmap_and_config 2023-11-05T08:07:05.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.787+0000 7f8650cbb640 10 monclient: build_initial_monmap 2023-11-05T08:07:05.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.787+0000 7f8650cbb640 10 monclient: monmap: 2023-11-05T08:07:05.788 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:07:05.789 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:05.789 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:07:05.788203+0000 2023-11-05T08:07:05.789 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:07:05.788203+0000 2023-11-05T08:07:05.789 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:07:05.790 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:05.790 INFO:teuthology.orchestra.run.smithi052.stderr:0: v1:172.21.15.52:6789/0 mon.noname-a-legacy 2023-11-05T08:07:05.790 INFO:teuthology.orchestra.run.smithi052.stderr:1: v1:172.21.15.156:6789/0 mon.noname-c-legacy 2023-11-05T08:07:05.790 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-b 2023-11-05T08:07:05.790 INFO:teuthology.orchestra.run.smithi052.stderr:3: v2:172.21.15.52:3300/0 mon.noname-a 2023-11-05T08:07:05.790 INFO:teuthology.orchestra.run.smithi052.stderr:4: v2:172.21.15.156:3300/0 mon.noname-c 2023-11-05T08:07:05.791 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:05.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.788+0000 7f8650cbb640 1 Processor -- start 2023-11-05T08:07:05.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.788+0000 7f8650cbb640 1 -- start start 2023-11-05T08:07:05.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.788+0000 7f8650cbb640 10 monclient: init 2023-11-05T08:07:05.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.789+0000 7f8650cbb640 10 monclient: _reopen_session rank -1 2023-11-05T08:07:05.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.789+0000 7f8650cbb640 10 monclient: _add_conns ranks=[3,2,4,1,0] 2023-11-05T08:07:05.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.789+0000 7f8650cbb640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f864c0b42c0 0x7f864c0a9210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:05.795 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.789+0000 7f8650cbb640 10 monclient(hunting): picked mon.noname-a con 0x7f864c0b42c0 addr v2:172.21.15.52:3300/0 2023-11-05T08:07:05.795 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.789+0000 7f8650cbb640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f864c0a8770 0x7f864c13ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:05.795 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.789+0000 7f8650cbb640 10 monclient(hunting): picked mon.noname-b con 0x7f864c0a8770 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:07:05.795 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.789+0000 7f8650cbb640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f864c13f130 0x7f864c144f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:05.795 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.789+0000 7f8650cbb640 10 monclient(hunting): picked mon.noname-c con 0x7f864c13f130 addr v2:172.21.15.156:3300/0 2023-11-05T08:07:05.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.789+0000 7f8650cbb640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:05.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.789+0000 7f8650cbb640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f864c0b46a0 con 0x7f864c0b42c0 2023-11-05T08:07:05.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.789+0000 7f8650cbb640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:05.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.789+0000 7f8650cbb640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f864c0a8d00 con 0x7f864c13f130 2023-11-05T08:07:05.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.789+0000 7f8650cbb640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:05.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.789+0000 7f8650cbb640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f864c13f5c0 con 0x7f864c0a8770 2023-11-05T08:07:05.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.789+0000 7f8650cbb640 10 monclient(hunting): _renew_subs 2023-11-05T08:07:05.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.789+0000 7f8650cbb640 10 monclient(hunting): authenticate will time out at 1371.994120s 2023-11-05T08:07:05.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.789+0000 7f8643fff640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f864c0a8770 0x7f864c13ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:05.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.789+0000 7f864a59c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f864c0b42c0 0x7f864c0a9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:05.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.789+0000 7f864ad9d640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f864c13f130 0x7f864c144f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:05.798 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.790+0000 7f8643fff640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f864c0a8770 0x7f864c13ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.52:47134/0 (socket says 172.21.15.52:47134) 2023-11-05T08:07:05.798 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.790+0000 7f8643fff640 1 -- 172.21.15.52:0/3655990606 learned_addr learned my addr 172.21.15.52:0/3655990606 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-11-05T08:07:05.798 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.790+0000 7f8643fff640 10 monclient(hunting): get_auth_request con 0x7f864c0a8770 auth_method 0 2023-11-05T08:07:05.798 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.790+0000 7f8643fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:05.798 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.790+0000 7f8643fff640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:05.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.790+0000 7f8643fff640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:05.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.790+0000 7f864a59c640 10 monclient(hunting): get_auth_request con 0x7f864c0b42c0 auth_method 0 2023-11-05T08:07:05.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.790+0000 7f864a59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:05.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.790+0000 7f864a59c640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:05.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.790+0000 7f864a59c640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:05.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.790+0000 7f864ad9d640 10 monclient(hunting): get_auth_request con 0x7f864c13f130 auth_method 0 2023-11-05T08:07:05.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.790+0000 7f864ad9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:05.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.790+0000 7f864ad9d640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:05.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.790+0000 7f864ad9d640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:05.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.790+0000 7f8643fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:05.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.790+0000 7f8643fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:05.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.790+0000 7f8643fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:05.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.790+0000 7f864ad9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:05.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.790+0000 7f864ad9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:05.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.790+0000 7f864ad9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:05.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.790+0000 7f864a59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:05.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.790+0000 7f864a59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:05.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.791+0000 7f864a59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:05.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.792+0000 7f864ad9d640 10 monclient(hunting): handle_auth_done global_id 4273 payload 274 2023-11-05T08:07:05.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.792+0000 7f864ad9d640 1 -- 172.21.15.52:0/3655990606 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f864c0a8770 msgr2=0x7f864c13ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-05T08:07:05.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.792+0000 7f864ad9d640 1 --2- 172.21.15.52:0/3655990606 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f864c0a8770 0x7f864c13ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:05.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.792+0000 7f864ad9d640 1 -- 172.21.15.52:0/3655990606 >> v2:172.21.15.52:3300/0 conn(0x7f864c0b42c0 msgr2=0x7f864c0a9210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-05T08:07:05.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.792+0000 7f864ad9d640 1 --2- 172.21.15.52:0/3655990606 >> v2:172.21.15.52:3300/0 conn(0x7f864c0b42c0 0x7f864c0a9210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:05.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.792+0000 7f864ad9d640 10 monclient: _finish_hunting 0 2023-11-05T08:07:05.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.792+0000 7f864ad9d640 1 monclient: found mon.noname-c 2023-11-05T08:07:05.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.792+0000 7f864ad9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:07:05.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.792+0000 7f864ad9d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.156:3300/0 2023-11-05T08:07:05.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.792+0000 7f864ad9d640 1 -- 172.21.15.52:0/3655990606 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f864c0ade80 con 0x7f864c13f130 2023-11-05T08:07:05.808 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.794+0000 7f864ad9d640 1 --2- 172.21.15.52:0/3655990606 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f864c13f130 0x7f864c144f60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f864c0aaaf0 tx=0x7f864402bd00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ca46ecdec3dddc4 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:05.809 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.798+0000 7f8649d9b640 1 -- 172.21.15.52:0/3655990606 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f864402cab0 con 0x7f864c13f130 2023-11-05T08:07:05.809 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.798+0000 7f8649d9b640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:05.809 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.798+0000 7f8649d9b640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-11-05T08:07:05.809 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.798+0000 7f8649d9b640 10 monclient: dump: 2023-11-05T08:07:05.809 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:05.810 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:05.810 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:05.810 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:05.810 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:05.810 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:05.811 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:05.811 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:05.811 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:05.811 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:05.811 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.798+0000 7f8649d9b640 10 monclient: _finish_auth 0 2023-11-05T08:07:05.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.798+0000 7f8649d9b640 10 monclient: _check_auth_tickets 2023-11-05T08:07:05.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.798+0000 7f8649d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:07:05.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.799+0000 7f8650cbb640 5 monclient: authenticate success, global_id 4273 2023-11-05T08:07:05.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.798+0000 7f8649d9b640 1 -- 172.21.15.52:0/3655990606 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f864402cc10 con 0x7f864c13f130 2023-11-05T08:07:05.813 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.799+0000 7f8650cbb640 20 monclient: get_monmap_and_config waiting for monmap|config 2023-11-05T08:07:05.813 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.799+0000 7f8649d9b640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:07:05.813 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.799+0000 7f8650cbb640 10 monclient: get_monmap_and_config success 2023-11-05T08:07:05.813 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.799+0000 7f8650cbb640 4 set_mon_vals no callback set 2023-11-05T08:07:05.813 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.799+0000 7f8649d9b640 1 -- 172.21.15.52:0/3655990606 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8644034440 con 0x7f864c13f130 2023-11-05T08:07:05.813 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.799+0000 7f8649d9b640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:05.814 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.799+0000 7f8649d9b640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-05T08:07:05.814 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.799+0000 7f8649d9b640 10 monclient: dump: 2023-11-05T08:07:05.814 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:05.814 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:05.815 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:05.815 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:05.815 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:05.815 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:05.815 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:05.815 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:05.816 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:05.816 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:05.816 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.799+0000 7f8650cbb640 10 monclient: shutdown 2023-11-05T08:07:05.816 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.799+0000 7f8650cbb640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:07:05.816 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.799+0000 7f8650cbb640 1 -- 172.21.15.52:0/3655990606 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f864c13f130 msgr2=0x7f864c144f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:05.816 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.799+0000 7f8650cbb640 1 --2- 172.21.15.52:0/3655990606 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f864c13f130 0x7f864c144f60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f864c0aaaf0 tx=0x7f864402bd00 comp rx=0 tx=0).stop 2023-11-05T08:07:05.817 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.799+0000 7f8650cbb640 1 -- 172.21.15.52:0/3655990606 shutdown_connections 2023-11-05T08:07:05.817 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.800+0000 7f8650cbb640 1 --2- 172.21.15.52:0/3655990606 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f864c13f130 0x7f864c144f60 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:05.817 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.800+0000 7f8650cbb640 1 --2- 172.21.15.52:0/3655990606 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f864c0a8770 0x7f864c13ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:05.817 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.800+0000 7f8650cbb640 1 --2- 172.21.15.52:0/3655990606 >> v2:172.21.15.52:3300/0 conn(0x7f864c0b42c0 0x7f864c0a9210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:05.817 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.800+0000 7f8650cbb640 1 -- 172.21.15.52:0/3655990606 >> 172.21.15.52:0/3655990606 conn(0x7f864c065ee0 msgr2=0x7f864c0662f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:07:05.818 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.800+0000 7f8650cbb640 1 -- 172.21.15.52:0/3655990606 shutdown_connections 2023-11-05T08:07:05.819 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.800+0000 7f8650cbb640 1 -- 172.21.15.52:0/3655990606 wait complete. 2023-11-05T08:07:05.819 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.801+0000 7f8650cbb640 10 monclient: build_initial_monmap 2023-11-05T08:07:05.819 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.801+0000 7f8650cbb640 10 monclient: monmap: 2023-11-05T08:07:05.819 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:07:05.819 INFO:teuthology.orchestra.run.smithi052.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-05T08:07:05.820 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 0.000000 2023-11-05T08:07:05.821 INFO:teuthology.orchestra.run.smithi052.stderr:created 0.000000 2023-11-05T08:07:05.821 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:07:05.821 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:05.822 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.noname-a 2023-11-05T08:07:05.822 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.noname-b 2023-11-05T08:07:05.822 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-c 2023-11-05T08:07:05.822 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:05.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.801+0000 7f8650cbb640 1 librados: starting msgr at 2023-11-05T08:07:05.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.801+0000 7f8650cbb640 1 librados: starting objecter 2023-11-05T08:07:05.823 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.801+0000 7f8650cbb640 1 Processor -- start 2023-11-05T08:07:05.823 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.801+0000 7f8650cbb640 1 -- start start 2023-11-05T08:07:05.823 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.801+0000 7f8650cbb640 1 librados: setting wanted keys 2023-11-05T08:07:05.823 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.801+0000 7f8650cbb640 1 librados: calling monclient init 2023-11-05T08:07:05.823 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.801+0000 7f8650cbb640 10 monclient: init 2023-11-05T08:07:05.824 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.801+0000 7f8650cbb640 10 monclient: _reopen_session rank -1 2023-11-05T08:07:05.824 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.801+0000 7f8650cbb640 10 monclient: _add_conns ranks=[2,1,0] 2023-11-05T08:07:05.824 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.801+0000 7f8650cbb640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f864c0a8770 0x7f864c1da020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:05.824 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.801+0000 7f8650cbb640 10 monclient(hunting): picked mon.noname-c con 0x7f864c0a8770 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:07:05.824 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.801+0000 7f8650cbb640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f864c0b42c0 0x7f864c0ae430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:05.825 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.801+0000 7f8650cbb640 10 monclient(hunting): picked mon.noname-b con 0x7f864c0b42c0 addr [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] 2023-11-05T08:07:05.825 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.801+0000 7f8650cbb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f864c13f130 0x7f864c1d6350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:05.825 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.801+0000 7f8650cbb640 10 monclient(hunting): picked mon.noname-a con 0x7f864c13f130 addr [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] 2023-11-05T08:07:05.825 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.801+0000 7f8650cbb640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:05.825 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.801+0000 7f8650cbb640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f864c1d9b90 con 0x7f864c13f130 2023-11-05T08:07:05.825 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.802+0000 7f8650cbb640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:05.826 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.802+0000 7f8650cbb640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f864c141370 con 0x7f864c0b42c0 2023-11-05T08:07:05.826 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.802+0000 7f8650cbb640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:05.826 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.802+0000 7f8650cbb640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f864c142700 con 0x7f864c0a8770 2023-11-05T08:07:05.826 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.802+0000 7f8650cbb640 10 monclient(hunting): _renew_subs 2023-11-05T08:07:05.826 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.802+0000 7f8650cbb640 10 monclient(hunting): authenticate will time out at 1372.006935s 2023-11-05T08:07:05.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.802+0000 7f864ad9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f864c13f130 0x7f864c1d6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:05.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.802+0000 7f8643fff640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f864c0b42c0 0x7f864c0ae430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:05.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.802+0000 7f864a59c640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f864c0a8770 0x7f864c1da020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:05.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.803+0000 7f864a59c640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f864c0a8770 0x7f864c1da020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.52:47144/0 (socket says 172.21.15.52:47144) 2023-11-05T08:07:05.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.803+0000 7f864a59c640 1 -- 172.21.15.52:0/610769984 learned_addr learned my addr 172.21.15.52:0/610769984 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-11-05T08:07:05.828 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.803+0000 7f864a59c640 10 monclient(hunting): get_auth_request con 0x7f864c0a8770 auth_method 0 2023-11-05T08:07:05.828 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.803+0000 7f864a59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:05.828 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.803+0000 7f864a59c640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:05.828 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.803+0000 7f864a59c640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:05.828 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.803+0000 7f864ad9d640 10 monclient(hunting): get_auth_request con 0x7f864c13f130 auth_method 0 2023-11-05T08:07:05.828 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.803+0000 7f864ad9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:05.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.803+0000 7f864ad9d640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:05.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.803+0000 7f864ad9d640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:05.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.803+0000 7f8643fff640 10 monclient(hunting): get_auth_request con 0x7f864c0b42c0 auth_method 0 2023-11-05T08:07:05.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.803+0000 7f8643fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:05.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.803+0000 7f8643fff640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:05.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.803+0000 7f8643fff640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:05.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.803+0000 7f864a59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:05.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.803+0000 7f864a59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:05.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.803+0000 7f864a59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:05.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.803+0000 7f8643fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:05.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.803+0000 7f8643fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:05.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.803+0000 7f8643fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:05.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.804+0000 7f864ad9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:05.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.804+0000 7f864ad9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:05.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.804+0000 7f864ad9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:05.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.806+0000 7f864a59c640 10 monclient(hunting): handle_auth_done global_id 4205 payload 824 2023-11-05T08:07:05.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.806+0000 7f864a59c640 1 -- 172.21.15.52:0/610769984 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f864c0b42c0 msgr2=0x7f864c0ae430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:05.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.806+0000 7f864a59c640 1 --2- 172.21.15.52:0/610769984 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f864c0b42c0 0x7f864c0ae430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:05.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.806+0000 7f864a59c640 1 -- 172.21.15.52:0/610769984 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f864c13f130 msgr2=0x7f864c1d6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:05.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.806+0000 7f864a59c640 1 --2- 172.21.15.52:0/610769984 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f864c13f130 0x7f864c1d6350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:05.833 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.806+0000 7f864a59c640 10 monclient: _finish_hunting 0 2023-11-05T08:07:05.833 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.806+0000 7f864a59c640 1 monclient: found mon.noname-c 2023-11-05T08:07:05.833 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.806+0000 7f864a59c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:07:05.833 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.806+0000 7f864a59c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.52:3301/0 2023-11-05T08:07:05.833 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.806+0000 7f864a59c640 1 -- 172.21.15.52:0/610769984 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8644009a70 con 0x7f864c0a8770 2023-11-05T08:07:05.835 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.809+0000 7f864a59c640 1 --2- 172.21.15.52:0/610769984 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f864c0a8770 0x7f864c1da020 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f863c00e9b0 tx=0x7f863c00ee70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:05.835 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.809+0000 7f8642ffd640 10 client.?.objecter ms_handle_connect 0x7f864c0a8770 2023-11-05T08:07:05.836 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.809+0000 7f8642ffd640 10 client.?.objecter resend_mon_ops 2023-11-05T08:07:05.836 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.813+0000 7f8642ffd640 1 -- 172.21.15.52:0/610769984 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f863c009670 con 0x7f864c0a8770 2023-11-05T08:07:05.836 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.813+0000 7f8642ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:05.836 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.813+0000 7f8642ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-11-05T08:07:05.836 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.813+0000 7f8642ffd640 10 monclient: dump: 2023-11-05T08:07:05.837 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:05.837 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:05.837 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:05.837 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:05.837 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:05.838 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:05.838 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:05.838 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:05.838 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:05.838 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:05.839 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.813+0000 7f8642ffd640 10 monclient: _finish_auth 0 2023-11-05T08:07:05.839 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.813+0000 7f8642ffd640 10 monclient: _check_auth_tickets 2023-11-05T08:07:05.839 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.813+0000 7f8642ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:07:05.839 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.813+0000 7f8642ffd640 1 -- 172.21.15.52:0/610769984 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f863c00c9a0 con 0x7f864c0a8770 2023-11-05T08:07:05.839 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.813+0000 7f8650cbb640 5 monclient: authenticate success, global_id 4205 2023-11-05T08:07:05.840 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.813+0000 7f8650cbb640 10 monclient: _renew_subs 2023-11-05T08:07:05.840 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.813+0000 7f8650cbb640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.52:3301/0 2023-11-05T08:07:05.840 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.813+0000 7f8650cbb640 1 -- 172.21.15.52:0/610769984 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f864c1da560 con 0x7f864c0a8770 2023-11-05T08:07:05.840 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.813+0000 7f8642ffd640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:07:05.840 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.813+0000 7f8642ffd640 1 -- 172.21.15.52:0/610769984 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f863c00cd50 con 0x7f864c0a8770 2023-11-05T08:07:05.841 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.813+0000 7f8642ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:05.841 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.813+0000 7f8642ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-11-05T08:07:05.841 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.813+0000 7f8642ffd640 10 monclient: dump: 2023-11-05T08:07:05.841 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:05.841 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:05.842 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:05.842 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:05.842 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:05.842 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:05.842 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:05.843 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:05.843 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:05.843 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:05.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.813+0000 7f864959a640 4 set_mon_vals no callback set 2023-11-05T08:07:05.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.813+0000 7f8650cbb640 10 client.4205.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-05T08:07:05.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.813+0000 7f8650cbb640 10 monclient: _renew_subs 2023-11-05T08:07:05.844 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.813+0000 7f8650cbb640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.52:3301/0 2023-11-05T08:07:05.844 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.813+0000 7f8650cbb640 1 -- 172.21.15.52:0/610769984 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f864c0aeb50 con 0x7f864c0a8770 2023-11-05T08:07:05.844 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.813+0000 7f8650cbb640 1 librados: init done 2023-11-05T08:07:05.844 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.813+0000 7f8650cbb640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-05T08:07:05.844 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.813+0000 7f8650cbb640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:07:05.845 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.813+0000 7f8650cbb640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.52:3301/0 2023-11-05T08:07:05.845 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:05.813+0000 7f8650cbb640 1 -- 172.21.15.52:0/610769984 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f864c075530 con 0x7f864c0a8770 2023-11-05T08:07:06.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.090+0000 7f8642ffd640 1 -- 172.21.15.52:0/610769984 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f863c013470 con 0x7f864c0a8770 2023-11-05T08:07:06.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.090+0000 7f8642ffd640 1 --2- 172.21.15.52:0/610769984 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f862c06c800 0x7f862c06ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:06.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.090+0000 7f8643fff640 1 --2- 172.21.15.52:0/610769984 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f862c06c800 0x7f862c06ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:06.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.090+0000 7f8643fff640 10 monclient: get_auth_request con 0x7f862c06c800 auth_method 0 2023-11-05T08:07:06.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.091+0000 7f8643fff640 1 --2- 172.21.15.52:0/610769984 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f862c06c800 0x7f862c06ecc0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f864c1d4120 tx=0x7f8634009240 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:06.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.091+0000 7f8642ffd640 10 client.4205.objecter ms_handle_connect 0x7f862c06c800 2023-11-05T08:07:06.108 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.108+0000 7f8642ffd640 1 -- 172.21.15.52:0/610769984 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5199+0+0 (secure 0 0 0) 0x7f863c058e00 con 0x7f864c0a8770 2023-11-05T08:07:06.108 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.108+0000 7f8642ffd640 10 client.4205.objecter ms_dispatch 0x7f864c000b90 osd_map(20..20 src has 1..20) v4 2023-11-05T08:07:06.109 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.108+0000 7f8642ffd640 3 client.4205.objecter handle_osd_map got epochs [20,20] > 0 2023-11-05T08:07:06.109 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.108+0000 7f8642ffd640 3 client.4205.objecter handle_osd_map decoding full epoch 20 2023-11-05T08:07:06.109 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.108+0000 7f8642ffd640 20 client.4205.objecter dump_active .. 0 homeless 2023-11-05T08:07:06.109 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.108+0000 7f8642ffd640 1 -- 172.21.15.52:0/610769984 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f863c055140 con 0x7f864c0a8770 2023-11-05T08:07:06.109 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.108+0000 7f8642ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:07:06.110 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.108+0000 7f8642ffd640 10 monclient: _finish_command 1 = system:0 2023-11-05T08:07:06.306 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.306+0000 7f8650cbb640 10 start_mon_command cmd=[{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}] 2023-11-05T08:07:06.307 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.306+0000 7f8650cbb640 10 monclient: _send_command 2 [{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}] 2023-11-05T08:07:06.307 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.306+0000 7f8650cbb640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.52:3301/0 2023-11-05T08:07:06.307 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.306+0000 7f8650cbb640 1 -- 172.21.15.52:0/610769984 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f864c142890 con 0x7f864c0a8770 2023-11-05T08:07:06.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.774+0000 7f8642ffd640 1 -- 172.21.15.52:0/610769984 <== mon.2 v2:172.21.15.52:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v21) v1 ==== 173+0+0 (secure 0 0 0) 0x7f863c0170c0 con 0x7f864c0a8770 2023-11-05T08:07:06.775 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.774+0000 7f8642ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}] 2023-11-05T08:07:06.775 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.774+0000 7f8642ffd640 10 monclient: _finish_command 2 = system:0 enabled application 'rbd' on pool 'rbd' 2023-11-05T08:07:06.775 INFO:teuthology.orchestra.run.smithi052.stderr:enabled application 'rbd' on pool 'rbd' 2023-11-05T08:07:06.776 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.775+0000 7f8650cbb640 10 librados: watch_flush enter 2023-11-05T08:07:06.777 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.776+0000 7f8650cbb640 10 librados: watch_flush exit 2023-11-05T08:07:06.777 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.776+0000 7f8650cbb640 20 client.4205.objecter shutdown clearing up homeless session... 2023-11-05T08:07:06.777 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.776+0000 7f8650cbb640 10 client.4205.objecter successfully canceled tick 2023-11-05T08:07:06.777 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.776+0000 7f8650cbb640 1 -- 172.21.15.52:0/610769984 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f862c06c800 msgr2=0x7f862c06ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:06.777 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.776+0000 7f8650cbb640 1 --2- 172.21.15.52:0/610769984 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f862c06c800 0x7f862c06ecc0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f864c1d4120 tx=0x7f8634009240 comp rx=0 tx=0).stop 2023-11-05T08:07:06.778 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.776+0000 7f8650cbb640 10 monclient: shutdown 2023-11-05T08:07:06.778 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.776+0000 7f8650cbb640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:07:06.778 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.776+0000 7f8650cbb640 1 -- 172.21.15.52:0/610769984 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f864c0a8770 msgr2=0x7f864c1da020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:06.778 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.776+0000 7f8650cbb640 1 --2- 172.21.15.52:0/610769984 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f864c0a8770 0x7f864c1da020 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f863c00e9b0 tx=0x7f863c00ee70 comp rx=0 tx=0).stop 2023-11-05T08:07:06.778 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.776+0000 7f8650cbb640 1 -- 172.21.15.52:0/610769984 shutdown_connections 2023-11-05T08:07:06.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.776+0000 7f8650cbb640 1 --2- 172.21.15.52:0/610769984 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f862c06c800 0x7f862c06ecc0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:06.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.776+0000 7f8650cbb640 1 --2- 172.21.15.52:0/610769984 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f864c13f130 0x7f864c1d6350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:06.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.776+0000 7f8650cbb640 1 --2- 172.21.15.52:0/610769984 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f864c0b42c0 0x7f864c0ae430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:06.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.776+0000 7f8650cbb640 1 --2- 172.21.15.52:0/610769984 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f864c0a8770 0x7f864c1da020 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:06.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.776+0000 7f8650cbb640 1 -- 172.21.15.52:0/610769984 >> 172.21.15.52:0/610769984 conn(0x7f864c065ee0 msgr2=0x7f864c0b31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:07:06.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.776+0000 7f8650cbb640 1 -- 172.21.15.52:0/610769984 shutdown_connections 2023-11-05T08:07:06.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.776+0000 7f8650cbb640 1 -- 172.21.15.52:0/610769984 wait complete. 2023-11-05T08:07:06.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.776+0000 7f8650cbb640 1 librados: shutdown 2023-11-05T08:07:06.790 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-11-05T08:07:06.791 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-11-05T08:07:06.791 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-11-05T08:07:06.791 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-11-05T08:07:06.792 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-11-05T08:07:06.898 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.898+0000 7f8470632640 10 monclient: get_monmap_and_config 2023-11-05T08:07:06.899 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.898+0000 7f8470632640 10 monclient: build_initial_monmap 2023-11-05T08:07:06.899 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.898+0000 7f8470632640 10 monclient: monmap: 2023-11-05T08:07:06.899 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:07:06.899 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:06.899 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:07:06.898814+0000 2023-11-05T08:07:06.900 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:07:06.898814+0000 2023-11-05T08:07:06.900 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:07:06.900 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:06.900 INFO:teuthology.orchestra.run.smithi052.stderr:0: v1:172.21.15.52:6789/0 mon.noname-a-legacy 2023-11-05T08:07:06.900 INFO:teuthology.orchestra.run.smithi052.stderr:1: v1:172.21.15.156:6789/0 mon.noname-c-legacy 2023-11-05T08:07:06.901 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-b 2023-11-05T08:07:06.901 INFO:teuthology.orchestra.run.smithi052.stderr:3: v2:172.21.15.52:3300/0 mon.noname-a 2023-11-05T08:07:06.901 INFO:teuthology.orchestra.run.smithi052.stderr:4: v2:172.21.15.156:3300/0 mon.noname-c 2023-11-05T08:07:06.901 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:06.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.898+0000 7f8470632640 1 Processor -- start 2023-11-05T08:07:06.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.898+0000 7f8470632640 1 -- start start 2023-11-05T08:07:06.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.898+0000 7f8470632640 10 monclient: init 2023-11-05T08:07:06.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.899+0000 7f8470632640 10 monclient: _reopen_session rank -1 2023-11-05T08:07:06.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.899+0000 7f8470632640 10 monclient: _add_conns ranks=[2,1,4,3,0] 2023-11-05T08:07:06.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.899+0000 7f8470632640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f84680a8ae0 0x7f846813ec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:06.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.899+0000 7f8470632640 10 monclient(hunting): picked mon.noname-b con 0x7f84680a8ae0 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:07:06.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.899+0000 7f8470632640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f84680a8ec0 addr v1:172.21.15.156:6789/0 2023-11-05T08:07:06.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.899+0000 7f8470632640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f84680b0de0 0x7f846813f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:06.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.899+0000 7f8470632640 10 monclient(hunting): picked mon.noname-c con 0x7f84680b0de0 addr v2:172.21.15.156:3300/0 2023-11-05T08:07:06.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.899+0000 7f8470632640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84680a9600 con 0x7f84680a8ec0 2023-11-05T08:07:06.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.899+0000 7f8470632640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:06.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.899+0000 7f8470632640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84680a9360 con 0x7f84680b0de0 2023-11-05T08:07:06.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.899+0000 7f8470632640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:06.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.899+0000 7f8470632640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84680b80b0 con 0x7f84680a8ae0 2023-11-05T08:07:06.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.899+0000 7f8470632640 10 monclient(hunting): _renew_subs 2023-11-05T08:07:06.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.899+0000 7f8470632640 10 monclient(hunting): authenticate will time out at 1373.104735s 2023-11-05T08:07:06.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.900+0000 7f846e3ce640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f84680a8ae0 0x7f846813ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:06.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.900+0000 7f846ebcf640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f84680b0de0 0x7f846813f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:06.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.900+0000 7f846e3ce640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f84680a8ae0 0x7f846813ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.52:40056/0 (socket says 172.21.15.52:40056) 2023-11-05T08:07:06.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.900+0000 7f846e3ce640 1 -- 172.21.15.52:0/465908655 learned_addr learned my addr 172.21.15.52:0/465908655 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-11-05T08:07:06.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.900+0000 7f846e3ce640 10 monclient(hunting): get_auth_request con 0x7f84680a8ae0 auth_method 0 2023-11-05T08:07:06.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.900+0000 7f846e3ce640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:06.908 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.900+0000 7f846e3ce640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:06.908 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.900+0000 7f846e3ce640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:06.908 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.901+0000 7f846e3ce640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:06.908 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.901+0000 7f846e3ce640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:06.908 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.901+0000 7f846e3ce640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:06.908 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.901+0000 7f846ebcf640 10 monclient(hunting): get_auth_request con 0x7f84680b0de0 auth_method 0 2023-11-05T08:07:06.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.901+0000 7f846ebcf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:06.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.901+0000 7f846ebcf640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:06.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.901+0000 7f846ebcf640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:06.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.902+0000 7f846ebcf640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:06.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.902+0000 7f846ebcf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:06.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.902+0000 7f846ebcf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:06.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.903+0000 7f846e3ce640 10 monclient(hunting): handle_auth_done global_id 4208 payload 274 2023-11-05T08:07:06.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.903+0000 7f846e3ce640 1 -- 172.21.15.52:0/465908655 >> v2:172.21.15.156:3300/0 conn(0x7f84680b0de0 msgr2=0x7f846813f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-05T08:07:06.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.903+0000 7f846e3ce640 1 --2- 172.21.15.52:0/465908655 >> v2:172.21.15.156:3300/0 conn(0x7f84680b0de0 0x7f846813f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:06.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.903+0000 7f846e3ce640 1 -- 172.21.15.52:0/465908655 >> v1:172.21.15.156:6789/0 conn(0x7f84680a8ec0 legacy=0x7f8468145000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-05T08:07:06.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.903+0000 7f846e3ce640 10 monclient: _finish_hunting 0 2023-11-05T08:07:06.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.903+0000 7f846e3ce640 1 monclient: found mon.noname-b 2023-11-05T08:07:06.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.903+0000 7f846e3ce640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:07:06.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.903+0000 7f846e3ce640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.52:3301/0 2023-11-05T08:07:06.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.903+0000 7f846e3ce640 1 -- 172.21.15.52:0/465908655 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8468145710 con 0x7f84680a8ae0 2023-11-05T08:07:06.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.905+0000 7f846e3ce640 1 --2- 172.21.15.52:0/465908655 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f84680a8ae0 0x7f846813ec30 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8464009850 tx=0x7f846402b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b5f8aa52d90d003 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:06.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.910+0000 7f846d3cc640 1 -- 172.21.15.52:0/465908655 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8464004230 con 0x7f84680a8ae0 2023-11-05T08:07:06.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.910+0000 7f846d3cc640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:06.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.910+0000 7f846d3cc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-05T08:07:06.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.910+0000 7f846d3cc640 10 monclient: dump: 2023-11-05T08:07:06.914 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:06.915 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:06.915 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:06.915 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:06.915 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:06.915 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:06.915 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:06.916 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:06.916 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:06.916 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:06.916 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.910+0000 7f846d3cc640 10 monclient: _finish_auth 0 2023-11-05T08:07:06.916 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.910+0000 7f846d3cc640 10 monclient: _check_auth_tickets 2023-11-05T08:07:06.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.910+0000 7f846d3cc640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:07:06.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.910+0000 7f846d3cc640 1 -- 172.21.15.52:0/465908655 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8464004390 con 0x7f84680a8ae0 2023-11-05T08:07:06.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.910+0000 7f8470632640 5 monclient: authenticate success, global_id 4208 2023-11-05T08:07:06.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.910+0000 7f8470632640 20 monclient: get_monmap_and_config waiting for monmap|config 2023-11-05T08:07:06.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.910+0000 7f846d3cc640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:07:06.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.910+0000 7f8470632640 10 monclient: get_monmap_and_config success 2023-11-05T08:07:06.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.910+0000 7f8470632640 4 set_mon_vals no callback set 2023-11-05T08:07:06.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.910+0000 7f846d3cc640 1 -- 172.21.15.52:0/465908655 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8464031830 con 0x7f84680a8ae0 2023-11-05T08:07:06.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.910+0000 7f846d3cc640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:06.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.910+0000 7f846d3cc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-11-05T08:07:06.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.910+0000 7f846d3cc640 10 monclient: dump: 2023-11-05T08:07:06.918 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:06.919 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:06.919 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:06.919 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:06.919 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:06.919 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:06.919 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:06.920 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:06.920 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:06.920 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:06.920 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.910+0000 7f8470632640 10 monclient: shutdown 2023-11-05T08:07:06.920 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.910+0000 7f8470632640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:07:06.920 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.910+0000 7f8470632640 1 -- 172.21.15.52:0/465908655 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f84680a8ae0 msgr2=0x7f846813ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:06.921 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.910+0000 7f8470632640 1 --2- 172.21.15.52:0/465908655 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f84680a8ae0 0x7f846813ec30 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8464009850 tx=0x7f846402b8d0 comp rx=0 tx=0).stop 2023-11-05T08:07:06.921 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.911+0000 7f8470632640 1 -- 172.21.15.52:0/465908655 shutdown_connections 2023-11-05T08:07:06.921 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.911+0000 7f8470632640 1 --2- 172.21.15.52:0/465908655 >> v2:172.21.15.156:3300/0 conn(0x7f84680b0de0 0x7f846813f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:06.921 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.911+0000 7f8470632640 1 --2- 172.21.15.52:0/465908655 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f84680a8ae0 0x7f846813ec30 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:06.921 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.911+0000 7f8470632640 1 -- 172.21.15.52:0/465908655 >> 172.21.15.52:0/465908655 conn(0x7f84680b7230 msgr2=0x7f84680b7610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:07:06.921 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.911+0000 7f8470632640 1 -- 172.21.15.52:0/465908655 shutdown_connections 2023-11-05T08:07:06.922 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.911+0000 7f8470632640 1 -- 172.21.15.52:0/465908655 wait complete. 2023-11-05T08:07:06.922 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.911+0000 7f8470632640 10 monclient: build_initial_monmap 2023-11-05T08:07:06.922 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.911+0000 7f8470632640 10 monclient: monmap: 2023-11-05T08:07:06.922 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:07:06.922 INFO:teuthology.orchestra.run.smithi052.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-05T08:07:06.923 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 0.000000 2023-11-05T08:07:06.923 INFO:teuthology.orchestra.run.smithi052.stderr:created 0.000000 2023-11-05T08:07:06.923 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:07:06.923 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:06.923 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.noname-a 2023-11-05T08:07:06.923 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.noname-b 2023-11-05T08:07:06.924 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-c 2023-11-05T08:07:06.924 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:06.924 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.911+0000 7f8470632640 1 librados: starting msgr at 2023-11-05T08:07:06.924 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.911+0000 7f8470632640 1 librados: starting objecter 2023-11-05T08:07:06.924 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.912+0000 7f8470632640 1 Processor -- start 2023-11-05T08:07:06.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.912+0000 7f8470632640 1 -- start start 2023-11-05T08:07:06.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.912+0000 7f8470632640 1 librados: setting wanted keys 2023-11-05T08:07:06.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.912+0000 7f8470632640 1 librados: calling monclient init 2023-11-05T08:07:06.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.912+0000 7f8470632640 10 monclient: init 2023-11-05T08:07:06.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.912+0000 7f8470632640 10 monclient: _reopen_session rank -1 2023-11-05T08:07:06.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.912+0000 7f8470632640 10 monclient: _add_conns ranks=[1,0,2] 2023-11-05T08:07:06.926 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.912+0000 7f8470632640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f84680a8ae0 0x7f84681448f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:06.926 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.912+0000 7f8470632640 10 monclient(hunting): picked mon.noname-b con 0x7f84680a8ae0 addr [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] 2023-11-05T08:07:06.926 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.912+0000 7f8470632640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84680a8ec0 0x7f846812e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:06.926 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.912+0000 7f8470632640 10 monclient(hunting): picked mon.noname-a con 0x7f84680a8ec0 addr [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] 2023-11-05T08:07:06.926 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.912+0000 7f8470632640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f84680b0de0 0x7f846812c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:06.927 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.912+0000 7f8470632640 10 monclient(hunting): picked mon.noname-c con 0x7f84680b0de0 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:07:06.927 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.912+0000 7f8470632640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:06.927 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.912+0000 7f8470632640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84680b5b30 con 0x7f84680a8ec0 2023-11-05T08:07:06.927 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.912+0000 7f8470632640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:06.927 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.912+0000 7f8470632640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f846812e9c0 con 0x7f84680a8ae0 2023-11-05T08:07:06.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.912+0000 7f8470632640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:06.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.912+0000 7f8470632640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84680b5580 con 0x7f84680b0de0 2023-11-05T08:07:06.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.912+0000 7f8470632640 10 monclient(hunting): _renew_subs 2023-11-05T08:07:06.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.912+0000 7f8470632640 10 monclient(hunting): authenticate will time out at 1373.117594s 2023-11-05T08:07:06.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.913+0000 7f846ebcf640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f84680b0de0 0x7f846812c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:06.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.913+0000 7f846dbcd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84680a8ec0 0x7f846812e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:06.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.913+0000 7f846ebcf640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f84680b0de0 0x7f846812c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.52:40064/0 (socket says 172.21.15.52:40064) 2023-11-05T08:07:06.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.913+0000 7f846ebcf640 1 -- 172.21.15.52:0/3380744168 learned_addr learned my addr 172.21.15.52:0/3380744168 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-11-05T08:07:06.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.913+0000 7f846ebcf640 10 monclient(hunting): get_auth_request con 0x7f84680b0de0 auth_method 0 2023-11-05T08:07:06.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.913+0000 7f846ebcf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:06.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.913+0000 7f846ebcf640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:06.930 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.913+0000 7f846ebcf640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:06.930 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.913+0000 7f846e3ce640 1 --2- 172.21.15.52:0/3380744168 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f84680a8ae0 0x7f84681448f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:06.930 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.913+0000 7f846dbcd640 10 monclient(hunting): get_auth_request con 0x7f84680a8ec0 auth_method 0 2023-11-05T08:07:06.930 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.913+0000 7f846dbcd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:06.930 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.913+0000 7f846dbcd640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:06.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.913+0000 7f846dbcd640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:06.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.914+0000 7f846ebcf640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:06.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.914+0000 7f846ebcf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:06.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.914+0000 7f846ebcf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:06.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.914+0000 7f846e3ce640 10 monclient(hunting): get_auth_request con 0x7f84680a8ae0 auth_method 0 2023-11-05T08:07:06.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.914+0000 7f846e3ce640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:06.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.914+0000 7f846e3ce640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:06.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.914+0000 7f846e3ce640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:06.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.914+0000 7f846dbcd640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:06.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.914+0000 7f846dbcd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:06.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.914+0000 7f846dbcd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:06.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.915+0000 7f846e3ce640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:06.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.915+0000 7f846e3ce640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:06.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.915+0000 7f846e3ce640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:06.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.917+0000 7f846ebcf640 10 monclient(hunting): handle_auth_done global_id 4211 payload 824 2023-11-05T08:07:06.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.917+0000 7f846ebcf640 1 -- 172.21.15.52:0/3380744168 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f84680a8ae0 msgr2=0x7f84681448f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:06.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.917+0000 7f846ebcf640 1 --2- 172.21.15.52:0/3380744168 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f84680a8ae0 0x7f84681448f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:06.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.917+0000 7f846ebcf640 1 -- 172.21.15.52:0/3380744168 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84680a8ec0 msgr2=0x7f846812e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:06.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.917+0000 7f846ebcf640 1 --2- 172.21.15.52:0/3380744168 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84680a8ec0 0x7f846812e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:06.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.917+0000 7f846ebcf640 10 monclient: _finish_hunting 0 2023-11-05T08:07:06.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.917+0000 7f846ebcf640 1 monclient: found mon.noname-c 2023-11-05T08:07:06.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.917+0000 7f846ebcf640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:07:06.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.917+0000 7f846ebcf640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.52:3301/0 2023-11-05T08:07:06.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.917+0000 7f846ebcf640 1 -- 172.21.15.52:0/3380744168 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8464009460 con 0x7f84680b0de0 2023-11-05T08:07:06.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.919+0000 7f846ebcf640 1 --2- 172.21.15.52:0/3380744168 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f84680b0de0 0x7f846812c400 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f846000efc0 tx=0x7f846000c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:06.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.919+0000 7f845effd640 10 client.?.objecter ms_handle_connect 0x7f84680b0de0 2023-11-05T08:07:06.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.919+0000 7f845effd640 10 client.?.objecter resend_mon_ops 2023-11-05T08:07:06.944 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.943+0000 7f845effd640 1 -- 172.21.15.52:0/3380744168 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8460014480 con 0x7f84680b0de0 2023-11-05T08:07:06.945 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.943+0000 7f845effd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:06.945 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.943+0000 7f845effd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-11-05T08:07:06.945 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.943+0000 7f845effd640 10 monclient: dump: 2023-11-05T08:07:06.945 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:06.945 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:06.946 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:06.946 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:06.946 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:06.946 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:06.946 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:06.947 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:06.947 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:06.947 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:06.947 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.943+0000 7f845effd640 10 monclient: _finish_auth 0 2023-11-05T08:07:06.947 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.943+0000 7f845effd640 10 monclient: _check_auth_tickets 2023-11-05T08:07:06.947 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.943+0000 7f845effd640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:07:06.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.943+0000 7f845effd640 1 -- 172.21.15.52:0/3380744168 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f846000f040 con 0x7f84680b0de0 2023-11-05T08:07:06.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.943+0000 7f845effd640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:07:06.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.943+0000 7f845effd640 1 -- 172.21.15.52:0/3380744168 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8460014820 con 0x7f84680b0de0 2023-11-05T08:07:06.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.943+0000 7f845effd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:06.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.943+0000 7f845effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-11-05T08:07:06.949 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.943+0000 7f845effd640 10 monclient: dump: 2023-11-05T08:07:06.949 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:06.949 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:06.949 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:06.950 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:06.950 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:06.950 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:06.950 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:06.950 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:06.950 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:06.951 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:06.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.943+0000 7f846cbcb640 4 set_mon_vals no callback set 2023-11-05T08:07:06.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.943+0000 7f8470632640 5 monclient: authenticate success, global_id 4211 2023-11-05T08:07:06.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.943+0000 7f8470632640 10 monclient: _renew_subs 2023-11-05T08:07:06.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.943+0000 7f8470632640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.52:3301/0 2023-11-05T08:07:06.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.943+0000 7f8470632640 1 -- 172.21.15.52:0/3380744168 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84680b57a0 con 0x7f84680b0de0 2023-11-05T08:07:06.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.943+0000 7f8470632640 10 client.4211.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-05T08:07:06.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.943+0000 7f8470632640 10 monclient: _renew_subs 2023-11-05T08:07:06.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.943+0000 7f8470632640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.52:3301/0 2023-11-05T08:07:06.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.943+0000 7f8470632640 1 -- 172.21.15.52:0/3380744168 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f846812cb20 con 0x7f84680b0de0 2023-11-05T08:07:06.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.943+0000 7f8470632640 1 librados: init done 2023-11-05T08:07:06.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.945+0000 7f8470632640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-05T08:07:06.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.945+0000 7f8470632640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:07:06.954 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.945+0000 7f8470632640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.52:3301/0 2023-11-05T08:07:06.954 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:06.945+0000 7f8470632640 1 -- 172.21.15.52:0/3380744168 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84680b6e50 con 0x7f84680b0de0 2023-11-05T08:07:07.252 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:07.252+0000 7f845effd640 1 -- 172.21.15.52:0/3380744168 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8460014980 con 0x7f84680b0de0 2023-11-05T08:07:07.253 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:07.252+0000 7f845effd640 1 --2- 172.21.15.52:0/3380744168 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f844c06c850 0x7f844c06ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:07.258 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:07.258+0000 7f846e3ce640 1 --2- 172.21.15.52:0/3380744168 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f844c06c850 0x7f844c06ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:07.258 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:07.258+0000 7f846e3ce640 10 monclient: get_auth_request con 0x7f844c06c850 auth_method 0 2023-11-05T08:07:07.259 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:07.259+0000 7f846e3ce640 1 --2- 172.21.15.52:0/3380744168 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f844c06c850 0x7f844c06ed10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8464035000 tx=0x7f8464008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:07.259 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:07.259+0000 7f845effd640 10 client.4211.objecter ms_handle_connect 0x7f844c06c850 2023-11-05T08:07:07.277 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:07.276+0000 7f845effd640 1 -- 172.21.15.52:0/3380744168 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f84600594c0 con 0x7f84680b0de0 2023-11-05T08:07:07.277 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:07.276+0000 7f845effd640 10 client.4211.objecter ms_dispatch 0x7f8468000b90 osd_map(21..21 src has 1..21) v4 2023-11-05T08:07:07.277 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:07.276+0000 7f845effd640 3 client.4211.objecter handle_osd_map got epochs [21,21] > 0 2023-11-05T08:07:07.277 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:07.276+0000 7f845effd640 3 client.4211.objecter handle_osd_map decoding full epoch 21 2023-11-05T08:07:07.278 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:07.276+0000 7f845effd640 20 client.4211.objecter dump_active .. 0 homeless 2023-11-05T08:07:07.278 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:07.276+0000 7f845effd640 1 -- 172.21.15.52:0/3380744168 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8460055800 con 0x7f84680b0de0 2023-11-05T08:07:07.278 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:07.276+0000 7f845effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:07:07.278 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:07.276+0000 7f845effd640 10 monclient: _finish_command 1 = system:0 2023-11-05T08:07:07.386 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:01:10.501 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:07:07.444 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:01:10.560 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:07:07.458 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:01:10.571 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:07:07.471 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:01:10.545 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:07:07.518 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:01:10.634 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:07:07.535 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:01:10.610 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:07:07.626 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:07.625+0000 7f8470632640 10 start_mon_command cmd=[{"prefix": "mgr dump", "format": "json"}] 2023-11-05T08:07:07.626 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:07.625+0000 7f8470632640 10 monclient: _send_command 2 [{"prefix": "mgr dump", "format": "json"}] 2023-11-05T08:07:07.626 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:07.625+0000 7f8470632640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.52:3301/0 2023-11-05T08:07:07.626 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:07.625+0000 7f8470632640 1 -- 172.21.15.52:0/3380744168 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f84680b6e50 con 0x7f84680b0de0 2023-11-05T08:07:07.774 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:01:10.848 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:07:07.788 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:01:10.903 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:07:07.797 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:01:10.912 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:07:08.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.072+0000 7f845effd640 1 -- 172.21.15.52:0/3380744168 <== mon.2 v2:172.21.15.52:3301/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+171037 (secure 0 0 0) 0x7f84680b6e50 con 0x7f84680b0de0 2023-11-05T08:07:08.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.072+0000 7f845effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mgr dump", "format": "json"}] 2023-11-05T08:07:08.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.072+0000 7f845effd640 10 monclient: _finish_command 2 = system:0 2023-11-05T08:07:08.076 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:07:08.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.075+0000 7f8470632640 10 librados: watch_flush enter 2023-11-05T08:07:08.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.075+0000 7f8470632640 10 librados: watch_flush exit 2023-11-05T08:07:08.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.075+0000 7f8470632640 20 client.4211.objecter shutdown clearing up homeless session... 2023-11-05T08:07:08.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.075+0000 7f8470632640 10 client.4211.objecter successfully canceled tick 2023-11-05T08:07:08.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.075+0000 7f8470632640 1 -- 172.21.15.52:0/3380744168 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f844c06c850 msgr2=0x7f844c06ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:08.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.075+0000 7f8470632640 1 --2- 172.21.15.52:0/3380744168 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f844c06c850 0x7f844c06ed10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8464035000 tx=0x7f8464008030 comp rx=0 tx=0).stop 2023-11-05T08:07:08.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.075+0000 7f8470632640 10 monclient: shutdown 2023-11-05T08:07:08.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.075+0000 7f8470632640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:07:08.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.075+0000 7f8470632640 1 -- 172.21.15.52:0/3380744168 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f84680b0de0 msgr2=0x7f846812c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:08.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.075+0000 7f8470632640 1 --2- 172.21.15.52:0/3380744168 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f84680b0de0 0x7f846812c400 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f846000efc0 tx=0x7f846000c490 comp rx=0 tx=0).stop 2023-11-05T08:07:08.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.075+0000 7f8470632640 1 -- 172.21.15.52:0/3380744168 shutdown_connections 2023-11-05T08:07:08.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.075+0000 7f8470632640 1 --2- 172.21.15.52:0/3380744168 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f844c06c850 0x7f844c06ed10 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:08.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.075+0000 7f8470632640 1 --2- 172.21.15.52:0/3380744168 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f84680b0de0 0x7f846812c400 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:08.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.075+0000 7f8470632640 1 --2- 172.21.15.52:0/3380744168 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84680a8ec0 0x7f846812e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:08.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.075+0000 7f8470632640 1 --2- 172.21.15.52:0/3380744168 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f84680a8ae0 0x7f84681448f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:08.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.075+0000 7f8470632640 1 -- 172.21.15.52:0/3380744168 >> 172.21.15.52:0/3380744168 conn(0x7f84680b7230 msgr2=0x7f846813bc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:07:08.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.076+0000 7f8470632640 1 -- 172.21.15.52:0/3380744168 shutdown_connections 2023-11-05T08:07:08.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.076+0000 7f8470632640 1 -- 172.21.15.52:0/3380744168 wait complete. 2023-11-05T08:07:08.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.076+0000 7f8470632640 1 librados: shutdown 2023-11-05T08:07:08.087 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":5,"active_gid":4108,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":3320012339},{"type":"v1","addr":"172.21.15.156:6801","nonce":3320012339}]},"active_addr":"172.21.15.156:6801/3320012339","active_change":"2023-11-05T08:06:14.704866+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4098,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.156:0","nonce":3217151445}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.156:0","nonce":3745435653}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.156:0","nonce":2938234788}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.156:0","nonce":2441648645}]}]} 2023-11-05T08:07:08.093 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-11-05T08:07:08.094 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-11-05T08:07:08.094 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-05T08:07:08.205 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.204+0000 7f7fcfc39640 10 monclient: get_monmap_and_config 2023-11-05T08:07:08.205 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.204+0000 7f7fcfc39640 10 monclient: build_initial_monmap 2023-11-05T08:07:08.205 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.204+0000 7f7fcfc39640 10 monclient: monmap: 2023-11-05T08:07:08.206 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:07:08.206 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:08.206 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:07:08.205398+0000 2023-11-05T08:07:08.206 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:07:08.205398+0000 2023-11-05T08:07:08.206 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:07:08.207 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:08.207 INFO:teuthology.orchestra.run.smithi052.stderr:0: v1:172.21.15.52:6789/0 mon.noname-a-legacy 2023-11-05T08:07:08.207 INFO:teuthology.orchestra.run.smithi052.stderr:1: v1:172.21.15.156:6789/0 mon.noname-c-legacy 2023-11-05T08:07:08.207 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-b 2023-11-05T08:07:08.207 INFO:teuthology.orchestra.run.smithi052.stderr:3: v2:172.21.15.52:3300/0 mon.noname-a 2023-11-05T08:07:08.207 INFO:teuthology.orchestra.run.smithi052.stderr:4: v2:172.21.15.156:3300/0 mon.noname-c 2023-11-05T08:07:08.208 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:08.209 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.205+0000 7f7fcfc39640 1 Processor -- start 2023-11-05T08:07:08.209 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.205+0000 7f7fcfc39640 1 -- start start 2023-11-05T08:07:08.209 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.205+0000 7f7fcfc39640 10 monclient: init 2023-11-05T08:07:08.210 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.206+0000 7f7fcfc39640 10 monclient: _reopen_session rank -1 2023-11-05T08:07:08.210 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.206+0000 7f7fcfc39640 10 monclient: _add_conns ranks=[2,0,1,4,3] 2023-11-05T08:07:08.210 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.206+0000 7f7fcfc39640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7fc80a8cc0 0x7f7fc80ad9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:08.210 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.206+0000 7f7fcfc39640 10 monclient(hunting): picked mon.noname-b con 0x7f7fc80a8cc0 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:07:08.210 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.206+0000 7f7fcfc39640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f7fc80adf10 addr v1:172.21.15.52:6789/0 2023-11-05T08:07:08.211 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.206+0000 7f7fcfc39640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f7fc8149bd0 addr v1:172.21.15.156:6789/0 2023-11-05T08:07:08.211 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.206+0000 7f7fcfc39640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fc80acb40 con 0x7f7fc80adf10 2023-11-05T08:07:08.211 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.206+0000 7f7fcfc39640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fc80aabc0 con 0x7f7fc8149bd0 2023-11-05T08:07:08.211 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.206+0000 7f7fcfc39640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:08.211 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.206+0000 7f7fcfc39640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc80aaea0 con 0x7f7fc80a8cc0 2023-11-05T08:07:08.211 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.206+0000 7f7fcfc39640 10 monclient(hunting): _renew_subs 2023-11-05T08:07:08.212 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.206+0000 7f7fcfc39640 10 monclient(hunting): authenticate will time out at 1374.411687s 2023-11-05T08:07:08.212 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.207+0000 7f7fcd1d4640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f7fc80adf10 0x7f7fc81494c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:47016/0 (socket says 172.21.15.52:47016) 2023-11-05T08:07:08.212 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.207+0000 7f7fcd1d4640 1 -- 172.21.15.52:0/2032509488 learned_addr learned my addr 172.21.15.52:0/2032509488 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-11-05T08:07:08.213 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.210+0000 7f7fcc9d3640 1 -- 172.21.15.52:0/2032509488 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4022491584 0 0) 0x7f7fc80acb40 con 0x7f7fc80adf10 2023-11-05T08:07:08.213 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.210+0000 7f7fcc9d3640 10 monclient(hunting): _negotiate 2023-11-05T08:07:08.213 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.210+0000 7f7fcc9d3640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:08.213 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.210+0000 7f7fcc9d3640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:08.213 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.210+0000 7f7fcc9d3640 10 monclient(hunting): my global_id is 4263 2023-11-05T08:07:08.214 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.210+0000 7f7fcc9d3640 1 -- 172.21.15.52:0/2032509488 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7fb4003520 con 0x7f7fc80adf10 2023-11-05T08:07:08.215 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.214+0000 7f7fcc9d3640 1 -- 172.21.15.52:0/2032509488 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1809391794 0 0) 0x7f7fb4003520 con 0x7f7fc80adf10 2023-11-05T08:07:08.215 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.214+0000 7f7fcc9d3640 1 -- 172.21.15.52:0/2032509488 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7fc80a8cc0 msgr2=0x7f7fc80ad9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-05T08:07:08.215 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.214+0000 7f7fcc9d3640 1 --2- 172.21.15.52:0/2032509488 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7fc80a8cc0 0x7f7fc80ad9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:08.215 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.214+0000 7f7fcc9d3640 1 -- 172.21.15.52:0/2032509488 >> v1:172.21.15.156:6789/0 conn(0x7f7fc8149bd0 legacy=0x7f7fc8150990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:08.216 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.214+0000 7f7fcc9d3640 10 monclient: _finish_hunting 0 2023-11-05T08:07:08.216 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.214+0000 7f7fcc9d3640 1 monclient: found mon.noname-a-legacy 2023-11-05T08:07:08.216 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.214+0000 7f7fcc9d3640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:07:08.216 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.214+0000 7f7fcc9d3640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:172.21.15.52:6789/0 2023-11-05T08:07:08.216 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.214+0000 7f7fcc9d3640 1 -- 172.21.15.52:0/2032509488 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fc80ab180 con 0x7f7fc80adf10 2023-11-05T08:07:08.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.214+0000 7f7fcc9d3640 10 monclient: _finish_auth 0 2023-11-05T08:07:08.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.214+0000 7f7fcc9d3640 10 monclient: _check_auth_tickets 2023-11-05T08:07:08.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.214+0000 7f7fcc9d3640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:07:08.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.214+0000 7f7fcc9d3640 1 -- 172.21.15.52:0/2032509488 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2979872170 0 0) 0x7f7fb8001670 con 0x7f7fc80adf10 2023-11-05T08:07:08.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.214+0000 7f7fcc9d3640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:08.218 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.214+0000 7f7fcc9d3640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2023-11-05T08:07:08.218 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.214+0000 7f7fcc9d3640 10 monclient: dump: 2023-11-05T08:07:08.218 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:08.218 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:08.218 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:08.219 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:08.219 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:08.219 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:08.219 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:08.219 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:08.219 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:08.220 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:08.220 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.214+0000 7f7fcc9d3640 1 monclient: mon.a has (v2) addrs [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] but i'm connected to v1:172.21.15.52:6789/0, reconnecting 2023-11-05T08:07:08.220 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.214+0000 7f7fcc9d3640 10 monclient: _reopen_session rank -1 2023-11-05T08:07:08.220 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.214+0000 7f7fcc9d3640 1 -- 172.21.15.52:0/2032509488 >> v1:172.21.15.52:6789/0 conn(0x7f7fc80adf10 legacy=0x7f7fc81494c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:08.221 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.214+0000 7f7fcc9d3640 10 monclient: _add_conns ranks=[1,2,0] 2023-11-05T08:07:08.221 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.214+0000 7f7fcc9d3640 1 --2- 172.21.15.52:0/2032509488 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7fb40039a0 0x7f7fb4003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:08.221 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.214+0000 7f7fcc9d3640 10 monclient(hunting): picked mon.b con 0x7f7fb40039a0 addr [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] 2023-11-05T08:07:08.221 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.214+0000 7f7fcc9d3640 1 --2- 172.21.15.52:0/2032509488 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7fc80a8cc0 0x7f7fb40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:08.221 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.214+0000 7f7fcc9d3640 10 monclient(hunting): picked mon.c con 0x7f7fc80a8cc0 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:07:08.221 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.214+0000 7f7fcc9d3640 1 --2- 172.21.15.52:0/2032509488 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7fb4004dd0 0x7f7fb4005250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:08.222 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.214+0000 7f7fcc9d3640 10 monclient(hunting): picked mon.a con 0x7f7fb4004dd0 addr [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] 2023-11-05T08:07:08.222 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.214+0000 7f7fcc9d3640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:08.223 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.214+0000 7f7fcc9d3640 1 -- 172.21.15.52:0/2032509488 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc80aaea0 con 0x7f7fb4004dd0 2023-11-05T08:07:08.224 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.214+0000 7f7fcc9d3640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:08.224 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.214+0000 7f7fcc9d3640 1 -- 172.21.15.52:0/2032509488 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb400bbe0 con 0x7f7fb40039a0 2023-11-05T08:07:08.224 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.214+0000 7f7fcc9d3640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:08.224 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.214+0000 7f7fcc9d3640 1 -- 172.21.15.52:0/2032509488 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb400bda0 con 0x7f7fc80a8cc0 2023-11-05T08:07:08.224 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.214+0000 7f7fcc9d3640 10 monclient(hunting): _renew_subs 2023-11-05T08:07:08.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.214+0000 7f7fcc9d3640 10 monclient(hunting): _finish_auth 0 2023-11-05T08:07:08.227 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.215+0000 7f7fcd9d5640 1 --2- 172.21.15.52:0/2032509488 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7fb40039a0 0x7f7fb4003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:08.227 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.216+0000 7f7fcd9d5640 10 monclient(hunting): get_auth_request con 0x7f7fb40039a0 auth_method 0 2023-11-05T08:07:08.227 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.216+0000 7f7fcd9d5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:08.227 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.216+0000 7f7fcd9d5640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:08.227 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.216+0000 7f7fcd9d5640 10 monclient(hunting): _init_auth already have auth, reseting 2023-11-05T08:07:08.228 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.217+0000 7f7fcd9d5640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:08.228 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.217+0000 7f7fcd9d5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:08.228 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.217+0000 7f7fcd9d5640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2023-11-05T08:07:08.228 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.218+0000 7f7fce1d6640 1 --2- 172.21.15.52:0/2032509488 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7fb4004dd0 0x7f7fb4005250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:08.228 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.219+0000 7f7fcd9d5640 10 monclient(hunting): handle_auth_done global_id 4263 payload 293 2023-11-05T08:07:08.229 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.219+0000 7f7fcd9d5640 1 -- 172.21.15.52:0/2032509488 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7fc80a8cc0 msgr2=0x7f7fb40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-05T08:07:08.229 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.219+0000 7f7fcd9d5640 1 --2- 172.21.15.52:0/2032509488 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7fc80a8cc0 0x7f7fb40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:08.229 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.219+0000 7f7fcd9d5640 1 -- 172.21.15.52:0/2032509488 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7fb4004dd0 msgr2=0x7f7fb4005250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-05T08:07:08.229 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.219+0000 7f7fcd9d5640 1 --2- 172.21.15.52:0/2032509488 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7fb4004dd0 0x7f7fb4005250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:08.229 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.219+0000 7f7fcd9d5640 10 monclient: _finish_hunting 0 2023-11-05T08:07:08.229 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.219+0000 7f7fcd9d5640 1 monclient: found mon.b 2023-11-05T08:07:08.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.219+0000 7f7fcd9d5640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:07:08.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.219+0000 7f7fcd9d5640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:07:08.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.219+0000 7f7fcd9d5640 1 -- 172.21.15.52:0/2032509488 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fb4003520 con 0x7f7fb40039a0 2023-11-05T08:07:08.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.219+0000 7f7fcd9d5640 10 monclient: _finish_auth 0 2023-11-05T08:07:08.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.219+0000 7f7fcd9d5640 10 monclient: _check_auth_tickets 2023-11-05T08:07:08.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.219+0000 7f7fcd9d5640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:07:08.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.219+0000 7f7fcfc39640 5 monclient: authenticate success, global_id 4263 2023-11-05T08:07:08.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.219+0000 7f7fcfc39640 20 monclient: get_monmap_and_config waiting for monmap|config 2023-11-05T08:07:08.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.221+0000 7f7fcd9d5640 1 --2- 172.21.15.52:0/2032509488 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7fb40039a0 0x7f7fb4003dc0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7fc4009860 tx=0x7f7fb40057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a77366da7500439d server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:08.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.225+0000 7f7fcc9d3640 1 -- 172.21.15.52:0/2032509488 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc4032600 con 0x7f7fb40039a0 2023-11-05T08:07:08.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.225+0000 7f7fcc9d3640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:08.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.225+0000 7f7fcc9d3640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-05T08:07:08.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.225+0000 7f7fcc9d3640 10 monclient: dump: 2023-11-05T08:07:08.232 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:08.232 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:08.232 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:08.233 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:08.234 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:08.234 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:08.234 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:08.234 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:08.235 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:08.235 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:08.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.225+0000 7f7fcc9d3640 1 -- 172.21.15.52:0/2032509488 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fc402e050 con 0x7f7fb40039a0 2023-11-05T08:07:08.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.225+0000 7f7fcc9d3640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:07:08.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.225+0000 7f7fcc9d3640 1 -- 172.21.15.52:0/2032509488 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc4032a00 con 0x7f7fb40039a0 2023-11-05T08:07:08.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.225+0000 7f7fcfc39640 10 monclient: get_monmap_and_config success 2023-11-05T08:07:08.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.225+0000 7f7fcfc39640 4 set_mon_vals no callback set 2023-11-05T08:07:08.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.225+0000 7f7fcc9d3640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:08.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.225+0000 7f7fcc9d3640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-05T08:07:08.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.225+0000 7f7fcc9d3640 10 monclient: dump: 2023-11-05T08:07:08.236 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:08.237 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:08.237 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:08.237 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:08.237 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:08.237 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:08.238 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:08.238 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:08.238 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:08.238 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:08.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.226+0000 7f7fcfc39640 10 monclient: shutdown 2023-11-05T08:07:08.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.226+0000 7f7fcfc39640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:07:08.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.226+0000 7f7fcfc39640 1 -- 172.21.15.52:0/2032509488 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7fb40039a0 msgr2=0x7f7fb4003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:08.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.226+0000 7f7fcfc39640 1 --2- 172.21.15.52:0/2032509488 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7fb40039a0 0x7f7fb4003dc0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7fc4009860 tx=0x7f7fb40057f0 comp rx=0 tx=0).stop 2023-11-05T08:07:08.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.226+0000 7f7fce1d6640 1 -- 172.21.15.52:0/2032509488 reap_dead start 2023-11-05T08:07:08.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.226+0000 7f7fcfc39640 1 -- 172.21.15.52:0/2032509488 shutdown_connections 2023-11-05T08:07:08.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.226+0000 7f7fcfc39640 1 -- 172.21.15.52:0/2032509488 >> 172.21.15.52:0/2032509488 conn(0x7f7fc80b2ff0 msgr2=0x7f7fc80b3400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:07:08.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.226+0000 7f7fcfc39640 1 -- 172.21.15.52:0/2032509488 shutdown_connections 2023-11-05T08:07:08.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.226+0000 7f7fcfc39640 1 -- 172.21.15.52:0/2032509488 wait complete. 2023-11-05T08:07:08.242 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.227+0000 7f7fcfc39640 10 monclient: build_initial_monmap 2023-11-05T08:07:08.242 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.227+0000 7f7fcfc39640 10 monclient: monmap: 2023-11-05T08:07:08.242 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:07:08.243 INFO:teuthology.orchestra.run.smithi052.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-05T08:07:08.243 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 0.000000 2023-11-05T08:07:08.243 INFO:teuthology.orchestra.run.smithi052.stderr:created 0.000000 2023-11-05T08:07:08.243 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:07:08.243 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:08.244 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.noname-a 2023-11-05T08:07:08.244 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.noname-b 2023-11-05T08:07:08.244 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-c 2023-11-05T08:07:08.244 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:08.244 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.227+0000 7f7fcfc39640 1 librados: starting msgr at 2023-11-05T08:07:08.245 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.227+0000 7f7fcfc39640 1 librados: starting objecter 2023-11-05T08:07:08.245 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.228+0000 7f7fcfc39640 1 Processor -- start 2023-11-05T08:07:08.245 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.228+0000 7f7fcfc39640 1 -- start start 2023-11-05T08:07:08.245 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.228+0000 7f7fcfc39640 1 librados: setting wanted keys 2023-11-05T08:07:08.245 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.228+0000 7f7fcfc39640 1 librados: calling monclient init 2023-11-05T08:07:08.246 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.228+0000 7f7fcfc39640 10 monclient: init 2023-11-05T08:07:08.246 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.228+0000 7f7fcfc39640 10 monclient: _reopen_session rank -1 2023-11-05T08:07:08.246 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.228+0000 7f7fcfc39640 10 monclient: _add_conns ranks=[0,1,2] 2023-11-05T08:07:08.246 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.228+0000 7f7fcfc39640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7fb40039a0 0x7f7fc8125600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:08.246 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.228+0000 7f7fcfc39640 10 monclient(hunting): picked mon.noname-a con 0x7f7fb40039a0 addr [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] 2023-11-05T08:07:08.247 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.228+0000 7f7fcfc39640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7fc8070a20 0x7f7fc8126660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:08.247 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.229+0000 7f7fcfc39640 10 monclient(hunting): picked mon.noname-b con 0x7f7fc8070a20 addr [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] 2023-11-05T08:07:08.247 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.229+0000 7f7fcfc39640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7fc8125b90 0x7f7fc81dde10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:08.247 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.229+0000 7f7fcfc39640 10 monclient(hunting): picked mon.noname-c con 0x7f7fc8125b90 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:07:08.247 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.229+0000 7f7fcfc39640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:08.247 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.229+0000 7f7fcfc39640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc81261d0 con 0x7f7fb40039a0 2023-11-05T08:07:08.248 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.229+0000 7f7fcfc39640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:08.248 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.229+0000 7f7fcfc39640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc8124750 con 0x7f7fc8070a20 2023-11-05T08:07:08.248 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.229+0000 7f7fcfc39640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:08.248 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.229+0000 7f7fcfc39640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc81248c0 con 0x7f7fc8125b90 2023-11-05T08:07:08.248 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.229+0000 7f7fcfc39640 10 monclient(hunting): _renew_subs 2023-11-05T08:07:08.249 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.229+0000 7f7fcfc39640 10 monclient(hunting): authenticate will time out at 1374.433966s 2023-11-05T08:07:08.249 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.229+0000 7f7fcd1d4640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7fc8070a20 0x7f7fc8126660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:08.249 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.229+0000 7f7fcd1d4640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7fc8070a20 0x7f7fc8126660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.52:58824/0 (socket says 172.21.15.52:58824) 2023-11-05T08:07:08.249 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.229+0000 7f7fcd1d4640 1 -- 172.21.15.52:0/2123107142 learned_addr learned my addr 172.21.15.52:0/2123107142 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-11-05T08:07:08.249 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.229+0000 7f7fcd1d4640 10 monclient(hunting): get_auth_request con 0x7f7fc8070a20 auth_method 0 2023-11-05T08:07:08.250 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.229+0000 7f7fcd1d4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:08.250 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.229+0000 7f7fcd1d4640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:08.250 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.229+0000 7f7fcd1d4640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:08.250 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.230+0000 7f7fcd1d4640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:08.250 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.230+0000 7f7fcd1d4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:08.250 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.230+0000 7f7fcd1d4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:08.251 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.233+0000 7f7fcd1d4640 10 monclient(hunting): handle_auth_done global_id 4285 payload 824 2023-11-05T08:07:08.251 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.233+0000 7f7fcd1d4640 1 -- 172.21.15.52:0/2123107142 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7fc8125b90 msgr2=0x7f7fc81dde10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:08.251 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.233+0000 7f7fcd1d4640 1 --2- 172.21.15.52:0/2123107142 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7fc8125b90 0x7f7fc81dde10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:08.251 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.233+0000 7f7fcd1d4640 1 -- 172.21.15.52:0/2123107142 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7fb40039a0 msgr2=0x7f7fc8125600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:08.251 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.233+0000 7f7fcd1d4640 1 --2- 172.21.15.52:0/2123107142 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7fb40039a0 0x7f7fc8125600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:08.252 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.233+0000 7f7fcd1d4640 10 monclient: _finish_hunting 0 2023-11-05T08:07:08.252 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.233+0000 7f7fcd1d4640 1 monclient: found mon.noname-b 2023-11-05T08:07:08.252 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.233+0000 7f7fcd1d4640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:07:08.252 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.233+0000 7f7fcd1d4640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.156:3300/0 2023-11-05T08:07:08.252 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.233+0000 7f7fcd1d4640 1 -- 172.21.15.52:0/2123107142 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fc81de350 con 0x7f7fc8070a20 2023-11-05T08:07:08.253 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.237+0000 7f7fcd1d4640 1 --2- 172.21.15.52:0/2123107142 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7fc8070a20 0x7f7fc8126660 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7fb800c7a0 tx=0x7f7fb800cc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:08.253 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.237+0000 7f7fbe7fc640 10 client.?.objecter ms_handle_connect 0x7f7fc8070a20 2023-11-05T08:07:08.253 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.237+0000 7f7fbe7fc640 10 client.?.objecter resend_mon_ops 2023-11-05T08:07:08.297 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.295+0000 7f7fbe7fc640 1 -- 172.21.15.52:0/2123107142 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb80074e0 con 0x7f7fc8070a20 2023-11-05T08:07:08.298 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.295+0000 7f7fbe7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:08.298 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.295+0000 7f7fbe7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-05T08:07:08.298 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.295+0000 7f7fbe7fc640 10 monclient: dump: 2023-11-05T08:07:08.298 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:08.299 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:08.299 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:08.299 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:08.299 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:08.299 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:08.300 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:08.300 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:08.300 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:08.300 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:08.300 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.295+0000 7f7fbe7fc640 10 monclient: _finish_auth 0 2023-11-05T08:07:08.301 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.295+0000 7f7fbe7fc640 10 monclient: _check_auth_tickets 2023-11-05T08:07:08.301 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.295+0000 7f7fbe7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:07:08.301 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.295+0000 7f7fbe7fc640 1 -- 172.21.15.52:0/2123107142 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fb8007640 con 0x7f7fc8070a20 2023-11-05T08:07:08.301 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.295+0000 7f7fbe7fc640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:07:08.301 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.295+0000 7f7fbe7fc640 1 -- 172.21.15.52:0/2123107142 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb8004a20 con 0x7f7fc8070a20 2023-11-05T08:07:08.302 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.295+0000 7f7fcfc39640 5 monclient: authenticate success, global_id 4285 2023-11-05T08:07:08.302 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.295+0000 7f7fcfc39640 10 monclient: _renew_subs 2023-11-05T08:07:08.302 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.295+0000 7f7fcfc39640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:07:08.302 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.295+0000 7f7fcfc39640 1 -- 172.21.15.52:0/2123107142 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fc81de5a0 con 0x7f7fc8070a20 2023-11-05T08:07:08.302 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.295+0000 7f7fbe7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:08.302 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.295+0000 7f7fbffff640 4 set_mon_vals no callback set 2023-11-05T08:07:08.303 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.295+0000 7f7fbe7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-05T08:07:08.303 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.295+0000 7f7fbe7fc640 10 monclient: dump: 2023-11-05T08:07:08.303 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:08.303 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:08.303 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:08.304 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:08.304 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:08.304 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:08.304 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:08.304 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:08.305 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:08.305 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:08.305 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.295+0000 7f7fcfc39640 10 client.4285.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-05T08:07:08.305 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.295+0000 7f7fcfc39640 10 monclient: _renew_subs 2023-11-05T08:07:08.305 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.295+0000 7f7fcfc39640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:07:08.305 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.295+0000 7f7fcfc39640 1 -- 172.21.15.52:0/2123107142 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fc8123440 con 0x7f7fc8070a20 2023-11-05T08:07:08.306 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.295+0000 7f7fcfc39640 1 librados: init done 2023-11-05T08:07:08.306 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.296+0000 7f7fcfc39640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-05T08:07:08.306 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.296+0000 7f7fcfc39640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:07:08.306 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.296+0000 7f7fcfc39640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:07:08.306 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.296+0000 7f7fcfc39640 1 -- 172.21.15.52:0/2123107142 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fc8125fe0 con 0x7f7fc8070a20 2023-11-05T08:07:08.324 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.324+0000 7f7fbe7fc640 1 -- 172.21.15.52:0/2123107142 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7fb8004b80 con 0x7f7fc8070a20 2023-11-05T08:07:08.325 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.324+0000 7f7fbe7fc640 1 --2- 172.21.15.52:0/2123107142 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f7fac06c850 0x7f7fac06ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:08.325 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.324+0000 7f7fcd9d5640 1 --2- 172.21.15.52:0/2123107142 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f7fac06c850 0x7f7fac06ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:08.326 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.324+0000 7f7fcd9d5640 10 monclient: get_auth_request con 0x7f7fac06c850 auth_method 0 2023-11-05T08:07:08.326 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.325+0000 7f7fbe7fc640 10 client.4285.objecter ms_handle_connect 0x7f7fac06c850 2023-11-05T08:07:08.326 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.325+0000 7f7fcd9d5640 1 --2- 172.21.15.52:0/2123107142 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f7fac06c850 0x7f7fac06ed10 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7fc4034000 tx=0x7f7fc402f000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:08.557 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.557+0000 7f7fbe7fc640 1 -- 172.21.15.52:0/2123107142 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f7fb8058830 con 0x7f7fc8070a20 2023-11-05T08:07:08.558 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.557+0000 7f7fbe7fc640 10 client.4285.objecter ms_dispatch 0x7f7fc8000b90 osd_map(22..22 src has 1..22) v4 2023-11-05T08:07:08.558 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.557+0000 7f7fbe7fc640 3 client.4285.objecter handle_osd_map got epochs [22,22] > 0 2023-11-05T08:07:08.558 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.557+0000 7f7fbe7fc640 3 client.4285.objecter handle_osd_map decoding full epoch 22 2023-11-05T08:07:08.558 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.557+0000 7f7fbe7fc640 20 client.4285.objecter dump_active .. 0 homeless 2023-11-05T08:07:08.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.568+0000 7f7fbe7fc640 1 -- 172.21.15.52:0/2123107142 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7fb8057f00 con 0x7f7fc8070a20 2023-11-05T08:07:08.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.569+0000 7f7fbe7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:07:08.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.569+0000 7f7fbe7fc640 10 monclient: _finish_command 1 = system:0 2023-11-05T08:07:08.771 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.771+0000 7f7fcfc39640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2023-11-05T08:07:08.772 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.771+0000 7f7fcfc39640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2023-11-05T08:07:08.772 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.771+0000 7f7fcfc39640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:07:08.772 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.771+0000 7f7fcfc39640 1 -- 172.21.15.52:0/2123107142 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7fc804e9f0 con 0x7f7fc8070a20 2023-11-05T08:07:08.809 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.808+0000 7f7fbe7fc640 1 -- 172.21.15.52:0/2123107142 <== mon.1 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+14627 (secure 0 0 0) 0x7f7fb8018070 con 0x7f7fc8070a20 2023-11-05T08:07:08.809 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.808+0000 7f7fbe7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2023-11-05T08:07:08.809 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.808+0000 7f7fbe7fc640 10 monclient: _finish_command 2 = system:0 2023-11-05T08:07:08.810 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:07:08.810 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":22,"fsid":"b7fdc914-b520-409f-b9d7-902b05a64252","created":"2023-11-05T08:06:09.361414+0000","modified":"2023-11-05T08:07:07.877874+0000","last_up_change":"2023-11-05T08:06:58.242946+0000","last_in_change":"2023-11-05T08:06:15.124773+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-05T08:06:57.428817+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-05T08:07:04.236294+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c95e48e9-832b-4950-b467-9f61d33decc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":61703536},{"type":"v1","addr":"172.21.15.52:6817","nonce":61703536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6818","nonce":61703536},{"type":"v1","addr":"172.21.15.52:6819","nonce":61703536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":61703536},{"type":"v1","addr":"172.21.15.52:6823","nonce":61703536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":61703536},{"type":"v1","addr":"172.21.15.52:6821","nonce":61703536}]},"public_addr":"172.21.15.52:6817/61703536","cluster_addr":"172.21.15.52:6819/61703536","heartbeat_back_addr":"172.21.15.52:6823/61703536","heartbeat_front_addr":"172.21.15.52:6821/61703536","state":["exists","up"]},{"osd":1,"uuid":"82d5dd13-f1f5-4282-8ec8-4d6c273a42c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":544646809},{"type":"v1","addr":"172.21.15.52:6825","nonce":544646809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":544646809},{"type":"v1","addr":"172.21.15.52:6827","nonce":544646809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":544646809},{"type":"v1","addr":"172.21.15.52:6831","nonce":544646809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":544646809},{"type":"v1","addr":"172.21.15.52:6829","nonce":544646809}]},"public_addr":"172.21.15.52:6825/544646809","cluster_addr":"172.21.15.52:6827/544646809","heartbeat_back_addr":"172.21.15.52:6831/544646809","heartbeat_front_addr":"172.21.15.52:6829/544646809","state":["exists","up"]},{"osd":2,"uuid":"2c5ea82d-5534-4437-a76f-e3769d798b17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":495294409},{"type":"v1","addr":"172.21.15.52:6801","nonce":495294409}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":495294409},{"type":"v1","addr":"172.21.15.52:6803","nonce":495294409}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":495294409},{"type":"v1","addr":"172.21.15.52:6807","nonce":495294409}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":495294409},{"type":"v1","addr":"172.21.15.52:6805","nonce":495294409}]},"public_addr":"172.21.15.52:6801/495294409","cluster_addr":"172.21.15.52:6803/495294409","heartbeat_back_addr":"172.21.15.52:6807/495294409","heartbeat_front_addr":"172.21.15.52:6805/495294409","state":["exists","up"]},{"osd":3,"uuid":"9ffcbf5b-1afd-4777-825f-c5fb551b9d88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":3439629566},{"type":"v1","addr":"172.21.15.52:6809","nonce":3439629566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":3439629566},{"type":"v1","addr":"172.21.15.52:6811","nonce":3439629566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":3439629566},{"type":"v1","addr":"172.21.15.52:6815","nonce":3439629566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3439629566},{"type":"v1","addr":"172.21.15.52:6813","nonce":3439629566}]},"public_addr":"172.21.15.52:6809/3439629566","cluster_addr":"172.21.15.52:6811/3439629566","heartbeat_back_addr":"172.21.15.52:6815/3439629566","heartbeat_front_addr":"172.21.15.52:6813/3439629566","state":["exists","up"]},{"osd":4,"uuid":"3f5f9aa4-2015-4835-9b39-faf459a35a49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":3458684008},{"type":"v1","addr":"172.21.15.156:6816","nonce":3458684008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":3458684008},{"type":"v1","addr":"172.21.15.156:6820","nonce":3458684008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":3458684008},{"type":"v1","addr":"172.21.15.156:6825","nonce":3458684008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":3458684008},{"type":"v1","addr":"172.21.15.156:6823","nonce":3458684008}]},"public_addr":"172.21.15.156:6816/3458684008","cluster_addr":"172.21.15.156:6820/3458684008","heartbeat_back_addr":"172.21.15.156:6825/3458684008","heartbeat_front_addr":"172.21.15.156:6823/3458684008","state":["exists","up"]},{"osd":5,"uuid":"cf781fb3-83fb-40e0-86a3-f895d7824edb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":2755763872},{"type":"v1","addr":"172.21.15.156:6811","nonce":2755763872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":2755763872},{"type":"v1","addr":"172.21.15.156:6813","nonce":2755763872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6819","nonce":2755763872},{"type":"v1","addr":"172.21.15.156:6821","nonce":2755763872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6815","nonce":2755763872},{"type":"v1","addr":"172.21.15.156:6817","nonce":2755763872}]},"public_addr":"172.21.15.156:6811/2755763872","cluster_addr":"172.21.15.156:6813/2755763872","heartbeat_back_addr":"172.21.15.156:6821/2755763872","heartbeat_front_addr":"172.21.15.156:6817/2755763872","state":["exists","up"]},{"osd":6,"uuid":"d2787c11-d907-4924-b9cf-69db95ad35c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":2586579514},{"type":"v1","addr":"172.21.15.156:6827","nonce":2586579514}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":2586579514},{"type":"v1","addr":"172.21.15.156:6829","nonce":2586579514}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":2586579514},{"type":"v1","addr":"172.21.15.156:6833","nonce":2586579514}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":2586579514},{"type":"v1","addr":"172.21.15.156:6831","nonce":2586579514}]},"public_addr":"172.21.15.156:6827/2586579514","cluster_addr":"172.21.15.156:6829/2586579514","heartbeat_back_addr":"172.21.15.156:6833/2586579514","heartbeat_front_addr":"172.21.15.156:6831/2586579514","state":["exists","up"]},{"osd":7,"uuid":"e9e51eb8-2a9d-4cd0-9158-a00eea2a5614","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":617205919},{"type":"v1","addr":"172.21.15.156:6803","nonce":617205919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":617205919},{"type":"v1","addr":"172.21.15.156:6805","nonce":617205919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":617205919},{"type":"v1","addr":"172.21.15.156:6809","nonce":617205919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":617205919},{"type":"v1","addr":"172.21.15.156:6807","nonce":617205919}]},"public_addr":"172.21.15.156:6803/617205919","cluster_addr":"172.21.15.156:6805/617205919","heartbeat_back_addr":"172.21.15.156:6809/617205919","heartbeat_front_addr":"172.21.15.156:6807/617205919","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-05T08:06:55.502291+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-05T08:06:55.933520+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-05T08:06:54.412766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-05T08:06:55.414534+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-05T08:06:53.487778+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-05T08:06:53.398349+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-05T08:06:53.054197+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-05T08:06:53.155612+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-05T08:07:08.811 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.810+0000 7f7fcfc39640 10 librados: watch_flush enter 2023-11-05T08:07:08.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.810+0000 7f7fcfc39640 10 librados: watch_flush exit 2023-11-05T08:07:08.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.810+0000 7f7fcfc39640 20 client.4285.objecter shutdown clearing up homeless session... 2023-11-05T08:07:08.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.810+0000 7f7fcfc39640 10 client.4285.objecter successfully canceled tick 2023-11-05T08:07:08.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.810+0000 7f7fcfc39640 1 -- 172.21.15.52:0/2123107142 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f7fac06c850 msgr2=0x7f7fac06ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:08.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.810+0000 7f7fcfc39640 1 --2- 172.21.15.52:0/2123107142 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f7fac06c850 0x7f7fac06ed10 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7fc4034000 tx=0x7f7fc402f000 comp rx=0 tx=0).stop 2023-11-05T08:07:08.813 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.810+0000 7f7fcfc39640 10 monclient: shutdown 2023-11-05T08:07:08.813 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.810+0000 7f7fcfc39640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:07:08.813 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.810+0000 7f7fcfc39640 1 -- 172.21.15.52:0/2123107142 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7fc8070a20 msgr2=0x7f7fc8126660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:08.813 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.810+0000 7f7fcfc39640 1 --2- 172.21.15.52:0/2123107142 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7fc8070a20 0x7f7fc8126660 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7fb800c7a0 tx=0x7f7fb800cc60 comp rx=0 tx=0).stop 2023-11-05T08:07:08.813 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.810+0000 7f7fcfc39640 1 -- 172.21.15.52:0/2123107142 shutdown_connections 2023-11-05T08:07:08.814 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.810+0000 7f7fcfc39640 1 --2- 172.21.15.52:0/2123107142 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f7fac06c850 0x7f7fac06ed10 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:08.814 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.810+0000 7f7fcfc39640 1 --2- 172.21.15.52:0/2123107142 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7fc8125b90 0x7f7fc81dde10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:08.814 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.810+0000 7f7fcfc39640 1 --2- 172.21.15.52:0/2123107142 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7fc8070a20 0x7f7fc8126660 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:08.814 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.810+0000 7f7fcfc39640 1 --2- 172.21.15.52:0/2123107142 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7fb40039a0 0x7f7fc8125600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:08.815 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.810+0000 7f7fcfc39640 1 -- 172.21.15.52:0/2123107142 >> 172.21.15.52:0/2123107142 conn(0x7f7fc80b2ff0 msgr2=0x7f7fc80affe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:07:08.815 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.811+0000 7f7fcfc39640 1 -- 172.21.15.52:0/2123107142 shutdown_connections 2023-11-05T08:07:08.815 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.811+0000 7f7fcfc39640 1 -- 172.21.15.52:0/2123107142 wait complete. 2023-11-05T08:07:08.815 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.811+0000 7f7fcfc39640 1 librados: shutdown 2023-11-05T08:07:08.825 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-11-05T08:07:08.826 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-05T08:07:08.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.931+0000 7fe2f22a9640 10 monclient: get_monmap_and_config 2023-11-05T08:07:08.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.931+0000 7fe2f22a9640 10 monclient: build_initial_monmap 2023-11-05T08:07:08.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.931+0000 7fe2f22a9640 10 monclient: monmap: 2023-11-05T08:07:08.932 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:07:08.933 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:08.933 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:07:08.932229+0000 2023-11-05T08:07:08.933 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:07:08.932229+0000 2023-11-05T08:07:08.933 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:07:08.933 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:08.934 INFO:teuthology.orchestra.run.smithi052.stderr:0: v1:172.21.15.52:6789/0 mon.noname-a-legacy 2023-11-05T08:07:08.934 INFO:teuthology.orchestra.run.smithi052.stderr:1: v1:172.21.15.156:6789/0 mon.noname-c-legacy 2023-11-05T08:07:08.934 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-b 2023-11-05T08:07:08.934 INFO:teuthology.orchestra.run.smithi052.stderr:3: v2:172.21.15.52:3300/0 mon.noname-a 2023-11-05T08:07:08.934 INFO:teuthology.orchestra.run.smithi052.stderr:4: v2:172.21.15.156:3300/0 mon.noname-c 2023-11-05T08:07:08.935 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:08.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.932+0000 7fe2f22a9640 1 Processor -- start 2023-11-05T08:07:08.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.932+0000 7fe2f22a9640 1 -- start start 2023-11-05T08:07:08.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.932+0000 7fe2f22a9640 10 monclient: init 2023-11-05T08:07:08.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.933+0000 7fe2f22a9640 10 monclient: _reopen_session rank -1 2023-11-05T08:07:08.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.933+0000 7fe2f22a9640 10 monclient: _add_conns ranks=[2,0,4,3,1] 2023-11-05T08:07:08.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.933+0000 7fe2f22a9640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe2ec0a8720 0x7fe2ec142430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:08.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.933+0000 7fe2f22a9640 10 monclient(hunting): picked mon.noname-b con 0x7fe2ec0a8720 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:07:08.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.933+0000 7fe2f22a9640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fe2ec141a80 addr v1:172.21.15.52:6789/0 2023-11-05T08:07:08.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.933+0000 7fe2f22a9640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe2ec13ebf0 0x7fe2ec13f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:08.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.933+0000 7fe2f22a9640 10 monclient(hunting): picked mon.noname-c con 0x7fe2ec13ebf0 addr v2:172.21.15.156:3300/0 2023-11-05T08:07:08.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.933+0000 7fe2f22a9640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2ec141fa0 con 0x7fe2ec141a80 2023-11-05T08:07:08.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.933+0000 7fe2f22a9640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:08.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.933+0000 7fe2f22a9640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2ec0a8b00 con 0x7fe2ec13ebf0 2023-11-05T08:07:08.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.933+0000 7fe2f22a9640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:08.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.933+0000 7fe2f22a9640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2ec0aa500 con 0x7fe2ec0a8720 2023-11-05T08:07:08.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.933+0000 7fe2f22a9640 10 monclient(hunting): _renew_subs 2023-11-05T08:07:08.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.933+0000 7fe2f22a9640 10 monclient(hunting): authenticate will time out at 1375.138028s 2023-11-05T08:07:08.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.933+0000 7fe2f0846640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe2ec13ebf0 0x7fe2ec13f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:08.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.933+0000 7fe2eb7fe640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fe2ec141a80 0x7fe2ec0b1c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:47028/0 (socket says 172.21.15.52:47028) 2023-11-05T08:07:08.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.933+0000 7fe2eb7fe640 1 -- 172.21.15.52:0/19384367 learned_addr learned my addr 172.21.15.52:0/19384367 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-11-05T08:07:08.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.934+0000 7fe2f0846640 10 monclient(hunting): get_auth_request con 0x7fe2ec13ebf0 auth_method 0 2023-11-05T08:07:08.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.934+0000 7fe2f0846640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:08.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.934+0000 7fe2f0846640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:08.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.934+0000 7fe2f0846640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:08.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.934+0000 7fe2f0846640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:08.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.934+0000 7fe2f0846640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:08.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.934+0000 7fe2f0846640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:08.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.936+0000 7fe2f0846640 10 monclient(hunting): handle_auth_done global_id 4288 payload 274 2023-11-05T08:07:08.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.936+0000 7fe2f0846640 1 -- 172.21.15.52:0/19384367 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe2ec0a8720 msgr2=0x7fe2ec142430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-05T08:07:08.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.936+0000 7fe2f0846640 1 --2- 172.21.15.52:0/19384367 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe2ec0a8720 0x7fe2ec142430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:08.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.936+0000 7fe2f0846640 1 -- 172.21.15.52:0/19384367 >> v1:172.21.15.52:6789/0 conn(0x7fe2ec141a80 legacy=0x7fe2ec0b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:08.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.936+0000 7fe2f0846640 10 monclient: _finish_hunting 0 2023-11-05T08:07:08.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.936+0000 7fe2f0846640 1 monclient: found mon.noname-c 2023-11-05T08:07:08.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.936+0000 7fe2f0846640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:07:08.944 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.936+0000 7fe2f0846640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.156:3300/0 2023-11-05T08:07:08.944 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.936+0000 7fe2f0846640 1 -- 172.21.15.52:0/19384367 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2ec142970 con 0x7fe2ec13ebf0 2023-11-05T08:07:08.947 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.938+0000 7fe2f0846640 1 --2- 172.21.15.52:0/19384367 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe2ec13ebf0 0x7fe2ec13f080 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe2e4009d90 tx=0x7fe2e402be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7cae3a9fb25e9a63 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:08.947 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.942+0000 7fe2eaffd640 1 -- 172.21.15.52:0/19384367 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e402cbc0 con 0x7fe2ec13ebf0 2023-11-05T08:07:08.947 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.942+0000 7fe2eaffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:08.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.942+0000 7fe2eaffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-11-05T08:07:08.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.942+0000 7fe2eaffd640 10 monclient: dump: 2023-11-05T08:07:08.948 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:08.949 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:08.949 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:08.949 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:08.949 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:08.949 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:08.950 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:08.950 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:08.950 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:08.950 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:08.950 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.942+0000 7fe2eaffd640 10 monclient: _finish_auth 0 2023-11-05T08:07:08.950 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.942+0000 7fe2eaffd640 10 monclient: _check_auth_tickets 2023-11-05T08:07:08.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.942+0000 7fe2eaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:07:08.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.942+0000 7fe2eaffd640 1 -- 172.21.15.52:0/19384367 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2e402cd20 con 0x7fe2ec13ebf0 2023-11-05T08:07:08.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.942+0000 7fe2eaffd640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:07:08.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.942+0000 7fe2eaffd640 1 -- 172.21.15.52:0/19384367 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e4034660 con 0x7fe2ec13ebf0 2023-11-05T08:07:08.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.942+0000 7fe2f22a9640 5 monclient: authenticate success, global_id 4288 2023-11-05T08:07:08.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.942+0000 7fe2f22a9640 10 monclient: get_monmap_and_config success 2023-11-05T08:07:08.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.942+0000 7fe2f22a9640 4 set_mon_vals no callback set 2023-11-05T08:07:08.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.942+0000 7fe2eaffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:08.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.942+0000 7fe2eaffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-05T08:07:08.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.942+0000 7fe2eaffd640 10 monclient: dump: 2023-11-05T08:07:08.953 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:08.953 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:08.953 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:08.953 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:08.953 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:08.953 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:08.954 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:08.954 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:08.954 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:08.954 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:08.954 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.942+0000 7fe2f22a9640 10 monclient: shutdown 2023-11-05T08:07:08.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.942+0000 7fe2f22a9640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:07:08.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.942+0000 7fe2f22a9640 1 -- 172.21.15.52:0/19384367 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe2ec13ebf0 msgr2=0x7fe2ec13f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:08.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.942+0000 7fe2f22a9640 1 --2- 172.21.15.52:0/19384367 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe2ec13ebf0 0x7fe2ec13f080 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe2e4009d90 tx=0x7fe2e402be10 comp rx=0 tx=0).stop 2023-11-05T08:07:08.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.942+0000 7fe2f22a9640 1 -- 172.21.15.52:0/19384367 shutdown_connections 2023-11-05T08:07:08.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.942+0000 7fe2f22a9640 1 --2- 172.21.15.52:0/19384367 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe2ec13ebf0 0x7fe2ec13f080 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:08.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.942+0000 7fe2f22a9640 1 --2- 172.21.15.52:0/19384367 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe2ec0a8720 0x7fe2ec142430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:08.956 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.942+0000 7fe2f22a9640 1 -- 172.21.15.52:0/19384367 >> 172.21.15.52:0/19384367 conn(0x7fe2ec0b7280 msgr2=0x7fe2ec0b7690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:07:08.956 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.942+0000 7fe2f22a9640 1 -- 172.21.15.52:0/19384367 shutdown_connections 2023-11-05T08:07:08.956 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.942+0000 7fe2f22a9640 1 -- 172.21.15.52:0/19384367 wait complete. 2023-11-05T08:07:08.956 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.943+0000 7fe2f22a9640 10 monclient: build_initial_monmap 2023-11-05T08:07:08.956 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.943+0000 7fe2f22a9640 10 monclient: monmap: 2023-11-05T08:07:08.957 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:07:08.957 INFO:teuthology.orchestra.run.smithi052.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-05T08:07:08.957 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 0.000000 2023-11-05T08:07:08.957 INFO:teuthology.orchestra.run.smithi052.stderr:created 0.000000 2023-11-05T08:07:08.957 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:07:08.958 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:08.958 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.noname-a 2023-11-05T08:07:08.958 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.noname-b 2023-11-05T08:07:08.958 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-c 2023-11-05T08:07:08.958 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:08.959 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.943+0000 7fe2f22a9640 1 librados: starting msgr at 2023-11-05T08:07:08.959 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.943+0000 7fe2f22a9640 1 librados: starting objecter 2023-11-05T08:07:08.959 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.943+0000 7fe2f22a9640 1 Processor -- start 2023-11-05T08:07:08.959 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.944+0000 7fe2f22a9640 1 -- start start 2023-11-05T08:07:08.959 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.944+0000 7fe2f22a9640 1 librados: setting wanted keys 2023-11-05T08:07:08.959 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.944+0000 7fe2f22a9640 1 librados: calling monclient init 2023-11-05T08:07:08.960 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.944+0000 7fe2f22a9640 10 monclient: init 2023-11-05T08:07:08.960 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.944+0000 7fe2f22a9640 10 monclient: _reopen_session rank -1 2023-11-05T08:07:08.960 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.944+0000 7fe2f22a9640 10 monclient: _add_conns ranks=[0,1,2] 2023-11-05T08:07:08.960 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.944+0000 7fe2f22a9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe2ec0a8720 0x7fe2ec139a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:08.960 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.944+0000 7fe2f22a9640 10 monclient(hunting): picked mon.noname-a con 0x7fe2ec0a8720 addr [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] 2023-11-05T08:07:08.960 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.944+0000 7fe2f22a9640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe2ec13ebf0 0x7fe2ec13b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:08.961 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.944+0000 7fe2f22a9640 10 monclient(hunting): picked mon.noname-b con 0x7fe2ec13ebf0 addr [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] 2023-11-05T08:07:08.961 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.944+0000 7fe2f22a9640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe2ec131ff0 0x7fe2ec1324a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:08.961 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.944+0000 7fe2f22a9640 10 monclient(hunting): picked mon.noname-c con 0x7fe2ec131ff0 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:07:08.961 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.944+0000 7fe2f22a9640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:08.961 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.944+0000 7fe2f22a9640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2ec0b6c20 con 0x7fe2ec0a8720 2023-11-05T08:07:08.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.944+0000 7fe2f22a9640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:08.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.944+0000 7fe2f22a9640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2ec0b7040 con 0x7fe2ec13ebf0 2023-11-05T08:07:08.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.944+0000 7fe2f22a9640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:08.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.944+0000 7fe2f22a9640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2ec139fb0 con 0x7fe2ec131ff0 2023-11-05T08:07:08.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.944+0000 7fe2f22a9640 10 monclient(hunting): _renew_subs 2023-11-05T08:07:08.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.944+0000 7fe2f22a9640 10 monclient(hunting): authenticate will time out at 1375.149542s 2023-11-05T08:07:08.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.945+0000 7fe2eb7fe640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe2ec13ebf0 0x7fe2ec13b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:08.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.945+0000 7fe2ebfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe2ec0a8720 0x7fe2ec139a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:08.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.945+0000 7fe2eb7fe640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe2ec13ebf0 0x7fe2ec13b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.52:58842/0 (socket says 172.21.15.52:58842) 2023-11-05T08:07:08.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.945+0000 7fe2eb7fe640 1 -- 172.21.15.52:0/2923522235 learned_addr learned my addr 172.21.15.52:0/2923522235 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-11-05T08:07:08.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.945+0000 7fe2eb7fe640 10 monclient(hunting): get_auth_request con 0x7fe2ec13ebf0 auth_method 0 2023-11-05T08:07:08.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.945+0000 7fe2eb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:08.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.945+0000 7fe2eb7fe640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:08.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.945+0000 7fe2eb7fe640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:08.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.945+0000 7fe2ebfff640 10 monclient(hunting): get_auth_request con 0x7fe2ec0a8720 auth_method 0 2023-11-05T08:07:08.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.945+0000 7fe2ebfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:08.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.945+0000 7fe2ebfff640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:08.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.945+0000 7fe2ebfff640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:08.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.945+0000 7fe2eb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:08.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.945+0000 7fe2eb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:08.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.945+0000 7fe2eb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:08.966 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.946+0000 7fe2ebfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:08.966 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.946+0000 7fe2ebfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:08.966 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.946+0000 7fe2ebfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:08.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.948+0000 7fe2eb7fe640 10 monclient(hunting): handle_auth_done global_id 4291 payload 824 2023-11-05T08:07:08.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.948+0000 7fe2eb7fe640 1 -- 172.21.15.52:0/2923522235 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe2ec131ff0 msgr2=0x7fe2ec1324a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:08.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.948+0000 7fe2eb7fe640 1 --2- 172.21.15.52:0/2923522235 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe2ec131ff0 0x7fe2ec1324a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:08.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.948+0000 7fe2eb7fe640 1 -- 172.21.15.52:0/2923522235 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe2ec0a8720 msgr2=0x7fe2ec139a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:08.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.948+0000 7fe2eb7fe640 1 --2- 172.21.15.52:0/2923522235 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe2ec0a8720 0x7fe2ec139a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:08.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.948+0000 7fe2eb7fe640 10 monclient: _finish_hunting 0 2023-11-05T08:07:08.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.948+0000 7fe2eb7fe640 1 monclient: found mon.noname-b 2023-11-05T08:07:08.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.948+0000 7fe2eb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:07:08.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.948+0000 7fe2eb7fe640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.156:3300/0 2023-11-05T08:07:08.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.948+0000 7fe2eb7fe640 1 -- 172.21.15.52:0/2923522235 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2e4009a70 con 0x7fe2ec13ebf0 2023-11-05T08:07:08.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.950+0000 7fe2eb7fe640 1 --2- 172.21.15.52:0/2923522235 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe2ec13ebf0 0x7fe2ec13b7d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe2dc00c480 tx=0x7fe2dc00c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:08.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.950+0000 7fe2e8ff9640 10 client.?.objecter ms_handle_connect 0x7fe2ec13ebf0 2023-11-05T08:07:08.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.950+0000 7fe2e8ff9640 10 client.?.objecter resend_mon_ops 2023-11-05T08:07:08.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.954+0000 7fe2e8ff9640 1 -- 172.21.15.52:0/2923522235 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2dc005ce0 con 0x7fe2ec13ebf0 2023-11-05T08:07:08.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.954+0000 7fe2e8ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:08.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.954+0000 7fe2e8ff9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-05T08:07:08.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.954+0000 7fe2e8ff9640 10 monclient: dump: 2023-11-05T08:07:08.971 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:08.971 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:08.971 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:08.971 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:08.972 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:08.972 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:08.972 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:08.972 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:08.972 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:08.972 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:08.973 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.954+0000 7fe2e8ff9640 10 monclient: _finish_auth 0 2023-11-05T08:07:08.973 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.954+0000 7fe2e8ff9640 10 monclient: _check_auth_tickets 2023-11-05T08:07:08.973 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.954+0000 7fe2e8ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:07:08.973 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.954+0000 7fe2e8ff9640 1 -- 172.21.15.52:0/2923522235 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2dc005e40 con 0x7fe2ec13ebf0 2023-11-05T08:07:08.974 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.954+0000 7fe2e8ff9640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:07:08.974 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.954+0000 7fe2e8ff9640 1 -- 172.21.15.52:0/2923522235 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2dc0072d0 con 0x7fe2ec13ebf0 2023-11-05T08:07:08.974 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.954+0000 7fe2f22a9640 5 monclient: authenticate success, global_id 4291 2023-11-05T08:07:08.974 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.954+0000 7fe2f22a9640 10 monclient: _renew_subs 2023-11-05T08:07:08.974 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.954+0000 7fe2f22a9640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:07:08.975 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.954+0000 7fe2f22a9640 1 -- 172.21.15.52:0/2923522235 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2ec13ad60 con 0x7fe2ec13ebf0 2023-11-05T08:07:08.975 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.954+0000 7fe2e8ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:08.975 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.954+0000 7fe2ea7fc640 4 set_mon_vals no callback set 2023-11-05T08:07:08.975 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.954+0000 7fe2e8ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-05T08:07:08.975 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.954+0000 7fe2e8ff9640 10 monclient: dump: 2023-11-05T08:07:08.975 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:08.976 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:08.976 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:08.976 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:08.976 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:08.976 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:08.977 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:08.977 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:08.977 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:08.977 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:08.977 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.954+0000 7fe2f22a9640 10 client.4291.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-05T08:07:08.978 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.954+0000 7fe2f22a9640 10 monclient: _renew_subs 2023-11-05T08:07:08.978 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.954+0000 7fe2f22a9640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:07:08.978 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.954+0000 7fe2f22a9640 1 -- 172.21.15.52:0/2923522235 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2ec13bd10 con 0x7fe2ec13ebf0 2023-11-05T08:07:08.978 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.954+0000 7fe2f22a9640 1 librados: init done 2023-11-05T08:07:08.978 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.955+0000 7fe2f22a9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-05T08:07:08.978 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.955+0000 7fe2f22a9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:07:08.979 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.955+0000 7fe2f22a9640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:07:08.979 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.955+0000 7fe2f22a9640 1 -- 172.21.15.52:0/2923522235 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2ec0b6d60 con 0x7fe2ec13ebf0 2023-11-05T08:07:08.980 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.973+0000 7fe2e8ff9640 1 -- 172.21.15.52:0/2923522235 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe2dc007430 con 0x7fe2ec13ebf0 2023-11-05T08:07:08.980 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.973+0000 7fe2e8ff9640 1 --2- 172.21.15.52:0/2923522235 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7fe2cc06c850 0x7fe2cc06ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:08.980 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.973+0000 7fe2ebfff640 1 --2- 172.21.15.52:0/2923522235 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7fe2cc06c850 0x7fe2cc06ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:08.981 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.973+0000 7fe2ebfff640 10 monclient: get_auth_request con 0x7fe2cc06c850 auth_method 0 2023-11-05T08:07:08.981 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.974+0000 7fe2e8ff9640 10 client.4291.objecter ms_handle_connect 0x7fe2cc06c850 2023-11-05T08:07:08.981 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.974+0000 7fe2ebfff640 1 --2- 172.21.15.52:0/2923522235 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7fe2cc06c850 0x7fe2cc06ed10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe2d4009990 tx=0x7fe2d4009110 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:08.981 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.975+0000 7fe2e8ff9640 1 -- 172.21.15.52:0/2923522235 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fe2dc057b40 con 0x7fe2ec13ebf0 2023-11-05T08:07:08.981 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.975+0000 7fe2e8ff9640 10 client.4291.objecter ms_dispatch 0x7fe2ec000b90 osd_map(22..22 src has 1..22) v4 2023-11-05T08:07:08.982 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.975+0000 7fe2e8ff9640 3 client.4291.objecter handle_osd_map got epochs [22,22] > 0 2023-11-05T08:07:08.982 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.975+0000 7fe2e8ff9640 3 client.4291.objecter handle_osd_map decoding full epoch 22 2023-11-05T08:07:08.982 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:08.975+0000 7fe2e8ff9640 20 client.4291.objecter dump_active .. 0 homeless 2023-11-05T08:07:09.211 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.209+0000 7fe2e8ff9640 1 -- 172.21.15.52:0/2923522235 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe2dc053e80 con 0x7fe2ec13ebf0 2023-11-05T08:07:09.211 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.209+0000 7fe2e8ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:07:09.211 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.209+0000 7fe2e8ff9640 10 monclient: _finish_command 1 = system:0 2023-11-05T08:07:09.432 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.431+0000 7fe2f22a9640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2023-11-05T08:07:09.433 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.431+0000 7fe2f22a9640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2023-11-05T08:07:09.433 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.431+0000 7fe2f22a9640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:07:09.433 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.431+0000 7fe2f22a9640 1 -- 172.21.15.52:0/2923522235 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe2ec0b6d60 con 0x7fe2ec13ebf0 2023-11-05T08:07:09.459 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.458+0000 7fe2e8ff9640 1 -- 172.21.15.52:0/2923522235 <== mon.1 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+14614 (secure 0 0 0) 0x7fe2dc085930 con 0x7fe2ec13ebf0 2023-11-05T08:07:09.460 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.458+0000 7fe2e8ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2023-11-05T08:07:09.460 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.458+0000 7fe2e8ff9640 10 monclient: _finish_command 2 = system:0 2023-11-05T08:07:09.460 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:07:09.461 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":23,"fsid":"b7fdc914-b520-409f-b9d7-902b05a64252","created":"2023-11-05T08:06:09.361414+0000","modified":"2023-11-05T08:07:09.282599+0000","last_up_change":"2023-11-05T08:06:58.242946+0000","last_in_change":"2023-11-05T08:06:15.124773+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-05T08:06:57.428817+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-05T08:07:04.236294+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c95e48e9-832b-4950-b467-9f61d33decc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":61703536},{"type":"v1","addr":"172.21.15.52:6817","nonce":61703536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6818","nonce":61703536},{"type":"v1","addr":"172.21.15.52:6819","nonce":61703536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":61703536},{"type":"v1","addr":"172.21.15.52:6823","nonce":61703536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":61703536},{"type":"v1","addr":"172.21.15.52:6821","nonce":61703536}]},"public_addr":"172.21.15.52:6817/61703536","cluster_addr":"172.21.15.52:6819/61703536","heartbeat_back_addr":"172.21.15.52:6823/61703536","heartbeat_front_addr":"172.21.15.52:6821/61703536","state":["exists","up"]},{"osd":1,"uuid":"82d5dd13-f1f5-4282-8ec8-4d6c273a42c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":544646809},{"type":"v1","addr":"172.21.15.52:6825","nonce":544646809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":544646809},{"type":"v1","addr":"172.21.15.52:6827","nonce":544646809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":544646809},{"type":"v1","addr":"172.21.15.52:6831","nonce":544646809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":544646809},{"type":"v1","addr":"172.21.15.52:6829","nonce":544646809}]},"public_addr":"172.21.15.52:6825/544646809","cluster_addr":"172.21.15.52:6827/544646809","heartbeat_back_addr":"172.21.15.52:6831/544646809","heartbeat_front_addr":"172.21.15.52:6829/544646809","state":["exists","up"]},{"osd":2,"uuid":"2c5ea82d-5534-4437-a76f-e3769d798b17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":495294409},{"type":"v1","addr":"172.21.15.52:6801","nonce":495294409}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":495294409},{"type":"v1","addr":"172.21.15.52:6803","nonce":495294409}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":495294409},{"type":"v1","addr":"172.21.15.52:6807","nonce":495294409}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":495294409},{"type":"v1","addr":"172.21.15.52:6805","nonce":495294409}]},"public_addr":"172.21.15.52:6801/495294409","cluster_addr":"172.21.15.52:6803/495294409","heartbeat_back_addr":"172.21.15.52:6807/495294409","heartbeat_front_addr":"172.21.15.52:6805/495294409","state":["exists","up"]},{"osd":3,"uuid":"9ffcbf5b-1afd-4777-825f-c5fb551b9d88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":3439629566},{"type":"v1","addr":"172.21.15.52:6809","nonce":3439629566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":3439629566},{"type":"v1","addr":"172.21.15.52:6811","nonce":3439629566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":3439629566},{"type":"v1","addr":"172.21.15.52:6815","nonce":3439629566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3439629566},{"type":"v1","addr":"172.21.15.52:6813","nonce":3439629566}]},"public_addr":"172.21.15.52:6809/3439629566","cluster_addr":"172.21.15.52:6811/3439629566","heartbeat_back_addr":"172.21.15.52:6815/3439629566","heartbeat_front_addr":"172.21.15.52:6813/3439629566","state":["exists","up"]},{"osd":4,"uuid":"3f5f9aa4-2015-4835-9b39-faf459a35a49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":3458684008},{"type":"v1","addr":"172.21.15.156:6816","nonce":3458684008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":3458684008},{"type":"v1","addr":"172.21.15.156:6820","nonce":3458684008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":3458684008},{"type":"v1","addr":"172.21.15.156:6825","nonce":3458684008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":3458684008},{"type":"v1","addr":"172.21.15.156:6823","nonce":3458684008}]},"public_addr":"172.21.15.156:6816/3458684008","cluster_addr":"172.21.15.156:6820/3458684008","heartbeat_back_addr":"172.21.15.156:6825/3458684008","heartbeat_front_addr":"172.21.15.156:6823/3458684008","state":["exists","up"]},{"osd":5,"uuid":"cf781fb3-83fb-40e0-86a3-f895d7824edb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":2755763872},{"type":"v1","addr":"172.21.15.156:6811","nonce":2755763872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":2755763872},{"type":"v1","addr":"172.21.15.156:6813","nonce":2755763872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6819","nonce":2755763872},{"type":"v1","addr":"172.21.15.156:6821","nonce":2755763872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6815","nonce":2755763872},{"type":"v1","addr":"172.21.15.156:6817","nonce":2755763872}]},"public_addr":"172.21.15.156:6811/2755763872","cluster_addr":"172.21.15.156:6813/2755763872","heartbeat_back_addr":"172.21.15.156:6821/2755763872","heartbeat_front_addr":"172.21.15.156:6817/2755763872","state":["exists","up"]},{"osd":6,"uuid":"d2787c11-d907-4924-b9cf-69db95ad35c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":2586579514},{"type":"v1","addr":"172.21.15.156:6827","nonce":2586579514}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":2586579514},{"type":"v1","addr":"172.21.15.156:6829","nonce":2586579514}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":2586579514},{"type":"v1","addr":"172.21.15.156:6833","nonce":2586579514}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":2586579514},{"type":"v1","addr":"172.21.15.156:6831","nonce":2586579514}]},"public_addr":"172.21.15.156:6827/2586579514","cluster_addr":"172.21.15.156:6829/2586579514","heartbeat_back_addr":"172.21.15.156:6833/2586579514","heartbeat_front_addr":"172.21.15.156:6831/2586579514","state":["exists","up"]},{"osd":7,"uuid":"e9e51eb8-2a9d-4cd0-9158-a00eea2a5614","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":617205919},{"type":"v1","addr":"172.21.15.156:6803","nonce":617205919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":617205919},{"type":"v1","addr":"172.21.15.156:6805","nonce":617205919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":617205919},{"type":"v1","addr":"172.21.15.156:6809","nonce":617205919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":617205919},{"type":"v1","addr":"172.21.15.156:6807","nonce":617205919}]},"public_addr":"172.21.15.156:6803/617205919","cluster_addr":"172.21.15.156:6805/617205919","heartbeat_back_addr":"172.21.15.156:6809/617205919","heartbeat_front_addr":"172.21.15.156:6807/617205919","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-05T08:06:55.502291+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-05T08:06:55.933520+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-05T08:06:54.412766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-05T08:06:55.414534+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-05T08:06:53.487778+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-05T08:06:53.398349+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-05T08:06:53.054197+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-05T08:06:53.155612+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-05T08:07:09.463 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.460+0000 7fe2f22a9640 10 librados: watch_flush enter 2023-11-05T08:07:09.463 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.460+0000 7fe2f22a9640 10 librados: watch_flush exit 2023-11-05T08:07:09.463 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.460+0000 7fe2f22a9640 20 client.4291.objecter shutdown clearing up homeless session... 2023-11-05T08:07:09.463 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.460+0000 7fe2f22a9640 10 client.4291.objecter successfully canceled tick 2023-11-05T08:07:09.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.461+0000 7fe2f22a9640 1 -- 172.21.15.52:0/2923522235 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7fe2cc06c850 msgr2=0x7fe2cc06ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:09.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.461+0000 7fe2f22a9640 1 --2- 172.21.15.52:0/2923522235 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7fe2cc06c850 0x7fe2cc06ed10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe2d4009990 tx=0x7fe2d4009110 comp rx=0 tx=0).stop 2023-11-05T08:07:09.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.461+0000 7fe2f22a9640 10 monclient: shutdown 2023-11-05T08:07:09.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.461+0000 7fe2f22a9640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:07:09.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.461+0000 7fe2f22a9640 1 -- 172.21.15.52:0/2923522235 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe2ec13ebf0 msgr2=0x7fe2ec13b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:09.465 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.461+0000 7fe2f22a9640 1 --2- 172.21.15.52:0/2923522235 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe2ec13ebf0 0x7fe2ec13b7d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe2dc00c480 tx=0x7fe2dc00c880 comp rx=0 tx=0).stop 2023-11-05T08:07:09.465 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.461+0000 7fe2f22a9640 1 -- 172.21.15.52:0/2923522235 shutdown_connections 2023-11-05T08:07:09.465 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.461+0000 7fe2f22a9640 1 --2- 172.21.15.52:0/2923522235 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7fe2cc06c850 0x7fe2cc06ed10 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:09.465 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.461+0000 7fe2f22a9640 1 --2- 172.21.15.52:0/2923522235 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe2ec131ff0 0x7fe2ec1324a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:09.465 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.461+0000 7fe2f22a9640 1 --2- 172.21.15.52:0/2923522235 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe2ec13ebf0 0x7fe2ec13b7d0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:09.465 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.461+0000 7fe2f22a9640 1 --2- 172.21.15.52:0/2923522235 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe2ec0a8720 0x7fe2ec139a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:09.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.461+0000 7fe2f22a9640 1 -- 172.21.15.52:0/2923522235 >> 172.21.15.52:0/2923522235 conn(0x7fe2ec0b7280 msgr2=0x7fe2ec13da30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:07:09.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.461+0000 7fe2f22a9640 1 -- 172.21.15.52:0/2923522235 shutdown_connections 2023-11-05T08:07:09.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.461+0000 7fe2f22a9640 1 -- 172.21.15.52:0/2923522235 wait complete. 2023-11-05T08:07:09.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.461+0000 7fe2f22a9640 1 librados: shutdown 2023-11-05T08:07:09.476 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-11-05T08:07:09.477 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-11-05T08:07:09.477 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-11-05T08:07:09.478 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-11-05T08:07:09.478 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-11-05T08:07:09.479 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-11-05T08:07:09.480 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-11-05T08:07:09.480 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-11-05T08:07:09.677 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.675+0000 7fbedc973640 10 monclient: get_monmap_and_config 2023-11-05T08:07:09.677 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.675+0000 7fbedc973640 10 monclient: build_initial_monmap 2023-11-05T08:07:09.677 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.675+0000 7fbedc973640 10 monclient: monmap: 2023-11-05T08:07:09.678 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:07:09.678 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:09.678 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:07:09.677181+0000 2023-11-05T08:07:09.678 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:07:09.677181+0000 2023-11-05T08:07:09.678 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:07:09.679 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:09.679 INFO:teuthology.orchestra.run.smithi052.stderr:0: v1:172.21.15.52:6789/0 mon.noname-a-legacy 2023-11-05T08:07:09.679 INFO:teuthology.orchestra.run.smithi052.stderr:1: v1:172.21.15.156:6789/0 mon.noname-c-legacy 2023-11-05T08:07:09.679 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-b 2023-11-05T08:07:09.679 INFO:teuthology.orchestra.run.smithi052.stderr:3: v2:172.21.15.52:3300/0 mon.noname-a 2023-11-05T08:07:09.679 INFO:teuthology.orchestra.run.smithi052.stderr:4: v2:172.21.15.156:3300/0 mon.noname-c 2023-11-05T08:07:09.680 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:09.680 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.676+0000 7fbedc973640 1 Processor -- start 2023-11-05T08:07:09.681 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.676+0000 7fbedc973640 1 -- start start 2023-11-05T08:07:09.681 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.676+0000 7fbedc973640 10 monclient: init 2023-11-05T08:07:09.681 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.677+0000 7fbedc973640 10 monclient: _reopen_session rank -1 2023-11-05T08:07:09.681 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.677+0000 7fbedc973640 10 monclient: _add_conns ranks=[2,3,1,4,0] 2023-11-05T08:07:09.682 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.677+0000 7fbedc973640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbed00070e0 0x7fbed0035e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:09.682 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.677+0000 7fbedc973640 10 monclient(hunting): picked mon.noname-b con 0x7fbed00070e0 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:07:09.682 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.678+0000 7fbedc973640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fbed0030b10 0x7fbed0036360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:09.682 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.678+0000 7fbedc973640 10 monclient(hunting): picked mon.noname-a con 0x7fbed0030b10 addr v2:172.21.15.52:3300/0 2023-11-05T08:07:09.683 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.678+0000 7fbedc973640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fbed0033600 addr v1:172.21.15.156:6789/0 2023-11-05T08:07:09.683 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.678+0000 7fbedc973640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbed00355f0 con 0x7fbed0033600 2023-11-05T08:07:09.683 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.678+0000 7fbedc973640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:09.683 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.678+0000 7fbedc973640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbed00074c0 con 0x7fbed0030b10 2023-11-05T08:07:09.683 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.678+0000 7fbedc973640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:09.684 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.678+0000 7fbedc973640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbed0037580 con 0x7fbed00070e0 2023-11-05T08:07:09.684 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.678+0000 7fbedc973640 10 monclient(hunting): _renew_subs 2023-11-05T08:07:09.684 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.678+0000 7fbedc973640 10 monclient(hunting): authenticate will time out at 1375.883962s 2023-11-05T08:07:09.684 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.679+0000 7fbed659c640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbed00070e0 0x7fbed0035e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:09.685 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.679+0000 7fbed6d9d640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fbed0033600 0x7fbed0033a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.52:35388/0 (socket says 172.21.15.52:35388) 2023-11-05T08:07:09.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.679+0000 7fbed659c640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbed00070e0 0x7fbed0035e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.52:40142/0 (socket says 172.21.15.52:40142) 2023-11-05T08:07:09.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.679+0000 7fbed659c640 1 -- 172.21.15.52:0/930097787 learned_addr learned my addr 172.21.15.52:0/930097787 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-11-05T08:07:09.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.679+0000 7fbed659c640 10 monclient(hunting): get_auth_request con 0x7fbed00070e0 auth_method 0 2023-11-05T08:07:09.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.679+0000 7fbed659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:09.687 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.679+0000 7fbed659c640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:09.687 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.679+0000 7fbed659c640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:09.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.680+0000 7f7c4610c640 10 monclient: get_monmap_and_config 2023-11-05T08:07:09.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.680+0000 7f7c4610c640 10 monclient: build_initial_monmap 2023-11-05T08:07:09.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.680+0000 7f7c4610c640 10 monclient: monmap: 2023-11-05T08:07:09.688 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:07:09.689 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:09.689 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:07:09.681924+0000 2023-11-05T08:07:09.689 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:07:09.681924+0000 2023-11-05T08:07:09.690 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:07:09.690 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:09.690 INFO:teuthology.orchestra.run.smithi052.stderr:0: v1:172.21.15.52:6789/0 mon.noname-a-legacy 2023-11-05T08:07:09.691 INFO:teuthology.orchestra.run.smithi052.stderr:1: v1:172.21.15.156:6789/0 mon.noname-c-legacy 2023-11-05T08:07:09.691 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-b 2023-11-05T08:07:09.691 INFO:teuthology.orchestra.run.smithi052.stderr:3: v2:172.21.15.52:3300/0 mon.noname-a 2023-11-05T08:07:09.691 INFO:teuthology.orchestra.run.smithi052.stderr:4: v2:172.21.15.156:3300/0 mon.noname-c 2023-11-05T08:07:09.691 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:09.692 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.680+0000 7f11cdb67640 10 monclient: get_monmap_and_config 2023-11-05T08:07:09.692 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.680+0000 7f11cdb67640 10 monclient: build_initial_monmap 2023-11-05T08:07:09.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.680+0000 7f11cdb67640 10 monclient: monmap: 2023-11-05T08:07:09.693 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:07:09.693 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:09.693 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:07:09.682362+0000 2023-11-05T08:07:09.693 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:07:09.682362+0000 2023-11-05T08:07:09.694 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:07:09.694 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:09.694 INFO:teuthology.orchestra.run.smithi052.stderr:0: v1:172.21.15.52:6789/0 mon.noname-a-legacy 2023-11-05T08:07:09.694 INFO:teuthology.orchestra.run.smithi052.stderr:1: v1:172.21.15.156:6789/0 mon.noname-c-legacy 2023-11-05T08:07:09.694 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-b 2023-11-05T08:07:09.694 INFO:teuthology.orchestra.run.smithi052.stderr:3: v2:172.21.15.52:3300/0 mon.noname-a 2023-11-05T08:07:09.695 INFO:teuthology.orchestra.run.smithi052.stderr:4: v2:172.21.15.156:3300/0 mon.noname-c 2023-11-05T08:07:09.695 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:09.695 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.681+0000 7fbed659c640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:09.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.681+0000 7fbed659c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:09.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.681+0000 7fbed659c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:09.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.681+0000 7f7c4610c640 1 Processor -- start 2023-11-05T08:07:09.697 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.668+0000 7fa4f0df5640 10 monclient: get_monmap_and_config 2023-11-05T08:07:09.697 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.668+0000 7fa4f0df5640 10 monclient: build_initial_monmap 2023-11-05T08:07:09.697 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.668+0000 7fa4f0df5640 10 monclient: monmap: 2023-11-05T08:07:09.697 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:07:09.698 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:09.698 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:07:09.670003+0000 2023-11-05T08:07:09.698 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:07:09.670003+0000 2023-11-05T08:07:09.698 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:07:09.698 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:09.699 INFO:teuthology.orchestra.run.smithi052.stderr:0: v1:172.21.15.52:6789/0 mon.noname-a-legacy 2023-11-05T08:07:09.699 INFO:teuthology.orchestra.run.smithi052.stderr:1: v1:172.21.15.156:6789/0 mon.noname-c-legacy 2023-11-05T08:07:09.699 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-b 2023-11-05T08:07:09.699 INFO:teuthology.orchestra.run.smithi052.stderr:3: v2:172.21.15.52:3300/0 mon.noname-a 2023-11-05T08:07:09.699 INFO:teuthology.orchestra.run.smithi052.stderr:4: v2:172.21.15.156:3300/0 mon.noname-c 2023-11-05T08:07:09.700 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:09.700 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.669+0000 7fa4f0df5640 1 Processor -- start 2023-11-05T08:07:09.700 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.669+0000 7fa4f0df5640 1 -- start start 2023-11-05T08:07:09.700 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.669+0000 7fa4f0df5640 10 monclient: init 2023-11-05T08:07:09.700 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.670+0000 7fa4f0df5640 10 monclient: _reopen_session rank -1 2023-11-05T08:07:09.701 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.670+0000 7fa4f0df5640 10 monclient: _add_conns ranks=[2,3,0,4,1] 2023-11-05T08:07:09.701 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.670+0000 7fa4f0df5640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa4ec0a8cc0 0x7fa4ec0a90a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:09.701 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.670+0000 7fa4f0df5640 10 monclient(hunting): picked mon.noname-b con 0x7fa4ec0a8cc0 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:07:09.701 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.670+0000 7fa4f0df5640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa4ec0712d0 0x7fa4ec0716d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:09.701 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.670+0000 7fa4f0df5640 10 monclient(hunting): picked mon.noname-a con 0x7fa4ec0712d0 addr v2:172.21.15.52:3300/0 2023-11-05T08:07:09.702 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.670+0000 7fa4f0df5640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fa4ec151e30 addr v1:172.21.15.52:6789/0 2023-11-05T08:07:09.702 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.670+0000 7fa4f0df5640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4ec0aac30 con 0x7fa4ec151e30 2023-11-05T08:07:09.702 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.670+0000 7fa4f0df5640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:09.702 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.670+0000 7fa4f0df5640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4ec0aaf10 con 0x7fa4ec0712d0 2023-11-05T08:07:09.702 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.670+0000 7fa4f0df5640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:09.703 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.670+0000 7fa4f0df5640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4ec0a9a60 con 0x7fa4ec0a8cc0 2023-11-05T08:07:09.703 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.670+0000 7fa4f0df5640 10 monclient(hunting): _renew_subs 2023-11-05T08:07:09.703 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.670+0000 7fa4f0df5640 10 monclient(hunting): authenticate will time out at 1375.876506s 2023-11-05T08:07:09.703 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.672+0000 7fa4ea59c640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa4ec0a8cc0 0x7fa4ec0a90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:09.703 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.672+0000 7fa4ea59c640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa4ec0a8cc0 0x7fa4ec0a90a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.52:40134/0 (socket says 172.21.15.52:40134) 2023-11-05T08:07:09.704 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.672+0000 7fa4ea59c640 1 -- 172.21.15.52:0/432817287 learned_addr learned my addr 172.21.15.52:0/432817287 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-11-05T08:07:09.704 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.672+0000 7fa4ea59c640 10 monclient(hunting): get_auth_request con 0x7fa4ec0a8cc0 auth_method 0 2023-11-05T08:07:09.704 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.672+0000 7fa4ea59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:09.704 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.677+0000 7fa4ea59c640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:09.704 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.677+0000 7fa4ea59c640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:09.705 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.679+0000 7fa4e9d9b640 1 --2- 172.21.15.52:0/432817287 >> v2:172.21.15.52:3300/0 conn(0x7fa4ec0712d0 0x7fa4ec0716d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:09.705 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.679+0000 7fa4e9d9b640 10 monclient(hunting): get_auth_request con 0x7fa4ec0712d0 auth_method 0 2023-11-05T08:07:09.705 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.679+0000 7fa4e9d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:09.705 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.679+0000 7fa4e9d9b640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:09.705 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.679+0000 7fa4e9d9b640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:09.706 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.680+0000 7fa4e9d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:09.706 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.680+0000 7fa4e9d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:09.706 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.680+0000 7fa4e9d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:09.706 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.682+0000 7fa4ea59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:09.706 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.682+0000 7fa4ea59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:09.707 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.682+0000 7fa4ea59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:09.707 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.682+0000 7f11cdb67640 1 Processor -- start 2023-11-05T08:07:09.708 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.681+0000 7f7c4610c640 1 -- start start 2023-11-05T08:07:09.709 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.681+0000 7f7c4610c640 10 monclient: init 2023-11-05T08:07:09.709 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.682+0000 7f7c4610c640 10 monclient: _reopen_session rank -1 2023-11-05T08:07:09.709 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.682+0000 7f7c4610c640 10 monclient: _add_conns ranks=[4,1,2,0,3] 2023-11-05T08:07:09.709 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.682+0000 7f7c4610c640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f7c400ad980 0x7f7c400ae5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:09.710 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.682+0000 7f7c4610c640 10 monclient(hunting): picked mon.noname-c con 0x7f7c400ad980 addr v2:172.21.15.156:3300/0 2023-11-05T08:07:09.710 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.682+0000 7f7c4610c640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f7c4013eb20 addr v1:172.21.15.156:6789/0 2023-11-05T08:07:09.710 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.682+0000 7f7c4610c640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7c4013efb0 0x7f7c400b0f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:09.710 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.682+0000 7f7c4610c640 10 monclient(hunting): picked mon.noname-b con 0x7f7c4013efb0 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:07:09.710 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.682+0000 7f7c4610c640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c400b1440 con 0x7f7c4013eb20 2023-11-05T08:07:09.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.682+0000 7f7c4610c640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:09.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.682+0000 7f11cdb67640 1 -- start start 2023-11-05T08:07:09.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.682+0000 7f11cdb67640 10 monclient: init 2023-11-05T08:07:09.714 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.682+0000 7f7c4610c640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c4013f420 con 0x7f7c400ad980 2023-11-05T08:07:09.714 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.682+0000 7f7c4610c640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:09.715 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.682+0000 7f7c4610c640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c400b02b0 con 0x7f7c4013efb0 2023-11-05T08:07:09.715 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.682+0000 7f7c4610c640 10 monclient(hunting): _renew_subs 2023-11-05T08:07:09.715 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.682+0000 7f7c4610c640 10 monclient(hunting): authenticate will time out at 1375.888638s 2023-11-05T08:07:09.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.683+0000 7f11cdb67640 10 monclient: _reopen_session rank -1 2023-11-05T08:07:09.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.683+0000 7f11cdb67640 10 monclient: _add_conns ranks=[1,4,2,3,0] 2023-11-05T08:07:09.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.683+0000 7f11cdb67640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f11c806d930 addr v1:172.21.15.156:6789/0 2023-11-05T08:07:09.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.683+0000 7f11cdb67640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f11c806dd10 0x7f11c8070280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:09.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.683+0000 7f11cdb67640 10 monclient(hunting): picked mon.noname-c con 0x7f11c806dd10 addr v2:172.21.15.156:3300/0 2023-11-05T08:07:09.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.683+0000 7f11cdb67640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f11c8142860 0x7f11c8142d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:09.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.683+0000 7f11cdb67640 10 monclient(hunting): picked mon.noname-b con 0x7f11c8142860 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:07:09.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.683+0000 7f11cdb67640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11c806fb80 con 0x7f11c806d930 2023-11-05T08:07:09.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.683+0000 7f11cdb67640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:09.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.683+0000 7f11cdb67640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11c806fe60 con 0x7f11c806dd10 2023-11-05T08:07:09.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.683+0000 7f11cdb67640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:09.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.683+0000 7f11cdb67640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11c8071c40 con 0x7f11c8142860 2023-11-05T08:07:09.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.683+0000 7f11cdb67640 10 monclient(hunting): _renew_subs 2023-11-05T08:07:09.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.683+0000 7f11cdb67640 10 monclient(hunting): authenticate will time out at 1375.889782s 2023-11-05T08:07:09.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.684+0000 7fa4e9d9b640 10 monclient(hunting): handle_auth_done global_id 4275 payload 274 2023-11-05T08:07:09.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.684+0000 7fa4e9d9b640 1 -- 172.21.15.52:0/432817287 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa4ec0a8cc0 msgr2=0x7fa4ec0a90a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-05T08:07:09.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.684+0000 7fa4e9d9b640 1 --2- 172.21.15.52:0/432817287 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa4ec0a8cc0 0x7fa4ec0a90a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:09.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.684+0000 7fa4e9d9b640 1 -- 172.21.15.52:0/432817287 >> v1:172.21.15.52:6789/0 conn(0x7fa4ec151e30 legacy=0x7fa4ec152280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:09.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.684+0000 7fa4e9d9b640 10 monclient: _finish_hunting 0 2023-11-05T08:07:09.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.684+0000 7fa4e9d9b640 1 monclient: found mon.noname-a 2023-11-05T08:07:09.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.684+0000 7fa4e9d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:07:09.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.684+0000 7fa4e9d9b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.52:3300/0 2023-11-05T08:07:09.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.684+0000 7fa4e9d9b640 1 -- 172.21.15.52:0/432817287 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4ec071c10 con 0x7fa4ec0712d0 2023-11-05T08:07:09.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.684+0000 7f11ccb65640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f11c806d930 0x7f11c8149850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.52:35396/0 (socket says 172.21.15.52:35396) 2023-11-05T08:07:09.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.684+0000 7f11ccb65640 1 -- 172.21.15.52:0/3378090785 learned_addr learned my addr 172.21.15.52:0/3378090785 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-11-05T08:07:09.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.684+0000 7f7c4510a640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f7c400ad980 0x7f7c400ae5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:09.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.684+0000 7f7c44909640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f7c4013eb20 0x7f7c400b07f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.52:35390/0 (socket says 172.21.15.52:35390) 2023-11-05T08:07:09.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.684+0000 7f7c44909640 1 -- 172.21.15.52:0/224966975 learned_addr learned my addr 172.21.15.52:0/224966975 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-11-05T08:07:09.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.684+0000 7f7c4510a640 10 monclient(hunting): get_auth_request con 0x7f7c400ad980 auth_method 0 2023-11-05T08:07:09.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.684+0000 7f7c4510a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:09.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.684+0000 7f7c4510a640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:09.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.684+0000 7f7c4510a640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:09.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.685+0000 7fbed559a640 1 -- 172.21.15.52:0/930097787 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3752119605 0 0) 0x7fbed00355f0 con 0x7fbed0033600 2023-11-05T08:07:09.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.685+0000 7fbed559a640 10 monclient(hunting): _negotiate 2023-11-05T08:07:09.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.685+0000 7fbed559a640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:09.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.685+0000 7fbed559a640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:09.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.685+0000 7fbed559a640 10 monclient(hunting): my global_id is 4294 2023-11-05T08:07:09.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.685+0000 7fbed559a640 1 -- 172.21.15.52:0/930097787 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbec0003520 con 0x7fbed0033600 2023-11-05T08:07:09.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.685+0000 7fbed659c640 10 monclient(hunting): handle_auth_done global_id 4217 payload 274 2023-11-05T08:07:09.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.685+0000 7fbed659c640 1 -- 172.21.15.52:0/930097787 >> v2:172.21.15.52:3300/0 conn(0x7fbed0030b10 msgr2=0x7fbed0036360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-05T08:07:09.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.685+0000 7fbed659c640 1 --2- 172.21.15.52:0/930097787 >> v2:172.21.15.52:3300/0 conn(0x7fbed0030b10 0x7fbed0036360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:09.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.685+0000 7fbed659c640 1 -- 172.21.15.52:0/930097787 >> v1:172.21.15.156:6789/0 conn(0x7fbed0033600 legacy=0x7fbed0033a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:09.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.685+0000 7fbed659c640 10 monclient: _finish_hunting 0 2023-11-05T08:07:09.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.685+0000 7fbed659c640 1 monclient: found mon.noname-b 2023-11-05T08:07:09.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.685+0000 7fbed659c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:07:09.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.685+0000 7fbed659c640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.52:3301/0 2023-11-05T08:07:09.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.685+0000 7fbed659c640 1 -- 172.21.15.52:0/930097787 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbed0035890 con 0x7fbed00070e0 2023-11-05T08:07:09.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.685+0000 7f7c4510a640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:09.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.685+0000 7f7c4510a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:09.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.685+0000 7f7c4510a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:09.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.686+0000 7f11c7fff640 1 --2- 172.21.15.52:0/3378090785 >> v2:172.21.15.156:3300/0 conn(0x7f11c806dd10 0x7f11c8070280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:09.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.686+0000 7f11c7fff640 10 monclient(hunting): get_auth_request con 0x7f11c806dd10 auth_method 0 2023-11-05T08:07:09.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.687+0000 7f11c7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:09.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.687+0000 7f11c7fff640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:09.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.687+0000 7f11c7fff640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:09.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.688+0000 7f11c7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:09.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.688+0000 7f11c7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:09.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.688+0000 7f11c7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:09.731 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.689+0000 7f7c4510a640 10 monclient(hunting): handle_auth_done global_id 4297 payload 274 2023-11-05T08:07:09.731 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.689+0000 7f7c4510a640 1 -- 172.21.15.52:0/224966975 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7c4013efb0 msgr2=0x7f7c400b0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-05T08:07:09.731 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.689+0000 7f7c4510a640 1 --2- 172.21.15.52:0/224966975 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7c4013efb0 0x7f7c400b0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:09.731 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.689+0000 7f7c4510a640 1 -- 172.21.15.52:0/224966975 >> v1:172.21.15.156:6789/0 conn(0x7f7c4013eb20 legacy=0x7f7c400b07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:09.732 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.689+0000 7f7c4510a640 10 monclient: _finish_hunting 0 2023-11-05T08:07:09.732 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.689+0000 7f7c4510a640 1 monclient: found mon.noname-c 2023-11-05T08:07:09.732 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.689+0000 7f7c4510a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:07:09.732 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.689+0000 7f7c4510a640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.156:3300/0 2023-11-05T08:07:09.732 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.689+0000 7f7c4510a640 1 -- 172.21.15.52:0/224966975 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c4006a5e0 con 0x7f7c400ad980 2023-11-05T08:07:09.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.692+0000 7fbed659c640 1 --2- 172.21.15.52:0/930097787 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbed00070e0 0x7fbed0035e20 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fbed8073440 tx=0x7fbed80a5aa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d327fe8f00d62b6b server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:09.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.693+0000 7fb10759e640 10 monclient: get_monmap_and_config 2023-11-05T08:07:09.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.693+0000 7fb10759e640 10 monclient: build_initial_monmap 2023-11-05T08:07:09.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.693+0000 7fb10759e640 10 monclient: monmap: 2023-11-05T08:07:09.734 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:07:09.734 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:09.734 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:07:09.695318+0000 2023-11-05T08:07:09.734 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:07:09.695318+0000 2023-11-05T08:07:09.735 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:07:09.735 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:09.735 INFO:teuthology.orchestra.run.smithi052.stderr:0: v1:172.21.15.52:6789/0 mon.noname-a-legacy 2023-11-05T08:07:09.735 INFO:teuthology.orchestra.run.smithi052.stderr:1: v1:172.21.15.156:6789/0 mon.noname-c-legacy 2023-11-05T08:07:09.736 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-b 2023-11-05T08:07:09.736 INFO:teuthology.orchestra.run.smithi052.stderr:3: v2:172.21.15.52:3300/0 mon.noname-a 2023-11-05T08:07:09.736 INFO:teuthology.orchestra.run.smithi052.stderr:4: v2:172.21.15.156:3300/0 mon.noname-c 2023-11-05T08:07:09.736 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:09.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.693+0000 7f11c7fff640 10 monclient(hunting): handle_auth_done global_id 4300 payload 274 2023-11-05T08:07:09.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.693+0000 7f11c7fff640 1 -- 172.21.15.52:0/3378090785 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f11c8142860 msgr2=0x7f11c8142d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-05T08:07:09.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.693+0000 7f11c7fff640 1 --2- 172.21.15.52:0/3378090785 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f11c8142860 0x7f11c8142d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:09.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.693+0000 7f11c7fff640 1 -- 172.21.15.52:0/3378090785 >> v1:172.21.15.156:6789/0 conn(0x7f11c806d930 legacy=0x7f11c8149850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:09.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.693+0000 7f11c7fff640 10 monclient: _finish_hunting 0 2023-11-05T08:07:09.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.693+0000 7f11c7fff640 1 monclient: found mon.noname-c 2023-11-05T08:07:09.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.693+0000 7f11c7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:07:09.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.693+0000 7f11c7fff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.156:3300/0 2023-11-05T08:07:09.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.693+0000 7f11c7fff640 1 -- 172.21.15.52:0/3378090785 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11c80b2a10 con 0x7f11c806dd10 2023-11-05T08:07:09.739 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.695+0000 7fa4e9d9b640 1 --2- 172.21.15.52:0/432817287 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa4ec0712d0 0x7fa4ec0716d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa4dc010b90 tx=0x7fa4dc02fe70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fd0a355d5e697ec server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:09.739 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.694+0000 7fb10759e640 1 Processor -- start 2023-11-05T08:07:09.740 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.694+0000 7fb10759e640 1 -- start start 2023-11-05T08:07:09.740 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.694+0000 7fb10759e640 10 monclient: init 2023-11-05T08:07:09.740 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.696+0000 7fb10759e640 10 monclient: _reopen_session rank -1 2023-11-05T08:07:09.740 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.696+0000 7fb10759e640 10 monclient: _add_conns ranks=[4,1,2,3,0] 2023-11-05T08:07:09.740 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.696+0000 7fb10759e640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb10806d8d0 0x7fb108070220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:09.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.696+0000 7fb10759e640 10 monclient(hunting): picked mon.noname-c con 0x7fb10806d8d0 addr v2:172.21.15.156:3300/0 2023-11-05T08:07:09.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.696+0000 7fb10759e640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fb10806dcb0 addr v1:172.21.15.156:6789/0 2023-11-05T08:07:09.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.696+0000 7fb10759e640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb108142d60 0x7fb1081431f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:09.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.696+0000 7fb10759e640 10 monclient(hunting): picked mon.noname-b con 0x7fb108142d60 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:07:09.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.696+0000 7fb10759e640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb108071a40 con 0x7fb10806dcb0 2023-11-05T08:07:09.742 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.696+0000 7fb10759e640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:09.742 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.696+0000 7fb10759e640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb108070760 con 0x7fb10806d8d0 2023-11-05T08:07:09.742 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.696+0000 7fb10759e640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:09.742 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.696+0000 7fb10759e640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb108149fd0 con 0x7fb108142d60 2023-11-05T08:07:09.742 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.696+0000 7fb10759e640 10 monclient(hunting): _renew_subs 2023-11-05T08:07:09.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.696+0000 7fb10759e640 10 monclient(hunting): authenticate will time out at 1375.902159s 2023-11-05T08:07:09.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.698+0000 7f740b724640 10 monclient: get_monmap_and_config 2023-11-05T08:07:09.744 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.698+0000 7f740b724640 10 monclient: build_initial_monmap 2023-11-05T08:07:09.744 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.698+0000 7f740b724640 10 monclient: monmap: 2023-11-05T08:07:09.744 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:07:09.744 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:09.744 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:07:09.700015+0000 2023-11-05T08:07:09.745 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:07:09.700015+0000 2023-11-05T08:07:09.745 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:07:09.745 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:09.745 INFO:teuthology.orchestra.run.smithi052.stderr:0: v1:172.21.15.52:6789/0 mon.noname-a-legacy 2023-11-05T08:07:09.745 INFO:teuthology.orchestra.run.smithi052.stderr:1: v1:172.21.15.156:6789/0 mon.noname-c-legacy 2023-11-05T08:07:09.746 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-b 2023-11-05T08:07:09.746 INFO:teuthology.orchestra.run.smithi052.stderr:3: v2:172.21.15.52:3300/0 mon.noname-a 2023-11-05T08:07:09.746 INFO:teuthology.orchestra.run.smithi052.stderr:4: v2:172.21.15.156:3300/0 mon.noname-c 2023-11-05T08:07:09.746 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:09.746 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.699+0000 7f740b724640 1 Processor -- start 2023-11-05T08:07:09.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.699+0000 7f740b724640 1 -- start start 2023-11-05T08:07:09.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.699+0000 7f740b724640 10 monclient: init 2023-11-05T08:07:09.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.699+0000 7f7c4510a640 1 --2- 172.21.15.52:0/224966975 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7c400ad980 0x7f7c400ae5d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7c38009d90 tx=0x7f7c3802bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dae679fa370de2f0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:09.748 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.700+0000 7f740b724640 10 monclient: _reopen_session rank -1 2023-11-05T08:07:09.748 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.700+0000 7f740b724640 10 monclient: _add_conns ranks=[4,1,0,2,3] 2023-11-05T08:07:09.748 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.700+0000 7f740b724640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f74040b4240 0x7f74040b1150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:09.749 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.700+0000 7f740b724640 10 monclient(hunting): picked mon.noname-c con 0x7f74040b4240 addr v2:172.21.15.156:3300/0 2023-11-05T08:07:09.749 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.700+0000 7f740b724640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f74040b38d0 addr v1:172.21.15.156:6789/0 2023-11-05T08:07:09.749 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.700+0000 7f740b724640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f74040ade00 addr v1:172.21.15.52:6789/0 2023-11-05T08:07:09.749 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.700+0000 7f740b724640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74040b0cc0 con 0x7f74040ade00 2023-11-05T08:07:09.749 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.700+0000 7f740b724640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74040b1690 con 0x7f74040b38d0 2023-11-05T08:07:09.750 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.700+0000 7f740b724640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:09.750 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.700+0000 7f740b724640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74040b4620 con 0x7f74040b4240 2023-11-05T08:07:09.750 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.700+0000 7f740b724640 10 monclient(hunting): _renew_subs 2023-11-05T08:07:09.750 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.700+0000 7f740b724640 10 monclient(hunting): authenticate will time out at 1375.906134s 2023-11-05T08:07:09.750 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.701+0000 7f7409cc1640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f74040ade00 0x7f740413b420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:47038/0 (socket says 172.21.15.52:47038) 2023-11-05T08:07:09.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.701+0000 7f7409cc1640 1 -- 172.21.15.52:0/1105730242 learned_addr learned my addr 172.21.15.52:0/1105730242 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-11-05T08:07:09.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.700+0000 7fbed559a640 1 -- 172.21.15.52:0/930097787 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbed80a7710 con 0x7fbed00070e0 2023-11-05T08:07:09.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.700+0000 7fbed559a640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:09.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.700+0000 7fbed559a640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-05T08:07:09.752 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.700+0000 7fbed559a640 10 monclient: dump: 2023-11-05T08:07:09.752 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:09.752 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:09.752 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:09.752 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:09.753 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:09.753 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:09.753 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:09.753 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:09.753 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:09.754 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:09.754 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.700+0000 7fbed559a640 10 monclient: _finish_auth 0 2023-11-05T08:07:09.754 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.700+0000 7fbed559a640 10 monclient: _check_auth_tickets 2023-11-05T08:07:09.754 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.700+0000 7fbed559a640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:07:09.754 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.700+0000 7fbed559a640 1 -- 172.21.15.52:0/930097787 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbed80a7870 con 0x7fbed00070e0 2023-11-05T08:07:09.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.700+0000 7fbed559a640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:07:09.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.700+0000 7fbed559a640 1 -- 172.21.15.52:0/930097787 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbed80a7ca0 con 0x7fbed00070e0 2023-11-05T08:07:09.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.700+0000 7fbed559a640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:09.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.700+0000 7fbed559a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-11-05T08:07:09.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.700+0000 7fbed559a640 10 monclient: dump: 2023-11-05T08:07:09.756 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:09.756 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:09.756 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:09.756 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:09.756 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:09.756 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:09.757 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:09.757 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:09.757 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:09.757 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:09.758 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.701+0000 7fb10659c640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb10806d8d0 0x7fb108070220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:09.758 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.701+0000 7fb10659c640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb10806d8d0 0x7fb108070220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.52:58860/0 (socket says 172.21.15.52:58860) 2023-11-05T08:07:09.758 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.701+0000 7fb10659c640 1 -- 172.21.15.52:0/3615566260 learned_addr learned my addr 172.21.15.52:0/3615566260 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-11-05T08:07:09.759 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.701+0000 7fb10659c640 10 monclient(hunting): get_auth_request con 0x7fb10806d8d0 auth_method 0 2023-11-05T08:07:09.759 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.701+0000 7fbedc973640 5 monclient: authenticate success, global_id 4217 2023-11-05T08:07:09.759 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.701+0000 7fbedc973640 10 monclient: get_monmap_and_config success 2023-11-05T08:07:09.760 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.701+0000 7fbedc973640 4 set_mon_vals no callback set 2023-11-05T08:07:09.760 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.702+0000 7fbedc973640 10 monclient: shutdown 2023-11-05T08:07:09.760 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.702+0000 7fbedc973640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:07:09.760 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.702+0000 7fbedc973640 1 -- 172.21.15.52:0/930097787 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbed00070e0 msgr2=0x7fbed0035e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:09.760 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.702+0000 7fbedc973640 1 --2- 172.21.15.52:0/930097787 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbed00070e0 0x7fbed0035e20 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fbed8073440 tx=0x7fbed80a5aa0 comp rx=0 tx=0).stop 2023-11-05T08:07:09.761 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.701+0000 7fb10659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:09.761 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.701+0000 7fb10659c640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:09.761 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.701+0000 7fb10659c640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:09.762 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.702+0000 7fbedc973640 1 -- 172.21.15.52:0/930097787 shutdown_connections 2023-11-05T08:07:09.762 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.702+0000 7fbedc973640 1 --2- 172.21.15.52:0/930097787 >> v2:172.21.15.52:3300/0 conn(0x7fbed0030b10 0x7fbed0036360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:09.763 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.702+0000 7fbedc973640 1 --2- 172.21.15.52:0/930097787 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbed00070e0 0x7fbed0035e20 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:09.763 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.702+0000 7fbedc973640 1 -- 172.21.15.52:0/930097787 >> 172.21.15.52:0/930097787 conn(0x7fbed0006030 msgr2=0x7fbed0006440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:07:09.763 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.702+0000 7fbedc973640 1 -- 172.21.15.52:0/930097787 shutdown_connections 2023-11-05T08:07:09.763 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.702+0000 7fbedc973640 1 -- 172.21.15.52:0/930097787 wait complete. 2023-11-05T08:07:09.764 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.703+0000 7fb10659c640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:09.764 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.703+0000 7fb10659c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:09.764 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.703+0000 7fb10659c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:09.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.703+0000 7fbedc973640 10 monclient: build_initial_monmap 2023-11-05T08:07:09.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.703+0000 7fbedc973640 10 monclient: monmap: 2023-11-05T08:07:09.765 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:07:09.765 INFO:teuthology.orchestra.run.smithi052.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-05T08:07:09.766 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 0.000000 2023-11-05T08:07:09.766 INFO:teuthology.orchestra.run.smithi052.stderr:created 0.000000 2023-11-05T08:07:09.766 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:07:09.766 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:09.766 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.noname-a 2023-11-05T08:07:09.767 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.noname-b 2023-11-05T08:07:09.767 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-c 2023-11-05T08:07:09.767 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:09.767 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.703+0000 7fbedc973640 1 librados: starting msgr at 2023-11-05T08:07:09.768 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.703+0000 7f780ce52640 10 monclient: get_monmap_and_config 2023-11-05T08:07:09.768 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.703+0000 7f780ce52640 10 monclient: build_initial_monmap 2023-11-05T08:07:09.768 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.703+0000 7f780ce52640 10 monclient: monmap: 2023-11-05T08:07:09.768 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:07:09.769 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:09.769 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:07:09.705486+0000 2023-11-05T08:07:09.769 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:07:09.705486+0000 2023-11-05T08:07:09.769 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:07:09.769 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:09.770 INFO:teuthology.orchestra.run.smithi052.stderr:0: v1:172.21.15.52:6789/0 mon.noname-a-legacy 2023-11-05T08:07:09.770 INFO:teuthology.orchestra.run.smithi052.stderr:1: v1:172.21.15.156:6789/0 mon.noname-c-legacy 2023-11-05T08:07:09.770 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-b 2023-11-05T08:07:09.770 INFO:teuthology.orchestra.run.smithi052.stderr:3: v2:172.21.15.52:3300/0 mon.noname-a 2023-11-05T08:07:09.770 INFO:teuthology.orchestra.run.smithi052.stderr:4: v2:172.21.15.156:3300/0 mon.noname-c 2023-11-05T08:07:09.770 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:09.772 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.703+0000 7fbedc973640 1 librados: starting objecter 2023-11-05T08:07:09.772 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.704+0000 7fbedc973640 1 Processor -- start 2023-11-05T08:07:09.772 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.704+0000 7fbedc973640 1 -- start start 2023-11-05T08:07:09.773 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.704+0000 7fbedc973640 1 librados: setting wanted keys 2023-11-05T08:07:09.773 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.704+0000 7fbedc973640 1 librados: calling monclient init 2023-11-05T08:07:09.773 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.704+0000 7fbedc973640 10 monclient: init 2023-11-05T08:07:09.773 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.704+0000 7fbedc973640 10 monclient: _reopen_session rank -1 2023-11-05T08:07:09.773 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.704+0000 7fbedc973640 10 monclient: _add_conns ranks=[0,2,1] 2023-11-05T08:07:09.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.704+0000 7fbedc973640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbed00070e0 0x7fbed002d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:09.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.704+0000 7fbedc973640 10 monclient(hunting): picked mon.noname-a con 0x7fbed00070e0 addr [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] 2023-11-05T08:07:09.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.704+0000 7fbedc973640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbed0030b10 0x7fbed00bff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:09.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.704+0000 7fbedc973640 10 monclient(hunting): picked mon.noname-c con 0x7fbed0030b10 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:07:09.775 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.704+0000 7fb10659c640 10 monclient(hunting): handle_auth_done global_id 4309 payload 274 2023-11-05T08:07:09.775 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.704+0000 7fbedc973640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbed0033600 0x7fbed00c0490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:09.775 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.704+0000 7fbedc973640 10 monclient(hunting): picked mon.noname-b con 0x7fbed0033600 addr [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] 2023-11-05T08:07:09.776 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.704+0000 7fbedc973640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:09.776 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.704+0000 7fbedc973640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbed00c09d0 con 0x7fbed00070e0 2023-11-05T08:07:09.776 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.704+0000 7fbedc973640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:09.776 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.704+0000 7fbedc973640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbed002ebe0 con 0x7fbed0033600 2023-11-05T08:07:09.776 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.704+0000 7fbedc973640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:09.776 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.704+0000 7fbedc973640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbed002eec0 con 0x7fbed0030b10 2023-11-05T08:07:09.777 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.704+0000 7fbedc973640 10 monclient(hunting): _renew_subs 2023-11-05T08:07:09.777 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.704+0000 7fbedc973640 10 monclient(hunting): authenticate will time out at 1375.910765s 2023-11-05T08:07:09.777 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.704+0000 7fb10659c640 1 -- 172.21.15.52:0/3615566260 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb108142d60 msgr2=0x7fb1081431f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-05T08:07:09.778 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.705+0000 7f780ce52640 1 Processor -- start 2023-11-05T08:07:09.778 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.704+0000 7fb10659c640 1 --2- 172.21.15.52:0/3615566260 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb108142d60 0x7fb1081431f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:09.778 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.704+0000 7fb10659c640 1 -- 172.21.15.52:0/3615566260 >> v1:172.21.15.156:6789/0 conn(0x7fb10806dcb0 legacy=0x7fb1081498c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-05T08:07:09.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.705+0000 7f780ce52640 1 -- start start 2023-11-05T08:07:09.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.705+0000 7f780ce52640 10 monclient: init 2023-11-05T08:07:09.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.704+0000 7fb10659c640 10 monclient: _finish_hunting 0 2023-11-05T08:07:09.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.704+0000 7fb10659c640 1 monclient: found mon.noname-c 2023-11-05T08:07:09.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.704+0000 7fb10659c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:07:09.781 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.704+0000 7fb10659c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.156:3300/0 2023-11-05T08:07:09.781 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.704+0000 7fb10659c640 1 -- 172.21.15.52:0/3615566260 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb10806f840 con 0x7fb10806d8d0 2023-11-05T08:07:09.781 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.705+0000 7fbed659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbed00070e0 0x7fbed002d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:09.782 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.706+0000 7f780ce52640 10 monclient: _reopen_session rank -1 2023-11-05T08:07:09.782 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.706+0000 7f780ce52640 10 monclient: _add_conns ranks=[2,1,0,3,4] 2023-11-05T08:07:09.782 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.706+0000 7f780ce52640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f78080b4240 0x7f78080b1150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:09.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.706+0000 7f780ce52640 10 monclient(hunting): picked mon.noname-b con 0x7f78080b4240 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:07:09.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.706+0000 7f780ce52640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f78080b38d0 addr v1:172.21.15.156:6789/0 2023-11-05T08:07:09.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.706+0000 7f780ce52640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f78080ade00 addr v1:172.21.15.52:6789/0 2023-11-05T08:07:09.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.706+0000 7fbed659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbed00070e0 0x7fbed002d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46838/0 (socket says 172.21.15.52:46838) 2023-11-05T08:07:09.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.706+0000 7f780ce52640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78080b0cc0 con 0x7f78080ade00 2023-11-05T08:07:09.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.706+0000 7f780ce52640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78080b1690 con 0x7f78080b38d0 2023-11-05T08:07:09.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.706+0000 7f780ce52640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:09.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.706+0000 7f780ce52640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78080b4620 con 0x7f78080b4240 2023-11-05T08:07:09.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.706+0000 7f780ce52640 10 monclient(hunting): _renew_subs 2023-11-05T08:07:09.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.706+0000 7f780ce52640 10 monclient(hunting): authenticate will time out at 1375.912461s 2023-11-05T08:07:09.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.706+0000 7fbed659c640 1 -- 172.21.15.52:0/1661704675 learned_addr learned my addr 172.21.15.52:0/1661704675 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-11-05T08:07:09.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.706+0000 7fbed659c640 10 monclient(hunting): get_auth_request con 0x7fbed00070e0 auth_method 0 2023-11-05T08:07:09.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.706+0000 7fbed659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:09.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.706+0000 7fbed659c640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:09.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.706+0000 7fbed659c640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:09.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.707+0000 7fbed659c640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:09.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.707+0000 7fbed659c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:09.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.707+0000 7fbed659c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:09.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.707+0000 7fbed5d9b640 1 --2- 172.21.15.52:0/1661704675 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbed0030b10 0x7fbed00bff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:09.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.708+0000 7fbed5d9b640 10 monclient(hunting): get_auth_request con 0x7fbed0030b10 auth_method 0 2023-11-05T08:07:09.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.708+0000 7fbed5d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:09.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.708+0000 7fbed5d9b640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:09.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.708+0000 7fbed5d9b640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:09.789 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.709+0000 7fbed5d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:09.789 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.709+0000 7fbed5d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:09.789 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.709+0000 7fbed5d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:09.789 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.711+0000 7fbed659c640 10 monclient(hunting): handle_auth_done global_id 4278 payload 824 2023-11-05T08:07:09.789 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.711+0000 7fbed659c640 1 -- 172.21.15.52:0/1661704675 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbed0030b10 msgr2=0x7fbed00bff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:09.790 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.711+0000 7fbed659c640 1 --2- 172.21.15.52:0/1661704675 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbed0030b10 0x7fbed00bff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:09.790 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.711+0000 7fbed659c640 1 -- 172.21.15.52:0/1661704675 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbed0033600 msgr2=0x7fbed00c0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:09.790 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.711+0000 7fbed659c640 1 --2- 172.21.15.52:0/1661704675 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbed0033600 0x7fbed00c0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:09.790 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.711+0000 7fbed659c640 10 monclient: _finish_hunting 0 2023-11-05T08:07:09.790 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.711+0000 7fbed659c640 1 monclient: found mon.noname-a 2023-11-05T08:07:09.791 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.711+0000 7fbed659c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:07:09.791 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.711+0000 7fbed659c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.52:3300/0 2023-11-05T08:07:09.791 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.711+0000 7fbed659c640 1 -- 172.21.15.52:0/1661704675 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbed8068fc0 con 0x7fbed00070e0 2023-11-05T08:07:09.791 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.713+0000 7fb10659c640 1 --2- 172.21.15.52:0/3615566260 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb10806d8d0 0x7fb108070220 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc009870 tx=0x7fb0fc02b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=254a154ab04ff095 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:09.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.713+0000 7f7806d9d640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f78080ade00 0x7f780813b420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:47052/0 (socket says 172.21.15.52:47052) 2023-11-05T08:07:09.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.713+0000 7f7806d9d640 1 -- 172.21.15.52:0/2594601883 learned_addr learned my addr 172.21.15.52:0/2594601883 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-11-05T08:07:09.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.714+0000 7f780659c640 1 --2- 172.21.15.52:0/2594601883 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f78080b4240 0x7f78080b1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:09.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.714+0000 7f7c37fff640 1 -- 172.21.15.52:0/224966975 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c3802cc50 con 0x7f7c400ad980 2023-11-05T08:07:09.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.714+0000 7f7c37fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:09.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.714+0000 7f7c37fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-11-05T08:07:09.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.714+0000 7f7c37fff640 10 monclient: dump: 2023-11-05T08:07:09.794 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:09.794 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:09.794 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:09.795 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:09.795 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:09.795 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:09.795 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:09.795 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:09.795 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:09.796 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:09.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.714+0000 7f7c37fff640 10 monclient: _finish_auth 0 2023-11-05T08:07:09.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.714+0000 7f7c37fff640 10 monclient: _check_auth_tickets 2023-11-05T08:07:09.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.714+0000 7f7c37fff640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:07:09.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.714+0000 7f7c37fff640 1 -- 172.21.15.52:0/224966975 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c3802cdb0 con 0x7f7c400ad980 2023-11-05T08:07:09.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.714+0000 7f7c4610c640 5 monclient: authenticate success, global_id 4297 2023-11-05T08:07:09.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.714+0000 7f7c4610c640 20 monclient: get_monmap_and_config waiting for monmap|config 2023-11-05T08:07:09.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.714+0000 7f780659c640 10 monclient(hunting): get_auth_request con 0x7f78080b4240 auth_method 0 2023-11-05T08:07:09.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.714+0000 7f780659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:09.798 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.714+0000 7f780659c640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:09.798 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.714+0000 7f780659c640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:09.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.714+0000 7f7c37fff640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:07:09.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.714+0000 7f7c4610c640 10 monclient: get_monmap_and_config success 2023-11-05T08:07:09.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.714+0000 7f7c4610c640 4 set_mon_vals no callback set 2023-11-05T08:07:09.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.714+0000 7fe5596c2640 10 monclient: get_monmap_and_config 2023-11-05T08:07:09.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.714+0000 7fe5596c2640 10 monclient: build_initial_monmap 2023-11-05T08:07:09.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.714+0000 7fe5596c2640 10 monclient: monmap: 2023-11-05T08:07:09.800 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:07:09.800 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:09.801 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:07:09.716193+0000 2023-11-05T08:07:09.801 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:07:09.716193+0000 2023-11-05T08:07:09.801 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:07:09.801 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:09.801 INFO:teuthology.orchestra.run.smithi052.stderr:0: v1:172.21.15.52:6789/0 mon.noname-a-legacy 2023-11-05T08:07:09.802 INFO:teuthology.orchestra.run.smithi052.stderr:1: v1:172.21.15.156:6789/0 mon.noname-c-legacy 2023-11-05T08:07:09.802 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-b 2023-11-05T08:07:09.802 INFO:teuthology.orchestra.run.smithi052.stderr:3: v2:172.21.15.52:3300/0 mon.noname-a 2023-11-05T08:07:09.802 INFO:teuthology.orchestra.run.smithi052.stderr:4: v2:172.21.15.156:3300/0 mon.noname-c 2023-11-05T08:07:09.802 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:09.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.714+0000 7f74094c0640 1 --2- 172.21.15.52:0/1105730242 >> v2:172.21.15.156:3300/0 conn(0x7f74040b4240 0x7f74040b1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:09.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.714+0000 7f7c37fff640 1 -- 172.21.15.52:0/224966975 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c38034660 con 0x7f7c400ad980 2023-11-05T08:07:09.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.714+0000 7f7c37fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:09.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.714+0000 7f7c37fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-05T08:07:09.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.714+0000 7f7c37fff640 10 monclient: dump: 2023-11-05T08:07:09.804 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:09.805 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:09.805 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:09.805 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:09.805 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:09.805 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:09.805 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:09.806 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:09.806 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:09.806 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:09.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.715+0000 7f7c4610c640 10 monclient: shutdown 2023-11-05T08:07:09.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.715+0000 7f7c4610c640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:07:09.807 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.715+0000 7f7c4610c640 1 -- 172.21.15.52:0/224966975 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7c400ad980 msgr2=0x7f7c400ae5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:09.807 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.715+0000 7fe5596c2640 1 Processor -- start 2023-11-05T08:07:09.808 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.715+0000 7f7c4610c640 1 --2- 172.21.15.52:0/224966975 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7c400ad980 0x7f7c400ae5d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7c38009d90 tx=0x7f7c3802bea0 comp rx=0 tx=0).stop 2023-11-05T08:07:09.808 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.715+0000 7f7c4610c640 1 -- 172.21.15.52:0/224966975 shutdown_connections 2023-11-05T08:07:09.808 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.715+0000 7f7c4610c640 1 --2- 172.21.15.52:0/224966975 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7c4013efb0 0x7f7c400b0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:09.808 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.715+0000 7f7c4610c640 1 --2- 172.21.15.52:0/224966975 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7c400ad980 0x7f7c400ae5d0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:09.808 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.715+0000 7f7c4610c640 1 -- 172.21.15.52:0/224966975 >> 172.21.15.52:0/224966975 conn(0x7f7c400b7020 msgr2=0x7f7c400b7430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:07:09.809 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.715+0000 7f7c4610c640 1 -- 172.21.15.52:0/224966975 shutdown_connections 2023-11-05T08:07:09.809 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.715+0000 7f7c4610c640 1 -- 172.21.15.52:0/224966975 wait complete. 2023-11-05T08:07:09.809 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.715+0000 7fe5596c2640 1 -- start start 2023-11-05T08:07:09.809 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.715+0000 7fe5596c2640 10 monclient: init 2023-11-05T08:07:09.810 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.715+0000 7fbed659c640 1 --2- 172.21.15.52:0/1661704675 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbed00070e0 0x7fbed002d7f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fbed8079f30 tx=0x7fbed8068750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:09.810 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.715+0000 7fbec6ffd640 10 client.?.objecter ms_handle_connect 0x7fbed00070e0 2023-11-05T08:07:09.810 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.715+0000 7fbec6ffd640 10 client.?.objecter resend_mon_ops 2023-11-05T08:07:09.811 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.716+0000 7fe5596c2640 10 monclient: _reopen_session rank -1 2023-11-05T08:07:09.811 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.716+0000 7fe5596c2640 10 monclient: _add_conns ranks=[2,0,3,4,1] 2023-11-05T08:07:09.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.716+0000 7fe5596c2640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe5540b4240 0x7fe5540b1150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:09.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.716+0000 7fe5596c2640 10 monclient(hunting): picked mon.noname-b con 0x7fe5540b4240 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:07:09.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.716+0000 7fe5596c2640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fe5540b38d0 addr v1:172.21.15.52:6789/0 2023-11-05T08:07:09.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.716+0000 7fe5596c2640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe5540ade00 0x7fe55413b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:09.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.716+0000 7fe5596c2640 10 monclient(hunting): picked mon.noname-a con 0x7fe5540ade00 addr v2:172.21.15.52:3300/0 2023-11-05T08:07:09.813 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.716+0000 7fe5596c2640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5540b0cc0 con 0x7fe5540b38d0 2023-11-05T08:07:09.813 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.716+0000 7fe5596c2640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:09.813 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.716+0000 7fe5596c2640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5540b4620 con 0x7fe5540ade00 2023-11-05T08:07:09.813 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.716+0000 7fe5596c2640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:09.813 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.716+0000 7fe5596c2640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5540b1690 con 0x7fe5540b4240 2023-11-05T08:07:09.814 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.716+0000 7fe5596c2640 10 monclient(hunting): _renew_subs 2023-11-05T08:07:09.814 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.716+0000 7fe5596c2640 10 monclient(hunting): authenticate will time out at 1375.922221s 2023-11-05T08:07:09.814 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.716+0000 7f7c4610c640 10 monclient: build_initial_monmap 2023-11-05T08:07:09.815 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.716+0000 7f7c4610c640 10 monclient: monmap: 2023-11-05T08:07:09.815 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:07:09.815 INFO:teuthology.orchestra.run.smithi052.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-05T08:07:09.815 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 0.000000 2023-11-05T08:07:09.815 INFO:teuthology.orchestra.run.smithi052.stderr:created 0.000000 2023-11-05T08:07:09.816 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:07:09.816 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:09.816 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.noname-a 2023-11-05T08:07:09.816 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.noname-b 2023-11-05T08:07:09.816 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-c 2023-11-05T08:07:09.816 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:09.817 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.716+0000 7f7c4610c640 1 librados: starting msgr at 2023-11-05T08:07:09.817 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.716+0000 7f7c4610c640 1 librados: starting objecter 2023-11-05T08:07:09.817 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.716+0000 7f780659c640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:09.818 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.716+0000 7f780659c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:09.818 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.716+0000 7f780659c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:09.819 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.716+0000 7f7c4610c640 1 Processor -- start 2023-11-05T08:07:09.819 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.717+0000 7f7c4610c640 1 -- start start 2023-11-05T08:07:09.819 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.717+0000 7f7c4610c640 1 librados: setting wanted keys 2023-11-05T08:07:09.820 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.717+0000 7f7c4610c640 1 librados: calling monclient init 2023-11-05T08:07:09.820 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.717+0000 7f7c4610c640 10 monclient: init 2023-11-05T08:07:09.820 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.717+0000 7f7c4610c640 10 monclient: _reopen_session rank -1 2023-11-05T08:07:09.820 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.717+0000 7f7c4610c640 10 monclient: _add_conns ranks=[1,2,0] 2023-11-05T08:07:09.820 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.717+0000 7f7c4610c640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7c400ad980 0x7f7c40143ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:09.821 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.717+0000 7f7c4610c640 10 monclient(hunting): picked mon.noname-b con 0x7f7c400ad980 addr [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] 2023-11-05T08:07:09.821 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.717+0000 7f7c4610c640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7c4013eb20 0x7f7c401442d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:09.821 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.717+0000 7f7c4610c640 10 monclient(hunting): picked mon.noname-c con 0x7f7c4013eb20 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:07:09.821 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.717+0000 7f7c4610c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c4013efb0 0x7f7c40139920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:09.821 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.717+0000 7f7c4610c640 10 monclient(hunting): picked mon.noname-a con 0x7f7c4013efb0 addr [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] 2023-11-05T08:07:09.821 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.717+0000 7f7c4610c640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:09.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.717+0000 7f7c4610c640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c40144810 con 0x7f7c4013efb0 2023-11-05T08:07:09.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.717+0000 7f7c4610c640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:09.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.717+0000 7f7c4610c640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c40144ac0 con 0x7f7c400ad980 2023-11-05T08:07:09.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.717+0000 7f7c4610c640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:09.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.717+0000 7f7c4610c640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c401459d0 con 0x7f7c4013eb20 2023-11-05T08:07:09.823 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.717+0000 7f7c4610c640 10 monclient(hunting): _renew_subs 2023-11-05T08:07:09.823 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.717+0000 7f7c4610c640 10 monclient(hunting): authenticate will time out at 1375.923873s 2023-11-05T08:07:09.823 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.718+0000 7f74094c0640 10 monclient(hunting): get_auth_request con 0x7f74040b4240 auth_method 0 2023-11-05T08:07:09.824 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.718+0000 7f74094c0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:09.824 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.718+0000 7f74094c0640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:09.824 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.718+0000 7f74094c0640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:09.824 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.718+0000 7fe5537fe640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe5540ade00 0x7fe55413b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:09.825 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.718+0000 7f11c7fff640 1 --2- 172.21.15.52:0/3378090785 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f11c806dd10 0x7f11c8070280 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f11b80097a0 tx=0x7f11b802b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e822e361f474a094 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:09.825 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.718+0000 7fe5527fc640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fe5540b38d0 0x7fe5540ae640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:47054/0 (socket says 172.21.15.52:47054) 2023-11-05T08:07:09.826 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.718+0000 7fe5527fc640 1 -- 172.21.15.52:0/1125464803 learned_addr learned my addr 172.21.15.52:0/1125464803 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-11-05T08:07:09.826 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.718+0000 7fe5537fe640 10 monclient(hunting): get_auth_request con 0x7fe5540ade00 auth_method 0 2023-11-05T08:07:09.826 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.718+0000 7fe5537fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:09.826 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.718+0000 7fe5537fe640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:09.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.718+0000 7fe5537fe640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:09.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.719+0000 7f780659c640 10 monclient(hunting): handle_auth_done global_id 4223 payload 274 2023-11-05T08:07:09.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.719+0000 7f780659c640 1 -- 172.21.15.52:0/2594601883 >> v1:172.21.15.156:6789/0 conn(0x7f78080b38d0 legacy=0x7f78080ae640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-05T08:07:09.828 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.719+0000 7f780659c640 1 -- 172.21.15.52:0/2594601883 >> v1:172.21.15.52:6789/0 conn(0x7f78080ade00 legacy=0x7f780813b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:09.828 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.719+0000 7f780659c640 10 monclient: _finish_hunting 0 2023-11-05T08:07:09.828 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.719+0000 7f780659c640 1 monclient: found mon.noname-b 2023-11-05T08:07:09.828 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.719+0000 7f780659c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:07:09.828 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.719+0000 7f780659c640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.52:3301/0 2023-11-05T08:07:09.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.719+0000 7f780659c640 1 -- 172.21.15.52:0/2594601883 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f780813f5f0 con 0x7f78080b4240 2023-11-05T08:07:09.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.719+0000 7fe5537fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:09.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.719+0000 7fe5537fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:09.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.719+0000 7fe5537fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:09.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.720+0000 7f74094c0640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:09.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.720+0000 7f74094c0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:09.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.720+0000 7f74094c0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:09.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.721+0000 7f7c4590b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c4013efb0 0x7f7c40139920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:09.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.722+0000 7f7c4590b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c4013efb0 0x7f7c40139920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46850/0 (socket says 172.21.15.52:46850) 2023-11-05T08:07:09.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.722+0000 7f7c4590b640 1 -- 172.21.15.52:0/2875222341 learned_addr learned my addr 172.21.15.52:0/2875222341 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-11-05T08:07:09.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.722+0000 7f7c4590b640 10 monclient(hunting): get_auth_request con 0x7f7c4013efb0 auth_method 0 2023-11-05T08:07:09.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.722+0000 7f7c4590b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:09.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.722+0000 7f7c4590b640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:09.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.722+0000 7fb10559a640 1 -- 172.21.15.52:0/3615566260 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0fc031640 con 0x7fb10806d8d0 2023-11-05T08:07:09.833 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.722+0000 7fb10559a640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:09.833 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.722+0000 7f7c4590b640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:09.834 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.722+0000 7fb10559a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-11-05T08:07:09.834 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.722+0000 7fb10559a640 10 monclient: dump: 2023-11-05T08:07:09.835 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:09.835 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:09.835 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:09.835 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:09.835 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:09.836 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:09.836 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:09.836 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:09.836 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:09.836 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:09.837 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.722+0000 7fb10559a640 10 monclient: _finish_auth 0 2023-11-05T08:07:09.837 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.722+0000 7fb10559a640 10 monclient: _check_auth_tickets 2023-11-05T08:07:09.837 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.722+0000 7fb10559a640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:07:09.837 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.722+0000 7fb10559a640 1 -- 172.21.15.52:0/3615566260 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0fc0317a0 con 0x7fb10806d8d0 2023-11-05T08:07:09.837 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.722+0000 7fb10559a640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:07:09.838 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.722+0000 7fb10559a640 1 -- 172.21.15.52:0/3615566260 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0fc031b30 con 0x7fb10806d8d0 2023-11-05T08:07:09.838 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.722+0000 7fb10559a640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:09.838 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.722+0000 7fb10559a640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-05T08:07:09.838 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.722+0000 7fb10559a640 10 monclient: dump: 2023-11-05T08:07:09.838 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:09.839 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:09.839 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:09.839 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:09.839 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:09.839 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:09.839 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:09.840 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:09.840 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:09.840 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:09.840 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.722+0000 7fb10759e640 5 monclient: authenticate success, global_id 4309 2023-11-05T08:07:09.840 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.722+0000 7fb10759e640 10 monclient: get_monmap_and_config success 2023-11-05T08:07:09.841 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.722+0000 7fb10759e640 4 set_mon_vals no callback set 2023-11-05T08:07:09.841 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.723+0000 7fb10759e640 10 monclient: shutdown 2023-11-05T08:07:09.841 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.723+0000 7fb10759e640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:07:09.841 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.723+0000 7fb10759e640 1 -- 172.21.15.52:0/3615566260 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb10806d8d0 msgr2=0x7fb108070220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:09.841 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.723+0000 7fb10759e640 1 --2- 172.21.15.52:0/3615566260 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb10806d8d0 0x7fb108070220 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc009870 tx=0x7fb0fc02b8f0 comp rx=0 tx=0).stop 2023-11-05T08:07:09.842 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.724+0000 7fb10759e640 1 -- 172.21.15.52:0/3615566260 shutdown_connections 2023-11-05T08:07:09.842 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.724+0000 7fb10759e640 1 --2- 172.21.15.52:0/3615566260 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb108142d60 0x7fb1081431f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:09.842 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.724+0000 7fb10759e640 1 --2- 172.21.15.52:0/3615566260 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb10806d8d0 0x7fb108070220 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:09.842 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.724+0000 7fb10759e640 1 -- 172.21.15.52:0/3615566260 >> 172.21.15.52:0/3615566260 conn(0x7fb1080b2ca0 msgr2=0x7fb1080b30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:07:09.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.724+0000 7fe5537fe640 10 monclient(hunting): handle_auth_done global_id 4281 payload 274 2023-11-05T08:07:09.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.724+0000 7fb10759e640 1 -- 172.21.15.52:0/3615566260 shutdown_connections 2023-11-05T08:07:09.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.724+0000 7fb10759e640 1 -- 172.21.15.52:0/3615566260 wait complete. 2023-11-05T08:07:09.844 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.724+0000 7fe5537fe640 1 -- 172.21.15.52:0/1125464803 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe5540b4240 msgr2=0x7fe5540b1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-05T08:07:09.844 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.724+0000 7f780659c640 1 --2- 172.21.15.52:0/2594601883 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f78080b4240 0x7f78080b1150 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f77f00097d0 tx=0x7f77f002b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=60ac07b679ae0803 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:09.845 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.724+0000 7fe5537fe640 1 --2- 172.21.15.52:0/1125464803 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe5540b4240 0x7fe5540b1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:09.845 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.724+0000 7fe5537fe640 1 -- 172.21.15.52:0/1125464803 >> v1:172.21.15.52:6789/0 conn(0x7fe5540b38d0 legacy=0x7fe5540ae640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:09.845 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.724+0000 7fe5537fe640 10 monclient: _finish_hunting 0 2023-11-05T08:07:09.846 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.724+0000 7fe5537fe640 1 monclient: found mon.noname-a 2023-11-05T08:07:09.846 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.725+0000 7fe5537fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:07:09.846 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.725+0000 7fe5537fe640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.52:3300/0 2023-11-05T08:07:09.846 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.725+0000 7fe5537fe640 1 -- 172.21.15.52:0/1125464803 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe55413f5f0 con 0x7fe5540ade00 2023-11-05T08:07:09.848 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.725+0000 7fb10759e640 10 monclient: build_initial_monmap 2023-11-05T08:07:09.848 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.725+0000 7fb10759e640 10 monclient: monmap: 2023-11-05T08:07:09.848 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:07:09.849 INFO:teuthology.orchestra.run.smithi052.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-05T08:07:09.849 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 0.000000 2023-11-05T08:07:09.849 INFO:teuthology.orchestra.run.smithi052.stderr:created 0.000000 2023-11-05T08:07:09.849 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:07:09.849 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:09.850 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.noname-a 2023-11-05T08:07:09.850 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.noname-b 2023-11-05T08:07:09.850 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-c 2023-11-05T08:07:09.850 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:09.850 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.725+0000 7fb10759e640 1 librados: starting msgr at 2023-11-05T08:07:09.851 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.725+0000 7fb10759e640 1 librados: starting objecter 2023-11-05T08:07:09.851 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.725+0000 7fb10759e640 1 Processor -- start 2023-11-05T08:07:09.851 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.725+0000 7fb10759e640 1 -- start start 2023-11-05T08:07:09.851 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.725+0000 7fb10759e640 1 librados: setting wanted keys 2023-11-05T08:07:09.851 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.725+0000 7fb10759e640 1 librados: calling monclient init 2023-11-05T08:07:09.851 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.725+0000 7fb10759e640 10 monclient: init 2023-11-05T08:07:09.852 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.726+0000 7fb10759e640 10 monclient: _reopen_session rank -1 2023-11-05T08:07:09.852 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.726+0000 7fb10759e640 10 monclient: _add_conns ranks=[1,0,2] 2023-11-05T08:07:09.852 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.726+0000 7fb10759e640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb10806d8d0 0x7fb108145e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:09.852 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.726+0000 7fb10759e640 10 monclient(hunting): picked mon.noname-b con 0x7fb10806d8d0 addr [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] 2023-11-05T08:07:09.852 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.726+0000 7fb10759e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb10806dcb0 0x7fb108138600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:09.853 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.726+0000 7fb10759e640 10 monclient(hunting): picked mon.noname-a con 0x7fb10806dcb0 addr [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] 2023-11-05T08:07:09.853 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.726+0000 7fb10759e640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb108142d60 0x7fb108138b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:09.853 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.726+0000 7fb10759e640 10 monclient(hunting): picked mon.noname-c con 0x7fb108142d60 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:07:09.853 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.726+0000 7fb10759e640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:09.853 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.726+0000 7fb10759e640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb10813fe60 con 0x7fb10806dcb0 2023-11-05T08:07:09.854 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.726+0000 7fb10759e640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:09.854 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.726+0000 7fb10759e640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb108139080 con 0x7fb10806d8d0 2023-11-05T08:07:09.854 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.726+0000 7fb10759e640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:09.854 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.726+0000 7fb10759e640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb10813f940 con 0x7fb108142d60 2023-11-05T08:07:09.854 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.726+0000 7fb10759e640 10 monclient(hunting): _renew_subs 2023-11-05T08:07:09.855 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.726+0000 7fb10759e640 10 monclient(hunting): authenticate will time out at 1375.932745s 2023-11-05T08:07:09.856 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.728+0000 7f11c77fe640 1 -- 172.21.15.52:0/3378090785 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b8030610 con 0x7f11c806dd10 2023-11-05T08:07:09.856 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.728+0000 7f11c77fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:09.856 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.728+0000 7f11c77fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-11-05T08:07:09.856 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.728+0000 7f11c77fe640 10 monclient: dump: 2023-11-05T08:07:09.856 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:09.857 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:09.857 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:09.857 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:09.857 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:09.857 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:09.858 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:09.858 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:09.858 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:09.858 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:09.858 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.728+0000 7f11c77fe640 10 monclient: _finish_auth 0 2023-11-05T08:07:09.859 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.728+0000 7f11c77fe640 10 monclient: _check_auth_tickets 2023-11-05T08:07:09.859 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.728+0000 7f11c77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:07:09.859 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.728+0000 7f11cdb67640 5 monclient: authenticate success, global_id 4300 2023-11-05T08:07:09.859 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.728+0000 7f11cdb67640 20 monclient: get_monmap_and_config waiting for monmap|config 2023-11-05T08:07:09.859 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.728+0000 7f11c77fe640 1 -- 172.21.15.52:0/3378090785 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11b8030770 con 0x7f11c806dd10 2023-11-05T08:07:09.860 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.728+0000 7f11c77fe640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:07:09.860 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.728+0000 7f11cdb67640 10 monclient: get_monmap_and_config success 2023-11-05T08:07:09.860 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.728+0000 7fe5537fe640 1 --2- 172.21.15.52:0/1125464803 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe5540ade00 0x7fe55413b420 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe54c009d90 tx=0x7fe54c02be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac2cd1fcb46b64b server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:09.861 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.728+0000 7f11cdb67640 4 set_mon_vals no callback set 2023-11-05T08:07:09.861 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.729+0000 7f11c77fe640 1 -- 172.21.15.52:0/3378090785 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b8030b00 con 0x7f11c806dd10 2023-11-05T08:07:09.861 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.729+0000 7f11c77fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:09.862 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.729+0000 7f11c77fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-05T08:07:09.862 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.729+0000 7f11c77fe640 10 monclient: dump: 2023-11-05T08:07:09.862 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:09.862 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:09.862 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:09.863 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:09.863 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:09.863 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:09.863 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:09.863 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:09.863 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:09.864 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:09.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.729+0000 7f7c4510a640 1 --2- 172.21.15.52:0/2875222341 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7c400ad980 0x7f7c40143ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:09.865 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.729+0000 7f11cdb67640 10 monclient: shutdown 2023-11-05T08:07:09.865 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.729+0000 7f11cdb67640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:07:09.865 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.729+0000 7f11cdb67640 1 -- 172.21.15.52:0/3378090785 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f11c806dd10 msgr2=0x7f11c8070280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:09.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.729+0000 7f11cdb67640 1 --2- 172.21.15.52:0/3378090785 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f11c806dd10 0x7f11c8070280 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f11b80097a0 tx=0x7f11b802b960 comp rx=0 tx=0).stop 2023-11-05T08:07:09.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.729+0000 7f11cdb67640 1 -- 172.21.15.52:0/3378090785 shutdown_connections 2023-11-05T08:07:09.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.729+0000 7f11cdb67640 1 --2- 172.21.15.52:0/3378090785 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f11c8142860 0x7f11c8142d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:09.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.729+0000 7f11cdb67640 1 --2- 172.21.15.52:0/3378090785 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f11c806dd10 0x7f11c8070280 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:09.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.729+0000 7f11cdb67640 1 -- 172.21.15.52:0/3378090785 >> 172.21.15.52:0/3378090785 conn(0x7f11c80b30c0 msgr2=0x7f11c80b34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:07:09.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.730+0000 7f11cdb67640 1 -- 172.21.15.52:0/3378090785 shutdown_connections 2023-11-05T08:07:09.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.730+0000 7f11cdb67640 1 -- 172.21.15.52:0/3378090785 wait complete. 2023-11-05T08:07:09.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.730+0000 7f7c4590b640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:09.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.730+0000 7f7c4590b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:09.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.730+0000 7f7c4590b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:09.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.730+0000 7fb106d9d640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb108142d60 0x7fb108138b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:09.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.730+0000 7fb106d9d640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb108142d60 0x7fb108138b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.52:40222/0 (socket says 172.21.15.52:40222) 2023-11-05T08:07:09.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.730+0000 7fb106d9d640 1 -- 172.21.15.52:0/630459610 learned_addr learned my addr 172.21.15.52:0/630459610 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-11-05T08:07:09.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.730+0000 7fb106d9d640 10 monclient(hunting): get_auth_request con 0x7fb108142d60 auth_method 0 2023-11-05T08:07:09.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.730+0000 7fb106d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:09.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.730+0000 7fb106d9d640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:09.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.730+0000 7fb106d9d640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:09.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.730+0000 7f11cdb67640 10 monclient: build_initial_monmap 2023-11-05T08:07:09.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.730+0000 7f11cdb67640 10 monclient: monmap: 2023-11-05T08:07:09.871 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:07:09.871 INFO:teuthology.orchestra.run.smithi052.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-05T08:07:09.871 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 0.000000 2023-11-05T08:07:09.871 INFO:teuthology.orchestra.run.smithi052.stderr:created 0.000000 2023-11-05T08:07:09.871 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:07:09.872 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:09.872 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.noname-a 2023-11-05T08:07:09.872 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.noname-b 2023-11-05T08:07:09.872 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-c 2023-11-05T08:07:09.872 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:09.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.731+0000 7f11cdb67640 1 librados: starting msgr at 2023-11-05T08:07:09.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.731+0000 7f11cdb67640 1 librados: starting objecter 2023-11-05T08:07:09.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.731+0000 7f11cdb67640 1 Processor -- start 2023-11-05T08:07:09.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.731+0000 7f11cdb67640 1 -- start start 2023-11-05T08:07:09.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.731+0000 7f11cdb67640 1 librados: setting wanted keys 2023-11-05T08:07:09.874 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.731+0000 7f11cdb67640 1 librados: calling monclient init 2023-11-05T08:07:09.874 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.731+0000 7f11cdb67640 10 monclient: init 2023-11-05T08:07:09.874 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.732+0000 7f74094c0640 10 monclient(hunting): handle_auth_done global_id 4312 payload 274 2023-11-05T08:07:09.874 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.732+0000 7f74094c0640 1 -- 172.21.15.52:0/1105730242 >> v1:172.21.15.156:6789/0 conn(0x7f74040b38d0 legacy=0x7f74040ae640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:09.875 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.732+0000 7f74094c0640 1 -- 172.21.15.52:0/1105730242 >> v1:172.21.15.52:6789/0 conn(0x7f74040ade00 legacy=0x7f740413b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:09.875 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.732+0000 7f74094c0640 10 monclient: _finish_hunting 0 2023-11-05T08:07:09.875 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.732+0000 7f74094c0640 1 monclient: found mon.noname-c 2023-11-05T08:07:09.875 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.732+0000 7f74094c0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:07:09.875 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.732+0000 7f74094c0640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.156:3300/0 2023-11-05T08:07:09.876 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.732+0000 7f74094c0640 1 -- 172.21.15.52:0/1105730242 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f740413f5f0 con 0x7f74040b4240 2023-11-05T08:07:09.876 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.732+0000 7f7c44909640 1 --2- 172.21.15.52:0/2875222341 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7c4013eb20 0x7f7c401442d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:09.877 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.732+0000 7f11cdb67640 10 monclient: _reopen_session rank -1 2023-11-05T08:07:09.877 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.732+0000 7f11cdb67640 10 monclient: _add_conns ranks=[0,1,2] 2023-11-05T08:07:09.877 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.732+0000 7f11cdb67640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f11c806d930 0x7f11c813af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:09.878 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.732+0000 7f11cdb67640 10 monclient(hunting): picked mon.noname-a con 0x7f11c806d930 addr [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] 2023-11-05T08:07:09.878 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.732+0000 7f11cdb67640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f11c806dd10 0x7f11c8145770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:09.878 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.732+0000 7f11cdb67640 10 monclient(hunting): picked mon.noname-b con 0x7f11c806dd10 addr [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] 2023-11-05T08:07:09.878 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.732+0000 7f11cdb67640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f11c8142860 0x7f11c81444b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:09.878 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.732+0000 7f7c4510a640 10 monclient(hunting): get_auth_request con 0x7f7c400ad980 auth_method 0 2023-11-05T08:07:09.879 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.732+0000 7f7c4510a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:09.879 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.732+0000 7f7c4510a640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:09.879 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.732+0000 7f7c4510a640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:09.880 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.732+0000 7f11cdb67640 10 monclient(hunting): picked mon.noname-c con 0x7f11c8142860 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:07:09.880 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.732+0000 7f11cdb67640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:09.880 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.733+0000 7f11cdb67640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11c80a9440 con 0x7f11c806d930 2023-11-05T08:07:09.881 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.733+0000 7f11cdb67640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:09.881 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.733+0000 7f11cdb67640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11c8143f90 con 0x7f11c806dd10 2023-11-05T08:07:09.881 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.733+0000 7f11cdb67640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:09.881 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.733+0000 7fb106d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:09.882 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.733+0000 7fb106d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:09.882 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.733+0000 7fb106d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:09.882 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.733+0000 7f11cdb67640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11c81394c0 con 0x7f11c8142860 2023-11-05T08:07:09.883 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.733+0000 7f11cdb67640 10 monclient(hunting): _renew_subs 2023-11-05T08:07:09.883 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.733+0000 7f11cdb67640 10 monclient(hunting): authenticate will time out at 1375.939058s 2023-11-05T08:07:09.884 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.733+0000 7f7c4510a640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:09.884 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.733+0000 7f7c4510a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:09.884 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.733+0000 7f7c4510a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:09.884 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.733+0000 7f7c44909640 10 monclient(hunting): get_auth_request con 0x7f7c4013eb20 auth_method 0 2023-11-05T08:07:09.884 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.733+0000 7f7c44909640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:09.885 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.733+0000 7f7c44909640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:09.885 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.733+0000 7f7c44909640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:09.885 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.734+0000 7f7c4590b640 10 monclient(hunting): handle_auth_done global_id 4284 payload 824 2023-11-05T08:07:09.885 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.734+0000 7f7c4590b640 1 -- 172.21.15.52:0/2875222341 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7c4013eb20 msgr2=0x7f7c401442d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:09.885 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.734+0000 7f7c4590b640 1 --2- 172.21.15.52:0/2875222341 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7c4013eb20 0x7f7c401442d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:09.886 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.734+0000 7f7c4590b640 1 -- 172.21.15.52:0/2875222341 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7c400ad980 msgr2=0x7f7c40143ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:09.886 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.734+0000 7f7c4590b640 1 --2- 172.21.15.52:0/2875222341 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7c400ad980 0x7f7c40143ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:09.886 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.734+0000 7f7c4590b640 10 monclient: _finish_hunting 0 2023-11-05T08:07:09.886 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.734+0000 7f7c4590b640 1 monclient: found mon.noname-a 2023-11-05T08:07:09.886 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.735+0000 7f7c4590b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:07:09.887 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.735+0000 7f7c4590b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.52:3300/0 2023-11-05T08:07:09.887 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.735+0000 7f7c4590b640 1 -- 172.21.15.52:0/2875222341 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c38009a70 con 0x7f7c4013efb0 2023-11-05T08:07:09.887 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.736+0000 7fb106d9d640 10 monclient(hunting): handle_auth_done global_id 4226 payload 824 2023-11-05T08:07:09.888 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.736+0000 7fb106d9d640 1 -- 172.21.15.52:0/630459610 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb10806d8d0 msgr2=0x7fb108145e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:09.888 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.736+0000 7fb106d9d640 1 --2- 172.21.15.52:0/630459610 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb10806d8d0 0x7fb108145e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:09.888 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.736+0000 7fb106d9d640 1 -- 172.21.15.52:0/630459610 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb10806dcb0 msgr2=0x7fb108138600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:09.888 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.736+0000 7fb106d9d640 1 --2- 172.21.15.52:0/630459610 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb10806dcb0 0x7fb108138600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:09.888 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.736+0000 7fb106d9d640 10 monclient: _finish_hunting 0 2023-11-05T08:07:09.889 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.736+0000 7fb106d9d640 1 monclient: found mon.noname-c 2023-11-05T08:07:09.889 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.736+0000 7fb106d9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:07:09.889 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.736+0000 7fb106d9d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.52:3301/0 2023-11-05T08:07:09.889 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.736+0000 7fb106d9d640 1 -- 172.21.15.52:0/630459610 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0fc0094d0 con 0x7fb108142d60 2023-11-05T08:07:09.890 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.738+0000 7f7c4590b640 1 --2- 172.21.15.52:0/2875222341 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c4013efb0 0x7f7c40139920 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c00b410 tx=0x7f7c3c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:09.890 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.738+0000 7f7c35ffb640 10 client.?.objecter ms_handle_connect 0x7f7c4013efb0 2023-11-05T08:07:09.890 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.738+0000 7f7c35ffb640 10 client.?.objecter resend_mon_ops 2023-11-05T08:07:09.891 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.740+0000 7fb106d9d640 1 --2- 172.21.15.52:0/630459610 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb108142d60 0x7fb108138b40 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb0f800b440 tx=0x7fb0f800b900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:09.891 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.740+0000 7fb0f6ffd640 10 client.?.objecter ms_handle_connect 0x7fb108142d60 2023-11-05T08:07:09.891 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.740+0000 7fb0f6ffd640 10 client.?.objecter resend_mon_ops 2023-11-05T08:07:09.891 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.742+0000 7f74094c0640 1 --2- 172.21.15.52:0/1105730242 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f74040b4240 0x7f74040b1150 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f74000097d0 tx=0x7f740002b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2187a0d318811baf server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:09.892 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.742+0000 7f11ccb65640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f11c806d930 0x7f11c813af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:09.892 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.742+0000 7f11ccb65640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f11c806d930 0x7f11c813af50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46864/0 (socket says 172.21.15.52:46864) 2023-11-05T08:07:09.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.742+0000 7f11ccb65640 1 -- 172.21.15.52:0/1817509779 learned_addr learned my addr 172.21.15.52:0/1817509779 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-11-05T08:07:09.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.742+0000 7f11ccb65640 10 monclient(hunting): get_auth_request con 0x7f11c806d930 auth_method 0 2023-11-05T08:07:09.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.742+0000 7f11ccb65640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:09.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.742+0000 7f11ccb65640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:09.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.742+0000 7f11ccb65640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:09.894 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.743+0000 7f11ccb65640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:09.894 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.743+0000 7f11ccb65640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:09.894 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.743+0000 7f11ccb65640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:09.895 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.745+0000 7f7805d9b640 1 -- 172.21.15.52:0/2594601883 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f002e070 con 0x7f78080b4240 2023-11-05T08:07:09.895 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.745+0000 7f7805d9b640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:09.895 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.745+0000 7f7805d9b640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-05T08:07:09.895 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.745+0000 7f7805d9b640 10 monclient: dump: 2023-11-05T08:07:09.895 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:09.896 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:09.896 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:09.896 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:09.896 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:09.896 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:09.896 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:09.897 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:09.897 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:09.897 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:09.897 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.745+0000 7f7805d9b640 10 monclient: _finish_auth 0 2023-11-05T08:07:09.897 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.745+0000 7f7805d9b640 10 monclient: _check_auth_tickets 2023-11-05T08:07:09.898 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.745+0000 7f7805d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:07:09.898 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.745+0000 7f7805d9b640 1 -- 172.21.15.52:0/2594601883 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77f00315a0 con 0x7f78080b4240 2023-11-05T08:07:09.898 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.745+0000 7f7805d9b640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:07:09.898 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.745+0000 7f7805d9b640 1 -- 172.21.15.52:0/2594601883 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f0031970 con 0x7f78080b4240 2023-11-05T08:07:09.898 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.745+0000 7f7805d9b640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:09.899 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.745+0000 7f7805d9b640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-11-05T08:07:09.899 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.745+0000 7f7805d9b640 10 monclient: dump: 2023-11-05T08:07:09.899 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:09.899 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:09.899 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:09.900 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:09.900 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:09.900 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:09.900 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:09.900 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:09.901 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:09.901 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:09.901 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.745+0000 7f780ce52640 5 monclient: authenticate success, global_id 4223 2023-11-05T08:07:09.901 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.745+0000 7f780ce52640 10 monclient: get_monmap_and_config success 2023-11-05T08:07:09.901 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.745+0000 7f780ce52640 4 set_mon_vals no callback set 2023-11-05T08:07:09.902 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.745+0000 7f11c7fff640 1 --2- 172.21.15.52:0/1817509779 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f11c806dd10 0x7f11c8145770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:09.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.745+0000 7f780ce52640 10 monclient: shutdown 2023-11-05T08:07:09.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.745+0000 7f780ce52640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:07:09.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.745+0000 7f780ce52640 1 -- 172.21.15.52:0/2594601883 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f78080b4240 msgr2=0x7f78080b1150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:09.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.745+0000 7f780ce52640 1 --2- 172.21.15.52:0/2594601883 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f78080b4240 0x7f78080b1150 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f77f00097d0 tx=0x7f77f002b840 comp rx=0 tx=0).stop 2023-11-05T08:07:09.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.745+0000 7f780ce52640 1 -- 172.21.15.52:0/2594601883 shutdown_connections 2023-11-05T08:07:09.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.745+0000 7f780ce52640 1 --2- 172.21.15.52:0/2594601883 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f78080b4240 0x7f78080b1150 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:09.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.745+0000 7f780ce52640 1 -- 172.21.15.52:0/2594601883 >> 172.21.15.52:0/2594601883 conn(0x7f7808065cd0 msgr2=0x7f78080660e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:07:09.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.746+0000 7f780ce52640 1 -- 172.21.15.52:0/2594601883 shutdown_connections 2023-11-05T08:07:09.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.746+0000 7f780ce52640 1 -- 172.21.15.52:0/2594601883 wait complete. 2023-11-05T08:07:09.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.746+0000 7f11c7fff640 10 monclient(hunting): get_auth_request con 0x7f11c806dd10 auth_method 0 2023-11-05T08:07:09.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.746+0000 7f11c7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:09.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.746+0000 7f11c7fff640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:09.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.746+0000 7f11c7fff640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:09.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.746+0000 7f73fbfff640 1 -- 172.21.15.52:0/1105730242 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f740002d040 con 0x7f74040b4240 2023-11-05T08:07:09.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.746+0000 7f73fbfff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:09.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.746+0000 7f73fbfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-11-05T08:07:09.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.746+0000 7f73fbfff640 10 monclient: dump: 2023-11-05T08:07:09.907 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:09.907 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:09.907 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:09.908 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:09.908 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:09.908 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:09.908 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:09.908 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:09.909 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:09.909 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:09.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.746+0000 7f73fbfff640 10 monclient: _finish_auth 0 2023-11-05T08:07:09.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.746+0000 7f73fbfff640 10 monclient: _check_auth_tickets 2023-11-05T08:07:09.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.746+0000 7f73fbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:07:09.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.746+0000 7f73fbfff640 1 -- 172.21.15.52:0/1105730242 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7400031810 con 0x7f74040b4240 2023-11-05T08:07:09.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.746+0000 7f73fbfff640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:07:09.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.746+0000 7f73fbfff640 1 -- 172.21.15.52:0/1105730242 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7400031ba0 con 0x7f74040b4240 2023-11-05T08:07:09.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.746+0000 7f73fbfff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:09.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.746+0000 7f73fbfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-05T08:07:09.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.746+0000 7f73fbfff640 10 monclient: dump: 2023-11-05T08:07:09.911 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:09.911 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:09.911 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:09.911 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:09.911 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:09.912 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:09.912 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:09.912 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:09.912 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:09.912 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:09.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.746+0000 7f11cd366640 1 --2- 172.21.15.52:0/1817509779 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f11c8142860 0x7f11c81444b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:09.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.746+0000 7f740b724640 5 monclient: authenticate success, global_id 4312 2023-11-05T08:07:09.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.746+0000 7f740b724640 10 monclient: get_monmap_and_config success 2023-11-05T08:07:09.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.746+0000 7f740b724640 4 set_mon_vals no callback set 2023-11-05T08:07:09.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.747+0000 7f780ce52640 10 monclient: build_initial_monmap 2023-11-05T08:07:09.915 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.747+0000 7f780ce52640 10 monclient: monmap: 2023-11-05T08:07:09.915 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:07:09.915 INFO:teuthology.orchestra.run.smithi052.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-05T08:07:09.915 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 0.000000 2023-11-05T08:07:09.915 INFO:teuthology.orchestra.run.smithi052.stderr:created 0.000000 2023-11-05T08:07:09.916 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:07:09.916 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:09.916 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.noname-a 2023-11-05T08:07:09.916 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.noname-b 2023-11-05T08:07:09.916 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-c 2023-11-05T08:07:09.916 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:09.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.747+0000 7f11c7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:09.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.747+0000 7f11c7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:09.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.747+0000 7f11c7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:09.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.747+0000 7f11cd366640 10 monclient(hunting): get_auth_request con 0x7f11c8142860 auth_method 0 2023-11-05T08:07:09.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.747+0000 7f11cd366640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:09.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.747+0000 7f11cd366640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:09.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.747+0000 7f11cd366640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:09.919 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.747+0000 7f740b724640 10 monclient: shutdown 2023-11-05T08:07:09.922 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.747+0000 7f740b724640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:07:09.922 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.747+0000 7f740b724640 1 -- 172.21.15.52:0/1105730242 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f74040b4240 msgr2=0x7f74040b1150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:09.922 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.747+0000 7f740b724640 1 --2- 172.21.15.52:0/1105730242 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f74040b4240 0x7f74040b1150 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f74000097d0 tx=0x7f740002b8b0 comp rx=0 tx=0).stop 2023-11-05T08:07:09.923 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.747+0000 7f11ccb65640 10 monclient(hunting): handle_auth_done global_id 4287 payload 824 2023-11-05T08:07:09.924 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.747+0000 7f740b724640 1 -- 172.21.15.52:0/1105730242 shutdown_connections 2023-11-05T08:07:09.924 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.747+0000 7f740b724640 1 --2- 172.21.15.52:0/1105730242 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f74040b4240 0x7f74040b1150 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:09.924 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.747+0000 7f740b724640 1 -- 172.21.15.52:0/1105730242 >> 172.21.15.52:0/1105730242 conn(0x7f7404065cd0 msgr2=0x7f74040660e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:07:09.924 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.747+0000 7f11ccb65640 1 -- 172.21.15.52:0/1817509779 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f11c8142860 msgr2=0x7f11c81444b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:09.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.747+0000 7f11ccb65640 1 --2- 172.21.15.52:0/1817509779 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f11c8142860 0x7f11c81444b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:09.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.747+0000 7f11ccb65640 1 -- 172.21.15.52:0/1817509779 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f11c806dd10 msgr2=0x7f11c8145770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:09.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.747+0000 7f11ccb65640 1 --2- 172.21.15.52:0/1817509779 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f11c806dd10 0x7f11c8145770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:09.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.747+0000 7f11ccb65640 10 monclient: _finish_hunting 0 2023-11-05T08:07:09.926 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.747+0000 7f11ccb65640 1 monclient: found mon.noname-a 2023-11-05T08:07:09.926 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.747+0000 7f11ccb65640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:07:09.926 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.747+0000 7f11ccb65640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.52:3300/0 2023-11-05T08:07:09.926 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.747+0000 7f11ccb65640 1 -- 172.21.15.52:0/1817509779 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11b8009400 con 0x7f11c806d930 2023-11-05T08:07:09.927 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.748+0000 7f740b724640 1 -- 172.21.15.52:0/1105730242 shutdown_connections 2023-11-05T08:07:09.927 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.748+0000 7f740b724640 1 -- 172.21.15.52:0/1105730242 wait complete. 2023-11-05T08:07:09.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.748+0000 7f780ce52640 1 librados: starting msgr at 2023-11-05T08:07:09.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.748+0000 7f780ce52640 1 librados: starting objecter 2023-11-05T08:07:09.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.748+0000 7f780ce52640 1 Processor -- start 2023-11-05T08:07:09.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.748+0000 7f780ce52640 1 -- start start 2023-11-05T08:07:09.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.748+0000 7f780ce52640 1 librados: setting wanted keys 2023-11-05T08:07:09.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.748+0000 7f780ce52640 1 librados: calling monclient init 2023-11-05T08:07:09.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.748+0000 7f780ce52640 10 monclient: init 2023-11-05T08:07:09.930 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.749+0000 7f740b724640 10 monclient: build_initial_monmap 2023-11-05T08:07:09.930 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.749+0000 7f740b724640 10 monclient: monmap: 2023-11-05T08:07:09.930 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:07:09.930 INFO:teuthology.orchestra.run.smithi052.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-05T08:07:09.930 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 0.000000 2023-11-05T08:07:09.931 INFO:teuthology.orchestra.run.smithi052.stderr:created 0.000000 2023-11-05T08:07:09.931 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:07:09.931 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:09.931 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.noname-a 2023-11-05T08:07:09.931 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.noname-b 2023-11-05T08:07:09.932 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-c 2023-11-05T08:07:09.932 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:09.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.749+0000 7f780ce52640 10 monclient: _reopen_session rank -1 2023-11-05T08:07:09.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.749+0000 7f780ce52640 10 monclient: _add_conns ranks=[0,2,1] 2023-11-05T08:07:09.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.749+0000 7f740b724640 1 librados: starting msgr at 2023-11-05T08:07:09.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.749+0000 7f740b724640 1 librados: starting objecter 2023-11-05T08:07:09.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.749+0000 7f780ce52640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f78080ade00 0x7f78081454c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:09.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.749+0000 7f740b724640 1 Processor -- start 2023-11-05T08:07:09.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.749+0000 7f740b724640 1 -- start start 2023-11-05T08:07:09.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.750+0000 7f740b724640 1 librados: setting wanted keys 2023-11-05T08:07:09.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.749+0000 7fb0f6ffd640 1 -- 172.21.15.52:0/630459610 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f8011830 con 0x7fb108142d60 2023-11-05T08:07:09.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.750+0000 7fb0f6ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:09.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.750+0000 7f740b724640 1 librados: calling monclient init 2023-11-05T08:07:09.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.750+0000 7f740b724640 10 monclient: init 2023-11-05T08:07:09.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.750+0000 7fb0f6ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-11-05T08:07:09.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.750+0000 7fb0f6ffd640 10 monclient: dump: 2023-11-05T08:07:09.937 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:09.937 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:09.937 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:09.937 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:09.937 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:09.938 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:09.938 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:09.938 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:09.938 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:09.938 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:09.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.750+0000 7fb0f6ffd640 10 monclient: _finish_auth 0 2023-11-05T08:07:09.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.750+0000 7fb0f6ffd640 10 monclient: _check_auth_tickets 2023-11-05T08:07:09.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.750+0000 7f780ce52640 10 monclient(hunting): picked mon.noname-a con 0x7f78080ade00 addr [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] 2023-11-05T08:07:09.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.750+0000 7f780ce52640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f78080b4240 0x7f780813d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:09.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.750+0000 7f11ccb65640 1 --2- 172.21.15.52:0/1817509779 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f11c806d930 0x7f11c813af50 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f11bc00c4a0 tx=0x7f11bc00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:09.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.750+0000 7f11c57fa640 10 client.?.objecter ms_handle_connect 0x7f11c806d930 2023-11-05T08:07:09.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.750+0000 7f11c57fa640 10 client.?.objecter resend_mon_ops 2023-11-05T08:07:09.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.750+0000 7f780ce52640 10 monclient(hunting): picked mon.noname-c con 0x7f78080b4240 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:07:09.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.750+0000 7f780ce52640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7808137a40 0x7f7808144300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:09.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.750+0000 7fb0f6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:07:09.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.750+0000 7fb10759e640 5 monclient: authenticate success, global_id 4226 2023-11-05T08:07:09.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.750+0000 7fb0f6ffd640 1 -- 172.21.15.52:0/630459610 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0f80119b0 con 0x7fb108142d60 2023-11-05T08:07:09.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.750+0000 7fb0f6ffd640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:07:09.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.750+0000 7fb0f6ffd640 1 -- 172.21.15.52:0/630459610 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f8011d60 con 0x7fb108142d60 2023-11-05T08:07:09.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.750+0000 7fb10759e640 10 monclient: _renew_subs 2023-11-05T08:07:09.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.750+0000 7fb10759e640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.52:3301/0 2023-11-05T08:07:09.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.750+0000 7fb10759e640 1 -- 172.21.15.52:0/630459610 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb10806fbd0 con 0x7fb108142d60 2023-11-05T08:07:09.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.750+0000 7fb0f6ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:09.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.750+0000 7fb0f6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-11-05T08:07:09.944 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.750+0000 7fb104d99640 4 set_mon_vals no callback set 2023-11-05T08:07:09.944 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.750+0000 7fb0f6ffd640 10 monclient: dump: 2023-11-05T08:07:09.944 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:09.944 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:09.944 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:09.944 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:09.945 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:09.945 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:09.945 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:09.945 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:09.945 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:09.946 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:09.946 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.750+0000 7fb10759e640 10 client.4226.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-05T08:07:09.946 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.750+0000 7fb10759e640 10 monclient: _renew_subs 2023-11-05T08:07:09.946 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.750+0000 7fb10759e640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.52:3301/0 2023-11-05T08:07:09.946 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.750+0000 7fb10759e640 1 -- 172.21.15.52:0/630459610 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb10813f460 con 0x7fb108142d60 2023-11-05T08:07:09.947 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.750+0000 7fb10759e640 1 librados: init done 2023-11-05T08:07:09.947 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.750+0000 7f780ce52640 10 monclient(hunting): picked mon.noname-b con 0x7f7808137a40 addr [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] 2023-11-05T08:07:09.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.750+0000 7f780ce52640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:09.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.750+0000 7f780ce52640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7808145a00 con 0x7f78080ade00 2023-11-05T08:07:09.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.750+0000 7f780ce52640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:09.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.750+0000 7f780ce52640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f780813af10 con 0x7f7808137a40 2023-11-05T08:07:09.949 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.750+0000 7f780ce52640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:09.949 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.750+0000 7f780ce52640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f780813ee80 con 0x7f78080b4240 2023-11-05T08:07:09.949 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.750+0000 7f780ce52640 10 monclient(hunting): _renew_subs 2023-11-05T08:07:09.949 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.750+0000 7f780ce52640 10 monclient(hunting): authenticate will time out at 1375.956820s 2023-11-05T08:07:09.950 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.750+0000 7f740b724640 10 monclient: _reopen_session rank -1 2023-11-05T08:07:09.950 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.751+0000 7f740b724640 10 monclient: _add_conns ranks=[0,1,2] 2023-11-05T08:07:09.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.751+0000 7f740b724640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f74040ade00 0x7f740413d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:09.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.751+0000 7f740b724640 10 monclient(hunting): picked mon.noname-a con 0x7f74040ade00 addr [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] 2023-11-05T08:07:09.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.751+0000 7fb10759e640 10 client.4226.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:07:09.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.751+0000 7fb10759e640 15 client.4226.objecter _session_command_op_assign -1 1 2023-11-05T08:07:09.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.751+0000 7fb10759e640 20 client.4226.objecter _get_session osd=-1 returning homeless 2023-11-05T08:07:09.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.751+0000 7fb10759e640 10 client.4226.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-05T08:07:09.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.751+0000 7fb10759e640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.52:3301/0 2023-11-05T08:07:09.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.751+0000 7fb10759e640 1 -- 172.21.15.52:0/630459610 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb10806fe00 con 0x7fb108142d60 2023-11-05T08:07:09.954 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.751+0000 7f740b724640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f74040b4240 0x7f740413ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:09.954 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.751+0000 7f740b724640 10 monclient(hunting): picked mon.noname-b con 0x7f74040b4240 addr [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] 2023-11-05T08:07:09.954 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.751+0000 7f740b724640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7404137db0 0x7f7404131fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:09.954 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.751+0000 7f740b724640 10 monclient(hunting): picked mon.noname-c con 0x7f7404137db0 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:07:09.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.751+0000 7f740b724640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:09.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.751+0000 7f740b724640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f740413d3a0 con 0x7f74040ade00 2023-11-05T08:07:09.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.751+0000 7f740b724640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:09.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.751+0000 7f740b724640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f740413ef70 con 0x7f74040b4240 2023-11-05T08:07:09.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.751+0000 7f740b724640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:09.956 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.751+0000 7f740b724640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f740413c220 con 0x7f7404137db0 2023-11-05T08:07:09.956 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.751+0000 7f740b724640 10 monclient(hunting): _renew_subs 2023-11-05T08:07:09.956 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.751+0000 7f740b724640 10 monclient(hunting): authenticate will time out at 1375.957540s 2023-11-05T08:07:09.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.752+0000 7f780659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f78080ade00 0x7f78081454c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:09.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.752+0000 7f780659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f78080ade00 0x7f78081454c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46880/0 (socket says 172.21.15.52:46880) 2023-11-05T08:07:09.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.752+0000 7f780659c640 1 -- 172.21.15.52:0/988693665 learned_addr learned my addr 172.21.15.52:0/988693665 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-11-05T08:07:09.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.752+0000 7f780659c640 10 monclient(hunting): get_auth_request con 0x7f78080ade00 auth_method 0 2023-11-05T08:07:09.958 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.752+0000 7f780659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:09.958 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.752+0000 7f780659c640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:09.958 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.752+0000 7f780659c640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:09.958 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.753+0000 7f74094c0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f74040ade00 0x7f740413d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:09.959 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.753+0000 7f7806d9d640 1 --2- 172.21.15.52:0/988693665 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7808137a40 0x7f7808144300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:09.959 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.753+0000 7f7408cbf640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f74040b4240 0x7f740413ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:09.960 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.753+0000 7f7806d9d640 10 monclient(hunting): get_auth_request con 0x7f7808137a40 auth_method 0 2023-11-05T08:07:09.960 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.753+0000 7f7806d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:09.960 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.753+0000 7f7806d9d640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:09.960 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.753+0000 7f7806d9d640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:09.961 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.754+0000 7f780659c640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:09.961 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.754+0000 7f780659c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:09.961 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.754+0000 7f780659c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:09.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.754+0000 7f7408cbf640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f74040b4240 0x7f740413ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.52:58940/0 (socket says 172.21.15.52:58940) 2023-11-05T08:07:09.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.754+0000 7f7408cbf640 1 -- 172.21.15.52:0/2924702582 learned_addr learned my addr 172.21.15.52:0/2924702582 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-11-05T08:07:09.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.754+0000 7f7408cbf640 10 monclient(hunting): get_auth_request con 0x7f74040b4240 auth_method 0 2023-11-05T08:07:09.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.754+0000 7f7408cbf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:09.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.754+0000 7f7408cbf640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:09.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.754+0000 7f7408cbf640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:09.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.754+0000 7f74094c0640 10 monclient(hunting): get_auth_request con 0x7f74040ade00 auth_method 0 2023-11-05T08:07:09.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.754+0000 7f74094c0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:09.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.754+0000 7f74094c0640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:09.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.754+0000 7f74094c0640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:09.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.754+0000 7f7806d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:09.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.754+0000 7f7806d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:09.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.754+0000 7f7806d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:09.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.754+0000 7f7408cbf640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:09.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.754+0000 7f7408cbf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:09.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.754+0000 7f7408cbf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:09.966 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.757+0000 7f7806d9d640 10 monclient(hunting): handle_auth_done global_id 4324 payload 824 2023-11-05T08:07:09.966 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.757+0000 7f7806d9d640 1 -- 172.21.15.52:0/988693665 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f78080b4240 msgr2=0x7f780813d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:09.966 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.757+0000 7f7806d9d640 1 --2- 172.21.15.52:0/988693665 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f78080b4240 0x7f780813d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:09.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.757+0000 7f7806d9d640 1 -- 172.21.15.52:0/988693665 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f78080ade00 msgr2=0x7f78081454c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:09.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.757+0000 7f7806d9d640 1 --2- 172.21.15.52:0/988693665 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f78080ade00 0x7f78081454c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:09.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.757+0000 7f7806d9d640 10 monclient: _finish_hunting 0 2023-11-05T08:07:09.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.757+0000 7f7806d9d640 1 monclient: found mon.noname-b 2023-11-05T08:07:09.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.757+0000 7f7806d9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:07:09.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.757+0000 7f7806d9d640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.156:3300/0 2023-11-05T08:07:09.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.757+0000 7f7806d9d640 1 -- 172.21.15.52:0/988693665 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77f0009400 con 0x7f7808137a40 2023-11-05T08:07:09.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.761+0000 7f7408cbf640 10 monclient(hunting): handle_auth_done global_id 4327 payload 824 2023-11-05T08:07:09.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.761+0000 7f7408cbf640 1 -- 172.21.15.52:0/2924702582 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7404137db0 msgr2=0x7f7404131fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:09.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.761+0000 7f7408cbf640 1 --2- 172.21.15.52:0/2924702582 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7404137db0 0x7f7404131fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:09.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.761+0000 7f7408cbf640 1 -- 172.21.15.52:0/2924702582 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f74040ade00 msgr2=0x7f740413d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:09.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.761+0000 7f7408cbf640 1 --2- 172.21.15.52:0/2924702582 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f74040ade00 0x7f740413d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:09.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.761+0000 7f7408cbf640 10 monclient: _finish_hunting 0 2023-11-05T08:07:09.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.761+0000 7f7408cbf640 1 monclient: found mon.noname-b 2023-11-05T08:07:09.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.761+0000 7f7408cbf640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:07:09.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.761+0000 7f7408cbf640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.156:3300/0 2023-11-05T08:07:09.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.761+0000 7f7408cbf640 1 -- 172.21.15.52:0/2924702582 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7400009400 con 0x7f74040b4240 2023-11-05T08:07:09.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.763+0000 7f7806d9d640 1 --2- 172.21.15.52:0/988693665 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7808137a40 0x7f7808144300 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f780000ca70 tx=0x7f780000cf30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:09.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.763+0000 7f77feffd640 10 client.?.objecter ms_handle_connect 0x7f7808137a40 2023-11-05T08:07:09.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.763+0000 7f77feffd640 10 client.?.objecter resend_mon_ops 2023-11-05T08:07:09.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.766+0000 7f7408cbf640 1 --2- 172.21.15.52:0/2924702582 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f74040b4240 0x7f740413ce60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f73f400c450 tx=0x7f73f400c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:09.972 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.766+0000 7f73f9ffb640 10 client.?.objecter ms_handle_connect 0x7f74040b4240 2023-11-05T08:07:09.972 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.766+0000 7f73f9ffb640 10 client.?.objecter resend_mon_ops 2023-11-05T08:07:09.974 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.767+0000 7f77feffd640 1 -- 172.21.15.52:0/988693665 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f780000abd0 con 0x7f7808137a40 2023-11-05T08:07:09.974 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.767+0000 7f77feffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:09.974 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.767+0000 7f77feffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-05T08:07:09.975 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.767+0000 7f77feffd640 10 monclient: dump: 2023-11-05T08:07:09.975 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:09.975 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:09.975 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:09.975 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:09.976 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:09.976 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:09.976 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:09.976 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:09.976 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:09.976 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:09.977 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.767+0000 7f77feffd640 10 monclient: _finish_auth 0 2023-11-05T08:07:09.977 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.767+0000 7f77feffd640 10 monclient: _check_auth_tickets 2023-11-05T08:07:09.977 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.767+0000 7f77feffd640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:07:09.977 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.767+0000 7f77feffd640 1 -- 172.21.15.52:0/988693665 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f780000ad30 con 0x7f7808137a40 2023-11-05T08:07:09.977 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.767+0000 7f780ce52640 5 monclient: authenticate success, global_id 4324 2023-11-05T08:07:09.978 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.767+0000 7f780ce52640 10 monclient: _renew_subs 2023-11-05T08:07:09.978 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.767+0000 7f780ce52640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:07:09.978 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.767+0000 7f780ce52640 1 -- 172.21.15.52:0/988693665 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f780813dec0 con 0x7f7808137a40 2023-11-05T08:07:09.978 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.767+0000 7f77feffd640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:07:09.978 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.767+0000 7f77feffd640 1 -- 172.21.15.52:0/988693665 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f780000aea0 con 0x7f7808137a40 2023-11-05T08:07:09.979 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.767+0000 7f77feffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:09.979 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.767+0000 7f77feffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-05T08:07:09.979 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.767+0000 7f77feffd640 10 monclient: dump: 2023-11-05T08:07:09.979 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:09.979 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:09.980 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:09.980 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:09.980 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:09.980 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:09.980 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:09.981 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:09.981 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:09.981 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:09.981 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.767+0000 7f780559a640 4 set_mon_vals no callback set 2023-11-05T08:07:09.981 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.767+0000 7f780ce52640 10 client.4324.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-05T08:07:09.981 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.767+0000 7f780ce52640 10 monclient: _renew_subs 2023-11-05T08:07:09.982 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.768+0000 7f780ce52640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:07:09.982 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.768+0000 7f780ce52640 1 -- 172.21.15.52:0/988693665 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f780813db00 con 0x7f7808137a40 2023-11-05T08:07:09.982 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.768+0000 7f780ce52640 1 librados: init done 2023-11-05T08:07:09.982 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.768+0000 7f77fcff9640 10 client.4324.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:07:09.982 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.768+0000 7f77fcff9640 15 client.4324.objecter _session_command_op_assign -1 1 2023-11-05T08:07:09.983 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.768+0000 7f77fcff9640 20 client.4324.objecter _get_session osd=-1 returning homeless 2023-11-05T08:07:09.983 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.768+0000 7f77fcff9640 10 client.4324.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-05T08:07:09.983 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.768+0000 7f77fcff9640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:07:09.983 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.768+0000 7f77fcff9640 1 -- 172.21.15.52:0/988693665 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f780804e9f0 con 0x7f7808137a40 2023-11-05T08:07:09.985 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.772+0000 7f73f9ffb640 1 -- 172.21.15.52:0/2924702582 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f40052d0 con 0x7f74040b4240 2023-11-05T08:07:09.985 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.772+0000 7f73f9ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:09.985 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.772+0000 7f73f9ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-05T08:07:09.985 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.772+0000 7f73f9ffb640 10 monclient: dump: 2023-11-05T08:07:09.985 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:09.986 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:09.986 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:09.986 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:09.986 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:09.986 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:09.987 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:09.987 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:09.987 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:09.987 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:09.987 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.772+0000 7f73f9ffb640 10 monclient: _finish_auth 0 2023-11-05T08:07:09.987 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.772+0000 7f73f9ffb640 10 monclient: _check_auth_tickets 2023-11-05T08:07:09.988 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.772+0000 7f73f9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:07:09.988 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.772+0000 7f73f9ffb640 1 -- 172.21.15.52:0/2924702582 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73f4005430 con 0x7f74040b4240 2023-11-05T08:07:09.988 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.772+0000 7f73f9ffb640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:07:09.988 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.772+0000 7f73f9ffb640 1 -- 172.21.15.52:0/2924702582 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f4012870 con 0x7f74040b4240 2023-11-05T08:07:09.988 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.772+0000 7f73f9ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:09.989 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.772+0000 7f73f9ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-05T08:07:09.989 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.772+0000 7f73f9ffb640 10 monclient: dump: 2023-11-05T08:07:09.989 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:09.989 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:09.989 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:09.990 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:09.990 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:09.990 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:09.990 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:09.990 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:09.991 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:09.991 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:09.991 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.772+0000 7f73fb7fe640 4 set_mon_vals no callback set 2023-11-05T08:07:09.991 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.774+0000 7f740b724640 5 monclient: authenticate success, global_id 4327 2023-11-05T08:07:09.991 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.774+0000 7f740b724640 10 monclient: _renew_subs 2023-11-05T08:07:09.991 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.774+0000 7f740b724640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:07:09.992 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.774+0000 7f740b724640 1 -- 172.21.15.52:0/2924702582 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f740413e2d0 con 0x7f74040b4240 2023-11-05T08:07:09.992 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.774+0000 7f740b724640 10 client.4327.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-05T08:07:09.992 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.774+0000 7f740b724640 10 monclient: _renew_subs 2023-11-05T08:07:09.992 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.774+0000 7f740b724640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:07:09.992 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.774+0000 7f740b724640 1 -- 172.21.15.52:0/2924702582 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74041326d0 con 0x7f74040b4240 2023-11-05T08:07:09.993 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.774+0000 7f740b724640 1 librados: init done 2023-11-05T08:07:09.993 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.774+0000 7f740b724640 10 client.4327.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:07:09.993 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.775+0000 7f740b724640 15 client.4327.objecter _session_command_op_assign -1 1 2023-11-05T08:07:09.993 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.775+0000 7f740b724640 20 client.4327.objecter _get_session osd=-1 returning homeless 2023-11-05T08:07:09.993 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.775+0000 7f740b724640 10 client.4327.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-05T08:07:09.993 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.775+0000 7f740b724640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:07:09.994 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.775+0000 7f740b724640 1 -- 172.21.15.52:0/2924702582 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f740404e9f0 con 0x7f74040b4240 2023-11-05T08:07:09.995 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.778+0000 7fb0f6ffd640 1 -- 172.21.15.52:0/630459610 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb0f801a400 con 0x7fb108142d60 2023-11-05T08:07:09.996 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.779+0000 7fb0f6ffd640 1 --2- 172.21.15.52:0/630459610 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7fb0e806c880 0x7fb0e806ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:09.996 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.779+0000 7fb10659c640 1 --2- 172.21.15.52:0/630459610 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7fb0e806c880 0x7fb0e806ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:09.996 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.779+0000 7fb10659c640 10 monclient: get_auth_request con 0x7fb0e806c880 auth_method 0 2023-11-05T08:07:09.996 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.780+0000 7fb10659c640 1 --2- 172.21.15.52:0/630459610 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7fb0e806c880 0x7fb0e806ed40 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc036000 tx=0x7fb0fc030000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:09.997 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.780+0000 7fb0f6ffd640 10 client.4226.objecter ms_handle_connect 0x7fb0e806c880 2023-11-05T08:07:09.997 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.782+0000 7fb0f6ffd640 1 -- 172.21.15.52:0/630459610 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fb0f8059120 con 0x7fb108142d60 2023-11-05T08:07:09.997 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.782+0000 7fb0f6ffd640 10 client.4226.objecter ms_dispatch 0x7fb108000b90 osd_map(23..23 src has 1..23) v4 2023-11-05T08:07:09.997 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.782+0000 7fb0f6ffd640 3 client.4226.objecter handle_osd_map got epochs [23,23] > 0 2023-11-05T08:07:09.997 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.782+0000 7fb0f6ffd640 3 client.4226.objecter handle_osd_map decoding full epoch 23 2023-11-05T08:07:09.998 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.782+0000 7fb0f6ffd640 10 client.4226.objecter checking command 1 2023-11-05T08:07:09.998 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.782+0000 7fb0f6ffd640 1 --2- 172.21.15.52:0/630459610 >> [v2:172.21.15.52:6824/544646809,v1:172.21.15.52:6825/544646809] conn(0x7fb0e8072c60 0x7fb0e8075080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:09.998 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.782+0000 7fb0f6ffd640 20 client.4226.objecter _get_session s=0x7fb0e8072590 osd=1 3 2023-11-05T08:07:09.998 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.782+0000 7fb0f6ffd640 20 client.4226.objecter put_session s=0x7fb0e8072590 osd=1 3 2023-11-05T08:07:09.998 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.782+0000 7fb0f6ffd640 15 client.4226.objecter _session_command_op_remove -1 1 2023-11-05T08:07:09.999 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.782+0000 7fb0f6ffd640 20 client.4226.objecter _get_session s=0x7fb0e8072590 osd=1 3 2023-11-05T08:07:09.999 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.782+0000 7fb0f6ffd640 20 client.4226.objecter get_session s=0x7fb0e8072590 osd=1 3 2023-11-05T08:07:09.999 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.782+0000 7fb0f6ffd640 15 client.4226.objecter _session_command_op_assign 1 1 2023-11-05T08:07:09.999 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.782+0000 7fb0f6ffd640 20 client.4226.objecter put_session s=0x7fb0e8072590 osd=1 4 2023-11-05T08:07:10.000 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.782+0000 7fb0f6ffd640 10 client.4226.objecter _send_command 1 2023-11-05T08:07:10.000 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.782+0000 7fb0f6ffd640 1 -- 172.21.15.52:0/630459610 --> [v2:172.21.15.52:6824/544646809,v1:172.21.15.52:6825/544646809] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb0e8075730 con 0x7fb0e8072c60 2023-11-05T08:07:10.000 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.782+0000 7fb0f6ffd640 20 client.4226.objecter dump_active .. 0 homeless 2023-11-05T08:07:10.000 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.782+0000 7fb0f6ffd640 1 -- 172.21.15.52:0/630459610 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb0f8009100 con 0x7fb108142d60 2023-11-05T08:07:10.001 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.782+0000 7fb0f6ffd640 10 monclient: handle_get_version_reply finishing 1 version 23 2023-11-05T08:07:10.001 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.782+0000 7fb105d9b640 1 --2- 172.21.15.52:0/630459610 >> [v2:172.21.15.52:6824/544646809,v1:172.21.15.52:6825/544646809] conn(0x7fb0e8072c60 0x7fb0e8075080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:10.001 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.783+0000 7fb105d9b640 10 monclient: get_auth_request con 0x7fb0e8072c60 auth_method 0 2023-11-05T08:07:10.001 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.786+0000 7fb105d9b640 1 --2- 172.21.15.52:0/630459610 >> [v2:172.21.15.52:6824/544646809,v1:172.21.15.52:6825/544646809] conn(0x7fb0e8072c60 0x7fb0e8075080 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:10.001 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.786+0000 7fb0f6ffd640 10 client.4226.objecter ms_handle_connect 0x7fb0e8072c60 2023-11-05T08:07:10.003 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.791+0000 7f77feffd640 1 -- 172.21.15.52:0/988693665 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7800007070 con 0x7f7808137a40 2023-11-05T08:07:10.003 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.792+0000 7f77feffd640 1 --2- 172.21.15.52:0/988693665 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f77e806c850 0x7f77e806ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:10.004 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.792+0000 7f780659c640 1 --2- 172.21.15.52:0/988693665 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f77e806c850 0x7f77e806ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:10.004 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.792+0000 7f780659c640 10 monclient: get_auth_request con 0x7f77e806c850 auth_method 0 2023-11-05T08:07:10.004 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.793+0000 7f77feffd640 10 client.4324.objecter ms_handle_connect 0x7f77e806c850 2023-11-05T08:07:10.004 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.793+0000 7f780659c640 1 --2- 172.21.15.52:0/988693665 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f77e806c850 0x7f77e806ed10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f77f0009720 tx=0x7f77f003d040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:10.004 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.794+0000 7f77feffd640 1 -- 172.21.15.52:0/988693665 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f78000589d0 con 0x7f7808137a40 2023-11-05T08:07:10.005 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.794+0000 7f77feffd640 10 client.4324.objecter ms_dispatch 0x7f7808000b90 osd_map(23..23 src has 1..23) v4 2023-11-05T08:07:10.005 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.794+0000 7f77feffd640 3 client.4324.objecter handle_osd_map got epochs [23,23] > 0 2023-11-05T08:07:10.005 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.794+0000 7f77feffd640 3 client.4324.objecter handle_osd_map decoding full epoch 23 2023-11-05T08:07:10.005 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.794+0000 7f77feffd640 10 client.4324.objecter checking command 1 2023-11-05T08:07:10.005 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.794+0000 7f77feffd640 1 --2- 172.21.15.52:0/988693665 >> [v2:172.21.15.156:6802/617205919,v1:172.21.15.156:6803/617205919] conn(0x7f77e8072c30 0x7f77e8075050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:10.006 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.794+0000 7f77feffd640 20 client.4324.objecter _get_session s=0x7f77e8072560 osd=7 3 2023-11-05T08:07:10.006 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.794+0000 7f77feffd640 20 client.4324.objecter put_session s=0x7f77e8072560 osd=7 3 2023-11-05T08:07:10.006 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.794+0000 7f77feffd640 15 client.4324.objecter _session_command_op_remove -1 1 2023-11-05T08:07:10.006 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.794+0000 7f77feffd640 20 client.4324.objecter _get_session s=0x7f77e8072560 osd=7 3 2023-11-05T08:07:10.006 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.794+0000 7f77feffd640 20 client.4324.objecter get_session s=0x7f77e8072560 osd=7 3 2023-11-05T08:07:10.007 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.794+0000 7f77feffd640 15 client.4324.objecter _session_command_op_assign 7 1 2023-11-05T08:07:10.007 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.794+0000 7f77feffd640 20 client.4324.objecter put_session s=0x7f77e8072560 osd=7 4 2023-11-05T08:07:10.007 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.794+0000 7f77feffd640 10 client.4324.objecter _send_command 1 2023-11-05T08:07:10.007 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.794+0000 7f77feffd640 1 -- 172.21.15.52:0/988693665 --> [v2:172.21.15.156:6802/617205919,v1:172.21.15.156:6803/617205919] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f77e8075700 con 0x7f77e8072c30 2023-11-05T08:07:10.007 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.794+0000 7f77feffd640 20 client.4324.objecter dump_active .. 0 homeless 2023-11-05T08:07:10.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.794+0000 7f77feffd640 1 -- 172.21.15.52:0/988693665 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7800054d10 con 0x7f7808137a40 2023-11-05T08:07:10.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.794+0000 7f77feffd640 10 monclient: handle_get_version_reply finishing 1 version 23 2023-11-05T08:07:10.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.795+0000 7f77fffff640 1 --2- 172.21.15.52:0/988693665 >> [v2:172.21.15.156:6802/617205919,v1:172.21.15.156:6803/617205919] conn(0x7f77e8072c30 0x7f77e8075050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:10.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.795+0000 7f77fffff640 10 monclient: get_auth_request con 0x7f77e8072c30 auth_method 0 2023-11-05T08:07:10.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.799+0000 7f77feffd640 10 client.4324.objecter ms_handle_connect 0x7f77e8072c30 2023-11-05T08:07:10.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.799+0000 7f77fffff640 1 --2- 172.21.15.52:0/988693665 >> [v2:172.21.15.156:6802/617205919,v1:172.21.15.156:6803/617205919] conn(0x7f77e8072c30 0x7f77e8075050 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:10.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.815+0000 7f73f9ffb640 1 -- 172.21.15.52:0/2924702582 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f73f40129d0 con 0x7f74040b4240 2023-11-05T08:07:10.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.815+0000 7f73f9ffb640 1 --2- 172.21.15.52:0/2924702582 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f73e806c850 0x7f73e806ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:10.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.816+0000 7f74094c0640 1 --2- 172.21.15.52:0/2924702582 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f73e806c850 0x7f73e806ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:10.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.816+0000 7f74094c0640 10 monclient: get_auth_request con 0x7f73e806c850 auth_method 0 2023-11-05T08:07:10.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.816+0000 7f74094c0640 1 --2- 172.21.15.52:0/2924702582 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f73e806c850 0x7f73e806ed10 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7400036000 tx=0x7f740003c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:10.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.816+0000 7f73f9ffb640 10 client.4327.objecter ms_handle_connect 0x7f73e806c850 2023-11-05T08:07:10.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.817+0000 7f73f9ffb640 1 -- 172.21.15.52:0/2924702582 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f73f4059010 con 0x7f74040b4240 2023-11-05T08:07:10.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.817+0000 7f73f9ffb640 10 client.4327.objecter ms_dispatch 0x7f7404000b90 osd_map(23..23 src has 1..23) v4 2023-11-05T08:07:10.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.817+0000 7f73f9ffb640 3 client.4327.objecter handle_osd_map got epochs [23,23] > 0 2023-11-05T08:07:10.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.817+0000 7f73f9ffb640 3 client.4327.objecter handle_osd_map decoding full epoch 23 2023-11-05T08:07:10.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.817+0000 7f73f9ffb640 10 client.4327.objecter checking command 1 2023-11-05T08:07:10.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.817+0000 7f73f9ffb640 1 --2- 172.21.15.52:0/2924702582 >> [v2:172.21.15.156:6814/3458684008,v1:172.21.15.156:6816/3458684008] conn(0x7f73e8072c30 0x7f73e8075050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:10.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.817+0000 7f73f9ffb640 20 client.4327.objecter _get_session s=0x7f73e8072560 osd=4 3 2023-11-05T08:07:10.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.817+0000 7f73f9ffb640 20 client.4327.objecter put_session s=0x7f73e8072560 osd=4 3 2023-11-05T08:07:10.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.817+0000 7f73f9ffb640 15 client.4327.objecter _session_command_op_remove -1 1 2023-11-05T08:07:10.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.817+0000 7f73f9ffb640 20 client.4327.objecter _get_session s=0x7f73e8072560 osd=4 3 2023-11-05T08:07:10.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.817+0000 7f73f9ffb640 20 client.4327.objecter get_session s=0x7f73e8072560 osd=4 3 2023-11-05T08:07:10.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.817+0000 7f73f9ffb640 15 client.4327.objecter _session_command_op_assign 4 1 2023-11-05T08:07:10.015 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.817+0000 7f73f9ffb640 20 client.4327.objecter put_session s=0x7f73e8072560 osd=4 4 2023-11-05T08:07:10.015 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.817+0000 7f73f9ffb640 10 client.4327.objecter _send_command 1 2023-11-05T08:07:10.015 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.817+0000 7f73f9ffb640 1 -- 172.21.15.52:0/2924702582 --> [v2:172.21.15.156:6814/3458684008,v1:172.21.15.156:6816/3458684008] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f73e8075700 con 0x7f73e8072c30 2023-11-05T08:07:10.015 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.817+0000 7f73f9ffb640 20 client.4327.objecter dump_active .. 0 homeless 2023-11-05T08:07:10.015 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.817+0000 7f73f9ffb640 1 -- 172.21.15.52:0/2924702582 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f73f40011e0 con 0x7f74040b4240 2023-11-05T08:07:10.016 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.817+0000 7f73f9ffb640 10 monclient: handle_get_version_reply finishing 1 version 23 2023-11-05T08:07:10.016 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.817+0000 7f7409cc1640 1 --2- 172.21.15.52:0/2924702582 >> [v2:172.21.15.156:6814/3458684008,v1:172.21.15.156:6816/3458684008] conn(0x7f73e8072c30 0x7f73e8075050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:10.016 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.818+0000 7f7409cc1640 10 monclient: get_auth_request con 0x7f73e8072c30 auth_method 0 2023-11-05T08:07:10.016 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.821+0000 7f7409cc1640 1 --2- 172.21.15.52:0/2924702582 >> [v2:172.21.15.156:6814/3458684008,v1:172.21.15.156:6816/3458684008] conn(0x7f73e8072c30 0x7f73e8075050 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:10.017 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.821+0000 7f73f9ffb640 10 client.4327.objecter ms_handle_connect 0x7f73e8072c30 2023-11-05T08:07:10.017 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.830+0000 7fb0f6ffd640 1 -- 172.21.15.52:0/630459610 <== osd.1 v2:172.21.15.52:6824/544646809 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fb0e8075730 con 0x7fb0e8072c60 2023-11-05T08:07:10.018 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.830+0000 7fb0f6ffd640 10 client.4226.objecter ms_dispatch 0x7fb108000b90 command_reply(tid 1: 0 ) v1 2023-11-05T08:07:10.018 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.830+0000 7fb0f6ffd640 10 client.4226.objecter _finish_command 1 = system:0 2023-11-05T08:07:10.018 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.830+0000 7fb0f6ffd640 20 client.4226.objecter put_session s=0x7fb0e8072590 osd=1 4 2023-11-05T08:07:10.018 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.830+0000 7fb0f6ffd640 15 client.4226.objecter _session_command_op_remove 1 1 2023-11-05T08:07:10.019 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.844+0000 7fb10759e640 10 client.4226.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2023-11-05T08:07:10.019 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.844+0000 7fb10759e640 15 client.4226.objecter _session_command_op_assign -1 2 2023-11-05T08:07:10.019 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.844+0000 7fb10759e640 20 client.4226.objecter _get_session s=0x7fb0e8072590 osd=1 3 2023-11-05T08:07:10.019 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.844+0000 7fb10759e640 20 client.4226.objecter put_session s=0x7fb0e8072590 osd=1 3 2023-11-05T08:07:10.019 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.844+0000 7fb10759e640 20 client.4226.objecter _get_session s=0x7fb0e8072590 osd=1 3 2023-11-05T08:07:10.020 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.844+0000 7fb10759e640 15 client.4226.objecter _session_command_op_remove -1 2 2023-11-05T08:07:10.020 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.844+0000 7fb10759e640 20 client.4226.objecter get_session s=0x7fb0e8072590 osd=1 3 2023-11-05T08:07:10.020 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.844+0000 7fb10759e640 15 client.4226.objecter _session_command_op_assign 1 2 2023-11-05T08:07:10.020 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.844+0000 7fb10759e640 20 client.4226.objecter put_session s=0x7fb0e8072590 osd=1 4 2023-11-05T08:07:10.020 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.844+0000 7fb10759e640 10 client.4226.objecter _send_command 2 2023-11-05T08:07:10.021 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.844+0000 7fb10759e640 1 -- 172.21.15.52:0/630459610 --> [v2:172.21.15.52:6824/544646809,v1:172.21.15.52:6825/544646809] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb108071c90 con 0x7fb0e8072c60 2023-11-05T08:07:10.021 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.845+0000 7f77feffd640 1 -- 172.21.15.52:0/988693665 <== osd.7 v2:172.21.15.156:6802/617205919 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f77e8075700 con 0x7f77e8072c30 2023-11-05T08:07:10.021 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.845+0000 7f77feffd640 10 client.4324.objecter ms_dispatch 0x7f7808000b90 command_reply(tid 1: 0 ) v1 2023-11-05T08:07:10.021 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.845+0000 7f77feffd640 10 client.4324.objecter _finish_command 1 = system:0 2023-11-05T08:07:10.022 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.845+0000 7f77feffd640 20 client.4324.objecter put_session s=0x7f77e8072560 osd=7 4 2023-11-05T08:07:10.022 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.845+0000 7f77feffd640 15 client.4324.objecter _session_command_op_remove 7 1 2023-11-05T08:07:10.022 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.850+0000 7fb0f6ffd640 1 -- 172.21.15.52:0/630459610 <== osd.1 v2:172.21.15.52:6824/544646809 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb100001850 con 0x7fb0e8072c60 2023-11-05T08:07:10.023 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.850+0000 7fb0f6ffd640 10 client.4226.objecter ms_dispatch 0x7fb108000b90 command_reply(tid 2: 0 ) v1 2023-11-05T08:07:10.023 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.850+0000 7fb0f6ffd640 10 client.4226.objecter _finish_command 2 = system:0 2023-11-05T08:07:10.023 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.850+0000 7fb0f6ffd640 20 client.4226.objecter put_session s=0x7fb0e8072590 osd=1 4 2023-11-05T08:07:10.023 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.850+0000 7fb0f6ffd640 15 client.4226.objecter _session_command_op_remove 1 2 2023-11-05T08:07:10.025 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.851+0000 7fb10759e640 10 librados: watch_flush enter 2023-11-05T08:07:10.025 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.851+0000 7fb10759e640 10 librados: watch_flush exit 2023-11-05T08:07:10.026 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.851+0000 7fb10759e640 10 client.4226.objecter close_session for osd.1 2023-11-05T08:07:10.026 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.851+0000 7fb10759e640 1 -- 172.21.15.52:0/630459610 >> [v2:172.21.15.52:6824/544646809,v1:172.21.15.52:6825/544646809] conn(0x7fb0e8072c60 msgr2=0x7fb0e8075080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:10.026 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.851+0000 7fb10759e640 1 --2- 172.21.15.52:0/630459610 >> [v2:172.21.15.52:6824/544646809,v1:172.21.15.52:6825/544646809] conn(0x7fb0e8072c60 0x7fb0e8075080 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:10.026 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.851+0000 7fb10759e640 20 client.4226.objecter put_session s=0x7fb0e8072590 osd=1 1 2023-11-05T08:07:10.027 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.851+0000 7fb10759e640 20 client.4226.objecter shutdown clearing up homeless session... 2023-11-05T08:07:10.027 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.851+0000 7fb10759e640 10 client.4226.objecter successfully canceled tick 2023-11-05T08:07:10.027 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.851+0000 7fb10759e640 1 -- 172.21.15.52:0/630459610 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7fb0e806c880 msgr2=0x7fb0e806ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:10.027 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.851+0000 7fb10759e640 1 --2- 172.21.15.52:0/630459610 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7fb0e806c880 0x7fb0e806ed40 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc036000 tx=0x7fb0fc030000 comp rx=0 tx=0).stop 2023-11-05T08:07:10.027 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.851+0000 7fb10759e640 10 monclient: shutdown 2023-11-05T08:07:10.027 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.851+0000 7fb10759e640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:07:10.028 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.851+0000 7fb10759e640 1 -- 172.21.15.52:0/630459610 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb108142d60 msgr2=0x7fb108138b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:10.028 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.851+0000 7fb10759e640 1 --2- 172.21.15.52:0/630459610 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb108142d60 0x7fb108138b40 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb0f800b440 tx=0x7fb0f800b900 comp rx=0 tx=0).stop 2023-11-05T08:07:10.028 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.851+0000 7fb106d9d640 1 -- 172.21.15.52:0/630459610 reap_dead start 2023-11-05T08:07:10.028 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.851+0000 7fb10759e640 1 -- 172.21.15.52:0/630459610 shutdown_connections 2023-11-05T08:07:10.028 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.851+0000 7fb10759e640 1 -- 172.21.15.52:0/630459610 >> 172.21.15.52:0/630459610 conn(0x7fb1080b2ca0 msgr2=0x7fb10813bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:07:10.029 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.851+0000 7fb10759e640 1 -- 172.21.15.52:0/630459610 shutdown_connections 2023-11-05T08:07:10.029 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.851+0000 7fb10759e640 1 -- 172.21.15.52:0/630459610 wait complete. 2023-11-05T08:07:10.029 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.851+0000 7fb10759e640 1 librados: shutdown 2023-11-05T08:07:10.029 INFO:teuthology.orchestra.run.smithi052.stdout:64424509445 2023-11-05T08:07:10.030 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-05T08:07:10.031 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.867+0000 7f73f9ffb640 1 -- 172.21.15.52:0/2924702582 <== osd.4 v2:172.21.15.156:6814/3458684008 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f73e8075700 con 0x7f73e8072c30 2023-11-05T08:07:10.031 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.867+0000 7f73f9ffb640 10 client.4327.objecter ms_dispatch 0x7f7404000b90 command_reply(tid 1: 0 ) v1 2023-11-05T08:07:10.031 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.867+0000 7f73f9ffb640 10 client.4327.objecter _finish_command 1 = system:0 2023-11-05T08:07:10.031 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.867+0000 7f73f9ffb640 20 client.4327.objecter put_session s=0x7f73e8072560 osd=4 4 2023-11-05T08:07:10.031 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.867+0000 7f73f9ffb640 15 client.4327.objecter _session_command_op_remove 4 1 2023-11-05T08:07:10.032 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.875+0000 7f77fcff9640 10 client.4324.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2023-11-05T08:07:10.033 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.875+0000 7f77fcff9640 15 client.4324.objecter _session_command_op_assign -1 2 2023-11-05T08:07:10.033 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.875+0000 7f77fcff9640 20 client.4324.objecter _get_session s=0x7f77e8072560 osd=7 3 2023-11-05T08:07:10.033 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.875+0000 7f77fcff9640 20 client.4324.objecter put_session s=0x7f77e8072560 osd=7 3 2023-11-05T08:07:10.033 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.875+0000 7f77fcff9640 20 client.4324.objecter _get_session s=0x7f77e8072560 osd=7 3 2023-11-05T08:07:10.033 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.875+0000 7f77fcff9640 15 client.4324.objecter _session_command_op_remove -1 2 2023-11-05T08:07:10.034 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.875+0000 7f77fcff9640 20 client.4324.objecter get_session s=0x7f77e8072560 osd=7 3 2023-11-05T08:07:10.034 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.875+0000 7f77fcff9640 15 client.4324.objecter _session_command_op_assign 7 2 2023-11-05T08:07:10.034 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.875+0000 7f77fcff9640 20 client.4324.objecter put_session s=0x7f77e8072560 osd=7 4 2023-11-05T08:07:10.034 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.875+0000 7f77fcff9640 10 client.4324.objecter _send_command 2 2023-11-05T08:07:10.034 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.875+0000 7f77fcff9640 1 -- 172.21.15.52:0/988693665 --> [v2:172.21.15.156:6802/617205919,v1:172.21.15.156:6803/617205919] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f780813e0b0 con 0x7f77e8072c30 2023-11-05T08:07:10.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.881+0000 7f77feffd640 1 -- 172.21.15.52:0/988693665 <== osd.7 v2:172.21.15.156:6802/617205919 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f77f80038f0 con 0x7f77e8072c30 2023-11-05T08:07:10.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.881+0000 7f77feffd640 10 client.4324.objecter ms_dispatch 0x7f7808000b90 command_reply(tid 2: 0 ) v1 2023-11-05T08:07:10.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.881+0000 7f77feffd640 10 client.4324.objecter _finish_command 2 = system:0 2023-11-05T08:07:10.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.881+0000 7f77feffd640 20 client.4324.objecter put_session s=0x7f77e8072560 osd=7 4 2023-11-05T08:07:10.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.881+0000 7f77feffd640 15 client.4324.objecter _session_command_op_remove 7 2 2023-11-05T08:07:10.037 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.881+0000 7f77fcff9640 10 librados: watch_flush enter 2023-11-05T08:07:10.037 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.881+0000 7f77fcff9640 10 librados: watch_flush exit 2023-11-05T08:07:10.037 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.881+0000 7f77fcff9640 10 client.4324.objecter close_session for osd.7 2023-11-05T08:07:10.037 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.881+0000 7f77fcff9640 1 -- 172.21.15.52:0/988693665 >> [v2:172.21.15.156:6802/617205919,v1:172.21.15.156:6803/617205919] conn(0x7f77e8072c30 msgr2=0x7f77e8075050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:10.038 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.881+0000 7f77fcff9640 1 --2- 172.21.15.52:0/988693665 >> [v2:172.21.15.156:6802/617205919,v1:172.21.15.156:6803/617205919] conn(0x7f77e8072c30 0x7f77e8075050 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:10.038 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.881+0000 7f77fcff9640 20 client.4324.objecter put_session s=0x7f77e8072560 osd=7 1 2023-11-05T08:07:10.038 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.881+0000 7f77fcff9640 20 client.4324.objecter shutdown clearing up homeless session... 2023-11-05T08:07:10.038 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.881+0000 7f77fcff9640 10 client.4324.objecter successfully canceled tick 2023-11-05T08:07:10.038 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.881+0000 7f77fcff9640 1 -- 172.21.15.52:0/988693665 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f77e806c850 msgr2=0x7f77e806ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:10.039 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.881+0000 7f77fcff9640 1 --2- 172.21.15.52:0/988693665 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f77e806c850 0x7f77e806ed10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f77f0009720 tx=0x7f77f003d040 comp rx=0 tx=0).stop 2023-11-05T08:07:10.039 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.881+0000 7f77fcff9640 10 monclient: shutdown 2023-11-05T08:07:10.039 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.881+0000 7f77fcff9640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:07:10.039 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.881+0000 7f77fcff9640 1 -- 172.21.15.52:0/988693665 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7808137a40 msgr2=0x7f7808144300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:10.039 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.881+0000 7f77fcff9640 1 --2- 172.21.15.52:0/988693665 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7808137a40 0x7f7808144300 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f780000ca70 tx=0x7f780000cf30 comp rx=0 tx=0).stop 2023-11-05T08:07:10.040 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.881+0000 7f7806d9d640 1 -- 172.21.15.52:0/988693665 reap_dead start 2023-11-05T08:07:10.040 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.881+0000 7f77fcff9640 1 -- 172.21.15.52:0/988693665 shutdown_connections 2023-11-05T08:07:10.040 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.881+0000 7f77fcff9640 1 -- 172.21.15.52:0/988693665 >> 172.21.15.52:0/988693665 conn(0x7f7808065cd0 msgr2=0x7f78080b1ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:07:10.040 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.881+0000 7f77fcff9640 1 -- 172.21.15.52:0/988693665 shutdown_connections 2023-11-05T08:07:10.040 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.881+0000 7f77fcff9640 1 -- 172.21.15.52:0/988693665 wait complete. 2023-11-05T08:07:10.041 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.882+0000 7f77fcff9640 1 librados: shutdown 2023-11-05T08:07:10.041 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.889+0000 7f740b724640 10 client.4327.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2023-11-05T08:07:10.041 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.889+0000 7f740b724640 15 client.4327.objecter _session_command_op_assign -1 2 2023-11-05T08:07:10.041 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.889+0000 7f740b724640 20 client.4327.objecter _get_session s=0x7f73e8072560 osd=4 3 2023-11-05T08:07:10.042 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.889+0000 7f740b724640 20 client.4327.objecter put_session s=0x7f73e8072560 osd=4 3 2023-11-05T08:07:10.042 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.889+0000 7f740b724640 20 client.4327.objecter _get_session s=0x7f73e8072560 osd=4 3 2023-11-05T08:07:10.042 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.889+0000 7f740b724640 15 client.4327.objecter _session_command_op_remove -1 2 2023-11-05T08:07:10.042 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.889+0000 7f740b724640 20 client.4327.objecter get_session s=0x7f73e8072560 osd=4 3 2023-11-05T08:07:10.043 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.889+0000 7f740b724640 15 client.4327.objecter _session_command_op_assign 4 2 2023-11-05T08:07:10.043 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.889+0000 7f740b724640 20 client.4327.objecter put_session s=0x7f73e8072560 osd=4 4 2023-11-05T08:07:10.043 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.889+0000 7f740b724640 10 client.4327.objecter _send_command 2 2023-11-05T08:07:10.043 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.889+0000 7f740b724640 1 -- 172.21.15.52:0/2924702582 --> [v2:172.21.15.156:6814/3458684008,v1:172.21.15.156:6816/3458684008] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7404142930 con 0x7f73e8072c30 2023-11-05T08:07:10.044 INFO:teuthology.orchestra.run.smithi052.stdout:60129542149 2023-11-05T08:07:10.044 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-05T08:07:10.045 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.896+0000 7f73f9ffb640 1 -- 172.21.15.52:0/2924702582 <== osd.4 v2:172.21.15.156:6814/3458684008 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7404142930 con 0x7f73e8072c30 2023-11-05T08:07:10.045 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.896+0000 7f73f9ffb640 10 client.4327.objecter ms_dispatch 0x7f7404000b90 command_reply(tid 2: 0 ) v1 2023-11-05T08:07:10.046 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.896+0000 7f73f9ffb640 10 client.4327.objecter _finish_command 2 = system:0 2023-11-05T08:07:10.046 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.896+0000 7f73f9ffb640 20 client.4327.objecter put_session s=0x7f73e8072560 osd=4 4 2023-11-05T08:07:10.046 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.896+0000 7f73f9ffb640 15 client.4327.objecter _session_command_op_remove 4 2 2023-11-05T08:07:10.047 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.896+0000 7f740b724640 10 librados: watch_flush enter 2023-11-05T08:07:10.048 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.896+0000 7f740b724640 10 librados: watch_flush exit 2023-11-05T08:07:10.048 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.896+0000 7f740b724640 10 client.4327.objecter close_session for osd.4 2023-11-05T08:07:10.048 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.896+0000 7f740b724640 1 -- 172.21.15.52:0/2924702582 >> [v2:172.21.15.156:6814/3458684008,v1:172.21.15.156:6816/3458684008] conn(0x7f73e8072c30 msgr2=0x7f73e8075050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:10.048 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.896+0000 7f740b724640 1 --2- 172.21.15.52:0/2924702582 >> [v2:172.21.15.156:6814/3458684008,v1:172.21.15.156:6816/3458684008] conn(0x7f73e8072c30 0x7f73e8075050 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:10.048 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.896+0000 7f740b724640 20 client.4327.objecter put_session s=0x7f73e8072560 osd=4 1 2023-11-05T08:07:10.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.896+0000 7f740b724640 20 client.4327.objecter shutdown clearing up homeless session... 2023-11-05T08:07:10.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.896+0000 7f740b724640 10 client.4327.objecter successfully canceled tick 2023-11-05T08:07:10.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.896+0000 7f740b724640 1 -- 172.21.15.52:0/2924702582 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f73e806c850 msgr2=0x7f73e806ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:10.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.896+0000 7f740b724640 1 --2- 172.21.15.52:0/2924702582 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f73e806c850 0x7f73e806ed10 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7400036000 tx=0x7f740003c040 comp rx=0 tx=0).stop 2023-11-05T08:07:10.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.896+0000 7f740b724640 10 monclient: shutdown 2023-11-05T08:07:10.050 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.896+0000 7f740b724640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:07:10.050 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.896+0000 7f740b724640 1 -- 172.21.15.52:0/2924702582 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f74040b4240 msgr2=0x7f740413ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:10.050 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.896+0000 7f740b724640 1 --2- 172.21.15.52:0/2924702582 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f74040b4240 0x7f740413ce60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f73f400c450 tx=0x7f73f400c910 comp rx=0 tx=0).stop 2023-11-05T08:07:10.050 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.896+0000 7f7409cc1640 1 -- 172.21.15.52:0/2924702582 reap_dead start 2023-11-05T08:07:10.050 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.896+0000 7f740b724640 1 -- 172.21.15.52:0/2924702582 shutdown_connections 2023-11-05T08:07:10.051 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.896+0000 7f740b724640 1 -- 172.21.15.52:0/2924702582 >> 172.21.15.52:0/2924702582 conn(0x7f7404065cd0 msgr2=0x7f74040b1aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:07:10.051 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.896+0000 7f740b724640 1 -- 172.21.15.52:0/2924702582 shutdown_connections 2023-11-05T08:07:10.051 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.896+0000 7f740b724640 1 -- 172.21.15.52:0/2924702582 wait complete. 2023-11-05T08:07:10.051 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.896+0000 7f740b724640 1 librados: shutdown 2023-11-05T08:07:10.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.902+0000 7fa4e959a640 1 -- 172.21.15.52:0/432817287 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4dc030c20 con 0x7fa4ec0712d0 2023-11-05T08:07:10.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.902+0000 7fa4e959a640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:10.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.902+0000 7fa4e959a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-11-05T08:07:10.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.902+0000 7fa4e959a640 10 monclient: dump: 2023-11-05T08:07:10.053 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:10.053 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:10.053 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:10.053 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:10.054 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:10.054 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:10.054 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:10.054 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:10.054 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:10.055 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:10.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.902+0000 7fa4e959a640 10 monclient: _finish_auth 0 2023-11-05T08:07:10.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.902+0000 7fa4e959a640 10 monclient: _check_auth_tickets 2023-11-05T08:07:10.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.902+0000 7fa4e959a640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:07:10.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.902+0000 7fa4e959a640 1 -- 172.21.15.52:0/432817287 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4dc030d80 con 0x7fa4ec0712d0 2023-11-05T08:07:10.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.902+0000 7fa4f0df5640 5 monclient: authenticate success, global_id 4275 2023-11-05T08:07:10.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.902+0000 7fa4f0df5640 20 monclient: get_monmap_and_config waiting for monmap|config 2023-11-05T08:07:10.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.902+0000 7fa4e959a640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:07:10.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.902+0000 7fa4f0df5640 10 monclient: get_monmap_and_config success 2023-11-05T08:07:10.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.902+0000 7fa4e959a640 1 -- 172.21.15.52:0/432817287 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4dc038660 con 0x7fa4ec0712d0 2023-11-05T08:07:10.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.902+0000 7fa4e959a640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:10.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.902+0000 7fa4f0df5640 4 set_mon_vals no callback set 2023-11-05T08:07:10.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.902+0000 7fa4e959a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-11-05T08:07:10.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.902+0000 7fa4e959a640 10 monclient: dump: 2023-11-05T08:07:10.057 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:10.057 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:10.058 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:10.058 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:10.058 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:10.058 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:10.058 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:10.059 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:10.059 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:10.059 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:10.059 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.903+0000 7fa4f0df5640 10 monclient: shutdown 2023-11-05T08:07:10.059 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.903+0000 7fa4f0df5640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:07:10.060 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.903+0000 7fa4f0df5640 1 -- 172.21.15.52:0/432817287 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa4ec0712d0 msgr2=0x7fa4ec0716d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:10.060 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.903+0000 7fa4f0df5640 1 --2- 172.21.15.52:0/432817287 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa4ec0712d0 0x7fa4ec0716d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa4dc010b90 tx=0x7fa4dc02fe70 comp rx=0 tx=0).stop 2023-11-05T08:07:10.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.903+0000 7fbec6ffd640 1 -- 172.21.15.52:0/1661704675 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbed80b6040 con 0x7fbed00070e0 2023-11-05T08:07:10.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.903+0000 7fbec6ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:10.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.903+0000 7fbec6ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-11-05T08:07:10.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.903+0000 7fbec6ffd640 10 monclient: dump: 2023-11-05T08:07:10.062 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:10.062 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:10.062 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:10.062 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:10.062 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:10.063 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:10.063 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:10.063 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:10.063 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:10.063 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:10.064 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.903+0000 7fbec6ffd640 10 monclient: _finish_auth 0 2023-11-05T08:07:10.064 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.903+0000 7fbec6ffd640 10 monclient: _check_auth_tickets 2023-11-05T08:07:10.064 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.903+0000 7fbec6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:07:10.064 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.903+0000 7fbec6ffd640 1 -- 172.21.15.52:0/1661704675 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbed80a8b70 con 0x7fbed00070e0 2023-11-05T08:07:10.064 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.903+0000 7fbedc973640 5 monclient: authenticate success, global_id 4278 2023-11-05T08:07:10.065 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.903+0000 7fbec6ffd640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:07:10.065 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.903+0000 7fbec6ffd640 1 -- 172.21.15.52:0/1661704675 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbed80b1400 con 0x7fbed00070e0 2023-11-05T08:07:10.065 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.903+0000 7fbec6ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:10.065 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.903+0000 7fbec6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-11-05T08:07:10.065 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.903+0000 7fbec6ffd640 10 monclient: dump: 2023-11-05T08:07:10.066 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:10.066 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:10.066 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:10.066 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:10.066 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:10.067 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:10.067 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:10.067 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:10.067 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:10.067 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:10.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.903+0000 7fbed4d99640 4 set_mon_vals no callback set 2023-11-05T08:07:10.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.903+0000 7fbedc973640 10 monclient: _renew_subs 2023-11-05T08:07:10.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.903+0000 7fbedc973640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.52:3300/0 2023-11-05T08:07:10.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.903+0000 7fbedc973640 1 -- 172.21.15.52:0/1661704675 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbed00c88a0 con 0x7fbed00070e0 2023-11-05T08:07:10.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.904+0000 7fbedc973640 10 client.4278.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-05T08:07:10.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.904+0000 7fbedc973640 10 monclient: _renew_subs 2023-11-05T08:07:10.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.904+0000 7fbedc973640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.52:3300/0 2023-11-05T08:07:10.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.904+0000 7fbedc973640 1 -- 172.21.15.52:0/1661704675 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbed00c1150 con 0x7fbed00070e0 2023-11-05T08:07:10.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.904+0000 7fbedc973640 1 librados: init done 2023-11-05T08:07:10.070 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.904+0000 7fa4f0df5640 1 -- 172.21.15.52:0/432817287 shutdown_connections 2023-11-05T08:07:10.070 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.904+0000 7fa4f0df5640 1 --2- 172.21.15.52:0/432817287 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa4ec0712d0 0x7fa4ec0716d0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:10.070 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.904+0000 7fa4f0df5640 1 --2- 172.21.15.52:0/432817287 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa4ec0a8cc0 0x7fa4ec0a90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:10.070 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.904+0000 7fa4f0df5640 1 -- 172.21.15.52:0/432817287 >> 172.21.15.52:0/432817287 conn(0x7fa4ec0b2e10 msgr2=0x7fa4ec0b3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:07:10.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.904+0000 7fa4f0df5640 1 -- 172.21.15.52:0/432817287 shutdown_connections 2023-11-05T08:07:10.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.904+0000 7fa4f0df5640 1 -- 172.21.15.52:0/432817287 wait complete. 2023-11-05T08:07:10.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.904+0000 7fbedc973640 10 client.4278.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:07:10.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.905+0000 7fbedc973640 15 client.4278.objecter _session_command_op_assign -1 1 2023-11-05T08:07:10.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.905+0000 7fbedc973640 20 client.4278.objecter _get_session osd=-1 returning homeless 2023-11-05T08:07:10.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.905+0000 7fbedc973640 10 client.4278.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-05T08:07:10.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.905+0000 7fbedc973640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.52:3300/0 2023-11-05T08:07:10.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.905+0000 7fbedc973640 1 -- 172.21.15.52:0/1661704675 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbed002f310 con 0x7fbed00070e0 2023-11-05T08:07:10.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.905+0000 7fa4f0df5640 10 monclient: build_initial_monmap 2023-11-05T08:07:10.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.905+0000 7fa4f0df5640 10 monclient: monmap: 2023-11-05T08:07:10.074 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:07:10.074 INFO:teuthology.orchestra.run.smithi052.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-05T08:07:10.074 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 0.000000 2023-11-05T08:07:10.074 INFO:teuthology.orchestra.run.smithi052.stderr:created 0.000000 2023-11-05T08:07:10.074 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:07:10.075 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:10.075 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.noname-a 2023-11-05T08:07:10.075 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.noname-b 2023-11-05T08:07:10.075 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-c 2023-11-05T08:07:10.075 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:10.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.905+0000 7fa4f0df5640 1 librados: starting msgr at 2023-11-05T08:07:10.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.905+0000 7fa4f0df5640 1 librados: starting objecter 2023-11-05T08:07:10.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.905+0000 7fa4f0df5640 1 Processor -- start 2023-11-05T08:07:10.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.905+0000 7fa4f0df5640 1 -- start start 2023-11-05T08:07:10.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.905+0000 7fa4f0df5640 1 librados: setting wanted keys 2023-11-05T08:07:10.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.905+0000 7fa4f0df5640 1 librados: calling monclient init 2023-11-05T08:07:10.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.905+0000 7fa4f0df5640 10 monclient: init 2023-11-05T08:07:10.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.905+0000 7f7c35ffb640 1 -- 172.21.15.52:0/2875222341 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c3c011830 con 0x7f7c4013efb0 2023-11-05T08:07:10.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.905+0000 7f7c35ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:10.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.905+0000 7f7c35ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-11-05T08:07:10.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.905+0000 7f7c35ffb640 10 monclient: dump: 2023-11-05T08:07:10.078 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:10.079 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:10.079 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:10.079 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:10.079 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:10.080 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:10.080 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:10.080 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:10.080 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:10.080 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:10.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.905+0000 7f7c35ffb640 10 monclient: _finish_auth 0 2023-11-05T08:07:10.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.905+0000 7f7c35ffb640 10 monclient: _check_auth_tickets 2023-11-05T08:07:10.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.905+0000 7f7c35ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:07:10.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.905+0000 7f7c35ffb640 1 -- 172.21.15.52:0/2875222341 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c3c0119b0 con 0x7f7c4013efb0 2023-11-05T08:07:10.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.905+0000 7f7c4610c640 5 monclient: authenticate success, global_id 4284 2023-11-05T08:07:10.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.905+0000 7f7c4610c640 10 monclient: _renew_subs 2023-11-05T08:07:10.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.905+0000 7f7c4610c640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.52:3300/0 2023-11-05T08:07:10.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.905+0000 7f7c4610c640 1 -- 172.21.15.52:0/2875222341 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c40142cf0 con 0x7f7c4013efb0 2023-11-05T08:07:10.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.905+0000 7f7c35ffb640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:07:10.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.905+0000 7f7c35ffb640 1 -- 172.21.15.52:0/2875222341 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c3c011d60 con 0x7f7c4013efb0 2023-11-05T08:07:10.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.905+0000 7f7c35ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:10.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.905+0000 7f7c35ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-11-05T08:07:10.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.905+0000 7f7c35ffb640 10 monclient: dump: 2023-11-05T08:07:10.083 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:10.083 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:10.083 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:10.084 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:10.084 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:10.084 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:10.084 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:10.084 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:10.085 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:10.085 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:10.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.906+0000 7f7c4610c640 10 client.4284.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-05T08:07:10.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.906+0000 7f7c4610c640 10 monclient: _renew_subs 2023-11-05T08:07:10.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.906+0000 7f7c4610c640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.52:3300/0 2023-11-05T08:07:10.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.905+0000 7f7c377fe640 4 set_mon_vals no callback set 2023-11-05T08:07:10.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.906+0000 7f7c4610c640 1 -- 172.21.15.52:0/2875222341 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c4013a040 con 0x7f7c4013efb0 2023-11-05T08:07:10.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.906+0000 7f7c4610c640 1 librados: init done 2023-11-05T08:07:10.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.906+0000 7fa4f0df5640 10 monclient: _reopen_session rank -1 2023-11-05T08:07:10.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.906+0000 7fa4f0df5640 10 monclient: _add_conns ranks=[2,0,1] 2023-11-05T08:07:10.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.906+0000 7fa4f0df5640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa4ec0712d0 0x7fa4ec13d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:10.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.906+0000 7fa4f0df5640 10 monclient(hunting): picked mon.noname-c con 0x7fa4ec0712d0 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:07:10.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.906+0000 7fa4f0df5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa4ec0a8cc0 0x7fa4ec14bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:10.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.906+0000 7fa4f0df5640 10 monclient(hunting): picked mon.noname-a con 0x7fa4ec0a8cc0 addr [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] 2023-11-05T08:07:10.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.906+0000 7fa4f0df5640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa4ec151e30 0x7fa4ec14c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:10.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.906+0000 7fa4f0df5640 10 monclient(hunting): picked mon.noname-b con 0x7fa4ec151e30 addr [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] 2023-11-05T08:07:10.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.906+0000 7fa4f0df5640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:10.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.906+0000 7fa4f0df5640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4ec13e440 con 0x7fa4ec0a8cc0 2023-11-05T08:07:10.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.906+0000 7fa4f0df5640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:10.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.906+0000 7fa4f0df5640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4ec070950 con 0x7fa4ec151e30 2023-11-05T08:07:10.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.906+0000 7fa4f0df5640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:10.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.906+0000 7fa4f0df5640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4ec14c9a0 con 0x7fa4ec0712d0 2023-11-05T08:07:10.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.906+0000 7fa4f0df5640 10 monclient(hunting): _renew_subs 2023-11-05T08:07:10.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.906+0000 7fa4f0df5640 10 monclient(hunting): authenticate will time out at 1376.112517s 2023-11-05T08:07:10.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.906+0000 7fe551ffb640 1 -- 172.21.15.52:0/1125464803 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe54c02cbc0 con 0x7fe5540ade00 2023-11-05T08:07:10.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.906+0000 7fe551ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:10.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.906+0000 7fe551ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-11-05T08:07:10.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.906+0000 7fe551ffb640 10 monclient: dump: 2023-11-05T08:07:10.091 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:10.091 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:10.092 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:10.092 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:10.092 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:10.092 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:10.092 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:10.093 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:10.093 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:10.093 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:10.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.906+0000 7fe551ffb640 10 monclient: _finish_auth 0 2023-11-05T08:07:10.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.906+0000 7fe551ffb640 10 monclient: _check_auth_tickets 2023-11-05T08:07:10.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.906+0000 7fe551ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:07:10.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.907+0000 7fe551ffb640 1 -- 172.21.15.52:0/1125464803 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe54c02cd20 con 0x7fe5540ade00 2023-11-05T08:07:10.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.907+0000 7fe5596c2640 5 monclient: authenticate success, global_id 4281 2023-11-05T08:07:10.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.907+0000 7fe5596c2640 20 monclient: get_monmap_and_config waiting for monmap|config 2023-11-05T08:07:10.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.907+0000 7fe551ffb640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:07:10.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.907+0000 7fe5596c2640 10 monclient: get_monmap_and_config success 2023-11-05T08:07:10.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.907+0000 7fe551ffb640 1 -- 172.21.15.52:0/1125464803 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe54c034660 con 0x7fe5540ade00 2023-11-05T08:07:10.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.907+0000 7fe5596c2640 4 set_mon_vals no callback set 2023-11-05T08:07:10.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.907+0000 7fe551ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:10.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.907+0000 7fe551ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-11-05T08:07:10.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.907+0000 7fe551ffb640 10 monclient: dump: 2023-11-05T08:07:10.096 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:10.096 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:10.096 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:10.097 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:10.097 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:10.097 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:10.097 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:10.097 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:10.098 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:10.098 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:10.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.907+0000 7f7c4610c640 10 client.4284.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:07:10.099 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.907+0000 7f7c4610c640 15 client.4284.objecter _session_command_op_assign -1 1 2023-11-05T08:07:10.099 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.907+0000 7f7c4610c640 20 client.4284.objecter _get_session osd=-1 returning homeless 2023-11-05T08:07:10.099 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.907+0000 7f7c4610c640 10 client.4284.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-05T08:07:10.099 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.907+0000 7f7c4610c640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.52:3300/0 2023-11-05T08:07:10.099 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.907+0000 7f7c4610c640 1 -- 172.21.15.52:0/2875222341 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7c400aebe0 con 0x7f7c4013efb0 2023-11-05T08:07:10.100 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.907+0000 7fa4ea59c640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa4ec0712d0 0x7fa4ec13d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:10.100 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.907+0000 7fa4ea59c640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa4ec0712d0 0x7fa4ec13d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.52:40254/0 (socket says 172.21.15.52:40254) 2023-11-05T08:07:10.100 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.907+0000 7fa4ea59c640 1 -- 172.21.15.52:0/1083007888 learned_addr learned my addr 172.21.15.52:0/1083007888 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-11-05T08:07:10.101 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.907+0000 7fa4ea59c640 10 monclient(hunting): get_auth_request con 0x7fa4ec0712d0 auth_method 0 2023-11-05T08:07:10.101 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.907+0000 7fa4ea59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:10.101 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.907+0000 7fa4ea59c640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:10.101 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.907+0000 7fa4ea59c640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:10.102 INFO:teuthology.orchestra.run.smithi052.stdout:60129542150 2023-11-05T08:07:10.103 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-05T08:07:10.104 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.907+0000 7fe5596c2640 10 monclient: shutdown 2023-11-05T08:07:10.104 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.907+0000 7fe5596c2640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:07:10.104 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.907+0000 7fe5596c2640 1 -- 172.21.15.52:0/1125464803 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe5540ade00 msgr2=0x7fe55413b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:10.104 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.907+0000 7fe5596c2640 1 --2- 172.21.15.52:0/1125464803 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe5540ade00 0x7fe55413b420 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe54c009d90 tx=0x7fe54c02be10 comp rx=0 tx=0).stop 2023-11-05T08:07:10.105 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.907+0000 7fe5596c2640 1 -- 172.21.15.52:0/1125464803 shutdown_connections 2023-11-05T08:07:10.105 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.908+0000 7fe5596c2640 1 --2- 172.21.15.52:0/1125464803 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe5540ade00 0x7fe55413b420 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:10.105 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.908+0000 7fe5596c2640 1 --2- 172.21.15.52:0/1125464803 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe5540b4240 0x7fe5540b1150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:10.105 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.908+0000 7fe5596c2640 1 -- 172.21.15.52:0/1125464803 >> 172.21.15.52:0/1125464803 conn(0x7fe554065cd0 msgr2=0x7fe5540660e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:07:10.105 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.908+0000 7fe5596c2640 1 -- 172.21.15.52:0/1125464803 shutdown_connections 2023-11-05T08:07:10.106 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.908+0000 7fe5596c2640 1 -- 172.21.15.52:0/1125464803 wait complete. 2023-11-05T08:07:10.106 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.908+0000 7fa4ea59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:10.106 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.908+0000 7fa4ea59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:10.107 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.908+0000 7fa4ea59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:10.107 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.908+0000 7fe5596c2640 10 monclient: build_initial_monmap 2023-11-05T08:07:10.107 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.908+0000 7fe5596c2640 10 monclient: monmap: 2023-11-05T08:07:10.107 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:07:10.108 INFO:teuthology.orchestra.run.smithi052.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-05T08:07:10.108 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 0.000000 2023-11-05T08:07:10.108 INFO:teuthology.orchestra.run.smithi052.stderr:created 0.000000 2023-11-05T08:07:10.108 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:07:10.108 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:10.109 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.noname-a 2023-11-05T08:07:10.109 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.noname-b 2023-11-05T08:07:10.109 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-c 2023-11-05T08:07:10.109 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:10.110 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.908+0000 7f11c57fa640 1 -- 172.21.15.52:0/1817509779 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11bc005ce0 con 0x7f11c806d930 2023-11-05T08:07:10.110 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.908+0000 7f11c57fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:10.111 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.908+0000 7f11c57fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-11-05T08:07:10.111 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.908+0000 7f11c57fa640 10 monclient: dump: 2023-11-05T08:07:10.111 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:10.111 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:10.111 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:10.112 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:10.112 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:10.112 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:10.112 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:10.112 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:10.113 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:10.113 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:10.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.908+0000 7f11c57fa640 10 monclient: _finish_auth 0 2023-11-05T08:07:10.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.908+0000 7f11c57fa640 10 monclient: _check_auth_tickets 2023-11-05T08:07:10.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.908+0000 7f11c57fa640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:07:10.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.908+0000 7f11c57fa640 1 -- 172.21.15.52:0/1817509779 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11bc005e40 con 0x7f11c806d930 2023-11-05T08:07:10.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.908+0000 7f11c57fa640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:07:10.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.908+0000 7f11cdb67640 5 monclient: authenticate success, global_id 4287 2023-11-05T08:07:10.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.908+0000 7f11c57fa640 1 -- 172.21.15.52:0/1817509779 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11bc007270 con 0x7f11c806d930 2023-11-05T08:07:10.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.908+0000 7f11cdb67640 10 monclient: _renew_subs 2023-11-05T08:07:10.115 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.908+0000 7f11cdb67640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.52:3300/0 2023-11-05T08:07:10.115 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.908+0000 7f11cdb67640 1 -- 172.21.15.52:0/1817509779 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11c81449f0 con 0x7f11c806d930 2023-11-05T08:07:10.115 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.908+0000 7f11c6ffd640 4 set_mon_vals no callback set 2023-11-05T08:07:10.115 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.908+0000 7f11cdb67640 10 client.4287.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-05T08:07:10.115 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.908+0000 7f11c57fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:10.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.908+0000 7f11c57fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-11-05T08:07:10.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.908+0000 7f11c57fa640 10 monclient: dump: 2023-11-05T08:07:10.116 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:10.116 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:10.116 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:10.117 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:10.117 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:10.117 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:10.117 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:10.117 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:10.118 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:10.118 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:10.118 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.908+0000 7fe5596c2640 1 librados: starting msgr at 2023-11-05T08:07:10.118 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.908+0000 7fe5596c2640 1 librados: starting objecter 2023-11-05T08:07:10.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.909+0000 7f11cdb67640 10 monclient: _renew_subs 2023-11-05T08:07:10.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.909+0000 7f11cdb67640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.52:3300/0 2023-11-05T08:07:10.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.909+0000 7f11cdb67640 1 -- 172.21.15.52:0/1817509779 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11c8143c00 con 0x7f11c806d930 2023-11-05T08:07:10.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.909+0000 7f11cdb67640 1 librados: init done 2023-11-05T08:07:10.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.909+0000 7fe5596c2640 1 Processor -- start 2023-11-05T08:07:10.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.909+0000 7fe5596c2640 1 -- start start 2023-11-05T08:07:10.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.909+0000 7fe5596c2640 1 librados: setting wanted keys 2023-11-05T08:07:10.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.909+0000 7fe5596c2640 1 librados: calling monclient init 2023-11-05T08:07:10.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.909+0000 7fe5596c2640 10 monclient: init 2023-11-05T08:07:10.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.910+0000 7f11cdb67640 10 client.4287.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:07:10.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.910+0000 7f11cdb67640 15 client.4287.objecter _session_command_op_assign -1 1 2023-11-05T08:07:10.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.910+0000 7f11cdb67640 20 client.4287.objecter _get_session osd=-1 returning homeless 2023-11-05T08:07:10.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.910+0000 7f11cdb67640 10 client.4287.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-05T08:07:10.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.910+0000 7f11cdb67640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.52:3300/0 2023-11-05T08:07:10.123 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.910+0000 7f11cdb67640 1 -- 172.21.15.52:0/1817509779 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f11c80a95b0 con 0x7f11c806d930 2023-11-05T08:07:10.123 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.910+0000 7fe5596c2640 10 monclient: _reopen_session rank -1 2023-11-05T08:07:10.124 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.910+0000 7fe5596c2640 10 monclient: _add_conns ranks=[2,1,0] 2023-11-05T08:07:10.124 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.910+0000 7fe5596c2640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe5540ade00 0x7fe55413e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:10.124 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.910+0000 7fe5596c2640 10 monclient(hunting): picked mon.noname-c con 0x7fe5540ade00 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:07:10.124 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.910+0000 7fe5596c2640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe5540b4240 0x7fe554144d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:10.124 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.910+0000 7fe5596c2640 10 monclient(hunting): picked mon.noname-b con 0x7fe5540b4240 addr [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] 2023-11-05T08:07:10.124 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.910+0000 7fe5596c2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe5541448d0 0x7fe554137450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:10.125 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.910+0000 7fe5596c2640 10 monclient(hunting): picked mon.noname-a con 0x7fe5541448d0 addr [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] 2023-11-05T08:07:10.125 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.910+0000 7fe5596c2640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:10.125 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.910+0000 7fe5596c2640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe55413ebb0 con 0x7fe5541448d0 2023-11-05T08:07:10.125 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.910+0000 7fe5596c2640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:10.125 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.910+0000 7fe5596c2640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe554145280 con 0x7fe5540b4240 2023-11-05T08:07:10.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.910+0000 7fe5596c2640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:10.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.910+0000 7fe5596c2640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5541454a0 con 0x7fe5540ade00 2023-11-05T08:07:10.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.910+0000 7fe5596c2640 10 monclient(hunting): _renew_subs 2023-11-05T08:07:10.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.910+0000 7fe5596c2640 10 monclient(hunting): authenticate will time out at 1376.116244s 2023-11-05T08:07:10.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.910+0000 7fa4ead9d640 1 --2- 172.21.15.52:0/1083007888 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa4ec151e30 0x7fa4ec14c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:10.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.911+0000 7fa4ea59c640 10 monclient(hunting): handle_auth_done global_id 4235 payload 824 2023-11-05T08:07:10.129 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.911+0000 7fa4ea59c640 1 -- 172.21.15.52:0/1083007888 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa4ec151e30 msgr2=0x7fa4ec14c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:10.130 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.911+0000 7fa4ea59c640 1 --2- 172.21.15.52:0/1083007888 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa4ec151e30 0x7fa4ec14c460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:10.130 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.911+0000 7fa4ea59c640 1 -- 172.21.15.52:0/1083007888 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa4ec0a8cc0 msgr2=0x7fa4ec14bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:10.130 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.911+0000 7fa4ea59c640 1 --2- 172.21.15.52:0/1083007888 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa4ec0a8cc0 0x7fa4ec14bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:10.130 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.911+0000 7fa4ea59c640 10 monclient: _finish_hunting 0 2023-11-05T08:07:10.130 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.911+0000 7fa4ea59c640 1 monclient: found mon.noname-c 2023-11-05T08:07:10.131 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.911+0000 7fa4ea59c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:07:10.131 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.911+0000 7fa4ea59c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.52:3301/0 2023-11-05T08:07:10.131 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.911+0000 7fa4ea59c640 1 -- 172.21.15.52:0/1083007888 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4dc0107f0 con 0x7fa4ec0712d0 2023-11-05T08:07:10.131 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.914+0000 7fa4ea59c640 1 --2- 172.21.15.52:0/1083007888 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa4ec0712d0 0x7fa4ec13d8e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa4e400eea0 tx=0x7fa4e400ef90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:10.131 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.914+0000 7fa4daffd640 10 client.?.objecter ms_handle_connect 0x7fa4ec0712d0 2023-11-05T08:07:10.132 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.914+0000 7fa4daffd640 10 client.?.objecter resend_mon_ops 2023-11-05T08:07:10.132 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.914+0000 7fe5527fc640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe5540b4240 0x7fe554144d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:10.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.918+0000 7fe552ffd640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe5540ade00 0x7fe55413e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:10.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.919+0000 7fe552ffd640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe5540ade00 0x7fe55413e470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.52:40260/0 (socket says 172.21.15.52:40260) 2023-11-05T08:07:10.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.919+0000 7fe552ffd640 1 -- 172.21.15.52:0/1098459558 learned_addr learned my addr 172.21.15.52:0/1098459558 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-11-05T08:07:10.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.919+0000 7fe552ffd640 10 monclient(hunting): get_auth_request con 0x7fe5540ade00 auth_method 0 2023-11-05T08:07:10.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.919+0000 7fe552ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:10.134 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.919+0000 7fe552ffd640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:10.134 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.919+0000 7fe552ffd640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:10.135 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.919+0000 7fa4daffd640 1 -- 172.21.15.52:0/1083007888 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e4008c70 con 0x7fa4ec0712d0 2023-11-05T08:07:10.135 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.919+0000 7fa4daffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:10.136 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.919+0000 7fa4daffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-11-05T08:07:10.136 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.919+0000 7fa4daffd640 10 monclient: dump: 2023-11-05T08:07:10.136 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:10.136 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:10.136 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:10.137 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:10.137 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:10.137 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:10.137 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:10.137 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:10.138 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:10.138 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:10.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.919+0000 7fa4daffd640 10 monclient: _finish_auth 0 2023-11-05T08:07:10.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.919+0000 7fa4daffd640 10 monclient: _check_auth_tickets 2023-11-05T08:07:10.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.919+0000 7fa4daffd640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:07:10.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.919+0000 7fa4daffd640 1 -- 172.21.15.52:0/1083007888 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4e4014640 con 0x7fa4ec0712d0 2023-11-05T08:07:10.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.919+0000 7fa4f0df5640 5 monclient: authenticate success, global_id 4235 2023-11-05T08:07:10.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.919+0000 7fa4f0df5640 10 monclient: _renew_subs 2023-11-05T08:07:10.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.919+0000 7fa4f0df5640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.52:3301/0 2023-11-05T08:07:10.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.919+0000 7fa4f0df5640 1 -- 172.21.15.52:0/1083007888 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4ec0acb80 con 0x7fa4ec0712d0 2023-11-05T08:07:10.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.919+0000 7fa4daffd640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:07:10.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.919+0000 7fa4daffd640 1 -- 172.21.15.52:0/1083007888 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e40149f0 con 0x7fa4ec0712d0 2023-11-05T08:07:10.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.919+0000 7fa4daffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:10.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.919+0000 7fa4daffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-11-05T08:07:10.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.919+0000 7fa4daffd640 10 monclient: dump: 2023-11-05T08:07:10.141 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:10.141 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:10.141 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:10.141 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:10.141 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:10.141 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:10.142 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:10.142 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:10.142 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:10.142 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:10.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.919+0000 7fa4e8d99640 4 set_mon_vals no callback set 2023-11-05T08:07:10.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.919+0000 7fa4f0df5640 10 client.4235.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-05T08:07:10.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.919+0000 7fa4f0df5640 10 monclient: _renew_subs 2023-11-05T08:07:10.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.919+0000 7fa4f0df5640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.52:3301/0 2023-11-05T08:07:10.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.919+0000 7fa4f0df5640 1 -- 172.21.15.52:0/1083007888 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4ec08a330 con 0x7fa4ec0712d0 2023-11-05T08:07:10.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.919+0000 7fa4f0df5640 1 librados: init done 2023-11-05T08:07:10.144 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.920+0000 7fe552ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:10.144 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.920+0000 7fe552ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:10.144 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.920+0000 7fe552ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:10.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.920+0000 7fa4f0df5640 10 client.4235.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:07:10.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.920+0000 7fa4f0df5640 15 client.4235.objecter _session_command_op_assign -1 1 2023-11-05T08:07:10.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.920+0000 7fa4f0df5640 20 client.4235.objecter _get_session osd=-1 returning homeless 2023-11-05T08:07:10.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.920+0000 7fa4f0df5640 10 client.4235.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-05T08:07:10.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.920+0000 7fa4f0df5640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.52:3301/0 2023-11-05T08:07:10.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.920+0000 7fa4f0df5640 1 -- 172.21.15.52:0/1083007888 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa4ec0aca00 con 0x7fa4ec0712d0 2023-11-05T08:07:10.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.921+0000 7fe5527fc640 10 monclient(hunting): get_auth_request con 0x7fe5540b4240 auth_method 0 2023-11-05T08:07:10.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.921+0000 7fe5527fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:10.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.921+0000 7fe5527fc640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:10.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.921+0000 7fe5527fc640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:10.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.924+0000 7fe552ffd640 10 monclient(hunting): handle_auth_done global_id 4238 payload 824 2023-11-05T08:07:10.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.924+0000 7fe552ffd640 1 -- 172.21.15.52:0/1098459558 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe5540b4240 msgr2=0x7fe554144d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:10.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.924+0000 7fe552ffd640 1 --2- 172.21.15.52:0/1098459558 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe5540b4240 0x7fe554144d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:10.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.924+0000 7fe552ffd640 1 -- 172.21.15.52:0/1098459558 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe5541448d0 msgr2=0x7fe554137450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:10.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.924+0000 7fe552ffd640 1 --2- 172.21.15.52:0/1098459558 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe5541448d0 0x7fe554137450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:10.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.924+0000 7fe552ffd640 10 monclient: _finish_hunting 0 2023-11-05T08:07:10.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.924+0000 7fe552ffd640 1 monclient: found mon.noname-c 2023-11-05T08:07:10.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.924+0000 7fe552ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:07:10.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.924+0000 7fe552ffd640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.52:3301/0 2023-11-05T08:07:10.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.924+0000 7fe552ffd640 1 -- 172.21.15.52:0/1098459558 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe54c009a70 con 0x7fe5540ade00 2023-11-05T08:07:10.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.948+0000 7fa4daffd640 1 -- 172.21.15.52:0/1083007888 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa4e4010040 con 0x7fa4ec0712d0 2023-11-05T08:07:10.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.948+0000 7fa4daffd640 1 --2- 172.21.15.52:0/1083007888 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7fa4cc06c850 0x7fa4cc06ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:10.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.948+0000 7fa4e9d9b640 1 --2- 172.21.15.52:0/1083007888 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7fa4cc06c850 0x7fa4cc06ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:10.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.949+0000 7fa4e9d9b640 10 monclient: get_auth_request con 0x7fa4cc06c850 auth_method 0 2023-11-05T08:07:10.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.949+0000 7fa4e9d9b640 1 --2- 172.21.15.52:0/1083007888 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7fa4cc06c850 0x7fa4cc06ed10 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa4dc03a000 tx=0x7fa4dc032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:10.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.949+0000 7fa4daffd640 10 client.4235.objecter ms_handle_connect 0x7fa4cc06c850 2023-11-05T08:07:10.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.951+0000 7fa4daffd640 1 -- 172.21.15.52:0/1083007888 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fa4e400d040 con 0x7fa4ec0712d0 2023-11-05T08:07:10.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.951+0000 7fa4daffd640 10 client.4235.objecter ms_dispatch 0x7fa4ec000b90 osd_map(23..23 src has 1..23) v4 2023-11-05T08:07:10.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.951+0000 7fa4daffd640 3 client.4235.objecter handle_osd_map got epochs [23,23] > 0 2023-11-05T08:07:10.153 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.951+0000 7fa4daffd640 3 client.4235.objecter handle_osd_map decoding full epoch 23 2023-11-05T08:07:10.153 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.951+0000 7fa4daffd640 10 client.4235.objecter checking command 1 2023-11-05T08:07:10.153 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.951+0000 7fa4daffd640 1 --2- 172.21.15.52:0/1083007888 >> [v2:172.21.15.52:6808/3439629566,v1:172.21.15.52:6809/3439629566] conn(0x7fa4cc072c30 0x7fa4cc075050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:10.153 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.951+0000 7fa4daffd640 20 client.4235.objecter _get_session s=0x7fa4cc072560 osd=3 3 2023-11-05T08:07:10.153 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.951+0000 7fa4daffd640 20 client.4235.objecter put_session s=0x7fa4cc072560 osd=3 3 2023-11-05T08:07:10.154 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.951+0000 7fa4daffd640 15 client.4235.objecter _session_command_op_remove -1 1 2023-11-05T08:07:10.154 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.951+0000 7fa4daffd640 20 client.4235.objecter _get_session s=0x7fa4cc072560 osd=3 3 2023-11-05T08:07:10.154 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.951+0000 7fa4daffd640 20 client.4235.objecter get_session s=0x7fa4cc072560 osd=3 3 2023-11-05T08:07:10.154 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.951+0000 7fa4daffd640 15 client.4235.objecter _session_command_op_assign 3 1 2023-11-05T08:07:10.154 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.951+0000 7fa4daffd640 20 client.4235.objecter put_session s=0x7fa4cc072560 osd=3 4 2023-11-05T08:07:10.155 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.951+0000 7fa4daffd640 10 client.4235.objecter _send_command 1 2023-11-05T08:07:10.155 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.951+0000 7fa4daffd640 1 -- 172.21.15.52:0/1083007888 --> [v2:172.21.15.52:6808/3439629566,v1:172.21.15.52:6809/3439629566] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa4cc075700 con 0x7fa4cc072c30 2023-11-05T08:07:10.155 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.951+0000 7fa4daffd640 20 client.4235.objecter dump_active .. 0 homeless 2023-11-05T08:07:10.155 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.951+0000 7fa4daffd640 1 -- 172.21.15.52:0/1083007888 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa4e4055bd0 con 0x7fa4ec0712d0 2023-11-05T08:07:10.155 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.951+0000 7fa4daffd640 10 monclient: handle_get_version_reply finishing 1 version 23 2023-11-05T08:07:10.156 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.951+0000 7fa4ead9d640 1 --2- 172.21.15.52:0/1083007888 >> [v2:172.21.15.52:6808/3439629566,v1:172.21.15.52:6809/3439629566] conn(0x7fa4cc072c30 0x7fa4cc075050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:10.156 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.952+0000 7fe552ffd640 1 --2- 172.21.15.52:0/1098459558 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe5540ade00 0x7fe55413e470 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe54400b410 tx=0x7fe54400b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:10.156 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.952+0000 7fe53b7fe640 10 client.?.objecter ms_handle_connect 0x7fe5540ade00 2023-11-05T08:07:10.157 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.952+0000 7fe53b7fe640 10 client.?.objecter resend_mon_ops 2023-11-05T08:07:10.157 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.952+0000 7fa4ead9d640 10 monclient: get_auth_request con 0x7fa4cc072c30 auth_method 0 2023-11-05T08:07:10.157 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.955+0000 7fa4daffd640 10 client.4235.objecter ms_handle_connect 0x7fa4cc072c30 2023-11-05T08:07:10.158 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.955+0000 7fa4ead9d640 1 --2- 172.21.15.52:0/1083007888 >> [v2:172.21.15.52:6808/3439629566,v1:172.21.15.52:6809/3439629566] conn(0x7fa4cc072c30 0x7fa4cc075050 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:10.158 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.956+0000 7f7c35ffb640 1 -- 172.21.15.52:0/2875222341 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7c3c01a400 con 0x7f7c4013efb0 2023-11-05T08:07:10.159 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.957+0000 7f7c35ffb640 1 --2- 172.21.15.52:0/2875222341 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f7c2406c830 0x7f7c2406ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:10.159 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.957+0000 7f7c4510a640 1 --2- 172.21.15.52:0/2875222341 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f7c2406c830 0x7f7c2406ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:10.159 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.957+0000 7f7c4510a640 10 monclient: get_auth_request con 0x7f7c2406c830 auth_method 0 2023-11-05T08:07:10.159 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.958+0000 7f7c35ffb640 10 client.4284.objecter ms_handle_connect 0x7f7c2406c830 2023-11-05T08:07:10.159 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.958+0000 7f7c4510a640 1 --2- 172.21.15.52:0/2875222341 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f7c2406c830 0x7f7c2406ecf0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7c38036000 tx=0x7f7c38030000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:10.160 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.975+0000 7fe53b7fe640 1 -- 172.21.15.52:0/1098459558 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe544011830 con 0x7fe5540ade00 2023-11-05T08:07:10.161 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.975+0000 7fe53b7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:10.161 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.975+0000 7fe53b7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-11-05T08:07:10.161 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.975+0000 7fe53b7fe640 10 monclient: dump: 2023-11-05T08:07:10.161 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:10.161 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:10.162 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:10.162 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:10.162 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:10.162 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:10.162 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:10.162 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:10.163 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:10.163 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:10.163 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.975+0000 7fe53b7fe640 10 monclient: _finish_auth 0 2023-11-05T08:07:10.163 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.975+0000 7fe53b7fe640 10 monclient: _check_auth_tickets 2023-11-05T08:07:10.163 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.975+0000 7fe53b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:07:10.164 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.975+0000 7fe5596c2640 5 monclient: authenticate success, global_id 4238 2023-11-05T08:07:10.164 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.975+0000 7fe5596c2640 10 monclient: _renew_subs 2023-11-05T08:07:10.164 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.975+0000 7fe5596c2640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.52:3301/0 2023-11-05T08:07:10.164 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.975+0000 7fe5596c2640 1 -- 172.21.15.52:0/1098459558 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe554145a20 con 0x7fe5540ade00 2023-11-05T08:07:10.164 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.975+0000 7fe5596c2640 10 client.4238.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-05T08:07:10.165 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.975+0000 7fe5596c2640 10 monclient: _renew_subs 2023-11-05T08:07:10.165 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.975+0000 7fe5596c2640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.52:3301/0 2023-11-05T08:07:10.165 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.975+0000 7fe5596c2640 1 -- 172.21.15.52:0/1098459558 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe554137d00 con 0x7fe5540ade00 2023-11-05T08:07:10.165 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.975+0000 7fe5596c2640 1 librados: init done 2023-11-05T08:07:10.165 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.976+0000 7fe5596c2640 10 client.4238.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:07:10.166 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.976+0000 7fe5596c2640 15 client.4238.objecter _session_command_op_assign -1 1 2023-11-05T08:07:10.166 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.976+0000 7fe5596c2640 20 client.4238.objecter _get_session osd=-1 returning homeless 2023-11-05T08:07:10.166 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.976+0000 7fe5596c2640 10 client.4238.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-05T08:07:10.166 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.976+0000 7fe5596c2640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.52:3301/0 2023-11-05T08:07:10.166 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.976+0000 7fe5596c2640 1 -- 172.21.15.52:0/1098459558 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe5541456c0 con 0x7fe5540ade00 2023-11-05T08:07:10.167 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.980+0000 7f7c35ffb640 1 -- 172.21.15.52:0/2875222341 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f7c3c059160 con 0x7f7c4013efb0 2023-11-05T08:07:10.167 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.980+0000 7f7c35ffb640 10 client.4284.objecter ms_dispatch 0x7f7c40000b90 osd_map(23..23 src has 1..23) v4 2023-11-05T08:07:10.168 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.980+0000 7f7c35ffb640 3 client.4284.objecter handle_osd_map got epochs [23,23] > 0 2023-11-05T08:07:10.168 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.980+0000 7f7c35ffb640 3 client.4284.objecter handle_osd_map decoding full epoch 23 2023-11-05T08:07:10.168 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.980+0000 7f7c35ffb640 10 client.4284.objecter checking command 1 2023-11-05T08:07:10.168 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.980+0000 7f7c35ffb640 1 --2- 172.21.15.52:0/2875222341 >> [v2:172.21.15.52:6800/495294409,v1:172.21.15.52:6801/495294409] conn(0x7f7c24072c10 0x7f7c24075030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:10.168 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.980+0000 7f7c35ffb640 20 client.4284.objecter _get_session s=0x7f7c24072540 osd=2 3 2023-11-05T08:07:10.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.980+0000 7f7c35ffb640 20 client.4284.objecter put_session s=0x7f7c24072540 osd=2 3 2023-11-05T08:07:10.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.980+0000 7f7c35ffb640 15 client.4284.objecter _session_command_op_remove -1 1 2023-11-05T08:07:10.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.980+0000 7f7c35ffb640 20 client.4284.objecter _get_session s=0x7f7c24072540 osd=2 3 2023-11-05T08:07:10.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.980+0000 7f7c35ffb640 20 client.4284.objecter get_session s=0x7f7c24072540 osd=2 3 2023-11-05T08:07:10.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.980+0000 7f7c35ffb640 15 client.4284.objecter _session_command_op_assign 2 1 2023-11-05T08:07:10.170 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.980+0000 7f7c35ffb640 20 client.4284.objecter put_session s=0x7f7c24072540 osd=2 4 2023-11-05T08:07:10.170 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.980+0000 7f7c35ffb640 10 client.4284.objecter _send_command 1 2023-11-05T08:07:10.170 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.980+0000 7f7c35ffb640 1 -- 172.21.15.52:0/2875222341 --> [v2:172.21.15.52:6800/495294409,v1:172.21.15.52:6801/495294409] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7c240756e0 con 0x7f7c24072c10 2023-11-05T08:07:10.170 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.980+0000 7f7c35ffb640 20 client.4284.objecter dump_active .. 0 homeless 2023-11-05T08:07:10.170 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.980+0000 7f7c35ffb640 1 -- 172.21.15.52:0/2875222341 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7c3c054da0 con 0x7f7c4013efb0 2023-11-05T08:07:10.171 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.980+0000 7f7c35ffb640 10 monclient: handle_get_version_reply finishing 1 version 23 2023-11-05T08:07:10.171 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.980+0000 7fbec6ffd640 1 -- 172.21.15.52:0/1661704675 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fbed80b1560 con 0x7fbed00070e0 2023-11-05T08:07:10.172 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.981+0000 7fbec6ffd640 1 --2- 172.21.15.52:0/1661704675 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7fbeb806c850 0x7fbeb806ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:10.172 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.981+0000 7fbed5d9b640 1 --2- 172.21.15.52:0/1661704675 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7fbeb806c850 0x7fbeb806ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:10.172 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.981+0000 7fbed5d9b640 10 monclient: get_auth_request con 0x7fbeb806c850 auth_method 0 2023-11-05T08:07:10.172 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.981+0000 7f7c44909640 1 --2- 172.21.15.52:0/2875222341 >> [v2:172.21.15.52:6800/495294409,v1:172.21.15.52:6801/495294409] conn(0x7f7c24072c10 0x7f7c24075030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:10.173 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.981+0000 7f7c44909640 10 monclient: get_auth_request con 0x7f7c24072c10 auth_method 0 2023-11-05T08:07:10.173 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.981+0000 7fbec6ffd640 10 client.4278.objecter ms_handle_connect 0x7fbeb806c850 2023-11-05T08:07:10.173 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.981+0000 7fbed5d9b640 1 --2- 172.21.15.52:0/1661704675 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7fbeb806c850 0x7fbeb806ed10 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fbed0032f40 tx=0x7fbec8009110 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:10.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.986+0000 7f7c35ffb640 10 client.4284.objecter ms_handle_connect 0x7f7c24072c10 2023-11-05T08:07:10.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.986+0000 7f7c44909640 1 --2- 172.21.15.52:0/2875222341 >> [v2:172.21.15.52:6800/495294409,v1:172.21.15.52:6801/495294409] conn(0x7f7c24072c10 0x7f7c24075030 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:10.175 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:09.999+0000 7f11c57fa640 1 -- 172.21.15.52:0/1817509779 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f11bc007490 con 0x7f11c806d930 2023-11-05T08:07:10.176 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.000+0000 7f11c57fa640 1 --2- 172.21.15.52:0/1817509779 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f11b406c800 0x7f11b406ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:10.176 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.000+0000 7f11c7fff640 1 --2- 172.21.15.52:0/1817509779 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f11b406c800 0x7f11b406ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:10.176 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.000+0000 7f11c7fff640 10 monclient: get_auth_request con 0x7f11b406c800 auth_method 0 2023-11-05T08:07:10.176 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.000+0000 7f11c57fa640 10 client.4287.objecter ms_handle_connect 0x7f11b406c800 2023-11-05T08:07:10.176 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.000+0000 7f11c7fff640 1 --2- 172.21.15.52:0/1817509779 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f11b406c800 0x7f11b406ecc0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f11b8036000 tx=0x7f11b8008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:10.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.006+0000 7f11c57fa640 1 -- 172.21.15.52:0/1817509779 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f11bc0580b0 con 0x7f11c806d930 2023-11-05T08:07:10.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.006+0000 7f11c57fa640 10 client.4287.objecter ms_dispatch 0x7f11c8000b90 osd_map(23..23 src has 1..23) v4 2023-11-05T08:07:10.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.006+0000 7f11c57fa640 3 client.4287.objecter handle_osd_map got epochs [23,23] > 0 2023-11-05T08:07:10.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.006+0000 7f11c57fa640 3 client.4287.objecter handle_osd_map decoding full epoch 23 2023-11-05T08:07:10.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.007+0000 7f11c57fa640 10 client.4287.objecter checking command 1 2023-11-05T08:07:10.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.007+0000 7f11c57fa640 1 --2- 172.21.15.52:0/1817509779 >> [v2:172.21.15.156:6810/2755763872,v1:172.21.15.156:6811/2755763872] conn(0x7f11b4072be0 0x7f11b4075000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:10.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.007+0000 7f11c57fa640 20 client.4287.objecter _get_session s=0x7f11b4072510 osd=5 3 2023-11-05T08:07:10.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.007+0000 7f11c57fa640 20 client.4287.objecter put_session s=0x7f11b4072510 osd=5 3 2023-11-05T08:07:10.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.007+0000 7f11c57fa640 15 client.4287.objecter _session_command_op_remove -1 1 2023-11-05T08:07:10.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.007+0000 7f11c57fa640 20 client.4287.objecter _get_session s=0x7f11b4072510 osd=5 3 2023-11-05T08:07:10.179 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.007+0000 7f11c57fa640 20 client.4287.objecter get_session s=0x7f11b4072510 osd=5 3 2023-11-05T08:07:10.179 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.007+0000 7f11c57fa640 15 client.4287.objecter _session_command_op_assign 5 1 2023-11-05T08:07:10.179 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.007+0000 7f11c57fa640 20 client.4287.objecter put_session s=0x7f11b4072510 osd=5 4 2023-11-05T08:07:10.179 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.007+0000 7f11c57fa640 10 client.4287.objecter _send_command 1 2023-11-05T08:07:10.179 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.007+0000 7f11c57fa640 1 -- 172.21.15.52:0/1817509779 --> [v2:172.21.15.156:6810/2755763872,v1:172.21.15.156:6811/2755763872] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f11b40756b0 con 0x7f11b4072be0 2023-11-05T08:07:10.180 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.007+0000 7f11c57fa640 20 client.4287.objecter dump_active .. 0 homeless 2023-11-05T08:07:10.180 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.007+0000 7f11c57fa640 1 -- 172.21.15.52:0/1817509779 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f11bc0543f0 con 0x7f11c806d930 2023-11-05T08:07:10.180 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.007+0000 7f11c57fa640 10 monclient: handle_get_version_reply finishing 1 version 23 2023-11-05T08:07:10.180 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.007+0000 7fe53b7fe640 1 -- 172.21.15.52:0/1098459558 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5541456c0 con 0x7fe5540ade00 2023-11-05T08:07:10.181 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.007+0000 7fe53b7fe640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:07:10.181 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.007+0000 7fe53b7fe640 1 -- 172.21.15.52:0/1098459558 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe544011b90 con 0x7fe5540ade00 2023-11-05T08:07:10.181 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.007+0000 7fe53b7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:10.181 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.007+0000 7fe53b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-11-05T08:07:10.181 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.007+0000 7fe53b7fe640 10 monclient: dump: 2023-11-05T08:07:10.182 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:10.182 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:10.182 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:10.182 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:10.182 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:10.183 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:10.183 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:10.183 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:10.183 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:10.183 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:10.184 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.007+0000 7fe5517fa640 4 set_mon_vals no callback set 2023-11-05T08:07:10.184 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.007+0000 7fbec6ffd640 1 -- 172.21.15.52:0/1661704675 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fbed80f4940 con 0x7fbed00070e0 2023-11-05T08:07:10.184 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.007+0000 7fbec6ffd640 10 client.4278.objecter ms_dispatch 0x7fbed8000b90 osd_map(23..23 src has 1..23) v4 2023-11-05T08:07:10.185 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.007+0000 7fbec6ffd640 3 client.4278.objecter handle_osd_map got epochs [23,23] > 0 2023-11-05T08:07:10.185 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.007+0000 7fbec6ffd640 3 client.4278.objecter handle_osd_map decoding full epoch 23 2023-11-05T08:07:10.185 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.007+0000 7fbec6ffd640 10 client.4278.objecter checking command 1 2023-11-05T08:07:10.185 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.007+0000 7fbec6ffd640 1 --2- 172.21.15.52:0/1661704675 >> [v2:172.21.15.156:6826/2586579514,v1:172.21.15.156:6827/2586579514] conn(0x7fbeb8072c30 0x7fbeb8075050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:10.185 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.007+0000 7fbec6ffd640 20 client.4278.objecter _get_session s=0x7fbeb8072560 osd=6 3 2023-11-05T08:07:10.186 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.007+0000 7fbec6ffd640 20 client.4278.objecter put_session s=0x7fbeb8072560 osd=6 3 2023-11-05T08:07:10.186 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.007+0000 7fbec6ffd640 15 client.4278.objecter _session_command_op_remove -1 1 2023-11-05T08:07:10.186 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.007+0000 7fbec6ffd640 20 client.4278.objecter _get_session s=0x7fbeb8072560 osd=6 3 2023-11-05T08:07:10.186 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.007+0000 7fbec6ffd640 20 client.4278.objecter get_session s=0x7fbeb8072560 osd=6 3 2023-11-05T08:07:10.186 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.007+0000 7fbec6ffd640 15 client.4278.objecter _session_command_op_assign 6 1 2023-11-05T08:07:10.187 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.007+0000 7fbec6ffd640 20 client.4278.objecter put_session s=0x7fbeb8072560 osd=6 4 2023-11-05T08:07:10.187 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.007+0000 7fbec6ffd640 10 client.4278.objecter _send_command 1 2023-11-05T08:07:10.187 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.007+0000 7fbec6ffd640 1 -- 172.21.15.52:0/1661704675 --> [v2:172.21.15.156:6826/2586579514,v1:172.21.15.156:6827/2586579514] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbeb8075700 con 0x7fbeb8072c30 2023-11-05T08:07:10.187 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.007+0000 7fbec6ffd640 20 client.4278.objecter dump_active .. 0 homeless 2023-11-05T08:07:10.188 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.007+0000 7fbec6ffd640 1 -- 172.21.15.52:0/1661704675 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbed80f0580 con 0x7fbed00070e0 2023-11-05T08:07:10.188 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.007+0000 7fbec6ffd640 10 monclient: handle_get_version_reply finishing 1 version 23 2023-11-05T08:07:10.188 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.007+0000 7f11cd366640 1 --2- 172.21.15.52:0/1817509779 >> [v2:172.21.15.156:6810/2755763872,v1:172.21.15.156:6811/2755763872] conn(0x7f11b4072be0 0x7f11b4075000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:10.189 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.008+0000 7fe53b7fe640 1 -- 172.21.15.52:0/1098459558 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe54401a400 con 0x7fe5540ade00 2023-11-05T08:07:10.189 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.008+0000 7f11cd366640 10 monclient: get_auth_request con 0x7f11b4072be0 auth_method 0 2023-11-05T08:07:10.189 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.008+0000 7fbed6d9d640 1 --2- 172.21.15.52:0/1661704675 >> [v2:172.21.15.156:6826/2586579514,v1:172.21.15.156:6827/2586579514] conn(0x7fbeb8072c30 0x7fbeb8075050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:10.190 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.008+0000 7fe53b7fe640 1 --2- 172.21.15.52:0/1098459558 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7fe54006c800 0x7fe54006ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:10.190 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.008+0000 7fbed6d9d640 10 monclient: get_auth_request con 0x7fbeb8072c30 auth_method 0 2023-11-05T08:07:10.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.008+0000 7fe5527fc640 1 --2- 172.21.15.52:0/1098459558 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7fe54006c800 0x7fe54006ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:10.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.008+0000 7fe5527fc640 10 monclient: get_auth_request con 0x7fe54006c800 auth_method 0 2023-11-05T08:07:10.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.009+0000 7fe5527fc640 1 --2- 172.21.15.52:0/1098459558 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7fe54006c800 0x7fe54006ecc0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe554066320 tx=0x7fe548009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:10.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.009+0000 7fe53b7fe640 10 client.4238.objecter ms_handle_connect 0x7fe54006c800 2023-11-05T08:07:10.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.011+0000 7fe53b7fe640 1 -- 172.21.15.52:0/1098459558 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fe544059020 con 0x7fe5540ade00 2023-11-05T08:07:10.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.011+0000 7fe53b7fe640 10 client.4238.objecter ms_dispatch 0x7fe554000b90 osd_map(23..23 src has 1..23) v4 2023-11-05T08:07:10.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.011+0000 7fe53b7fe640 3 client.4238.objecter handle_osd_map got epochs [23,23] > 0 2023-11-05T08:07:10.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.011+0000 7fe53b7fe640 3 client.4238.objecter handle_osd_map decoding full epoch 23 2023-11-05T08:07:10.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.011+0000 7fe53b7fe640 10 client.4238.objecter checking command 1 2023-11-05T08:07:10.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.011+0000 7fe53b7fe640 1 --2- 172.21.15.52:0/1098459558 >> [v2:172.21.15.52:6816/61703536,v1:172.21.15.52:6817/61703536] conn(0x7fe540072be0 0x7fe540075000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:10.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.011+0000 7fe53b7fe640 20 client.4238.objecter _get_session s=0x7fe540072510 osd=0 3 2023-11-05T08:07:10.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.011+0000 7fe53b7fe640 20 client.4238.objecter put_session s=0x7fe540072510 osd=0 3 2023-11-05T08:07:10.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.011+0000 7fe53b7fe640 15 client.4238.objecter _session_command_op_remove -1 1 2023-11-05T08:07:10.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.011+0000 7fe53b7fe640 20 client.4238.objecter _get_session s=0x7fe540072510 osd=0 3 2023-11-05T08:07:10.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.011+0000 7fe53b7fe640 20 client.4238.objecter get_session s=0x7fe540072510 osd=0 3 2023-11-05T08:07:10.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.011+0000 7fe53b7fe640 15 client.4238.objecter _session_command_op_assign 0 1 2023-11-05T08:07:10.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.011+0000 7fe53b7fe640 20 client.4238.objecter put_session s=0x7fe540072510 osd=0 4 2023-11-05T08:07:10.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.011+0000 7fe53b7fe640 10 client.4238.objecter _send_command 1 2023-11-05T08:07:10.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.011+0000 7fe53b7fe640 1 -- 172.21.15.52:0/1098459558 --> [v2:172.21.15.52:6816/61703536,v1:172.21.15.52:6817/61703536] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe5400756b0 con 0x7fe540072be0 2023-11-05T08:07:10.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.011+0000 7fe53b7fe640 20 client.4238.objecter dump_active .. 0 homeless 2023-11-05T08:07:10.196 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.011+0000 7fe53b7fe640 1 -- 172.21.15.52:0/1098459558 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe544009230 con 0x7fe5540ade00 2023-11-05T08:07:10.196 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.011+0000 7fe53b7fe640 10 monclient: handle_get_version_reply finishing 1 version 23 2023-11-05T08:07:10.196 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.011+0000 7fe5537fe640 1 --2- 172.21.15.52:0/1098459558 >> [v2:172.21.15.52:6816/61703536,v1:172.21.15.52:6817/61703536] conn(0x7fe540072be0 0x7fe540075000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:10.196 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.012+0000 7fe5537fe640 10 monclient: get_auth_request con 0x7fe540072be0 auth_method 0 2023-11-05T08:07:10.197 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.012+0000 7fbec6ffd640 10 client.4278.objecter ms_handle_connect 0x7fbeb8072c30 2023-11-05T08:07:10.197 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.012+0000 7fbed6d9d640 1 --2- 172.21.15.52:0/1661704675 >> [v2:172.21.15.156:6826/2586579514,v1:172.21.15.156:6827/2586579514] conn(0x7fbeb8072c30 0x7fbeb8075050 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:10.197 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.013+0000 7f11c57fa640 10 client.4287.objecter ms_handle_connect 0x7f11b4072be0 2023-11-05T08:07:10.197 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.013+0000 7f11cd366640 1 --2- 172.21.15.52:0/1817509779 >> [v2:172.21.15.156:6810/2755763872,v1:172.21.15.156:6811/2755763872] conn(0x7f11b4072be0 0x7f11b4075000 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:10.198 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.015+0000 7fe53b7fe640 10 client.4238.objecter ms_handle_connect 0x7fe540072be0 2023-11-05T08:07:10.198 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.015+0000 7fe5537fe640 1 --2- 172.21.15.52:0/1098459558 >> [v2:172.21.15.52:6816/61703536,v1:172.21.15.52:6817/61703536] conn(0x7fe540072be0 0x7fe540075000 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:10.199 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.020+0000 7fa4daffd640 1 -- 172.21.15.52:0/1083007888 <== osd.3 v2:172.21.15.52:6808/3439629566 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fa4cc075700 con 0x7fa4cc072c30 2023-11-05T08:07:10.199 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.020+0000 7fa4daffd640 10 client.4235.objecter ms_dispatch 0x7fa4ec000b90 command_reply(tid 1: 0 ) v1 2023-11-05T08:07:10.200 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.020+0000 7fa4daffd640 10 client.4235.objecter _finish_command 1 = system:0 2023-11-05T08:07:10.200 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.020+0000 7fa4daffd640 20 client.4235.objecter put_session s=0x7fa4cc072560 osd=3 4 2023-11-05T08:07:10.200 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.020+0000 7fa4daffd640 15 client.4235.objecter _session_command_op_remove 3 1 2023-11-05T08:07:10.200 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.034+0000 7fa4f0df5640 10 client.4235.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2023-11-05T08:07:10.200 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.034+0000 7fa4f0df5640 15 client.4235.objecter _session_command_op_assign -1 2 2023-11-05T08:07:10.201 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.034+0000 7fa4f0df5640 20 client.4235.objecter _get_session s=0x7fa4cc072560 osd=3 3 2023-11-05T08:07:10.201 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.034+0000 7fa4f0df5640 20 client.4235.objecter put_session s=0x7fa4cc072560 osd=3 3 2023-11-05T08:07:10.201 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.034+0000 7fa4f0df5640 20 client.4235.objecter _get_session s=0x7fa4cc072560 osd=3 3 2023-11-05T08:07:10.201 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.034+0000 7fa4f0df5640 15 client.4235.objecter _session_command_op_remove -1 2 2023-11-05T08:07:10.201 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.034+0000 7fa4f0df5640 20 client.4235.objecter get_session s=0x7fa4cc072560 osd=3 3 2023-11-05T08:07:10.202 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.034+0000 7fa4f0df5640 15 client.4235.objecter _session_command_op_assign 3 2 2023-11-05T08:07:10.202 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.034+0000 7fa4f0df5640 20 client.4235.objecter put_session s=0x7fa4cc072560 osd=3 4 2023-11-05T08:07:10.202 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.034+0000 7fa4f0df5640 10 client.4235.objecter _send_command 2 2023-11-05T08:07:10.202 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.034+0000 7fa4f0df5640 1 -- 172.21.15.52:0/1083007888 --> [v2:172.21.15.52:6808/3439629566,v1:172.21.15.52:6809/3439629566] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa4ec0aa0e0 con 0x7fa4cc072c30 2023-11-05T08:07:10.203 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.044+0000 7fa4daffd640 1 -- 172.21.15.52:0/1083007888 <== osd.3 v2:172.21.15.52:6808/3439629566 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa4e00016f0 con 0x7fa4cc072c30 2023-11-05T08:07:10.203 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.044+0000 7fa4daffd640 10 client.4235.objecter ms_dispatch 0x7fa4ec000b90 command_reply(tid 2: 0 ) v1 2023-11-05T08:07:10.203 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.044+0000 7fa4daffd640 10 client.4235.objecter _finish_command 2 = system:0 2023-11-05T08:07:10.203 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.044+0000 7fa4daffd640 20 client.4235.objecter put_session s=0x7fa4cc072560 osd=3 4 2023-11-05T08:07:10.203 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.044+0000 7fa4daffd640 15 client.4235.objecter _session_command_op_remove 3 2 2023-11-05T08:07:10.205 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.044+0000 7fa4f0df5640 10 librados: watch_flush enter 2023-11-05T08:07:10.206 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.044+0000 7fa4f0df5640 10 librados: watch_flush exit 2023-11-05T08:07:10.206 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.044+0000 7fa4f0df5640 10 client.4235.objecter close_session for osd.3 2023-11-05T08:07:10.206 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.044+0000 7fa4f0df5640 1 -- 172.21.15.52:0/1083007888 >> [v2:172.21.15.52:6808/3439629566,v1:172.21.15.52:6809/3439629566] conn(0x7fa4cc072c30 msgr2=0x7fa4cc075050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:10.206 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.044+0000 7fa4f0df5640 1 --2- 172.21.15.52:0/1083007888 >> [v2:172.21.15.52:6808/3439629566,v1:172.21.15.52:6809/3439629566] conn(0x7fa4cc072c30 0x7fa4cc075050 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:10.206 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.044+0000 7fa4f0df5640 20 client.4235.objecter put_session s=0x7fa4cc072560 osd=3 1 2023-11-05T08:07:10.207 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.044+0000 7fa4f0df5640 20 client.4235.objecter shutdown clearing up homeless session... 2023-11-05T08:07:10.207 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.044+0000 7fa4f0df5640 10 client.4235.objecter successfully canceled tick 2023-11-05T08:07:10.207 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.044+0000 7fa4f0df5640 1 -- 172.21.15.52:0/1083007888 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7fa4cc06c850 msgr2=0x7fa4cc06ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:10.207 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.044+0000 7fa4f0df5640 1 --2- 172.21.15.52:0/1083007888 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7fa4cc06c850 0x7fa4cc06ed10 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa4dc03a000 tx=0x7fa4dc032000 comp rx=0 tx=0).stop 2023-11-05T08:07:10.207 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.044+0000 7fa4f0df5640 10 monclient: shutdown 2023-11-05T08:07:10.208 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.044+0000 7fa4f0df5640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:07:10.208 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.044+0000 7fa4f0df5640 1 -- 172.21.15.52:0/1083007888 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa4ec0712d0 msgr2=0x7fa4ec13d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:10.208 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.044+0000 7fa4f0df5640 1 --2- 172.21.15.52:0/1083007888 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa4ec0712d0 0x7fa4ec13d8e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa4e400eea0 tx=0x7fa4e400ef90 comp rx=0 tx=0).stop 2023-11-05T08:07:10.208 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.044+0000 7fa4ead9d640 1 -- 172.21.15.52:0/1083007888 reap_dead start 2023-11-05T08:07:10.208 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.045+0000 7fa4f0df5640 1 -- 172.21.15.52:0/1083007888 shutdown_connections 2023-11-05T08:07:10.209 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.045+0000 7fa4f0df5640 1 -- 172.21.15.52:0/1083007888 >> 172.21.15.52:0/1083007888 conn(0x7fa4ec0b2e10 msgr2=0x7fa4ec0abcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:07:10.209 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.045+0000 7fa4f0df5640 1 -- 172.21.15.52:0/1083007888 shutdown_connections 2023-11-05T08:07:10.209 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.045+0000 7fa4f0df5640 1 -- 172.21.15.52:0/1083007888 wait complete. 2023-11-05T08:07:10.209 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.045+0000 7fa4f0df5640 1 librados: shutdown 2023-11-05T08:07:10.210 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.046+0000 7f7c35ffb640 1 -- 172.21.15.52:0/2875222341 <== osd.2 v2:172.21.15.52:6800/495294409 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f7c240756e0 con 0x7f7c24072c10 2023-11-05T08:07:10.210 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.046+0000 7f7c35ffb640 10 client.4284.objecter ms_dispatch 0x7f7c40000b90 command_reply(tid 1: 0 ) v1 2023-11-05T08:07:10.210 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.046+0000 7f7c35ffb640 10 client.4284.objecter _finish_command 1 = system:0 2023-11-05T08:07:10.210 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.047+0000 7f7c35ffb640 20 client.4284.objecter put_session s=0x7f7c24072540 osd=2 4 2023-11-05T08:07:10.211 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.047+0000 7f7c35ffb640 15 client.4284.objecter _session_command_op_remove 2 1 2023-11-05T08:07:10.211 INFO:teuthology.orchestra.run.smithi052.stdout:64424509445 2023-11-05T08:07:10.212 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-05T08:07:10.213 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.061+0000 7f7c4610c640 10 client.4284.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2023-11-05T08:07:10.213 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.061+0000 7f7c4610c640 15 client.4284.objecter _session_command_op_assign -1 2 2023-11-05T08:07:10.213 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.061+0000 7f7c4610c640 20 client.4284.objecter _get_session s=0x7f7c24072540 osd=2 3 2023-11-05T08:07:10.213 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.061+0000 7f7c4610c640 20 client.4284.objecter put_session s=0x7f7c24072540 osd=2 3 2023-11-05T08:07:10.214 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.061+0000 7f7c4610c640 20 client.4284.objecter _get_session s=0x7f7c24072540 osd=2 3 2023-11-05T08:07:10.214 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.061+0000 7f7c4610c640 15 client.4284.objecter _session_command_op_remove -1 2 2023-11-05T08:07:10.214 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.061+0000 7f7c4610c640 20 client.4284.objecter get_session s=0x7f7c24072540 osd=2 3 2023-11-05T08:07:10.214 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.061+0000 7f7c4610c640 15 client.4284.objecter _session_command_op_assign 2 2 2023-11-05T08:07:10.214 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.061+0000 7f7c4610c640 20 client.4284.objecter put_session s=0x7f7c24072540 osd=2 4 2023-11-05T08:07:10.215 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.061+0000 7f7c4610c640 10 client.4284.objecter _send_command 2 2023-11-05T08:07:10.215 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.061+0000 7f7c4610c640 1 -- 172.21.15.52:0/2875222341 --> [v2:172.21.15.52:6800/495294409,v1:172.21.15.52:6801/495294409] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7c400add60 con 0x7f7c24072c10 2023-11-05T08:07:10.215 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.066+0000 7fe53b7fe640 1 -- 172.21.15.52:0/1098459558 <== osd.0 v2:172.21.15.52:6816/61703536 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fe5400756b0 con 0x7fe540072be0 2023-11-05T08:07:10.215 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.066+0000 7fe53b7fe640 10 client.4238.objecter ms_dispatch 0x7fe554000b90 command_reply(tid 1: 0 ) v1 2023-11-05T08:07:10.216 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.066+0000 7fe53b7fe640 10 client.4238.objecter _finish_command 1 = system:0 2023-11-05T08:07:10.216 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.066+0000 7fe53b7fe640 20 client.4238.objecter put_session s=0x7fe540072510 osd=0 4 2023-11-05T08:07:10.216 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.066+0000 7fe53b7fe640 15 client.4238.objecter _session_command_op_remove 0 1 2023-11-05T08:07:10.216 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.067+0000 7f11c57fa640 1 -- 172.21.15.52:0/1817509779 <== osd.5 v2:172.21.15.156:6810/2755763872 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f11b40756b0 con 0x7f11b4072be0 2023-11-05T08:07:10.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.067+0000 7f11c57fa640 10 client.4287.objecter ms_dispatch 0x7f11c8000b90 command_reply(tid 1: 0 ) v1 2023-11-05T08:07:10.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.067+0000 7f11c57fa640 10 client.4287.objecter _finish_command 1 = system:0 2023-11-05T08:07:10.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.067+0000 7f11c57fa640 20 client.4287.objecter put_session s=0x7f11b4072510 osd=5 4 2023-11-05T08:07:10.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.067+0000 7f11c57fa640 15 client.4287.objecter _session_command_op_remove 5 1 2023-11-05T08:07:10.218 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.067+0000 7f7c35ffb640 1 -- 172.21.15.52:0/2875222341 <== osd.2 v2:172.21.15.52:6800/495294409 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7c30001360 con 0x7f7c24072c10 2023-11-05T08:07:10.218 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.067+0000 7f7c35ffb640 10 client.4284.objecter ms_dispatch 0x7f7c40000b90 command_reply(tid 2: 0 ) v1 2023-11-05T08:07:10.218 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.067+0000 7f7c35ffb640 10 client.4284.objecter _finish_command 2 = system:0 2023-11-05T08:07:10.218 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.067+0000 7f7c35ffb640 20 client.4284.objecter put_session s=0x7f7c24072540 osd=2 4 2023-11-05T08:07:10.219 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.067+0000 7f7c35ffb640 15 client.4284.objecter _session_command_op_remove 2 2 2023-11-05T08:07:10.220 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.068+0000 7f7c4610c640 10 librados: watch_flush enter 2023-11-05T08:07:10.220 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.068+0000 7f7c4610c640 10 librados: watch_flush exit 2023-11-05T08:07:10.220 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.068+0000 7f7c4610c640 10 client.4284.objecter close_session for osd.2 2023-11-05T08:07:10.221 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.068+0000 7f7c4610c640 1 -- 172.21.15.52:0/2875222341 >> [v2:172.21.15.52:6800/495294409,v1:172.21.15.52:6801/495294409] conn(0x7f7c24072c10 msgr2=0x7f7c24075030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:10.221 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.068+0000 7f7c4610c640 1 --2- 172.21.15.52:0/2875222341 >> [v2:172.21.15.52:6800/495294409,v1:172.21.15.52:6801/495294409] conn(0x7f7c24072c10 0x7f7c24075030 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:10.221 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.068+0000 7f7c4610c640 20 client.4284.objecter put_session s=0x7f7c24072540 osd=2 1 2023-11-05T08:07:10.221 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.068+0000 7f7c4610c640 20 client.4284.objecter shutdown clearing up homeless session... 2023-11-05T08:07:10.221 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.068+0000 7f7c4610c640 10 client.4284.objecter successfully canceled tick 2023-11-05T08:07:10.222 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.068+0000 7f7c4610c640 1 -- 172.21.15.52:0/2875222341 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f7c2406c830 msgr2=0x7f7c2406ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:10.222 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.068+0000 7f7c4610c640 1 --2- 172.21.15.52:0/2875222341 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f7c2406c830 0x7f7c2406ecf0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7c38036000 tx=0x7f7c38030000 comp rx=0 tx=0).stop 2023-11-05T08:07:10.222 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.068+0000 7f7c4610c640 10 monclient: shutdown 2023-11-05T08:07:10.222 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.068+0000 7f7c4610c640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:07:10.222 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.068+0000 7f7c4610c640 1 -- 172.21.15.52:0/2875222341 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c4013efb0 msgr2=0x7f7c40139920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:10.223 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.068+0000 7f7c4610c640 1 --2- 172.21.15.52:0/2875222341 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c4013efb0 0x7f7c40139920 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c00b410 tx=0x7f7c3c00b8d0 comp rx=0 tx=0).stop 2023-11-05T08:07:10.223 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.068+0000 7f7c4590b640 1 -- 172.21.15.52:0/2875222341 reap_dead start 2023-11-05T08:07:10.223 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.068+0000 7f7c4610c640 1 -- 172.21.15.52:0/2875222341 shutdown_connections 2023-11-05T08:07:10.223 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.068+0000 7f7c4610c640 1 -- 172.21.15.52:0/2875222341 >> 172.21.15.52:0/2875222341 conn(0x7f7c400b7020 msgr2=0x7f7c401417d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:07:10.223 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.068+0000 7f7c4610c640 1 -- 172.21.15.52:0/2875222341 shutdown_connections 2023-11-05T08:07:10.224 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.068+0000 7f7c4610c640 1 -- 172.21.15.52:0/2875222341 wait complete. 2023-11-05T08:07:10.224 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.068+0000 7f7c4610c640 1 librados: shutdown 2023-11-05T08:07:10.224 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.071+0000 7fbec6ffd640 1 -- 172.21.15.52:0/1661704675 <== osd.6 v2:172.21.15.156:6826/2586579514 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fbeb8075700 con 0x7fbeb8072c30 2023-11-05T08:07:10.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.071+0000 7fbec6ffd640 10 client.4278.objecter ms_dispatch 0x7fbed8000b90 command_reply(tid 1: 0 ) v1 2023-11-05T08:07:10.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.071+0000 7fbec6ffd640 10 client.4278.objecter _finish_command 1 = system:0 2023-11-05T08:07:10.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.071+0000 7fbec6ffd640 20 client.4278.objecter put_session s=0x7fbeb8072560 osd=6 4 2023-11-05T08:07:10.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.071+0000 7fbec6ffd640 15 client.4278.objecter _session_command_op_remove 6 1 2023-11-05T08:07:10.226 INFO:teuthology.orchestra.run.smithi052.stdout:64424509446 2023-11-05T08:07:10.227 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-05T08:07:10.227 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.082+0000 7fe5596c2640 10 client.4238.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2023-11-05T08:07:10.228 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.082+0000 7fe5596c2640 15 client.4238.objecter _session_command_op_assign -1 2 2023-11-05T08:07:10.228 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.082+0000 7fe5596c2640 20 client.4238.objecter _get_session s=0x7fe540072510 osd=0 3 2023-11-05T08:07:10.228 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.082+0000 7fe5596c2640 20 client.4238.objecter put_session s=0x7fe540072510 osd=0 3 2023-11-05T08:07:10.228 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.082+0000 7fe5596c2640 20 client.4238.objecter _get_session s=0x7fe540072510 osd=0 3 2023-11-05T08:07:10.228 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.082+0000 7fe5596c2640 15 client.4238.objecter _session_command_op_remove -1 2 2023-11-05T08:07:10.229 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.082+0000 7fe5596c2640 20 client.4238.objecter get_session s=0x7fe540072510 osd=0 3 2023-11-05T08:07:10.229 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.082+0000 7fe5596c2640 15 client.4238.objecter _session_command_op_assign 0 2 2023-11-05T08:07:10.229 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.082+0000 7fe5596c2640 20 client.4238.objecter put_session s=0x7fe540072510 osd=0 4 2023-11-05T08:07:10.229 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.082+0000 7fe5596c2640 10 client.4238.objecter _send_command 2 2023-11-05T08:07:10.229 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.082+0000 7fe5596c2640 1 -- 172.21.15.52:0/1098459558 --> [v2:172.21.15.52:6816/61703536,v1:172.21.15.52:6817/61703536] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe55404e9f0 con 0x7fe540072be0 2023-11-05T08:07:10.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.088+0000 7fe53b7fe640 1 -- 172.21.15.52:0/1098459558 <== osd.0 v2:172.21.15.52:6816/61703536 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe55404e9f0 con 0x7fe540072be0 2023-11-05T08:07:10.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.088+0000 7fe53b7fe640 10 client.4238.objecter ms_dispatch 0x7fe554000b90 command_reply(tid 2: 0 ) v1 2023-11-05T08:07:10.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.088+0000 7fe53b7fe640 10 client.4238.objecter _finish_command 2 = system:0 2023-11-05T08:07:10.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.088+0000 7fe53b7fe640 20 client.4238.objecter put_session s=0x7fe540072510 osd=0 4 2023-11-05T08:07:10.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.088+0000 7fe53b7fe640 15 client.4238.objecter _session_command_op_remove 0 2 2023-11-05T08:07:10.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.088+0000 7fe5596c2640 10 librados: watch_flush enter 2023-11-05T08:07:10.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.088+0000 7fe5596c2640 10 librados: watch_flush exit 2023-11-05T08:07:10.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.088+0000 7fe5596c2640 10 client.4238.objecter close_session for osd.0 2023-11-05T08:07:10.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.088+0000 7fe5596c2640 1 -- 172.21.15.52:0/1098459558 >> [v2:172.21.15.52:6816/61703536,v1:172.21.15.52:6817/61703536] conn(0x7fe540072be0 msgr2=0x7fe540075000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:10.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.088+0000 7fe5596c2640 1 --2- 172.21.15.52:0/1098459558 >> [v2:172.21.15.52:6816/61703536,v1:172.21.15.52:6817/61703536] conn(0x7fe540072be0 0x7fe540075000 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:10.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.088+0000 7fe5596c2640 20 client.4238.objecter put_session s=0x7fe540072510 osd=0 1 2023-11-05T08:07:10.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.088+0000 7fe5596c2640 20 client.4238.objecter shutdown clearing up homeless session... 2023-11-05T08:07:10.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.088+0000 7fe5596c2640 10 client.4238.objecter successfully canceled tick 2023-11-05T08:07:10.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.088+0000 7fe5596c2640 1 -- 172.21.15.52:0/1098459558 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7fe54006c800 msgr2=0x7fe54006ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:10.234 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.088+0000 7fe5596c2640 1 --2- 172.21.15.52:0/1098459558 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7fe54006c800 0x7fe54006ecc0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe554066320 tx=0x7fe548009040 comp rx=0 tx=0).stop 2023-11-05T08:07:10.234 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.088+0000 7fe5596c2640 10 monclient: shutdown 2023-11-05T08:07:10.234 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.088+0000 7fe5596c2640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:07:10.234 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.088+0000 7fe5596c2640 1 -- 172.21.15.52:0/1098459558 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe5540ade00 msgr2=0x7fe55413e470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:10.234 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.088+0000 7fe5596c2640 1 --2- 172.21.15.52:0/1098459558 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe5540ade00 0x7fe55413e470 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe54400b410 tx=0x7fe54400b8d0 comp rx=0 tx=0).stop 2023-11-05T08:07:10.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.088+0000 7fe5537fe640 1 -- 172.21.15.52:0/1098459558 reap_dead start 2023-11-05T08:07:10.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.089+0000 7fe5596c2640 1 -- 172.21.15.52:0/1098459558 shutdown_connections 2023-11-05T08:07:10.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.089+0000 7fe5596c2640 1 -- 172.21.15.52:0/1098459558 >> 172.21.15.52:0/1098459558 conn(0x7fe554065cd0 msgr2=0x7fe5540b7990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:07:10.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.089+0000 7fe5596c2640 1 -- 172.21.15.52:0/1098459558 shutdown_connections 2023-11-05T08:07:10.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.089+0000 7fe5596c2640 1 -- 172.21.15.52:0/1098459558 wait complete. 2023-11-05T08:07:10.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.089+0000 7fe5596c2640 1 librados: shutdown 2023-11-05T08:07:10.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.095+0000 7f11cdb67640 10 client.4287.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2023-11-05T08:07:10.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.095+0000 7f11cdb67640 15 client.4287.objecter _session_command_op_assign -1 2 2023-11-05T08:07:10.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.095+0000 7f11cdb67640 20 client.4287.objecter _get_session s=0x7f11b4072510 osd=5 3 2023-11-05T08:07:10.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.095+0000 7f11cdb67640 20 client.4287.objecter put_session s=0x7f11b4072510 osd=5 3 2023-11-05T08:07:10.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.095+0000 7f11cdb67640 20 client.4287.objecter _get_session s=0x7f11b4072510 osd=5 3 2023-11-05T08:07:10.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.095+0000 7f11cdb67640 15 client.4287.objecter _session_command_op_remove -1 2 2023-11-05T08:07:10.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.095+0000 7f11cdb67640 20 client.4287.objecter get_session s=0x7f11b4072510 osd=5 3 2023-11-05T08:07:10.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.095+0000 7f11cdb67640 15 client.4287.objecter _session_command_op_assign 5 2 2023-11-05T08:07:10.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.095+0000 7f11cdb67640 20 client.4287.objecter put_session s=0x7f11b4072510 osd=5 4 2023-11-05T08:07:10.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.095+0000 7f11cdb67640 10 client.4287.objecter _send_command 2 2023-11-05T08:07:10.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.095+0000 7f11cdb67640 1 -- 172.21.15.52:0/1817509779 --> [v2:172.21.15.156:6810/2755763872,v1:172.21.15.156:6811/2755763872] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f11c8149f60 con 0x7f11b4072be0 2023-11-05T08:07:10.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.099+0000 7fbedc973640 10 client.4278.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2023-11-05T08:07:10.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.099+0000 7fbedc973640 15 client.4278.objecter _session_command_op_assign -1 2 2023-11-05T08:07:10.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.099+0000 7fbedc973640 20 client.4278.objecter _get_session s=0x7fbeb8072560 osd=6 3 2023-11-05T08:07:10.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.099+0000 7fbedc973640 20 client.4278.objecter put_session s=0x7fbeb8072560 osd=6 3 2023-11-05T08:07:10.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.099+0000 7fbedc973640 20 client.4278.objecter _get_session s=0x7fbeb8072560 osd=6 3 2023-11-05T08:07:10.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.099+0000 7fbedc973640 15 client.4278.objecter _session_command_op_remove -1 2 2023-11-05T08:07:10.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.099+0000 7fbedc973640 20 client.4278.objecter get_session s=0x7fbeb8072560 osd=6 3 2023-11-05T08:07:10.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.099+0000 7fbedc973640 15 client.4278.objecter _session_command_op_assign 6 2 2023-11-05T08:07:10.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.099+0000 7fbedc973640 20 client.4278.objecter put_session s=0x7fbeb8072560 osd=6 4 2023-11-05T08:07:10.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.099+0000 7fbedc973640 10 client.4278.objecter _send_command 2 2023-11-05T08:07:10.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.099+0000 7fbedc973640 1 -- 172.21.15.52:0/1661704675 --> [v2:172.21.15.156:6826/2586579514,v1:172.21.15.156:6827/2586579514] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbed00c56d0 con 0x7fbeb8072c30 2023-11-05T08:07:10.242 INFO:teuthology.orchestra.run.smithi052.stdout:68719476742 2023-11-05T08:07:10.242 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-05T08:07:10.243 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.103+0000 7f11c57fa640 1 -- 172.21.15.52:0/1817509779 <== osd.5 v2:172.21.15.156:6810/2755763872 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f11c0009a70 con 0x7f11b4072be0 2023-11-05T08:07:10.243 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.103+0000 7f11c57fa640 10 client.4287.objecter ms_dispatch 0x7f11c8000b90 command_reply(tid 2: 0 ) v1 2023-11-05T08:07:10.243 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.103+0000 7f11c57fa640 10 client.4287.objecter _finish_command 2 = system:0 2023-11-05T08:07:10.244 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.103+0000 7f11c57fa640 20 client.4287.objecter put_session s=0x7f11b4072510 osd=5 4 2023-11-05T08:07:10.244 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.103+0000 7f11c57fa640 15 client.4287.objecter _session_command_op_remove 5 2 2023-11-05T08:07:10.245 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.103+0000 7f11cdb67640 10 librados: watch_flush enter 2023-11-05T08:07:10.246 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.103+0000 7f11cdb67640 10 librados: watch_flush exit 2023-11-05T08:07:10.246 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.103+0000 7f11cdb67640 10 client.4287.objecter close_session for osd.5 2023-11-05T08:07:10.246 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.103+0000 7f11cdb67640 1 -- 172.21.15.52:0/1817509779 >> [v2:172.21.15.156:6810/2755763872,v1:172.21.15.156:6811/2755763872] conn(0x7f11b4072be0 msgr2=0x7f11b4075000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:10.246 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.103+0000 7f11cdb67640 1 --2- 172.21.15.52:0/1817509779 >> [v2:172.21.15.156:6810/2755763872,v1:172.21.15.156:6811/2755763872] conn(0x7f11b4072be0 0x7f11b4075000 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:10.246 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.103+0000 7f11cdb67640 20 client.4287.objecter put_session s=0x7f11b4072510 osd=5 1 2023-11-05T08:07:10.247 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.103+0000 7f11cdb67640 20 client.4287.objecter shutdown clearing up homeless session... 2023-11-05T08:07:10.247 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.103+0000 7f11cdb67640 10 client.4287.objecter successfully canceled tick 2023-11-05T08:07:10.247 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.103+0000 7f11cdb67640 1 -- 172.21.15.52:0/1817509779 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f11b406c800 msgr2=0x7f11b406ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:10.247 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.103+0000 7f11cdb67640 1 --2- 172.21.15.52:0/1817509779 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f11b406c800 0x7f11b406ecc0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f11b8036000 tx=0x7f11b8008030 comp rx=0 tx=0).stop 2023-11-05T08:07:10.247 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.103+0000 7f11cdb67640 10 monclient: shutdown 2023-11-05T08:07:10.248 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.103+0000 7f11cdb67640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:07:10.248 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.103+0000 7f11cdb67640 1 -- 172.21.15.52:0/1817509779 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f11c806d930 msgr2=0x7f11c813af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:10.248 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.103+0000 7f11cdb67640 1 --2- 172.21.15.52:0/1817509779 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f11c806d930 0x7f11c813af50 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f11bc00c4a0 tx=0x7f11bc00c960 comp rx=0 tx=0).stop 2023-11-05T08:07:10.248 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.103+0000 7f11cd366640 1 -- 172.21.15.52:0/1817509779 reap_dead start 2023-11-05T08:07:10.248 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.103+0000 7f11cdb67640 1 -- 172.21.15.52:0/1817509779 shutdown_connections 2023-11-05T08:07:10.249 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.103+0000 7f11cdb67640 1 -- 172.21.15.52:0/1817509779 >> 172.21.15.52:0/1817509779 conn(0x7f11c80b30c0 msgr2=0x7f11c81406d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:07:10.249 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.103+0000 7f11cdb67640 1 -- 172.21.15.52:0/1817509779 shutdown_connections 2023-11-05T08:07:10.249 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.103+0000 7f11cdb67640 1 -- 172.21.15.52:0/1817509779 wait complete. 2023-11-05T08:07:10.249 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.103+0000 7f11cdb67640 1 librados: shutdown 2023-11-05T08:07:10.250 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.110+0000 7fbec6ffd640 1 -- 172.21.15.52:0/1661704675 <== osd.6 v2:172.21.15.156:6826/2586579514 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fbecc007090 con 0x7fbeb8072c30 2023-11-05T08:07:10.250 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.110+0000 7fbec6ffd640 10 client.4278.objecter ms_dispatch 0x7fbed8000b90 command_reply(tid 2: 0 ) v1 2023-11-05T08:07:10.250 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.110+0000 7fbec6ffd640 10 client.4278.objecter _finish_command 2 = system:0 2023-11-05T08:07:10.250 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.110+0000 7fbec6ffd640 20 client.4278.objecter put_session s=0x7fbeb8072560 osd=6 4 2023-11-05T08:07:10.250 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.110+0000 7fbec6ffd640 15 client.4278.objecter _session_command_op_remove 6 2 2023-11-05T08:07:10.252 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.110+0000 7fbedc973640 10 librados: watch_flush enter 2023-11-05T08:07:10.252 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.110+0000 7fbedc973640 10 librados: watch_flush exit 2023-11-05T08:07:10.252 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.110+0000 7fbedc973640 10 client.4278.objecter close_session for osd.6 2023-11-05T08:07:10.253 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.110+0000 7fbedc973640 1 -- 172.21.15.52:0/1661704675 >> [v2:172.21.15.156:6826/2586579514,v1:172.21.15.156:6827/2586579514] conn(0x7fbeb8072c30 msgr2=0x7fbeb8075050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:10.253 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.110+0000 7fbedc973640 1 --2- 172.21.15.52:0/1661704675 >> [v2:172.21.15.156:6826/2586579514,v1:172.21.15.156:6827/2586579514] conn(0x7fbeb8072c30 0x7fbeb8075050 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:10.253 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.110+0000 7fbedc973640 20 client.4278.objecter put_session s=0x7fbeb8072560 osd=6 1 2023-11-05T08:07:10.253 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.110+0000 7fbedc973640 20 client.4278.objecter shutdown clearing up homeless session... 2023-11-05T08:07:10.253 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.110+0000 7fbedc973640 10 client.4278.objecter successfully canceled tick 2023-11-05T08:07:10.254 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.110+0000 7fbedc973640 1 -- 172.21.15.52:0/1661704675 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7fbeb806c850 msgr2=0x7fbeb806ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:10.254 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.110+0000 7fbedc973640 1 --2- 172.21.15.52:0/1661704675 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7fbeb806c850 0x7fbeb806ed10 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fbed0032f40 tx=0x7fbec8009110 comp rx=0 tx=0).stop 2023-11-05T08:07:10.254 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.110+0000 7fbedc973640 10 monclient: shutdown 2023-11-05T08:07:10.254 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.110+0000 7fbedc973640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:07:10.255 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.110+0000 7fbedc973640 1 -- 172.21.15.52:0/1661704675 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbed00070e0 msgr2=0x7fbed002d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:10.255 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.110+0000 7fbedc973640 1 --2- 172.21.15.52:0/1661704675 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbed00070e0 0x7fbed002d7f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fbed8079f30 tx=0x7fbed8068750 comp rx=0 tx=0).stop 2023-11-05T08:07:10.255 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.110+0000 7fbed6d9d640 1 -- 172.21.15.52:0/1661704675 reap_dead start 2023-11-05T08:07:10.255 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.110+0000 7fbedc973640 1 -- 172.21.15.52:0/1661704675 shutdown_connections 2023-11-05T08:07:10.255 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.110+0000 7fbedc973640 1 -- 172.21.15.52:0/1661704675 >> 172.21.15.52:0/1661704675 conn(0x7fbed0006030 msgr2=0x7fbed0004de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:07:10.256 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.110+0000 7fbedc973640 1 -- 172.21.15.52:0/1661704675 shutdown_connections 2023-11-05T08:07:10.256 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.110+0000 7fbedc973640 1 -- 172.21.15.52:0/1661704675 wait complete. 2023-11-05T08:07:10.256 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.110+0000 7fbedc973640 1 librados: shutdown 2023-11-05T08:07:10.257 INFO:teuthology.orchestra.run.smithi052.stdout:60129542149 2023-11-05T08:07:10.257 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-05T08:07:10.258 INFO:teuthology.orchestra.run.smithi052.stdout:55834574852 2023-11-05T08:07:10.259 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-05T08:07:10.347 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.344+0000 7f009fe9b640 10 monclient: get_monmap_and_config 2023-11-05T08:07:10.347 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.344+0000 7f009fe9b640 10 monclient: build_initial_monmap 2023-11-05T08:07:10.347 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.344+0000 7f009fe9b640 10 monclient: monmap: 2023-11-05T08:07:10.348 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:07:10.348 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:10.348 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:07:10.345976+0000 2023-11-05T08:07:10.348 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:07:10.345976+0000 2023-11-05T08:07:10.348 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:07:10.349 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:10.349 INFO:teuthology.orchestra.run.smithi052.stderr:0: v1:172.21.15.52:6789/0 mon.noname-a-legacy 2023-11-05T08:07:10.349 INFO:teuthology.orchestra.run.smithi052.stderr:1: v1:172.21.15.156:6789/0 mon.noname-c-legacy 2023-11-05T08:07:10.349 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-b 2023-11-05T08:07:10.349 INFO:teuthology.orchestra.run.smithi052.stderr:3: v2:172.21.15.52:3300/0 mon.noname-a 2023-11-05T08:07:10.349 INFO:teuthology.orchestra.run.smithi052.stderr:4: v2:172.21.15.156:3300/0 mon.noname-c 2023-11-05T08:07:10.350 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:10.350 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.345+0000 7f009fe9b640 1 Processor -- start 2023-11-05T08:07:10.350 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.346+0000 7f009fe9b640 1 -- start start 2023-11-05T08:07:10.351 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.346+0000 7f009fe9b640 10 monclient: init 2023-11-05T08:07:10.353 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.347+0000 7f009fe9b640 10 monclient: _reopen_session rank -1 2023-11-05T08:07:10.357 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.347+0000 7f009fe9b640 10 monclient: _add_conns ranks=[2,1,4,3,0] 2023-11-05T08:07:10.357 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.347+0000 7f009fe9b640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f00980ae970 0x7f00980a6350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:10.357 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.347+0000 7f009fe9b640 10 monclient(hunting): picked mon.noname-b con 0x7f00980ae970 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:07:10.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.347+0000 7f009fe9b640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f009806b090 addr v1:172.21.15.156:6789/0 2023-11-05T08:07:10.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.347+0000 7f009fe9b640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f00980ab790 0x7f00981415a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:10.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.347+0000 7f009fe9b640 10 monclient(hunting): picked mon.noname-c con 0x7f00980ab790 addr v2:172.21.15.156:3300/0 2023-11-05T08:07:10.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.347+0000 7f009fe9b640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00980a68c0 con 0x7f009806b090 2023-11-05T08:07:10.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.347+0000 7f009fe9b640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:10.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.347+0000 7f009fe9b640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00980af190 con 0x7f00980ab790 2023-11-05T08:07:10.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.347+0000 7f009fe9b640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:10.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.347+0000 7f009fe9b640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00980aed50 con 0x7f00980ae970 2023-11-05T08:07:10.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.347+0000 7f009fe9b640 10 monclient(hunting): _renew_subs 2023-11-05T08:07:10.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.347+0000 7f009fe9b640 10 monclient(hunting): authenticate will time out at 1376.553337s 2023-11-05T08:07:10.360 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.349+0000 7f009d436640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f009806b090 0x7f00980ab080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.52:35450/0 (socket says 172.21.15.52:35450) 2023-11-05T08:07:10.360 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.349+0000 7f009d436640 1 -- 172.21.15.52:0/1766171526 learned_addr learned my addr 172.21.15.52:0/1766171526 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-11-05T08:07:10.360 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.349+0000 7f009dc37640 1 --2- 172.21.15.52:0/1766171526 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f00980ae970 0x7f00980a6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:10.360 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.350+0000 7f009dc37640 10 monclient(hunting): get_auth_request con 0x7f00980ae970 auth_method 0 2023-11-05T08:07:10.360 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.350+0000 7f009dc37640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:10.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.350+0000 7f009dc37640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:10.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.350+0000 7f009dc37640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:10.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.352+0000 7f009dc37640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:10.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.352+0000 7f009dc37640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:10.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.352+0000 7f009dc37640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:10.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.357+0000 7f009dc37640 10 monclient(hunting): handle_auth_done global_id 4244 payload 274 2023-11-05T08:07:10.363 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.357+0000 7f009dc37640 1 -- 172.21.15.52:0/1766171526 >> v2:172.21.15.156:3300/0 conn(0x7f00980ab790 msgr2=0x7f00981415a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-05T08:07:10.363 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.357+0000 7f009dc37640 1 --2- 172.21.15.52:0/1766171526 >> v2:172.21.15.156:3300/0 conn(0x7f00980ab790 0x7f00981415a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:10.363 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.357+0000 7f009dc37640 1 -- 172.21.15.52:0/1766171526 >> v1:172.21.15.156:6789/0 conn(0x7f009806b090 legacy=0x7f00980ab080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:10.363 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.357+0000 7f009dc37640 10 monclient: _finish_hunting 0 2023-11-05T08:07:10.364 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.357+0000 7f009dc37640 1 monclient: found mon.noname-b 2023-11-05T08:07:10.364 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.357+0000 7f009dc37640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:07:10.364 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.357+0000 7f009dc37640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.52:3301/0 2023-11-05T08:07:10.364 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.357+0000 7f009dc37640 1 -- 172.21.15.52:0/1766171526 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00980af5e0 con 0x7f00980ae970 2023-11-05T08:07:10.364 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.359+0000 7f8f726a9640 10 monclient: get_monmap_and_config 2023-11-05T08:07:10.365 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.359+0000 7f8f726a9640 10 monclient: build_initial_monmap 2023-11-05T08:07:10.365 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.359+0000 7f8f726a9640 10 monclient: monmap: 2023-11-05T08:07:10.365 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:07:10.365 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:10.365 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:07:10.360806+0000 2023-11-05T08:07:10.366 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:07:10.360806+0000 2023-11-05T08:07:10.366 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:07:10.366 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:10.366 INFO:teuthology.orchestra.run.smithi052.stderr:0: v1:172.21.15.52:6789/0 mon.noname-a-legacy 2023-11-05T08:07:10.366 INFO:teuthology.orchestra.run.smithi052.stderr:1: v1:172.21.15.156:6789/0 mon.noname-c-legacy 2023-11-05T08:07:10.367 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-b 2023-11-05T08:07:10.367 INFO:teuthology.orchestra.run.smithi052.stderr:3: v2:172.21.15.52:3300/0 mon.noname-a 2023-11-05T08:07:10.367 INFO:teuthology.orchestra.run.smithi052.stderr:4: v2:172.21.15.156:3300/0 mon.noname-c 2023-11-05T08:07:10.367 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:10.368 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.360+0000 7f009dc37640 1 --2- 172.21.15.52:0/1766171526 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f00980ae970 0x7f00980a6350 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0094008260 tx=0x7f009402dd00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa2376fb54259143 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:10.370 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.362+0000 7f8f726a9640 1 Processor -- start 2023-11-05T08:07:10.370 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.362+0000 7f8f726a9640 1 -- start start 2023-11-05T08:07:10.370 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.362+0000 7f8f726a9640 10 monclient: init 2023-11-05T08:07:10.370 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.363+0000 7f8f726a9640 10 monclient: _reopen_session rank -1 2023-11-05T08:07:10.370 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.363+0000 7f8f726a9640 10 monclient: _add_conns ranks=[3,4,1,2,0] 2023-11-05T08:07:10.371 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.363+0000 7f8f726a9640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8f6c0a8fe0 0x7f8f6c0a93c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:10.371 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.363+0000 7f8f726a9640 10 monclient(hunting): picked mon.noname-a con 0x7f8f6c0a8fe0 addr v2:172.21.15.52:3300/0 2023-11-05T08:07:10.371 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.363+0000 7f8f726a9640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f8f6c0aa160 0x7f8f6c13b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:10.371 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.363+0000 7f8f726a9640 10 monclient(hunting): picked mon.noname-c con 0x7f8f6c0aa160 addr v2:172.21.15.156:3300/0 2023-11-05T08:07:10.371 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.363+0000 7f8f726a9640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f8f6c13bee0 addr v1:172.21.15.156:6789/0 2023-11-05T08:07:10.372 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.363+0000 7f8f726a9640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f6c0adff0 con 0x7f8f6c13bee0 2023-11-05T08:07:10.372 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.363+0000 7f8f726a9640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:10.372 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.363+0000 7f8f726a9640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f6c13c310 con 0x7f8f6c0a8fe0 2023-11-05T08:07:10.372 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.363+0000 7f8f726a9640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:10.372 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.363+0000 7f8f726a9640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f6c0ab250 con 0x7f8f6c0aa160 2023-11-05T08:07:10.373 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.363+0000 7f8f726a9640 10 monclient(hunting): _renew_subs 2023-11-05T08:07:10.373 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.363+0000 7f8f726a9640 10 monclient(hunting): authenticate will time out at 1376.569625s 2023-11-05T08:07:10.373 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.364+0000 7f8f6bfff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8f6c0a8fe0 0x7f8f6c0a93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:10.373 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.365+0000 7f8f70c46640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f8f6c13bee0 0x7f8f6c141ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.52:35456/0 (socket says 172.21.15.52:35456) 2023-11-05T08:07:10.373 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.365+0000 7f8f70c46640 1 -- 172.21.15.52:0/3771339035 learned_addr learned my addr 172.21.15.52:0/3771339035 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-11-05T08:07:10.374 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.365+0000 7f8f6b7fe640 1 --2- 172.21.15.52:0/3771339035 >> v2:172.21.15.156:3300/0 conn(0x7f8f6c0aa160 0x7f8f6c13b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:10.374 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.365+0000 7f8f6b7fe640 10 monclient(hunting): get_auth_request con 0x7f8f6c0aa160 auth_method 0 2023-11-05T08:07:10.374 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.365+0000 7f8f6b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:10.374 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.365+0000 7f8f6b7fe640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:10.374 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.365+0000 7f8f6b7fe640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:10.375 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.365+0000 7f8f6bfff640 10 monclient(hunting): get_auth_request con 0x7f8f6c0a8fe0 auth_method 0 2023-11-05T08:07:10.375 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.365+0000 7f8f6bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:10.375 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.366+0000 7f8f6bfff640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:10.375 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.366+0000 7f8f6bfff640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:10.375 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.367+0000 7f8f6bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:10.375 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.367+0000 7f8f6bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:10.376 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.367+0000 7f8f6bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:10.377 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.369+0000 7f8f6b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:10.377 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.369+0000 7f8f6b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:10.378 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.369+0000 7f8f6b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:10.378 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.371+0000 7f8f6b7fe640 10 monclient(hunting): handle_auth_done global_id 4336 payload 274 2023-11-05T08:07:10.378 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.371+0000 7f8f6b7fe640 1 -- 172.21.15.52:0/3771339035 >> v2:172.21.15.52:3300/0 conn(0x7f8f6c0a8fe0 msgr2=0x7f8f6c0a93c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-05T08:07:10.378 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.371+0000 7f8f6b7fe640 1 --2- 172.21.15.52:0/3771339035 >> v2:172.21.15.52:3300/0 conn(0x7f8f6c0a8fe0 0x7f8f6c0a93c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:10.378 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.371+0000 7f8f6b7fe640 1 -- 172.21.15.52:0/3771339035 >> v1:172.21.15.156:6789/0 conn(0x7f8f6c13bee0 legacy=0x7f8f6c141ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:10.379 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.371+0000 7f8f6b7fe640 10 monclient: _finish_hunting 0 2023-11-05T08:07:10.379 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.371+0000 7f8f6b7fe640 1 monclient: found mon.noname-c 2023-11-05T08:07:10.379 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.371+0000 7f8f6b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:07:10.379 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.371+0000 7f8f6b7fe640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.156:3300/0 2023-11-05T08:07:10.379 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.371+0000 7f8f6b7fe640 1 -- 172.21.15.52:0/3771339035 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f6c0ae240 con 0x7f8f6c0aa160 2023-11-05T08:07:10.380 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.377+0000 7f8f6b7fe640 1 --2- 172.21.15.52:0/3771339035 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f6c0aa160 0x7f8f6c13b9a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c0a8ce0 tx=0x7f8f64030310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f96cc4f7c23fa9ac server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:10.385 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.384+0000 7f8f6affd640 1 -- 172.21.15.52:0/3771339035 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f64038640 con 0x7f8f6c0aa160 2023-11-05T08:07:10.386 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.384+0000 7f8f6affd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:10.386 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.384+0000 7f8f6affd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-11-05T08:07:10.386 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.384+0000 7f8f6affd640 10 monclient: dump: 2023-11-05T08:07:10.386 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:10.386 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:10.387 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:10.387 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:10.387 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:10.387 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:10.387 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:10.388 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:10.388 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:10.388 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:10.388 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.384+0000 7f8f6affd640 10 monclient: _finish_auth 0 2023-11-05T08:07:10.388 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.384+0000 7f8f6affd640 10 monclient: _check_auth_tickets 2023-11-05T08:07:10.388 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.384+0000 7f8f6affd640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:07:10.389 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.384+0000 7f8f6affd640 1 -- 172.21.15.52:0/3771339035 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f640387a0 con 0x7f8f6c0aa160 2023-11-05T08:07:10.389 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.384+0000 7f8f726a9640 5 monclient: authenticate success, global_id 4336 2023-11-05T08:07:10.389 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.384+0000 7f8f726a9640 20 monclient: get_monmap_and_config waiting for monmap|config 2023-11-05T08:07:10.389 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.384+0000 7f8f6affd640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:07:10.389 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.384+0000 7f8f6affd640 1 -- 172.21.15.52:0/3771339035 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f64038b70 con 0x7f8f6c0aa160 2023-11-05T08:07:10.390 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.384+0000 7f8f726a9640 10 monclient: get_monmap_and_config success 2023-11-05T08:07:10.390 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.384+0000 7f8f726a9640 4 set_mon_vals no callback set 2023-11-05T08:07:10.393 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.385+0000 7f8f726a9640 10 monclient: shutdown 2023-11-05T08:07:10.393 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.385+0000 7f8f726a9640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:07:10.393 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.385+0000 7f8f726a9640 1 -- 172.21.15.52:0/3771339035 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f6c0aa160 msgr2=0x7f8f6c13b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:10.393 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.385+0000 7f8f726a9640 1 --2- 172.21.15.52:0/3771339035 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f6c0aa160 0x7f8f6c13b9a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c0a8ce0 tx=0x7f8f64030310 comp rx=0 tx=0).stop 2023-11-05T08:07:10.394 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.385+0000 7f8f6affd640 10 monclient: discarding stray monitor message mon_map magic: 0 v1 2023-11-05T08:07:10.394 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.386+0000 7f8f726a9640 1 -- 172.21.15.52:0/3771339035 shutdown_connections 2023-11-05T08:07:10.394 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.386+0000 7f8f726a9640 1 --2- 172.21.15.52:0/3771339035 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f6c0aa160 0x7f8f6c13b9a0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:10.394 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.386+0000 7f8f726a9640 1 --2- 172.21.15.52:0/3771339035 >> v2:172.21.15.52:3300/0 conn(0x7f8f6c0a8fe0 0x7f8f6c0a93c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:10.394 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.386+0000 7f8f726a9640 1 -- 172.21.15.52:0/3771339035 >> 172.21.15.52:0/3771339035 conn(0x7f8f6c0b0b90 msgr2=0x7f8f6c0b0fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:07:10.395 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.386+0000 7f8f726a9640 1 -- 172.21.15.52:0/3771339035 shutdown_connections 2023-11-05T08:07:10.395 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.386+0000 7f8f726a9640 1 -- 172.21.15.52:0/3771339035 wait complete. 2023-11-05T08:07:10.395 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.387+0000 7f8f726a9640 10 monclient: build_initial_monmap 2023-11-05T08:07:10.395 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.387+0000 7f8f726a9640 10 monclient: monmap: 2023-11-05T08:07:10.395 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:07:10.396 INFO:teuthology.orchestra.run.smithi052.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-05T08:07:10.396 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 0.000000 2023-11-05T08:07:10.396 INFO:teuthology.orchestra.run.smithi052.stderr:created 0.000000 2023-11-05T08:07:10.396 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:07:10.396 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:10.397 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.noname-a 2023-11-05T08:07:10.397 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.noname-b 2023-11-05T08:07:10.397 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-c 2023-11-05T08:07:10.397 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:10.397 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.388+0000 7f8f726a9640 1 librados: starting msgr at 2023-11-05T08:07:10.397 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.388+0000 7f8f726a9640 1 librados: starting objecter 2023-11-05T08:07:10.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.388+0000 7f8f726a9640 1 Processor -- start 2023-11-05T08:07:10.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.389+0000 7f8f726a9640 1 -- start start 2023-11-05T08:07:10.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.389+0000 7f8f726a9640 1 librados: setting wanted keys 2023-11-05T08:07:10.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.389+0000 7f8f726a9640 1 librados: calling monclient init 2023-11-05T08:07:10.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.389+0000 7f8f726a9640 10 monclient: init 2023-11-05T08:07:10.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.390+0000 7f8f726a9640 10 monclient: _reopen_session rank -1 2023-11-05T08:07:10.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.390+0000 7f8f726a9640 10 monclient: _add_conns ranks=[1,0,2] 2023-11-05T08:07:10.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.390+0000 7f8f726a9640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f6c0a8fe0 0x7f8f6c0b1d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:10.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.390+0000 7f8f726a9640 10 monclient(hunting): picked mon.noname-b con 0x7f8f6c0a8fe0 addr [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] 2023-11-05T08:07:10.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.391+0000 7f8f726a9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f6c0aa160 0x7f8f6c1d2910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:10.400 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.391+0000 7f8f726a9640 10 monclient(hunting): picked mon.noname-a con 0x7f8f6c0aa160 addr [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] 2023-11-05T08:07:10.400 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.391+0000 7f8f726a9640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8f6c13bee0 0x7f8f6c0acae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:10.400 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.391+0000 7f8f726a9640 10 monclient(hunting): picked mon.noname-c con 0x7f8f6c13bee0 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:07:10.403 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.393+0000 7f8f6bfff640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f6c0a8fe0 0x7f8f6c0b1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:10.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.393+0000 7f8f6bfff640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f6c0a8fe0 0x7f8f6c0b1d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.52:58998/0 (socket says 172.21.15.52:58998) 2023-11-05T08:07:10.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.393+0000 7f8f6bfff640 1 -- 172.21.15.52:0/2821365872 learned_addr learned my addr 172.21.15.52:0/2821365872 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-11-05T08:07:10.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.394+0000 7f8f6b7fe640 1 --2- 172.21.15.52:0/2821365872 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f6c0aa160 0x7f8f6c1d2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:10.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.394+0000 7f8f70c46640 1 --2- 172.21.15.52:0/2821365872 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8f6c13bee0 0x7f8f6c0acae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:10.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.394+0000 7f8f726a9640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:10.405 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.394+0000 7f8f726a9640 1 -- 172.21.15.52:0/2821365872 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f6c1d2480 con 0x7f8f6c0aa160 2023-11-05T08:07:10.405 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.394+0000 7f8f726a9640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:10.405 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.394+0000 7f8f726a9640 1 -- 172.21.15.52:0/2821365872 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f6c1d2110 con 0x7f8f6c0a8fe0 2023-11-05T08:07:10.405 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.395+0000 7f8f726a9640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:10.405 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.395+0000 7f8f726a9640 1 -- 172.21.15.52:0/2821365872 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f6c1d2e50 con 0x7f8f6c13bee0 2023-11-05T08:07:10.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.395+0000 7f8f726a9640 10 monclient(hunting): _renew_subs 2023-11-05T08:07:10.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.395+0000 7f8f726a9640 10 monclient(hunting): authenticate will time out at 1376.601138s 2023-11-05T08:07:10.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.395+0000 7f8f6bfff640 10 monclient(hunting): get_auth_request con 0x7f8f6c0a8fe0 auth_method 0 2023-11-05T08:07:10.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.395+0000 7f8f6bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:10.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.395+0000 7f8f6bfff640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:10.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.395+0000 7f8f6bfff640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:10.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.395+0000 7f8f6b7fe640 10 monclient(hunting): get_auth_request con 0x7f8f6c0aa160 auth_method 0 2023-11-05T08:07:10.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.395+0000 7f8f6b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:10.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.395+0000 7f8f6b7fe640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:10.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.395+0000 7f8f6b7fe640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:10.408 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.395+0000 7f8f70c46640 10 monclient(hunting): get_auth_request con 0x7f8f6c13bee0 auth_method 0 2023-11-05T08:07:10.408 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.396+0000 7f8f70c46640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:10.408 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.396+0000 7f8f70c46640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:10.408 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.396+0000 7f8f70c46640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:10.408 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.396+0000 7f8f6bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:10.408 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.397+0000 7f8f6bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:10.409 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.397+0000 7f8f6bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:10.409 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.397+0000 7f8f6b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:10.409 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.398+0000 7f8f6b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:10.409 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.398+0000 7f8f6b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:10.409 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.398+0000 7f8f70c46640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:10.410 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.398+0000 7f8f70c46640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:10.410 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.398+0000 7f8f70c46640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:10.411 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.403+0000 7f8f6bfff640 10 monclient(hunting): handle_auth_done global_id 4339 payload 824 2023-11-05T08:07:10.411 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.403+0000 7f8f6bfff640 1 -- 172.21.15.52:0/2821365872 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8f6c13bee0 msgr2=0x7f8f6c0acae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:10.412 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.403+0000 7f8f6bfff640 1 --2- 172.21.15.52:0/2821365872 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8f6c13bee0 0x7f8f6c0acae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:10.412 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.403+0000 7f8f6bfff640 1 -- 172.21.15.52:0/2821365872 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f6c0aa160 msgr2=0x7f8f6c1d2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:10.412 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.403+0000 7f8f6bfff640 1 --2- 172.21.15.52:0/2821365872 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f6c0aa160 0x7f8f6c1d2910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:10.412 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.403+0000 7f8f6bfff640 10 monclient: _finish_hunting 0 2023-11-05T08:07:10.412 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.403+0000 7f8f6bfff640 1 monclient: found mon.noname-b 2023-11-05T08:07:10.413 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.403+0000 7f8f6bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:07:10.413 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.403+0000 7f8f6bfff640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.156:3300/0 2023-11-05T08:07:10.413 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.403+0000 7f8f6bfff640 1 -- 172.21.15.52:0/2821365872 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f64009a70 con 0x7f8f6c0a8fe0 2023-11-05T08:07:10.413 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.408+0000 7f8f6bfff640 1 --2- 172.21.15.52:0/2821365872 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f6c0a8fe0 0x7f8f6c0b1d30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c00e9b0 tx=0x7f8f5c00ee70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:10.413 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.409+0000 7f8f68ff9640 10 client.?.objecter ms_handle_connect 0x7f8f6c0a8fe0 2023-11-05T08:07:10.414 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.409+0000 7f8f68ff9640 10 client.?.objecter resend_mon_ops 2023-11-05T08:07:10.414 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.412+0000 7f8f68ff9640 1 -- 172.21.15.52:0/2821365872 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f5c009670 con 0x7f8f6c0a8fe0 2023-11-05T08:07:10.414 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.412+0000 7f8f68ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:10.415 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.412+0000 7f8f68ff9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-05T08:07:10.415 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.412+0000 7f8f68ff9640 10 monclient: dump: 2023-11-05T08:07:10.415 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:10.415 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:10.415 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:10.416 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:10.416 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:10.416 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:10.416 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:10.416 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:10.417 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:10.417 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:10.417 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.412+0000 7f8f68ff9640 10 monclient: _finish_auth 0 2023-11-05T08:07:10.417 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.412+0000 7f8f68ff9640 10 monclient: _check_auth_tickets 2023-11-05T08:07:10.417 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.412+0000 7f8f68ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:07:10.418 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.412+0000 7f8f68ff9640 1 -- 172.21.15.52:0/2821365872 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f5c00c9a0 con 0x7f8f6c0a8fe0 2023-11-05T08:07:10.418 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.412+0000 7f8f726a9640 5 monclient: authenticate success, global_id 4339 2023-11-05T08:07:10.418 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.413+0000 7f8f726a9640 10 monclient: _renew_subs 2023-11-05T08:07:10.418 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.413+0000 7f8f726a9640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:07:10.418 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.413+0000 7f8f726a9640 1 -- 172.21.15.52:0/2821365872 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f6c0abf40 con 0x7f8f6c0a8fe0 2023-11-05T08:07:10.419 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.413+0000 7f8f726a9640 10 client.4339.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-05T08:07:10.419 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.413+0000 7f8f726a9640 10 monclient: _renew_subs 2023-11-05T08:07:10.419 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.413+0000 7f8f726a9640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:07:10.419 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.413+0000 7f8f726a9640 1 -- 172.21.15.52:0/2821365872 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f6c0ad200 con 0x7f8f6c0a8fe0 2023-11-05T08:07:10.419 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.413+0000 7f8f726a9640 1 librados: init done 2023-11-05T08:07:10.420 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.413+0000 7f8f68ff9640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:07:10.420 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.413+0000 7f8f68ff9640 1 -- 172.21.15.52:0/2821365872 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f5c00cd50 con 0x7f8f6c0a8fe0 2023-11-05T08:07:10.420 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.413+0000 7f8f68ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:10.420 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.413+0000 7f8f68ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-05T08:07:10.420 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.413+0000 7f8f68ff9640 10 monclient: dump: 2023-11-05T08:07:10.420 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:10.421 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:10.421 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:10.421 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:10.421 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:10.421 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:10.422 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:10.422 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:10.422 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:10.422 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:10.423 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.414+0000 7f8f726a9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-05T08:07:10.423 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.415+0000 7f8f726a9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:07:10.423 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.415+0000 7f8f726a9640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:07:10.424 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.415+0000 7f8f726a9640 1 -- 172.21.15.52:0/2821365872 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f6c1d22d0 con 0x7f8f6c0a8fe0 2023-11-05T08:07:10.424 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.415+0000 7f8f69ffb640 4 set_mon_vals no callback set 2023-11-05T08:07:10.435 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.433+0000 7f8f68ff9640 1 -- 172.21.15.52:0/2821365872 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8f5c013470 con 0x7f8f6c0a8fe0 2023-11-05T08:07:10.435 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.433+0000 7f502aa1a640 10 monclient: get_monmap_and_config 2023-11-05T08:07:10.435 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.434+0000 7f502aa1a640 10 monclient: build_initial_monmap 2023-11-05T08:07:10.436 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.434+0000 7f502aa1a640 10 monclient: monmap: 2023-11-05T08:07:10.436 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:07:10.436 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:10.436 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:07:10.435555+0000 2023-11-05T08:07:10.436 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:07:10.435555+0000 2023-11-05T08:07:10.437 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:07:10.437 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:10.437 INFO:teuthology.orchestra.run.smithi052.stderr:0: v1:172.21.15.52:6789/0 mon.noname-a-legacy 2023-11-05T08:07:10.437 INFO:teuthology.orchestra.run.smithi052.stderr:1: v1:172.21.15.156:6789/0 mon.noname-c-legacy 2023-11-05T08:07:10.437 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-b 2023-11-05T08:07:10.437 INFO:teuthology.orchestra.run.smithi052.stderr:3: v2:172.21.15.52:3300/0 mon.noname-a 2023-11-05T08:07:10.438 INFO:teuthology.orchestra.run.smithi052.stderr:4: v2:172.21.15.156:3300/0 mon.noname-c 2023-11-05T08:07:10.438 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:10.439 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.434+0000 7f8f68ff9640 1 --2- 172.21.15.52:0/2821365872 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f8f5806c850 0x7f8f5806ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:10.439 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.434+0000 7f8f68ff9640 1 -- 172.21.15.52:0/2821365872 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f8f5c058db0 con 0x7f8f6c0a8fe0 2023-11-05T08:07:10.439 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.434+0000 7f8f68ff9640 10 client.4339.objecter ms_dispatch 0x7f8f6c000b90 osd_map(23..23 src has 1..23) v4 2023-11-05T08:07:10.440 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.434+0000 7f8f68ff9640 3 client.4339.objecter handle_osd_map got epochs [23,23] > 0 2023-11-05T08:07:10.440 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.434+0000 7f8f68ff9640 3 client.4339.objecter handle_osd_map decoding full epoch 23 2023-11-05T08:07:10.440 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.434+0000 7f8f68ff9640 20 client.4339.objecter dump_active .. 0 homeless 2023-11-05T08:07:10.440 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.434+0000 7f8f6b7fe640 1 --2- 172.21.15.52:0/2821365872 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f8f5806c850 0x7f8f5806ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:10.440 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.434+0000 7f8f6b7fe640 10 monclient: get_auth_request con 0x7f8f5806c850 auth_method 0 2023-11-05T08:07:10.441 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.435+0000 7f502aa1a640 1 Processor -- start 2023-11-05T08:07:10.441 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.435+0000 7f502aa1a640 1 -- start start 2023-11-05T08:07:10.441 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.435+0000 7f502aa1a640 10 monclient: init 2023-11-05T08:07:10.442 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.435+0000 7f8f6b7fe640 1 --2- 172.21.15.52:0/2821365872 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f8f5806c850 0x7f8f5806ed10 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8f6403a000 tx=0x7f8f64034000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:10.442 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.435+0000 7f8f68ff9640 10 client.4339.objecter ms_handle_connect 0x7f8f5806c850 2023-11-05T08:07:10.443 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.436+0000 7f502aa1a640 10 monclient: _reopen_session rank -1 2023-11-05T08:07:10.444 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.436+0000 7f502aa1a640 10 monclient: _add_conns ranks=[2,1,0,3,4] 2023-11-05T08:07:10.444 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.436+0000 7f502aa1a640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f50240b41f0 0x7f50240adcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:10.444 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.436+0000 7f502aa1a640 10 monclient(hunting): picked mon.noname-b con 0x7f50240b41f0 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:07:10.444 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.436+0000 7f502aa1a640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f50240af370 addr v1:172.21.15.156:6789/0 2023-11-05T08:07:10.444 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.436+0000 7f502aa1a640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f50240b0ad0 addr v1:172.21.15.52:6789/0 2023-11-05T08:07:10.445 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.436+0000 7f502aa1a640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50240ad7b0 con 0x7f50240b0ad0 2023-11-05T08:07:10.445 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.436+0000 7f502aa1a640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50241439f0 con 0x7f50240af370 2023-11-05T08:07:10.445 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.436+0000 7f502aa1a640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:10.445 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.436+0000 7f502aa1a640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50240b45d0 con 0x7f50240b41f0 2023-11-05T08:07:10.445 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.436+0000 7f502aa1a640 10 monclient(hunting): _renew_subs 2023-11-05T08:07:10.446 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.436+0000 7f502aa1a640 10 monclient(hunting): authenticate will time out at 1376.642204s 2023-11-05T08:07:10.446 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.437+0000 7f5028fb7640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f50240b0ad0 0x7f50241432e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:47070/0 (socket says 172.21.15.52:47070) 2023-11-05T08:07:10.446 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.437+0000 7f5028fb7640 1 -- 172.21.15.52:0/1297045474 learned_addr learned my addr 172.21.15.52:0/1297045474 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-11-05T08:07:10.446 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.438+0000 7f5023fff640 1 --2- 172.21.15.52:0/1297045474 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f50240b41f0 0x7f50240adcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:10.446 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.438+0000 7f5023fff640 10 monclient(hunting): get_auth_request con 0x7f50240b41f0 auth_method 0 2023-11-05T08:07:10.447 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.438+0000 7f5023fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:10.447 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.438+0000 7f5023fff640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:10.447 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.438+0000 7f5023fff640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:10.447 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.440+0000 7f5023fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:10.447 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.440+0000 7f5023fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:10.448 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.440+0000 7f5023fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:10.448 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.443+0000 7f5022ffd640 1 -- 172.21.15.52:0/1297045474 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2263176022 0 0) 0x7f50240ad7b0 con 0x7f50240b0ad0 2023-11-05T08:07:10.448 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.443+0000 7f5022ffd640 10 monclient(hunting): _negotiate 2023-11-05T08:07:10.449 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.443+0000 7f5022ffd640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:10.449 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.443+0000 7f5022ffd640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:10.449 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.443+0000 7f5022ffd640 10 monclient(hunting): my global_id is 4302 2023-11-05T08:07:10.449 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.443+0000 7f5022ffd640 1 -- 172.21.15.52:0/1297045474 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f500c003520 con 0x7f50240b0ad0 2023-11-05T08:07:10.449 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.444+0000 7f5023fff640 10 monclient(hunting): handle_auth_done global_id 4250 payload 274 2023-11-05T08:07:10.450 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.444+0000 7f5023fff640 1 -- 172.21.15.52:0/1297045474 >> v1:172.21.15.156:6789/0 conn(0x7f50240af370 legacy=0x7f50240ae640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-05T08:07:10.450 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.444+0000 7f5023fff640 1 -- 172.21.15.52:0/1297045474 >> v1:172.21.15.52:6789/0 conn(0x7f50240b0ad0 legacy=0x7f50241432e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:10.450 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.444+0000 7f5023fff640 10 monclient: _finish_hunting 0 2023-11-05T08:07:10.450 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.444+0000 7f5023fff640 1 monclient: found mon.noname-b 2023-11-05T08:07:10.450 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.444+0000 7f5023fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:07:10.451 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.444+0000 7f5023fff640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.52:3301/0 2023-11-05T08:07:10.451 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.444+0000 7f5023fff640 1 -- 172.21.15.52:0/1297045474 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5024143b80 con 0x7f50240b41f0 2023-11-05T08:07:10.451 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.449+0000 7f5023fff640 1 --2- 172.21.15.52:0/1297045474 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f50240b41f0 0x7f50240adcd0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f50180097d0 tx=0x7f501802b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3590ae6b0513e62c server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:10.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.469+0000 7f6779e64640 10 monclient: get_monmap_and_config 2023-11-05T08:07:10.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.470+0000 7f6779e64640 10 monclient: build_initial_monmap 2023-11-05T08:07:10.472 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.470+0000 7f6779e64640 10 monclient: monmap: 2023-11-05T08:07:10.472 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:07:10.472 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:10.472 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:07:10.471563+0000 2023-11-05T08:07:10.472 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:07:10.471563+0000 2023-11-05T08:07:10.473 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:07:10.473 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:10.473 INFO:teuthology.orchestra.run.smithi052.stderr:0: v1:172.21.15.52:6789/0 mon.noname-a-legacy 2023-11-05T08:07:10.473 INFO:teuthology.orchestra.run.smithi052.stderr:1: v1:172.21.15.156:6789/0 mon.noname-c-legacy 2023-11-05T08:07:10.473 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-b 2023-11-05T08:07:10.474 INFO:teuthology.orchestra.run.smithi052.stderr:3: v2:172.21.15.52:3300/0 mon.noname-a 2023-11-05T08:07:10.474 INFO:teuthology.orchestra.run.smithi052.stderr:4: v2:172.21.15.156:3300/0 mon.noname-c 2023-11-05T08:07:10.474 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:10.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.470+0000 7f6779e64640 1 Processor -- start 2023-11-05T08:07:10.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.471+0000 7f6779e64640 1 -- start start 2023-11-05T08:07:10.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.471+0000 7f6779e64640 10 monclient: init 2023-11-05T08:07:10.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.471+0000 7f6779e64640 10 monclient: _reopen_session rank -1 2023-11-05T08:07:10.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.471+0000 7f6779e64640 10 monclient: _add_conns ranks=[2,4,3,0,1] 2023-11-05T08:07:10.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.471+0000 7f6779e64640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f67740b4240 0x7f67740b1150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:10.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.471+0000 7f6779e64640 10 monclient(hunting): picked mon.noname-b con 0x7f67740b4240 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:07:10.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.471+0000 7f6779e64640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f67740b38d0 0x7f67740ae640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:10.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.471+0000 7f6779e64640 10 monclient(hunting): picked mon.noname-c con 0x7f67740b38d0 addr v2:172.21.15.156:3300/0 2023-11-05T08:07:10.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.471+0000 7f6779e64640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f67740ade00 0x7f677413b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:10.480 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.472+0000 7f6779e64640 10 monclient(hunting): picked mon.noname-a con 0x7f67740ade00 addr v2:172.21.15.52:3300/0 2023-11-05T08:07:10.480 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.472+0000 7f6779e64640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:10.480 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.472+0000 7f6779e64640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67740b4620 con 0x7f67740ade00 2023-11-05T08:07:10.480 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.472+0000 7f6779e64640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:10.480 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.472+0000 7f6779e64640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67740b0cc0 con 0x7f67740b38d0 2023-11-05T08:07:10.480 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.472+0000 7f6779e64640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:10.481 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.472+0000 7f6779e64640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67740b1690 con 0x7f67740b4240 2023-11-05T08:07:10.481 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.472+0000 7f6779e64640 10 monclient(hunting): _renew_subs 2023-11-05T08:07:10.481 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.472+0000 7f6779e64640 10 monclient(hunting): authenticate will time out at 1376.678546s 2023-11-05T08:07:10.481 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.472+0000 7f67737fe640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f67740b4240 0x7f67740b1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:10.481 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.473+0000 7f6773fff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f67740ade00 0x7f677413b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:10.482 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.473+0000 7f67737fe640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f67740b4240 0x7f67740b1150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.52:40296/0 (socket says 172.21.15.52:40296) 2023-11-05T08:07:10.482 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.473+0000 7f67737fe640 1 -- 172.21.15.52:0/1516987603 learned_addr learned my addr 172.21.15.52:0/1516987603 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-11-05T08:07:10.482 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.473+0000 7f67737fe640 10 monclient(hunting): get_auth_request con 0x7f67740b4240 auth_method 0 2023-11-05T08:07:10.482 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.473+0000 7f67737fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:10.482 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.473+0000 7f67737fe640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:10.483 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.473+0000 7f67737fe640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:10.483 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.473+0000 7f6773fff640 10 monclient(hunting): get_auth_request con 0x7f67740ade00 auth_method 0 2023-11-05T08:07:10.483 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.473+0000 7f6773fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:10.483 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.473+0000 7f6773fff640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:10.483 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.473+0000 7f6773fff640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:10.483 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.474+0000 7f6773fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:10.484 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.474+0000 7f6773fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:10.484 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.474+0000 7f6773fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:10.484 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.474+0000 7f67737fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:10.484 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.474+0000 7f67737fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:10.484 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.474+0000 7f67737fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:10.485 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.478+0000 7f6773fff640 10 monclient(hunting): handle_auth_done global_id 4305 payload 274 2023-11-05T08:07:10.485 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.478+0000 7f6773fff640 1 -- 172.21.15.52:0/1516987603 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f67740b4240 msgr2=0x7f67740b1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-05T08:07:10.485 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.478+0000 7f6773fff640 1 --2- 172.21.15.52:0/1516987603 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f67740b4240 0x7f67740b1150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:10.486 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.478+0000 7f6773fff640 1 -- 172.21.15.52:0/1516987603 >> v2:172.21.15.156:3300/0 conn(0x7f67740b38d0 msgr2=0x7f67740ae640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-05T08:07:10.486 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.478+0000 7f6773fff640 1 --2- 172.21.15.52:0/1516987603 >> v2:172.21.15.156:3300/0 conn(0x7f67740b38d0 0x7f67740ae640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:10.486 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.478+0000 7f6773fff640 10 monclient: _finish_hunting 0 2023-11-05T08:07:10.486 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.478+0000 7f6773fff640 1 monclient: found mon.noname-a 2023-11-05T08:07:10.486 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.478+0000 7f6773fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:07:10.487 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.478+0000 7f6773fff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.52:3300/0 2023-11-05T08:07:10.487 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.478+0000 7f6773fff640 1 -- 172.21.15.52:0/1516987603 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67740aeb80 con 0x7f67740ade00 2023-11-05T08:07:10.487 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.481+0000 7f6773fff640 1 --2- 172.21.15.52:0/1516987603 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f67740ade00 0x7f677413b420 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f67740669d0 tx=0x7f676c02bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38aa029f6080f6d server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:10.488 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.482+0000 7f3b4fd6c640 10 monclient: get_monmap_and_config 2023-11-05T08:07:10.488 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.482+0000 7f3b4fd6c640 10 monclient: build_initial_monmap 2023-11-05T08:07:10.489 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.482+0000 7f3b4fd6c640 10 monclient: monmap: 2023-11-05T08:07:10.489 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:07:10.489 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:10.489 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:07:10.483936+0000 2023-11-05T08:07:10.489 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:07:10.483936+0000 2023-11-05T08:07:10.490 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:07:10.490 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:10.490 INFO:teuthology.orchestra.run.smithi052.stderr:0: v1:172.21.15.52:6789/0 mon.noname-a-legacy 2023-11-05T08:07:10.490 INFO:teuthology.orchestra.run.smithi052.stderr:1: v1:172.21.15.156:6789/0 mon.noname-c-legacy 2023-11-05T08:07:10.490 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-b 2023-11-05T08:07:10.491 INFO:teuthology.orchestra.run.smithi052.stderr:3: v2:172.21.15.52:3300/0 mon.noname-a 2023-11-05T08:07:10.491 INFO:teuthology.orchestra.run.smithi052.stderr:4: v2:172.21.15.156:3300/0 mon.noname-c 2023-11-05T08:07:10.491 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:10.491 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.483+0000 7f3b4fd6c640 1 Processor -- start 2023-11-05T08:07:10.491 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.483+0000 7f3b4fd6c640 1 -- start start 2023-11-05T08:07:10.491 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.483+0000 7f3b4fd6c640 10 monclient: init 2023-11-05T08:07:10.492 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.484+0000 7f3b4fd6c640 10 monclient: _reopen_session rank -1 2023-11-05T08:07:10.492 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.484+0000 7f3b4fd6c640 10 monclient: _add_conns ranks=[3,4,1,0,2] 2023-11-05T08:07:10.492 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.484+0000 7f3b4fd6c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3b480b4240 0x7f3b480b1150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:10.492 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.484+0000 7f3b4fd6c640 10 monclient(hunting): picked mon.noname-a con 0x7f3b480b4240 addr v2:172.21.15.52:3300/0 2023-11-05T08:07:10.492 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.484+0000 7f3b4fd6c640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f3b480b38d0 0x7f3b480ae640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:10.493 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.484+0000 7f3b4fd6c640 10 monclient(hunting): picked mon.noname-c con 0x7f3b480b38d0 addr v2:172.21.15.156:3300/0 2023-11-05T08:07:10.493 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.484+0000 7f3b4fd6c640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f3b480ade00 addr v1:172.21.15.156:6789/0 2023-11-05T08:07:10.493 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.484+0000 7f3b4fd6c640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b480b0cc0 con 0x7f3b480ade00 2023-11-05T08:07:10.493 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.484+0000 7f3b4fd6c640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:10.494 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.484+0000 7f3b4fd6c640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b480b4620 con 0x7f3b480b4240 2023-11-05T08:07:10.494 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.484+0000 7f3b4fd6c640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:10.494 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.484+0000 7f3b4fd6c640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b480b1690 con 0x7f3b480b38d0 2023-11-05T08:07:10.494 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.484+0000 7f3b4fd6c640 10 monclient(hunting): _renew_subs 2023-11-05T08:07:10.494 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.484+0000 7f3b4fd6c640 10 monclient(hunting): authenticate will time out at 1376.690498s 2023-11-05T08:07:10.495 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.485+0000 7f67727fc640 1 -- 172.21.15.52:0/1516987603 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f676c02cb50 con 0x7f67740ade00 2023-11-05T08:07:10.495 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.485+0000 7f67727fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:10.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.485+0000 7f67727fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-11-05T08:07:10.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.485+0000 7f67727fc640 10 monclient: dump: 2023-11-05T08:07:10.496 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:10.496 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:10.496 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:10.497 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:10.497 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:10.497 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:10.497 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:10.497 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:10.498 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:10.498 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:10.498 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.485+0000 7f67727fc640 10 monclient: _finish_auth 0 2023-11-05T08:07:10.498 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.485+0000 7f67727fc640 10 monclient: _check_auth_tickets 2023-11-05T08:07:10.498 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.485+0000 7f67727fc640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:07:10.498 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.485+0000 7f67727fc640 1 -- 172.21.15.52:0/1516987603 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f676c02ccb0 con 0x7f67740ade00 2023-11-05T08:07:10.499 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.485+0000 7f6779e64640 5 monclient: authenticate success, global_id 4305 2023-11-05T08:07:10.499 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.485+0000 7f6779e64640 20 monclient: get_monmap_and_config waiting for monmap|config 2023-11-05T08:07:10.499 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.485+0000 7f67727fc640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:07:10.499 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.485+0000 7f6779e64640 10 monclient: get_monmap_and_config success 2023-11-05T08:07:10.499 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.485+0000 7f67727fc640 1 -- 172.21.15.52:0/1516987603 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f676c034660 con 0x7f67740ade00 2023-11-05T08:07:10.500 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.485+0000 7f6779e64640 4 set_mon_vals no callback set 2023-11-05T08:07:10.500 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.485+0000 7f67727fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:10.500 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.485+0000 7f67727fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-11-05T08:07:10.500 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.485+0000 7f67727fc640 10 monclient: dump: 2023-11-05T08:07:10.500 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:10.501 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:10.501 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:10.501 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:10.501 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:10.501 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:10.501 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:10.502 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:10.502 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:10.502 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:10.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.486+0000 7f6779e64640 10 monclient: shutdown 2023-11-05T08:07:10.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.486+0000 7f6779e64640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:07:10.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.486+0000 7f3b4db08640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3b480b4240 0x7f3b480b1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:10.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.486+0000 7f3b4db08640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3b480b4240 0x7f3b480b1150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46938/0 (socket says 172.21.15.52:46938) 2023-11-05T08:07:10.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.486+0000 7f6779e64640 1 -- 172.21.15.52:0/1516987603 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f67740ade00 msgr2=0x7f677413b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:10.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.486+0000 7f3b4db08640 1 -- 172.21.15.52:0/52340885 learned_addr learned my addr 172.21.15.52:0/52340885 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-11-05T08:07:10.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.486+0000 7f3b4db08640 10 monclient(hunting): get_auth_request con 0x7f3b480b4240 auth_method 0 2023-11-05T08:07:10.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.486+0000 7f3b4db08640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:10.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.486+0000 7f3b4db08640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:10.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.486+0000 7f3b4db08640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:10.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.486+0000 7f6779e64640 1 --2- 172.21.15.52:0/1516987603 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f67740ade00 0x7f677413b420 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f67740669d0 tx=0x7f676c02bda0 comp rx=0 tx=0).stop 2023-11-05T08:07:10.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.486+0000 7f6779e64640 1 -- 172.21.15.52:0/1516987603 shutdown_connections 2023-11-05T08:07:10.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.486+0000 7f6779e64640 1 --2- 172.21.15.52:0/1516987603 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f67740ade00 0x7f677413b420 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:10.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.486+0000 7f6779e64640 1 --2- 172.21.15.52:0/1516987603 >> v2:172.21.15.156:3300/0 conn(0x7f67740b38d0 0x7f67740ae640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:10.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.486+0000 7f6779e64640 1 --2- 172.21.15.52:0/1516987603 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f67740b4240 0x7f67740b1150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:10.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.486+0000 7f6779e64640 1 -- 172.21.15.52:0/1516987603 >> 172.21.15.52:0/1516987603 conn(0x7f6774065cd0 msgr2=0x7f67740660e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:07:10.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.486+0000 7f6779e64640 1 -- 172.21.15.52:0/1516987603 shutdown_connections 2023-11-05T08:07:10.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.487+0000 7f3999675640 10 monclient: get_monmap_and_config 2023-11-05T08:07:10.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.487+0000 7f3999675640 10 monclient: build_initial_monmap 2023-11-05T08:07:10.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.487+0000 7f3999675640 10 monclient: monmap: 2023-11-05T08:07:10.508 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:07:10.508 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:10.508 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:07:10.488567+0000 2023-11-05T08:07:10.509 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:07:10.488567+0000 2023-11-05T08:07:10.509 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:07:10.509 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:10.509 INFO:teuthology.orchestra.run.smithi052.stderr:0: v1:172.21.15.52:6789/0 mon.noname-a-legacy 2023-11-05T08:07:10.509 INFO:teuthology.orchestra.run.smithi052.stderr:1: v1:172.21.15.156:6789/0 mon.noname-c-legacy 2023-11-05T08:07:10.510 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-b 2023-11-05T08:07:10.510 INFO:teuthology.orchestra.run.smithi052.stderr:3: v2:172.21.15.52:3300/0 mon.noname-a 2023-11-05T08:07:10.510 INFO:teuthology.orchestra.run.smithi052.stderr:4: v2:172.21.15.156:3300/0 mon.noname-c 2023-11-05T08:07:10.510 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:10.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.486+0000 7f6779e64640 1 -- 172.21.15.52:0/1516987603 wait complete. 2023-11-05T08:07:10.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.487+0000 7f3b4db08640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:10.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.487+0000 7f3b4db08640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:10.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.487+0000 7f3b4db08640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:10.512 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.487+0000 7f6779e64640 10 monclient: build_initial_monmap 2023-11-05T08:07:10.512 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.488+0000 7f6779e64640 10 monclient: monmap: 2023-11-05T08:07:10.512 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:07:10.513 INFO:teuthology.orchestra.run.smithi052.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-05T08:07:10.513 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 0.000000 2023-11-05T08:07:10.513 INFO:teuthology.orchestra.run.smithi052.stderr:created 0.000000 2023-11-05T08:07:10.513 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:07:10.513 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:10.513 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.noname-a 2023-11-05T08:07:10.514 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.noname-b 2023-11-05T08:07:10.514 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-c 2023-11-05T08:07:10.514 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:10.515 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.488+0000 7f3999675640 1 Processor -- start 2023-11-05T08:07:10.515 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.488+0000 7f3999675640 1 -- start start 2023-11-05T08:07:10.515 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.488+0000 7f3999675640 10 monclient: init 2023-11-05T08:07:10.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.488+0000 7f6779e64640 1 librados: starting msgr at 2023-11-05T08:07:10.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.488+0000 7f6779e64640 1 librados: starting objecter 2023-11-05T08:07:10.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.488+0000 7f6779e64640 1 Processor -- start 2023-11-05T08:07:10.517 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.488+0000 7f6779e64640 1 -- start start 2023-11-05T08:07:10.517 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.488+0000 7f6779e64640 1 librados: setting wanted keys 2023-11-05T08:07:10.517 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.488+0000 7f6779e64640 1 librados: calling monclient init 2023-11-05T08:07:10.517 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.488+0000 7f6779e64640 10 monclient: init 2023-11-05T08:07:10.518 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.489+0000 7f3999675640 10 monclient: _reopen_session rank -1 2023-11-05T08:07:10.518 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.489+0000 7f3999675640 10 monclient: _add_conns ranks=[4,0,3,1,2] 2023-11-05T08:07:10.519 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.489+0000 7f3999675640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f398c038eb0 0x7f398c0339a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:10.519 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.489+0000 7f3999675640 10 monclient(hunting): picked mon.noname-c con 0x7f398c038eb0 addr v2:172.21.15.156:3300/0 2023-11-05T08:07:10.519 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.489+0000 7f3999675640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f398c039290 addr v1:172.21.15.52:6789/0 2023-11-05T08:07:10.519 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.489+0000 7f3999675640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f398c030b40 0x7f398c0d25b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:10.519 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.489+0000 7f3999675640 10 monclient(hunting): picked mon.noname-a con 0x7f398c030b40 addr v2:172.21.15.52:3300/0 2023-11-05T08:07:10.520 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.489+0000 7f3999675640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f398c0c5990 con 0x7f398c039290 2023-11-05T08:07:10.520 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.489+0000 7f3b4db08640 10 monclient(hunting): handle_auth_done global_id 4308 payload 274 2023-11-05T08:07:10.520 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.489+0000 7f3b4db08640 1 -- 172.21.15.52:0/52340885 >> v2:172.21.15.156:3300/0 conn(0x7f3b480b38d0 msgr2=0x7f3b480ae640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-05T08:07:10.521 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.489+0000 7f3b4db08640 1 --2- 172.21.15.52:0/52340885 >> v2:172.21.15.156:3300/0 conn(0x7f3b480b38d0 0x7f3b480ae640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:10.521 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.489+0000 7f3b4db08640 1 -- 172.21.15.52:0/52340885 >> v1:172.21.15.156:6789/0 conn(0x7f3b480ade00 legacy=0x7f3b4813b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-05T08:07:10.521 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.489+0000 7f3b4db08640 10 monclient: _finish_hunting 0 2023-11-05T08:07:10.521 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.489+0000 7f3b4db08640 1 monclient: found mon.noname-a 2023-11-05T08:07:10.521 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.489+0000 7f3b4db08640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:07:10.522 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.489+0000 7f3b4db08640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.52:3300/0 2023-11-05T08:07:10.522 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.489+0000 7f3b4db08640 1 -- 172.21.15.52:0/52340885 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b480aeb80 con 0x7f3b480b4240 2023-11-05T08:07:10.523 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.489+0000 7f3999675640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:10.523 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.489+0000 7f3999675640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f398c0376d0 con 0x7f398c030b40 2023-11-05T08:07:10.523 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.489+0000 7f3999675640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:10.523 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.489+0000 7f3999675640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f398c036710 con 0x7f398c038eb0 2023-11-05T08:07:10.523 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.489+0000 7f3999675640 10 monclient(hunting): _renew_subs 2023-11-05T08:07:10.524 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.489+0000 7f6779e64640 10 monclient: _reopen_session rank -1 2023-11-05T08:07:10.524 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.489+0000 7f6779e64640 10 monclient: _add_conns ranks=[0,1,2] 2023-11-05T08:07:10.525 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.489+0000 7f6779e64640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f67740ade00 0x7f67740ad1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:10.525 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.489+0000 7f6779e64640 10 monclient(hunting): picked mon.noname-a con 0x7f67740ade00 addr [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] 2023-11-05T08:07:10.525 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.489+0000 7f6779e64640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f67740b4240 0x7f67740a8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:10.525 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.489+0000 7f6779e64640 10 monclient(hunting): picked mon.noname-b con 0x7f67740b4240 addr [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] 2023-11-05T08:07:10.526 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.489+0000 7f3999675640 10 monclient(hunting): authenticate will time out at 1376.695238s 2023-11-05T08:07:10.527 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.490+0000 7f6779e64640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f67741d6330 0x7f67741d67c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:10.527 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.490+0000 7f6779e64640 10 monclient(hunting): picked mon.noname-c con 0x7f67741d6330 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:07:10.527 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.490+0000 7f6779e64640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:10.528 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.490+0000 7f6779e64640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67740a9380 con 0x7f67740ade00 2023-11-05T08:07:10.528 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.490+0000 7f6779e64640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:10.528 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.490+0000 7f6779e64640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67740a9060 con 0x7f67740b4240 2023-11-05T08:07:10.528 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.490+0000 7f6779e64640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:10.528 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.490+0000 7f6779e64640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67741d6d00 con 0x7f67741d6330 2023-11-05T08:07:10.529 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.490+0000 7f6779e64640 10 monclient(hunting): _renew_subs 2023-11-05T08:07:10.529 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.490+0000 7f6779e64640 10 monclient(hunting): authenticate will time out at 1376.696003s 2023-11-05T08:07:10.529 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.490+0000 7f6773fff640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f67741d6330 0x7f67741d67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:10.529 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.491+0000 7f6773fff640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f67741d6330 0x7f67741d67c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.52:40304/0 (socket says 172.21.15.52:40304) 2023-11-05T08:07:10.529 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.491+0000 7f6773fff640 1 -- 172.21.15.52:0/2141157636 learned_addr learned my addr 172.21.15.52:0/2141157636 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-11-05T08:07:10.530 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.491+0000 7f6773fff640 10 monclient(hunting): get_auth_request con 0x7f67741d6330 auth_method 0 2023-11-05T08:07:10.530 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.491+0000 7f6773fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:10.530 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.491+0000 7f6773fff640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:10.530 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.491+0000 7f6773fff640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:10.530 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.491+0000 7f6773fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:10.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.491+0000 7f6773fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:10.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.491+0000 7f6773fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:10.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.493+0000 7f0d0467c640 10 monclient: get_monmap_and_config 2023-11-05T08:07:10.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.493+0000 7f0d0467c640 10 monclient: build_initial_monmap 2023-11-05T08:07:10.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.493+0000 7f0d0467c640 10 monclient: monmap: 2023-11-05T08:07:10.532 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:07:10.532 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:10.532 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:07:10.494581+0000 2023-11-05T08:07:10.533 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:07:10.494581+0000 2023-11-05T08:07:10.533 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:07:10.533 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:10.533 INFO:teuthology.orchestra.run.smithi052.stderr:0: v1:172.21.15.52:6789/0 mon.noname-a-legacy 2023-11-05T08:07:10.533 INFO:teuthology.orchestra.run.smithi052.stderr:1: v1:172.21.15.156:6789/0 mon.noname-c-legacy 2023-11-05T08:07:10.534 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-b 2023-11-05T08:07:10.534 INFO:teuthology.orchestra.run.smithi052.stderr:3: v2:172.21.15.52:3300/0 mon.noname-a 2023-11-05T08:07:10.534 INFO:teuthology.orchestra.run.smithi052.stderr:4: v2:172.21.15.156:3300/0 mon.noname-c 2023-11-05T08:07:10.534 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:10.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.493+0000 7f0d0467c640 1 Processor -- start 2023-11-05T08:07:10.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.493+0000 7f0d0467c640 1 -- start start 2023-11-05T08:07:10.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.493+0000 7f0d0467c640 10 monclient: init 2023-11-05T08:07:10.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.493+0000 7f866d434640 10 monclient: get_monmap_and_config 2023-11-05T08:07:10.537 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.493+0000 7f866d434640 10 monclient: build_initial_monmap 2023-11-05T08:07:10.537 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.493+0000 7f866d434640 10 monclient: monmap: 2023-11-05T08:07:10.537 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:07:10.538 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:10.538 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:07:10.495466+0000 2023-11-05T08:07:10.538 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:07:10.495466+0000 2023-11-05T08:07:10.538 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:07:10.538 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:10.539 INFO:teuthology.orchestra.run.smithi052.stderr:0: v1:172.21.15.52:6789/0 mon.noname-a-legacy 2023-11-05T08:07:10.539 INFO:teuthology.orchestra.run.smithi052.stderr:1: v1:172.21.15.156:6789/0 mon.noname-c-legacy 2023-11-05T08:07:10.539 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-b 2023-11-05T08:07:10.539 INFO:teuthology.orchestra.run.smithi052.stderr:3: v2:172.21.15.52:3300/0 mon.noname-a 2023-11-05T08:07:10.539 INFO:teuthology.orchestra.run.smithi052.stderr:4: v2:172.21.15.156:3300/0 mon.noname-c 2023-11-05T08:07:10.540 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:10.540 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.494+0000 7f39937fe640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f398c039290 0x7f398c0c7d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:47080/0 (socket says 172.21.15.52:47080) 2023-11-05T08:07:10.540 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.494+0000 7f39937fe640 1 -- 172.21.15.52:0/1145040525 learned_addr learned my addr 172.21.15.52:0/1145040525 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-11-05T08:07:10.541 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.494+0000 7f0d0467c640 10 monclient: _reopen_session rank -1 2023-11-05T08:07:10.541 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.494+0000 7f0d0467c640 10 monclient: _add_conns ranks=[4,2,0,3,1] 2023-11-05T08:07:10.542 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.494+0000 7f0d0467c640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f0cfc0b4240 0x7f0cfc0b1150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:10.542 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.495+0000 7f0d0467c640 10 monclient(hunting): picked mon.noname-c con 0x7f0cfc0b4240 addr v2:172.21.15.156:3300/0 2023-11-05T08:07:10.542 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.495+0000 7f0d0467c640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0cfc0b38d0 0x7f0cfc0ae640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:10.542 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.495+0000 7f0d0467c640 10 monclient(hunting): picked mon.noname-b con 0x7f0cfc0b38d0 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:07:10.543 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.495+0000 7f866d434640 1 Processor -- start 2023-11-05T08:07:10.543 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.495+0000 7f866d434640 1 -- start start 2023-11-05T08:07:10.543 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.495+0000 7f866d434640 10 monclient: init 2023-11-05T08:07:10.544 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.495+0000 7f0d0467c640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f0cfc0ade00 addr v1:172.21.15.52:6789/0 2023-11-05T08:07:10.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.495+0000 7f0d0467c640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cfc0b0cc0 con 0x7f0cfc0ade00 2023-11-05T08:07:10.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.495+0000 7f0d0467c640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:10.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.495+0000 7f0d0467c640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cfc0b4620 con 0x7f0cfc0b4240 2023-11-05T08:07:10.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.495+0000 7f0d0467c640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:10.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.495+0000 7f0d0467c640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cfc0b1690 con 0x7f0cfc0b38d0 2023-11-05T08:07:10.546 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.495+0000 7f0d0467c640 10 monclient(hunting): _renew_subs 2023-11-05T08:07:10.546 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.495+0000 7f0d0467c640 10 monclient(hunting): authenticate will time out at 1376.701289s 2023-11-05T08:07:10.546 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.496+0000 7f866d434640 10 monclient: _reopen_session rank -1 2023-11-05T08:07:10.547 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.496+0000 7f866d434640 10 monclient: _add_conns ranks=[4,1,3,0,2] 2023-11-05T08:07:10.547 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.496+0000 7f866d434640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f86680ad980 0x7f86680ae5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:10.547 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.496+0000 7f866d434640 10 monclient(hunting): picked mon.noname-c con 0x7f86680ad980 addr v2:172.21.15.156:3300/0 2023-11-05T08:07:10.547 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.496+0000 7f866d434640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f866813eb20 addr v1:172.21.15.156:6789/0 2023-11-05T08:07:10.547 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.496+0000 7f866d434640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f866813efb0 0x7f86680b0f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:10.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.496+0000 7f866d434640 10 monclient(hunting): picked mon.noname-a con 0x7f866813efb0 addr v2:172.21.15.52:3300/0 2023-11-05T08:07:10.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.496+0000 7f3b4db08640 1 --2- 172.21.15.52:0/52340885 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b480b4240 0x7f3b480b1150 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3b44009870 tx=0x7f3b4402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f3fe7db1c1f6e31 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:10.549 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.496+0000 7f866d434640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86680b1440 con 0x7f866813eb20 2023-11-05T08:07:10.549 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.496+0000 7f866d434640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:10.549 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.496+0000 7f866d434640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86680b02b0 con 0x7f866813efb0 2023-11-05T08:07:10.549 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.496+0000 7f866d434640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:10.549 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.496+0000 7f866d434640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86680add60 con 0x7f86680ad980 2023-11-05T08:07:10.550 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.496+0000 7f866d434640 10 monclient(hunting): _renew_subs 2023-11-05T08:07:10.550 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.496+0000 7f866d434640 10 monclient(hunting): authenticate will time out at 1376.702186s 2023-11-05T08:07:10.550 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.498+0000 7f6773fff640 10 monclient(hunting): handle_auth_done global_id 4256 payload 824 2023-11-05T08:07:10.551 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.498+0000 7f6773fff640 1 -- 172.21.15.52:0/2141157636 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f67740b4240 msgr2=0x7f67740a8b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:10.551 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.498+0000 7f6773fff640 1 --2- 172.21.15.52:0/2141157636 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f67740b4240 0x7f67740a8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:10.551 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.498+0000 7f6773fff640 1 -- 172.21.15.52:0/2141157636 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f67740ade00 msgr2=0x7f67740ad1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:10.551 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.498+0000 7f6773fff640 1 --2- 172.21.15.52:0/2141157636 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f67740ade00 0x7f67740ad1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:10.551 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.498+0000 7f6773fff640 10 monclient: _finish_hunting 0 2023-11-05T08:07:10.552 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.498+0000 7f6773fff640 1 monclient: found mon.noname-c 2023-11-05T08:07:10.552 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.498+0000 7f6773fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:07:10.552 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.498+0000 7f6773fff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.52:3301/0 2023-11-05T08:07:10.552 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.498+0000 7f6773fff640 1 -- 172.21.15.52:0/2141157636 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f676c009a70 con 0x7f67741d6330 2023-11-05T08:07:10.552 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.500+0000 7f6773fff640 1 --2- 172.21.15.52:0/2141157636 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f67741d6330 0x7f67741d67c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f676c02c3b0 tx=0x7f676c004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:10.553 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.500+0000 7f675bfff640 10 client.?.objecter ms_handle_connect 0x7f67741d6330 2023-11-05T08:07:10.553 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.500+0000 7f675bfff640 10 client.?.objecter resend_mon_ops 2023-11-05T08:07:10.554 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.501+0000 7f0d01c17640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0cfc0b38d0 0x7f0cfc0ae640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:10.554 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.502+0000 7f0d01c17640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0cfc0b38d0 0x7f0cfc0ae640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.52:40318/0 (socket says 172.21.15.52:40318) 2023-11-05T08:07:10.554 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.502+0000 7f0d01c17640 1 -- 172.21.15.52:0/3825478020 learned_addr learned my addr 172.21.15.52:0/3825478020 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-11-05T08:07:10.554 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.502+0000 7f0d01c17640 10 monclient(hunting): get_auth_request con 0x7f0cfc0b38d0 auth_method 0 2023-11-05T08:07:10.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.502+0000 7f0d01c17640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:10.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.502+0000 7f0d01c17640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:10.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.502+0000 7f0d01c17640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:10.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.502+0000 7f0d01c17640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:10.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.502+0000 7f0d01c17640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:10.556 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.502+0000 7f0d01c17640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:10.557 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.504+0000 7f3b4cb06640 1 -- 172.21.15.52:0/52340885 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b440317e0 con 0x7f3b480b4240 2023-11-05T08:07:10.557 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.504+0000 7f3b4cb06640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:10.557 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.504+0000 7f3b4cb06640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-11-05T08:07:10.557 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.504+0000 7f3b4cb06640 10 monclient: dump: 2023-11-05T08:07:10.558 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:10.558 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:10.558 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:10.558 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:10.558 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:10.558 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:10.559 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:10.559 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:10.559 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:10.559 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:10.559 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.504+0000 7f3b4cb06640 10 monclient: _finish_auth 0 2023-11-05T08:07:10.560 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.504+0000 7f3b4cb06640 10 monclient: _check_auth_tickets 2023-11-05T08:07:10.560 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.504+0000 7f3b4cb06640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:07:10.560 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.504+0000 7f3b4cb06640 1 -- 172.21.15.52:0/52340885 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b44031940 con 0x7f3b480b4240 2023-11-05T08:07:10.560 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.504+0000 7f3b4cb06640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:07:10.560 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.504+0000 7f3b4cb06640 1 -- 172.21.15.52:0/52340885 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b44031cd0 con 0x7f3b480b4240 2023-11-05T08:07:10.560 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.504+0000 7f3b4cb06640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:10.561 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.504+0000 7f3b4cb06640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-11-05T08:07:10.561 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.504+0000 7f3b4cb06640 10 monclient: dump: 2023-11-05T08:07:10.561 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:10.561 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:10.561 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:10.562 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:10.562 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:10.562 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:10.562 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:10.562 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:10.562 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:10.563 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:10.563 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.504+0000 7f3b4fd6c640 5 monclient: authenticate success, global_id 4308 2023-11-05T08:07:10.563 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.504+0000 7f3b4fd6c640 10 monclient: get_monmap_and_config success 2023-11-05T08:07:10.563 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.504+0000 7f3b4fd6c640 4 set_mon_vals no callback set 2023-11-05T08:07:10.563 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.504+0000 7f3b4fd6c640 10 monclient: shutdown 2023-11-05T08:07:10.564 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.504+0000 7f3b4fd6c640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:07:10.564 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.505+0000 7f3b4fd6c640 1 -- 172.21.15.52:0/52340885 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b480b4240 msgr2=0x7f3b480b1150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:10.564 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.505+0000 7f3b4fd6c640 1 --2- 172.21.15.52:0/52340885 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b480b4240 0x7f3b480b1150 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3b44009870 tx=0x7f3b4402b880 comp rx=0 tx=0).stop 2023-11-05T08:07:10.565 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.505+0000 7f0d01c17640 10 monclient(hunting): handle_auth_done global_id 4259 payload 274 2023-11-05T08:07:10.565 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.505+0000 7f0d01c17640 1 -- 172.21.15.52:0/3825478020 >> v2:172.21.15.156:3300/0 conn(0x7f0cfc0b4240 msgr2=0x7f0cfc0b1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-05T08:07:10.565 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.505+0000 7f0d01c17640 1 --2- 172.21.15.52:0/3825478020 >> v2:172.21.15.156:3300/0 conn(0x7f0cfc0b4240 0x7f0cfc0b1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:10.565 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.505+0000 7f0d01c17640 1 -- 172.21.15.52:0/3825478020 >> v1:172.21.15.52:6789/0 conn(0x7f0cfc0ade00 legacy=0x7f0cfc13b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-05T08:07:10.566 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.505+0000 7f3b4fd6c640 1 -- 172.21.15.52:0/52340885 shutdown_connections 2023-11-05T08:07:10.566 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.505+0000 7f3b4fd6c640 1 --2- 172.21.15.52:0/52340885 >> v2:172.21.15.156:3300/0 conn(0x7f3b480b38d0 0x7f3b480ae640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:10.566 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.505+0000 7f3b4fd6c640 1 --2- 172.21.15.52:0/52340885 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b480b4240 0x7f3b480b1150 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:10.566 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.505+0000 7f3b4fd6c640 1 -- 172.21.15.52:0/52340885 >> 172.21.15.52:0/52340885 conn(0x7f3b48065cd0 msgr2=0x7f3b480660e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:07:10.567 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.505+0000 7f0d01c17640 10 monclient: _finish_hunting 0 2023-11-05T08:07:10.567 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.505+0000 7f0d01c17640 1 monclient: found mon.noname-b 2023-11-05T08:07:10.567 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.505+0000 7f0d01c17640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:07:10.567 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.505+0000 7f0d01c17640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.52:3301/0 2023-11-05T08:07:10.568 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.505+0000 7f0d01c17640 1 -- 172.21.15.52:0/3825478020 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cfc0aeb80 con 0x7f0cfc0b38d0 2023-11-05T08:07:10.568 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.505+0000 7f3b4fd6c640 1 -- 172.21.15.52:0/52340885 shutdown_connections 2023-11-05T08:07:10.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.505+0000 7f3b4fd6c640 1 -- 172.21.15.52:0/52340885 wait complete. 2023-11-05T08:07:10.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.505+0000 7f3992ffd640 1 -- 172.21.15.52:0/1145040525 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3089807323 0 0) 0x7f398c0c5990 con 0x7f398c039290 2023-11-05T08:07:10.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.505+0000 7f3992ffd640 10 monclient(hunting): _negotiate 2023-11-05T08:07:10.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.505+0000 7f3992ffd640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:10.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.505+0000 7f3992ffd640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:10.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.505+0000 7f3992ffd640 10 monclient(hunting): my global_id is 4311 2023-11-05T08:07:10.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.505+0000 7f3992ffd640 1 -- 172.21.15.52:0/1145040525 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3984003520 con 0x7f398c039290 2023-11-05T08:07:10.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.506+0000 7f3998e74640 1 --2- 172.21.15.52:0/1145040525 >> v2:172.21.15.52:3300/0 conn(0x7f398c030b40 0x7f398c0d25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:10.571 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.506+0000 7f3b4fd6c640 10 monclient: build_initial_monmap 2023-11-05T08:07:10.571 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.506+0000 7f3b4fd6c640 10 monclient: monmap: 2023-11-05T08:07:10.572 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:07:10.572 INFO:teuthology.orchestra.run.smithi052.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-05T08:07:10.572 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 0.000000 2023-11-05T08:07:10.572 INFO:teuthology.orchestra.run.smithi052.stderr:created 0.000000 2023-11-05T08:07:10.572 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:07:10.572 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:10.573 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.noname-a 2023-11-05T08:07:10.573 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.noname-b 2023-11-05T08:07:10.573 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-c 2023-11-05T08:07:10.573 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:10.573 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.506+0000 7f3b4fd6c640 1 librados: starting msgr at 2023-11-05T08:07:10.574 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.507+0000 7f3b4fd6c640 1 librados: starting objecter 2023-11-05T08:07:10.574 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.507+0000 7f3b4fd6c640 1 Processor -- start 2023-11-05T08:07:10.574 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.507+0000 7f0d01c17640 1 --2- 172.21.15.52:0/3825478020 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0cfc0b38d0 0x7f0cfc0ae640 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0cec009870 tx=0x7f0cec02b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=911cae359f721c5b server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:10.575 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.507+0000 7f3b4fd6c640 1 -- start start 2023-11-05T08:07:10.575 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.507+0000 7f3b4fd6c640 1 librados: setting wanted keys 2023-11-05T08:07:10.575 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.507+0000 7f3b4fd6c640 1 librados: calling monclient init 2023-11-05T08:07:10.575 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.507+0000 7f3b4fd6c640 10 monclient: init 2023-11-05T08:07:10.576 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.507+0000 7f3998e74640 10 monclient(hunting): get_auth_request con 0x7f398c030b40 auth_method 0 2023-11-05T08:07:10.576 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.507+0000 7f3998e74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:10.576 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.507+0000 7f3998e74640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:10.577 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.507+0000 7f3998e74640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:10.577 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.508+0000 7f3b4fd6c640 10 monclient: _reopen_session rank -1 2023-11-05T08:07:10.577 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.508+0000 7f3b4fd6c640 10 monclient: _add_conns ranks=[2,1,0] 2023-11-05T08:07:10.577 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.508+0000 7f3b4fd6c640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3b480ade00 0x7f3b48144ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:10.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.508+0000 7f866cc33640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f866813efb0 0x7f86680b0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:10.579 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.508+0000 7f3b4fd6c640 10 monclient(hunting): picked mon.noname-c con 0x7f3b480ade00 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:07:10.579 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.508+0000 7f3b4fd6c640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3b480b4240 0x7f3b4813da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:10.579 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.508+0000 7f3b4fd6c640 10 monclient(hunting): picked mon.noname-b con 0x7f3b480b4240 addr [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] 2023-11-05T08:07:10.579 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.508+0000 7f3b4fd6c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b4813e810 0x7f3b481d9d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:10.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.508+0000 7f3b4fd6c640 10 monclient(hunting): picked mon.noname-a con 0x7f3b4813e810 addr [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] 2023-11-05T08:07:10.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.508+0000 7f3b4fd6c640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:10.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.508+0000 7f3b4fd6c640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b4813e380 con 0x7f3b4813e810 2023-11-05T08:07:10.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.508+0000 7f3b4fd6c640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:10.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.508+0000 7f3b4fd6c640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b4813df90 con 0x7f3b480b4240 2023-11-05T08:07:10.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.508+0000 7f3b4fd6c640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:10.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.508+0000 7f3b4fd6c640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b4813e100 con 0x7f3b480ade00 2023-11-05T08:07:10.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.508+0000 7f3b4fd6c640 10 monclient(hunting): _renew_subs 2023-11-05T08:07:10.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.508+0000 7f3b4fd6c640 10 monclient(hunting): authenticate will time out at 1376.714156s 2023-11-05T08:07:10.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.508+0000 7f3b4db08640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3b480ade00 0x7f3b48144ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:10.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.509+0000 7f3998e74640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:10.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.509+0000 7f3998e74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:10.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.509+0000 7f3998e74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:10.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.509+0000 7f3b4db08640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3b480ade00 0x7f3b48144ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.52:40328/0 (socket says 172.21.15.52:40328) 2023-11-05T08:07:10.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.509+0000 7f3b4db08640 1 -- 172.21.15.52:0/1213078853 learned_addr learned my addr 172.21.15.52:0/1213078853 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-11-05T08:07:10.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.509+0000 7f3b4db08640 10 monclient(hunting): get_auth_request con 0x7f3b480ade00 auth_method 0 2023-11-05T08:07:10.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.509+0000 7f3b4db08640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:10.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.509+0000 7f3b4db08640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:10.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.509+0000 7f3b4db08640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:10.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.509+0000 7f3b4db08640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:10.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.509+0000 7f3b4db08640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:10.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.509+0000 7f3b4db08640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:10.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.512+0000 7f866cc33640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f866813efb0 0x7f86680b0f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46962/0 (socket says 172.21.15.52:46962) 2023-11-05T08:07:10.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.512+0000 7f866cc33640 1 -- 172.21.15.52:0/2569719712 learned_addr learned my addr 172.21.15.52:0/2569719712 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-11-05T08:07:10.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.512+0000 7f866cc33640 10 monclient(hunting): get_auth_request con 0x7f866813efb0 auth_method 0 2023-11-05T08:07:10.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.512+0000 7f866cc33640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:10.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.512+0000 7f866cc33640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:10.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.512+0000 7f866cc33640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:10.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.514+0000 7f3998e74640 10 monclient(hunting): handle_auth_done global_id 4314 payload 274 2023-11-05T08:07:10.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.514+0000 7f3998e74640 1 -- 172.21.15.52:0/1145040525 >> v2:172.21.15.156:3300/0 conn(0x7f398c038eb0 msgr2=0x7f398c0339a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-05T08:07:10.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.514+0000 7f3998e74640 1 --2- 172.21.15.52:0/1145040525 >> v2:172.21.15.156:3300/0 conn(0x7f398c038eb0 0x7f398c0339a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:10.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.514+0000 7f3998e74640 1 -- 172.21.15.52:0/1145040525 >> v1:172.21.15.52:6789/0 conn(0x7f398c039290 legacy=0x7f398c0c7d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:10.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.514+0000 7f3998e74640 10 monclient: _finish_hunting 0 2023-11-05T08:07:10.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.514+0000 7f3998e74640 1 monclient: found mon.noname-a 2023-11-05T08:07:10.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.514+0000 7f3998e74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:07:10.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.514+0000 7f3998e74640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.52:3300/0 2023-11-05T08:07:10.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.514+0000 7f3998e74640 1 -- 172.21.15.52:0/1145040525 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f398c039cd0 con 0x7f398c030b40 2023-11-05T08:07:10.589 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.515+0000 7f3b4db08640 10 monclient(hunting): handle_auth_done global_id 4262 payload 824 2023-11-05T08:07:10.589 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.515+0000 7f3b4db08640 1 -- 172.21.15.52:0/1213078853 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3b480b4240 msgr2=0x7f3b4813da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:10.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.515+0000 7f3b4db08640 1 --2- 172.21.15.52:0/1213078853 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3b480b4240 0x7f3b4813da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:10.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.515+0000 7f3b4db08640 1 -- 172.21.15.52:0/1213078853 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b4813e810 msgr2=0x7f3b481d9d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:10.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.515+0000 7f3b4db08640 1 --2- 172.21.15.52:0/1213078853 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b4813e810 0x7f3b481d9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:10.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.515+0000 7f3b4db08640 10 monclient: _finish_hunting 0 2023-11-05T08:07:10.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.515+0000 7f3b4db08640 1 monclient: found mon.noname-c 2023-11-05T08:07:10.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.515+0000 7f3b4db08640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:07:10.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.515+0000 7f3b4db08640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.52:3301/0 2023-11-05T08:07:10.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.515+0000 7f3b4db08640 1 -- 172.21.15.52:0/1213078853 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b440094d0 con 0x7f3b480ade00 2023-11-05T08:07:10.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.515+0000 7f866cc33640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:10.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.515+0000 7f866cc33640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:10.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.515+0000 7f866cc33640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:10.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.517+0000 7f3998e74640 1 --2- 172.21.15.52:0/1145040525 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f398c030b40 0x7f398c0d25b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f399404ef50 tx=0x7f39940a5890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f71da08917ba5237 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:10.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.519+0000 7f3b4db08640 1 --2- 172.21.15.52:0/1213078853 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3b480ade00 0x7f3b48144ed0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3b44000c00 tx=0x7f3b440046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:10.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.519+0000 7f3b3e7fc640 10 client.?.objecter ms_handle_connect 0x7f3b480ade00 2023-11-05T08:07:10.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.519+0000 7f3b3e7fc640 10 client.?.objecter resend_mon_ops 2023-11-05T08:07:10.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.519+0000 7f866cc33640 10 monclient(hunting): handle_auth_done global_id 4317 payload 274 2023-11-05T08:07:10.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.519+0000 7f866cc33640 1 -- 172.21.15.52:0/2569719712 >> v2:172.21.15.156:3300/0 conn(0x7f86680ad980 msgr2=0x7f86680ae5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-05T08:07:10.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.519+0000 7f866cc33640 1 --2- 172.21.15.52:0/2569719712 >> v2:172.21.15.156:3300/0 conn(0x7f86680ad980 0x7f86680ae5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:10.595 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.519+0000 7f866cc33640 1 -- 172.21.15.52:0/2569719712 >> v1:172.21.15.156:6789/0 conn(0x7f866813eb20 legacy=0x7f86680b07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-05T08:07:10.595 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.519+0000 7f866cc33640 10 monclient: _finish_hunting 0 2023-11-05T08:07:10.595 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.519+0000 7f866cc33640 1 monclient: found mon.noname-a 2023-11-05T08:07:10.595 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.519+0000 7f866cc33640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:07:10.595 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.519+0000 7f866cc33640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.52:3300/0 2023-11-05T08:07:10.596 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.519+0000 7f866cc33640 1 -- 172.21.15.52:0/2569719712 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f866806a5e0 con 0x7f866813efb0 2023-11-05T08:07:10.596 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.524+0000 7f866cc33640 1 --2- 172.21.15.52:0/2569719712 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f866813efb0 0x7f86680b0f00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f86680b4ba0 tx=0x7f866002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=477db7087f0191e3 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:10.599 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.531+0000 7f3992ffd640 1 -- 172.21.15.52:0/1145040525 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39940b0070 con 0x7f398c030b40 2023-11-05T08:07:10.599 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.531+0000 7f3992ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:10.599 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.531+0000 7f3992ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-11-05T08:07:10.599 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.531+0000 7f3992ffd640 10 monclient: dump: 2023-11-05T08:07:10.599 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:10.600 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:10.600 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:10.600 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:10.600 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:10.601 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:10.601 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:10.601 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:10.601 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:10.601 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:10.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.531+0000 7f3992ffd640 10 monclient: _finish_auth 0 2023-11-05T08:07:10.602 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.531+0000 7f3992ffd640 10 monclient: _check_auth_tickets 2023-11-05T08:07:10.602 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.531+0000 7f3992ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:07:10.602 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.531+0000 7f3992ffd640 1 -- 172.21.15.52:0/1145040525 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39940ab440 con 0x7f398c030b40 2023-11-05T08:07:10.602 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.531+0000 7f3992ffd640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:07:10.602 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.531+0000 7f3992ffd640 1 -- 172.21.15.52:0/1145040525 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39940ab870 con 0x7f398c030b40 2023-11-05T08:07:10.603 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.531+0000 7f3992ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:10.603 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.531+0000 7f3992ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-11-05T08:07:10.603 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.531+0000 7f3992ffd640 10 monclient: dump: 2023-11-05T08:07:10.603 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:10.603 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:10.604 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:10.604 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:10.604 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:10.604 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:10.604 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:10.605 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:10.605 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:10.605 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:10.605 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.531+0000 7f3999675640 5 monclient: authenticate success, global_id 4314 2023-11-05T08:07:10.605 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.531+0000 7f3999675640 10 monclient: get_monmap_and_config success 2023-11-05T08:07:10.605 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.531+0000 7f3999675640 4 set_mon_vals no callback set 2023-11-05T08:07:10.606 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.532+0000 7f3999675640 10 monclient: shutdown 2023-11-05T08:07:10.606 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.532+0000 7f3999675640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:07:10.606 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.532+0000 7f3999675640 1 -- 172.21.15.52:0/1145040525 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f398c030b40 msgr2=0x7f398c0d25b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:10.606 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.532+0000 7f3999675640 1 --2- 172.21.15.52:0/1145040525 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f398c030b40 0x7f398c0d25b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f399404ef50 tx=0x7f39940a5890 comp rx=0 tx=0).stop 2023-11-05T08:07:10.606 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.532+0000 7f3999675640 1 -- 172.21.15.52:0/1145040525 shutdown_connections 2023-11-05T08:07:10.607 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.532+0000 7f3999675640 1 --2- 172.21.15.52:0/1145040525 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f398c030b40 0x7f398c0d25b0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:10.607 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.532+0000 7f3999675640 1 --2- 172.21.15.52:0/1145040525 >> v2:172.21.15.156:3300/0 conn(0x7f398c038eb0 0x7f398c0339a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:10.607 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.532+0000 7f3999675640 1 -- 172.21.15.52:0/1145040525 >> 172.21.15.52:0/1145040525 conn(0x7f398c0065a0 msgr2=0x7f398c0069b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:07:10.607 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.532+0000 7f3999675640 1 -- 172.21.15.52:0/1145040525 shutdown_connections 2023-11-05T08:07:10.607 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.532+0000 7f3999675640 1 -- 172.21.15.52:0/1145040525 wait complete. 2023-11-05T08:07:10.607 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.533+0000 7f3999675640 10 monclient: build_initial_monmap 2023-11-05T08:07:10.608 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.533+0000 7f3999675640 10 monclient: monmap: 2023-11-05T08:07:10.608 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:07:10.608 INFO:teuthology.orchestra.run.smithi052.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-05T08:07:10.608 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 0.000000 2023-11-05T08:07:10.609 INFO:teuthology.orchestra.run.smithi052.stderr:created 0.000000 2023-11-05T08:07:10.609 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:07:10.609 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:10.609 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.noname-a 2023-11-05T08:07:10.609 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.noname-b 2023-11-05T08:07:10.609 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-c 2023-11-05T08:07:10.610 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:10.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.533+0000 7f3999675640 1 librados: starting msgr at 2023-11-05T08:07:10.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.533+0000 7f3999675640 1 librados: starting objecter 2023-11-05T08:07:10.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.533+0000 7f3999675640 1 Processor -- start 2023-11-05T08:07:10.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.533+0000 7f3999675640 1 -- start start 2023-11-05T08:07:10.611 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.533+0000 7f3999675640 1 librados: setting wanted keys 2023-11-05T08:07:10.611 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.533+0000 7f3999675640 1 librados: calling monclient init 2023-11-05T08:07:10.611 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.533+0000 7f3999675640 10 monclient: init 2023-11-05T08:07:10.611 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.534+0000 7f3999675640 10 monclient: _reopen_session rank -1 2023-11-05T08:07:10.611 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.534+0000 7f3999675640 10 monclient: _add_conns ranks=[0,2,1] 2023-11-05T08:07:10.612 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.534+0000 7f3999675640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f398c030b40 0x7f398c0a8840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:10.612 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.534+0000 7f3999675640 10 monclient(hunting): picked mon.noname-a con 0x7f398c030b40 addr [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] 2023-11-05T08:07:10.612 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.534+0000 7f3999675640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f398c038eb0 0x7f398c0a7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:10.612 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.534+0000 7f3999675640 10 monclient(hunting): picked mon.noname-c con 0x7f398c038eb0 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:07:10.612 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.534+0000 7f3999675640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f398c0a5160 0x7f398c15d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:10.612 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.534+0000 7f3999675640 10 monclient(hunting): picked mon.noname-b con 0x7f398c0a5160 addr [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] 2023-11-05T08:07:10.613 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.534+0000 7f3999675640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:10.613 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.534+0000 7f3999675640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f398c0a6d80 con 0x7f398c030b40 2023-11-05T08:07:10.613 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.534+0000 7f3999675640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:10.613 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.534+0000 7f3999675640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f398c0a8d80 con 0x7f398c0a5160 2023-11-05T08:07:10.613 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.534+0000 7f3999675640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:10.614 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.534+0000 7f3999675640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f398c15ce40 con 0x7f398c038eb0 2023-11-05T08:07:10.614 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.534+0000 7f3999675640 10 monclient(hunting): _renew_subs 2023-11-05T08:07:10.614 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.534+0000 7f3999675640 10 monclient(hunting): authenticate will time out at 1376.740509s 2023-11-05T08:07:10.614 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.535+0000 7f39937fe640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f398c038eb0 0x7f398c0a7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:10.614 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.535+0000 7f39937fe640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f398c038eb0 0x7f398c0a7aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.52:40330/0 (socket says 172.21.15.52:40330) 2023-11-05T08:07:10.615 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.535+0000 7f39937fe640 1 -- 172.21.15.52:0/1137646105 learned_addr learned my addr 172.21.15.52:0/1137646105 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-11-05T08:07:10.615 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.535+0000 7f39937fe640 10 monclient(hunting): get_auth_request con 0x7f398c038eb0 auth_method 0 2023-11-05T08:07:10.615 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.535+0000 7f39937fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:10.615 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.535+0000 7f39937fe640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:10.615 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.535+0000 7f39937fe640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:10.616 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.535+0000 7f8666ffd640 1 -- 172.21.15.52:0/2569719712 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f866002ca80 con 0x7f866813efb0 2023-11-05T08:07:10.616 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.536+0000 7f8666ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:10.616 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.536+0000 7f8666ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-11-05T08:07:10.616 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.536+0000 7f8666ffd640 10 monclient: dump: 2023-11-05T08:07:10.617 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:10.617 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:10.617 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:10.617 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:10.617 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:10.618 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:10.618 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:10.618 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:10.618 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:10.618 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:10.619 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.536+0000 7f8666ffd640 10 monclient: _finish_auth 0 2023-11-05T08:07:10.619 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.536+0000 7f8666ffd640 10 monclient: _check_auth_tickets 2023-11-05T08:07:10.619 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.536+0000 7f8666ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:07:10.619 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.536+0000 7f8666ffd640 1 -- 172.21.15.52:0/2569719712 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f866002cbe0 con 0x7f866813efb0 2023-11-05T08:07:10.619 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.536+0000 7f8666ffd640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:07:10.620 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.536+0000 7f8666ffd640 1 -- 172.21.15.52:0/2569719712 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86600343f0 con 0x7f866813efb0 2023-11-05T08:07:10.620 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.536+0000 7f8666ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:10.620 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.536+0000 7f8666ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-11-05T08:07:10.620 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.536+0000 7f8666ffd640 10 monclient: dump: 2023-11-05T08:07:10.620 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:10.621 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:10.621 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:10.621 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:10.621 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:10.621 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:10.621 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:10.622 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:10.622 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:10.622 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:10.622 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.536+0000 7f866d434640 5 monclient: authenticate success, global_id 4317 2023-11-05T08:07:10.622 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.536+0000 7f866d434640 10 monclient: get_monmap_and_config success 2023-11-05T08:07:10.623 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.536+0000 7f866d434640 4 set_mon_vals no callback set 2023-11-05T08:07:10.623 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.536+0000 7f39937fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:10.623 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.536+0000 7f39937fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:10.624 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.536+0000 7f39937fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:10.624 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.536+0000 7f866d434640 10 monclient: shutdown 2023-11-05T08:07:10.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.536+0000 7f866d434640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:07:10.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.536+0000 7f866d434640 1 -- 172.21.15.52:0/2569719712 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f866813efb0 msgr2=0x7f86680b0f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:10.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.536+0000 7f866d434640 1 --2- 172.21.15.52:0/2569719712 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f866813efb0 0x7f86680b0f00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f86680b4ba0 tx=0x7f866002bee0 comp rx=0 tx=0).stop 2023-11-05T08:07:10.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.536+0000 7f866d434640 1 -- 172.21.15.52:0/2569719712 shutdown_connections 2023-11-05T08:07:10.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.536+0000 7f866d434640 1 --2- 172.21.15.52:0/2569719712 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f866813efb0 0x7f86680b0f00 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:10.626 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.536+0000 7f866d434640 1 --2- 172.21.15.52:0/2569719712 >> v2:172.21.15.156:3300/0 conn(0x7f86680ad980 0x7f86680ae5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:10.626 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.537+0000 7f866d434640 1 -- 172.21.15.52:0/2569719712 >> 172.21.15.52:0/2569719712 conn(0x7f86680b7020 msgr2=0x7f86680b7430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:07:10.626 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.537+0000 7f866d434640 1 -- 172.21.15.52:0/2569719712 shutdown_connections 2023-11-05T08:07:10.626 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.537+0000 7f866d434640 1 -- 172.21.15.52:0/2569719712 wait complete. 2023-11-05T08:07:10.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.537+0000 7f866d434640 10 monclient: build_initial_monmap 2023-11-05T08:07:10.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.537+0000 7f866d434640 10 monclient: monmap: 2023-11-05T08:07:10.627 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:07:10.627 INFO:teuthology.orchestra.run.smithi052.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-05T08:07:10.627 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 0.000000 2023-11-05T08:07:10.627 INFO:teuthology.orchestra.run.smithi052.stderr:created 0.000000 2023-11-05T08:07:10.628 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:07:10.628 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:10.628 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.noname-a 2023-11-05T08:07:10.628 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.noname-b 2023-11-05T08:07:10.628 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-c 2023-11-05T08:07:10.629 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:10.629 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.537+0000 7f3993fff640 1 --2- 172.21.15.52:0/1137646105 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f398c030b40 0x7f398c0a8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:10.630 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.538+0000 7f866d434640 1 librados: starting msgr at 2023-11-05T08:07:10.630 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.538+0000 7f866d434640 1 librados: starting objecter 2023-11-05T08:07:10.630 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.538+0000 7f866d434640 1 Processor -- start 2023-11-05T08:07:10.631 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.538+0000 7f866d434640 1 -- start start 2023-11-05T08:07:10.631 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.538+0000 7f866d434640 1 librados: setting wanted keys 2023-11-05T08:07:10.631 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.538+0000 7f866d434640 1 librados: calling monclient init 2023-11-05T08:07:10.631 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.538+0000 7f866d434640 10 monclient: init 2023-11-05T08:07:10.631 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.538+0000 7f866d434640 10 monclient: _reopen_session rank -1 2023-11-05T08:07:10.632 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.538+0000 7f866d434640 10 monclient: _add_conns ranks=[1,2,0] 2023-11-05T08:07:10.632 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.538+0000 7f866d434640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f86680ad980 0x7f8668139fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:10.632 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.538+0000 7f866d434640 10 monclient(hunting): picked mon.noname-b con 0x7f86680ad980 addr [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] 2023-11-05T08:07:10.632 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.538+0000 7f866d434640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f866813eb20 0x7f86681d67b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:10.632 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.538+0000 7f866d434640 10 monclient(hunting): picked mon.noname-c con 0x7f866813eb20 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:07:10.633 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.538+0000 7f866d434640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f866813efb0 0x7f86681d6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:10.633 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.538+0000 7f866d434640 10 monclient(hunting): picked mon.noname-a con 0x7f866813efb0 addr [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] 2023-11-05T08:07:10.633 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.538+0000 7f866d434640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:10.633 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.538+0000 7f866d434640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86681d6320 con 0x7f866813efb0 2023-11-05T08:07:10.633 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.538+0000 7f866d434640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:10.633 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.538+0000 7f866d434640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86681d7230 con 0x7f86680ad980 2023-11-05T08:07:10.634 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.538+0000 7f866d434640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:10.634 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.538+0000 7f866d434640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86680b4e20 con 0x7f866813eb20 2023-11-05T08:07:10.634 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.538+0000 7f866d434640 10 monclient(hunting): _renew_subs 2023-11-05T08:07:10.634 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.538+0000 7f866d434640 10 monclient(hunting): authenticate will time out at 1376.744873s 2023-11-05T08:07:10.635 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.539+0000 7f3993fff640 10 monclient(hunting): get_auth_request con 0x7f398c030b40 auth_method 0 2023-11-05T08:07:10.635 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.539+0000 7f3993fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:10.635 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.539+0000 7f3993fff640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:10.635 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.539+0000 7f3993fff640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:10.635 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.540+0000 7f3993fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:10.636 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.540+0000 7f3993fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:10.636 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.540+0000 7f3993fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:10.636 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.541+0000 7f866cc33640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f866813efb0 0x7f86681d6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:10.638 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.541+0000 7f39937fe640 10 monclient(hunting): handle_auth_done global_id 4265 payload 824 2023-11-05T08:07:10.638 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.541+0000 7f39937fe640 1 -- 172.21.15.52:0/1137646105 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f398c0a5160 msgr2=0x7f398c15d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:10.638 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.541+0000 7f39937fe640 1 --2- 172.21.15.52:0/1137646105 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f398c0a5160 0x7f398c15d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:10.638 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.541+0000 7f39937fe640 1 -- 172.21.15.52:0/1137646105 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f398c030b40 msgr2=0x7f398c0a8840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:10.639 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.541+0000 7f39937fe640 1 --2- 172.21.15.52:0/1137646105 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f398c030b40 0x7f398c0a8840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:10.639 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.541+0000 7f39937fe640 10 monclient: _finish_hunting 0 2023-11-05T08:07:10.639 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.541+0000 7f39937fe640 1 monclient: found mon.noname-c 2023-11-05T08:07:10.639 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.541+0000 7f39937fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:07:10.639 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.541+0000 7f39937fe640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.52:3301/0 2023-11-05T08:07:10.640 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.541+0000 7f39937fe640 1 -- 172.21.15.52:0/1137646105 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3994074d40 con 0x7f398c038eb0 2023-11-05T08:07:10.640 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.545+0000 7f39937fe640 1 --2- 172.21.15.52:0/1137646105 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f398c038eb0 0x7f398c0a7aa0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f398000c400 tx=0x7f398000c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:10.640 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.545+0000 7f3990ff9640 10 client.?.objecter ms_handle_connect 0x7f398c038eb0 2023-11-05T08:07:10.640 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.545+0000 7f3990ff9640 10 client.?.objecter resend_mon_ops 2023-11-05T08:07:10.641 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.547+0000 7f86677fe640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f866813eb20 0x7f86681d67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:10.642 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.547+0000 7f86677fe640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f866813eb20 0x7f86681d67b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.52:40342/0 (socket says 172.21.15.52:40342) 2023-11-05T08:07:10.642 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.547+0000 7f86677fe640 1 -- 172.21.15.52:0/3013039951 learned_addr learned my addr 172.21.15.52:0/3013039951 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-11-05T08:07:10.642 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.547+0000 7f86677fe640 10 monclient(hunting): get_auth_request con 0x7f866813eb20 auth_method 0 2023-11-05T08:07:10.642 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.547+0000 7f86677fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:10.643 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.547+0000 7f86677fe640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:10.643 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.547+0000 7f86677fe640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:10.643 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.547+0000 7f866cc33640 10 monclient(hunting): get_auth_request con 0x7f866813efb0 auth_method 0 2023-11-05T08:07:10.643 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.547+0000 7f866cc33640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:10.643 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.547+0000 7f866cc33640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:10.644 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.547+0000 7f866cc33640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:10.644 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.547+0000 7f86677fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:10.644 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.547+0000 7f86677fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:10.644 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.547+0000 7f86677fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:10.645 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.549+0000 7f866cc33640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:10.645 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.549+0000 7f866cc33640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:10.645 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.549+0000 7f866cc33640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:10.645 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.551+0000 7f86677fe640 10 monclient(hunting): handle_auth_done global_id 4268 payload 824 2023-11-05T08:07:10.645 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.551+0000 7f86677fe640 1 -- 172.21.15.52:0/3013039951 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f86680ad980 msgr2=0x7f8668139fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:10.646 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.551+0000 7f86677fe640 1 --2- 172.21.15.52:0/3013039951 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f86680ad980 0x7f8668139fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:10.646 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.551+0000 7f86677fe640 1 -- 172.21.15.52:0/3013039951 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f866813efb0 msgr2=0x7f86681d6cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:10.646 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.551+0000 7f86677fe640 1 --2- 172.21.15.52:0/3013039951 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f866813efb0 0x7f86681d6cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:10.646 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.551+0000 7f86677fe640 10 monclient: _finish_hunting 0 2023-11-05T08:07:10.646 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.551+0000 7f86677fe640 1 monclient: found mon.noname-c 2023-11-05T08:07:10.647 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.551+0000 7f86677fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:07:10.647 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.552+0000 7f86677fe640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.52:3301/0 2023-11-05T08:07:10.647 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.552+0000 7f86677fe640 1 -- 172.21.15.52:0/3013039951 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8660009b30 con 0x7f866813eb20 2023-11-05T08:07:10.647 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.556+0000 7f86677fe640 1 --2- 172.21.15.52:0/3013039951 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f866813eb20 0x7f86681d67b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f865c00c440 tx=0x7f865c00c900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:10.647 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.556+0000 7f8664ff9640 10 client.?.objecter ms_handle_connect 0x7f866813eb20 2023-11-05T08:07:10.648 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.556+0000 7f8664ff9640 10 client.?.objecter resend_mon_ops 2023-11-05T08:07:10.659 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.658+0000 7f5022ffd640 1 -- 172.21.15.52:0/1297045474 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f501802e070 con 0x7f50240b41f0 2023-11-05T08:07:10.659 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.658+0000 7f5022ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:10.660 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.658+0000 7f5022ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-05T08:07:10.660 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.658+0000 7f5022ffd640 10 monclient: dump: 2023-11-05T08:07:10.660 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:10.660 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:10.661 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:10.661 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:10.661 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:10.661 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:10.661 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:10.661 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:10.662 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:10.662 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:10.662 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.658+0000 7f5022ffd640 10 monclient: _finish_auth 0 2023-11-05T08:07:10.662 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.658+0000 7f5022ffd640 10 monclient: _check_auth_tickets 2023-11-05T08:07:10.663 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.658+0000 7f5022ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:07:10.663 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.658+0000 7f502aa1a640 5 monclient: authenticate success, global_id 4250 2023-11-05T08:07:10.663 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.658+0000 7f502aa1a640 20 monclient: get_monmap_and_config waiting for monmap|config 2023-11-05T08:07:10.664 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.658+0000 7f009cc35640 1 -- 172.21.15.52:0/1766171526 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0094008df0 con 0x7f00980ae970 2023-11-05T08:07:10.664 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.659+0000 7f009cc35640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:10.664 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.659+0000 7f009cc35640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-05T08:07:10.664 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.659+0000 7f009cc35640 10 monclient: dump: 2023-11-05T08:07:10.665 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:10.665 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:10.665 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:10.665 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:10.665 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:10.666 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:10.666 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:10.666 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:10.666 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:10.666 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:10.667 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.659+0000 7f009cc35640 10 monclient: _finish_auth 0 2023-11-05T08:07:10.667 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.659+0000 7f009cc35640 10 monclient: _check_auth_tickets 2023-11-05T08:07:10.667 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.659+0000 7f009cc35640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:07:10.667 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.659+0000 7f009fe9b640 5 monclient: authenticate success, global_id 4244 2023-11-05T08:07:10.667 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.659+0000 7f009fe9b640 20 monclient: get_monmap_and_config waiting for monmap|config 2023-11-05T08:07:10.668 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.659+0000 7f675bfff640 1 -- 172.21.15.52:0/2141157636 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f676c03e610 con 0x7f67741d6330 2023-11-05T08:07:10.668 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.659+0000 7f675bfff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:10.669 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.659+0000 7f675bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-11-05T08:07:10.669 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.659+0000 7f675bfff640 10 monclient: dump: 2023-11-05T08:07:10.669 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:10.669 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:10.669 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:10.670 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:10.670 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:10.670 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:10.670 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:10.670 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:10.671 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:10.671 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:10.671 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.659+0000 7f675bfff640 10 monclient: _finish_auth 0 2023-11-05T08:07:10.671 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.659+0000 7f675bfff640 10 monclient: _check_auth_tickets 2023-11-05T08:07:10.671 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.659+0000 7f675bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:07:10.672 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.659+0000 7f6779e64640 5 monclient: authenticate success, global_id 4256 2023-11-05T08:07:10.672 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.659+0000 7f6779e64640 10 monclient: _renew_subs 2023-11-05T08:07:10.672 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.659+0000 7f6779e64640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.52:3301/0 2023-11-05T08:07:10.672 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.659+0000 7f6779e64640 1 -- 172.21.15.52:0/2141157636 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67740aa6a0 con 0x7f67741d6330 2023-11-05T08:07:10.672 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.659+0000 7f6779e64640 10 client.4256.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-05T08:07:10.673 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.659+0000 7f6779e64640 10 monclient: _renew_subs 2023-11-05T08:07:10.673 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.659+0000 7f6779e64640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.52:3301/0 2023-11-05T08:07:10.673 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.659+0000 7f6779e64640 1 -- 172.21.15.52:0/2141157636 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67740a97a0 con 0x7f67741d6330 2023-11-05T08:07:10.673 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.659+0000 7f6779e64640 1 librados: init done 2023-11-05T08:07:10.673 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.660+0000 7f6779e64640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-05T08:07:10.673 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.660+0000 7f6779e64640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:07:10.674 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.660+0000 7f6779e64640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.52:3301/0 2023-11-05T08:07:10.674 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.660+0000 7f6779e64640 1 -- 172.21.15.52:0/2141157636 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67740a94c0 con 0x7f67741d6330 2023-11-05T08:07:10.674 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.664+0000 7f0d01416640 1 -- 172.21.15.52:0/3825478020 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cec0317c0 con 0x7f0cfc0b38d0 2023-11-05T08:07:10.675 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.664+0000 7f0d01416640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:10.675 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.664+0000 7f0d01416640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-05T08:07:10.675 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.664+0000 7f0d01416640 10 monclient: dump: 2023-11-05T08:07:10.675 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:10.675 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:10.676 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:10.676 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:10.676 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:10.676 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:10.676 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:10.677 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:10.677 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:10.677 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:10.677 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.664+0000 7f0d01416640 10 monclient: _finish_auth 0 2023-11-05T08:07:10.677 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.664+0000 7f0d01416640 10 monclient: _check_auth_tickets 2023-11-05T08:07:10.677 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.664+0000 7f0d01416640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:07:10.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.664+0000 7f0d0467c640 5 monclient: authenticate success, global_id 4259 2023-11-05T08:07:10.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.664+0000 7f0d0467c640 20 monclient: get_monmap_and_config waiting for monmap|config 2023-11-05T08:07:10.679 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.665+0000 7f3b3e7fc640 1 -- 172.21.15.52:0/1213078853 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b44032c30 con 0x7f3b480ade00 2023-11-05T08:07:10.679 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.665+0000 7f3b3e7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:10.680 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.665+0000 7f3b3e7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-11-05T08:07:10.680 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.665+0000 7f3b3e7fc640 10 monclient: dump: 2023-11-05T08:07:10.680 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:10.680 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:10.680 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:10.680 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:10.681 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:10.681 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:10.681 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:10.681 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:10.681 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:10.682 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:10.682 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.665+0000 7f3b3e7fc640 10 monclient: _finish_auth 0 2023-11-05T08:07:10.682 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.665+0000 7f3b3e7fc640 10 monclient: _check_auth_tickets 2023-11-05T08:07:10.682 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.665+0000 7f3b3e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:07:10.682 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.665+0000 7f3b4fd6c640 5 monclient: authenticate success, global_id 4262 2023-11-05T08:07:10.683 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.665+0000 7f3b4fd6c640 10 monclient: _renew_subs 2023-11-05T08:07:10.683 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.665+0000 7f3b4fd6c640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.52:3301/0 2023-11-05T08:07:10.683 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.665+0000 7f3b4fd6c640 1 -- 172.21.15.52:0/1213078853 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b48145980 con 0x7f3b480ade00 2023-11-05T08:07:10.683 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.665+0000 7f3b4fd6c640 10 client.4262.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-05T08:07:10.683 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.665+0000 7f3b4fd6c640 10 monclient: _renew_subs 2023-11-05T08:07:10.683 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.665+0000 7f3b4fd6c640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.52:3301/0 2023-11-05T08:07:10.684 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.665+0000 7f3b4fd6c640 1 -- 172.21.15.52:0/1213078853 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b481da470 con 0x7f3b480ade00 2023-11-05T08:07:10.684 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.665+0000 7f3b4fd6c640 1 librados: init done 2023-11-05T08:07:10.684 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.666+0000 7f3b4fd6c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-05T08:07:10.684 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.666+0000 7f3b4fd6c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:07:10.684 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.666+0000 7f3b4fd6c640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.52:3301/0 2023-11-05T08:07:10.685 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.666+0000 7f3b4fd6c640 1 -- 172.21.15.52:0/1213078853 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b480a8c80 con 0x7f3b480ade00 2023-11-05T08:07:10.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.669+0000 7f3990ff9640 1 -- 172.21.15.52:0/1137646105 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39800074e0 con 0x7f398c038eb0 2023-11-05T08:07:10.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.669+0000 7f3990ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:10.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.669+0000 7f3990ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-11-05T08:07:10.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.669+0000 7f3990ff9640 10 monclient: dump: 2023-11-05T08:07:10.687 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:10.687 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:10.687 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:10.687 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:10.687 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:10.688 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:10.688 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:10.688 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:10.688 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:10.688 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:10.689 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.669+0000 7f3990ff9640 10 monclient: _finish_auth 0 2023-11-05T08:07:10.689 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.669+0000 7f3990ff9640 10 monclient: _check_auth_tickets 2023-11-05T08:07:10.689 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.669+0000 7f3990ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:07:10.689 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.669+0000 7f3999675640 5 monclient: authenticate success, global_id 4265 2023-11-05T08:07:10.689 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.669+0000 7f3999675640 10 monclient: _renew_subs 2023-11-05T08:07:10.689 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.669+0000 7f3999675640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.52:3301/0 2023-11-05T08:07:10.690 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.669+0000 7f3999675640 1 -- 172.21.15.52:0/1137646105 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f398c0a7fe0 con 0x7f398c038eb0 2023-11-05T08:07:10.690 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.669+0000 7f3999675640 10 client.4265.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-05T08:07:10.690 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.669+0000 7f3999675640 10 monclient: _renew_subs 2023-11-05T08:07:10.690 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.669+0000 7f3999675640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.52:3301/0 2023-11-05T08:07:10.690 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.669+0000 7f3999675640 1 -- 172.21.15.52:0/1137646105 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f398c15da80 con 0x7f398c038eb0 2023-11-05T08:07:10.691 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.669+0000 7f3999675640 1 librados: init done 2023-11-05T08:07:10.691 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.670+0000 7f3999675640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-05T08:07:10.691 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.670+0000 7f3999675640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:07:10.691 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.670+0000 7f3999675640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.52:3301/0 2023-11-05T08:07:10.691 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.670+0000 7f3999675640 1 -- 172.21.15.52:0/1137646105 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f398c15d060 con 0x7f398c038eb0 2023-11-05T08:07:10.692 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.674+0000 7f8f68ff9640 1 -- 172.21.15.52:0/2821365872 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8f5c0550f0 con 0x7f8f6c0a8fe0 2023-11-05T08:07:10.692 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.674+0000 7f8f68ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:07:10.692 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.674+0000 7f8f68ff9640 10 monclient: _finish_command 1 = system:0 2023-11-05T08:07:10.881 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.879+0000 7f8f726a9640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 7}] 2023-11-05T08:07:10.881 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.879+0000 7f8f726a9640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 7}] 2023-11-05T08:07:10.881 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.879+0000 7f8f726a9640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:07:10.881 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.879+0000 7f8f726a9640 1 -- 172.21.15.52:0/2821365872 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f8f6c1d3010 con 0x7f8f6c0a8fe0 2023-11-05T08:07:10.889 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.888+0000 7f8f68ff9640 1 -- 172.21.15.52:0/2821365872 <== mon.1 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8f5c017090 con 0x7f8f6c0a8fe0 2023-11-05T08:07:10.889 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.888+0000 7f8f68ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 7}] 2023-11-05T08:07:10.889 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.888+0000 7f8f68ff9640 10 monclient: _finish_command 2 = system:0 2023-11-05T08:07:10.890 INFO:teuthology.orchestra.run.smithi052.stdout:60129542148 2023-11-05T08:07:10.891 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.889+0000 7f8f726a9640 10 librados: watch_flush enter 2023-11-05T08:07:10.892 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.889+0000 7f8f726a9640 10 librados: watch_flush exit 2023-11-05T08:07:10.892 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.889+0000 7f8f726a9640 20 client.4339.objecter shutdown clearing up homeless session... 2023-11-05T08:07:10.892 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.889+0000 7f8f726a9640 10 client.4339.objecter successfully canceled tick 2023-11-05T08:07:10.892 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.889+0000 7f8f726a9640 1 -- 172.21.15.52:0/2821365872 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f8f5806c850 msgr2=0x7f8f5806ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:10.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.889+0000 7f8f726a9640 1 --2- 172.21.15.52:0/2821365872 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f8f5806c850 0x7f8f5806ed10 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8f6403a000 tx=0x7f8f64034000 comp rx=0 tx=0).stop 2023-11-05T08:07:10.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.889+0000 7f8f726a9640 10 monclient: shutdown 2023-11-05T08:07:10.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.890+0000 7f8f726a9640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:07:10.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.890+0000 7f8f726a9640 1 -- 172.21.15.52:0/2821365872 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f6c0a8fe0 msgr2=0x7f8f6c0b1d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:10.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.890+0000 7f8f726a9640 1 --2- 172.21.15.52:0/2821365872 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f6c0a8fe0 0x7f8f6c0b1d30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c00e9b0 tx=0x7f8f5c00ee70 comp rx=0 tx=0).stop 2023-11-05T08:07:10.894 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.890+0000 7f8f726a9640 1 -- 172.21.15.52:0/2821365872 shutdown_connections 2023-11-05T08:07:10.894 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.890+0000 7f8f726a9640 1 --2- 172.21.15.52:0/2821365872 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f8f5806c850 0x7f8f5806ed10 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:10.894 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.890+0000 7f8f726a9640 1 --2- 172.21.15.52:0/2821365872 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8f6c13bee0 0x7f8f6c0acae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:10.894 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.890+0000 7f8f726a9640 1 --2- 172.21.15.52:0/2821365872 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f6c0aa160 0x7f8f6c1d2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:10.895 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.890+0000 7f8f726a9640 1 --2- 172.21.15.52:0/2821365872 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f6c0a8fe0 0x7f8f6c0b1d30 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:10.895 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.890+0000 7f8f726a9640 1 -- 172.21.15.52:0/2821365872 >> 172.21.15.52:0/2821365872 conn(0x7f8f6c0b0b90 msgr2=0x7f8f6c073690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:07:10.895 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.890+0000 7f8f726a9640 1 -- 172.21.15.52:0/2821365872 shutdown_connections 2023-11-05T08:07:10.895 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.890+0000 7f8f726a9640 1 -- 172.21.15.52:0/2821365872 wait complete. 2023-11-05T08:07:10.895 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:10.890+0000 7f8f726a9640 1 librados: shutdown 2023-11-05T08:07:10.902 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.7 2023-11-05T08:07:11.190 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.188+0000 7f5022ffd640 1 -- 172.21.15.52:0/1297045474 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50180315a0 con 0x7f50240b41f0 2023-11-05T08:07:11.190 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.188+0000 7f5022ffd640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:07:11.190 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.188+0000 7f5022ffd640 1 -- 172.21.15.52:0/1297045474 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5018031950 con 0x7f50240b41f0 2023-11-05T08:07:11.190 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.188+0000 7f5022ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:11.191 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.188+0000 7f5022ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-11-05T08:07:11.191 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.188+0000 7f5022ffd640 10 monclient: dump: 2023-11-05T08:07:11.191 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:11.191 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:11.192 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:11.192 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:11.192 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:11.192 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:11.192 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:11.192 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:11.193 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:11.193 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:11.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.188+0000 7f502aa1a640 10 monclient: get_monmap_and_config success 2023-11-05T08:07:11.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.188+0000 7f502aa1a640 4 set_mon_vals no callback set 2023-11-05T08:07:11.196 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.189+0000 7f502aa1a640 10 monclient: shutdown 2023-11-05T08:07:11.196 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.189+0000 7f502aa1a640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:07:11.197 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.189+0000 7f502aa1a640 1 -- 172.21.15.52:0/1297045474 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f50240b41f0 msgr2=0x7f50240adcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:11.197 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.189+0000 7f502aa1a640 1 --2- 172.21.15.52:0/1297045474 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f50240b41f0 0x7f50240adcd0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f50180097d0 tx=0x7f501802b840 comp rx=0 tx=0).stop 2023-11-05T08:07:11.197 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.189+0000 7f502aa1a640 1 -- 172.21.15.52:0/1297045474 shutdown_connections 2023-11-05T08:07:11.197 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.189+0000 7f502aa1a640 1 --2- 172.21.15.52:0/1297045474 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f50240b41f0 0x7f50240adcd0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:11.197 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.189+0000 7f502aa1a640 1 -- 172.21.15.52:0/1297045474 >> 172.21.15.52:0/1297045474 conn(0x7f5024065cd0 msgr2=0x7f50240660e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:07:11.198 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.189+0000 7f502aa1a640 1 -- 172.21.15.52:0/1297045474 shutdown_connections 2023-11-05T08:07:11.198 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.189+0000 7f502aa1a640 1 -- 172.21.15.52:0/1297045474 wait complete. 2023-11-05T08:07:11.198 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.190+0000 7f502aa1a640 10 monclient: build_initial_monmap 2023-11-05T08:07:11.198 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.190+0000 7f502aa1a640 10 monclient: monmap: 2023-11-05T08:07:11.198 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:07:11.199 INFO:teuthology.orchestra.run.smithi052.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-05T08:07:11.199 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 0.000000 2023-11-05T08:07:11.199 INFO:teuthology.orchestra.run.smithi052.stderr:created 0.000000 2023-11-05T08:07:11.199 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:07:11.199 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:11.200 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.noname-a 2023-11-05T08:07:11.200 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.noname-b 2023-11-05T08:07:11.200 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-c 2023-11-05T08:07:11.200 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:11.200 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.190+0000 7f502aa1a640 1 librados: starting msgr at 2023-11-05T08:07:11.201 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.190+0000 7f502aa1a640 1 librados: starting objecter 2023-11-05T08:07:11.201 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.190+0000 7f502aa1a640 1 Processor -- start 2023-11-05T08:07:11.201 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.191+0000 7f502aa1a640 1 -- start start 2023-11-05T08:07:11.201 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.191+0000 7f502aa1a640 1 librados: setting wanted keys 2023-11-05T08:07:11.201 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.191+0000 7f502aa1a640 1 librados: calling monclient init 2023-11-05T08:07:11.202 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.191+0000 7f502aa1a640 10 monclient: init 2023-11-05T08:07:11.202 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.191+0000 7f502aa1a640 10 monclient: _reopen_session rank -1 2023-11-05T08:07:11.202 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.191+0000 7f502aa1a640 10 monclient: _add_conns ranks=[0,1,2] 2023-11-05T08:07:11.202 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.191+0000 7f502aa1a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50240af370 0x7f5024146290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:11.202 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.191+0000 7f502aa1a640 10 monclient(hunting): picked mon.noname-a con 0x7f50240af370 addr [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] 2023-11-05T08:07:11.202 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.191+0000 7f502aa1a640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f50240b0ad0 0x7f50240b7020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:11.203 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.191+0000 7f502aa1a640 10 monclient(hunting): picked mon.noname-b con 0x7f50240b0ad0 addr [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] 2023-11-05T08:07:11.203 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.191+0000 7f502aa1a640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f50240b41f0 0x7f5024148320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:11.203 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.191+0000 7f502aa1a640 10 monclient(hunting): picked mon.noname-c con 0x7f50240b41f0 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:07:11.203 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.191+0000 7f502aa1a640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:11.203 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.191+0000 7f502aa1a640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5024147d00 con 0x7f50240af370 2023-11-05T08:07:11.204 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.191+0000 7f502aa1a640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:11.204 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.191+0000 7f502aa1a640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50240b78f0 con 0x7f50240b0ad0 2023-11-05T08:07:11.204 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.191+0000 7f502aa1a640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:11.204 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.191+0000 7f502aa1a640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50240b7d80 con 0x7f50240b41f0 2023-11-05T08:07:11.204 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.191+0000 7f502aa1a640 10 monclient(hunting): _renew_subs 2023-11-05T08:07:11.205 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.191+0000 7f502aa1a640 10 monclient(hunting): authenticate will time out at 1377.397607s 2023-11-05T08:07:11.205 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.192+0000 7f5023fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50240af370 0x7f5024146290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:11.205 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.192+0000 7f5023fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50240af370 0x7f5024146290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46998/0 (socket says 172.21.15.52:46998) 2023-11-05T08:07:11.205 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.192+0000 7f5023fff640 1 -- 172.21.15.52:0/1133386618 learned_addr learned my addr 172.21.15.52:0/1133386618 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-11-05T08:07:11.205 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.192+0000 7f5023fff640 10 monclient(hunting): get_auth_request con 0x7f50240af370 auth_method 0 2023-11-05T08:07:11.206 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.192+0000 7f5023fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:11.206 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.192+0000 7f5023fff640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:11.206 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.192+0000 7f5023fff640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:11.206 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.192+0000 7f50237fe640 1 --2- 172.21.15.52:0/1133386618 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f50240b0ad0 0x7f50240b7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:11.206 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.192+0000 7f50237fe640 10 monclient(hunting): get_auth_request con 0x7f50240b0ad0 auth_method 0 2023-11-05T08:07:11.207 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.192+0000 7f50237fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:11.207 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.192+0000 7f50237fe640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:11.207 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.192+0000 7f50237fe640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:11.207 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.193+0000 7f5023fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:11.207 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.193+0000 7f5023fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:11.207 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.193+0000 7f5023fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:11.208 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.193+0000 7f50237fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:11.208 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.193+0000 7f50237fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:11.208 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.193+0000 7f50237fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:11.210 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.196+0000 7f5023fff640 10 monclient(hunting): handle_auth_done global_id 4326 payload 824 2023-11-05T08:07:11.210 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.196+0000 7f5023fff640 1 -- 172.21.15.52:0/1133386618 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f50240b41f0 msgr2=0x7f5024148320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:11.210 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.196+0000 7f5023fff640 1 --2- 172.21.15.52:0/1133386618 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f50240b41f0 0x7f5024148320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:11.210 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.196+0000 7f5023fff640 1 -- 172.21.15.52:0/1133386618 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f50240b0ad0 msgr2=0x7f50240b7020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:11.211 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.196+0000 7f5023fff640 1 --2- 172.21.15.52:0/1133386618 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f50240b0ad0 0x7f50240b7020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:11.211 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.196+0000 7f5023fff640 10 monclient: _finish_hunting 0 2023-11-05T08:07:11.211 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.196+0000 7f5023fff640 1 monclient: found mon.noname-a 2023-11-05T08:07:11.211 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.196+0000 7f5023fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:07:11.211 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.196+0000 7f5023fff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.52:3300/0 2023-11-05T08:07:11.212 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.196+0000 7f5023fff640 1 -- 172.21.15.52:0/1133386618 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5018009400 con 0x7f50240af370 2023-11-05T08:07:11.212 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.198+0000 7f5023fff640 1 --2- 172.21.15.52:0/1133386618 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50240af370 0x7f5024146290 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5018034040 tx=0x7f50180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:11.212 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.198+0000 7f5020ff9640 10 client.?.objecter ms_handle_connect 0x7f50240af370 2023-11-05T08:07:11.212 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.198+0000 7f5020ff9640 10 client.?.objecter resend_mon_ops 2023-11-05T08:07:11.212 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.202+0000 7f5020ff9640 1 -- 172.21.15.52:0/1133386618 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5018006e10 con 0x7f50240af370 2023-11-05T08:07:11.213 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.202+0000 7f5020ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:11.213 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.202+0000 7f5020ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-11-05T08:07:11.213 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.202+0000 7f5020ff9640 10 monclient: dump: 2023-11-05T08:07:11.213 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:11.213 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:11.214 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:11.214 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:11.214 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:11.214 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:11.214 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:11.215 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:11.215 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:11.215 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:11.215 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.202+0000 7f5020ff9640 10 monclient: _finish_auth 0 2023-11-05T08:07:11.215 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.202+0000 7f5020ff9640 10 monclient: _check_auth_tickets 2023-11-05T08:07:11.216 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.202+0000 7f5020ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:07:11.216 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.202+0000 7f5020ff9640 1 -- 172.21.15.52:0/1133386618 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5018041070 con 0x7f50240af370 2023-11-05T08:07:11.216 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.202+0000 7f502aa1a640 5 monclient: authenticate success, global_id 4326 2023-11-05T08:07:11.216 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.202+0000 7f502aa1a640 10 monclient: _renew_subs 2023-11-05T08:07:11.216 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.202+0000 7f502aa1a640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.52:3300/0 2023-11-05T08:07:11.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.202+0000 7f502aa1a640 1 -- 172.21.15.52:0/1133386618 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50240b8000 con 0x7f50240af370 2023-11-05T08:07:11.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.202+0000 7f5020ff9640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:07:11.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.202+0000 7f5020ff9640 1 -- 172.21.15.52:0/1133386618 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5018003830 con 0x7f50240af370 2023-11-05T08:07:11.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.202+0000 7f5020ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:11.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.202+0000 7f5020ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-11-05T08:07:11.218 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.202+0000 7f502aa1a640 10 client.4326.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-05T08:07:11.218 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.202+0000 7f5020ff9640 10 monclient: dump: 2023-11-05T08:07:11.218 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:11.218 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:11.218 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:11.219 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:11.219 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:11.219 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:11.219 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:11.219 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:11.220 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:11.220 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:11.220 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.202+0000 7f50227fc640 4 set_mon_vals no callback set 2023-11-05T08:07:11.220 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.202+0000 7f502aa1a640 10 monclient: _renew_subs 2023-11-05T08:07:11.220 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.202+0000 7f502aa1a640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.52:3300/0 2023-11-05T08:07:11.221 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.202+0000 7f502aa1a640 1 -- 172.21.15.52:0/1133386618 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5024148a40 con 0x7f50240af370 2023-11-05T08:07:11.221 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.202+0000 7f502aa1a640 1 librados: init done 2023-11-05T08:07:11.221 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.202+0000 7f3b3e7fc640 1 -- 172.21.15.52:0/1213078853 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b44031e80 con 0x7f3b480ade00 2023-11-05T08:07:11.221 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.202+0000 7f3b3e7fc640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:07:11.222 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.202+0000 7f3b3e7fc640 1 -- 172.21.15.52:0/1213078853 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b4404e450 con 0x7f3b480ade00 2023-11-05T08:07:11.222 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.202+0000 7f3b3e7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:11.222 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.202+0000 7f3b3e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-11-05T08:07:11.222 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.202+0000 7f3b3e7fc640 10 monclient: dump: 2023-11-05T08:07:11.222 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:11.223 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:11.223 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:11.223 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:11.223 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:11.223 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:11.224 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:11.224 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:11.224 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:11.224 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:11.224 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.202+0000 7f3b3ffff640 4 set_mon_vals no callback set 2023-11-05T08:07:11.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.203+0000 7f502aa1a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-05T08:07:11.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.203+0000 7f502aa1a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:07:11.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.203+0000 7f502aa1a640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.52:3300/0 2023-11-05T08:07:11.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.203+0000 7f502aa1a640 1 -- 172.21.15.52:0/1133386618 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f502404e9f0 con 0x7f50240af370 2023-11-05T08:07:11.227 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.203+0000 7f3b3e7fc640 1 -- 172.21.15.52:0/1213078853 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3b4404e630 con 0x7f3b480ade00 2023-11-05T08:07:11.227 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.204+0000 7f3b3e7fc640 1 --2- 172.21.15.52:0/1213078853 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f3b2c06c830 0x7f3b2c06ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:11.227 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.204+0000 7f3b4d307640 1 --2- 172.21.15.52:0/1213078853 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f3b2c06c830 0x7f3b2c06ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:11.227 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.204+0000 7f3b4d307640 10 monclient: get_auth_request con 0x7f3b2c06c830 auth_method 0 2023-11-05T08:07:11.227 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.205+0000 7f3b4d307640 1 --2- 172.21.15.52:0/1213078853 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f3b2c06c830 0x7f3b2c06ecf0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3b481dae50 tx=0x7f3b38006c90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:11.228 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.205+0000 7f3b3e7fc640 10 client.4262.objecter ms_handle_connect 0x7f3b2c06c830 2023-11-05T08:07:11.228 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.217+0000 7f3b3e7fc640 1 -- 172.21.15.52:0/1213078853 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f3b44039310 con 0x7f3b480ade00 2023-11-05T08:07:11.228 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.217+0000 7f3b3e7fc640 10 client.4262.objecter ms_dispatch 0x7f3b48000b90 osd_map(23..23 src has 1..23) v4 2023-11-05T08:07:11.228 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.217+0000 7f3b3e7fc640 3 client.4262.objecter handle_osd_map got epochs [23,23] > 0 2023-11-05T08:07:11.228 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.217+0000 7f3b3e7fc640 3 client.4262.objecter handle_osd_map decoding full epoch 23 2023-11-05T08:07:11.229 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.217+0000 7f3b3e7fc640 20 client.4262.objecter dump_active .. 0 homeless 2023-11-05T08:07:11.229 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.217+0000 7f3b3e7fc640 1 -- 172.21.15.52:0/1213078853 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3b44076e00 con 0x7f3b480ade00 2023-11-05T08:07:11.229 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.217+0000 7f3b3e7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:07:11.229 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.217+0000 7f3b3e7fc640 10 monclient: _finish_command 1 = system:0 2023-11-05T08:07:11.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.218+0000 7f8664ff9640 1 -- 172.21.15.52:0/3013039951 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f865c005480 con 0x7f866813eb20 2023-11-05T08:07:11.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.218+0000 7f8664ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:11.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.218+0000 7f8664ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-11-05T08:07:11.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.218+0000 7f8664ff9640 10 monclient: dump: 2023-11-05T08:07:11.231 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:11.232 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:11.232 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:11.232 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:11.232 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:11.232 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:11.233 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:11.233 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:11.233 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:11.233 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:11.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.218+0000 7f8664ff9640 10 monclient: _finish_auth 0 2023-11-05T08:07:11.234 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.218+0000 7f8664ff9640 10 monclient: _check_auth_tickets 2023-11-05T08:07:11.234 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.218+0000 7f8664ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:07:11.234 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.218+0000 7f8664ff9640 1 -- 172.21.15.52:0/3013039951 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f865c0035f0 con 0x7f866813eb20 2023-11-05T08:07:11.234 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.218+0000 7f866d434640 5 monclient: authenticate success, global_id 4268 2023-11-05T08:07:11.234 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.218+0000 7f866d434640 10 monclient: _renew_subs 2023-11-05T08:07:11.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.218+0000 7f866d434640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.52:3301/0 2023-11-05T08:07:11.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.218+0000 7f866d434640 1 -- 172.21.15.52:0/3013039951 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8668139330 con 0x7f866813eb20 2023-11-05T08:07:11.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.218+0000 7f8664ff9640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:07:11.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.218+0000 7f8664ff9640 1 -- 172.21.15.52:0/3013039951 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f865c0039c0 con 0x7f866813eb20 2023-11-05T08:07:11.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.218+0000 7f8664ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:11.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.218+0000 7f8664ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-11-05T08:07:11.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.218+0000 7f8664ff9640 10 monclient: dump: 2023-11-05T08:07:11.236 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:11.236 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:11.236 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:11.236 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:11.237 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:11.237 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:11.237 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:11.237 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:11.237 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:11.238 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:11.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.218+0000 7f866d434640 10 client.4268.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-05T08:07:11.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.218+0000 7f866d434640 10 monclient: _renew_subs 2023-11-05T08:07:11.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.218+0000 7f866d434640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.52:3301/0 2023-11-05T08:07:11.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.218+0000 7f866d434640 1 -- 172.21.15.52:0/3013039951 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f866813a6f0 con 0x7f866813eb20 2023-11-05T08:07:11.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.218+0000 7f86667fc640 4 set_mon_vals no callback set 2023-11-05T08:07:11.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.218+0000 7f866d434640 1 librados: init done 2023-11-05T08:07:11.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.219+0000 7f866d434640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-05T08:07:11.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.219+0000 7f866d434640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:07:11.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.219+0000 7f866d434640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.52:3301/0 2023-11-05T08:07:11.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.219+0000 7f866d434640 1 -- 172.21.15.52:0/3013039951 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f866804e9f0 con 0x7f866813eb20 2023-11-05T08:07:11.244 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.220+0000 7f009cc35640 1 -- 172.21.15.52:0/1766171526 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f009400a0d0 con 0x7f00980ae970 2023-11-05T08:07:11.244 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.220+0000 7f009cc35640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:07:11.244 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.220+0000 7f009cc35640 1 -- 172.21.15.52:0/1766171526 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f009400a4a0 con 0x7f00980ae970 2023-11-05T08:07:11.244 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.220+0000 7f009cc35640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:11.245 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.220+0000 7f009cc35640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-11-05T08:07:11.245 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.220+0000 7f009cc35640 10 monclient: dump: 2023-11-05T08:07:11.245 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:11.245 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:11.245 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:11.245 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:11.246 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:11.246 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:11.246 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:11.246 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:11.246 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:11.247 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:11.247 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.220+0000 7f009fe9b640 10 monclient: get_monmap_and_config success 2023-11-05T08:07:11.247 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.220+0000 7f009fe9b640 4 set_mon_vals no callback set 2023-11-05T08:07:11.247 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.221+0000 7f009fe9b640 10 monclient: shutdown 2023-11-05T08:07:11.247 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.221+0000 7f009fe9b640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:07:11.248 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.221+0000 7f009fe9b640 1 -- 172.21.15.52:0/1766171526 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f00980ae970 msgr2=0x7f00980a6350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:11.248 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.221+0000 7f009fe9b640 1 --2- 172.21.15.52:0/1766171526 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f00980ae970 0x7f00980a6350 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0094008260 tx=0x7f009402dd00 comp rx=0 tx=0).stop 2023-11-05T08:07:11.248 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.221+0000 7f009fe9b640 1 -- 172.21.15.52:0/1766171526 shutdown_connections 2023-11-05T08:07:11.248 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.221+0000 7f009fe9b640 1 --2- 172.21.15.52:0/1766171526 >> v2:172.21.15.156:3300/0 conn(0x7f00980ab790 0x7f00981415a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:11.248 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.221+0000 7f009fe9b640 1 --2- 172.21.15.52:0/1766171526 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f00980ae970 0x7f00980a6350 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:11.249 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.221+0000 7f009fe9b640 1 -- 172.21.15.52:0/1766171526 >> 172.21.15.52:0/1766171526 conn(0x7f0098069dd0 msgr2=0x7f009806a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:07:11.249 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.222+0000 7f009fe9b640 1 -- 172.21.15.52:0/1766171526 shutdown_connections 2023-11-05T08:07:11.249 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.222+0000 7f009fe9b640 1 -- 172.21.15.52:0/1766171526 wait complete. 2023-11-05T08:07:11.249 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.222+0000 7f009fe9b640 10 monclient: build_initial_monmap 2023-11-05T08:07:11.249 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.222+0000 7f009fe9b640 10 monclient: monmap: 2023-11-05T08:07:11.250 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:07:11.250 INFO:teuthology.orchestra.run.smithi052.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-05T08:07:11.250 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 0.000000 2023-11-05T08:07:11.250 INFO:teuthology.orchestra.run.smithi052.stderr:created 0.000000 2023-11-05T08:07:11.250 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:07:11.251 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:11.251 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.noname-a 2023-11-05T08:07:11.251 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.noname-b 2023-11-05T08:07:11.251 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-c 2023-11-05T08:07:11.252 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:11.252 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.222+0000 7f009fe9b640 1 librados: starting msgr at 2023-11-05T08:07:11.252 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.222+0000 7f009fe9b640 1 librados: starting objecter 2023-11-05T08:07:11.252 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.223+0000 7f009fe9b640 1 Processor -- start 2023-11-05T08:07:11.252 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.223+0000 7f009fe9b640 1 -- start start 2023-11-05T08:07:11.252 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.223+0000 7f009fe9b640 1 librados: setting wanted keys 2023-11-05T08:07:11.253 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.223+0000 7f009fe9b640 1 librados: calling monclient init 2023-11-05T08:07:11.253 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.223+0000 7f009fe9b640 10 monclient: init 2023-11-05T08:07:11.253 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.223+0000 7f009fe9b640 10 monclient: _reopen_session rank -1 2023-11-05T08:07:11.253 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.223+0000 7f009fe9b640 10 monclient: _add_conns ranks=[2,1,0] 2023-11-05T08:07:11.253 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.223+0000 7f009fe9b640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f009806b090 0x7f0098099cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:11.254 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.223+0000 7f009fe9b640 10 monclient(hunting): picked mon.noname-c con 0x7f009806b090 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:07:11.254 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.223+0000 7f009fe9b640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f00980ab790 0x7f009813b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:11.254 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.223+0000 7f009fe9b640 10 monclient(hunting): picked mon.noname-b con 0x7f00980ab790 addr [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] 2023-11-05T08:07:11.254 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.223+0000 7f009fe9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f00980ae970 0x7f009813bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:11.254 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.223+0000 7f009fe9b640 10 monclient(hunting): picked mon.noname-a con 0x7f00980ae970 addr [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] 2023-11-05T08:07:11.255 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.223+0000 7f009fe9b640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:11.255 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.223+0000 7f009fe9b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0098071000 con 0x7f00980ae970 2023-11-05T08:07:11.255 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.223+0000 7f009fe9b640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:11.255 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.223+0000 7f009fe9b640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0098070c80 con 0x7f00980ab790 2023-11-05T08:07:11.256 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.223+0000 7f009fe9b640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:11.256 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.223+0000 7f009fe9b640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f009813c310 con 0x7f009806b090 2023-11-05T08:07:11.256 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.223+0000 7f009fe9b640 10 monclient(hunting): _renew_subs 2023-11-05T08:07:11.256 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.223+0000 7f009fe9b640 10 monclient(hunting): authenticate will time out at 1377.429664s 2023-11-05T08:07:11.256 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.224+0000 7f009d436640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f00980ab790 0x7f009813b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:11.256 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.224+0000 7f009d436640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f00980ab790 0x7f009813b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.52:59120/0 (socket says 172.21.15.52:59120) 2023-11-05T08:07:11.257 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.224+0000 7f009d436640 1 -- 172.21.15.52:0/3956986862 learned_addr learned my addr 172.21.15.52:0/3956986862 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-11-05T08:07:11.257 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.224+0000 7f009d436640 10 monclient(hunting): get_auth_request con 0x7f00980ab790 auth_method 0 2023-11-05T08:07:11.257 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.224+0000 7f009d436640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:11.257 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.224+0000 7f009d436640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:11.257 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.224+0000 7f009d436640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:11.258 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.225+0000 7f009d436640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:11.258 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.225+0000 7f009d436640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:11.258 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.225+0000 7f009d436640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:11.258 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.228+0000 7f009d436640 10 monclient(hunting): handle_auth_done global_id 4345 payload 824 2023-11-05T08:07:11.258 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.228+0000 7f009d436640 1 -- 172.21.15.52:0/3956986862 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f009806b090 msgr2=0x7f0098099cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:11.259 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.228+0000 7f009d436640 1 --2- 172.21.15.52:0/3956986862 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f009806b090 0x7f0098099cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:11.259 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.228+0000 7f009d436640 1 -- 172.21.15.52:0/3956986862 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f00980ae970 msgr2=0x7f009813bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:11.259 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.228+0000 7f009d436640 1 --2- 172.21.15.52:0/3956986862 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f00980ae970 0x7f009813bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:11.259 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.228+0000 7f009d436640 10 monclient: _finish_hunting 0 2023-11-05T08:07:11.259 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.228+0000 7f009d436640 1 monclient: found mon.noname-b 2023-11-05T08:07:11.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.228+0000 7f009d436640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:07:11.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.228+0000 7f009d436640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.156:3300/0 2023-11-05T08:07:11.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.228+0000 7f009d436640 1 -- 172.21.15.52:0/3956986862 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f009400ae30 con 0x7f00980ab790 2023-11-05T08:07:11.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.230+0000 7f009d436640 1 --2- 172.21.15.52:0/3956986862 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f00980ab790 0x7f009813b890 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f009000cbc0 tx=0x7f009000a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:11.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.230+0000 7f008e7fc640 10 client.?.objecter ms_handle_connect 0x7f00980ab790 2023-11-05T08:07:11.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.230+0000 7f008e7fc640 10 client.?.objecter resend_mon_ops 2023-11-05T08:07:11.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.234+0000 7f008e7fc640 1 -- 172.21.15.52:0/3956986862 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f009000aca0 con 0x7f00980ab790 2023-11-05T08:07:11.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.234+0000 7f008e7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:11.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.234+0000 7f008e7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-05T08:07:11.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.234+0000 7f008e7fc640 10 monclient: dump: 2023-11-05T08:07:11.262 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:11.262 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:11.262 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:11.262 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:11.262 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:11.263 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:11.263 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:11.263 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:11.263 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:11.263 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:11.263 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.234+0000 7f008e7fc640 10 monclient: _finish_auth 0 2023-11-05T08:07:11.264 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.234+0000 7f008e7fc640 10 monclient: _check_auth_tickets 2023-11-05T08:07:11.264 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.234+0000 7f008e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:07:11.264 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.234+0000 7f008e7fc640 1 -- 172.21.15.52:0/3956986862 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f009000ae00 con 0x7f00980ab790 2023-11-05T08:07:11.264 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.234+0000 7f008e7fc640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:07:11.264 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.234+0000 7f008e7fc640 1 -- 172.21.15.52:0/3956986862 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0090012600 con 0x7f00980ab790 2023-11-05T08:07:11.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.234+0000 7f009fe9b640 5 monclient: authenticate success, global_id 4345 2023-11-05T08:07:11.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.234+0000 7f008e7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:11.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.234+0000 7f008e7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-05T08:07:11.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.234+0000 7f008ffff640 4 set_mon_vals no callback set 2023-11-05T08:07:11.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.234+0000 7f008e7fc640 10 monclient: dump: 2023-11-05T08:07:11.266 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:11.266 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:11.266 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:11.266 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:11.266 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:11.267 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:11.267 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:11.267 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:11.267 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:11.267 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:11.268 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.234+0000 7f009fe9b640 10 monclient: _renew_subs 2023-11-05T08:07:11.268 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.234+0000 7f009fe9b640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:07:11.268 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.234+0000 7f009fe9b640 1 -- 172.21.15.52:0/3956986862 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f009813c5e0 con 0x7f00980ab790 2023-11-05T08:07:11.268 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.234+0000 7f009fe9b640 10 client.4345.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-05T08:07:11.268 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.234+0000 7f009fe9b640 10 monclient: _renew_subs 2023-11-05T08:07:11.269 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.234+0000 7f009fe9b640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:07:11.269 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.234+0000 7f009fe9b640 1 -- 172.21.15.52:0/3956986862 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f009809a320 con 0x7f00980ab790 2023-11-05T08:07:11.269 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.234+0000 7f009fe9b640 1 librados: init done 2023-11-05T08:07:11.269 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.235+0000 7f009fe9b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-05T08:07:11.269 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.235+0000 7f009fe9b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:07:11.270 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.235+0000 7f009fe9b640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:07:11.270 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.235+0000 7f009fe9b640 1 -- 172.21.15.52:0/3956986862 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f009806fd60 con 0x7f00980ab790 2023-11-05T08:07:11.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.253+0000 7f008e7fc640 1 -- 172.21.15.52:0/3956986862 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0090007070 con 0x7f00980ab790 2023-11-05T08:07:11.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.253+0000 7f008e7fc640 1 --2- 172.21.15.52:0/3956986862 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f007c06c800 0x7f007c06ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:11.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.253+0000 7f009dc37640 1 --2- 172.21.15.52:0/3956986862 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f007c06c800 0x7f007c06ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:11.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.253+0000 7f009dc37640 10 monclient: get_auth_request con 0x7f007c06c800 auth_method 0 2023-11-05T08:07:11.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.254+0000 7f009dc37640 1 --2- 172.21.15.52:0/3956986862 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f007c06c800 0x7f007c06ecc0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0094037000 tx=0x7f0094030000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:11.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.254+0000 7f008e7fc640 10 client.4345.objecter ms_handle_connect 0x7f007c06c800 2023-11-05T08:07:11.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.256+0000 7f008e7fc640 1 -- 172.21.15.52:0/3956986862 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f0090058720 con 0x7f00980ab790 2023-11-05T08:07:11.273 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.256+0000 7f008e7fc640 10 client.4345.objecter ms_dispatch 0x7f0098000b90 osd_map(23..23 src has 1..23) v4 2023-11-05T08:07:11.273 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.256+0000 7f008e7fc640 3 client.4345.objecter handle_osd_map got epochs [23,23] > 0 2023-11-05T08:07:11.273 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.256+0000 7f008e7fc640 3 client.4345.objecter handle_osd_map decoding full epoch 23 2023-11-05T08:07:11.273 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.256+0000 7f008e7fc640 20 client.4345.objecter dump_active .. 0 homeless 2023-11-05T08:07:11.401 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.399+0000 7f3b4fd6c640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 5}] 2023-11-05T08:07:11.401 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.399+0000 7f3b4fd6c640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2023-11-05T08:07:11.402 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.399+0000 7f3b4fd6c640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.52:3301/0 2023-11-05T08:07:11.402 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.399+0000 7f3b4fd6c640 1 -- 172.21.15.52:0/1213078853 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f3b4804e9f0 con 0x7f3b480ade00 2023-11-05T08:07:11.424 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.423+0000 7f675bfff640 1 -- 172.21.15.52:0/2141157636 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f676c03e770 con 0x7f67741d6330 2023-11-05T08:07:11.424 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.423+0000 7f675bfff640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:07:11.425 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.423+0000 7f6771ffb640 4 set_mon_vals no callback set 2023-11-05T08:07:11.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.466+0000 7f5020ff9640 1 -- 172.21.15.52:0/1133386618 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f5018043030 con 0x7f50240af370 2023-11-05T08:07:11.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.466+0000 7f5020ff9640 1 --2- 172.21.15.52:0/1133386618 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f501006c800 0x7f501006ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:11.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.466+0000 7f50237fe640 1 --2- 172.21.15.52:0/1133386618 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f501006c800 0x7f501006ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:11.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.466+0000 7f50237fe640 10 monclient: get_auth_request con 0x7f501006c800 auth_method 0 2023-11-05T08:07:11.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.467+0000 7f50237fe640 1 --2- 172.21.15.52:0/1133386618 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f501006c800 0x7f501006ecc0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5024147590 tx=0x7f5014009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:11.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.467+0000 7f5020ff9640 10 client.4326.objecter ms_handle_connect 0x7f501006c800 2023-11-05T08:07:11.488 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.487+0000 7f5020ff9640 1 -- 172.21.15.52:0/1133386618 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f501807b020 con 0x7f50240af370 2023-11-05T08:07:11.489 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.487+0000 7f5020ff9640 10 client.4326.objecter ms_dispatch 0x7f5024000b90 osd_map(23..23 src has 1..23) v4 2023-11-05T08:07:11.489 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.487+0000 7f5020ff9640 3 client.4326.objecter handle_osd_map got epochs [23,23] > 0 2023-11-05T08:07:11.489 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.487+0000 7f5020ff9640 3 client.4326.objecter handle_osd_map decoding full epoch 23 2023-11-05T08:07:11.489 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.487+0000 7f5020ff9640 20 client.4326.objecter dump_active .. 0 homeless 2023-11-05T08:07:11.490 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.487+0000 7f5020ff9640 1 -- 172.21.15.52:0/1133386618 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5018076c60 con 0x7f50240af370 2023-11-05T08:07:11.490 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.487+0000 7f5020ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:07:11.490 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.487+0000 7f5020ff9640 10 monclient: _finish_command 1 = system:0 2023-11-05T08:07:11.491 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.489+0000 7f008e7fc640 1 -- 172.21.15.52:0/3956986862 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0090054a60 con 0x7f00980ab790 2023-11-05T08:07:11.491 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.489+0000 7f008e7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:07:11.491 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.489+0000 7f008e7fc640 10 monclient: _finish_command 1 = system:0 2023-11-05T08:07:11.492 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.491+0000 7f675bfff640 1 -- 172.21.15.52:0/2141157636 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f676c03eb20 con 0x7f67741d6330 2023-11-05T08:07:11.492 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.491+0000 7f675bfff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:11.493 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.491+0000 7f675bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-11-05T08:07:11.493 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.491+0000 7f675bfff640 10 monclient: dump: 2023-11-05T08:07:11.493 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:11.493 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:11.493 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:11.493 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:11.494 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:11.494 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:11.494 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:11.494 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:11.494 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:11.495 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:11.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.492+0000 7f675bfff640 1 -- 172.21.15.52:0/2141157636 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f676c03b050 con 0x7f67741d6330 2023-11-05T08:07:11.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.492+0000 7f675bfff640 1 --2- 172.21.15.52:0/2141157636 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f676006c800 0x7f676006ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:11.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.493+0000 7f67737fe640 1 --2- 172.21.15.52:0/2141157636 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f676006c800 0x7f676006ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:11.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.493+0000 7f67737fe640 10 monclient: get_auth_request con 0x7f676006c800 auth_method 0 2023-11-05T08:07:11.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.493+0000 7f675bfff640 10 client.4256.objecter ms_handle_connect 0x7f676006c800 2023-11-05T08:07:11.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.493+0000 7f67737fe640 1 --2- 172.21.15.52:0/2141157636 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f676006c800 0x7f676006ecc0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6764006f40 tx=0x7f6764006e90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:11.499 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.497+0000 7f0d01416640 1 -- 172.21.15.52:0/3825478020 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cec031920 con 0x7f0cfc0b38d0 2023-11-05T08:07:11.499 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.497+0000 7f0d01416640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:07:11.499 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.497+0000 7f0d01416640 1 -- 172.21.15.52:0/3825478020 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cec031cb0 con 0x7f0cfc0b38d0 2023-11-05T08:07:11.499 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.497+0000 7f0d0467c640 10 monclient: get_monmap_and_config success 2023-11-05T08:07:11.499 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.497+0000 7f0d0467c640 4 set_mon_vals no callback set 2023-11-05T08:07:11.500 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.497+0000 7f0d01416640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:11.500 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.497+0000 7f0d01416640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-11-05T08:07:11.500 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.497+0000 7f0d01416640 10 monclient: dump: 2023-11-05T08:07:11.500 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:11.500 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:11.501 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:11.501 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:11.501 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:11.501 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:11.501 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:11.502 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:11.502 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:11.502 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:11.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.498+0000 7f0d0467c640 10 monclient: shutdown 2023-11-05T08:07:11.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.498+0000 7f0d0467c640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:07:11.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.498+0000 7f0d0467c640 1 -- 172.21.15.52:0/3825478020 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0cfc0b38d0 msgr2=0x7f0cfc0ae640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:11.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.498+0000 7f0d0467c640 1 --2- 172.21.15.52:0/3825478020 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0cfc0b38d0 0x7f0cfc0ae640 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0cec009870 tx=0x7f0cec02b860 comp rx=0 tx=0).stop 2023-11-05T08:07:11.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.498+0000 7f0d0467c640 1 -- 172.21.15.52:0/3825478020 shutdown_connections 2023-11-05T08:07:11.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.498+0000 7f0d0467c640 1 --2- 172.21.15.52:0/3825478020 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0cfc0b38d0 0x7f0cfc0ae640 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:11.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.498+0000 7f0d0467c640 1 --2- 172.21.15.52:0/3825478020 >> v2:172.21.15.156:3300/0 conn(0x7f0cfc0b4240 0x7f0cfc0b1150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:11.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.498+0000 7f0d0467c640 1 -- 172.21.15.52:0/3825478020 >> 172.21.15.52:0/3825478020 conn(0x7f0cfc065cd0 msgr2=0x7f0cfc0660e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:07:11.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.499+0000 7f0d0467c640 1 -- 172.21.15.52:0/3825478020 shutdown_connections 2023-11-05T08:07:11.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.499+0000 7f0d0467c640 1 -- 172.21.15.52:0/3825478020 wait complete. 2023-11-05T08:07:11.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.500+0000 7f0d0467c640 10 monclient: build_initial_monmap 2023-11-05T08:07:11.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.500+0000 7f0d0467c640 10 monclient: monmap: 2023-11-05T08:07:11.507 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:07:11.507 INFO:teuthology.orchestra.run.smithi052.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-05T08:07:11.507 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 0.000000 2023-11-05T08:07:11.508 INFO:teuthology.orchestra.run.smithi052.stderr:created 0.000000 2023-11-05T08:07:11.508 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:07:11.508 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:11.508 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.noname-a 2023-11-05T08:07:11.509 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.noname-b 2023-11-05T08:07:11.509 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-c 2023-11-05T08:07:11.509 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:11.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.500+0000 7f0d0467c640 1 librados: starting msgr at 2023-11-05T08:07:11.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.500+0000 7f0d0467c640 1 librados: starting objecter 2023-11-05T08:07:11.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.500+0000 7f0d0467c640 1 Processor -- start 2023-11-05T08:07:11.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.500+0000 7f0d0467c640 1 -- start start 2023-11-05T08:07:11.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.500+0000 7f0d0467c640 1 librados: setting wanted keys 2023-11-05T08:07:11.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.500+0000 7f0d0467c640 1 librados: calling monclient init 2023-11-05T08:07:11.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.500+0000 7f0d0467c640 10 monclient: init 2023-11-05T08:07:11.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.501+0000 7f0d0467c640 10 monclient: _reopen_session rank -1 2023-11-05T08:07:11.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.501+0000 7f0d0467c640 10 monclient: _add_conns ranks=[0,2,1] 2023-11-05T08:07:11.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.501+0000 7f0d0467c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0cfc0ade00 0x7f0cfc0a92f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:11.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.501+0000 7f0d0467c640 10 monclient(hunting): picked mon.noname-a con 0x7f0cfc0ade00 addr [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] 2023-11-05T08:07:11.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.501+0000 7f0d0467c640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0cfc0b4240 0x7f0cfc1d6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:11.512 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.501+0000 7f0d0467c640 10 monclient(hunting): picked mon.noname-c con 0x7f0cfc0b4240 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:07:11.512 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.501+0000 7f0d0467c640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0cfc0a9830 0x7f0cfc1d9c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:11.512 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.501+0000 7f0d0467c640 10 monclient(hunting): picked mon.noname-b con 0x7f0cfc0a9830 addr [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] 2023-11-05T08:07:11.512 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.501+0000 7f0d0467c640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:11.512 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.501+0000 7f0d0467c640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cfc1d68a0 con 0x7f0cfc0ade00 2023-11-05T08:07:11.512 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.501+0000 7f0d0467c640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:11.513 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.501+0000 7f0d0467c640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cfc13e900 con 0x7f0cfc0a9830 2023-11-05T08:07:11.513 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.501+0000 7f0d0467c640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:11.513 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.501+0000 7f0d0467c640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cfc0a8560 con 0x7f0cfc0b4240 2023-11-05T08:07:11.513 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.501+0000 7f0d0467c640 10 monclient(hunting): _renew_subs 2023-11-05T08:07:11.513 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.501+0000 7f0d0467c640 10 monclient(hunting): authenticate will time out at 1377.707725s 2023-11-05T08:07:11.514 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.502+0000 7f0d02c19640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0cfc0a9830 0x7f0cfc1d9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:11.514 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.502+0000 7f0d02c19640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0cfc0a9830 0x7f0cfc1d9c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.52:59136/0 (socket says 172.21.15.52:59136) 2023-11-05T08:07:11.514 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.502+0000 7f0d02c19640 1 -- 172.21.15.52:0/1685460913 learned_addr learned my addr 172.21.15.52:0/1685460913 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-11-05T08:07:11.514 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.502+0000 7f0d02c19640 10 monclient(hunting): get_auth_request con 0x7f0cfc0a9830 auth_method 0 2023-11-05T08:07:11.514 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.502+0000 7f0d02c19640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:11.515 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.502+0000 7f0d02c19640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:11.515 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.502+0000 7f0d02c19640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:11.515 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.503+0000 7f0d02c19640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:11.515 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.503+0000 7f0d02c19640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:11.515 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.503+0000 7f0d02c19640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:11.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.505+0000 7f0d02418640 1 --2- 172.21.15.52:0/1685460913 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0cfc0ade00 0x7f0cfc0a92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:11.517 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.505+0000 7f0d02c19640 10 monclient(hunting): handle_auth_done global_id 4348 payload 824 2023-11-05T08:07:11.517 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.505+0000 7f0d02c19640 1 -- 172.21.15.52:0/1685460913 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0cfc0b4240 msgr2=0x7f0cfc1d6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:11.517 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.505+0000 7f0d02c19640 1 --2- 172.21.15.52:0/1685460913 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0cfc0b4240 0x7f0cfc1d6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:11.517 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.505+0000 7f0d02c19640 1 -- 172.21.15.52:0/1685460913 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0cfc0ade00 msgr2=0x7f0cfc0a92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:11.517 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.505+0000 7f0d02c19640 1 --2- 172.21.15.52:0/1685460913 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0cfc0ade00 0x7f0cfc0a92f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:11.518 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.505+0000 7f0d02c19640 10 monclient: _finish_hunting 0 2023-11-05T08:07:11.518 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.505+0000 7f0d02c19640 1 monclient: found mon.noname-b 2023-11-05T08:07:11.518 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.505+0000 7f0d02c19640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:07:11.518 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.505+0000 7f0d02c19640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.156:3300/0 2023-11-05T08:07:11.518 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.505+0000 7f0d02c19640 1 -- 172.21.15.52:0/1685460913 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cec0094d0 con 0x7f0cfc0a9830 2023-11-05T08:07:11.519 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.508+0000 7f0d02c19640 1 --2- 172.21.15.52:0/1685460913 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0cfc0a9830 0x7f0cfc1d9c00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0cf400c780 tx=0x7f0cf400cc40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:11.519 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.508+0000 7f0cf2ffd640 10 client.?.objecter ms_handle_connect 0x7f0cfc0a9830 2023-11-05T08:07:11.519 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.508+0000 7f0cf2ffd640 10 client.?.objecter resend_mon_ops 2023-11-05T08:07:11.520 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.510+0000 7f675bfff640 1 -- 172.21.15.52:0/2141157636 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f676c07b620 con 0x7f67741d6330 2023-11-05T08:07:11.520 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.510+0000 7f675bfff640 10 client.4256.objecter ms_dispatch 0x7f6774000b90 osd_map(23..23 src has 1..23) v4 2023-11-05T08:07:11.520 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.510+0000 7f675bfff640 3 client.4256.objecter handle_osd_map got epochs [23,23] > 0 2023-11-05T08:07:11.521 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.510+0000 7f675bfff640 3 client.4256.objecter handle_osd_map decoding full epoch 23 2023-11-05T08:07:11.521 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.510+0000 7f675bfff640 20 client.4256.objecter dump_active .. 0 homeless 2023-11-05T08:07:11.521 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.510+0000 7f675bfff640 1 -- 172.21.15.52:0/2141157636 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f676c077260 con 0x7f67741d6330 2023-11-05T08:07:11.521 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.510+0000 7f675bfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:07:11.521 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.510+0000 7f675bfff640 10 monclient: _finish_command 1 = system:0 2023-11-05T08:07:11.523 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.511+0000 7f0cf2ffd640 1 -- 172.21.15.52:0/1685460913 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf4003d80 con 0x7f0cfc0a9830 2023-11-05T08:07:11.523 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.511+0000 7f0cf2ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:11.523 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.511+0000 7f0cf2ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-05T08:07:11.523 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.511+0000 7f0cf2ffd640 10 monclient: dump: 2023-11-05T08:07:11.524 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:11.524 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:11.524 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:11.524 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:11.524 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:11.525 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:11.525 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:11.525 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:11.525 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:11.525 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:11.526 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.511+0000 7f0cf2ffd640 10 monclient: _finish_auth 0 2023-11-05T08:07:11.526 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.511+0000 7f0cf2ffd640 10 monclient: _check_auth_tickets 2023-11-05T08:07:11.526 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.511+0000 7f0cf2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:07:11.526 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.511+0000 7f0cf2ffd640 1 -- 172.21.15.52:0/1685460913 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cf400ce30 con 0x7f0cfc0a9830 2023-11-05T08:07:11.526 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.511+0000 7f0d0467c640 5 monclient: authenticate success, global_id 4348 2023-11-05T08:07:11.527 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.511+0000 7f0cf2ffd640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:07:11.527 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.511+0000 7f0d00c15640 4 set_mon_vals no callback set 2023-11-05T08:07:11.527 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.512+0000 7f0d0467c640 10 monclient: _renew_subs 2023-11-05T08:07:11.527 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.512+0000 7f0cf2ffd640 1 -- 172.21.15.52:0/1685460913 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf4005290 con 0x7f0cfc0a9830 2023-11-05T08:07:11.527 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.512+0000 7f0d0467c640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:07:11.528 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.512+0000 7f0d0467c640 1 -- 172.21.15.52:0/1685460913 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cfc0a87e0 con 0x7f0cfc0a9830 2023-11-05T08:07:11.528 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.512+0000 7f0cf2ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:11.528 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.512+0000 7f0cf2ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-05T08:07:11.528 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.512+0000 7f0d0467c640 10 client.4348.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-05T08:07:11.528 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.512+0000 7f0cf2ffd640 10 monclient: dump: 2023-11-05T08:07:11.529 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:11.529 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:11.529 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:11.529 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:11.529 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:11.530 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:11.530 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:11.530 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:11.530 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:11.530 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:11.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.513+0000 7f0d0467c640 10 monclient: _renew_subs 2023-11-05T08:07:11.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.513+0000 7f0d0467c640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:07:11.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.513+0000 7f0d0467c640 1 -- 172.21.15.52:0/1685460913 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cfc13d270 con 0x7f0cfc0a9830 2023-11-05T08:07:11.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.513+0000 7f0d0467c640 1 librados: init done 2023-11-05T08:07:11.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.514+0000 7f0d0467c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-05T08:07:11.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.514+0000 7f0d0467c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:07:11.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.514+0000 7f0d0467c640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:07:11.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.514+0000 7f0d0467c640 1 -- 172.21.15.52:0/1685460913 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cfc04e9f0 con 0x7f0cfc0a9830 2023-11-05T08:07:11.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.532+0000 7f0cf2ffd640 1 -- 172.21.15.52:0/1685460913 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0cf40053f0 con 0x7f0cfc0a9830 2023-11-05T08:07:11.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.533+0000 7f0cf2ffd640 1 --2- 172.21.15.52:0/1685460913 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f0ce006c850 0x7f0ce006ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:11.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.533+0000 7f0d02418640 1 --2- 172.21.15.52:0/1685460913 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f0ce006c850 0x7f0ce006ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:11.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.533+0000 7f0d02418640 10 monclient: get_auth_request con 0x7f0ce006c850 auth_method 0 2023-11-05T08:07:11.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.534+0000 7f0d02418640 1 --2- 172.21.15.52:0/1685460913 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f0ce006c850 0x7f0ce006ed10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0cf800a770 tx=0x7f0cf8008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:11.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.534+0000 7f0cf2ffd640 10 client.4348.objecter ms_handle_connect 0x7f0ce006c850 2023-11-05T08:07:11.538 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.537+0000 7f0cf2ffd640 1 -- 172.21.15.52:0/1685460913 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f0cf4058790 con 0x7f0cfc0a9830 2023-11-05T08:07:11.538 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.537+0000 7f0cf2ffd640 10 client.4348.objecter ms_dispatch 0x7f0cfc000b90 osd_map(23..23 src has 1..23) v4 2023-11-05T08:07:11.538 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.537+0000 7f0cf2ffd640 3 client.4348.objecter handle_osd_map got epochs [23,23] > 0 2023-11-05T08:07:11.539 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.537+0000 7f0cf2ffd640 3 client.4348.objecter handle_osd_map decoding full epoch 23 2023-11-05T08:07:11.539 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.537+0000 7f0cf2ffd640 20 client.4348.objecter dump_active .. 0 homeless 2023-11-05T08:07:11.544 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.543+0000 7f3990ff9640 1 -- 172.21.15.52:0/1137646105 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3980007640 con 0x7f398c038eb0 2023-11-05T08:07:11.544 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.543+0000 7f3990ff9640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:07:11.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.543+0000 7f3990ff9640 1 -- 172.21.15.52:0/1137646105 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3980004a00 con 0x7f398c038eb0 2023-11-05T08:07:11.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.543+0000 7f3990ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:11.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.543+0000 7f3990ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-11-05T08:07:11.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.543+0000 7f3990ff9640 10 monclient: dump: 2023-11-05T08:07:11.545 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:11.546 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:11.546 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:11.546 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:11.546 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:11.546 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:11.547 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:11.547 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:11.547 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:11.547 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:11.547 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.543+0000 7f39927fc640 4 set_mon_vals no callback set 2023-11-05T08:07:11.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.544+0000 7f3990ff9640 1 -- 172.21.15.52:0/1137646105 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f39800133c0 con 0x7f398c038eb0 2023-11-05T08:07:11.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.544+0000 7f3990ff9640 1 --2- 172.21.15.52:0/1137646105 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f397806c800 0x7f397806ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:11.549 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.545+0000 7f3993fff640 1 --2- 172.21.15.52:0/1137646105 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f397806c800 0x7f397806ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:11.549 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.545+0000 7f3993fff640 10 monclient: get_auth_request con 0x7f397806c800 auth_method 0 2023-11-05T08:07:11.549 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.545+0000 7f3990ff9640 10 client.4265.objecter ms_handle_connect 0x7f397806c800 2023-11-05T08:07:11.549 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.545+0000 7f3993fff640 1 --2- 172.21.15.52:0/1137646105 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f397806c800 0x7f397806ecc0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3988009990 tx=0x7f3988009110 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:11.577 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.575+0000 7f3990ff9640 1 -- 172.21.15.52:0/1137646105 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f3980058ec0 con 0x7f398c038eb0 2023-11-05T08:07:11.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.575+0000 7f3990ff9640 10 client.4265.objecter ms_dispatch 0x7f3994000b90 osd_map(23..23 src has 1..23) v4 2023-11-05T08:07:11.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.575+0000 7f3990ff9640 3 client.4265.objecter handle_osd_map got epochs [23,23] > 0 2023-11-05T08:07:11.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.575+0000 7f3990ff9640 3 client.4265.objecter handle_osd_map decoding full epoch 23 2023-11-05T08:07:11.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.575+0000 7f3990ff9640 20 client.4265.objecter dump_active .. 0 homeless 2023-11-05T08:07:11.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.575+0000 7f3990ff9640 1 -- 172.21.15.52:0/1137646105 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3980054b00 con 0x7f398c038eb0 2023-11-05T08:07:11.579 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.576+0000 7f3990ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:07:11.579 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.576+0000 7f3990ff9640 10 monclient: _finish_command 1 = system:0 2023-11-05T08:07:11.683 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.681+0000 7f009fe9b640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 1}] 2023-11-05T08:07:11.683 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.682+0000 7f009fe9b640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2023-11-05T08:07:11.684 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.682+0000 7f009fe9b640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:07:11.684 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.682+0000 7f009fe9b640 1 -- 172.21.15.52:0/3956986862 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f009804e9f0 con 0x7f00980ab790 2023-11-05T08:07:11.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.720+0000 7f6779e64640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 6}] 2023-11-05T08:07:11.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.720+0000 7f6779e64640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 6}] 2023-11-05T08:07:11.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.720+0000 7f6779e64640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.52:3301/0 2023-11-05T08:07:11.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.720+0000 7f6779e64640 1 -- 172.21.15.52:0/2141157636 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f67740a94c0 con 0x7f67741d6330 2023-11-05T08:07:11.758 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.757+0000 7f502aa1a640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 4}] 2023-11-05T08:07:11.759 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.757+0000 7f502aa1a640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2023-11-05T08:07:11.759 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.757+0000 7f502aa1a640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.52:3300/0 2023-11-05T08:07:11.759 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.757+0000 7f502aa1a640 1 -- 172.21.15.52:0/1133386618 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f5024143b80 con 0x7f50240af370 2023-11-05T08:07:11.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.764+0000 7f5020ff9640 1 -- 172.21.15.52:0/1133386618 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5024143b80 con 0x7f50240af370 2023-11-05T08:07:11.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.764+0000 7f5020ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2023-11-05T08:07:11.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.764+0000 7f5020ff9640 10 monclient: _finish_command 2 = system:0 2023-11-05T08:07:11.766 INFO:teuthology.orchestra.run.smithi052.stdout:60129542149 2023-11-05T08:07:11.767 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.766+0000 7f3999675640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 3}] 2023-11-05T08:07:11.767 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.766+0000 7f3999675640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2023-11-05T08:07:11.768 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.766+0000 7f3999675640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.52:3301/0 2023-11-05T08:07:11.768 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.766+0000 7f3999675640 1 -- 172.21.15.52:0/1137646105 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f398c0086d0 con 0x7f398c038eb0 2023-11-05T08:07:11.769 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.766+0000 7f502aa1a640 10 librados: watch_flush enter 2023-11-05T08:07:11.769 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.766+0000 7f502aa1a640 10 librados: watch_flush exit 2023-11-05T08:07:11.769 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.766+0000 7f502aa1a640 20 client.4326.objecter shutdown clearing up homeless session... 2023-11-05T08:07:11.770 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.766+0000 7f502aa1a640 10 client.4326.objecter successfully canceled tick 2023-11-05T08:07:11.770 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.766+0000 7f502aa1a640 1 -- 172.21.15.52:0/1133386618 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f501006c800 msgr2=0x7f501006ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:11.770 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.766+0000 7f502aa1a640 1 --2- 172.21.15.52:0/1133386618 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f501006c800 0x7f501006ecc0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5024147590 tx=0x7f5014009040 comp rx=0 tx=0).stop 2023-11-05T08:07:11.770 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.766+0000 7f502aa1a640 10 monclient: shutdown 2023-11-05T08:07:11.770 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.766+0000 7f502aa1a640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:07:11.771 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.766+0000 7f502aa1a640 1 -- 172.21.15.52:0/1133386618 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50240af370 msgr2=0x7f5024146290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:11.771 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.766+0000 7f502aa1a640 1 --2- 172.21.15.52:0/1133386618 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50240af370 0x7f5024146290 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5018034040 tx=0x7f50180046c0 comp rx=0 tx=0).stop 2023-11-05T08:07:11.771 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.766+0000 7f502aa1a640 1 -- 172.21.15.52:0/1133386618 shutdown_connections 2023-11-05T08:07:11.771 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.766+0000 7f502aa1a640 1 --2- 172.21.15.52:0/1133386618 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f501006c800 0x7f501006ecc0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:11.771 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.766+0000 7f502aa1a640 1 --2- 172.21.15.52:0/1133386618 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f50240b41f0 0x7f5024148320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:11.772 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.766+0000 7f502aa1a640 1 --2- 172.21.15.52:0/1133386618 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f50240b0ad0 0x7f50240b7020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:11.772 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.766+0000 7f502aa1a640 1 --2- 172.21.15.52:0/1133386618 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50240af370 0x7f5024146290 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:11.772 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.766+0000 7f502aa1a640 1 -- 172.21.15.52:0/1133386618 >> 172.21.15.52:0/1133386618 conn(0x7f5024065cd0 msgr2=0x7f5024137ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:07:11.772 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.766+0000 7f502aa1a640 1 -- 172.21.15.52:0/1133386618 shutdown_connections 2023-11-05T08:07:11.772 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.766+0000 7f502aa1a640 1 -- 172.21.15.52:0/1133386618 wait complete. 2023-11-05T08:07:11.772 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.766+0000 7f502aa1a640 1 librados: shutdown 2023-11-05T08:07:11.779 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.4 2023-11-05T08:07:11.781 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.780+0000 7f0cf2ffd640 1 -- 172.21.15.52:0/1685460913 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0cf40543d0 con 0x7f0cfc0a9830 2023-11-05T08:07:11.781 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.780+0000 7f0cf2ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:07:11.782 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.780+0000 7f0cf2ffd640 10 monclient: _finish_command 1 = system:0 2023-11-05T08:07:11.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.786+0000 7f008e7fc640 1 -- 172.21.15.52:0/3956986862 <== mon.1 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0090021090 con 0x7f00980ab790 2023-11-05T08:07:11.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.786+0000 7f008e7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2023-11-05T08:07:11.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.786+0000 7f008e7fc640 10 monclient: _finish_command 2 = system:0 2023-11-05T08:07:11.788 INFO:teuthology.orchestra.run.smithi052.stdout:64424509443 2023-11-05T08:07:11.789 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.787+0000 7f009fe9b640 10 librados: watch_flush enter 2023-11-05T08:07:11.790 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.787+0000 7f009fe9b640 10 librados: watch_flush exit 2023-11-05T08:07:11.790 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.787+0000 7f009fe9b640 20 client.4345.objecter shutdown clearing up homeless session... 2023-11-05T08:07:11.790 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.787+0000 7f009fe9b640 10 client.4345.objecter successfully canceled tick 2023-11-05T08:07:11.790 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.788+0000 7f009fe9b640 1 -- 172.21.15.52:0/3956986862 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f007c06c800 msgr2=0x7f007c06ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:11.790 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.788+0000 7f009fe9b640 1 --2- 172.21.15.52:0/3956986862 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f007c06c800 0x7f007c06ecc0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0094037000 tx=0x7f0094030000 comp rx=0 tx=0).stop 2023-11-05T08:07:11.791 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.788+0000 7f009fe9b640 10 monclient: shutdown 2023-11-05T08:07:11.791 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.788+0000 7f009fe9b640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:07:11.791 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.788+0000 7f009fe9b640 1 -- 172.21.15.52:0/3956986862 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f00980ab790 msgr2=0x7f009813b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:11.791 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.788+0000 7f009fe9b640 1 --2- 172.21.15.52:0/3956986862 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f00980ab790 0x7f009813b890 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f009000cbc0 tx=0x7f009000a060 comp rx=0 tx=0).stop 2023-11-05T08:07:11.791 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.788+0000 7f009fe9b640 1 -- 172.21.15.52:0/3956986862 shutdown_connections 2023-11-05T08:07:11.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.788+0000 7f009fe9b640 1 --2- 172.21.15.52:0/3956986862 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f007c06c800 0x7f007c06ecc0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:11.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.788+0000 7f009fe9b640 1 --2- 172.21.15.52:0/3956986862 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f00980ae970 0x7f009813bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:11.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.788+0000 7f009fe9b640 1 --2- 172.21.15.52:0/3956986862 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f00980ab790 0x7f009813b890 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:11.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.788+0000 7f009fe9b640 1 --2- 172.21.15.52:0/3956986862 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f009806b090 0x7f0098099cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:11.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.788+0000 7f009fe9b640 1 -- 172.21.15.52:0/3956986862 >> 172.21.15.52:0/3956986862 conn(0x7f0098069dd0 msgr2=0x7f00980a9e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:07:11.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.788+0000 7f009fe9b640 1 -- 172.21.15.52:0/3956986862 shutdown_connections 2023-11-05T08:07:11.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.788+0000 7f009fe9b640 1 -- 172.21.15.52:0/3956986862 wait complete. 2023-11-05T08:07:11.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.788+0000 7f009fe9b640 1 librados: shutdown 2023-11-05T08:07:11.801 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509443 for osd.1 2023-11-05T08:07:11.903 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-05T08:07:11.981 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.979+0000 7f0d0467c640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 0}] 2023-11-05T08:07:11.981 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.979+0000 7f0d0467c640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2023-11-05T08:07:11.981 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.979+0000 7f0d0467c640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:07:11.982 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.979+0000 7f0d0467c640 1 -- 172.21.15.52:0/1685460913 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0cfc1d6a70 con 0x7f0cfc0a9830 2023-11-05T08:07:11.984 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.983+0000 7f0cf2ffd640 1 -- 172.21.15.52:0/1685460913 <== mon.1 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0cf4017020 con 0x7f0cfc0a9830 2023-11-05T08:07:11.985 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.983+0000 7f0cf2ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2023-11-05T08:07:11.985 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.983+0000 7f0cf2ffd640 10 monclient: _finish_command 2 = system:0 2023-11-05T08:07:11.985 INFO:teuthology.orchestra.run.smithi052.stdout:68719476740 2023-11-05T08:07:11.988 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.986+0000 7f0d0467c640 10 librados: watch_flush enter 2023-11-05T08:07:11.988 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.986+0000 7f0d0467c640 10 librados: watch_flush exit 2023-11-05T08:07:11.988 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.986+0000 7f0d0467c640 20 client.4348.objecter shutdown clearing up homeless session... 2023-11-05T08:07:11.988 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.986+0000 7f0d0467c640 10 client.4348.objecter successfully canceled tick 2023-11-05T08:07:11.989 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.986+0000 7f0d0467c640 1 -- 172.21.15.52:0/1685460913 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f0ce006c850 msgr2=0x7f0ce006ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:11.989 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.986+0000 7f0d0467c640 1 --2- 172.21.15.52:0/1685460913 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f0ce006c850 0x7f0ce006ed10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0cf800a770 tx=0x7f0cf8008040 comp rx=0 tx=0).stop 2023-11-05T08:07:11.989 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.986+0000 7f0d0467c640 10 monclient: shutdown 2023-11-05T08:07:11.989 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.986+0000 7f0d0467c640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:07:11.989 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.986+0000 7f0d0467c640 1 -- 172.21.15.52:0/1685460913 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0cfc0a9830 msgr2=0x7f0cfc1d9c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:11.990 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.986+0000 7f0d0467c640 1 --2- 172.21.15.52:0/1685460913 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0cfc0a9830 0x7f0cfc1d9c00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0cf400c780 tx=0x7f0cf400cc40 comp rx=0 tx=0).stop 2023-11-05T08:07:11.990 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.986+0000 7f0d0467c640 1 -- 172.21.15.52:0/1685460913 shutdown_connections 2023-11-05T08:07:11.990 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.986+0000 7f0d0467c640 1 --2- 172.21.15.52:0/1685460913 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f0ce006c850 0x7f0ce006ed10 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:11.990 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.986+0000 7f0d0467c640 1 --2- 172.21.15.52:0/1685460913 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0cfc0a9830 0x7f0cfc1d9c00 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:11.991 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.986+0000 7f0d0467c640 1 --2- 172.21.15.52:0/1685460913 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0cfc0b4240 0x7f0cfc1d6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:11.991 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.986+0000 7f0d0467c640 1 --2- 172.21.15.52:0/1685460913 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0cfc0ade00 0x7f0cfc0a92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:11.991 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.986+0000 7f0d0467c640 1 -- 172.21.15.52:0/1685460913 >> 172.21.15.52:0/1685460913 conn(0x7f0cfc065cd0 msgr2=0x7f0cfc1422f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:07:11.991 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.986+0000 7f0d0467c640 1 -- 172.21.15.52:0/1685460913 shutdown_connections 2023-11-05T08:07:11.991 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.986+0000 7f0d0467c640 1 -- 172.21.15.52:0/1685460913 wait complete. 2023-11-05T08:07:11.992 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:11.986+0000 7f0d0467c640 1 librados: shutdown 2023-11-05T08:07:12.002 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476742 got 68719476740 for osd.0 2023-11-05T08:07:12.024 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.023+0000 7f9269165640 10 monclient: get_monmap_and_config 2023-11-05T08:07:12.024 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.023+0000 7f9269165640 10 monclient: build_initial_monmap 2023-11-05T08:07:12.025 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.023+0000 7f9269165640 10 monclient: monmap: 2023-11-05T08:07:12.025 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:07:12.025 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:12.025 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:07:12.024698+0000 2023-11-05T08:07:12.025 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:07:12.024698+0000 2023-11-05T08:07:12.026 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:07:12.026 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:12.026 INFO:teuthology.orchestra.run.smithi052.stderr:0: v1:172.21.15.52:6789/0 mon.noname-a-legacy 2023-11-05T08:07:12.026 INFO:teuthology.orchestra.run.smithi052.stderr:1: v1:172.21.15.156:6789/0 mon.noname-c-legacy 2023-11-05T08:07:12.026 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-b 2023-11-05T08:07:12.027 INFO:teuthology.orchestra.run.smithi052.stderr:3: v2:172.21.15.52:3300/0 mon.noname-a 2023-11-05T08:07:12.027 INFO:teuthology.orchestra.run.smithi052.stderr:4: v2:172.21.15.156:3300/0 mon.noname-c 2023-11-05T08:07:12.027 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:12.029 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.023+0000 7f9269165640 1 Processor -- start 2023-11-05T08:07:12.029 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.023+0000 7f9269165640 1 -- start start 2023-11-05T08:07:12.029 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.023+0000 7f9269165640 10 monclient: init 2023-11-05T08:07:12.029 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.024+0000 7f9269165640 10 monclient: _reopen_session rank -1 2023-11-05T08:07:12.029 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.024+0000 7f9269165640 10 monclient: _add_conns ranks=[0,4,1,3,2] 2023-11-05T08:07:12.030 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.024+0000 7f9269165640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f92640b4240 addr v1:172.21.15.52:6789/0 2023-11-05T08:07:12.030 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.024+0000 7f9269165640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f92640b38d0 0x7f92640ae640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:12.030 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.024+0000 7f9269165640 10 monclient(hunting): picked mon.noname-c con 0x7f92640b38d0 addr v2:172.21.15.156:3300/0 2023-11-05T08:07:12.030 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.024+0000 7f9269165640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f92640ade00 addr v1:172.21.15.156:6789/0 2023-11-05T08:07:12.030 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.024+0000 7f9269165640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92640b0cc0 con 0x7f92640b4240 2023-11-05T08:07:12.031 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.024+0000 7f9269165640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92640aeb80 con 0x7f92640ade00 2023-11-05T08:07:12.031 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.024+0000 7f9269165640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:12.031 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.024+0000 7f9269165640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92640b4620 con 0x7f92640b38d0 2023-11-05T08:07:12.031 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.024+0000 7f9269165640 10 monclient(hunting): _renew_subs 2023-11-05T08:07:12.031 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.024+0000 7f9269165640 10 monclient(hunting): authenticate will time out at 1378.230471s 2023-11-05T08:07:12.032 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.025+0000 7f9262d9d640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f92640b4240 0x7f92640b1150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:47094/0 (socket says 172.21.15.52:47094) 2023-11-05T08:07:12.032 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.025+0000 7f9262d9d640 1 -- 172.21.15.52:0/2952930586 learned_addr learned my addr 172.21.15.52:0/2952930586 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-11-05T08:07:12.032 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.025+0000 7f926259c640 1 --2- 172.21.15.52:0/2952930586 >> v2:172.21.15.156:3300/0 conn(0x7f92640b38d0 0x7f92640ae640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:12.032 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.025+0000 7f926259c640 10 monclient(hunting): get_auth_request con 0x7f92640b38d0 auth_method 0 2023-11-05T08:07:12.032 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.025+0000 7f926259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:12.033 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.025+0000 7f926259c640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:12.033 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.025+0000 7f926259c640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:12.033 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.027+0000 7f926259c640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:12.033 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.027+0000 7f926259c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:12.033 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.027+0000 7f926259c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:12.034 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.028+0000 7f9261d9b640 1 -- 172.21.15.52:0/2952930586 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3988473387 0 0) 0x7f92640b0cc0 con 0x7f92640b4240 2023-11-05T08:07:12.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.028+0000 7f9261d9b640 10 monclient(hunting): _negotiate 2023-11-05T08:07:12.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.028+0000 7f9261d9b640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:12.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.028+0000 7f9261d9b640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:12.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.028+0000 7f9261d9b640 10 monclient(hunting): my global_id is 4329 2023-11-05T08:07:12.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.028+0000 7f9261d9b640 1 -- 172.21.15.52:0/2952930586 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9250003520 con 0x7f92640b4240 2023-11-05T08:07:12.036 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.028+0000 7f926259c640 10 monclient(hunting): handle_auth_done global_id 4351 payload 274 2023-11-05T08:07:12.036 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.028+0000 7f926259c640 1 -- 172.21.15.52:0/2952930586 >> v1:172.21.15.156:6789/0 conn(0x7f92640ade00 legacy=0x7f926413b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:12.036 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.028+0000 7f926259c640 1 -- 172.21.15.52:0/2952930586 >> v1:172.21.15.52:6789/0 conn(0x7f92640b4240 legacy=0x7f92640b1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:12.036 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.028+0000 7f926259c640 10 monclient: _finish_hunting 0 2023-11-05T08:07:12.036 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.028+0000 7f926259c640 1 monclient: found mon.noname-c 2023-11-05T08:07:12.037 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.028+0000 7f926259c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:07:12.037 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.028+0000 7f926259c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.156:3300/0 2023-11-05T08:07:12.037 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.028+0000 7f926259c640 1 -- 172.21.15.52:0/2952930586 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f926413f5f0 con 0x7f92640b38d0 2023-11-05T08:07:12.037 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.032+0000 7f926259c640 1 --2- 172.21.15.52:0/2952930586 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f92640b38d0 0x7f92640ae640 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f924c0097d0 tx=0x7f924c02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae25ee6a3ff9e876 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:12.038 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.036+0000 7f9261d9b640 1 -- 172.21.15.52:0/2952930586 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f924c031830 con 0x7f92640b38d0 2023-11-05T08:07:12.038 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.036+0000 7f9261d9b640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:12.038 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.036+0000 7f9261d9b640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-11-05T08:07:12.038 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.036+0000 7f9261d9b640 10 monclient: dump: 2023-11-05T08:07:12.039 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:12.039 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:12.039 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:12.039 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:12.039 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:12.040 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:12.040 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:12.040 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:12.040 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:12.041 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:12.041 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.036+0000 7f9261d9b640 10 monclient: _finish_auth 0 2023-11-05T08:07:12.041 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.036+0000 7f9261d9b640 10 monclient: _check_auth_tickets 2023-11-05T08:07:12.041 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.036+0000 7f9261d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:07:12.041 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.036+0000 7f9261d9b640 1 -- 172.21.15.52:0/2952930586 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f924c031990 con 0x7f92640b38d0 2023-11-05T08:07:12.042 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.036+0000 7f9261d9b640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:07:12.042 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.036+0000 7f9261d9b640 1 -- 172.21.15.52:0/2952930586 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f924c031d20 con 0x7f92640b38d0 2023-11-05T08:07:12.042 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.036+0000 7f9269165640 5 monclient: authenticate success, global_id 4351 2023-11-05T08:07:12.042 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.036+0000 7f9269165640 10 monclient: get_monmap_and_config success 2023-11-05T08:07:12.042 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.036+0000 7f9269165640 4 set_mon_vals no callback set 2023-11-05T08:07:12.042 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.036+0000 7f9261d9b640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:12.043 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.036+0000 7f9261d9b640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-05T08:07:12.043 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.036+0000 7f9261d9b640 10 monclient: dump: 2023-11-05T08:07:12.043 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:12.043 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:12.045 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:12.045 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:12.045 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:12.045 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:12.045 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:12.046 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:12.046 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:12.046 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:12.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.037+0000 7f9269165640 10 monclient: shutdown 2023-11-05T08:07:12.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.037+0000 7f9269165640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:07:12.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.037+0000 7f9269165640 1 -- 172.21.15.52:0/2952930586 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f92640b38d0 msgr2=0x7f92640ae640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:12.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.037+0000 7f9269165640 1 --2- 172.21.15.52:0/2952930586 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f92640b38d0 0x7f92640ae640 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f924c0097d0 tx=0x7f924c02b8d0 comp rx=0 tx=0).stop 2023-11-05T08:07:12.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.037+0000 7f9269165640 1 -- 172.21.15.52:0/2952930586 shutdown_connections 2023-11-05T08:07:12.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.037+0000 7f9269165640 1 --2- 172.21.15.52:0/2952930586 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f92640b38d0 0x7f92640ae640 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:12.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.037+0000 7f9269165640 1 -- 172.21.15.52:0/2952930586 >> 172.21.15.52:0/2952930586 conn(0x7f9264065cd0 msgr2=0x7f92640660e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:07:12.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.037+0000 7f9269165640 1 -- 172.21.15.52:0/2952930586 shutdown_connections 2023-11-05T08:07:12.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.037+0000 7f9269165640 1 -- 172.21.15.52:0/2952930586 wait complete. 2023-11-05T08:07:12.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.038+0000 7f9269165640 10 monclient: build_initial_monmap 2023-11-05T08:07:12.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.038+0000 7f9269165640 10 monclient: monmap: 2023-11-05T08:07:12.054 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:07:12.054 INFO:teuthology.orchestra.run.smithi052.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-05T08:07:12.054 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 0.000000 2023-11-05T08:07:12.055 INFO:teuthology.orchestra.run.smithi052.stderr:created 0.000000 2023-11-05T08:07:12.055 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:07:12.055 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:12.055 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.noname-a 2023-11-05T08:07:12.055 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.noname-b 2023-11-05T08:07:12.056 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-c 2023-11-05T08:07:12.056 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:12.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.039+0000 7f9269165640 1 librados: starting msgr at 2023-11-05T08:07:12.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.039+0000 7f9269165640 1 librados: starting objecter 2023-11-05T08:07:12.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.039+0000 7f9269165640 1 Processor -- start 2023-11-05T08:07:12.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.039+0000 7f9269165640 1 -- start start 2023-11-05T08:07:12.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.039+0000 7f9269165640 1 librados: setting wanted keys 2023-11-05T08:07:12.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.039+0000 7f9269165640 1 librados: calling monclient init 2023-11-05T08:07:12.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.039+0000 7f9269165640 10 monclient: init 2023-11-05T08:07:12.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.039+0000 7f9269165640 10 monclient: _reopen_session rank -1 2023-11-05T08:07:12.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.039+0000 7f9269165640 10 monclient: _add_conns ranks=[1,0,2] 2023-11-05T08:07:12.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.039+0000 7f9269165640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f92640ade00 0x7f92640a8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:12.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.039+0000 7f9269165640 10 monclient(hunting): picked mon.noname-b con 0x7f92640ade00 addr [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] 2023-11-05T08:07:12.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.039+0000 7f9269165640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f92640b4240 0x7f92640a9190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:12.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.039+0000 7f9269165640 10 monclient(hunting): picked mon.noname-a con 0x7f92640b4240 addr [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] 2023-11-05T08:07:12.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.039+0000 7f9269165640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9264139710 0x7f9264139ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:12.059 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.039+0000 7f9269165640 10 monclient(hunting): picked mon.noname-c con 0x7f9264139710 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:07:12.059 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.039+0000 7f9269165640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:12.059 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.039+0000 7f9269165640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f926413a0e0 con 0x7f92640b4240 2023-11-05T08:07:12.059 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.039+0000 7f9269165640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:12.059 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.039+0000 7f9269165640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92640a8730 con 0x7f92640ade00 2023-11-05T08:07:12.060 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.039+0000 7f9269165640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:12.060 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.039+0000 7f9269165640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f926413eb90 con 0x7f9264139710 2023-11-05T08:07:12.060 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.039+0000 7f9269165640 10 monclient(hunting): _renew_subs 2023-11-05T08:07:12.060 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.039+0000 7f9269165640 10 monclient(hunting): authenticate will time out at 1378.245900s 2023-11-05T08:07:12.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.040+0000 7f9262d9d640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f92640ade00 0x7f92640a8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:12.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.040+0000 7f9262d9d640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f92640ade00 0x7f92640a8c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.52:59158/0 (socket says 172.21.15.52:59158) 2023-11-05T08:07:12.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.040+0000 7f9262d9d640 1 -- 172.21.15.52:0/3360513462 learned_addr learned my addr 172.21.15.52:0/3360513462 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-11-05T08:07:12.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.040+0000 7f9262d9d640 10 monclient(hunting): get_auth_request con 0x7f92640ade00 auth_method 0 2023-11-05T08:07:12.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.040+0000 7f9262d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:12.062 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.040+0000 7f9262d9d640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:12.062 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.040+0000 7f9262d9d640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:12.062 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.041+0000 7f9262d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:12.062 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.041+0000 7f9262d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:12.062 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.041+0000 7f9262d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:12.063 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.043+0000 7f9262d9d640 10 monclient(hunting): handle_auth_done global_id 4354 payload 824 2023-11-05T08:07:12.063 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.043+0000 7f9262d9d640 1 -- 172.21.15.52:0/3360513462 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9264139710 msgr2=0x7f9264139ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:12.063 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.043+0000 7f9262d9d640 1 --2- 172.21.15.52:0/3360513462 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9264139710 0x7f9264139ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:12.063 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.043+0000 7f9262d9d640 1 -- 172.21.15.52:0/3360513462 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f92640b4240 msgr2=0x7f92640a9190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:12.063 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.043+0000 7f9262d9d640 1 --2- 172.21.15.52:0/3360513462 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f92640b4240 0x7f92640a9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:12.064 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.043+0000 7f9262d9d640 10 monclient: _finish_hunting 0 2023-11-05T08:07:12.064 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.043+0000 7f9262d9d640 1 monclient: found mon.noname-b 2023-11-05T08:07:12.064 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.043+0000 7f9262d9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:07:12.064 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.043+0000 7f9262d9d640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.156:3300/0 2023-11-05T08:07:12.064 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.043+0000 7f9262d9d640 1 -- 172.21.15.52:0/3360513462 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f924c009400 con 0x7f92640ade00 2023-11-05T08:07:12.065 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.046+0000 7f9262d9d640 1 --2- 172.21.15.52:0/3360513462 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f92640ade00 0x7f92640a8c50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f925400c410 tx=0x7f925400c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:12.065 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.046+0000 7f925b7fe640 10 client.?.objecter ms_handle_connect 0x7f92640ade00 2023-11-05T08:07:12.065 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.046+0000 7f925b7fe640 10 client.?.objecter resend_mon_ops 2023-11-05T08:07:12.065 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.049+0000 7f925b7fe640 1 -- 172.21.15.52:0/3360513462 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9254005ce0 con 0x7f92640ade00 2023-11-05T08:07:12.065 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.049+0000 7f925b7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:12.066 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.049+0000 7f925b7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-05T08:07:12.066 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.049+0000 7f925b7fe640 10 monclient: dump: 2023-11-05T08:07:12.066 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:12.066 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:12.066 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:12.066 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:12.067 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:12.067 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:12.067 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:12.067 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:12.067 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:12.068 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:12.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.049+0000 7f925b7fe640 10 monclient: _finish_auth 0 2023-11-05T08:07:12.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.049+0000 7f925b7fe640 10 monclient: _check_auth_tickets 2023-11-05T08:07:12.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.049+0000 7f925b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:07:12.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.049+0000 7f925b7fe640 1 -- 172.21.15.52:0/3360513462 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9254005e40 con 0x7f92640ade00 2023-11-05T08:07:12.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.049+0000 7f9269165640 5 monclient: authenticate success, global_id 4354 2023-11-05T08:07:12.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.049+0000 7f9269165640 10 monclient: _renew_subs 2023-11-05T08:07:12.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.049+0000 7f9269165640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:07:12.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.049+0000 7f9269165640 1 -- 172.21.15.52:0/3360513462 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f926413cc90 con 0x7f92640ade00 2023-11-05T08:07:12.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.049+0000 7f925b7fe640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:07:12.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.049+0000 7f925b7fe640 1 -- 172.21.15.52:0/3360513462 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92540072f0 con 0x7f92640ade00 2023-11-05T08:07:12.070 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.049+0000 7f925b7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:12.070 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.049+0000 7f925b7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-05T08:07:12.070 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.049+0000 7f925b7fe640 10 monclient: dump: 2023-11-05T08:07:12.070 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:12.070 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:12.071 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:12.071 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:12.071 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:12.071 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:12.071 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:12.071 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:12.072 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:12.072 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:12.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.049+0000 7f926159a640 4 set_mon_vals no callback set 2023-11-05T08:07:12.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.049+0000 7f9269165640 10 client.4354.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-05T08:07:12.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.049+0000 7f9269165640 10 monclient: _renew_subs 2023-11-05T08:07:12.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.049+0000 7f9269165640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:07:12.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.049+0000 7f9269165640 1 -- 172.21.15.52:0/3360513462 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92641d9e90 con 0x7f92640ade00 2023-11-05T08:07:12.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.050+0000 7f9269165640 1 librados: init done 2023-11-05T08:07:12.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.050+0000 7f9269165640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-05T08:07:12.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.051+0000 7f9269165640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:07:12.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.051+0000 7f9269165640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:07:12.074 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.051+0000 7f9269165640 1 -- 172.21.15.52:0/3360513462 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f926404e9f0 con 0x7f92640ade00 2023-11-05T08:07:12.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.068+0000 7f925b7fe640 1 -- 172.21.15.52:0/3360513462 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f9254007510 con 0x7f92640ade00 2023-11-05T08:07:12.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.069+0000 7f925b7fe640 1 --2- 172.21.15.52:0/3360513462 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f924406c800 0x7f924406ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:12.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.069+0000 7f926259c640 1 --2- 172.21.15.52:0/3360513462 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f924406c800 0x7f924406ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:12.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.069+0000 7f926259c640 10 monclient: get_auth_request con 0x7f924406c800 auth_method 0 2023-11-05T08:07:12.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.070+0000 7f926259c640 1 --2- 172.21.15.52:0/3360513462 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f924406c800 0x7f924406ecc0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f924c036000 tx=0x7f924c030000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:12.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.070+0000 7f925b7fe640 10 client.4354.objecter ms_handle_connect 0x7f924406c800 2023-11-05T08:07:12.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.070+0000 7f925b7fe640 1 -- 172.21.15.52:0/3360513462 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f9254058680 con 0x7f92640ade00 2023-11-05T08:07:12.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.070+0000 7f925b7fe640 10 client.4354.objecter ms_dispatch 0x7f9264000b90 osd_map(23..23 src has 1..23) v4 2023-11-05T08:07:12.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.070+0000 7f925b7fe640 3 client.4354.objecter handle_osd_map got epochs [23,23] > 0 2023-11-05T08:07:12.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.070+0000 7f925b7fe640 3 client.4354.objecter handle_osd_map decoding full epoch 23 2023-11-05T08:07:12.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.070+0000 7f925b7fe640 20 client.4354.objecter dump_active .. 0 homeless 2023-11-05T08:07:12.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.076+0000 7f675bfff640 1 -- 172.21.15.52:0/2141157636 <== mon.2 v2:172.21.15.52:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f67740a94c0 con 0x7f67741d6330 2023-11-05T08:07:12.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.076+0000 7f675bfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 6}] 2023-11-05T08:07:12.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.076+0000 7f675bfff640 10 monclient: _finish_command 2 = system:0 2023-11-05T08:07:12.078 INFO:teuthology.orchestra.run.smithi052.stdout:55834574851 2023-11-05T08:07:12.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.078+0000 7f6779e64640 10 librados: watch_flush enter 2023-11-05T08:07:12.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.078+0000 7f6779e64640 10 librados: watch_flush exit 2023-11-05T08:07:12.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.078+0000 7f6779e64640 20 client.4256.objecter shutdown clearing up homeless session... 2023-11-05T08:07:12.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.078+0000 7f6779e64640 10 client.4256.objecter successfully canceled tick 2023-11-05T08:07:12.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.078+0000 7f6779e64640 1 -- 172.21.15.52:0/2141157636 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f676006c800 msgr2=0x7f676006ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:12.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.078+0000 7f6779e64640 1 --2- 172.21.15.52:0/2141157636 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f676006c800 0x7f676006ecc0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6764006f40 tx=0x7f6764006e90 comp rx=0 tx=0).stop 2023-11-05T08:07:12.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.078+0000 7f6779e64640 10 monclient: shutdown 2023-11-05T08:07:12.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.078+0000 7f6779e64640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:07:12.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.078+0000 7f6779e64640 1 -- 172.21.15.52:0/2141157636 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f67741d6330 msgr2=0x7f67741d67c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:12.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.078+0000 7f6779e64640 1 --2- 172.21.15.52:0/2141157636 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f67741d6330 0x7f67741d67c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f676c02c3b0 tx=0x7f676c004a40 comp rx=0 tx=0).stop 2023-11-05T08:07:12.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.078+0000 7f6779e64640 1 -- 172.21.15.52:0/2141157636 shutdown_connections 2023-11-05T08:07:12.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.078+0000 7f6779e64640 1 --2- 172.21.15.52:0/2141157636 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f676006c800 0x7f676006ecc0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:12.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.078+0000 7f6779e64640 1 --2- 172.21.15.52:0/2141157636 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f67741d6330 0x7f67741d67c0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:12.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.078+0000 7f6779e64640 1 --2- 172.21.15.52:0/2141157636 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f67740b4240 0x7f67740a8b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:12.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.078+0000 7f6779e64640 1 --2- 172.21.15.52:0/2141157636 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f67740ade00 0x7f67740ad1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:12.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.078+0000 7f6779e64640 1 -- 172.21.15.52:0/2141157636 >> 172.21.15.52:0/2141157636 conn(0x7f6774065cd0 msgr2=0x7f67740b2a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:07:12.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.078+0000 7f6779e64640 1 -- 172.21.15.52:0/2141157636 shutdown_connections 2023-11-05T08:07:12.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.078+0000 7f6779e64640 1 -- 172.21.15.52:0/2141157636 wait complete. 2023-11-05T08:07:12.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.078+0000 7f6779e64640 1 librados: shutdown 2023-11-05T08:07:12.094 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.6 2023-11-05T08:07:12.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.097+0000 7f8664ff9640 1 -- 172.21.15.52:0/3013039951 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f865c003b20 con 0x7f866813eb20 2023-11-05T08:07:12.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.097+0000 7f8664ff9640 1 --2- 172.21.15.52:0/3013039951 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f865406c800 0x7f865406ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:12.099 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.098+0000 7f8667fff640 1 --2- 172.21.15.52:0/3013039951 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f865406c800 0x7f865406ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:12.099 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.098+0000 7f8667fff640 10 monclient: get_auth_request con 0x7f865406c800 auth_method 0 2023-11-05T08:07:12.100 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.098+0000 7f8667fff640 1 --2- 172.21.15.52:0/3013039951 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f865406c800 0x7f865406ecc0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8658009710 tx=0x7f8658006c90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:12.100 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.098+0000 7f8664ff9640 10 client.4268.objecter ms_handle_connect 0x7f865406c800 2023-11-05T08:07:12.115 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.113+0000 7f8664ff9640 1 -- 172.21.15.52:0/3013039951 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f865c0010c0 con 0x7f866813eb20 2023-11-05T08:07:12.115 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.113+0000 7f8664ff9640 10 client.4268.objecter ms_dispatch 0x7f8668000b90 osd_map(23..23 src has 1..23) v4 2023-11-05T08:07:12.115 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.113+0000 7f8664ff9640 3 client.4268.objecter handle_osd_map got epochs [23,23] > 0 2023-11-05T08:07:12.115 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.113+0000 7f8664ff9640 3 client.4268.objecter handle_osd_map decoding full epoch 23 2023-11-05T08:07:12.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.113+0000 7f8664ff9640 20 client.4268.objecter dump_active .. 0 homeless 2023-11-05T08:07:12.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.113+0000 7f8664ff9640 1 -- 172.21.15.52:0/3013039951 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f865c057b90 con 0x7f866813eb20 2023-11-05T08:07:12.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.113+0000 7f8664ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:07:12.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.113+0000 7f8664ff9640 10 monclient: _finish_command 1 = system:0 2023-11-05T08:07:12.117 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.116+0000 7f3b3e7fc640 1 -- 172.21.15.52:0/1213078853 <== mon.2 v2:172.21.15.52:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3b4407a420 con 0x7f3b480ade00 2023-11-05T08:07:12.117 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.116+0000 7f3b3e7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2023-11-05T08:07:12.117 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.116+0000 7f3b3e7fc640 10 monclient: _finish_command 2 = system:0 2023-11-05T08:07:12.118 INFO:teuthology.orchestra.run.smithi052.stdout:60129542148 2023-11-05T08:07:12.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.118+0000 7f3b4fd6c640 10 librados: watch_flush enter 2023-11-05T08:07:12.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.118+0000 7f3b4fd6c640 10 librados: watch_flush exit 2023-11-05T08:07:12.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.118+0000 7f3b4fd6c640 20 client.4262.objecter shutdown clearing up homeless session... 2023-11-05T08:07:12.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.118+0000 7f3b4fd6c640 10 client.4262.objecter successfully canceled tick 2023-11-05T08:07:12.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.118+0000 7f3b4fd6c640 1 -- 172.21.15.52:0/1213078853 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f3b2c06c830 msgr2=0x7f3b2c06ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:12.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.118+0000 7f3b4fd6c640 1 --2- 172.21.15.52:0/1213078853 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f3b2c06c830 0x7f3b2c06ecf0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3b481dae50 tx=0x7f3b38006c90 comp rx=0 tx=0).stop 2023-11-05T08:07:12.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.118+0000 7f3b4fd6c640 10 monclient: shutdown 2023-11-05T08:07:12.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.118+0000 7f3b4fd6c640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:07:12.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.118+0000 7f3b4fd6c640 1 -- 172.21.15.52:0/1213078853 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3b480ade00 msgr2=0x7f3b48144ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:12.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.118+0000 7f3b4fd6c640 1 --2- 172.21.15.52:0/1213078853 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3b480ade00 0x7f3b48144ed0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3b44000c00 tx=0x7f3b440046c0 comp rx=0 tx=0).stop 2023-11-05T08:07:12.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.118+0000 7f3b4fd6c640 1 -- 172.21.15.52:0/1213078853 shutdown_connections 2023-11-05T08:07:12.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.118+0000 7f3b4fd6c640 1 --2- 172.21.15.52:0/1213078853 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f3b2c06c830 0x7f3b2c06ecf0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:12.123 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.118+0000 7f3b4fd6c640 1 --2- 172.21.15.52:0/1213078853 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b4813e810 0x7f3b481d9d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:12.123 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.118+0000 7f3b4fd6c640 1 --2- 172.21.15.52:0/1213078853 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3b480b4240 0x7f3b4813da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:12.123 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.118+0000 7f3b4fd6c640 1 --2- 172.21.15.52:0/1213078853 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3b480ade00 0x7f3b48144ed0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:12.123 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.118+0000 7f3b4fd6c640 1 -- 172.21.15.52:0/1213078853 >> 172.21.15.52:0/1213078853 conn(0x7f3b48065cd0 msgr2=0x7f3b480b24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:07:12.123 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.119+0000 7f3b4fd6c640 1 -- 172.21.15.52:0/1213078853 shutdown_connections 2023-11-05T08:07:12.124 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.119+0000 7f3b4fd6c640 1 -- 172.21.15.52:0/1213078853 wait complete. 2023-11-05T08:07:12.124 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.119+0000 7f3b4fd6c640 1 librados: shutdown 2023-11-05T08:07:12.134 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.5 2023-11-05T08:07:12.136 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.135+0000 7f3990ff9640 1 -- 172.21.15.52:0/1137646105 <== mon.2 v2:172.21.15.52:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3980058120 con 0x7f398c038eb0 2023-11-05T08:07:12.136 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.135+0000 7f3990ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2023-11-05T08:07:12.136 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.135+0000 7f3990ff9640 10 monclient: _finish_command 2 = system:0 2023-11-05T08:07:12.137 INFO:teuthology.orchestra.run.smithi052.stdout:64424509443 2023-11-05T08:07:12.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.137+0000 7f3999675640 10 librados: watch_flush enter 2023-11-05T08:07:12.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.137+0000 7f3999675640 10 librados: watch_flush exit 2023-11-05T08:07:12.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.137+0000 7f3999675640 20 client.4265.objecter shutdown clearing up homeless session... 2023-11-05T08:07:12.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.137+0000 7f3999675640 10 client.4265.objecter successfully canceled tick 2023-11-05T08:07:12.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.137+0000 7f3999675640 1 -- 172.21.15.52:0/1137646105 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f397806c800 msgr2=0x7f397806ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:12.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.137+0000 7f3999675640 1 --2- 172.21.15.52:0/1137646105 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f397806c800 0x7f397806ecc0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3988009990 tx=0x7f3988009110 comp rx=0 tx=0).stop 2023-11-05T08:07:12.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.137+0000 7f3999675640 10 monclient: shutdown 2023-11-05T08:07:12.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.137+0000 7f3999675640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:07:12.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.137+0000 7f3999675640 1 -- 172.21.15.52:0/1137646105 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f398c038eb0 msgr2=0x7f398c0a7aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:12.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.137+0000 7f3999675640 1 --2- 172.21.15.52:0/1137646105 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f398c038eb0 0x7f398c0a7aa0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f398000c400 tx=0x7f398000c800 comp rx=0 tx=0).stop 2023-11-05T08:07:12.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.137+0000 7f3999675640 1 -- 172.21.15.52:0/1137646105 shutdown_connections 2023-11-05T08:07:12.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.137+0000 7f3999675640 1 --2- 172.21.15.52:0/1137646105 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f397806c800 0x7f397806ecc0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:12.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.137+0000 7f3999675640 1 --2- 172.21.15.52:0/1137646105 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f398c0a5160 0x7f398c15d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:12.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.137+0000 7f3999675640 1 --2- 172.21.15.52:0/1137646105 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f398c038eb0 0x7f398c0a7aa0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:12.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.137+0000 7f3999675640 1 --2- 172.21.15.52:0/1137646105 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f398c030b40 0x7f398c0a8840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:12.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.137+0000 7f3999675640 1 -- 172.21.15.52:0/1137646105 >> 172.21.15.52:0/1137646105 conn(0x7f398c0065a0 msgr2=0x7f398c0385f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:07:12.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.137+0000 7f3999675640 1 -- 172.21.15.52:0/1137646105 shutdown_connections 2023-11-05T08:07:12.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.137+0000 7f3999675640 1 -- 172.21.15.52:0/1137646105 wait complete. 2023-11-05T08:07:12.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.137+0000 7f3999675640 1 librados: shutdown 2023-11-05T08:07:12.151 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509443 for osd.3 2023-11-05T08:07:12.315 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.314+0000 7f925b7fe640 1 -- 172.21.15.52:0/3360513462 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f92540542c0 con 0x7f92640ade00 2023-11-05T08:07:12.316 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.314+0000 7f925b7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:07:12.316 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.314+0000 7f925b7fe640 10 monclient: _finish_command 1 = system:0 2023-11-05T08:07:12.328 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.326+0000 7f866d434640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 2}] 2023-11-05T08:07:12.328 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.326+0000 7f866d434640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2023-11-05T08:07:12.328 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.326+0000 7f866d434640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.52:3301/0 2023-11-05T08:07:12.329 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.326+0000 7f866d434640 1 -- 172.21.15.52:0/3013039951 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8668139520 con 0x7f866813eb20 2023-11-05T08:07:12.333 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.332+0000 7f8664ff9640 1 -- 172.21.15.52:0/3013039951 <== mon.2 v2:172.21.15.52:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f865c017070 con 0x7f866813eb20 2023-11-05T08:07:12.333 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.332+0000 7f8664ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2023-11-05T08:07:12.333 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.332+0000 7f8664ff9640 10 monclient: _finish_command 2 = system:0 2023-11-05T08:07:12.334 INFO:teuthology.orchestra.run.smithi052.stdout:64424509445 2023-11-05T08:07:12.335 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.333+0000 7f866d434640 10 librados: watch_flush enter 2023-11-05T08:07:12.336 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.334+0000 7f866d434640 10 librados: watch_flush exit 2023-11-05T08:07:12.336 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.334+0000 7f866d434640 20 client.4268.objecter shutdown clearing up homeless session... 2023-11-05T08:07:12.336 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.334+0000 7f866d434640 10 client.4268.objecter successfully canceled tick 2023-11-05T08:07:12.336 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.334+0000 7f866d434640 1 -- 172.21.15.52:0/3013039951 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f865406c800 msgr2=0x7f865406ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:12.336 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.334+0000 7f866d434640 1 --2- 172.21.15.52:0/3013039951 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f865406c800 0x7f865406ecc0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8658009710 tx=0x7f8658006c90 comp rx=0 tx=0).stop 2023-11-05T08:07:12.337 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.334+0000 7f866d434640 10 monclient: shutdown 2023-11-05T08:07:12.337 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.334+0000 7f866d434640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:07:12.337 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.334+0000 7f866d434640 1 -- 172.21.15.52:0/3013039951 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f866813eb20 msgr2=0x7f86681d67b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:12.337 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.334+0000 7f866d434640 1 --2- 172.21.15.52:0/3013039951 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f866813eb20 0x7f86681d67b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f865c00c440 tx=0x7f865c00c900 comp rx=0 tx=0).stop 2023-11-05T08:07:12.337 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.334+0000 7f866d434640 1 -- 172.21.15.52:0/3013039951 shutdown_connections 2023-11-05T08:07:12.337 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.334+0000 7f866d434640 1 --2- 172.21.15.52:0/3013039951 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f865406c800 0x7f865406ecc0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:12.338 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.334+0000 7f866d434640 1 --2- 172.21.15.52:0/3013039951 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f866813efb0 0x7f86681d6cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:12.338 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.334+0000 7f866d434640 1 --2- 172.21.15.52:0/3013039951 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f866813eb20 0x7f86681d67b0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:12.338 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.334+0000 7f866d434640 1 --2- 172.21.15.52:0/3013039951 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f86680ad980 0x7f8668139fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:12.338 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.334+0000 7f866d434640 1 -- 172.21.15.52:0/3013039951 >> 172.21.15.52:0/3013039951 conn(0x7f86680b7020 msgr2=0x7f86680b7400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:07:12.338 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.334+0000 7f866d434640 1 -- 172.21.15.52:0/3013039951 shutdown_connections 2023-11-05T08:07:12.339 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.334+0000 7f866d434640 1 -- 172.21.15.52:0/3013039951 wait complete. 2023-11-05T08:07:12.339 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.334+0000 7f866d434640 1 librados: shutdown 2023-11-05T08:07:12.346 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.2 2023-11-05T08:07:12.520 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.518+0000 7f9269165640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 7}] 2023-11-05T08:07:12.520 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.518+0000 7f9269165640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 7}] 2023-11-05T08:07:12.521 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.519+0000 7f9269165640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:07:12.521 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.519+0000 7f9269165640 1 -- 172.21.15.52:0/3360513462 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f92640b6a60 con 0x7f92640ade00 2023-11-05T08:07:12.523 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.522+0000 7f925b7fe640 1 -- 172.21.15.52:0/3360513462 <== mon.1 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9254017090 con 0x7f92640ade00 2023-11-05T08:07:12.523 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.522+0000 7f925b7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 7}] 2023-11-05T08:07:12.524 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.522+0000 7f925b7fe640 10 monclient: _finish_command 2 = system:0 2023-11-05T08:07:12.524 INFO:teuthology.orchestra.run.smithi052.stdout:60129542148 2023-11-05T08:07:12.526 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.524+0000 7f9269165640 10 librados: watch_flush enter 2023-11-05T08:07:12.526 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.524+0000 7f9269165640 10 librados: watch_flush exit 2023-11-05T08:07:12.526 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.524+0000 7f9269165640 20 client.4354.objecter shutdown clearing up homeless session... 2023-11-05T08:07:12.526 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.524+0000 7f9269165640 10 client.4354.objecter successfully canceled tick 2023-11-05T08:07:12.527 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.524+0000 7f9269165640 1 -- 172.21.15.52:0/3360513462 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f924406c800 msgr2=0x7f924406ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:12.527 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.524+0000 7f9269165640 1 --2- 172.21.15.52:0/3360513462 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f924406c800 0x7f924406ecc0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f924c036000 tx=0x7f924c030000 comp rx=0 tx=0).stop 2023-11-05T08:07:12.527 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.524+0000 7f9269165640 10 monclient: shutdown 2023-11-05T08:07:12.527 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.524+0000 7f9269165640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:07:12.527 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.524+0000 7f9269165640 1 -- 172.21.15.52:0/3360513462 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f92640ade00 msgr2=0x7f92640a8c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:12.527 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.524+0000 7f9269165640 1 --2- 172.21.15.52:0/3360513462 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f92640ade00 0x7f92640a8c50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f925400c410 tx=0x7f925400c8d0 comp rx=0 tx=0).stop 2023-11-05T08:07:12.528 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.524+0000 7f9269165640 1 -- 172.21.15.52:0/3360513462 shutdown_connections 2023-11-05T08:07:12.528 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.524+0000 7f9269165640 1 --2- 172.21.15.52:0/3360513462 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f924406c800 0x7f924406ecc0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:12.528 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.524+0000 7f9269165640 1 --2- 172.21.15.52:0/3360513462 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9264139710 0x7f9264139ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:12.528 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.524+0000 7f9269165640 1 --2- 172.21.15.52:0/3360513462 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f92640b4240 0x7f92640a9190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:12.528 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.524+0000 7f9269165640 1 --2- 172.21.15.52:0/3360513462 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f92640ade00 0x7f92640a8c50 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:12.529 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.524+0000 7f9269165640 1 -- 172.21.15.52:0/3360513462 >> 172.21.15.52:0/3360513462 conn(0x7f9264065cd0 msgr2=0x7f92640b1150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:07:12.529 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.524+0000 7f9269165640 1 -- 172.21.15.52:0/3360513462 shutdown_connections 2023-11-05T08:07:12.529 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.524+0000 7f9269165640 1 -- 172.21.15.52:0/3360513462 wait complete. 2023-11-05T08:07:12.529 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.524+0000 7f9269165640 1 librados: shutdown 2023-11-05T08:07:12.537 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.7 2023-11-05T08:07:12.781 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-05T08:07:12.803 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-05T08:07:12.890 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.889+0000 7f1cee38a640 10 monclient: get_monmap_and_config 2023-11-05T08:07:12.891 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.889+0000 7f1cee38a640 10 monclient: build_initial_monmap 2023-11-05T08:07:12.891 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.889+0000 7f1cee38a640 10 monclient: monmap: 2023-11-05T08:07:12.891 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:07:12.891 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:12.891 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:07:12.890792+0000 2023-11-05T08:07:12.892 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:07:12.890792+0000 2023-11-05T08:07:12.892 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:07:12.892 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:12.892 INFO:teuthology.orchestra.run.smithi052.stderr:0: v1:172.21.15.52:6789/0 mon.noname-a-legacy 2023-11-05T08:07:12.892 INFO:teuthology.orchestra.run.smithi052.stderr:1: v1:172.21.15.156:6789/0 mon.noname-c-legacy 2023-11-05T08:07:12.893 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-b 2023-11-05T08:07:12.893 INFO:teuthology.orchestra.run.smithi052.stderr:3: v2:172.21.15.52:3300/0 mon.noname-a 2023-11-05T08:07:12.893 INFO:teuthology.orchestra.run.smithi052.stderr:4: v2:172.21.15.156:3300/0 mon.noname-c 2023-11-05T08:07:12.893 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:12.895 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.890+0000 7f1cee38a640 1 Processor -- start 2023-11-05T08:07:12.895 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.890+0000 7f1cee38a640 1 -- start start 2023-11-05T08:07:12.895 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.890+0000 7f1cee38a640 10 monclient: init 2023-11-05T08:07:12.895 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.890+0000 7f1cee38a640 10 monclient: _reopen_session rank -1 2023-11-05T08:07:12.896 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.890+0000 7f1cee38a640 10 monclient: _add_conns ranks=[0,1,3,4,2] 2023-11-05T08:07:12.896 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.890+0000 7f1cee38a640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f1ce80a8ae0 addr v1:172.21.15.52:6789/0 2023-11-05T08:07:12.896 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.890+0000 7f1cee38a640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f1ce813f340 addr v1:172.21.15.156:6789/0 2023-11-05T08:07:12.896 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.890+0000 7f1cee38a640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1ce80a8ec0 0x7f1ce8145710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:12.896 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.890+0000 7f1cee38a640 10 monclient(hunting): picked mon.noname-a con 0x7f1ce80a8ec0 addr v2:172.21.15.52:3300/0 2023-11-05T08:07:12.897 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.890+0000 7f1cee38a640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ce80a9600 con 0x7f1ce80a8ae0 2023-11-05T08:07:12.897 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.890+0000 7f1cee38a640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ce8145c50 con 0x7f1ce813f340 2023-11-05T08:07:12.897 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.890+0000 7f1cee38a640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:12.897 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.890+0000 7f1cee38a640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ce80a9360 con 0x7f1ce80a8ec0 2023-11-05T08:07:12.897 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.890+0000 7f1cee38a640 10 monclient(hunting): _renew_subs 2023-11-05T08:07:12.898 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.890+0000 7f1cee38a640 10 monclient(hunting): authenticate will time out at 1379.096630s 2023-11-05T08:07:12.898 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.891+0000 7f1cec927640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1ce80a8ec0 0x7f1ce8145710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:12.898 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.891+0000 7f1ce77fe640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f1ce813f340 0x7f1ce8145000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.52:35510/0 (socket says 172.21.15.52:35510) 2023-11-05T08:07:12.898 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.891+0000 7f1ce77fe640 1 -- 172.21.15.52:0/2066998089 learned_addr learned my addr 172.21.15.52:0/2066998089 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-11-05T08:07:12.898 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.891+0000 7f1cec927640 10 monclient(hunting): get_auth_request con 0x7f1ce80a8ec0 auth_method 0 2023-11-05T08:07:12.899 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.891+0000 7f1cec927640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:12.899 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.891+0000 7f1cec927640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:12.899 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.891+0000 7f1cec927640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:12.899 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.892+0000 7f1cec927640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:12.899 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.892+0000 7f1cec927640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:12.900 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.892+0000 7f1cec927640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:12.900 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.894+0000 7f1ce6ffd640 1 -- 172.21.15.52:0/2066998089 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3204665715 0 0) 0x7f1ce8145c50 con 0x7f1ce813f340 2023-11-05T08:07:12.901 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.894+0000 7f1ce6ffd640 10 monclient(hunting): _negotiate 2023-11-05T08:07:12.901 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.894+0000 7f1ce6ffd640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:12.901 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.894+0000 7f1ce6ffd640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:12.901 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.894+0000 7f1ce6ffd640 10 monclient(hunting): my global_id is 4357 2023-11-05T08:07:12.902 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.894+0000 7f1ce6ffd640 1 -- 172.21.15.52:0/2066998089 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1cd0003520 con 0x7f1ce813f340 2023-11-05T08:07:12.902 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.894+0000 7f1cec927640 10 monclient(hunting): handle_auth_done global_id 4332 payload 274 2023-11-05T08:07:12.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.894+0000 7f1cec927640 1 -- 172.21.15.52:0/2066998089 >> v1:172.21.15.156:6789/0 conn(0x7f1ce813f340 legacy=0x7f1ce8145000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:12.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.894+0000 7f1cec927640 1 -- 172.21.15.52:0/2066998089 >> v1:172.21.15.52:6789/0 conn(0x7f1ce80a8ae0 legacy=0x7f1ce813ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:12.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.894+0000 7f1cec927640 10 monclient: _finish_hunting 0 2023-11-05T08:07:12.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.894+0000 7f1cec927640 1 monclient: found mon.noname-a 2023-11-05T08:07:12.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.894+0000 7f1cec927640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:07:12.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.894+0000 7f1cec927640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.52:3300/0 2023-11-05T08:07:12.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.894+0000 7f1cec927640 1 -- 172.21.15.52:0/2066998089 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ce80b80b0 con 0x7f1ce80a8ec0 2023-11-05T08:07:12.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.896+0000 7f1cec927640 1 --2- 172.21.15.52:0/2066998089 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ce80a8ec0 0x7f1ce8145710 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1ce0009d90 tx=0x7f1ce002beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=626de43f2f91e46b server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:12.908 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.902+0000 7f1ce6ffd640 1 -- 172.21.15.52:0/2066998089 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce002cc60 con 0x7f1ce80a8ec0 2023-11-05T08:07:12.908 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.902+0000 7f1ce6ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:12.908 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.902+0000 7f1ce6ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-11-05T08:07:12.908 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.902+0000 7f1ce6ffd640 10 monclient: dump: 2023-11-05T08:07:12.909 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:12.909 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:12.909 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:12.909 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:12.910 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:12.910 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:12.910 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:12.910 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:12.911 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:12.911 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:12.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.902+0000 7f1ce6ffd640 10 monclient: _finish_auth 0 2023-11-05T08:07:12.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.902+0000 7f1ce6ffd640 10 monclient: _check_auth_tickets 2023-11-05T08:07:12.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.902+0000 7f1ce6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:07:12.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.902+0000 7f1ce6ffd640 1 -- 172.21.15.52:0/2066998089 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ce002cdc0 con 0x7f1ce80a8ec0 2023-11-05T08:07:12.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.902+0000 7f1cee38a640 5 monclient: authenticate success, global_id 4332 2023-11-05T08:07:12.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.902+0000 7f1cee38a640 20 monclient: get_monmap_and_config waiting for monmap|config 2023-11-05T08:07:12.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.902+0000 7f1ce6ffd640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:07:12.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.902+0000 7f1cee38a640 10 monclient: get_monmap_and_config success 2023-11-05T08:07:12.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.902+0000 7f1cee38a640 4 set_mon_vals no callback set 2023-11-05T08:07:12.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.902+0000 7f1ce6ffd640 1 -- 172.21.15.52:0/2066998089 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce0034660 con 0x7f1ce80a8ec0 2023-11-05T08:07:12.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.902+0000 7f1ce6ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:12.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.902+0000 7f1ce6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-11-05T08:07:12.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.902+0000 7f1ce6ffd640 10 monclient: dump: 2023-11-05T08:07:12.914 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:12.914 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:12.914 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:12.915 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:12.915 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:12.915 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:12.916 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:12.916 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:12.916 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:12.917 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:12.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.902+0000 7f1cee38a640 10 monclient: shutdown 2023-11-05T08:07:12.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.902+0000 7f1cee38a640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:07:12.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.902+0000 7f1cee38a640 1 -- 172.21.15.52:0/2066998089 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ce80a8ec0 msgr2=0x7f1ce8145710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:12.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.902+0000 7f1cee38a640 1 --2- 172.21.15.52:0/2066998089 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ce80a8ec0 0x7f1ce8145710 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1ce0009d90 tx=0x7f1ce002beb0 comp rx=0 tx=0).stop 2023-11-05T08:07:12.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.902+0000 7f1cee38a640 1 -- 172.21.15.52:0/2066998089 shutdown_connections 2023-11-05T08:07:12.919 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.902+0000 7f1cee38a640 1 --2- 172.21.15.52:0/2066998089 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ce80a8ec0 0x7f1ce8145710 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:12.919 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.902+0000 7f1cee38a640 1 -- 172.21.15.52:0/2066998089 >> 172.21.15.52:0/2066998089 conn(0x7f1ce80b7230 msgr2=0x7f1ce80b7610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:07:12.919 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.902+0000 7f1cee38a640 1 -- 172.21.15.52:0/2066998089 shutdown_connections 2023-11-05T08:07:12.920 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.902+0000 7f1cee38a640 1 -- 172.21.15.52:0/2066998089 wait complete. 2023-11-05T08:07:12.920 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.903+0000 7f1cee38a640 10 monclient: build_initial_monmap 2023-11-05T08:07:12.920 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.903+0000 7f1cee38a640 10 monclient: monmap: 2023-11-05T08:07:12.921 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:07:12.921 INFO:teuthology.orchestra.run.smithi052.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-05T08:07:12.921 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 0.000000 2023-11-05T08:07:12.922 INFO:teuthology.orchestra.run.smithi052.stderr:created 0.000000 2023-11-05T08:07:12.922 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:07:12.922 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:12.922 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.noname-a 2023-11-05T08:07:12.923 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.noname-b 2023-11-05T08:07:12.923 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-c 2023-11-05T08:07:12.923 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:12.923 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.904+0000 7f1cee38a640 1 librados: starting msgr at 2023-11-05T08:07:12.923 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.904+0000 7f1cee38a640 1 librados: starting objecter 2023-11-05T08:07:12.923 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.904+0000 7f1cee38a640 1 Processor -- start 2023-11-05T08:07:12.924 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.904+0000 7f1cee38a640 1 -- start start 2023-11-05T08:07:12.924 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.904+0000 7f1cee38a640 1 librados: setting wanted keys 2023-11-05T08:07:12.924 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.904+0000 7f1cee38a640 1 librados: calling monclient init 2023-11-05T08:07:12.924 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.904+0000 7f1cee38a640 10 monclient: init 2023-11-05T08:07:12.924 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.904+0000 7f1cee38a640 10 monclient: _reopen_session rank -1 2023-11-05T08:07:12.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.904+0000 7f1cee38a640 10 monclient: _add_conns ranks=[2,1,0] 2023-11-05T08:07:12.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.904+0000 7f1cee38a640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1ce80a8ae0 0x7f1ce81438d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:12.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.904+0000 7f1cee38a640 10 monclient(hunting): picked mon.noname-c con 0x7f1ce80a8ae0 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:07:12.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.904+0000 7f1cee38a640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1ce80a8ec0 0x7f1ce812d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:12.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.905+0000 7f1cee38a640 10 monclient(hunting): picked mon.noname-b con 0x7f1ce80a8ec0 addr [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] 2023-11-05T08:07:12.926 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.905+0000 7f1cee38a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ce813f340 0x7f1ce8142c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:12.926 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.905+0000 7f1cee38a640 10 monclient(hunting): picked mon.noname-a con 0x7f1ce813f340 addr [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] 2023-11-05T08:07:12.926 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.905+0000 7f1cee38a640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:12.926 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.905+0000 7f1cee38a640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce80b6d30 con 0x7f1ce813f340 2023-11-05T08:07:12.927 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.905+0000 7f1cee38a640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:12.927 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.905+0000 7f1cee38a640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce81419c0 con 0x7f1ce80a8ec0 2023-11-05T08:07:12.927 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.905+0000 7f1cee38a640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:12.927 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.905+0000 7f1cee38a640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce8143190 con 0x7f1ce80a8ae0 2023-11-05T08:07:12.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.905+0000 7f1cee38a640 10 monclient(hunting): _renew_subs 2023-11-05T08:07:12.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.905+0000 7f1cee38a640 10 monclient(hunting): authenticate will time out at 1379.110948s 2023-11-05T08:07:12.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.905+0000 7f1cec927640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ce813f340 0x7f1ce8142c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:12.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.905+0000 7f1ce7fff640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1ce80a8ae0 0x7f1ce81438d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:12.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.905+0000 7f1ce77fe640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1ce80a8ec0 0x7f1ce812d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:12.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.905+0000 7f1ce7fff640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1ce80a8ae0 0x7f1ce81438d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.52:40392/0 (socket says 172.21.15.52:40392) 2023-11-05T08:07:12.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.905+0000 7f1ce7fff640 1 -- 172.21.15.52:0/1034509529 learned_addr learned my addr 172.21.15.52:0/1034509529 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-11-05T08:07:12.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.905+0000 7f1ce7fff640 10 monclient(hunting): get_auth_request con 0x7f1ce80a8ae0 auth_method 0 2023-11-05T08:07:12.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.905+0000 7f1ce77fe640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1ce80a8ec0 0x7f1ce812d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.52:59174/0 (socket says 172.21.15.52:59174) 2023-11-05T08:07:12.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.905+0000 7f1ce7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:12.930 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.905+0000 7f1ce7fff640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:12.930 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.905+0000 7f1ce7fff640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:12.930 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.905+0000 7f1ce77fe640 10 monclient(hunting): get_auth_request con 0x7f1ce80a8ec0 auth_method 0 2023-11-05T08:07:12.930 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.905+0000 7f1ce77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:12.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.905+0000 7f1ce77fe640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:12.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.905+0000 7f1ce77fe640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:12.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.906+0000 7f1cec927640 10 monclient(hunting): get_auth_request con 0x7f1ce813f340 auth_method 0 2023-11-05T08:07:12.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.906+0000 7f1cec927640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:12.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.906+0000 7f1cec927640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:12.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.906+0000 7f1cec927640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:12.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.906+0000 7f1ce7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:12.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.906+0000 7f1ce7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:12.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.906+0000 7f1ce7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:12.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.906+0000 7f1ce77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:12.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.906+0000 7f1ce77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:12.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.906+0000 7f1ce77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:12.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.906+0000 7f1cec927640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:12.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.906+0000 7f1cec927640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:12.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.906+0000 7f1cec927640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:12.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.909+0000 7f1ce77fe640 10 monclient(hunting): handle_auth_done global_id 4360 payload 824 2023-11-05T08:07:12.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.909+0000 7f1ce77fe640 1 -- 172.21.15.52:0/1034509529 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1ce80a8ae0 msgr2=0x7f1ce81438d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:12.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.909+0000 7f1ce77fe640 1 --2- 172.21.15.52:0/1034509529 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1ce80a8ae0 0x7f1ce81438d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:12.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.909+0000 7f1ce77fe640 1 -- 172.21.15.52:0/1034509529 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ce813f340 msgr2=0x7f1ce8142c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:12.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.909+0000 7f1ce77fe640 1 --2- 172.21.15.52:0/1034509529 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ce813f340 0x7f1ce8142c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:12.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.909+0000 7f1ce77fe640 10 monclient: _finish_hunting 0 2023-11-05T08:07:12.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.909+0000 7f1ce77fe640 1 monclient: found mon.noname-b 2023-11-05T08:07:12.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.909+0000 7f1ce77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:07:12.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.909+0000 7f1ce77fe640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.156:3300/0 2023-11-05T08:07:12.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.909+0000 7f1ce77fe640 1 -- 172.21.15.52:0/1034509529 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ce0009a70 con 0x7f1ce80a8ec0 2023-11-05T08:07:12.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.911+0000 7f1ce77fe640 1 --2- 172.21.15.52:0/1034509529 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1ce80a8ec0 0x7f1ce812d920 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc00c390 tx=0x7f1cdc001e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:12.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.911+0000 7f1ce4ff9640 10 client.?.objecter ms_handle_connect 0x7f1ce80a8ec0 2023-11-05T08:07:12.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.911+0000 7f1ce4ff9640 10 client.?.objecter resend_mon_ops 2023-11-05T08:07:12.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.915+0000 7f1ce4ff9640 1 -- 172.21.15.52:0/1034509529 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cdc005ce0 con 0x7f1ce80a8ec0 2023-11-05T08:07:12.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.915+0000 7f1ce4ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:12.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.915+0000 7f1ce4ff9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-05T08:07:12.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.915+0000 7f1ce4ff9640 10 monclient: dump: 2023-11-05T08:07:12.940 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:12.941 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:12.941 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:12.941 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:12.942 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:12.942 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:12.942 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:12.943 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:12.943 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:12.943 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:12.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.915+0000 7f1ce4ff9640 10 monclient: _finish_auth 0 2023-11-05T08:07:12.944 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.915+0000 7f1ce4ff9640 10 monclient: _check_auth_tickets 2023-11-05T08:07:12.944 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.915+0000 7f1ce4ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:07:12.944 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.915+0000 7f1ce4ff9640 1 -- 172.21.15.52:0/1034509529 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cdc005e40 con 0x7f1ce80a8ec0 2023-11-05T08:07:12.945 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.915+0000 7f1ce4ff9640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:07:12.945 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.915+0000 7f1ce4ff9640 1 -- 172.21.15.52:0/1034509529 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cdc0072d0 con 0x7f1ce80a8ec0 2023-11-05T08:07:12.945 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.915+0000 7f1cee38a640 5 monclient: authenticate success, global_id 4360 2023-11-05T08:07:12.945 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.915+0000 7f1cee38a640 10 monclient: _renew_subs 2023-11-05T08:07:12.945 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.915+0000 7f1cee38a640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:07:12.946 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.915+0000 7f1cee38a640 1 -- 172.21.15.52:0/1034509529 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ce8144c80 con 0x7f1ce80a8ec0 2023-11-05T08:07:12.946 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.915+0000 7f1ce4ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:12.946 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.915+0000 7f1ce4ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-05T08:07:12.946 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.915+0000 7f1ce4ff9640 10 monclient: dump: 2023-11-05T08:07:12.946 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:12.947 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:12.947 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:12.947 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:12.947 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:12.947 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:12.948 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:12.948 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:12.948 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:12.948 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:12.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.915+0000 7f1ce67fc640 4 set_mon_vals no callback set 2023-11-05T08:07:12.949 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.915+0000 7f1cee38a640 10 client.4360.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-05T08:07:12.949 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.915+0000 7f1cee38a640 10 monclient: _renew_subs 2023-11-05T08:07:12.949 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.915+0000 7f1cee38a640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:07:12.949 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.915+0000 7f1cee38a640 1 -- 172.21.15.52:0/1034509529 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ce813fcd0 con 0x7f1ce80a8ec0 2023-11-05T08:07:12.949 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.915+0000 7f1cee38a640 1 librados: init done 2023-11-05T08:07:12.950 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.916+0000 7f1cee38a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-05T08:07:12.950 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.916+0000 7f1cee38a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:07:12.950 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.916+0000 7f1cee38a640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:07:12.950 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.916+0000 7f1cee38a640 1 -- 172.21.15.52:0/1034509529 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ce80b6ea0 con 0x7f1ce80a8ec0 2023-11-05T08:07:12.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.932+0000 7f699bf97640 10 monclient: get_monmap_and_config 2023-11-05T08:07:12.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.932+0000 7f699bf97640 10 monclient: build_initial_monmap 2023-11-05T08:07:12.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.932+0000 7f699bf97640 10 monclient: monmap: 2023-11-05T08:07:12.952 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:07:12.952 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:12.952 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:07:12.933638+0000 2023-11-05T08:07:12.953 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:07:12.933638+0000 2023-11-05T08:07:12.953 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:07:12.953 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:12.953 INFO:teuthology.orchestra.run.smithi052.stderr:0: v1:172.21.15.52:6789/0 mon.noname-a-legacy 2023-11-05T08:07:12.953 INFO:teuthology.orchestra.run.smithi052.stderr:1: v1:172.21.15.156:6789/0 mon.noname-c-legacy 2023-11-05T08:07:12.953 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-b 2023-11-05T08:07:12.954 INFO:teuthology.orchestra.run.smithi052.stderr:3: v2:172.21.15.52:3300/0 mon.noname-a 2023-11-05T08:07:12.954 INFO:teuthology.orchestra.run.smithi052.stderr:4: v2:172.21.15.156:3300/0 mon.noname-c 2023-11-05T08:07:12.954 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:12.954 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.932+0000 7f699bf97640 1 Processor -- start 2023-11-05T08:07:12.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.932+0000 7f699bf97640 1 -- start start 2023-11-05T08:07:12.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.932+0000 7f699bf97640 10 monclient: init 2023-11-05T08:07:12.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.933+0000 7f1ce4ff9640 1 -- 172.21.15.52:0/1034509529 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1cdc007430 con 0x7f1ce80a8ec0 2023-11-05T08:07:12.958 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.933+0000 7f699bf97640 10 monclient: _reopen_session rank -1 2023-11-05T08:07:12.958 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.933+0000 7f699bf97640 10 monclient: _add_conns ranks=[3,2,4,1,0] 2023-11-05T08:07:12.958 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.933+0000 7f699bf97640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f69940a8ae0 0x7f699413ec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:12.958 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.933+0000 7f699bf97640 10 monclient(hunting): picked mon.noname-a con 0x7f69940a8ae0 addr v2:172.21.15.52:3300/0 2023-11-05T08:07:12.959 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.933+0000 7f699bf97640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f69940a8ec0 0x7f699413f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:12.959 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.933+0000 7f699bf97640 10 monclient(hunting): picked mon.noname-b con 0x7f69940a8ec0 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:07:12.959 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.933+0000 7f699bf97640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f69940b0de0 0x7f6994145000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:12.959 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.933+0000 7f699bf97640 10 monclient(hunting): picked mon.noname-c con 0x7f69940b0de0 addr v2:172.21.15.156:3300/0 2023-11-05T08:07:12.959 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.933+0000 7f699bf97640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:12.960 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.933+0000 7f699bf97640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69940a9360 con 0x7f69940a8ae0 2023-11-05T08:07:12.960 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.933+0000 7f699bf97640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:12.960 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.933+0000 7f699bf97640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69940a9600 con 0x7f69940b0de0 2023-11-05T08:07:12.960 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.933+0000 7f699bf97640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:12.960 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.933+0000 7f699bf97640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69940b80b0 con 0x7f69940a8ec0 2023-11-05T08:07:12.961 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.933+0000 7f699bf97640 10 monclient(hunting): _renew_subs 2023-11-05T08:07:12.961 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.933+0000 7f699bf97640 10 monclient(hunting): authenticate will time out at 1379.139410s 2023-11-05T08:07:12.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.933+0000 7f1ce4ff9640 1 --2- 172.21.15.52:0/1034509529 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f1cd406c850 0x7f1cd406ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:12.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.933+0000 7f1ce7fff640 1 --2- 172.21.15.52:0/1034509529 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f1cd406c850 0x7f1cd406ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:12.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.933+0000 7f1ce7fff640 10 monclient: get_auth_request con 0x7f1cd406c850 auth_method 0 2023-11-05T08:07:12.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.934+0000 7f6999532640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f69940a8ec0 0x7f699413f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:12.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.934+0000 7f6999d33640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f69940a8ae0 0x7f699413ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:12.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.934+0000 7f1ce7fff640 1 --2- 172.21.15.52:0/1034509529 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f1cd406c850 0x7f1cd406ed10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1cd8001830 tx=0x7f1cd8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:12.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.934+0000 7f1ce4ff9640 10 client.4360.objecter ms_handle_connect 0x7f1cd406c850 2023-11-05T08:07:12.966 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.934+0000 7f6999532640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f69940a8ec0 0x7f699413f170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.52:40404/0 (socket says 172.21.15.52:40404) 2023-11-05T08:07:12.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.934+0000 7f6999532640 1 -- 172.21.15.52:0/2061459391 learned_addr learned my addr 172.21.15.52:0/2061459391 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-11-05T08:07:12.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.934+0000 7f6999532640 10 monclient(hunting): get_auth_request con 0x7f69940a8ec0 auth_method 0 2023-11-05T08:07:12.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.934+0000 7f6999532640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:12.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.934+0000 7f6999532640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:12.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.934+0000 7f6999532640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:12.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.934+0000 7f6999d33640 10 monclient(hunting): get_auth_request con 0x7f69940a8ae0 auth_method 0 2023-11-05T08:07:12.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.934+0000 7f6999d33640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:12.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.934+0000 7f6999d33640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:12.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.934+0000 7f6999d33640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:12.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.934+0000 7f6999532640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:12.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.934+0000 7f6999532640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:12.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.934+0000 7f6999532640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:12.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.935+0000 7f6999d33640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:12.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.935+0000 7f6999d33640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:12.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.935+0000 7f6999d33640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:12.972 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.935+0000 7f1ce4ff9640 1 -- 172.21.15.52:0/1034509529 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f1cdc057bf0 con 0x7f1ce80a8ec0 2023-11-05T08:07:12.972 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.935+0000 7f1ce4ff9640 10 client.4360.objecter ms_dispatch 0x7f1ce8000b90 osd_map(23..23 src has 1..23) v4 2023-11-05T08:07:12.972 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.935+0000 7f1ce4ff9640 3 client.4360.objecter handle_osd_map got epochs [23,23] > 0 2023-11-05T08:07:12.972 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.935+0000 7f1ce4ff9640 3 client.4360.objecter handle_osd_map decoding full epoch 23 2023-11-05T08:07:12.972 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.935+0000 7f1ce4ff9640 20 client.4360.objecter dump_active .. 0 homeless 2023-11-05T08:07:12.980 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.936+0000 7f6999532640 10 monclient(hunting): handle_auth_done global_id 4274 payload 274 2023-11-05T08:07:12.980 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.936+0000 7f6999532640 1 -- 172.21.15.52:0/2061459391 >> v2:172.21.15.156:3300/0 conn(0x7f69940b0de0 msgr2=0x7f6994145000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-05T08:07:12.980 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.936+0000 7f6999532640 1 --2- 172.21.15.52:0/2061459391 >> v2:172.21.15.156:3300/0 conn(0x7f69940b0de0 0x7f6994145000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:12.980 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.936+0000 7f6999532640 1 -- 172.21.15.52:0/2061459391 >> v2:172.21.15.52:3300/0 conn(0x7f69940a8ae0 msgr2=0x7f699413ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-05T08:07:12.980 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.936+0000 7f6999532640 1 --2- 172.21.15.52:0/2061459391 >> v2:172.21.15.52:3300/0 conn(0x7f69940a8ae0 0x7f699413ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:12.981 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.936+0000 7f6999532640 10 monclient: _finish_hunting 0 2023-11-05T08:07:12.981 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.936+0000 7f6999532640 1 monclient: found mon.noname-b 2023-11-05T08:07:12.981 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.936+0000 7f6999532640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:07:12.981 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.936+0000 7f6999532640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.52:3301/0 2023-11-05T08:07:12.981 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.936+0000 7f6999532640 1 -- 172.21.15.52:0/2061459391 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6994145540 con 0x7f69940a8ec0 2023-11-05T08:07:12.982 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.938+0000 7f6999532640 1 --2- 172.21.15.52:0/2061459391 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f69940a8ec0 0x7f699413f170 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f69940aa900 tx=0x7f698402b990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ea56ac1a1729394 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:12.982 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.942+0000 7f6998d31640 1 -- 172.21.15.52:0/2061459391 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6984030850 con 0x7f69940a8ec0 2023-11-05T08:07:12.982 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.942+0000 7f6998d31640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:12.982 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.942+0000 7f6998d31640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-05T08:07:12.982 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.942+0000 7f6998d31640 10 monclient: dump: 2023-11-05T08:07:12.983 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:12.983 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:12.983 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:12.983 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:12.983 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:12.984 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:12.984 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:12.984 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:12.984 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:12.985 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:12.985 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.942+0000 7f6998d31640 10 monclient: _finish_auth 0 2023-11-05T08:07:12.985 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.942+0000 7f6998d31640 10 monclient: _check_auth_tickets 2023-11-05T08:07:12.985 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.942+0000 7f6998d31640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:07:12.985 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.942+0000 7f6998d31640 1 -- 172.21.15.52:0/2061459391 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69840309b0 con 0x7f69940a8ec0 2023-11-05T08:07:12.986 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.942+0000 7f699bf97640 5 monclient: authenticate success, global_id 4274 2023-11-05T08:07:12.986 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.942+0000 7f699bf97640 20 monclient: get_monmap_and_config waiting for monmap|config 2023-11-05T08:07:12.986 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.942+0000 7f6998d31640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:07:12.986 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.942+0000 7f699bf97640 10 monclient: get_monmap_and_config success 2023-11-05T08:07:12.986 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.942+0000 7f6998d31640 1 -- 172.21.15.52:0/2061459391 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6984030d40 con 0x7f69940a8ec0 2023-11-05T08:07:12.987 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.942+0000 7f699bf97640 4 set_mon_vals no callback set 2023-11-05T08:07:12.987 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.942+0000 7f6998d31640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:12.987 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.942+0000 7f6998d31640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-11-05T08:07:12.987 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.942+0000 7f6998d31640 10 monclient: dump: 2023-11-05T08:07:12.987 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:12.987 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:12.988 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:12.988 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:12.988 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:12.988 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:12.988 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:12.988 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:12.989 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:12.989 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:12.989 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.943+0000 7f699bf97640 10 monclient: shutdown 2023-11-05T08:07:12.989 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.943+0000 7f699bf97640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:07:12.989 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.943+0000 7f699bf97640 1 -- 172.21.15.52:0/2061459391 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f69940a8ec0 msgr2=0x7f699413f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:12.990 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.943+0000 7f699bf97640 1 --2- 172.21.15.52:0/2061459391 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f69940a8ec0 0x7f699413f170 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f69940aa900 tx=0x7f698402b990 comp rx=0 tx=0).stop 2023-11-05T08:07:12.990 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.943+0000 7f699bf97640 1 -- 172.21.15.52:0/2061459391 shutdown_connections 2023-11-05T08:07:12.990 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.943+0000 7f699bf97640 1 --2- 172.21.15.52:0/2061459391 >> v2:172.21.15.156:3300/0 conn(0x7f69940b0de0 0x7f6994145000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:12.990 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.943+0000 7f699bf97640 1 --2- 172.21.15.52:0/2061459391 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f69940a8ec0 0x7f699413f170 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:12.990 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.943+0000 7f699bf97640 1 --2- 172.21.15.52:0/2061459391 >> v2:172.21.15.52:3300/0 conn(0x7f69940a8ae0 0x7f699413ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:12.990 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.943+0000 7f699bf97640 1 -- 172.21.15.52:0/2061459391 >> 172.21.15.52:0/2061459391 conn(0x7f69940b7230 msgr2=0x7f69940b7610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:07:12.991 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.943+0000 7f699bf97640 1 -- 172.21.15.52:0/2061459391 shutdown_connections 2023-11-05T08:07:12.991 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.943+0000 7f699bf97640 1 -- 172.21.15.52:0/2061459391 wait complete. 2023-11-05T08:07:12.991 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.944+0000 7f699bf97640 10 monclient: build_initial_monmap 2023-11-05T08:07:12.991 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.944+0000 7f699bf97640 10 monclient: monmap: 2023-11-05T08:07:12.991 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:07:12.992 INFO:teuthology.orchestra.run.smithi052.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-05T08:07:12.992 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 0.000000 2023-11-05T08:07:12.992 INFO:teuthology.orchestra.run.smithi052.stderr:created 0.000000 2023-11-05T08:07:12.992 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:07:12.992 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:12.992 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.noname-a 2023-11-05T08:07:12.993 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.noname-b 2023-11-05T08:07:12.993 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-c 2023-11-05T08:07:12.993 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:12.993 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.944+0000 7f699bf97640 1 librados: starting msgr at 2023-11-05T08:07:12.993 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.944+0000 7f699bf97640 1 librados: starting objecter 2023-11-05T08:07:12.993 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.944+0000 7f699bf97640 1 Processor -- start 2023-11-05T08:07:12.994 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.944+0000 7f699bf97640 1 -- start start 2023-11-05T08:07:12.994 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.944+0000 7f699bf97640 1 librados: setting wanted keys 2023-11-05T08:07:12.994 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.944+0000 7f699bf97640 1 librados: calling monclient init 2023-11-05T08:07:12.994 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.944+0000 7f699bf97640 10 monclient: init 2023-11-05T08:07:12.994 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.945+0000 7f699bf97640 10 monclient: _reopen_session rank -1 2023-11-05T08:07:12.995 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.945+0000 7f699bf97640 10 monclient: _add_conns ranks=[1,2,0] 2023-11-05T08:07:12.995 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.945+0000 7f699bf97640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f69940a8ae0 0x7f699413e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:12.995 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.945+0000 7f699bf97640 10 monclient(hunting): picked mon.noname-b con 0x7f69940a8ae0 addr [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] 2023-11-05T08:07:12.995 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.945+0000 7f699bf97640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f69940a8ec0 0x7f69941d6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:12.995 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.945+0000 7f699bf97640 10 monclient(hunting): picked mon.noname-c con 0x7f69940a8ec0 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:07:12.996 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.945+0000 7f699bf97640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69940b0de0 0x7f69941d6750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:12.996 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.945+0000 7f699bf97640 10 monclient(hunting): picked mon.noname-a con 0x7f69940b0de0 addr [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] 2023-11-05T08:07:12.996 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.945+0000 7f699bf97640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:12.996 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.945+0000 7f699bf97640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69941d6c90 con 0x7f69940b0de0 2023-11-05T08:07:12.996 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.945+0000 7f699bf97640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:12.996 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.945+0000 7f699bf97640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69941420f0 con 0x7f69940a8ae0 2023-11-05T08:07:12.997 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.945+0000 7f699bf97640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:12.997 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.945+0000 7f699bf97640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6994142610 con 0x7f69940a8ec0 2023-11-05T08:07:12.997 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.945+0000 7f699bf97640 10 monclient(hunting): _renew_subs 2023-11-05T08:07:12.997 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.945+0000 7f699bf97640 10 monclient(hunting): authenticate will time out at 1379.151345s 2023-11-05T08:07:12.997 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.945+0000 7f6999532640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f69940a8ec0 0x7f69941d6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:12.998 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.945+0000 7f699a534640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69940b0de0 0x7f69941d6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:12.998 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.946+0000 7f6999532640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f69940a8ec0 0x7f69941d6210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.52:40406/0 (socket says 172.21.15.52:40406) 2023-11-05T08:07:12.998 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.946+0000 7f6999532640 1 -- 172.21.15.52:0/2280017784 learned_addr learned my addr 172.21.15.52:0/2280017784 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-11-05T08:07:12.998 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.946+0000 7f6999532640 10 monclient(hunting): get_auth_request con 0x7f69940a8ec0 auth_method 0 2023-11-05T08:07:12.998 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.946+0000 7f6999532640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:12.999 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.946+0000 7f6999532640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:12.999 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.946+0000 7f6999532640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:12.999 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.946+0000 7f699a534640 10 monclient(hunting): get_auth_request con 0x7f69940b0de0 auth_method 0 2023-11-05T08:07:12.999 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.946+0000 7f699a534640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:12.999 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.946+0000 7f699a534640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:12.999 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.946+0000 7f699a534640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:13.000 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.946+0000 7f6999532640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:13.000 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.946+0000 7f6999532640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:13.000 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.946+0000 7f6999532640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:13.000 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.946+0000 7f699a534640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:13.001 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.946+0000 7f699a534640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:13.001 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.946+0000 7f699a534640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:13.001 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.949+0000 7f6999532640 10 monclient(hunting): handle_auth_done global_id 4277 payload 824 2023-11-05T08:07:13.001 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.949+0000 7f6999532640 1 -- 172.21.15.52:0/2280017784 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f69940a8ae0 msgr2=0x7f699413e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:13.001 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.949+0000 7f6999532640 1 --2- 172.21.15.52:0/2280017784 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f69940a8ae0 0x7f699413e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:13.002 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.949+0000 7f6999532640 1 -- 172.21.15.52:0/2280017784 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69940b0de0 msgr2=0x7f69941d6750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:13.002 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.949+0000 7f6999532640 1 --2- 172.21.15.52:0/2280017784 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69940b0de0 0x7f69941d6750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:13.002 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.949+0000 7f6999532640 10 monclient: _finish_hunting 0 2023-11-05T08:07:13.002 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.949+0000 7f6999532640 1 monclient: found mon.noname-c 2023-11-05T08:07:13.002 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.949+0000 7f6999532640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:07:13.003 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.949+0000 7f6999532640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.52:3301/0 2023-11-05T08:07:13.003 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.949+0000 7f6999532640 1 -- 172.21.15.52:0/2280017784 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69840094d0 con 0x7f69940a8ec0 2023-11-05T08:07:13.003 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.951+0000 7f6999532640 1 --2- 172.21.15.52:0/2280017784 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f69940a8ec0 0x7f69941d6210 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6984009960 tx=0x7f6984004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:13.003 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.951+0000 7f698a7fc640 10 client.?.objecter ms_handle_connect 0x7f69940a8ec0 2023-11-05T08:07:13.003 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.951+0000 7f698a7fc640 10 client.?.objecter resend_mon_ops 2023-11-05T08:07:13.003 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.974+0000 7f698a7fc640 1 -- 172.21.15.52:0/2280017784 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6984039c90 con 0x7f69940a8ec0 2023-11-05T08:07:13.004 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.974+0000 7f698a7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:13.004 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.974+0000 7f698a7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-11-05T08:07:13.004 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.974+0000 7f698a7fc640 10 monclient: dump: 2023-11-05T08:07:13.004 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:13.004 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:13.005 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:13.005 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:13.005 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:13.005 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:13.005 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:13.006 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:13.006 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:13.006 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:13.006 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.974+0000 7f698a7fc640 10 monclient: _finish_auth 0 2023-11-05T08:07:13.006 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.974+0000 7f698a7fc640 10 monclient: _check_auth_tickets 2023-11-05T08:07:13.006 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.974+0000 7f698a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:07:13.007 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.974+0000 7f698a7fc640 1 -- 172.21.15.52:0/2280017784 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6984039e10 con 0x7f69940a8ec0 2023-11-05T08:07:13.007 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.974+0000 7f698a7fc640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:07:13.007 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.974+0000 7f698a7fc640 1 -- 172.21.15.52:0/2280017784 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6984043640 con 0x7f69940a8ec0 2023-11-05T08:07:13.007 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.974+0000 7f698a7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:13.007 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.974+0000 7f698a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-11-05T08:07:13.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.974+0000 7f698a7fc640 10 monclient: dump: 2023-11-05T08:07:13.008 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:13.008 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:13.008 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:13.008 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:13.009 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:13.009 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:13.009 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:13.009 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:13.009 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:13.009 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:13.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.974+0000 7f699bf97640 5 monclient: authenticate success, global_id 4277 2023-11-05T08:07:13.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.974+0000 7f699bf97640 10 monclient: _renew_subs 2023-11-05T08:07:13.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.974+0000 7f699bf97640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.52:3301/0 2023-11-05T08:07:13.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.974+0000 7f699bf97640 1 -- 172.21.15.52:0/2280017784 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6994141da0 con 0x7f69940a8ec0 2023-11-05T08:07:13.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.974+0000 7f698bfff640 4 set_mon_vals no callback set 2023-11-05T08:07:13.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.974+0000 7f699bf97640 10 client.4277.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-05T08:07:13.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.974+0000 7f699bf97640 10 monclient: _renew_subs 2023-11-05T08:07:13.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.974+0000 7f699bf97640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.52:3301/0 2023-11-05T08:07:13.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.974+0000 7f699bf97640 1 -- 172.21.15.52:0/2280017784 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69940b0a20 con 0x7f69940a8ec0 2023-11-05T08:07:13.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.974+0000 7f699bf97640 1 librados: init done 2023-11-05T08:07:13.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.975+0000 7f699bf97640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-05T08:07:13.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.975+0000 7f699bf97640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:07:13.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.975+0000 7f699bf97640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.52:3301/0 2023-11-05T08:07:13.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.975+0000 7f699bf97640 1 -- 172.21.15.52:0/2280017784 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6994141f30 con 0x7f69940a8ec0 2023-11-05T08:07:13.012 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-05T08:07:13.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.995+0000 7f698a7fc640 1 -- 172.21.15.52:0/2280017784 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f698402e070 con 0x7f69940a8ec0 2023-11-05T08:07:13.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.995+0000 7f698a7fc640 1 --2- 172.21.15.52:0/2280017784 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f697806c850 0x7f697806ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:13.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.995+0000 7f6999d33640 1 --2- 172.21.15.52:0/2280017784 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f697806c850 0x7f697806ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:13.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.995+0000 7f6999d33640 10 monclient: get_auth_request con 0x7f697806c850 auth_method 0 2023-11-05T08:07:13.015 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.996+0000 7f698a7fc640 10 client.4277.objecter ms_handle_connect 0x7f697806c850 2023-11-05T08:07:13.015 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:12.996+0000 7f6999d33640 1 --2- 172.21.15.52:0/2280017784 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f697806c850 0x7f697806ed10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6990006a30 tx=0x7f69900069c0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:13.095 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-05T08:07:13.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.120+0000 7f2239856640 10 monclient: get_monmap_and_config 2023-11-05T08:07:13.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.120+0000 7f2239856640 10 monclient: build_initial_monmap 2023-11-05T08:07:13.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.120+0000 7f2239856640 10 monclient: monmap: 2023-11-05T08:07:13.123 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:07:13.123 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:13.123 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:07:13.122455+0000 2023-11-05T08:07:13.123 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:07:13.122455+0000 2023-11-05T08:07:13.123 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:07:13.124 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:13.124 INFO:teuthology.orchestra.run.smithi052.stderr:0: v1:172.21.15.52:6789/0 mon.noname-a-legacy 2023-11-05T08:07:13.124 INFO:teuthology.orchestra.run.smithi052.stderr:1: v1:172.21.15.156:6789/0 mon.noname-c-legacy 2023-11-05T08:07:13.124 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-b 2023-11-05T08:07:13.125 INFO:teuthology.orchestra.run.smithi052.stderr:3: v2:172.21.15.52:3300/0 mon.noname-a 2023-11-05T08:07:13.125 INFO:teuthology.orchestra.run.smithi052.stderr:4: v2:172.21.15.156:3300/0 mon.noname-c 2023-11-05T08:07:13.125 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:13.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.121+0000 7f2239856640 1 Processor -- start 2023-11-05T08:07:13.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.121+0000 7f2239856640 1 -- start start 2023-11-05T08:07:13.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.121+0000 7f2239856640 10 monclient: init 2023-11-05T08:07:13.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.122+0000 7f2239856640 10 monclient: _reopen_session rank -1 2023-11-05T08:07:13.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.122+0000 7f2239856640 10 monclient: _add_conns ranks=[1,0,2,4,3] 2023-11-05T08:07:13.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.122+0000 7f2239856640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f22340b4240 addr v1:172.21.15.156:6789/0 2023-11-05T08:07:13.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.122+0000 7f2239856640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f22340b38d0 addr v1:172.21.15.52:6789/0 2023-11-05T08:07:13.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.122+0000 7f2239856640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f22340ade00 0x7f223413b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:13.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.122+0000 7f2239856640 10 monclient(hunting): picked mon.noname-b con 0x7f22340ade00 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:07:13.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.122+0000 7f2239856640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22340b0cc0 con 0x7f22340b38d0 2023-11-05T08:07:13.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.122+0000 7f2239856640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f223413f5f0 con 0x7f22340b4240 2023-11-05T08:07:13.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.122+0000 7f2239856640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:13.129 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.122+0000 7f2239856640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22340b4620 con 0x7f22340ade00 2023-11-05T08:07:13.129 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.122+0000 7f2239856640 10 monclient(hunting): _renew_subs 2023-11-05T08:07:13.129 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.122+0000 7f2239856640 10 monclient(hunting): authenticate will time out at 1379.328486s 2023-11-05T08:07:13.129 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.123+0000 7f222bfff640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f22340b38d0 0x7f22340ae640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:47112/0 (socket says 172.21.15.52:47112) 2023-11-05T08:07:13.129 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.123+0000 7f222bfff640 1 -- 172.21.15.52:0/601485230 learned_addr learned my addr 172.21.15.52:0/601485230 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-11-05T08:07:13.130 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.126+0000 7f22327fc640 1 -- 172.21.15.52:0/601485230 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3637986959 0 0) 0x7f22340b0cc0 con 0x7f22340b38d0 2023-11-05T08:07:13.130 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.126+0000 7f22327fc640 10 monclient(hunting): _negotiate 2023-11-05T08:07:13.130 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.126+0000 7f22327fc640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:13.131 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.126+0000 7f22327fc640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:13.131 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.126+0000 7f22327fc640 10 monclient(hunting): my global_id is 4344 2023-11-05T08:07:13.131 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.126+0000 7f22327fc640 1 -- 172.21.15.52:0/601485230 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2220003520 con 0x7f22340b38d0 2023-11-05T08:07:13.132 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.130+0000 7f22327fc640 1 -- 172.21.15.52:0/601485230 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2205760909 0 0) 0x7f2220003520 con 0x7f22340b38d0 2023-11-05T08:07:13.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.130+0000 7f22327fc640 1 -- 172.21.15.52:0/601485230 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f22340ade00 msgr2=0x7f223413b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-05T08:07:13.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.130+0000 7f22327fc640 1 --2- 172.21.15.52:0/601485230 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f22340ade00 0x7f223413b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:13.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.130+0000 7f22327fc640 1 -- 172.21.15.52:0/601485230 >> v1:172.21.15.156:6789/0 conn(0x7f22340b4240 legacy=0x7f22340b1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-05T08:07:13.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.130+0000 7f22327fc640 10 monclient: _finish_hunting 0 2023-11-05T08:07:13.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.130+0000 7f22327fc640 1 monclient: found mon.noname-a-legacy 2023-11-05T08:07:13.134 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.130+0000 7f22327fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:07:13.134 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.130+0000 7f22327fc640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:172.21.15.52:6789/0 2023-11-05T08:07:13.134 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.130+0000 7f22327fc640 1 -- 172.21.15.52:0/601485230 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f223413b960 con 0x7f22340b38d0 2023-11-05T08:07:13.134 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.130+0000 7f22327fc640 10 monclient: _finish_auth 0 2023-11-05T08:07:13.135 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.130+0000 7f22327fc640 10 monclient: _check_auth_tickets 2023-11-05T08:07:13.135 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.130+0000 7f22327fc640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:07:13.135 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.130+0000 7f22327fc640 1 -- 172.21.15.52:0/601485230 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2979872170 0 0) 0x7f221c001670 con 0x7f22340b38d0 2023-11-05T08:07:13.135 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.130+0000 7f22327fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:13.135 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.130+0000 7f22327fc640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2023-11-05T08:07:13.135 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.130+0000 7f22327fc640 10 monclient: dump: 2023-11-05T08:07:13.136 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:13.136 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:13.136 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:13.136 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:13.136 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:13.137 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:13.137 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:13.137 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:13.137 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:13.137 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:13.137 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.130+0000 7f22327fc640 1 monclient: mon.a has (v2) addrs [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] but i'm connected to v1:172.21.15.52:6789/0, reconnecting 2023-11-05T08:07:13.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.130+0000 7f22327fc640 10 monclient: _reopen_session rank -1 2023-11-05T08:07:13.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.130+0000 7f22327fc640 1 -- 172.21.15.52:0/601485230 >> v1:172.21.15.52:6789/0 conn(0x7f22340b38d0 legacy=0x7f22340ae640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:13.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.130+0000 7f22327fc640 10 monclient: _add_conns ranks=[1,2,0] 2023-11-05T08:07:13.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.130+0000 7f22327fc640 1 --2- 172.21.15.52:0/601485230 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f22200039a0 0x7f2220003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:13.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.130+0000 7f22327fc640 10 monclient(hunting): picked mon.b con 0x7f22200039a0 addr [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] 2023-11-05T08:07:13.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.130+0000 7f22327fc640 1 --2- 172.21.15.52:0/601485230 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f22340ade00 0x7f22200047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:13.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.130+0000 7f22327fc640 10 monclient(hunting): picked mon.c con 0x7f22340ade00 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:07:13.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.130+0000 7f22327fc640 1 --2- 172.21.15.52:0/601485230 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2220004e20 0x7f222000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:13.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.130+0000 7f22327fc640 10 monclient(hunting): picked mon.a con 0x7f2220004e20 addr [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] 2023-11-05T08:07:13.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.130+0000 7f22327fc640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:13.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.130+0000 7f22327fc640 1 -- 172.21.15.52:0/601485230 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22340b4620 con 0x7f2220004e20 2023-11-05T08:07:13.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.130+0000 7f22327fc640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:13.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.130+0000 7f22327fc640 1 -- 172.21.15.52:0/601485230 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22200055e0 con 0x7f22200039a0 2023-11-05T08:07:13.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.130+0000 7f22327fc640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:13.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.130+0000 7f22327fc640 1 -- 172.21.15.52:0/601485230 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f222000bec0 con 0x7f22340ade00 2023-11-05T08:07:13.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.130+0000 7f22327fc640 10 monclient(hunting): _renew_subs 2023-11-05T08:07:13.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.130+0000 7f22327fc640 10 monclient(hunting): _finish_auth 0 2023-11-05T08:07:13.141 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-05T08:07:13.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.132+0000 7f22337fe640 1 --2- 172.21.15.52:0/601485230 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2220004e20 0x7f222000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:13.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.134+0000 7f22337fe640 10 monclient(hunting): get_auth_request con 0x7f2220004e20 auth_method 0 2023-11-05T08:07:13.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.134+0000 7f22337fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:13.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.134+0000 7f22337fe640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:13.144 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.134+0000 7f22337fe640 10 monclient(hunting): _init_auth already have auth, reseting 2023-11-05T08:07:13.144 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.135+0000 7f22337fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:13.144 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.135+0000 7f22337fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:13.144 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.135+0000 7f22337fe640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2023-11-05T08:07:13.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.137+0000 7f22337fe640 10 monclient(hunting): handle_auth_done global_id 4344 payload 293 2023-11-05T08:07:13.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.137+0000 7f22337fe640 1 -- 172.21.15.52:0/601485230 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f22340ade00 msgr2=0x7f22200047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-05T08:07:13.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.137+0000 7f22337fe640 1 --2- 172.21.15.52:0/601485230 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f22340ade00 0x7f22200047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:13.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.137+0000 7f22337fe640 1 -- 172.21.15.52:0/601485230 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f22200039a0 msgr2=0x7f2220003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-05T08:07:13.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.137+0000 7f22337fe640 1 --2- 172.21.15.52:0/601485230 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f22200039a0 0x7f2220003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:13.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.137+0000 7f22337fe640 10 monclient: _finish_hunting 0 2023-11-05T08:07:13.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.137+0000 7f22337fe640 1 monclient: found mon.a 2023-11-05T08:07:13.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.137+0000 7f22337fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:07:13.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.137+0000 7f22337fe640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.52:3300/0 2023-11-05T08:07:13.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.137+0000 7f22337fe640 1 -- 172.21.15.52:0/601485230 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2220003520 con 0x7f2220004e20 2023-11-05T08:07:13.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.137+0000 7f22337fe640 10 monclient: _finish_auth 0 2023-11-05T08:07:13.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.137+0000 7f22337fe640 10 monclient: _check_auth_tickets 2023-11-05T08:07:13.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.137+0000 7f22337fe640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:07:13.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.137+0000 7f2239856640 5 monclient: authenticate success, global_id 4344 2023-11-05T08:07:13.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.137+0000 7f2239856640 20 monclient: get_monmap_and_config waiting for monmap|config 2023-11-05T08:07:13.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.139+0000 7f22337fe640 1 --2- 172.21.15.52:0/601485230 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2220004e20 0x7f222000b980 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f222c009e40 tx=0x7f22200057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2eafef9f86a66fb server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:13.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.143+0000 7f22327fc640 1 -- 172.21.15.52:0/601485230 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f222c02cd90 con 0x7f2220004e20 2023-11-05T08:07:13.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.143+0000 7f22327fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:13.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.143+0000 7f22327fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-11-05T08:07:13.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.143+0000 7f22327fc640 10 monclient: dump: 2023-11-05T08:07:13.151 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:13.151 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:13.151 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:13.151 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:13.152 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:13.152 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:13.152 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:13.152 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:13.152 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:13.153 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:13.153 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.143+0000 7f22327fc640 1 -- 172.21.15.52:0/601485230 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f222c034440 con 0x7f2220004e20 2023-11-05T08:07:13.153 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.143+0000 7f22327fc640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:07:13.153 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.143+0000 7f22327fc640 1 -- 172.21.15.52:0/601485230 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f222c034830 con 0x7f2220004e20 2023-11-05T08:07:13.153 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.143+0000 7f2239856640 10 monclient: get_monmap_and_config success 2023-11-05T08:07:13.154 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.144+0000 7f22327fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:13.154 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.144+0000 7f2239856640 4 set_mon_vals no callback set 2023-11-05T08:07:13.154 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.144+0000 7f22327fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-11-05T08:07:13.154 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.144+0000 7f22327fc640 10 monclient: dump: 2023-11-05T08:07:13.154 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:13.155 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:13.155 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:13.155 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:13.155 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:13.155 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:13.156 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:13.156 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:13.156 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:13.156 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:13.156 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.144+0000 7f2239856640 10 monclient: shutdown 2023-11-05T08:07:13.156 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.144+0000 7f2239856640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:07:13.157 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.144+0000 7f2239856640 1 -- 172.21.15.52:0/601485230 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2220004e20 msgr2=0x7f222000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:13.157 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.144+0000 7f2239856640 1 --2- 172.21.15.52:0/601485230 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2220004e20 0x7f222000b980 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f222c009e40 tx=0x7f22200057f0 comp rx=0 tx=0).stop 2023-11-05T08:07:13.157 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.144+0000 7f22337fe640 1 -- 172.21.15.52:0/601485230 reap_dead start 2023-11-05T08:07:13.157 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.144+0000 7f2239856640 1 -- 172.21.15.52:0/601485230 shutdown_connections 2023-11-05T08:07:13.157 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.144+0000 7f2239856640 1 -- 172.21.15.52:0/601485230 >> 172.21.15.52:0/601485230 conn(0x7f2234065cd0 msgr2=0x7f22340660e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:07:13.158 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.145+0000 7f2239856640 1 -- 172.21.15.52:0/601485230 shutdown_connections 2023-11-05T08:07:13.158 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.145+0000 7f2239856640 1 -- 172.21.15.52:0/601485230 wait complete. 2023-11-05T08:07:13.158 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.145+0000 7f2239856640 10 monclient: build_initial_monmap 2023-11-05T08:07:13.158 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.145+0000 7f2239856640 10 monclient: monmap: 2023-11-05T08:07:13.158 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:07:13.159 INFO:teuthology.orchestra.run.smithi052.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-05T08:07:13.159 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 0.000000 2023-11-05T08:07:13.159 INFO:teuthology.orchestra.run.smithi052.stderr:created 0.000000 2023-11-05T08:07:13.159 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:07:13.159 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:13.159 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.noname-a 2023-11-05T08:07:13.160 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.noname-b 2023-11-05T08:07:13.160 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-c 2023-11-05T08:07:13.160 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:13.160 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.146+0000 7f2239856640 1 librados: starting msgr at 2023-11-05T08:07:13.160 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.146+0000 7f2239856640 1 librados: starting objecter 2023-11-05T08:07:13.161 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.146+0000 7f2239856640 1 Processor -- start 2023-11-05T08:07:13.161 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.146+0000 7f2239856640 1 -- start start 2023-11-05T08:07:13.161 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.146+0000 7f2239856640 1 librados: setting wanted keys 2023-11-05T08:07:13.161 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.146+0000 7f2239856640 1 librados: calling monclient init 2023-11-05T08:07:13.161 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.146+0000 7f2239856640 10 monclient: init 2023-11-05T08:07:13.161 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.146+0000 7f2239856640 10 monclient: _reopen_session rank -1 2023-11-05T08:07:13.162 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.146+0000 7f2239856640 10 monclient: _add_conns ranks=[1,0,2] 2023-11-05T08:07:13.162 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.146+0000 7f2239856640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f22340a8d30 0x7f223413cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:13.162 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.146+0000 7f2239856640 10 monclient(hunting): picked mon.noname-b con 0x7f22340a8d30 addr [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] 2023-11-05T08:07:13.162 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.146+0000 7f2239856640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22340a9110 0x7f22340a9b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:13.162 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.146+0000 7f2239856640 10 monclient(hunting): picked mon.noname-a con 0x7f22340a9110 addr [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] 2023-11-05T08:07:13.163 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.146+0000 7f2239856640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f22341d7550 0x7f22340ac880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:13.163 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.146+0000 7f2239856640 10 monclient(hunting): picked mon.noname-c con 0x7f22341d7550 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:07:13.163 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.146+0000 7f2239856640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:13.163 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.146+0000 7f2239856640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22340aa040 con 0x7f22340a9110 2023-11-05T08:07:13.163 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.146+0000 7f2239856640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:13.164 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.146+0000 7f2239856640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22341d6de0 con 0x7f22340a8d30 2023-11-05T08:07:13.164 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.146+0000 7f2239856640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:13.164 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.146+0000 7f2239856640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22341d4a10 con 0x7f22341d7550 2023-11-05T08:07:13.164 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.146+0000 7f2239856640 10 monclient(hunting): _renew_subs 2023-11-05T08:07:13.164 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.146+0000 7f2239856640 10 monclient(hunting): authenticate will time out at 1379.352898s 2023-11-05T08:07:13.165 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.147+0000 7f222bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22340a9110 0x7f22340a9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:13.166 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-05T08:07:13.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.147+0000 7f222bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22340a9110 0x7f22340a9b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47062/0 (socket says 172.21.15.52:47062) 2023-11-05T08:07:13.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.147+0000 7f222bfff640 1 -- 172.21.15.52:0/2436792183 learned_addr learned my addr 172.21.15.52:0/2436792183 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-11-05T08:07:13.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.147+0000 7f222bfff640 10 monclient(hunting): get_auth_request con 0x7f22340a9110 auth_method 0 2023-11-05T08:07:13.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.147+0000 7f222bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:13.170 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.147+0000 7f222bfff640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:13.170 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.147+0000 7f222bfff640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:13.170 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.148+0000 7f222bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:13.170 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.148+0000 7f222bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:13.170 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.148+0000 7f222bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:13.171 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.151+0000 7f222bfff640 10 monclient(hunting): handle_auth_done global_id 4347 payload 824 2023-11-05T08:07:13.171 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.151+0000 7f222bfff640 1 -- 172.21.15.52:0/2436792183 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f22341d7550 msgr2=0x7f22340ac880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:13.171 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.151+0000 7f222bfff640 1 --2- 172.21.15.52:0/2436792183 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f22341d7550 0x7f22340ac880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:13.171 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.151+0000 7f222bfff640 1 -- 172.21.15.52:0/2436792183 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f22340a8d30 msgr2=0x7f223413cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:13.171 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.151+0000 7f222bfff640 1 --2- 172.21.15.52:0/2436792183 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f22340a8d30 0x7f223413cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:13.172 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.151+0000 7f222bfff640 10 monclient: _finish_hunting 0 2023-11-05T08:07:13.172 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.151+0000 7f222bfff640 1 monclient: found mon.noname-a 2023-11-05T08:07:13.172 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.151+0000 7f222bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:07:13.172 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.151+0000 7f222bfff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.52:3300/0 2023-11-05T08:07:13.172 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.151+0000 7f222bfff640 1 -- 172.21.15.52:0/2436792183 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22341d7030 con 0x7f22340a9110 2023-11-05T08:07:13.173 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.154+0000 7f222bfff640 1 --2- 172.21.15.52:0/2436792183 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22340a9110 0x7f22340a9b00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f221c00cb00 tx=0x7f221c001d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:13.173 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.154+0000 7f2230ff9640 10 client.?.objecter ms_handle_connect 0x7f22340a9110 2023-11-05T08:07:13.173 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.154+0000 7f2230ff9640 10 client.?.objecter resend_mon_ops 2023-11-05T08:07:13.173 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.158+0000 7f2230ff9640 1 -- 172.21.15.52:0/2436792183 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f221c004cb0 con 0x7f22340a9110 2023-11-05T08:07:13.173 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.158+0000 7f2230ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:13.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.158+0000 7f2230ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-11-05T08:07:13.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.158+0000 7f2230ff9640 10 monclient: dump: 2023-11-05T08:07:13.174 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:13.174 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:13.174 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:13.175 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:13.175 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:13.175 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:13.175 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:13.175 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:13.176 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:13.176 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:13.176 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.158+0000 7f2230ff9640 10 monclient: _finish_auth 0 2023-11-05T08:07:13.176 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.158+0000 7f2230ff9640 10 monclient: _check_auth_tickets 2023-11-05T08:07:13.176 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.158+0000 7f2230ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:07:13.176 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.158+0000 7f2230ff9640 1 -- 172.21.15.52:0/2436792183 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f221c004e10 con 0x7f22340a9110 2023-11-05T08:07:13.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.158+0000 7f2230ff9640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:07:13.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.158+0000 7f2230ff9640 1 -- 172.21.15.52:0/2436792183 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f221c007310 con 0x7f22340a9110 2023-11-05T08:07:13.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.158+0000 7f2230ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:13.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.158+0000 7f2230ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-11-05T08:07:13.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.158+0000 7f2230ff9640 10 monclient: dump: 2023-11-05T08:07:13.178 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:13.178 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:13.178 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:13.178 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:13.178 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:13.178 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:13.179 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:13.179 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:13.179 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:13.179 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:13.179 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.158+0000 7f2231ffb640 4 set_mon_vals no callback set 2023-11-05T08:07:13.180 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.158+0000 7f2239856640 5 monclient: authenticate success, global_id 4347 2023-11-05T08:07:13.180 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.158+0000 7f2239856640 10 monclient: _renew_subs 2023-11-05T08:07:13.180 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.158+0000 7f2239856640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.52:3300/0 2023-11-05T08:07:13.180 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.158+0000 7f2239856640 1 -- 172.21.15.52:0/2436792183 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22341d79d0 con 0x7f22340a9110 2023-11-05T08:07:13.180 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.159+0000 7f2239856640 10 client.4347.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-05T08:07:13.181 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.159+0000 7f2239856640 10 monclient: _renew_subs 2023-11-05T08:07:13.181 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.159+0000 7f2239856640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.52:3300/0 2023-11-05T08:07:13.181 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.159+0000 7f2239856640 1 -- 172.21.15.52:0/2436792183 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22340acfa0 con 0x7f22340a9110 2023-11-05T08:07:13.181 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.159+0000 7f2239856640 1 librados: init done 2023-11-05T08:07:13.181 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.160+0000 7f2239856640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-05T08:07:13.182 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.160+0000 7f2239856640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:07:13.182 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.160+0000 7f2239856640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.52:3300/0 2023-11-05T08:07:13.182 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.160+0000 7f2239856640 1 -- 172.21.15.52:0/2436792183 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f223404e9f0 con 0x7f22340a9110 2023-11-05T08:07:13.182 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.170+0000 7f1ce4ff9640 1 -- 172.21.15.52:0/1034509529 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1cdc053f30 con 0x7f1ce80a8ec0 2023-11-05T08:07:13.183 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.170+0000 7f1ce4ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:07:13.183 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.170+0000 7f1ce4ff9640 10 monclient: _finish_command 1 = system:0 2023-11-05T08:07:13.191 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.190+0000 7f2230ff9640 1 -- 172.21.15.52:0/2436792183 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f221c007470 con 0x7f22340a9110 2023-11-05T08:07:13.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.190+0000 7f2230ff9640 1 --2- 172.21.15.52:0/2436792183 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f221406c850 0x7f221406ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:13.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.191+0000 7f2232ffd640 1 --2- 172.21.15.52:0/2436792183 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f221406c850 0x7f221406ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:13.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.191+0000 7f2232ffd640 10 monclient: get_auth_request con 0x7f221406c850 auth_method 0 2023-11-05T08:07:13.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.191+0000 7f698a7fc640 1 -- 172.21.15.52:0/2280017784 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f698403e070 con 0x7f69940a8ec0 2023-11-05T08:07:13.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.191+0000 7f698a7fc640 10 client.4277.objecter ms_dispatch 0x7f6994000b90 osd_map(23..23 src has 1..23) v4 2023-11-05T08:07:13.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.191+0000 7f698a7fc640 3 client.4277.objecter handle_osd_map got epochs [23,23] > 0 2023-11-05T08:07:13.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.191+0000 7f698a7fc640 3 client.4277.objecter handle_osd_map decoding full epoch 23 2023-11-05T08:07:13.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.191+0000 7f698a7fc640 20 client.4277.objecter dump_active .. 0 homeless 2023-11-05T08:07:13.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.192+0000 7f2230ff9640 10 client.4347.objecter ms_handle_connect 0x7f221406c850 2023-11-05T08:07:13.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.192+0000 7f2232ffd640 1 --2- 172.21.15.52:0/2436792183 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f221406c850 0x7f221406ed10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f22240014e0 tx=0x7f2224007990 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:13.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.215+0000 7fbaafafc640 10 monclient: get_monmap_and_config 2023-11-05T08:07:13.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.215+0000 7fbaafafc640 10 monclient: build_initial_monmap 2023-11-05T08:07:13.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.215+0000 7fbaafafc640 10 monclient: monmap: 2023-11-05T08:07:13.217 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:07:13.218 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:13.218 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:07:13.217126+0000 2023-11-05T08:07:13.218 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:07:13.217126+0000 2023-11-05T08:07:13.218 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:07:13.218 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:13.219 INFO:teuthology.orchestra.run.smithi052.stderr:0: v1:172.21.15.52:6789/0 mon.noname-a-legacy 2023-11-05T08:07:13.219 INFO:teuthology.orchestra.run.smithi052.stderr:1: v1:172.21.15.156:6789/0 mon.noname-c-legacy 2023-11-05T08:07:13.219 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-b 2023-11-05T08:07:13.219 INFO:teuthology.orchestra.run.smithi052.stderr:3: v2:172.21.15.52:3300/0 mon.noname-a 2023-11-05T08:07:13.219 INFO:teuthology.orchestra.run.smithi052.stderr:4: v2:172.21.15.156:3300/0 mon.noname-c 2023-11-05T08:07:13.220 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:13.223 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.216+0000 7fbaafafc640 1 Processor -- start 2023-11-05T08:07:13.223 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.216+0000 7fbaafafc640 1 -- start start 2023-11-05T08:07:13.223 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.216+0000 7fbaafafc640 10 monclient: init 2023-11-05T08:07:13.224 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.217+0000 7fbaafafc640 10 monclient: _reopen_session rank -1 2023-11-05T08:07:13.224 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.217+0000 7fbaafafc640 10 monclient: _add_conns ranks=[3,0,4,2,1] 2023-11-05T08:07:13.224 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.217+0000 7fbaafafc640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fbaa80a8ae0 0x7fbaa813ec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:13.224 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.217+0000 7fbaafafc640 10 monclient(hunting): picked mon.noname-a con 0x7fbaa80a8ae0 addr v2:172.21.15.52:3300/0 2023-11-05T08:07:13.224 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.217+0000 7fbaafafc640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fbaa80a8ec0 addr v1:172.21.15.52:6789/0 2023-11-05T08:07:13.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.217+0000 7fbaafafc640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fbaa80b0de0 0x7fbaa813f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:13.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.217+0000 7fbaafafc640 10 monclient(hunting): picked mon.noname-c con 0x7fbaa80b0de0 addr v2:172.21.15.156:3300/0 2023-11-05T08:07:13.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.217+0000 7fbaafafc640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbaa80a9600 con 0x7fbaa80a8ec0 2023-11-05T08:07:13.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.217+0000 7fbaafafc640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:13.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.217+0000 7fbaafafc640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbaa80a9360 con 0x7fbaa80a8ae0 2023-11-05T08:07:13.226 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.217+0000 7fbaafafc640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:13.226 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.217+0000 7fbaafafc640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbaa80b80b0 con 0x7fbaa80b0de0 2023-11-05T08:07:13.226 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.217+0000 7fbaafafc640 10 monclient(hunting): _renew_subs 2023-11-05T08:07:13.226 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.217+0000 7fbaafafc640 10 monclient(hunting): authenticate will time out at 1379.423848s 2023-11-05T08:07:13.226 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.218+0000 7fbaae099640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fbaa80b0de0 0x7fbaa813f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:13.227 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.219+0000 7fbaae099640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fbaa80b0de0 0x7fbaa813f170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.52:59206/0 (socket says 172.21.15.52:59206) 2023-11-05T08:07:13.227 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.219+0000 7fbaae099640 1 -- 172.21.15.52:0/281376966 learned_addr learned my addr 172.21.15.52:0/281376966 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-11-05T08:07:13.227 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.219+0000 7fbaae099640 10 monclient(hunting): get_auth_request con 0x7fbaa80b0de0 auth_method 0 2023-11-05T08:07:13.227 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.219+0000 7fbaae099640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:13.227 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.219+0000 7fbaae099640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:13.227 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.219+0000 7fbaae099640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:13.228 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.219+0000 7fbaae099640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:13.228 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.219+0000 7fbaae099640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:13.228 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.219+0000 7fbaae099640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:13.228 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.221+0000 7fbaae099640 10 monclient(hunting): handle_auth_done global_id 4363 payload 274 2023-11-05T08:07:13.228 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.221+0000 7fbaae099640 1 -- 172.21.15.52:0/281376966 >> v2:172.21.15.52:3300/0 conn(0x7fbaa80a8ae0 msgr2=0x7fbaa813ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-05T08:07:13.229 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.221+0000 7fbaae099640 1 --2- 172.21.15.52:0/281376966 >> v2:172.21.15.52:3300/0 conn(0x7fbaa80a8ae0 0x7fbaa813ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:13.229 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.221+0000 7fbaae099640 1 -- 172.21.15.52:0/281376966 >> v1:172.21.15.52:6789/0 conn(0x7fbaa80a8ec0 legacy=0x7fbaa8145000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-05T08:07:13.229 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.221+0000 7fbaae099640 10 monclient: _finish_hunting 0 2023-11-05T08:07:13.229 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.221+0000 7fbaae099640 1 monclient: found mon.noname-c 2023-11-05T08:07:13.229 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.221+0000 7fbaae099640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:07:13.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.221+0000 7fbaae099640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.156:3300/0 2023-11-05T08:07:13.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.221+0000 7fbaae099640 1 -- 172.21.15.52:0/281376966 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaa8145710 con 0x7fbaa80b0de0 2023-11-05T08:07:13.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.223+0000 7fbaae099640 1 --2- 172.21.15.52:0/281376966 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbaa80b0de0 0x7fbaa813f170 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fbaa80b1810 tx=0x7fbaa002bee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3acb0ed9e74c989f server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:13.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.226+0000 7fbaac896640 1 -- 172.21.15.52:0/281376966 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaa002ca80 con 0x7fbaa80b0de0 2023-11-05T08:07:13.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.226+0000 7fbaac896640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:13.234 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.226+0000 7fbaac896640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-11-05T08:07:13.234 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.226+0000 7fbaac896640 10 monclient: dump: 2023-11-05T08:07:13.234 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:13.234 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:13.234 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:13.235 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:13.235 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:13.235 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:13.235 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:13.235 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:13.236 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:13.236 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:13.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.226+0000 7fbaac896640 10 monclient: _finish_auth 0 2023-11-05T08:07:13.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.226+0000 7fbaac896640 10 monclient: _check_auth_tickets 2023-11-05T08:07:13.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.226+0000 7fbaac896640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:07:13.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.226+0000 7fbaafafc640 5 monclient: authenticate success, global_id 4363 2023-11-05T08:07:13.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.226+0000 7fbaafafc640 20 monclient: get_monmap_and_config waiting for monmap|config 2023-11-05T08:07:13.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.226+0000 7fbaac896640 1 -- 172.21.15.52:0/281376966 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaa002cbe0 con 0x7fbaa80b0de0 2023-11-05T08:07:13.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.226+0000 7fbaac896640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:07:13.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.226+0000 7fbaafafc640 10 monclient: get_monmap_and_config success 2023-11-05T08:07:13.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.226+0000 7fbaafafc640 4 set_mon_vals no callback set 2023-11-05T08:07:13.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.227+0000 7fbaafafc640 10 monclient: shutdown 2023-11-05T08:07:13.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.227+0000 7fbaafafc640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:07:13.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.227+0000 7fbaafafc640 1 -- 172.21.15.52:0/281376966 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbaa80b0de0 msgr2=0x7fbaa813f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:13.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.227+0000 7fbaafafc640 1 --2- 172.21.15.52:0/281376966 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbaa80b0de0 0x7fbaa813f170 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fbaa80b1810 tx=0x7fbaa002bee0 comp rx=0 tx=0).stop 2023-11-05T08:07:13.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.227+0000 7fbaafafc640 1 -- 172.21.15.52:0/281376966 shutdown_connections 2023-11-05T08:07:13.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.227+0000 7fbaafafc640 1 --2- 172.21.15.52:0/281376966 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbaa80b0de0 0x7fbaa813f170 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:13.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.227+0000 7fbaafafc640 1 --2- 172.21.15.52:0/281376966 >> v2:172.21.15.52:3300/0 conn(0x7fbaa80a8ae0 0x7fbaa813ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:13.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.227+0000 7fbaafafc640 1 -- 172.21.15.52:0/281376966 >> 172.21.15.52:0/281376966 conn(0x7fbaa80b7230 msgr2=0x7fbaa80b7610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:07:13.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.227+0000 7fbaafafc640 1 -- 172.21.15.52:0/281376966 shutdown_connections 2023-11-05T08:07:13.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.227+0000 7fbaafafc640 1 -- 172.21.15.52:0/281376966 wait complete. 2023-11-05T08:07:13.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.228+0000 7fbaafafc640 10 monclient: build_initial_monmap 2023-11-05T08:07:13.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.228+0000 7fbaafafc640 10 monclient: monmap: 2023-11-05T08:07:13.240 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:07:13.240 INFO:teuthology.orchestra.run.smithi052.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-05T08:07:13.241 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 0.000000 2023-11-05T08:07:13.241 INFO:teuthology.orchestra.run.smithi052.stderr:created 0.000000 2023-11-05T08:07:13.241 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:07:13.241 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:13.241 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.noname-a 2023-11-05T08:07:13.242 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.noname-b 2023-11-05T08:07:13.242 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-c 2023-11-05T08:07:13.242 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:13.242 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.229+0000 7fbaafafc640 1 librados: starting msgr at 2023-11-05T08:07:13.242 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.229+0000 7fbaafafc640 1 librados: starting objecter 2023-11-05T08:07:13.243 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.229+0000 7fbaafafc640 1 Processor -- start 2023-11-05T08:07:13.243 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.229+0000 7fbaafafc640 1 -- start start 2023-11-05T08:07:13.243 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.229+0000 7fbaafafc640 1 librados: setting wanted keys 2023-11-05T08:07:13.243 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.229+0000 7fbaafafc640 1 librados: calling monclient init 2023-11-05T08:07:13.243 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.229+0000 7fbaafafc640 10 monclient: init 2023-11-05T08:07:13.244 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.230+0000 7fbaafafc640 10 monclient: _reopen_session rank -1 2023-11-05T08:07:13.244 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.230+0000 7fbaafafc640 10 monclient: _add_conns ranks=[2,1,0] 2023-11-05T08:07:13.244 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.230+0000 7fbaafafc640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbaa80a8ae0 0x7fbaa813e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:13.244 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.230+0000 7fbaafafc640 10 monclient(hunting): picked mon.noname-c con 0x7fbaa80a8ae0 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:07:13.244 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.230+0000 7fbaafafc640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbaa80a8ec0 0x7fbaa812d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:13.244 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.230+0000 7fbaafafc640 10 monclient(hunting): picked mon.noname-b con 0x7fbaa80a8ec0 addr [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] 2023-11-05T08:07:13.245 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.230+0000 7fbaafafc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbaa80b0de0 0x7fbaa80b67d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:13.245 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.230+0000 7fbaafafc640 10 monclient(hunting): picked mon.noname-a con 0x7fbaa80b0de0 addr [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] 2023-11-05T08:07:13.245 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.230+0000 7fbaafafc640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:13.245 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.230+0000 7fbaafafc640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa812dbb0 con 0x7fbaa80b0de0 2023-11-05T08:07:13.245 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.230+0000 7fbaafafc640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:13.246 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.230+0000 7fbaafafc640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa813d830 con 0x7fbaa80a8ec0 2023-11-05T08:07:13.246 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.230+0000 7fbaafafc640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:13.246 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.230+0000 7fbaafafc640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa8144c40 con 0x7fbaa80a8ae0 2023-11-05T08:07:13.246 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.230+0000 7fbaafafc640 10 monclient(hunting): _renew_subs 2023-11-05T08:07:13.246 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.230+0000 7fbaafafc640 10 monclient(hunting): authenticate will time out at 1379.436770s 2023-11-05T08:07:13.247 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.231+0000 7fbaad097640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbaa80a8ec0 0x7fbaa812d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:13.247 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.231+0000 7fbaad097640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbaa80a8ec0 0x7fbaa812d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.52:59218/0 (socket says 172.21.15.52:59218) 2023-11-05T08:07:13.247 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.231+0000 7fbaad097640 1 -- 172.21.15.52:0/589837096 learned_addr learned my addr 172.21.15.52:0/589837096 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-11-05T08:07:13.247 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.231+0000 7fbaad097640 10 monclient(hunting): get_auth_request con 0x7fbaa80a8ec0 auth_method 0 2023-11-05T08:07:13.247 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.231+0000 7fbaad097640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:13.247 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.231+0000 7fbaad097640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:13.248 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.231+0000 7fbaad097640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:13.248 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.231+0000 7fbaad097640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:13.248 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.231+0000 7fbaad097640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:13.248 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.231+0000 7fbaad097640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:13.250 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.234+0000 7fbaad097640 10 monclient(hunting): handle_auth_done global_id 4366 payload 824 2023-11-05T08:07:13.251 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.234+0000 7fbaad097640 1 -- 172.21.15.52:0/589837096 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbaa80a8ae0 msgr2=0x7fbaa813e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:13.251 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.234+0000 7fbaad097640 1 --2- 172.21.15.52:0/589837096 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbaa80a8ae0 0x7fbaa813e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:13.251 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.234+0000 7fbaad097640 1 -- 172.21.15.52:0/589837096 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbaa80b0de0 msgr2=0x7fbaa80b67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:13.251 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.234+0000 7fbaad097640 1 --2- 172.21.15.52:0/589837096 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbaa80b0de0 0x7fbaa80b67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:13.251 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.234+0000 7fbaad097640 10 monclient: _finish_hunting 0 2023-11-05T08:07:13.252 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.234+0000 7fbaad097640 1 monclient: found mon.noname-b 2023-11-05T08:07:13.252 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.234+0000 7fbaad097640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:07:13.252 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.234+0000 7fbaad097640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.156:3300/0 2023-11-05T08:07:13.252 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.234+0000 7fbaad097640 1 -- 172.21.15.52:0/589837096 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaa0009b30 con 0x7fbaa80a8ec0 2023-11-05T08:07:13.252 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.236+0000 7fbaad097640 1 --2- 172.21.15.52:0/589837096 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbaa80a8ec0 0x7fbaa812d670 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fba9800b3f0 tx=0x7fba9800b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:13.253 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.236+0000 7fba9e7fc640 10 client.?.objecter ms_handle_connect 0x7fbaa80a8ec0 2023-11-05T08:07:13.253 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.236+0000 7fba9e7fc640 10 client.?.objecter resend_mon_ops 2023-11-05T08:07:13.253 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.240+0000 7fba9e7fc640 1 -- 172.21.15.52:0/589837096 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba98011830 con 0x7fbaa80a8ec0 2023-11-05T08:07:13.253 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.240+0000 7fba9e7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:13.253 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.240+0000 7fba9e7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-05T08:07:13.254 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.240+0000 7fba9e7fc640 10 monclient: dump: 2023-11-05T08:07:13.254 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:13.254 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:13.254 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:13.254 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:13.255 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:13.255 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:13.255 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:13.255 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:13.255 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:13.255 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:13.256 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.240+0000 7fba9e7fc640 10 monclient: _finish_auth 0 2023-11-05T08:07:13.256 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.240+0000 7fba9e7fc640 10 monclient: _check_auth_tickets 2023-11-05T08:07:13.256 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.240+0000 7fba9e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:07:13.256 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.240+0000 7fba9e7fc640 1 -- 172.21.15.52:0/589837096 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba98011990 con 0x7fbaa80a8ec0 2023-11-05T08:07:13.256 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.240+0000 7fbaafafc640 5 monclient: authenticate success, global_id 4366 2023-11-05T08:07:13.257 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.240+0000 7fbaafafc640 10 monclient: _renew_subs 2023-11-05T08:07:13.257 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.240+0000 7fbaafafc640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:07:13.257 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.240+0000 7fbaafafc640 1 -- 172.21.15.52:0/589837096 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbaa813c9c0 con 0x7fbaa80a8ec0 2023-11-05T08:07:13.257 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.240+0000 7fba9e7fc640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:07:13.257 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.240+0000 7fba9e7fc640 1 -- 172.21.15.52:0/589837096 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba98011d20 con 0x7fbaa80a8ec0 2023-11-05T08:07:13.258 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.240+0000 7fba9e7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:13.258 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.240+0000 7fba9e7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-05T08:07:13.258 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.240+0000 7fba9e7fc640 10 monclient: dump: 2023-11-05T08:07:13.258 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:13.258 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:13.259 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:13.259 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:13.259 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:13.259 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:13.259 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:13.259 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:13.260 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:13.260 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:13.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.240+0000 7fba9ffff640 4 set_mon_vals no callback set 2023-11-05T08:07:13.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.240+0000 7fbaafafc640 10 client.4366.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-05T08:07:13.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.240+0000 7fbaafafc640 10 monclient: _renew_subs 2023-11-05T08:07:13.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.240+0000 7fbaafafc640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:07:13.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.240+0000 7fbaafafc640 1 -- 172.21.15.52:0/589837096 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbaa80b6ef0 con 0x7fbaa80a8ec0 2023-11-05T08:07:13.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.240+0000 7fbaafafc640 1 librados: init done 2023-11-05T08:07:13.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.241+0000 7fbaafafc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-05T08:07:13.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.241+0000 7fbaafafc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:07:13.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.241+0000 7fbaafafc640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:07:13.262 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.241+0000 7fbaafafc640 1 -- 172.21.15.52:0/589837096 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbaa813d600 con 0x7fbaa80a8ec0 2023-11-05T08:07:13.263 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.262+0000 7fba9e7fc640 1 -- 172.21.15.52:0/589837096 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fba9801a400 con 0x7fbaa80a8ec0 2023-11-05T08:07:13.264 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.263+0000 7fba9e7fc640 1 --2- 172.21.15.52:0/589837096 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7fba8c06c850 0x7fba8c06ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:13.264 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.263+0000 7fbaad898640 1 --2- 172.21.15.52:0/589837096 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7fba8c06c850 0x7fba8c06ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:13.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.263+0000 7fbaad898640 10 monclient: get_auth_request con 0x7fba8c06c850 auth_method 0 2023-11-05T08:07:13.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.263+0000 7fbaad898640 1 --2- 172.21.15.52:0/589837096 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7fba8c06c850 0x7fba8c06ed10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fbaa4009670 tx=0x7fbaa4006be0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:13.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.263+0000 7fba9e7fc640 10 client.4366.objecter ms_handle_connect 0x7fba8c06c850 2023-11-05T08:07:13.290 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.288+0000 7f0fc8b1d640 10 monclient: get_monmap_and_config 2023-11-05T08:07:13.290 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.288+0000 7f0fc8b1d640 10 monclient: build_initial_monmap 2023-11-05T08:07:13.290 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.288+0000 7f0fc8b1d640 10 monclient: monmap: 2023-11-05T08:07:13.290 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:07:13.291 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:13.291 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:07:13.290217+0000 2023-11-05T08:07:13.291 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:07:13.290217+0000 2023-11-05T08:07:13.291 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:07:13.291 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:13.292 INFO:teuthology.orchestra.run.smithi052.stderr:0: v1:172.21.15.52:6789/0 mon.noname-a-legacy 2023-11-05T08:07:13.292 INFO:teuthology.orchestra.run.smithi052.stderr:1: v1:172.21.15.156:6789/0 mon.noname-c-legacy 2023-11-05T08:07:13.292 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-b 2023-11-05T08:07:13.292 INFO:teuthology.orchestra.run.smithi052.stderr:3: v2:172.21.15.52:3300/0 mon.noname-a 2023-11-05T08:07:13.292 INFO:teuthology.orchestra.run.smithi052.stderr:4: v2:172.21.15.156:3300/0 mon.noname-c 2023-11-05T08:07:13.292 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:13.294 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.289+0000 7f0fc8b1d640 1 Processor -- start 2023-11-05T08:07:13.294 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.289+0000 7f0fc8b1d640 1 -- start start 2023-11-05T08:07:13.294 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.289+0000 7f0fc8b1d640 10 monclient: init 2023-11-05T08:07:13.294 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.290+0000 7f0fc8b1d640 10 monclient: _reopen_session rank -1 2023-11-05T08:07:13.295 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.290+0000 7f0fc8b1d640 10 monclient: _add_conns ranks=[4,0,3,2,1] 2023-11-05T08:07:13.295 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.290+0000 7f0fc8b1d640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f0fc40a8ae0 0x7f0fc413ec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:13.295 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.290+0000 7f0fc8b1d640 10 monclient(hunting): picked mon.noname-c con 0x7f0fc40a8ae0 addr v2:172.21.15.156:3300/0 2023-11-05T08:07:13.295 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.290+0000 7f0fc8b1d640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f0fc40a8ec0 addr v1:172.21.15.52:6789/0 2023-11-05T08:07:13.295 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.290+0000 7f0fc8b1d640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0fc40b0de0 0x7f0fc413f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:13.296 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.290+0000 7f0fc8b1d640 10 monclient(hunting): picked mon.noname-a con 0x7f0fc40b0de0 addr v2:172.21.15.52:3300/0 2023-11-05T08:07:13.296 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.290+0000 7f0fc8b1d640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fc40a9600 con 0x7f0fc40a8ec0 2023-11-05T08:07:13.296 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.290+0000 7f0fc8b1d640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:13.296 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.290+0000 7f0fc8b1d640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fc40a9360 con 0x7f0fc40b0de0 2023-11-05T08:07:13.296 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.290+0000 7f0fc8b1d640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:13.297 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.290+0000 7f0fc8b1d640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fc40b80b0 con 0x7f0fc40a8ae0 2023-11-05T08:07:13.297 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.290+0000 7f0fc8b1d640 10 monclient(hunting): _renew_subs 2023-11-05T08:07:13.297 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.290+0000 7f0fc8b1d640 10 monclient(hunting): authenticate will time out at 1379.496596s 2023-11-05T08:07:13.298 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.297+0000 7f698a7fc640 1 -- 172.21.15.52:0/2280017784 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6984077ee0 con 0x7f69940a8ec0 2023-11-05T08:07:13.298 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.297+0000 7f698a7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:07:13.298 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.297+0000 7f698a7fc640 10 monclient: _finish_command 1 = system:0 2023-11-05T08:07:13.311 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.307+0000 7f2e1984b640 10 monclient: get_monmap_and_config 2023-11-05T08:07:13.312 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.307+0000 7f2e1984b640 10 monclient: build_initial_monmap 2023-11-05T08:07:13.312 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.307+0000 7f2e1984b640 10 monclient: monmap: 2023-11-05T08:07:13.312 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:07:13.312 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:13.313 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:07:13.308892+0000 2023-11-05T08:07:13.313 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:07:13.308892+0000 2023-11-05T08:07:13.313 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:07:13.313 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:13.314 INFO:teuthology.orchestra.run.smithi052.stderr:0: v1:172.21.15.52:6789/0 mon.noname-a-legacy 2023-11-05T08:07:13.314 INFO:teuthology.orchestra.run.smithi052.stderr:1: v1:172.21.15.156:6789/0 mon.noname-c-legacy 2023-11-05T08:07:13.314 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-b 2023-11-05T08:07:13.314 INFO:teuthology.orchestra.run.smithi052.stderr:3: v2:172.21.15.52:3300/0 mon.noname-a 2023-11-05T08:07:13.314 INFO:teuthology.orchestra.run.smithi052.stderr:4: v2:172.21.15.156:3300/0 mon.noname-c 2023-11-05T08:07:13.315 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:13.315 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.308+0000 7f2e1984b640 1 Processor -- start 2023-11-05T08:07:13.315 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.308+0000 7f2e1984b640 1 -- start start 2023-11-05T08:07:13.315 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.308+0000 7f2e1984b640 10 monclient: init 2023-11-05T08:07:13.316 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.308+0000 7f2e1984b640 10 monclient: _reopen_session rank -1 2023-11-05T08:07:13.316 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.308+0000 7f2e1984b640 10 monclient: _add_conns ranks=[3,4,1,0,2] 2023-11-05T08:07:13.316 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.308+0000 7f2e1984b640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2e140b4240 0x7f2e140b1150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:13.316 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.308+0000 7f2e1984b640 10 monclient(hunting): picked mon.noname-a con 0x7f2e140b4240 addr v2:172.21.15.52:3300/0 2023-11-05T08:07:13.316 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.308+0000 7f2e1984b640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f2e140b38d0 0x7f2e140ae640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:13.316 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.308+0000 7f2e1984b640 10 monclient(hunting): picked mon.noname-c con 0x7f2e140b38d0 addr v2:172.21.15.156:3300/0 2023-11-05T08:07:13.317 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.308+0000 7f2e1984b640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f2e140ade00 addr v1:172.21.15.156:6789/0 2023-11-05T08:07:13.317 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.308+0000 7f2e1984b640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e140b0cc0 con 0x7f2e140ade00 2023-11-05T08:07:13.317 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.308+0000 7f2e1984b640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:13.317 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.308+0000 7f2e1984b640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e140b4620 con 0x7f2e140b4240 2023-11-05T08:07:13.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.309+0000 7f2e1984b640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:13.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.309+0000 7f2e1984b640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e140b1690 con 0x7f2e140b38d0 2023-11-05T08:07:13.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.309+0000 7f2e1984b640 10 monclient(hunting): _renew_subs 2023-11-05T08:07:13.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.309+0000 7f2e1984b640 10 monclient(hunting): authenticate will time out at 1379.514929s 2023-11-05T08:07:13.347 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-05T08:07:13.388 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.386+0000 7f1cee38a640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 4}] 2023-11-05T08:07:13.388 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.386+0000 7f1cee38a640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2023-11-05T08:07:13.388 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.386+0000 7f1cee38a640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:07:13.388 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.386+0000 7f1cee38a640 1 -- 172.21.15.52:0/1034509529 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f1ce80b6ea0 con 0x7f1ce80a8ec0 2023-11-05T08:07:13.456 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.454+0000 7ff3bbbd0640 10 monclient: get_monmap_and_config 2023-11-05T08:07:13.456 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.454+0000 7ff3bbbd0640 10 monclient: build_initial_monmap 2023-11-05T08:07:13.456 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.454+0000 7ff3bbbd0640 10 monclient: monmap: 2023-11-05T08:07:13.457 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:07:13.457 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:13.457 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:07:13.456394+0000 2023-11-05T08:07:13.457 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:07:13.456394+0000 2023-11-05T08:07:13.458 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:07:13.458 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:13.458 INFO:teuthology.orchestra.run.smithi052.stderr:0: v1:172.21.15.52:6789/0 mon.noname-a-legacy 2023-11-05T08:07:13.458 INFO:teuthology.orchestra.run.smithi052.stderr:1: v1:172.21.15.156:6789/0 mon.noname-c-legacy 2023-11-05T08:07:13.458 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-b 2023-11-05T08:07:13.459 INFO:teuthology.orchestra.run.smithi052.stderr:3: v2:172.21.15.52:3300/0 mon.noname-a 2023-11-05T08:07:13.459 INFO:teuthology.orchestra.run.smithi052.stderr:4: v2:172.21.15.156:3300/0 mon.noname-c 2023-11-05T08:07:13.459 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:13.461 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.455+0000 7ff3bbbd0640 1 Processor -- start 2023-11-05T08:07:13.461 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.455+0000 7ff3bbbd0640 1 -- start start 2023-11-05T08:07:13.461 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.455+0000 7ff3bbbd0640 10 monclient: init 2023-11-05T08:07:13.462 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.456+0000 7ff3bbbd0640 10 monclient: _reopen_session rank -1 2023-11-05T08:07:13.462 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.456+0000 7ff3bbbd0640 10 monclient: _add_conns ranks=[3,4,2,0,1] 2023-11-05T08:07:13.462 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.456+0000 7ff3bbbd0640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff3b40a8ae0 0x7ff3b413ec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:13.462 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.456+0000 7ff3bbbd0640 10 monclient(hunting): picked mon.noname-a con 0x7ff3b40a8ae0 addr v2:172.21.15.52:3300/0 2023-11-05T08:07:13.462 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.456+0000 7ff3bbbd0640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff3b40a8ec0 0x7ff3b413f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:13.463 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.456+0000 7ff3bbbd0640 10 monclient(hunting): picked mon.noname-c con 0x7ff3b40a8ec0 addr v2:172.21.15.156:3300/0 2023-11-05T08:07:13.463 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.456+0000 7ff3bbbd0640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff3b40b0de0 0x7ff3b4145000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:13.463 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.456+0000 7ff3bbbd0640 10 monclient(hunting): picked mon.noname-b con 0x7ff3b40b0de0 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:07:13.463 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.456+0000 7ff3bbbd0640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:13.463 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.456+0000 7ff3bbbd0640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3b40a9360 con 0x7ff3b40a8ae0 2023-11-05T08:07:13.463 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.456+0000 7ff3bbbd0640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:13.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.456+0000 7ff3bbbd0640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3b40a9600 con 0x7ff3b40a8ec0 2023-11-05T08:07:13.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.456+0000 7ff3bbbd0640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:13.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.456+0000 7ff3bbbd0640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b40b80b0 con 0x7ff3b40b0de0 2023-11-05T08:07:13.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.456+0000 7ff3bbbd0640 10 monclient(hunting): _renew_subs 2023-11-05T08:07:13.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.456+0000 7ff3bbbd0640 10 monclient(hunting): authenticate will time out at 1379.662316s 2023-11-05T08:07:13.465 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.457+0000 7ff3ba16d640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff3b40b0de0 0x7ff3b4145000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:13.465 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.457+0000 7ff3ba16d640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff3b40b0de0 0x7ff3b4145000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.52:40450/0 (socket says 172.21.15.52:40450) 2023-11-05T08:07:13.465 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.457+0000 7ff3ba16d640 1 -- 172.21.15.52:0/495687909 learned_addr learned my addr 172.21.15.52:0/495687909 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-11-05T08:07:13.465 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.457+0000 7ff3ba16d640 10 monclient(hunting): get_auth_request con 0x7ff3b40b0de0 auth_method 0 2023-11-05T08:07:13.465 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.457+0000 7ff3ba16d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:13.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.457+0000 7ff3ba16d640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:13.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.457+0000 7ff3ba16d640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:13.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.458+0000 7ff3ba16d640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:13.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.458+0000 7ff3ba16d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:13.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.458+0000 7ff3ba16d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:13.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.459+0000 7ff3ba16d640 10 monclient(hunting): handle_auth_done global_id 4280 payload 274 2023-11-05T08:07:13.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.459+0000 7ff3ba16d640 1 -- 172.21.15.52:0/495687909 >> v2:172.21.15.156:3300/0 conn(0x7ff3b40a8ec0 msgr2=0x7ff3b413f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-05T08:07:13.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.459+0000 7ff3ba16d640 1 --2- 172.21.15.52:0/495687909 >> v2:172.21.15.156:3300/0 conn(0x7ff3b40a8ec0 0x7ff3b413f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:13.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.459+0000 7ff3ba16d640 1 -- 172.21.15.52:0/495687909 >> v2:172.21.15.52:3300/0 conn(0x7ff3b40a8ae0 msgr2=0x7ff3b413ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-05T08:07:13.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.459+0000 7ff3ba16d640 1 --2- 172.21.15.52:0/495687909 >> v2:172.21.15.52:3300/0 conn(0x7ff3b40a8ae0 0x7ff3b413ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:13.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.459+0000 7ff3ba16d640 10 monclient: _finish_hunting 0 2023-11-05T08:07:13.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.459+0000 7ff3ba16d640 1 monclient: found mon.noname-b 2023-11-05T08:07:13.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.459+0000 7ff3ba16d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:07:13.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.459+0000 7ff3ba16d640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.52:3301/0 2023-11-05T08:07:13.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.459+0000 7ff3ba16d640 1 -- 172.21.15.52:0/495687909 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3b4145540 con 0x7ff3b40b0de0 2023-11-05T08:07:13.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.461+0000 7ff3ba16d640 1 --2- 172.21.15.52:0/495687909 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff3b40b0de0 0x7ff3b4145000 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff3b41418b0 tx=0x7ff3b002bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c0b16e0c7eb250d server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:13.472 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.465+0000 7ff3b896a640 1 -- 172.21.15.52:0/495687909 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b002cb00 con 0x7ff3b40b0de0 2023-11-05T08:07:13.472 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.465+0000 7ff3b896a640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:13.472 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.465+0000 7ff3b896a640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-05T08:07:13.472 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.465+0000 7ff3b896a640 10 monclient: dump: 2023-11-05T08:07:13.472 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:13.473 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:13.473 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:13.473 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:13.473 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:13.474 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:13.474 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:13.474 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:13.474 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:13.474 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:13.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.465+0000 7ff3b896a640 10 monclient: _finish_auth 0 2023-11-05T08:07:13.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.465+0000 7ff3b896a640 10 monclient: _check_auth_tickets 2023-11-05T08:07:13.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.465+0000 7ff3b896a640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:07:13.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.465+0000 7ff3b896a640 1 -- 172.21.15.52:0/495687909 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3b002cc60 con 0x7ff3b40b0de0 2023-11-05T08:07:13.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.465+0000 7ff3bbbd0640 5 monclient: authenticate success, global_id 4280 2023-11-05T08:07:13.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.465+0000 7ff3b896a640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:07:13.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.465+0000 7ff3bbbd0640 10 monclient: get_monmap_and_config success 2023-11-05T08:07:13.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.465+0000 7ff3bbbd0640 4 set_mon_vals no callback set 2023-11-05T08:07:13.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.465+0000 7ff3b896a640 1 -- 172.21.15.52:0/495687909 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b00343f0 con 0x7ff3b40b0de0 2023-11-05T08:07:13.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.465+0000 7ff3b896a640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:13.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.465+0000 7ff3b896a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-11-05T08:07:13.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.465+0000 7ff3b896a640 10 monclient: dump: 2023-11-05T08:07:13.477 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:13.477 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:13.477 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:13.478 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:13.478 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:13.478 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:13.478 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:13.478 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:13.479 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:13.479 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:13.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.466+0000 7ff3bbbd0640 10 monclient: shutdown 2023-11-05T08:07:13.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.466+0000 7ff3bbbd0640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:07:13.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.466+0000 7ff3bbbd0640 1 -- 172.21.15.52:0/495687909 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff3b40b0de0 msgr2=0x7ff3b4145000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:13.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.466+0000 7ff3bbbd0640 1 --2- 172.21.15.52:0/495687909 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff3b40b0de0 0x7ff3b4145000 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff3b41418b0 tx=0x7ff3b002bf60 comp rx=0 tx=0).stop 2023-11-05T08:07:13.480 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.466+0000 7ff3bbbd0640 1 -- 172.21.15.52:0/495687909 shutdown_connections 2023-11-05T08:07:13.480 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.466+0000 7ff3bbbd0640 1 --2- 172.21.15.52:0/495687909 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff3b40b0de0 0x7ff3b4145000 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:13.480 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.466+0000 7ff3bbbd0640 1 --2- 172.21.15.52:0/495687909 >> v2:172.21.15.156:3300/0 conn(0x7ff3b40a8ec0 0x7ff3b413f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:13.480 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.466+0000 7ff3bbbd0640 1 --2- 172.21.15.52:0/495687909 >> v2:172.21.15.52:3300/0 conn(0x7ff3b40a8ae0 0x7ff3b413ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:13.480 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.466+0000 7ff3bbbd0640 1 -- 172.21.15.52:0/495687909 >> 172.21.15.52:0/495687909 conn(0x7ff3b40b7230 msgr2=0x7ff3b40b7610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:07:13.481 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.466+0000 7ff3bbbd0640 1 -- 172.21.15.52:0/495687909 shutdown_connections 2023-11-05T08:07:13.481 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.466+0000 7ff3bbbd0640 1 -- 172.21.15.52:0/495687909 wait complete. 2023-11-05T08:07:13.481 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.467+0000 7ff3bbbd0640 10 monclient: build_initial_monmap 2023-11-05T08:07:13.481 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.467+0000 7ff3bbbd0640 10 monclient: monmap: 2023-11-05T08:07:13.481 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:07:13.482 INFO:teuthology.orchestra.run.smithi052.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-05T08:07:13.482 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 0.000000 2023-11-05T08:07:13.482 INFO:teuthology.orchestra.run.smithi052.stderr:created 0.000000 2023-11-05T08:07:13.482 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:07:13.482 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:13.482 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.noname-a 2023-11-05T08:07:13.483 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.noname-b 2023-11-05T08:07:13.483 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-c 2023-11-05T08:07:13.483 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:13.483 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.467+0000 7ff3bbbd0640 1 librados: starting msgr at 2023-11-05T08:07:13.483 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.467+0000 7ff3bbbd0640 1 librados: starting objecter 2023-11-05T08:07:13.484 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.467+0000 7ff3bbbd0640 1 Processor -- start 2023-11-05T08:07:13.484 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.467+0000 7ff3bbbd0640 1 -- start start 2023-11-05T08:07:13.484 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.467+0000 7ff3bbbd0640 1 librados: setting wanted keys 2023-11-05T08:07:13.484 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.467+0000 7ff3bbbd0640 1 librados: calling monclient init 2023-11-05T08:07:13.484 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.467+0000 7ff3bbbd0640 10 monclient: init 2023-11-05T08:07:13.485 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.468+0000 7ff3bbbd0640 10 monclient: _reopen_session rank -1 2023-11-05T08:07:13.485 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.468+0000 7ff3bbbd0640 10 monclient: _add_conns ranks=[1,2,0] 2023-11-05T08:07:13.485 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.468+0000 7ff3bbbd0640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff3b40a8ae0 0x7ff3b413e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:13.485 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.468+0000 7ff3bbbd0640 10 monclient(hunting): picked mon.noname-b con 0x7ff3b40a8ae0 addr [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] 2023-11-05T08:07:13.485 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.468+0000 7ff3bbbd0640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff3b40a8ec0 0x7ff3b4140130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:13.486 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.468+0000 7ff3bbbd0640 10 monclient(hunting): picked mon.noname-c con 0x7ff3b40a8ec0 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:07:13.486 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.468+0000 7ff3bbbd0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3b40b0de0 0x7ff3b41421b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:13.486 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.468+0000 7ff3bbbd0640 10 monclient(hunting): picked mon.noname-a con 0x7ff3b40b0de0 addr [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] 2023-11-05T08:07:13.486 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.468+0000 7ff3bbbd0640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:13.486 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.468+0000 7ff3bbbd0640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b413fc30 con 0x7ff3b40b0de0 2023-11-05T08:07:13.487 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.468+0000 7ff3bbbd0640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:13.487 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.468+0000 7ff3bbbd0640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b41426f0 con 0x7ff3b40a8ae0 2023-11-05T08:07:13.487 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.468+0000 7ff3bbbd0640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:13.487 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.468+0000 7ff3bbbd0640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b413f750 con 0x7ff3b40a8ec0 2023-11-05T08:07:13.487 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.468+0000 7ff3bbbd0640 10 monclient(hunting): _renew_subs 2023-11-05T08:07:13.487 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.468+0000 7ff3bbbd0640 10 monclient(hunting): authenticate will time out at 1379.674346s 2023-11-05T08:07:13.488 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.468+0000 7ff3b916b640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff3b40a8ec0 0x7ff3b4140130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:13.488 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.469+0000 7ff3b916b640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff3b40a8ec0 0x7ff3b4140130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.52:40460/0 (socket says 172.21.15.52:40460) 2023-11-05T08:07:13.488 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.469+0000 7ff3b916b640 1 -- 172.21.15.52:0/928833898 learned_addr learned my addr 172.21.15.52:0/928833898 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-11-05T08:07:13.488 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.469+0000 7ff3b916b640 10 monclient(hunting): get_auth_request con 0x7ff3b40a8ec0 auth_method 0 2023-11-05T08:07:13.488 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.469+0000 7ff3b916b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:13.489 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.469+0000 7ff3b916b640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:13.489 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.469+0000 7ff3b916b640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:13.489 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.470+0000 7ff3b916b640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:13.489 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.470+0000 7ff3b916b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:13.489 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.470+0000 7ff3b916b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:13.491 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.474+0000 7ff3b916b640 10 monclient(hunting): handle_auth_done global_id 4283 payload 824 2023-11-05T08:07:13.492 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.474+0000 7ff3b916b640 1 -- 172.21.15.52:0/928833898 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff3b40a8ae0 msgr2=0x7ff3b413e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:13.492 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.474+0000 7ff3b916b640 1 --2- 172.21.15.52:0/928833898 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff3b40a8ae0 0x7ff3b413e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:13.492 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.474+0000 7ff3b916b640 1 -- 172.21.15.52:0/928833898 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3b40b0de0 msgr2=0x7ff3b41421b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:13.492 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.474+0000 7ff3b916b640 1 --2- 172.21.15.52:0/928833898 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3b40b0de0 0x7ff3b41421b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:13.492 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.474+0000 7ff3b916b640 10 monclient: _finish_hunting 0 2023-11-05T08:07:13.493 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.474+0000 7ff3b916b640 1 monclient: found mon.noname-c 2023-11-05T08:07:13.493 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.474+0000 7ff3b916b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:07:13.493 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.474+0000 7ff3b916b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.52:3301/0 2023-11-05T08:07:13.493 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.474+0000 7ff3b916b640 1 -- 172.21.15.52:0/928833898 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3b0009b30 con 0x7ff3b40a8ec0 2023-11-05T08:07:13.493 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.477+0000 7ff3b916b640 1 --2- 172.21.15.52:0/928833898 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff3b40a8ec0 0x7ff3b4140130 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff3a400b450 tx=0x7ff3a400b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:13.494 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.477+0000 7ff3aa7fc640 10 client.?.objecter ms_handle_connect 0x7ff3b40a8ec0 2023-11-05T08:07:13.494 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.477+0000 7ff3aa7fc640 10 client.?.objecter resend_mon_ops 2023-11-05T08:07:13.494 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.482+0000 7ff3aa7fc640 1 -- 172.21.15.52:0/928833898 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3a4011830 con 0x7ff3b40a8ec0 2023-11-05T08:07:13.494 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.482+0000 7ff3aa7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:13.495 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.482+0000 7ff3aa7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-11-05T08:07:13.495 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.482+0000 7ff3aa7fc640 10 monclient: dump: 2023-11-05T08:07:13.495 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:13.495 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:13.495 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:13.495 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:13.496 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:13.496 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:13.496 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:13.496 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:13.496 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:13.497 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:13.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.482+0000 7ff3aa7fc640 10 monclient: _finish_auth 0 2023-11-05T08:07:13.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.482+0000 7ff3aa7fc640 10 monclient: _check_auth_tickets 2023-11-05T08:07:13.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.482+0000 7ff3aa7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:07:13.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.482+0000 7ff3aa7fc640 1 -- 172.21.15.52:0/928833898 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3a4011990 con 0x7ff3b40a8ec0 2023-11-05T08:07:13.498 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.482+0000 7ff3aa7fc640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:07:13.498 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.482+0000 7ff3aa7fc640 1 -- 172.21.15.52:0/928833898 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3a4011d40 con 0x7ff3b40a8ec0 2023-11-05T08:07:13.498 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.482+0000 7ff3aa7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:13.498 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.482+0000 7ff3aa7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-11-05T08:07:13.498 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.482+0000 7ff3aa7fc640 10 monclient: dump: 2023-11-05T08:07:13.499 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:13.499 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:13.499 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:13.499 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:13.499 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:13.500 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:13.500 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:13.500 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:13.500 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:13.500 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:13.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.482+0000 7ff3abfff640 4 set_mon_vals no callback set 2023-11-05T08:07:13.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.482+0000 7ff3bbbd0640 5 monclient: authenticate success, global_id 4283 2023-11-05T08:07:13.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.482+0000 7ff3bbbd0640 10 monclient: _renew_subs 2023-11-05T08:07:13.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.482+0000 7ff3bbbd0640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.52:3301/0 2023-11-05T08:07:13.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.482+0000 7ff3bbbd0640 1 -- 172.21.15.52:0/928833898 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3b413f9d0 con 0x7ff3b40a8ec0 2023-11-05T08:07:13.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.482+0000 7ff3bbbd0640 10 client.4283.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-05T08:07:13.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.482+0000 7ff3bbbd0640 10 monclient: _renew_subs 2023-11-05T08:07:13.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.482+0000 7ff3bbbd0640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.52:3301/0 2023-11-05T08:07:13.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.482+0000 7ff3bbbd0640 1 -- 172.21.15.52:0/928833898 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3b41d9c70 con 0x7ff3b40a8ec0 2023-11-05T08:07:13.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.482+0000 7ff3bbbd0640 1 librados: init done 2023-11-05T08:07:13.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.483+0000 7ff3bbbd0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-05T08:07:13.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.483+0000 7ff3bbbd0640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:07:13.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.483+0000 7ff3bbbd0640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.52:3301/0 2023-11-05T08:07:13.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.483+0000 7ff3bbbd0640 1 -- 172.21.15.52:0/928833898 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3b413fda0 con 0x7ff3b40a8ec0 2023-11-05T08:07:13.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.487+0000 7fba9e7fc640 1 -- 172.21.15.52:0/589837096 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fba98058980 con 0x7fbaa80a8ec0 2023-11-05T08:07:13.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.487+0000 7fba9e7fc640 10 client.4366.objecter ms_dispatch 0x7fbaa8000b90 osd_map(23..23 src has 1..23) v4 2023-11-05T08:07:13.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.487+0000 7fba9e7fc640 3 client.4366.objecter handle_osd_map got epochs [23,23] > 0 2023-11-05T08:07:13.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.487+0000 7fba9e7fc640 3 client.4366.objecter handle_osd_map decoding full epoch 23 2023-11-05T08:07:13.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.487+0000 7fba9e7fc640 20 client.4366.objecter dump_active .. 0 homeless 2023-11-05T08:07:13.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.489+0000 7f699bf97640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 1}] 2023-11-05T08:07:13.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.489+0000 7f699bf97640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2023-11-05T08:07:13.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.489+0000 7f699bf97640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.52:3301/0 2023-11-05T08:07:13.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.489+0000 7f699bf97640 1 -- 172.21.15.52:0/2280017784 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f699404e9f0 con 0x7f69940a8ec0 2023-11-05T08:07:13.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.497+0000 7fba9e7fc640 1 -- 172.21.15.52:0/589837096 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fba98054cc0 con 0x7fbaa80a8ec0 2023-11-05T08:07:13.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.497+0000 7fba9e7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:07:13.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.497+0000 7fba9e7fc640 10 monclient: _finish_command 1 = system:0 2023-11-05T08:07:13.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.500+0000 7f0fc259c640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f0fc40a8ae0 0x7f0fc413ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:13.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.503+0000 7f2230ff9640 1 -- 172.21.15.52:0/2436792183 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f221c0587d0 con 0x7f22340a9110 2023-11-05T08:07:13.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.503+0000 7f2230ff9640 10 client.4347.objecter ms_dispatch 0x7f2234000b90 osd_map(23..23 src has 1..23) v4 2023-11-05T08:07:13.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.503+0000 7f2230ff9640 3 client.4347.objecter handle_osd_map got epochs [23,23] > 0 2023-11-05T08:07:13.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.503+0000 7f2230ff9640 3 client.4347.objecter handle_osd_map decoding full epoch 23 2023-11-05T08:07:13.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.503+0000 7f2230ff9640 20 client.4347.objecter dump_active .. 0 homeless 2023-11-05T08:07:13.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.503+0000 7f2230ff9640 1 -- 172.21.15.52:0/2436792183 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f221c054410 con 0x7f22340a9110 2023-11-05T08:07:13.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.503+0000 7f2230ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:07:13.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.503+0000 7f2230ff9640 10 monclient: _finish_command 1 = system:0 2023-11-05T08:07:13.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.504+0000 7f2e127fc640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f2e140b38d0 0x7f2e140ae640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:13.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.504+0000 7f0fc259c640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f0fc40a8ae0 0x7f0fc413ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.52:59234/0 (socket says 172.21.15.52:59234) 2023-11-05T08:07:13.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.504+0000 7f0fc259c640 1 -- 172.21.15.52:0/575308812 learned_addr learned my addr 172.21.15.52:0/575308812 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-11-05T08:07:13.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.504+0000 7f0fc259c640 10 monclient(hunting): get_auth_request con 0x7f0fc40a8ae0 auth_method 0 2023-11-05T08:07:13.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.504+0000 7f0fc259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:13.512 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.504+0000 7f0fc259c640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:13.512 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.504+0000 7f0fc259c640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:13.512 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.506+0000 7f2e127fc640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f2e140b38d0 0x7f2e140ae640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.52:59242/0 (socket says 172.21.15.52:59242) 2023-11-05T08:07:13.512 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.506+0000 7f2e127fc640 1 -- 172.21.15.52:0/1384353063 learned_addr learned my addr 172.21.15.52:0/1384353063 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-11-05T08:07:13.513 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.506+0000 7f2e127fc640 10 monclient(hunting): get_auth_request con 0x7f2e140b38d0 auth_method 0 2023-11-05T08:07:13.513 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.506+0000 7f2e127fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:13.513 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.506+0000 7f2e127fc640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:13.513 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.506+0000 7f2e127fc640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:13.514 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.506+0000 7f0fc259c640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:13.514 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.506+0000 7f0fc259c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:13.514 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.506+0000 7f0fc259c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:13.515 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.508+0000 7f2e127fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:13.515 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.508+0000 7f2e127fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:13.515 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.508+0000 7f2e127fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:13.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.510+0000 7f2e127fc640 10 monclient(hunting): handle_auth_done global_id 4372 payload 274 2023-11-05T08:07:13.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.510+0000 7f2e127fc640 1 -- 172.21.15.52:0/1384353063 >> v2:172.21.15.52:3300/0 conn(0x7f2e140b4240 msgr2=0x7f2e140b1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-05T08:07:13.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.510+0000 7f2e127fc640 1 --2- 172.21.15.52:0/1384353063 >> v2:172.21.15.52:3300/0 conn(0x7f2e140b4240 0x7f2e140b1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:13.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.510+0000 7f2e127fc640 1 -- 172.21.15.52:0/1384353063 >> v1:172.21.15.156:6789/0 conn(0x7f2e140ade00 legacy=0x7f2e1413b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-05T08:07:13.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.510+0000 7f2e127fc640 10 monclient: _finish_hunting 0 2023-11-05T08:07:13.517 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.510+0000 7f2e127fc640 1 monclient: found mon.noname-c 2023-11-05T08:07:13.517 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.510+0000 7f2e127fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:07:13.517 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.510+0000 7f2e127fc640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.156:3300/0 2023-11-05T08:07:13.517 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.510+0000 7f2e127fc640 1 -- 172.21.15.52:0/1384353063 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e140aeb80 con 0x7f2e140b38d0 2023-11-05T08:07:13.518 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.511+0000 7f0fc259c640 10 monclient(hunting): handle_auth_done global_id 4369 payload 274 2023-11-05T08:07:13.518 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.511+0000 7f0fc259c640 1 -- 172.21.15.52:0/575308812 >> v2:172.21.15.52:3300/0 conn(0x7f0fc40b0de0 msgr2=0x7f0fc413f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-05T08:07:13.518 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.511+0000 7f0fc259c640 1 --2- 172.21.15.52:0/575308812 >> v2:172.21.15.52:3300/0 conn(0x7f0fc40b0de0 0x7f0fc413f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:13.519 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.511+0000 7f0fc259c640 1 -- 172.21.15.52:0/575308812 >> v1:172.21.15.52:6789/0 conn(0x7f0fc40a8ec0 legacy=0x7f0fc4145000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-05T08:07:13.519 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.511+0000 7f0fc259c640 10 monclient: _finish_hunting 0 2023-11-05T08:07:13.519 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.511+0000 7f0fc259c640 1 monclient: found mon.noname-c 2023-11-05T08:07:13.519 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.511+0000 7f0fc259c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:07:13.520 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.511+0000 7f0fc259c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.156:3300/0 2023-11-05T08:07:13.520 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.511+0000 7f0fc259c640 1 -- 172.21.15.52:0/575308812 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fc4145710 con 0x7f0fc40a8ae0 2023-11-05T08:07:13.520 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.515+0000 7f0fc259c640 1 --2- 172.21.15.52:0/575308812 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0fc40a8ae0 0x7f0fc413ec30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0fc406d070 tx=0x7f0fb402b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a4b91c33d6f3378a server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:13.520 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.517+0000 7f1ce4ff9640 1 -- 172.21.15.52:0/1034509529 <== mon.1 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1cdc017020 con 0x7f1ce80a8ec0 2023-11-05T08:07:13.521 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.517+0000 7f1ce4ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2023-11-05T08:07:13.521 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.517+0000 7f1ce4ff9640 10 monclient: _finish_command 2 = system:0 2023-11-05T08:07:13.521 INFO:teuthology.orchestra.run.smithi052.stdout:60129542149 2023-11-05T08:07:13.522 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.517+0000 7f2e127fc640 1 --2- 172.21.15.52:0/1384353063 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2e140b38d0 0x7f2e140ae640 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2e08009870 tx=0x7f2e0802b880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ded04e7d80645dd1 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:13.523 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.518+0000 7f1cee38a640 10 librados: watch_flush enter 2023-11-05T08:07:13.523 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.518+0000 7f1cee38a640 10 librados: watch_flush exit 2023-11-05T08:07:13.523 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.518+0000 7f1cee38a640 20 client.4360.objecter shutdown clearing up homeless session... 2023-11-05T08:07:13.524 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.518+0000 7f1cee38a640 10 client.4360.objecter successfully canceled tick 2023-11-05T08:07:13.524 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.519+0000 7f1cee38a640 1 -- 172.21.15.52:0/1034509529 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f1cd406c850 msgr2=0x7f1cd406ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:13.524 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.519+0000 7f1cee38a640 1 --2- 172.21.15.52:0/1034509529 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f1cd406c850 0x7f1cd406ed10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1cd8001830 tx=0x7f1cd8009040 comp rx=0 tx=0).stop 2023-11-05T08:07:13.524 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.519+0000 7f1cee38a640 10 monclient: shutdown 2023-11-05T08:07:13.524 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.519+0000 7f1cee38a640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:07:13.525 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.519+0000 7f1cee38a640 1 -- 172.21.15.52:0/1034509529 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1ce80a8ec0 msgr2=0x7f1ce812d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:13.525 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.519+0000 7f1cee38a640 1 --2- 172.21.15.52:0/1034509529 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1ce80a8ec0 0x7f1ce812d920 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc00c390 tx=0x7f1cdc001e70 comp rx=0 tx=0).stop 2023-11-05T08:07:13.525 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.519+0000 7f1cee38a640 1 -- 172.21.15.52:0/1034509529 shutdown_connections 2023-11-05T08:07:13.525 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.519+0000 7f1cee38a640 1 --2- 172.21.15.52:0/1034509529 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f1cd406c850 0x7f1cd406ed10 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:13.525 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.519+0000 7f1cee38a640 1 --2- 172.21.15.52:0/1034509529 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ce813f340 0x7f1ce8142c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:13.526 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.519+0000 7f1cee38a640 1 --2- 172.21.15.52:0/1034509529 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1ce80a8ec0 0x7f1ce812d920 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:13.526 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.519+0000 7f1cee38a640 1 --2- 172.21.15.52:0/1034509529 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1ce80a8ae0 0x7f1ce81438d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:13.526 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.519+0000 7f1cee38a640 1 -- 172.21.15.52:0/1034509529 >> 172.21.15.52:0/1034509529 conn(0x7f1ce80b7230 msgr2=0x7f1ce80b7610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:07:13.526 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.519+0000 7f1cee38a640 1 -- 172.21.15.52:0/1034509529 shutdown_connections 2023-11-05T08:07:13.527 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.519+0000 7f1cee38a640 1 -- 172.21.15.52:0/1034509529 wait complete. 2023-11-05T08:07:13.527 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.522+0000 7f1cee38a640 1 librados: shutdown 2023-11-05T08:07:13.528 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.524+0000 7f2e11ffb640 1 -- 172.21.15.52:0/1384353063 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e080317e0 con 0x7f2e140b38d0 2023-11-05T08:07:13.528 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.524+0000 7f2e11ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:13.528 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.524+0000 7f2e11ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-11-05T08:07:13.528 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.524+0000 7f2e11ffb640 10 monclient: dump: 2023-11-05T08:07:13.529 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:13.529 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:13.529 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:13.529 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:13.529 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:13.530 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:13.530 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:13.530 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:13.530 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:13.530 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:13.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.524+0000 7f2e11ffb640 10 monclient: _finish_auth 0 2023-11-05T08:07:13.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.524+0000 7f2e11ffb640 10 monclient: _check_auth_tickets 2023-11-05T08:07:13.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.524+0000 7f2e11ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:07:13.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.524+0000 7f2e11ffb640 1 -- 172.21.15.52:0/1384353063 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e08031940 con 0x7f2e140b38d0 2023-11-05T08:07:13.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.524+0000 7f2e11ffb640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:07:13.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.524+0000 7f2e11ffb640 1 -- 172.21.15.52:0/1384353063 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e08031cd0 con 0x7f2e140b38d0 2023-11-05T08:07:13.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.524+0000 7f2e11ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:13.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.524+0000 7f2e11ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-05T08:07:13.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.524+0000 7f2e11ffb640 10 monclient: dump: 2023-11-05T08:07:13.532 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:13.533 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:13.533 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:13.533 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:13.533 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:13.533 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:13.534 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:13.534 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:13.534 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:13.534 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:13.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.524+0000 7f2e1984b640 5 monclient: authenticate success, global_id 4372 2023-11-05T08:07:13.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.524+0000 7f2e1984b640 10 monclient: get_monmap_and_config success 2023-11-05T08:07:13.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.524+0000 7f2e1984b640 4 set_mon_vals no callback set 2023-11-05T08:07:13.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.525+0000 7f0fc159a640 1 -- 172.21.15.52:0/575308812 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb4004230 con 0x7f0fc40a8ae0 2023-11-05T08:07:13.537 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.525+0000 7f0fc159a640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:13.537 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.525+0000 7f0fc159a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-11-05T08:07:13.537 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.525+0000 7f0fc159a640 10 monclient: dump: 2023-11-05T08:07:13.537 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:13.537 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:13.538 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:13.538 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:13.538 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:13.538 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:13.539 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:13.539 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:13.539 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:13.539 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:13.539 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.525+0000 7f0fc159a640 10 monclient: _finish_auth 0 2023-11-05T08:07:13.540 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.525+0000 7f0fc159a640 10 monclient: _check_auth_tickets 2023-11-05T08:07:13.540 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.525+0000 7f0fc159a640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:07:13.540 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.525+0000 7f0fc159a640 1 -- 172.21.15.52:0/575308812 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fb4004390 con 0x7f0fc40a8ae0 2023-11-05T08:07:13.540 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.525+0000 7f0fc8b1d640 5 monclient: authenticate success, global_id 4369 2023-11-05T08:07:13.540 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.525+0000 7f0fc8b1d640 20 monclient: get_monmap_and_config waiting for monmap|config 2023-11-05T08:07:13.541 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.525+0000 7f0fc159a640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:07:13.541 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.525+0000 7f0fc159a640 1 -- 172.21.15.52:0/575308812 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb4003810 con 0x7f0fc40a8ae0 2023-11-05T08:07:13.541 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.525+0000 7f0fc8b1d640 10 monclient: get_monmap_and_config success 2023-11-05T08:07:13.541 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.525+0000 7f0fc8b1d640 4 set_mon_vals no callback set 2023-11-05T08:07:13.542 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-05T08:07:13.543 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.525+0000 7f2e1984b640 10 monclient: shutdown 2023-11-05T08:07:13.543 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.525+0000 7f2e1984b640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:07:13.543 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.525+0000 7f2e1984b640 1 -- 172.21.15.52:0/1384353063 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2e140b38d0 msgr2=0x7f2e140ae640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:13.544 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.525+0000 7f2e1984b640 1 --2- 172.21.15.52:0/1384353063 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2e140b38d0 0x7f2e140ae640 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2e08009870 tx=0x7f2e0802b880 comp rx=0 tx=0).stop 2023-11-05T08:07:13.544 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.526+0000 7f2e1984b640 1 -- 172.21.15.52:0/1384353063 shutdown_connections 2023-11-05T08:07:13.544 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.526+0000 7f2e1984b640 1 --2- 172.21.15.52:0/1384353063 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2e140b38d0 0x7f2e140ae640 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:13.544 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.526+0000 7f2e1984b640 1 --2- 172.21.15.52:0/1384353063 >> v2:172.21.15.52:3300/0 conn(0x7f2e140b4240 0x7f2e140b1150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:13.544 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.526+0000 7f2e1984b640 1 -- 172.21.15.52:0/1384353063 >> 172.21.15.52:0/1384353063 conn(0x7f2e14065cd0 msgr2=0x7f2e140660e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:07:13.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.526+0000 7f0fc159a640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:13.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.526+0000 7f0fc159a640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-05T08:07:13.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.526+0000 7f0fc159a640 10 monclient: dump: 2023-11-05T08:07:13.546 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:13.546 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:13.546 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:13.546 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:13.546 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:13.547 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:13.547 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:13.547 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:13.547 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:13.547 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:13.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.526+0000 7f2e1984b640 1 -- 172.21.15.52:0/1384353063 shutdown_connections 2023-11-05T08:07:13.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.526+0000 7f2e1984b640 1 -- 172.21.15.52:0/1384353063 wait complete. 2023-11-05T08:07:13.549 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.526+0000 7f0fc8b1d640 10 monclient: shutdown 2023-11-05T08:07:13.549 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.526+0000 7f0fc8b1d640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:07:13.549 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.526+0000 7f0fc8b1d640 1 -- 172.21.15.52:0/575308812 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0fc40a8ae0 msgr2=0x7f0fc413ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:13.549 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.526+0000 7f0fc8b1d640 1 --2- 172.21.15.52:0/575308812 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0fc40a8ae0 0x7f0fc413ec30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0fc406d070 tx=0x7f0fb402b8f0 comp rx=0 tx=0).stop 2023-11-05T08:07:13.550 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.526+0000 7f0fc8b1d640 1 -- 172.21.15.52:0/575308812 shutdown_connections 2023-11-05T08:07:13.550 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.526+0000 7f0fc8b1d640 1 --2- 172.21.15.52:0/575308812 >> v2:172.21.15.52:3300/0 conn(0x7f0fc40b0de0 0x7f0fc413f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:13.550 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.526+0000 7f0fc8b1d640 1 --2- 172.21.15.52:0/575308812 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0fc40a8ae0 0x7f0fc413ec30 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:13.550 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.526+0000 7f0fc8b1d640 1 -- 172.21.15.52:0/575308812 >> 172.21.15.52:0/575308812 conn(0x7f0fc40b7230 msgr2=0x7f0fc40b7610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:07:13.550 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.526+0000 7f0fc8b1d640 1 -- 172.21.15.52:0/575308812 shutdown_connections 2023-11-05T08:07:13.551 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.526+0000 7f0fc8b1d640 1 -- 172.21.15.52:0/575308812 wait complete. 2023-11-05T08:07:13.551 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.527+0000 7f2e1984b640 10 monclient: build_initial_monmap 2023-11-05T08:07:13.551 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.527+0000 7f2e1984b640 10 monclient: monmap: 2023-11-05T08:07:13.552 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:07:13.552 INFO:teuthology.orchestra.run.smithi052.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-05T08:07:13.552 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 0.000000 2023-11-05T08:07:13.552 INFO:teuthology.orchestra.run.smithi052.stderr:created 0.000000 2023-11-05T08:07:13.552 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:07:13.553 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:13.553 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.noname-a 2023-11-05T08:07:13.553 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.noname-b 2023-11-05T08:07:13.553 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-c 2023-11-05T08:07:13.553 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:13.553 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.527+0000 7f2e1984b640 1 librados: starting msgr at 2023-11-05T08:07:13.554 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.527+0000 7f2e1984b640 1 librados: starting objecter 2023-11-05T08:07:13.554 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.528+0000 7f2e1984b640 1 Processor -- start 2023-11-05T08:07:13.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.528+0000 7f0fc8b1d640 10 monclient: build_initial_monmap 2023-11-05T08:07:13.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.528+0000 7f0fc8b1d640 10 monclient: monmap: 2023-11-05T08:07:13.555 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:07:13.555 INFO:teuthology.orchestra.run.smithi052.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-05T08:07:13.556 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 0.000000 2023-11-05T08:07:13.556 INFO:teuthology.orchestra.run.smithi052.stderr:created 0.000000 2023-11-05T08:07:13.556 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:07:13.556 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:13.556 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.noname-a 2023-11-05T08:07:13.557 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.noname-b 2023-11-05T08:07:13.557 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-c 2023-11-05T08:07:13.557 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:13.557 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.528+0000 7f0fc8b1d640 1 librados: starting msgr at 2023-11-05T08:07:13.557 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.528+0000 7f0fc8b1d640 1 librados: starting objecter 2023-11-05T08:07:13.558 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.528+0000 7f2e1984b640 1 -- start start 2023-11-05T08:07:13.558 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.528+0000 7f0fc8b1d640 1 Processor -- start 2023-11-05T08:07:13.559 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.528+0000 7f2e1984b640 1 librados: setting wanted keys 2023-11-05T08:07:13.559 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.528+0000 7f2e1984b640 1 librados: calling monclient init 2023-11-05T08:07:13.559 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.528+0000 7f2e1984b640 10 monclient: init 2023-11-05T08:07:13.560 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.528+0000 7f0fc8b1d640 1 -- start start 2023-11-05T08:07:13.560 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.528+0000 7f0fc8b1d640 1 librados: setting wanted keys 2023-11-05T08:07:13.560 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.528+0000 7f0fc8b1d640 1 librados: calling monclient init 2023-11-05T08:07:13.560 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.528+0000 7f0fc8b1d640 10 monclient: init 2023-11-05T08:07:13.561 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.529+0000 7f0fc8b1d640 10 monclient: _reopen_session rank -1 2023-11-05T08:07:13.561 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.529+0000 7f0fc8b1d640 10 monclient: _add_conns ranks=[1,0,2] 2023-11-05T08:07:13.561 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.529+0000 7f0fc8b1d640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0fc40a8ae0 0x7f0fc413da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:13.561 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.529+0000 7f0fc8b1d640 10 monclient(hunting): picked mon.noname-b con 0x7f0fc40a8ae0 addr [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] 2023-11-05T08:07:13.561 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.529+0000 7f0fc8b1d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0fc40a8ec0 0x7f0fc4131a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:13.562 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.529+0000 7f2e1984b640 10 monclient: _reopen_session rank -1 2023-11-05T08:07:13.562 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.529+0000 7f2e1984b640 10 monclient: _add_conns ranks=[0,1,2] 2023-11-05T08:07:13.562 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.529+0000 7f2e1984b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2e140ade00 0x7f2e1406dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:13.562 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.529+0000 7f2e1984b640 10 monclient(hunting): picked mon.noname-a con 0x7f2e140ade00 addr [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] 2023-11-05T08:07:13.563 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.529+0000 7f2e1984b640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2e140b4240 0x7f2e1413d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:13.563 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.529+0000 7f2e1984b640 10 monclient(hunting): picked mon.noname-b con 0x7f2e140b4240 addr [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] 2023-11-05T08:07:13.563 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.529+0000 7f2e1984b640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2e1413d830 0x7f2e141de1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:13.563 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.529+0000 7f2e1984b640 10 monclient(hunting): picked mon.noname-c con 0x7f2e1413d830 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:07:13.563 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.529+0000 7f2e1984b640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:13.564 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.529+0000 7f2e1984b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e1406e320 con 0x7f2e140ade00 2023-11-05T08:07:13.564 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.529+0000 7f2e1984b640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:13.564 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.529+0000 7f2e1984b640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e1406d0f0 con 0x7f2e140b4240 2023-11-05T08:07:13.564 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.529+0000 7f2e1984b640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:13.564 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.529+0000 7f2e1984b640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e1413e8c0 con 0x7f2e1413d830 2023-11-05T08:07:13.564 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.529+0000 7f2e1984b640 10 monclient(hunting): _renew_subs 2023-11-05T08:07:13.565 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.529+0000 7f2e1984b640 10 monclient(hunting): authenticate will time out at 1379.735877s 2023-11-05T08:07:13.565 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.530+0000 7f0fc8b1d640 10 monclient(hunting): picked mon.noname-a con 0x7f0fc40a8ec0 addr [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] 2023-11-05T08:07:13.566 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.530+0000 7f0fc8b1d640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0fc40b0de0 0x7f0fc4131fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:13.566 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.530+0000 7f0fc8b1d640 10 monclient(hunting): picked mon.noname-c con 0x7f0fc40b0de0 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:07:13.566 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.530+0000 7f0fc8b1d640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:13.566 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.530+0000 7f0fc8b1d640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc41324f0 con 0x7f0fc40a8ec0 2023-11-05T08:07:13.567 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.530+0000 7f2e127fc640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2e140b4240 0x7f2e1413d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:13.568 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.530+0000 7f0fc8b1d640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:13.568 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.530+0000 7f0fc259c640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0fc40a8ae0 0x7f0fc413da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:13.568 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.530+0000 7f0fc8b1d640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc4132660 con 0x7f0fc40a8ae0 2023-11-05T08:07:13.568 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.530+0000 7f0fc8b1d640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:13.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.530+0000 7f0fc8b1d640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc40b6900 con 0x7f0fc40b0de0 2023-11-05T08:07:13.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.530+0000 7f0fc8b1d640 10 monclient(hunting): _renew_subs 2023-11-05T08:07:13.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.530+0000 7f0fc8b1d640 10 monclient(hunting): authenticate will time out at 1379.736516s 2023-11-05T08:07:13.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.530+0000 7f2e127fc640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2e140b4240 0x7f2e1413d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.52:59274/0 (socket says 172.21.15.52:59274) 2023-11-05T08:07:13.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.530+0000 7f2e127fc640 1 -- 172.21.15.52:0/1907260947 learned_addr learned my addr 172.21.15.52:0/1907260947 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-11-05T08:07:13.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.530+0000 7f2e127fc640 10 monclient(hunting): get_auth_request con 0x7f2e140b4240 auth_method 0 2023-11-05T08:07:13.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.530+0000 7f2e127fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:13.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.530+0000 7f2e127fc640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:13.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.530+0000 7f2e127fc640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:13.571 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.530+0000 7f0fc259c640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0fc40a8ae0 0x7f0fc413da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.52:59288/0 (socket says 172.21.15.52:59288) 2023-11-05T08:07:13.571 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.530+0000 7f0fc259c640 1 -- 172.21.15.52:0/3740253282 learned_addr learned my addr 172.21.15.52:0/3740253282 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-11-05T08:07:13.571 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.530+0000 7f0fc259c640 10 monclient(hunting): get_auth_request con 0x7f0fc40a8ae0 auth_method 0 2023-11-05T08:07:13.572 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.530+0000 7f0fc259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:13.572 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.530+0000 7f0fc259c640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:13.572 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.530+0000 7f0fc259c640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:13.572 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.531+0000 7f2e127fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:13.573 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.531+0000 7f2e127fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:13.573 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.531+0000 7f2e127fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:13.573 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.532+0000 7f0fc259c640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:13.573 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.532+0000 7f0fc259c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:13.574 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.532+0000 7f0fc259c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:13.574 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.534+0000 7f2e127fc640 10 monclient(hunting): handle_auth_done global_id 4375 payload 824 2023-11-05T08:07:13.575 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.534+0000 7f2e127fc640 1 -- 172.21.15.52:0/1907260947 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2e1413d830 msgr2=0x7f2e141de1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:13.575 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.534+0000 7f2e127fc640 1 --2- 172.21.15.52:0/1907260947 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2e1413d830 0x7f2e141de1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:13.575 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.534+0000 7f2e127fc640 1 -- 172.21.15.52:0/1907260947 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2e140ade00 msgr2=0x7f2e1406dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:13.575 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.534+0000 7f2e127fc640 1 --2- 172.21.15.52:0/1907260947 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2e140ade00 0x7f2e1406dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:13.575 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.534+0000 7f2e127fc640 10 monclient: _finish_hunting 0 2023-11-05T08:07:13.576 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.534+0000 7f2e127fc640 1 monclient: found mon.noname-b 2023-11-05T08:07:13.576 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.534+0000 7f2e127fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:07:13.576 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.534+0000 7f2e127fc640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.156:3300/0 2023-11-05T08:07:13.576 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.534+0000 7f2e127fc640 1 -- 172.21.15.52:0/1907260947 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e080094d0 con 0x7f2e140b4240 2023-11-05T08:07:13.577 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.4 2023-11-05T08:07:13.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.537+0000 7f0fc259c640 10 monclient(hunting): handle_auth_done global_id 4378 payload 824 2023-11-05T08:07:13.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.537+0000 7f0fc259c640 1 -- 172.21.15.52:0/3740253282 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0fc40b0de0 msgr2=0x7f0fc4131fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:13.579 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.537+0000 7f0fc259c640 1 --2- 172.21.15.52:0/3740253282 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0fc40b0de0 0x7f0fc4131fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:13.579 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.537+0000 7f0fc259c640 1 -- 172.21.15.52:0/3740253282 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0fc40a8ec0 msgr2=0x7f0fc4131a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:13.579 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.537+0000 7f0fc259c640 1 --2- 172.21.15.52:0/3740253282 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0fc40a8ec0 0x7f0fc4131a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:13.579 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.537+0000 7f0fc259c640 10 monclient: _finish_hunting 0 2023-11-05T08:07:13.579 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.537+0000 7f0fc259c640 1 monclient: found mon.noname-b 2023-11-05T08:07:13.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.537+0000 7f0fc259c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:07:13.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.537+0000 7f0fc259c640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.156:3300/0 2023-11-05T08:07:13.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.537+0000 7f0fc259c640 1 -- 172.21.15.52:0/3740253282 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fb4009460 con 0x7f0fc40a8ae0 2023-11-05T08:07:13.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.541+0000 7f0fc259c640 1 --2- 172.21.15.52:0/3740253282 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0fc40a8ae0 0x7f0fc413da80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0fb40090b0 tx=0x7f0fb40046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:13.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.541+0000 7f0fb2ffd640 10 client.?.objecter ms_handle_connect 0x7f0fc40a8ae0 2023-11-05T08:07:13.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.541+0000 7f0fb2ffd640 10 client.?.objecter resend_mon_ops 2023-11-05T08:07:13.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.541+0000 7f2e127fc640 1 --2- 172.21.15.52:0/1907260947 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2e140b4240 0x7f2e1413d2f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2e08000c00 tx=0x7f2e080046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:13.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.541+0000 7f2dfbfff640 10 client.?.objecter ms_handle_connect 0x7f2e140b4240 2023-11-05T08:07:13.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.541+0000 7f2dfbfff640 10 client.?.objecter resend_mon_ops 2023-11-05T08:07:13.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.547+0000 7f0fb2ffd640 1 -- 172.21.15.52:0/3740253282 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb4003e50 con 0x7f0fc40a8ae0 2023-11-05T08:07:13.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.547+0000 7f0fb2ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:13.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.547+0000 7f0fb2ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-05T08:07:13.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.547+0000 7f0fb2ffd640 10 monclient: dump: 2023-11-05T08:07:13.584 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:13.584 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:13.584 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:13.584 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:13.584 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:13.584 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:13.585 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:13.585 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:13.585 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:13.585 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:13.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.547+0000 7f0fb2ffd640 10 monclient: _finish_auth 0 2023-11-05T08:07:13.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.547+0000 7f0fb2ffd640 10 monclient: _check_auth_tickets 2023-11-05T08:07:13.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.547+0000 7f0fb2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:07:13.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.547+0000 7f0fb2ffd640 1 -- 172.21.15.52:0/3740253282 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fb4004500 con 0x7f0fc40a8ae0 2023-11-05T08:07:13.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.547+0000 7f0fc8b1d640 5 monclient: authenticate success, global_id 4378 2023-11-05T08:07:13.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.547+0000 7f0fc8b1d640 10 monclient: _renew_subs 2023-11-05T08:07:13.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.547+0000 7f0fc8b1d640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:07:13.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.547+0000 7f0fc8b1d640 1 -- 172.21.15.52:0/3740253282 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fc4142bc0 con 0x7f0fc40a8ae0 2023-11-05T08:07:13.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.547+0000 7f0fb2ffd640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:07:13.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.547+0000 7f0fb2ffd640 1 -- 172.21.15.52:0/3740253282 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb4006280 con 0x7f0fc40a8ae0 2023-11-05T08:07:13.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.547+0000 7f0fb2ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:13.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.547+0000 7f0fb2ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-05T08:07:13.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.547+0000 7f0fb2ffd640 10 monclient: dump: 2023-11-05T08:07:13.588 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:13.588 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:13.588 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:13.588 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:13.588 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:13.589 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:13.589 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:13.589 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:13.589 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:13.589 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:13.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.547+0000 7f0fc0d99640 4 set_mon_vals no callback set 2023-11-05T08:07:13.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.547+0000 7f0fc8b1d640 10 client.4378.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-05T08:07:13.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.547+0000 7f0fc8b1d640 10 monclient: _renew_subs 2023-11-05T08:07:13.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.547+0000 7f0fc8b1d640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:07:13.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.547+0000 7f0fc8b1d640 1 -- 172.21.15.52:0/3740253282 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fc40b6fa0 con 0x7f0fc40a8ae0 2023-11-05T08:07:13.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.547+0000 7f0fc8b1d640 1 librados: init done 2023-11-05T08:07:13.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.548+0000 7f0fc8b1d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-05T08:07:13.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.548+0000 7f0fc8b1d640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:07:13.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.548+0000 7f0fc8b1d640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:07:13.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.548+0000 7f0fc8b1d640 1 -- 172.21.15.52:0/3740253282 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fc41430d0 con 0x7f0fc40a8ae0 2023-11-05T08:07:13.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.550+0000 7f2dfbfff640 1 -- 172.21.15.52:0/1907260947 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e08032880 con 0x7f2e140b4240 2023-11-05T08:07:13.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.550+0000 7f2dfbfff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:13.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.550+0000 7f2dfbfff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-05T08:07:13.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.550+0000 7f2dfbfff640 10 monclient: dump: 2023-11-05T08:07:13.593 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:13.594 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:13.594 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:13.594 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:13.594 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:13.594 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:13.595 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:13.595 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:13.595 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:13.595 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:13.595 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.550+0000 7f2dfbfff640 10 monclient: _finish_auth 0 2023-11-05T08:07:13.595 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.550+0000 7f2dfbfff640 10 monclient: _check_auth_tickets 2023-11-05T08:07:13.596 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.550+0000 7f2dfbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:07:13.596 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.550+0000 7f2dfbfff640 1 -- 172.21.15.52:0/1907260947 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e08032a00 con 0x7f2e140b4240 2023-11-05T08:07:13.596 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.550+0000 7f2e1984b640 5 monclient: authenticate success, global_id 4375 2023-11-05T08:07:13.596 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.550+0000 7f2e1984b640 10 monclient: _renew_subs 2023-11-05T08:07:13.596 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.550+0000 7f2e1984b640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:07:13.597 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.550+0000 7f2e1984b640 1 -- 172.21.15.52:0/1907260947 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e14139fb0 con 0x7f2e140b4240 2023-11-05T08:07:13.597 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.550+0000 7f2dfbfff640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:07:13.597 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.550+0000 7f2dfbfff640 1 -- 172.21.15.52:0/1907260947 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e08032db0 con 0x7f2e140b4240 2023-11-05T08:07:13.597 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.550+0000 7f2dfbfff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:13.597 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.550+0000 7f2dfbfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-05T08:07:13.598 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.550+0000 7f2dfbfff640 10 monclient: dump: 2023-11-05T08:07:13.598 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:13.598 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:13.598 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:13.598 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:13.598 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:13.599 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:13.599 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:13.599 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:13.599 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:13.599 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:13.600 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.550+0000 7f2e117fa640 4 set_mon_vals no callback set 2023-11-05T08:07:13.600 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.551+0000 7f2e1984b640 10 client.4375.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-05T08:07:13.600 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.551+0000 7f2e1984b640 10 monclient: _renew_subs 2023-11-05T08:07:13.600 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.551+0000 7f2e1984b640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:07:13.600 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.551+0000 7f2e1984b640 1 -- 172.21.15.52:0/1907260947 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e1406e770 con 0x7f2e140b4240 2023-11-05T08:07:13.600 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.551+0000 7f2e1984b640 1 librados: init done 2023-11-05T08:07:13.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.552+0000 7f2e1984b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-05T08:07:13.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.552+0000 7f2e1984b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:07:13.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.552+0000 7f2e1984b640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:07:13.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.552+0000 7f2e1984b640 1 -- 172.21.15.52:0/1907260947 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e1413a140 con 0x7f2e140b4240 2023-11-05T08:07:13.691 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.689+0000 7fbaafafc640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 6}] 2023-11-05T08:07:13.691 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.689+0000 7fbaafafc640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 6}] 2023-11-05T08:07:13.691 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.689+0000 7fbaafafc640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:07:13.691 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.689+0000 7fbaafafc640 1 -- 172.21.15.52:0/589837096 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fbaa813d600 con 0x7fbaa80a8ec0 2023-11-05T08:07:13.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.722+0000 7f8536664640 10 monclient: get_monmap_and_config 2023-11-05T08:07:13.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.722+0000 7f8536664640 10 monclient: build_initial_monmap 2023-11-05T08:07:13.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.722+0000 7f8536664640 10 monclient: monmap: 2023-11-05T08:07:13.724 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:07:13.725 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:13.725 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:07:13.724393+0000 2023-11-05T08:07:13.725 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:07:13.724393+0000 2023-11-05T08:07:13.725 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:07:13.725 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:13.726 INFO:teuthology.orchestra.run.smithi052.stderr:0: v1:172.21.15.52:6789/0 mon.noname-a-legacy 2023-11-05T08:07:13.726 INFO:teuthology.orchestra.run.smithi052.stderr:1: v1:172.21.15.156:6789/0 mon.noname-c-legacy 2023-11-05T08:07:13.726 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-b 2023-11-05T08:07:13.726 INFO:teuthology.orchestra.run.smithi052.stderr:3: v2:172.21.15.52:3300/0 mon.noname-a 2023-11-05T08:07:13.726 INFO:teuthology.orchestra.run.smithi052.stderr:4: v2:172.21.15.156:3300/0 mon.noname-c 2023-11-05T08:07:13.727 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:13.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.723+0000 7f8536664640 1 Processor -- start 2023-11-05T08:07:13.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.723+0000 7f8536664640 1 -- start start 2023-11-05T08:07:13.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.723+0000 7f8536664640 10 monclient: init 2023-11-05T08:07:13.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.724+0000 7f8536664640 10 monclient: _reopen_session rank -1 2023-11-05T08:07:13.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.724+0000 7f8536664640 10 monclient: _add_conns ranks=[4,2,1,3,0] 2023-11-05T08:07:13.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.724+0000 7f8536664640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f85300a8ae0 0x7f853013ec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:13.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.724+0000 7f8536664640 10 monclient(hunting): picked mon.noname-c con 0x7f85300a8ae0 addr v2:172.21.15.156:3300/0 2023-11-05T08:07:13.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.724+0000 7f8536664640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f85300a8ec0 0x7f853013f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:13.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.724+0000 7f8536664640 10 monclient(hunting): picked mon.noname-b con 0x7f85300a8ec0 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:07:13.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.724+0000 7f8536664640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f85300b0de0 addr v1:172.21.15.156:6789/0 2023-11-05T08:07:13.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.724+0000 7f8536664640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85300a9600 con 0x7f85300b0de0 2023-11-05T08:07:13.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.724+0000 7f8536664640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:13.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.724+0000 7f8536664640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85300a9360 con 0x7f85300a8ae0 2023-11-05T08:07:13.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.724+0000 7f8536664640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:13.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.724+0000 7f8536664640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85300b80b0 con 0x7f85300a8ec0 2023-11-05T08:07:13.731 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.724+0000 7f8536664640 10 monclient(hunting): _renew_subs 2023-11-05T08:07:13.731 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.724+0000 7f8536664640 10 monclient(hunting): authenticate will time out at 1379.930217s 2023-11-05T08:07:13.732 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.724+0000 7f2239856640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 0}] 2023-11-05T08:07:13.732 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.724+0000 7f2239856640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2023-11-05T08:07:13.732 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.724+0000 7f2239856640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.52:3300/0 2023-11-05T08:07:13.732 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.724+0000 7f2239856640 1 -- 172.21.15.52:0/2436792183 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f22340b6bd0 con 0x7f22340a9110 2023-11-05T08:07:13.732 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.728+0000 7f2230ff9640 1 -- 172.21.15.52:0/2436792183 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f221c018070 con 0x7f22340a9110 2023-11-05T08:07:13.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.728+0000 7f2230ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2023-11-05T08:07:13.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.728+0000 7f2230ff9640 10 monclient: _finish_command 2 = system:0 2023-11-05T08:07:13.733 INFO:teuthology.orchestra.run.smithi052.stdout:68719476742 2023-11-05T08:07:13.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.730+0000 7f2239856640 10 librados: watch_flush enter 2023-11-05T08:07:13.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.730+0000 7f2239856640 10 librados: watch_flush exit 2023-11-05T08:07:13.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.730+0000 7f2239856640 20 client.4347.objecter shutdown clearing up homeless session... 2023-11-05T08:07:13.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.730+0000 7f2239856640 10 client.4347.objecter successfully canceled tick 2023-11-05T08:07:13.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.730+0000 7f2239856640 1 -- 172.21.15.52:0/2436792183 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f221406c850 msgr2=0x7f221406ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:13.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.730+0000 7f2239856640 1 --2- 172.21.15.52:0/2436792183 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f221406c850 0x7f221406ed10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f22240014e0 tx=0x7f2224007990 comp rx=0 tx=0).stop 2023-11-05T08:07:13.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.730+0000 7f2239856640 10 monclient: shutdown 2023-11-05T08:07:13.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.730+0000 7f2239856640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:07:13.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.730+0000 7f2239856640 1 -- 172.21.15.52:0/2436792183 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22340a9110 msgr2=0x7f22340a9b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:13.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.730+0000 7f2239856640 1 --2- 172.21.15.52:0/2436792183 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22340a9110 0x7f22340a9b00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f221c00cb00 tx=0x7f221c001d90 comp rx=0 tx=0).stop 2023-11-05T08:07:13.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.730+0000 7f2239856640 1 -- 172.21.15.52:0/2436792183 shutdown_connections 2023-11-05T08:07:13.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.730+0000 7f2239856640 1 --2- 172.21.15.52:0/2436792183 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f221406c850 0x7f221406ed10 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:13.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.730+0000 7f2239856640 1 --2- 172.21.15.52:0/2436792183 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f22341d7550 0x7f22340ac880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:13.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.730+0000 7f2239856640 1 --2- 172.21.15.52:0/2436792183 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22340a9110 0x7f22340a9b00 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:13.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.730+0000 7f2239856640 1 --2- 172.21.15.52:0/2436792183 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f22340a8d30 0x7f223413cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:13.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.730+0000 7f2239856640 1 -- 172.21.15.52:0/2436792183 >> 172.21.15.52:0/2436792183 conn(0x7f2234065cd0 msgr2=0x7f22341459a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:07:13.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.731+0000 7f2239856640 1 -- 172.21.15.52:0/2436792183 shutdown_connections 2023-11-05T08:07:13.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.731+0000 7f2239856640 1 -- 172.21.15.52:0/2436792183 wait complete. 2023-11-05T08:07:13.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.731+0000 7f2239856640 1 librados: shutdown 2023-11-05T08:07:13.743 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476742 got 68719476742 for osd.0 2023-11-05T08:07:13.744 DEBUG:teuthology.parallel:result is None 2023-11-05T08:07:13.795 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.793+0000 7ff3aa7fc640 1 -- 172.21.15.52:0/928833898 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff3a401a400 con 0x7ff3b40a8ec0 2023-11-05T08:07:13.795 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.794+0000 7ff3aa7fc640 1 --2- 172.21.15.52:0/928833898 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7ff39806c850 0x7ff39806ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:13.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.794+0000 7ff3b996c640 1 --2- 172.21.15.52:0/928833898 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7ff39806c850 0x7ff39806ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:13.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.794+0000 7ff3b996c640 10 monclient: get_auth_request con 0x7ff39806c850 auth_method 0 2023-11-05T08:07:13.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.795+0000 7ff3aa7fc640 10 client.4283.objecter ms_handle_connect 0x7ff39806c850 2023-11-05T08:07:13.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.795+0000 7ff3b996c640 1 --2- 172.21.15.52:0/928833898 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7ff39806c850 0x7ff39806ed10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff3ac009710 tx=0x7ff3ac006c80 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:13.798 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.796+0000 7f0fb2ffd640 1 -- 172.21.15.52:0/3740253282 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0fb402f050 con 0x7f0fc40a8ae0 2023-11-05T08:07:13.798 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.796+0000 7f0fb2ffd640 1 --2- 172.21.15.52:0/3740253282 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f0fa406c800 0x7f0fa406ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:13.798 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.796+0000 7f0fc1d9b640 1 --2- 172.21.15.52:0/3740253282 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f0fa406c800 0x7f0fa406ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:13.798 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.796+0000 7f0fc1d9b640 10 monclient: get_auth_request con 0x7f0fa406c800 auth_method 0 2023-11-05T08:07:13.798 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.796+0000 7f0fb2ffd640 10 client.4378.objecter ms_handle_connect 0x7f0fa406c800 2023-11-05T08:07:13.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.796+0000 7f0fc1d9b640 1 --2- 172.21.15.52:0/3740253282 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f0fa406c800 0x7f0fa406ecc0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0fc413e150 tx=0x7f0fb8007990 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:13.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.797+0000 7f698a7fc640 1 -- 172.21.15.52:0/2280017784 <== mon.2 v2:172.21.15.52:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6984034090 con 0x7f69940a8ec0 2023-11-05T08:07:13.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.797+0000 7f698a7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2023-11-05T08:07:13.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.797+0000 7f698a7fc640 10 monclient: _finish_command 2 = system:0 2023-11-05T08:07:13.802 INFO:teuthology.orchestra.run.smithi052.stdout:64424509444 2023-11-05T08:07:13.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.799+0000 7f0fb2ffd640 1 -- 172.21.15.52:0/3740253282 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f0fb407b4f0 con 0x7f0fc40a8ae0 2023-11-05T08:07:13.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.799+0000 7f0fb2ffd640 10 client.4378.objecter ms_dispatch 0x7f0fc4000b90 osd_map(23..23 src has 1..23) v4 2023-11-05T08:07:13.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.799+0000 7f0fb2ffd640 3 client.4378.objecter handle_osd_map got epochs [23,23] > 0 2023-11-05T08:07:13.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.799+0000 7f0fb2ffd640 3 client.4378.objecter handle_osd_map decoding full epoch 23 2023-11-05T08:07:13.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.799+0000 7f0fb2ffd640 20 client.4378.objecter dump_active .. 0 homeless 2023-11-05T08:07:13.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.799+0000 7f699bf97640 10 librados: watch_flush enter 2023-11-05T08:07:13.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.799+0000 7f699bf97640 10 librados: watch_flush exit 2023-11-05T08:07:13.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.799+0000 7f699bf97640 20 client.4277.objecter shutdown clearing up homeless session... 2023-11-05T08:07:13.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.799+0000 7f699bf97640 10 client.4277.objecter successfully canceled tick 2023-11-05T08:07:13.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.799+0000 7f699bf97640 1 -- 172.21.15.52:0/2280017784 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f697806c850 msgr2=0x7f697806ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:13.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.799+0000 7f699bf97640 1 --2- 172.21.15.52:0/2280017784 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f697806c850 0x7f697806ed10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6990006a30 tx=0x7f69900069c0 comp rx=0 tx=0).stop 2023-11-05T08:07:13.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.799+0000 7f699bf97640 10 monclient: shutdown 2023-11-05T08:07:13.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.799+0000 7f699bf97640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:07:13.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.799+0000 7f699bf97640 1 -- 172.21.15.52:0/2280017784 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f69940a8ec0 msgr2=0x7f69941d6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:13.807 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.799+0000 7f699bf97640 1 --2- 172.21.15.52:0/2280017784 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f69940a8ec0 0x7f69941d6210 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6984009960 tx=0x7f6984004730 comp rx=0 tx=0).stop 2023-11-05T08:07:13.807 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.800+0000 7f699bf97640 1 -- 172.21.15.52:0/2280017784 shutdown_connections 2023-11-05T08:07:13.807 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.800+0000 7f699bf97640 1 --2- 172.21.15.52:0/2280017784 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f697806c850 0x7f697806ed10 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:13.807 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.800+0000 7f699bf97640 1 --2- 172.21.15.52:0/2280017784 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69940b0de0 0x7f69941d6750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:13.807 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.800+0000 7f699bf97640 1 --2- 172.21.15.52:0/2280017784 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f69940a8ec0 0x7f69941d6210 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:13.808 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.800+0000 7f699bf97640 1 --2- 172.21.15.52:0/2280017784 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f69940a8ae0 0x7f699413e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:13.808 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.800+0000 7f699bf97640 1 -- 172.21.15.52:0/2280017784 >> 172.21.15.52:0/2280017784 conn(0x7f69940b7230 msgr2=0x7f6994139910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:07:13.808 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.800+0000 7f699bf97640 1 -- 172.21.15.52:0/2280017784 shutdown_connections 2023-11-05T08:07:13.808 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.800+0000 7f699bf97640 1 -- 172.21.15.52:0/2280017784 wait complete. 2023-11-05T08:07:13.808 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.800+0000 7f699bf97640 1 librados: shutdown 2023-11-05T08:07:13.810 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.808+0000 7ff3aa7fc640 1 -- 172.21.15.52:0/928833898 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5210+0+0 (secure 0 0 0) 0x7ff3a4059270 con 0x7ff3b40a8ec0 2023-11-05T08:07:13.810 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.808+0000 7ff3aa7fc640 10 client.4283.objecter ms_dispatch 0x7ff3b4000b90 osd_map(23..23 src has 1..23) v4 2023-11-05T08:07:13.810 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.808+0000 7ff3aa7fc640 3 client.4283.objecter handle_osd_map got epochs [23,23] > 0 2023-11-05T08:07:13.810 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.808+0000 7ff3aa7fc640 3 client.4283.objecter handle_osd_map decoding full epoch 23 2023-11-05T08:07:13.811 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.808+0000 7ff3aa7fc640 20 client.4283.objecter dump_active .. 0 homeless 2023-11-05T08:07:13.811 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.808+0000 7ff3aa7fc640 1 -- 172.21.15.52:0/928833898 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff3a4054eb0 con 0x7ff3b40a8ec0 2023-11-05T08:07:13.811 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.808+0000 7ff3aa7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:07:13.811 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.808+0000 7ff3aa7fc640 10 monclient: _finish_command 1 = system:0 2023-11-05T08:07:13.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.809+0000 7f0fb2ffd640 1 -- 172.21.15.52:0/3740253282 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0fb4077130 con 0x7f0fc40a8ae0 2023-11-05T08:07:13.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.809+0000 7f0fb2ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:07:13.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.809+0000 7f0fb2ffd640 10 monclient: _finish_command 1 = system:0 2023-11-05T08:07:13.813 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509444 for osd.1 2023-11-05T08:07:13.820 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.819+0000 7f852f7fe640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f85300a8ec0 0x7f853013f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:13.860 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.858+0000 7f852ffff640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f85300a8ae0 0x7f853013ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:13.862 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.861+0000 7f8534c01640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f85300b0de0 0x7f8530145000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.52:35540/0 (socket says 172.21.15.52:35540) 2023-11-05T08:07:13.862 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.861+0000 7f8534c01640 1 -- 172.21.15.52:0/1835675823 learned_addr learned my addr 172.21.15.52:0/1835675823 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-11-05T08:07:13.862 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.861+0000 7f852ffff640 10 monclient(hunting): get_auth_request con 0x7f85300a8ae0 auth_method 0 2023-11-05T08:07:13.863 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.861+0000 7f852ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:13.863 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.861+0000 7f852ffff640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:13.863 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.861+0000 7f852ffff640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:13.876 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.874+0000 7f852f7fe640 10 monclient(hunting): get_auth_request con 0x7f85300a8ec0 auth_method 0 2023-11-05T08:07:13.876 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.874+0000 7f852f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:13.876 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.874+0000 7f852f7fe640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:13.877 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.874+0000 7f852f7fe640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:13.880 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.878+0000 7f852f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:13.880 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.878+0000 7f852f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:13.880 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.878+0000 7f852f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:13.883 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.882+0000 7f852f7fe640 10 monclient(hunting): handle_auth_done global_id 4286 payload 274 2023-11-05T08:07:13.883 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.882+0000 7f852f7fe640 1 -- 172.21.15.52:0/1835675823 >> v2:172.21.15.156:3300/0 conn(0x7f85300a8ae0 msgr2=0x7f853013ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-05T08:07:13.883 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.882+0000 7f852f7fe640 1 --2- 172.21.15.52:0/1835675823 >> v2:172.21.15.156:3300/0 conn(0x7f85300a8ae0 0x7f853013ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:13.884 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.882+0000 7f852f7fe640 1 -- 172.21.15.52:0/1835675823 >> v1:172.21.15.156:6789/0 conn(0x7f85300b0de0 legacy=0x7f8530145000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-05T08:07:13.884 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.882+0000 7f852f7fe640 10 monclient: _finish_hunting 0 2023-11-05T08:07:13.884 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.882+0000 7f852f7fe640 1 monclient: found mon.noname-b 2023-11-05T08:07:13.884 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.882+0000 7f852f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:07:13.884 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.882+0000 7f852f7fe640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.52:3301/0 2023-11-05T08:07:13.885 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.882+0000 7f852f7fe640 1 -- 172.21.15.52:0/1835675823 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8530145710 con 0x7f85300a8ec0 2023-11-05T08:07:13.886 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.885+0000 7f852f7fe640 1 --2- 172.21.15.52:0/1835675823 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f85300a8ec0 0x7f853013f170 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f85240097a0 tx=0x7f852402b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a4cdeeb384af90a0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:13.892 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.890+0000 7f852effd640 1 -- 172.21.15.52:0/1835675823 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8524031830 con 0x7f85300a8ec0 2023-11-05T08:07:13.892 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.890+0000 7f852effd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:13.892 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.890+0000 7f852effd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-05T08:07:13.892 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.890+0000 7f852effd640 10 monclient: dump: 2023-11-05T08:07:13.892 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:13.893 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:13.893 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:13.893 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:13.893 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:13.893 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:13.894 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:13.894 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:13.894 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:13.894 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:13.894 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.890+0000 7f852effd640 10 monclient: _finish_auth 0 2023-11-05T08:07:13.895 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.890+0000 7f852effd640 10 monclient: _check_auth_tickets 2023-11-05T08:07:13.895 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.890+0000 7f852effd640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:07:13.895 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.890+0000 7f852effd640 1 -- 172.21.15.52:0/1835675823 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8524031990 con 0x7f85300a8ec0 2023-11-05T08:07:13.895 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.890+0000 7f8536664640 5 monclient: authenticate success, global_id 4286 2023-11-05T08:07:13.895 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.890+0000 7f8536664640 20 monclient: get_monmap_and_config waiting for monmap|config 2023-11-05T08:07:13.896 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.890+0000 7f852effd640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:07:13.896 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.890+0000 7f8536664640 10 monclient: get_monmap_and_config success 2023-11-05T08:07:13.896 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.890+0000 7f852effd640 1 -- 172.21.15.52:0/1835675823 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8524031d20 con 0x7f85300a8ec0 2023-11-05T08:07:13.896 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.890+0000 7f8536664640 4 set_mon_vals no callback set 2023-11-05T08:07:13.897 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.890+0000 7f852effd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:13.897 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.890+0000 7f852effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-11-05T08:07:13.897 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.890+0000 7f852effd640 10 monclient: dump: 2023-11-05T08:07:13.897 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:13.897 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:13.898 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:13.898 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:13.898 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:13.898 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:13.898 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:13.899 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:13.899 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:13.899 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:13.902 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.891+0000 7f8536664640 10 monclient: shutdown 2023-11-05T08:07:13.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.891+0000 7f8536664640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:07:13.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.891+0000 7f8536664640 1 -- 172.21.15.52:0/1835675823 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f85300a8ec0 msgr2=0x7f853013f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:13.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.891+0000 7f8536664640 1 --2- 172.21.15.52:0/1835675823 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f85300a8ec0 0x7f853013f170 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f85240097a0 tx=0x7f852402b8d0 comp rx=0 tx=0).stop 2023-11-05T08:07:13.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.891+0000 7f8536664640 1 -- 172.21.15.52:0/1835675823 shutdown_connections 2023-11-05T08:07:13.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.891+0000 7f8536664640 1 --2- 172.21.15.52:0/1835675823 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f85300a8ec0 0x7f853013f170 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:13.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.891+0000 7f8536664640 1 --2- 172.21.15.52:0/1835675823 >> v2:172.21.15.156:3300/0 conn(0x7f85300a8ae0 0x7f853013ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:13.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.891+0000 7f8536664640 1 -- 172.21.15.52:0/1835675823 >> 172.21.15.52:0/1835675823 conn(0x7f85300b7230 msgr2=0x7f85300b7610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:07:13.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.891+0000 7f8536664640 1 -- 172.21.15.52:0/1835675823 shutdown_connections 2023-11-05T08:07:13.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.891+0000 7f8536664640 1 -- 172.21.15.52:0/1835675823 wait complete. 2023-11-05T08:07:13.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.892+0000 7f8536664640 10 monclient: build_initial_monmap 2023-11-05T08:07:13.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.892+0000 7f8536664640 10 monclient: monmap: 2023-11-05T08:07:13.905 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:07:13.905 INFO:teuthology.orchestra.run.smithi052.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-05T08:07:13.905 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 0.000000 2023-11-05T08:07:13.905 INFO:teuthology.orchestra.run.smithi052.stderr:created 0.000000 2023-11-05T08:07:13.906 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:07:13.906 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:13.906 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.noname-a 2023-11-05T08:07:13.906 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.noname-b 2023-11-05T08:07:13.906 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-c 2023-11-05T08:07:13.907 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:13.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.892+0000 7f8536664640 1 librados: starting msgr at 2023-11-05T08:07:13.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.892+0000 7f8536664640 1 librados: starting objecter 2023-11-05T08:07:13.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.892+0000 7f8536664640 1 Processor -- start 2023-11-05T08:07:13.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.893+0000 7f8536664640 1 -- start start 2023-11-05T08:07:13.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.893+0000 7f8536664640 1 librados: setting wanted keys 2023-11-05T08:07:13.908 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.893+0000 7f8536664640 1 librados: calling monclient init 2023-11-05T08:07:13.908 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.893+0000 7f8536664640 10 monclient: init 2023-11-05T08:07:13.908 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.893+0000 7f8536664640 10 monclient: _reopen_session rank -1 2023-11-05T08:07:13.908 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.893+0000 7f8536664640 10 monclient: _add_conns ranks=[2,0,1] 2023-11-05T08:07:13.908 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.893+0000 7f8536664640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f85300a8ae0 0x7f8530142330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:13.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.893+0000 7f8536664640 10 monclient(hunting): picked mon.noname-c con 0x7f85300a8ae0 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:07:13.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.893+0000 7f8536664640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85300a8ec0 0x7f8530137c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:13.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.893+0000 7f8536664640 10 monclient(hunting): picked mon.noname-a con 0x7f85300a8ec0 addr [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] 2023-11-05T08:07:13.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.893+0000 7f8536664640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f85300b0de0 0x7f85301d6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:13.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.893+0000 7f8536664640 10 monclient(hunting): picked mon.noname-b con 0x7f85300b0de0 addr [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] 2023-11-05T08:07:13.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.893+0000 7f8536664640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:13.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.893+0000 7f8536664640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85301d6710 con 0x7f85300a8ec0 2023-11-05T08:07:13.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.893+0000 7f8536664640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:13.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.893+0000 7f8536664640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8530141ea0 con 0x7f85300b0de0 2023-11-05T08:07:13.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.893+0000 7f8536664640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:13.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.893+0000 7f8536664640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85301381d0 con 0x7f85300a8ae0 2023-11-05T08:07:13.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.893+0000 7f8536664640 10 monclient(hunting): _renew_subs 2023-11-05T08:07:13.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.893+0000 7f8536664640 10 monclient(hunting): authenticate will time out at 1380.099707s 2023-11-05T08:07:13.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.894+0000 7f852ffff640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f85300a8ae0 0x7f8530142330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:13.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.894+0000 7f852ffff640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f85300a8ae0 0x7f8530142330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.52:40500/0 (socket says 172.21.15.52:40500) 2023-11-05T08:07:13.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.894+0000 7f852ffff640 1 -- 172.21.15.52:0/2373126801 learned_addr learned my addr 172.21.15.52:0/2373126801 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-11-05T08:07:13.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.894+0000 7f852ffff640 10 monclient(hunting): get_auth_request con 0x7f85300a8ae0 auth_method 0 2023-11-05T08:07:13.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.894+0000 7f852ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:13.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.894+0000 7f852ffff640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:13.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.894+0000 7f852ffff640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:13.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.895+0000 7f852ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:13.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.895+0000 7f852ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:13.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.895+0000 7f852ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:13.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.899+0000 7f852ffff640 10 monclient(hunting): handle_auth_done global_id 4289 payload 824 2023-11-05T08:07:13.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.899+0000 7f852ffff640 1 -- 172.21.15.52:0/2373126801 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f85300b0de0 msgr2=0x7f85301d6ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:13.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.899+0000 7f852ffff640 1 --2- 172.21.15.52:0/2373126801 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f85300b0de0 0x7f85301d6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:13.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.899+0000 7f852ffff640 1 -- 172.21.15.52:0/2373126801 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85300a8ec0 msgr2=0x7f8530137c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:13.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.899+0000 7f852ffff640 1 --2- 172.21.15.52:0/2373126801 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85300a8ec0 0x7f8530137c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:13.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.899+0000 7f852ffff640 10 monclient: _finish_hunting 0 2023-11-05T08:07:13.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.899+0000 7f852ffff640 1 monclient: found mon.noname-c 2023-11-05T08:07:13.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.899+0000 7f852ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:07:13.915 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.899+0000 7f852ffff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.52:3301/0 2023-11-05T08:07:13.915 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.899+0000 7f852ffff640 1 -- 172.21.15.52:0/2373126801 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8524009400 con 0x7f85300a8ae0 2023-11-05T08:07:13.916 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.902+0000 7f852ffff640 1 --2- 172.21.15.52:0/2373126801 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f85300a8ae0 0x7f8530142330 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f852000d800 tx=0x7f852000dcc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:13.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.902+0000 7f852cff9640 10 client.?.objecter ms_handle_connect 0x7f85300a8ae0 2023-11-05T08:07:13.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.902+0000 7f852cff9640 10 client.?.objecter resend_mon_ops 2023-11-05T08:07:13.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.907+0000 7f852cff9640 1 -- 172.21.15.52:0/2373126801 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f852000b6c0 con 0x7f85300a8ae0 2023-11-05T08:07:13.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.907+0000 7f852cff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:13.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.907+0000 7f852cff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-11-05T08:07:13.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.907+0000 7f852cff9640 10 monclient: dump: 2023-11-05T08:07:13.918 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:13.918 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:13.918 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:13.918 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:13.919 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:13.919 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:13.919 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:13.919 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:13.919 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:13.920 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:13.920 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.907+0000 7f852cff9640 10 monclient: _finish_auth 0 2023-11-05T08:07:13.920 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.907+0000 7f852cff9640 10 monclient: _check_auth_tickets 2023-11-05T08:07:13.920 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.907+0000 7f852cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:07:13.920 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.907+0000 7f852cff9640 1 -- 172.21.15.52:0/2373126801 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f852000b820 con 0x7f85300a8ae0 2023-11-05T08:07:13.920 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.907+0000 7f8536664640 5 monclient: authenticate success, global_id 4289 2023-11-05T08:07:13.921 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.907+0000 7f8536664640 10 monclient: _renew_subs 2023-11-05T08:07:13.921 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.907+0000 7f8536664640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.52:3301/0 2023-11-05T08:07:13.921 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.907+0000 7f8536664640 1 -- 172.21.15.52:0/2373126801 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85301411f0 con 0x7f85300a8ae0 2023-11-05T08:07:13.921 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.907+0000 7f852cff9640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:07:13.921 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.907+0000 7f852cff9640 1 -- 172.21.15.52:0/2373126801 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f852000bbd0 con 0x7f85300a8ae0 2023-11-05T08:07:13.922 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.907+0000 7f852e7fc640 4 set_mon_vals no callback set 2023-11-05T08:07:13.922 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.907+0000 7f852cff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:13.922 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.907+0000 7f852cff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-11-05T08:07:13.922 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.907+0000 7f8536664640 10 client.4289.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-05T08:07:13.922 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.907+0000 7f852cff9640 10 monclient: dump: 2023-11-05T08:07:13.923 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:13.923 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:13.923 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:13.923 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:13.923 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:13.924 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:13.924 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:13.924 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:13.924 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:13.924 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:13.924 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.907+0000 7f8536664640 10 monclient: _renew_subs 2023-11-05T08:07:13.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.907+0000 7f8536664640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.52:3301/0 2023-11-05T08:07:13.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.907+0000 7f8536664640 1 -- 172.21.15.52:0/2373126801 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f853013f930 con 0x7f85300a8ae0 2023-11-05T08:07:13.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.907+0000 7f8536664640 1 librados: init done 2023-11-05T08:07:13.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.908+0000 7f8536664640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-05T08:07:13.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.908+0000 7f8536664640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:07:13.926 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.908+0000 7f8536664640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.52:3301/0 2023-11-05T08:07:13.926 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:13.908+0000 7f8536664640 1 -- 172.21.15.52:0/2373126801 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f853004e9f0 con 0x7f85300a8ae0 2023-11-05T08:07:14.001 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.000+0000 7f0fc8b1d640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 5}] 2023-11-05T08:07:14.002 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.000+0000 7f0fc8b1d640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2023-11-05T08:07:14.002 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.000+0000 7f0fc8b1d640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:07:14.002 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.000+0000 7f0fc8b1d640 1 -- 172.21.15.52:0/3740253282 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f0fc41430d0 con 0x7f0fc40a8ae0 2023-11-05T08:07:14.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.011+0000 7ff3bbbd0640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 2}] 2023-11-05T08:07:14.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.011+0000 7ff3bbbd0640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2023-11-05T08:07:14.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.011+0000 7ff3bbbd0640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.52:3301/0 2023-11-05T08:07:14.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.011+0000 7ff3bbbd0640 1 -- 172.21.15.52:0/928833898 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff3b404e9f0 con 0x7ff3b40a8ec0 2023-11-05T08:07:14.103 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.102+0000 7fba9e7fc640 1 -- 172.21.15.52:0/589837096 <== mon.1 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbaa813d600 con 0x7fbaa80a8ec0 2023-11-05T08:07:14.104 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.102+0000 7fba9e7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 6}] 2023-11-05T08:07:14.104 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.102+0000 7fba9e7fc640 10 monclient: _finish_command 2 = system:0 2023-11-05T08:07:14.104 INFO:teuthology.orchestra.run.smithi052.stdout:55834574853 2023-11-05T08:07:14.105 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.103+0000 7f0fb2ffd640 1 -- 172.21.15.52:0/3740253282 <== mon.1 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0fb407a750 con 0x7f0fc40a8ae0 2023-11-05T08:07:14.105 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.103+0000 7f0fb2ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2023-11-05T08:07:14.105 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.103+0000 7f0fb2ffd640 10 monclient: _finish_command 2 = system:0 2023-11-05T08:07:14.106 INFO:teuthology.orchestra.run.smithi052.stdout:60129542149 2023-11-05T08:07:14.106 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.105+0000 7fbaafafc640 10 librados: watch_flush enter 2023-11-05T08:07:14.107 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.105+0000 7fbaafafc640 10 librados: watch_flush exit 2023-11-05T08:07:14.107 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.105+0000 7fbaafafc640 20 client.4366.objecter shutdown clearing up homeless session... 2023-11-05T08:07:14.107 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.105+0000 7fbaafafc640 10 client.4366.objecter successfully canceled tick 2023-11-05T08:07:14.107 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.105+0000 7fbaafafc640 1 -- 172.21.15.52:0/589837096 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7fba8c06c850 msgr2=0x7fba8c06ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:14.108 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.105+0000 7fbaafafc640 1 --2- 172.21.15.52:0/589837096 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7fba8c06c850 0x7fba8c06ed10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fbaa4009670 tx=0x7fbaa4006be0 comp rx=0 tx=0).stop 2023-11-05T08:07:14.108 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.105+0000 7fbaafafc640 10 monclient: shutdown 2023-11-05T08:07:14.108 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.105+0000 7fbaafafc640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:07:14.108 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.105+0000 7fbaafafc640 1 -- 172.21.15.52:0/589837096 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbaa80a8ec0 msgr2=0x7fbaa812d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:14.108 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.105+0000 7fbaafafc640 1 --2- 172.21.15.52:0/589837096 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbaa80a8ec0 0x7fbaa812d670 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fba9800b3f0 tx=0x7fba9800b8b0 comp rx=0 tx=0).stop 2023-11-05T08:07:14.109 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.106+0000 7fbaafafc640 1 -- 172.21.15.52:0/589837096 shutdown_connections 2023-11-05T08:07:14.110 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.106+0000 7fbaafafc640 1 --2- 172.21.15.52:0/589837096 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7fba8c06c850 0x7fba8c06ed10 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:14.110 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.106+0000 7fbaafafc640 1 --2- 172.21.15.52:0/589837096 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbaa80b0de0 0x7fbaa80b67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:14.110 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.106+0000 7fbaafafc640 1 --2- 172.21.15.52:0/589837096 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbaa80a8ec0 0x7fbaa812d670 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:14.110 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.106+0000 7fbaafafc640 1 --2- 172.21.15.52:0/589837096 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbaa80a8ae0 0x7fbaa813e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:14.110 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.106+0000 7fbaafafc640 1 -- 172.21.15.52:0/589837096 >> 172.21.15.52:0/589837096 conn(0x7fbaa80b7230 msgr2=0x7fbaa8142170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:07:14.111 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.106+0000 7fbaafafc640 1 -- 172.21.15.52:0/589837096 shutdown_connections 2023-11-05T08:07:14.111 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.106+0000 7fbaafafc640 1 -- 172.21.15.52:0/589837096 wait complete. 2023-11-05T08:07:14.111 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.106+0000 7fbaafafc640 1 librados: shutdown 2023-11-05T08:07:14.112 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.106+0000 7f0fc8b1d640 10 librados: watch_flush enter 2023-11-05T08:07:14.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.106+0000 7f0fc8b1d640 10 librados: watch_flush exit 2023-11-05T08:07:14.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.106+0000 7f0fc8b1d640 20 client.4378.objecter shutdown clearing up homeless session... 2023-11-05T08:07:14.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.106+0000 7f0fc8b1d640 10 client.4378.objecter successfully canceled tick 2023-11-05T08:07:14.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.106+0000 7f0fc8b1d640 1 -- 172.21.15.52:0/3740253282 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f0fa406c800 msgr2=0x7f0fa406ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:14.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.106+0000 7f0fc8b1d640 1 --2- 172.21.15.52:0/3740253282 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f0fa406c800 0x7f0fa406ecc0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0fc413e150 tx=0x7f0fb8007990 comp rx=0 tx=0).stop 2023-11-05T08:07:14.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.106+0000 7f0fc8b1d640 10 monclient: shutdown 2023-11-05T08:07:14.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.106+0000 7f0fc8b1d640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:07:14.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.106+0000 7f0fc8b1d640 1 -- 172.21.15.52:0/3740253282 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0fc40a8ae0 msgr2=0x7f0fc413da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:14.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.106+0000 7f0fc8b1d640 1 --2- 172.21.15.52:0/3740253282 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0fc40a8ae0 0x7f0fc413da80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0fb40090b0 tx=0x7f0fb40046c0 comp rx=0 tx=0).stop 2023-11-05T08:07:14.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.106+0000 7f0fc8b1d640 1 -- 172.21.15.52:0/3740253282 shutdown_connections 2023-11-05T08:07:14.115 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.106+0000 7f0fc8b1d640 1 --2- 172.21.15.52:0/3740253282 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f0fa406c800 0x7f0fa406ecc0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:14.115 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.106+0000 7f0fc8b1d640 1 --2- 172.21.15.52:0/3740253282 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0fc40b0de0 0x7f0fc4131fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:14.115 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.106+0000 7f0fc8b1d640 1 --2- 172.21.15.52:0/3740253282 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0fc40a8ec0 0x7f0fc4131a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:14.115 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.106+0000 7f0fc8b1d640 1 --2- 172.21.15.52:0/3740253282 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0fc40a8ae0 0x7f0fc413da80 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:14.115 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.106+0000 7f0fc8b1d640 1 -- 172.21.15.52:0/3740253282 >> 172.21.15.52:0/3740253282 conn(0x7f0fc40b7230 msgr2=0x7f0fc41418e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:07:14.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.107+0000 7f0fc8b1d640 1 -- 172.21.15.52:0/3740253282 shutdown_connections 2023-11-05T08:07:14.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.107+0000 7f0fc8b1d640 1 -- 172.21.15.52:0/3740253282 wait complete. 2023-11-05T08:07:14.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.107+0000 7f0fc8b1d640 1 librados: shutdown 2023-11-05T08:07:14.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.119+0000 7f2dfbfff640 1 -- 172.21.15.52:0/1907260947 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f2e0804d3f0 con 0x7f2e140b4240 2023-11-05T08:07:14.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.120+0000 7f2dfbfff640 1 --2- 172.21.15.52:0/1907260947 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f2e0006c850 0x7f2e0006ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:14.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.120+0000 7f2e12ffd640 1 --2- 172.21.15.52:0/1907260947 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f2e0006c850 0x7f2e0006ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:14.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.120+0000 7f2e12ffd640 10 monclient: get_auth_request con 0x7f2e0006c850 auth_method 0 2023-11-05T08:07:14.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.120+0000 7f2e12ffd640 1 --2- 172.21.15.52:0/1907260947 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f2e0006c850 0x7f2e0006ed10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2e04009670 tx=0x7f2e04006be0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:14.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.120+0000 7f2dfbfff640 10 client.4375.objecter ms_handle_connect 0x7f2e0006c850 2023-11-05T08:07:14.124 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574853 for osd.6 2023-11-05T08:07:14.125 DEBUG:teuthology.parallel:result is None 2023-11-05T08:07:14.126 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.5 2023-11-05T08:07:14.126 DEBUG:teuthology.parallel:result is None 2023-11-05T08:07:14.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.123+0000 7f2dfbfff640 1 -- 172.21.15.52:0/1907260947 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f2e0807aba0 con 0x7f2e140b4240 2023-11-05T08:07:14.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.123+0000 7f2dfbfff640 10 client.4375.objecter ms_dispatch 0x7f2e14000b90 osd_map(23..23 src has 1..23) v4 2023-11-05T08:07:14.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.123+0000 7f2dfbfff640 3 client.4375.objecter handle_osd_map got epochs [23,23] > 0 2023-11-05T08:07:14.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.123+0000 7f2dfbfff640 3 client.4375.objecter handle_osd_map decoding full epoch 23 2023-11-05T08:07:14.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.123+0000 7f2dfbfff640 20 client.4375.objecter dump_active .. 0 homeless 2023-11-05T08:07:14.135 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.134+0000 7f2dfbfff640 1 -- 172.21.15.52:0/1907260947 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2e080767e0 con 0x7f2e140b4240 2023-11-05T08:07:14.136 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.134+0000 7f2dfbfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:07:14.136 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.134+0000 7f2dfbfff640 10 monclient: _finish_command 1 = system:0 2023-11-05T08:07:14.214 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.213+0000 7f852cff9640 1 -- 172.21.15.52:0/2373126801 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f852000bd30 con 0x7f85300a8ae0 2023-11-05T08:07:14.214 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.213+0000 7f852cff9640 1 --2- 172.21.15.52:0/2373126801 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f851c06c800 0x7f851c06ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:14.215 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.213+0000 7f852f7fe640 1 --2- 172.21.15.52:0/2373126801 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f851c06c800 0x7f851c06ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:14.215 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.213+0000 7f852f7fe640 10 monclient: get_auth_request con 0x7f851c06c800 auth_method 0 2023-11-05T08:07:14.216 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.214+0000 7f852cff9640 10 client.4289.objecter ms_handle_connect 0x7f851c06c800 2023-11-05T08:07:14.216 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.214+0000 7f852f7fe640 1 --2- 172.21.15.52:0/2373126801 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f851c06c800 0x7f851c06ecc0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8524036000 tx=0x7f8524030000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:14.227 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.226+0000 7f852cff9640 1 -- 172.21.15.52:0/2373126801 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f8520059b30 con 0x7f85300a8ae0 2023-11-05T08:07:14.228 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.226+0000 7f852cff9640 10 client.4289.objecter ms_dispatch 0x7f8530000b90 osd_map(23..23 src has 1..23) v4 2023-11-05T08:07:14.228 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.226+0000 7f852cff9640 3 client.4289.objecter handle_osd_map got epochs [23,23] > 0 2023-11-05T08:07:14.228 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.226+0000 7f852cff9640 3 client.4289.objecter handle_osd_map decoding full epoch 23 2023-11-05T08:07:14.228 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.226+0000 7f852cff9640 20 client.4289.objecter dump_active .. 0 homeless 2023-11-05T08:07:14.228 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.226+0000 7f852cff9640 1 -- 172.21.15.52:0/2373126801 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8520055770 con 0x7f85300a8ae0 2023-11-05T08:07:14.229 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.226+0000 7f852cff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:07:14.229 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.226+0000 7f852cff9640 10 monclient: _finish_command 1 = system:0 2023-11-05T08:07:14.310 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.308+0000 7ff3aa7fc640 1 -- 172.21.15.52:0/928833898 <== mon.2 v2:172.21.15.52:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff3a4015020 con 0x7ff3b40a8ec0 2023-11-05T08:07:14.310 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.308+0000 7ff3aa7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2023-11-05T08:07:14.310 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.308+0000 7ff3aa7fc640 10 monclient: _finish_command 2 = system:0 2023-11-05T08:07:14.311 INFO:teuthology.orchestra.run.smithi052.stdout:64424509446 2023-11-05T08:07:14.313 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.311+0000 7ff3bbbd0640 10 librados: watch_flush enter 2023-11-05T08:07:14.314 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.312+0000 7ff3bbbd0640 10 librados: watch_flush exit 2023-11-05T08:07:14.314 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.312+0000 7ff3bbbd0640 20 client.4283.objecter shutdown clearing up homeless session... 2023-11-05T08:07:14.314 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.312+0000 7ff3bbbd0640 10 client.4283.objecter successfully canceled tick 2023-11-05T08:07:14.314 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.312+0000 7ff3bbbd0640 1 -- 172.21.15.52:0/928833898 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7ff39806c850 msgr2=0x7ff39806ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:14.314 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.312+0000 7ff3bbbd0640 1 --2- 172.21.15.52:0/928833898 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7ff39806c850 0x7ff39806ed10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff3ac009710 tx=0x7ff3ac006c80 comp rx=0 tx=0).stop 2023-11-05T08:07:14.315 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.312+0000 7ff3bbbd0640 10 monclient: shutdown 2023-11-05T08:07:14.315 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.312+0000 7ff3bbbd0640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:07:14.315 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.312+0000 7ff3bbbd0640 1 -- 172.21.15.52:0/928833898 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff3b40a8ec0 msgr2=0x7ff3b4140130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:14.315 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.312+0000 7ff3bbbd0640 1 --2- 172.21.15.52:0/928833898 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff3b40a8ec0 0x7ff3b4140130 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff3a400b450 tx=0x7ff3a400b910 comp rx=0 tx=0).stop 2023-11-05T08:07:14.316 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.312+0000 7ff3bbbd0640 1 -- 172.21.15.52:0/928833898 shutdown_connections 2023-11-05T08:07:14.316 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.312+0000 7ff3bbbd0640 1 --2- 172.21.15.52:0/928833898 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7ff39806c850 0x7ff39806ed10 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:14.316 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.312+0000 7ff3bbbd0640 1 --2- 172.21.15.52:0/928833898 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3b40b0de0 0x7ff3b41421b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:14.316 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.312+0000 7ff3bbbd0640 1 --2- 172.21.15.52:0/928833898 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff3b40a8ec0 0x7ff3b4140130 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:14.316 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.312+0000 7ff3bbbd0640 1 --2- 172.21.15.52:0/928833898 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff3b40a8ae0 0x7ff3b413e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:14.316 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.312+0000 7ff3bbbd0640 1 -- 172.21.15.52:0/928833898 >> 172.21.15.52:0/928833898 conn(0x7ff3b40b7230 msgr2=0x7ff3b4139980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:07:14.317 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.312+0000 7ff3bbbd0640 1 -- 172.21.15.52:0/928833898 shutdown_connections 2023-11-05T08:07:14.317 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.312+0000 7ff3bbbd0640 1 -- 172.21.15.52:0/928833898 wait complete. 2023-11-05T08:07:14.317 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.312+0000 7ff3bbbd0640 1 librados: shutdown 2023-11-05T08:07:14.326 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.2 2023-11-05T08:07:14.328 DEBUG:teuthology.parallel:result is None 2023-11-05T08:07:14.373 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.372+0000 7f2e1984b640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 3}] 2023-11-05T08:07:14.374 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.372+0000 7f2e1984b640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2023-11-05T08:07:14.374 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.372+0000 7f2e1984b640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:07:14.374 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.372+0000 7f2e1984b640 1 -- 172.21.15.52:0/1907260947 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2e1413ea00 con 0x7f2e140b4240 2023-11-05T08:07:14.377 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.375+0000 7f2dfbfff640 1 -- 172.21.15.52:0/1907260947 <== mon.1 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2e08079e00 con 0x7f2e140b4240 2023-11-05T08:07:14.377 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.375+0000 7f2dfbfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2023-11-05T08:07:14.377 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.375+0000 7f2dfbfff640 10 monclient: _finish_command 2 = system:0 2023-11-05T08:07:14.377 INFO:teuthology.orchestra.run.smithi052.stdout:64424509445 2023-11-05T08:07:14.380 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.378+0000 7f2e1984b640 10 librados: watch_flush enter 2023-11-05T08:07:14.380 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.378+0000 7f2e1984b640 10 librados: watch_flush exit 2023-11-05T08:07:14.380 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.378+0000 7f2e1984b640 20 client.4375.objecter shutdown clearing up homeless session... 2023-11-05T08:07:14.380 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.378+0000 7f2e1984b640 10 client.4375.objecter successfully canceled tick 2023-11-05T08:07:14.380 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.378+0000 7f2e1984b640 1 -- 172.21.15.52:0/1907260947 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f2e0006c850 msgr2=0x7f2e0006ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:14.381 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.378+0000 7f2e1984b640 1 --2- 172.21.15.52:0/1907260947 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f2e0006c850 0x7f2e0006ed10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2e04009670 tx=0x7f2e04006be0 comp rx=0 tx=0).stop 2023-11-05T08:07:14.381 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.378+0000 7f2e1984b640 10 monclient: shutdown 2023-11-05T08:07:14.381 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.378+0000 7f2e1984b640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:07:14.381 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.378+0000 7f2e1984b640 1 -- 172.21.15.52:0/1907260947 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2e140b4240 msgr2=0x7f2e1413d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:14.381 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.378+0000 7f2e1984b640 1 --2- 172.21.15.52:0/1907260947 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2e140b4240 0x7f2e1413d2f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2e08000c00 tx=0x7f2e080046c0 comp rx=0 tx=0).stop 2023-11-05T08:07:14.382 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.378+0000 7f2e1984b640 1 -- 172.21.15.52:0/1907260947 shutdown_connections 2023-11-05T08:07:14.382 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.378+0000 7f2e1984b640 1 --2- 172.21.15.52:0/1907260947 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f2e0006c850 0x7f2e0006ed10 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:14.382 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.378+0000 7f2e1984b640 1 --2- 172.21.15.52:0/1907260947 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2e1413d830 0x7f2e141de1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:14.382 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.378+0000 7f2e1984b640 1 --2- 172.21.15.52:0/1907260947 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2e140b4240 0x7f2e1413d2f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:14.382 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.378+0000 7f2e1984b640 1 --2- 172.21.15.52:0/1907260947 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2e140ade00 0x7f2e1406dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:14.383 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.378+0000 7f2e1984b640 1 -- 172.21.15.52:0/1907260947 >> 172.21.15.52:0/1907260947 conn(0x7f2e14065cd0 msgr2=0x7f2e140b1ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:07:14.383 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.378+0000 7f2e1984b640 1 -- 172.21.15.52:0/1907260947 shutdown_connections 2023-11-05T08:07:14.383 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.378+0000 7f2e1984b640 1 -- 172.21.15.52:0/1907260947 wait complete. 2023-11-05T08:07:14.383 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.378+0000 7f2e1984b640 1 librados: shutdown 2023-11-05T08:07:14.390 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509445 for osd.3 2023-11-05T08:07:14.390 DEBUG:teuthology.parallel:result is None 2023-11-05T08:07:14.440 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.439+0000 7f8536664640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 7}] 2023-11-05T08:07:14.441 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.439+0000 7f8536664640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 7}] 2023-11-05T08:07:14.441 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.439+0000 7f8536664640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.52:3301/0 2023-11-05T08:07:14.441 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.439+0000 7f8536664640 1 -- 172.21.15.52:0/2373126801 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f853013e690 con 0x7f85300a8ae0 2023-11-05T08:07:14.444 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.443+0000 7f852cff9640 1 -- 172.21.15.52:0/2373126801 <== mon.2 v2:172.21.15.52:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8520058d90 con 0x7f85300a8ae0 2023-11-05T08:07:14.444 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.443+0000 7f852cff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 7}] 2023-11-05T08:07:14.445 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.443+0000 7f852cff9640 10 monclient: _finish_command 2 = system:0 2023-11-05T08:07:14.445 INFO:teuthology.orchestra.run.smithi052.stdout:60129542149 2023-11-05T08:07:14.447 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.445+0000 7f8536664640 10 librados: watch_flush enter 2023-11-05T08:07:14.447 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.445+0000 7f8536664640 10 librados: watch_flush exit 2023-11-05T08:07:14.448 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.445+0000 7f8536664640 20 client.4289.objecter shutdown clearing up homeless session... 2023-11-05T08:07:14.448 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.445+0000 7f8536664640 10 client.4289.objecter successfully canceled tick 2023-11-05T08:07:14.448 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.445+0000 7f8536664640 1 -- 172.21.15.52:0/2373126801 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f851c06c800 msgr2=0x7f851c06ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:14.448 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.445+0000 7f8536664640 1 --2- 172.21.15.52:0/2373126801 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f851c06c800 0x7f851c06ecc0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8524036000 tx=0x7f8524030000 comp rx=0 tx=0).stop 2023-11-05T08:07:14.448 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.445+0000 7f8536664640 10 monclient: shutdown 2023-11-05T08:07:14.449 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.445+0000 7f8536664640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:07:14.449 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.445+0000 7f8536664640 1 -- 172.21.15.52:0/2373126801 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f85300a8ae0 msgr2=0x7f8530142330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:14.449 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.445+0000 7f8536664640 1 --2- 172.21.15.52:0/2373126801 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f85300a8ae0 0x7f8530142330 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f852000d800 tx=0x7f852000dcc0 comp rx=0 tx=0).stop 2023-11-05T08:07:14.449 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.445+0000 7f8536664640 1 -- 172.21.15.52:0/2373126801 shutdown_connections 2023-11-05T08:07:14.449 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.445+0000 7f8536664640 1 --2- 172.21.15.52:0/2373126801 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f851c06c800 0x7f851c06ecc0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:14.449 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.445+0000 7f8536664640 1 --2- 172.21.15.52:0/2373126801 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f85300b0de0 0x7f85301d6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:14.450 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.445+0000 7f8536664640 1 --2- 172.21.15.52:0/2373126801 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85300a8ec0 0x7f8530137c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:14.450 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.445+0000 7f8536664640 1 --2- 172.21.15.52:0/2373126801 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f85300a8ae0 0x7f8530142330 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:14.450 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.445+0000 7f8536664640 1 -- 172.21.15.52:0/2373126801 >> 172.21.15.52:0/2373126801 conn(0x7f85300b7230 msgr2=0x7f8530136d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:07:14.450 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.445+0000 7f8536664640 1 -- 172.21.15.52:0/2373126801 shutdown_connections 2023-11-05T08:07:14.450 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.445+0000 7f8536664640 1 -- 172.21.15.52:0/2373126801 wait complete. 2023-11-05T08:07:14.451 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.445+0000 7f8536664640 1 librados: shutdown 2023-11-05T08:07:14.458 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.7 2023-11-05T08:07:14.458 DEBUG:teuthology.parallel:result is None 2023-11-05T08:07:14.578 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-05T08:07:14.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.686+0000 7f0b923ce640 10 monclient: get_monmap_and_config 2023-11-05T08:07:14.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.686+0000 7f0b923ce640 10 monclient: build_initial_monmap 2023-11-05T08:07:14.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.687+0000 7f0b923ce640 10 monclient: monmap: 2023-11-05T08:07:14.689 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:07:14.689 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:14.689 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:07:14.688520+0000 2023-11-05T08:07:14.689 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:07:14.688520+0000 2023-11-05T08:07:14.689 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:07:14.690 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:14.690 INFO:teuthology.orchestra.run.smithi052.stderr:0: v1:172.21.15.52:6789/0 mon.noname-a-legacy 2023-11-05T08:07:14.690 INFO:teuthology.orchestra.run.smithi052.stderr:1: v1:172.21.15.156:6789/0 mon.noname-c-legacy 2023-11-05T08:07:14.690 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-b 2023-11-05T08:07:14.690 INFO:teuthology.orchestra.run.smithi052.stderr:3: v2:172.21.15.52:3300/0 mon.noname-a 2023-11-05T08:07:14.691 INFO:teuthology.orchestra.run.smithi052.stderr:4: v2:172.21.15.156:3300/0 mon.noname-c 2023-11-05T08:07:14.691 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:14.692 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.687+0000 7f0b923ce640 1 Processor -- start 2023-11-05T08:07:14.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.687+0000 7f0b923ce640 1 -- start start 2023-11-05T08:07:14.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.687+0000 7f0b923ce640 10 monclient: init 2023-11-05T08:07:14.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.688+0000 7f0b923ce640 10 monclient: _reopen_session rank -1 2023-11-05T08:07:14.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.688+0000 7f0b923ce640 10 monclient: _add_conns ranks=[1,3,4,0,2] 2023-11-05T08:07:14.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.688+0000 7f0b923ce640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f0b8c0a8720 addr v1:172.21.15.156:6789/0 2023-11-05T08:07:14.694 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.688+0000 7f0b923ce640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0b8c141a80 0x7f0b8c0b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:14.694 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.688+0000 7f0b923ce640 10 monclient(hunting): picked mon.noname-a con 0x7f0b8c141a80 addr v2:172.21.15.52:3300/0 2023-11-05T08:07:14.694 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.688+0000 7f0b923ce640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f0b8c13ebf0 0x7f0b8c13f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:14.694 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.688+0000 7f0b923ce640 10 monclient(hunting): picked mon.noname-c con 0x7f0b8c13ebf0 addr v2:172.21.15.156:3300/0 2023-11-05T08:07:14.694 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.688+0000 7f0b923ce640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b8c141fa0 con 0x7f0b8c0a8720 2023-11-05T08:07:14.695 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.688+0000 7f0b923ce640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:14.695 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.688+0000 7f0b923ce640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b8c0a8b00 con 0x7f0b8c141a80 2023-11-05T08:07:14.695 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.688+0000 7f0b923ce640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:14.695 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.688+0000 7f0b923ce640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b8c0aa500 con 0x7f0b8c13ebf0 2023-11-05T08:07:14.695 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.688+0000 7f0b923ce640 10 monclient(hunting): _renew_subs 2023-11-05T08:07:14.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.688+0000 7f0b923ce640 10 monclient(hunting): authenticate will time out at 1380.894315s 2023-11-05T08:07:14.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.689+0000 7f0b9096b640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f0b8c13ebf0 0x7f0b8c13f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:14.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.689+0000 7f0b8b7fe640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0b8c141a80 0x7f0b8c0b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:14.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.689+0000 7f0b8bfff640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f0b8c0a8720 0x7f0b8c142430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.52:35548/0 (socket says 172.21.15.52:35548) 2023-11-05T08:07:14.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.689+0000 7f0b8bfff640 1 -- 172.21.15.52:0/2057846615 learned_addr learned my addr 172.21.15.52:0/2057846615 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-11-05T08:07:14.697 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.689+0000 7f0b8b7fe640 10 monclient(hunting): get_auth_request con 0x7f0b8c141a80 auth_method 0 2023-11-05T08:07:14.697 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.689+0000 7f0b8b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:14.697 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.689+0000 7f0b8b7fe640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:14.697 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.689+0000 7f0b8b7fe640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:14.697 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.689+0000 7f0b9096b640 10 monclient(hunting): get_auth_request con 0x7f0b8c13ebf0 auth_method 0 2023-11-05T08:07:14.698 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.689+0000 7f0b9096b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:14.698 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.689+0000 7f0b9096b640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:14.698 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.689+0000 7f0b9096b640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:14.698 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.689+0000 7f0b8b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:14.698 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.689+0000 7f0b8b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:14.699 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.689+0000 7f0b8b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:14.699 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.690+0000 7f0b9096b640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:14.699 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.690+0000 7f0b9096b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:14.699 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.690+0000 7f0b9096b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:14.701 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.692+0000 7f0b8b7fe640 10 monclient(hunting): handle_auth_done global_id 4350 payload 274 2023-11-05T08:07:14.702 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.692+0000 7f0b8b7fe640 1 -- 172.21.15.52:0/2057846615 >> v2:172.21.15.156:3300/0 conn(0x7f0b8c13ebf0 msgr2=0x7f0b8c13f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-05T08:07:14.702 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.692+0000 7f0b8b7fe640 1 --2- 172.21.15.52:0/2057846615 >> v2:172.21.15.156:3300/0 conn(0x7f0b8c13ebf0 0x7f0b8c13f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:14.702 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.692+0000 7f0b8b7fe640 1 -- 172.21.15.52:0/2057846615 >> v1:172.21.15.156:6789/0 conn(0x7f0b8c0a8720 legacy=0x7f0b8c142430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:14.702 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.692+0000 7f0b8b7fe640 10 monclient: _finish_hunting 0 2023-11-05T08:07:14.702 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.692+0000 7f0b8b7fe640 1 monclient: found mon.noname-a 2023-11-05T08:07:14.703 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.692+0000 7f0b8b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:07:14.703 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.692+0000 7f0b8b7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.52:3300/0 2023-11-05T08:07:14.703 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.692+0000 7f0b8b7fe640 1 -- 172.21.15.52:0/2057846615 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b8c0aa770 con 0x7f0b8c141a80 2023-11-05T08:07:14.703 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.694+0000 7f0b8b7fe640 1 --2- 172.21.15.52:0/2057846615 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b8c141a80 0x7f0b8c0b1c00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0b8c0721b0 tx=0x7f0b7c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f08b4452cc4708c server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:14.703 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.698+0000 7f0b8affd640 1 -- 172.21.15.52:0/2057846615 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b7c02e070 con 0x7f0b8c141a80 2023-11-05T08:07:14.704 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.698+0000 7f0b8affd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:14.704 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.698+0000 7f0b8affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-11-05T08:07:14.704 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.698+0000 7f0b8affd640 10 monclient: dump: 2023-11-05T08:07:14.704 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:14.704 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:14.705 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:14.705 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:14.705 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:14.705 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:14.705 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:14.706 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:14.706 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:14.706 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:14.706 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.698+0000 7f0b8affd640 10 monclient: _finish_auth 0 2023-11-05T08:07:14.706 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.698+0000 7f0b8affd640 10 monclient: _check_auth_tickets 2023-11-05T08:07:14.706 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.698+0000 7f0b8affd640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:07:14.707 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.698+0000 7f0b8affd640 1 -- 172.21.15.52:0/2057846615 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b7c0315a0 con 0x7f0b8c141a80 2023-11-05T08:07:14.707 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.698+0000 7f0b8affd640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:07:14.707 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.698+0000 7f0b8affd640 1 -- 172.21.15.52:0/2057846615 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b7c031930 con 0x7f0b8c141a80 2023-11-05T08:07:14.707 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.698+0000 7f0b923ce640 5 monclient: authenticate success, global_id 4350 2023-11-05T08:07:14.707 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.698+0000 7f0b923ce640 10 monclient: get_monmap_and_config success 2023-11-05T08:07:14.708 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.698+0000 7f0b8affd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:14.708 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.698+0000 7f0b923ce640 4 set_mon_vals no callback set 2023-11-05T08:07:14.708 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.698+0000 7f0b8affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-11-05T08:07:14.708 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.698+0000 7f0b8affd640 10 monclient: dump: 2023-11-05T08:07:14.708 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:14.708 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:14.709 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:14.709 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:14.709 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:14.709 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:14.709 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:14.709 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:14.710 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:14.710 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:14.710 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.699+0000 7f0b923ce640 10 monclient: shutdown 2023-11-05T08:07:14.710 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.699+0000 7f0b923ce640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:07:14.710 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.699+0000 7f0b923ce640 1 -- 172.21.15.52:0/2057846615 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b8c141a80 msgr2=0x7f0b8c0b1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:14.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.699+0000 7f0b923ce640 1 --2- 172.21.15.52:0/2057846615 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b8c141a80 0x7f0b8c0b1c00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0b8c0721b0 tx=0x7f0b7c02b840 comp rx=0 tx=0).stop 2023-11-05T08:07:14.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.699+0000 7f0b923ce640 1 -- 172.21.15.52:0/2057846615 shutdown_connections 2023-11-05T08:07:14.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.699+0000 7f0b923ce640 1 --2- 172.21.15.52:0/2057846615 >> v2:172.21.15.156:3300/0 conn(0x7f0b8c13ebf0 0x7f0b8c13f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:14.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.699+0000 7f0b923ce640 1 --2- 172.21.15.52:0/2057846615 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b8c141a80 0x7f0b8c0b1c00 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:14.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.699+0000 7f0b923ce640 1 -- 172.21.15.52:0/2057846615 >> 172.21.15.52:0/2057846615 conn(0x7f0b8c0b7280 msgr2=0x7f0b8c0b7690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:07:14.712 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.699+0000 7f0b923ce640 1 -- 172.21.15.52:0/2057846615 shutdown_connections 2023-11-05T08:07:14.712 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.699+0000 7f0b923ce640 1 -- 172.21.15.52:0/2057846615 wait complete. 2023-11-05T08:07:14.712 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.700+0000 7f0b923ce640 10 monclient: build_initial_monmap 2023-11-05T08:07:14.712 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.700+0000 7f0b923ce640 10 monclient: monmap: 2023-11-05T08:07:14.712 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:07:14.712 INFO:teuthology.orchestra.run.smithi052.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-05T08:07:14.713 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 0.000000 2023-11-05T08:07:14.713 INFO:teuthology.orchestra.run.smithi052.stderr:created 0.000000 2023-11-05T08:07:14.713 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:07:14.713 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:14.713 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.noname-a 2023-11-05T08:07:14.714 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.noname-b 2023-11-05T08:07:14.714 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-c 2023-11-05T08:07:14.714 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:14.714 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.700+0000 7f0b923ce640 1 librados: starting msgr at 2023-11-05T08:07:14.714 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.700+0000 7f0b923ce640 1 librados: starting objecter 2023-11-05T08:07:14.714 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.700+0000 7f0b923ce640 1 Processor -- start 2023-11-05T08:07:14.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.700+0000 7f0b923ce640 1 -- start start 2023-11-05T08:07:14.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.700+0000 7f0b923ce640 1 librados: setting wanted keys 2023-11-05T08:07:14.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.700+0000 7f0b923ce640 1 librados: calling monclient init 2023-11-05T08:07:14.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.700+0000 7f0b923ce640 10 monclient: init 2023-11-05T08:07:14.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.701+0000 7f0b923ce640 10 monclient: _reopen_session rank -1 2023-11-05T08:07:14.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.701+0000 7f0b923ce640 10 monclient: _add_conns ranks=[0,1,2] 2023-11-05T08:07:14.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.701+0000 7f0b923ce640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b8c0a8720 0x7f0b8c0b6810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:14.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.701+0000 7f0b923ce640 10 monclient(hunting): picked mon.noname-a con 0x7f0b8c0a8720 addr [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] 2023-11-05T08:07:14.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.701+0000 7f0b923ce640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0b8c13ebf0 0x7f0b8c145910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:14.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.701+0000 7f0b923ce640 10 monclient(hunting): picked mon.noname-b con 0x7f0b8c13ebf0 addr [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] 2023-11-05T08:07:14.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.701+0000 7f0b923ce640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0b8c0ae350 0x7f0b8c0af9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:14.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.701+0000 7f0b923ce640 10 monclient(hunting): picked mon.noname-c con 0x7f0b8c0ae350 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:07:14.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.701+0000 7f0b923ce640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:14.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.701+0000 7f0b923ce640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b8c144e30 con 0x7f0b8c0a8720 2023-11-05T08:07:14.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.701+0000 7f0b923ce640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:14.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.701+0000 7f0b923ce640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b8c0af380 con 0x7f0b8c13ebf0 2023-11-05T08:07:14.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.701+0000 7f0b923ce640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:14.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.701+0000 7f0b923ce640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b8c144b90 con 0x7f0b8c0ae350 2023-11-05T08:07:14.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.701+0000 7f0b923ce640 10 monclient(hunting): _renew_subs 2023-11-05T08:07:14.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.701+0000 7f0b923ce640 10 monclient(hunting): authenticate will time out at 1380.907396s 2023-11-05T08:07:14.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.701+0000 7f0b8bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b8c0a8720 0x7f0b8c0b6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:14.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.702+0000 7f0b9096b640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0b8c0ae350 0x7f0b8c0af9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:14.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.702+0000 7f0b8b7fe640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0b8c13ebf0 0x7f0b8c145910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:14.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.702+0000 7f0b8bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b8c0a8720 0x7f0b8c0b6810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47110/0 (socket says 172.21.15.52:47110) 2023-11-05T08:07:14.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.702+0000 7f0b8bfff640 1 -- 172.21.15.52:0/2621978028 learned_addr learned my addr 172.21.15.52:0/2621978028 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-11-05T08:07:14.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.702+0000 7f0b8bfff640 10 monclient(hunting): get_auth_request con 0x7f0b8c0a8720 auth_method 0 2023-11-05T08:07:14.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.702+0000 7f0b8bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:14.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.702+0000 7f0b8bfff640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:14.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.702+0000 7f0b8bfff640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:14.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.702+0000 7f0b9096b640 10 monclient(hunting): get_auth_request con 0x7f0b8c0ae350 auth_method 0 2023-11-05T08:07:14.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.702+0000 7f0b9096b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:14.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.702+0000 7f0b9096b640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:14.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.702+0000 7f0b9096b640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:14.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.702+0000 7f0b8b7fe640 10 monclient(hunting): get_auth_request con 0x7f0b8c13ebf0 auth_method 0 2023-11-05T08:07:14.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.702+0000 7f0b8b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:14.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.702+0000 7f0b8b7fe640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:14.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.702+0000 7f0b8b7fe640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:14.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.702+0000 7f0b8bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:14.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.702+0000 7f0b8bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:14.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.702+0000 7f0b8bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:14.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.702+0000 7f0b9096b640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:14.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.702+0000 7f0b9096b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:14.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.702+0000 7f0b9096b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:14.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.703+0000 7f0b8b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:14.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.703+0000 7f0b8b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:14.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.703+0000 7f0b8b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:14.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.705+0000 7f0b9096b640 10 monclient(hunting): handle_auth_done global_id 4292 payload 824 2023-11-05T08:07:14.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.705+0000 7f0b9096b640 1 -- 172.21.15.52:0/2621978028 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0b8c13ebf0 msgr2=0x7f0b8c145910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:14.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.705+0000 7f0b9096b640 1 --2- 172.21.15.52:0/2621978028 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0b8c13ebf0 0x7f0b8c145910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:14.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.705+0000 7f0b9096b640 1 -- 172.21.15.52:0/2621978028 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b8c0a8720 msgr2=0x7f0b8c0b6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:14.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.705+0000 7f0b9096b640 1 --2- 172.21.15.52:0/2621978028 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b8c0a8720 0x7f0b8c0b6810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:14.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.705+0000 7f0b9096b640 10 monclient: _finish_hunting 0 2023-11-05T08:07:14.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.705+0000 7f0b9096b640 1 monclient: found mon.noname-c 2023-11-05T08:07:14.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.705+0000 7f0b9096b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:07:14.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.705+0000 7f0b9096b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.52:3301/0 2023-11-05T08:07:14.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.705+0000 7f0b9096b640 1 -- 172.21.15.52:0/2621978028 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b7c009400 con 0x7f0b8c0ae350 2023-11-05T08:07:14.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.705+0000 7f0b8bfff640 1 --2- 172.21.15.52:0/2621978028 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b8c0a8720 0x7f0b8c0b6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-05T08:07:14.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.708+0000 7f0b9096b640 1 --2- 172.21.15.52:0/2621978028 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0b8c0ae350 0x7f0b8c0af9d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0b84009d90 tx=0x7f0b8400c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:14.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.708+0000 7f0b88ff9640 10 client.?.objecter ms_handle_connect 0x7f0b8c0ae350 2023-11-05T08:07:14.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.708+0000 7f0b88ff9640 10 client.?.objecter resend_mon_ops 2023-11-05T08:07:14.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.711+0000 7f0b88ff9640 1 -- 172.21.15.52:0/2621978028 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b84014480 con 0x7f0b8c0ae350 2023-11-05T08:07:14.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.711+0000 7f0b88ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:14.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.711+0000 7f0b88ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-11-05T08:07:14.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.711+0000 7f0b88ff9640 10 monclient: dump: 2023-11-05T08:07:14.730 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:14.731 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:14.731 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:14.731 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:14.731 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:14.731 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:14.732 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:14.732 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:14.732 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:14.732 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:14.732 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.711+0000 7f0b88ff9640 10 monclient: _finish_auth 0 2023-11-05T08:07:14.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.711+0000 7f0b88ff9640 10 monclient: _check_auth_tickets 2023-11-05T08:07:14.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.711+0000 7f0b88ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:07:14.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.711+0000 7f0b88ff9640 1 -- 172.21.15.52:0/2621978028 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b8400f040 con 0x7f0b8c0ae350 2023-11-05T08:07:14.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.711+0000 7f0b88ff9640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:07:14.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.711+0000 7f0b88ff9640 1 -- 172.21.15.52:0/2621978028 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b84014840 con 0x7f0b8c0ae350 2023-11-05T08:07:14.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.711+0000 7f0b88ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:14.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.711+0000 7f0b88ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-11-05T08:07:14.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.711+0000 7f0b88ff9640 10 monclient: dump: 2023-11-05T08:07:14.734 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:14.734 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:14.734 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:14.735 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:14.735 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:14.735 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:14.735 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:14.735 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:14.736 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:14.736 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:14.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.711+0000 7f0b923ce640 5 monclient: authenticate success, global_id 4292 2023-11-05T08:07:14.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.711+0000 7f0b8a7fc640 4 set_mon_vals no callback set 2023-11-05T08:07:14.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.711+0000 7f0b923ce640 10 monclient: _renew_subs 2023-11-05T08:07:14.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.711+0000 7f0b923ce640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.52:3301/0 2023-11-05T08:07:14.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.711+0000 7f0b923ce640 1 -- 172.21.15.52:0/2621978028 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b8c0af5b0 con 0x7f0b8c0ae350 2023-11-05T08:07:14.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.711+0000 7f0b923ce640 10 client.4292.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-05T08:07:14.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.711+0000 7f0b923ce640 10 monclient: _renew_subs 2023-11-05T08:07:14.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.711+0000 7f0b923ce640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.52:3301/0 2023-11-05T08:07:14.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.711+0000 7f0b923ce640 1 -- 172.21.15.52:0/2621978028 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b8c0aff10 con 0x7f0b8c0ae350 2023-11-05T08:07:14.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.711+0000 7f0b923ce640 1 librados: init done 2023-11-05T08:07:14.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.712+0000 7f0b923ce640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-05T08:07:14.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.713+0000 7f0b923ce640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:07:14.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.713+0000 7f0b923ce640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.52:3301/0 2023-11-05T08:07:14.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.713+0000 7f0b923ce640 1 -- 172.21.15.52:0/2621978028 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b8c145630 con 0x7f0b8c0ae350 2023-11-05T08:07:14.739 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.732+0000 7f0b88ff9640 1 -- 172.21.15.52:0/2621978028 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0b840149a0 con 0x7f0b8c0ae350 2023-11-05T08:07:14.740 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.732+0000 7f0b88ff9640 1 --2- 172.21.15.52:0/2621978028 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f0b6c06c850 0x7f0b6c06ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:14.740 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.732+0000 7f0b8bfff640 1 --2- 172.21.15.52:0/2621978028 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f0b6c06c850 0x7f0b6c06ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:14.740 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.732+0000 7f0b8bfff640 10 monclient: get_auth_request con 0x7f0b6c06c850 auth_method 0 2023-11-05T08:07:14.740 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.733+0000 7f0b8bfff640 1 --2- 172.21.15.52:0/2621978028 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f0b6c06c850 0x7f0b6c06ed10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0b74004e60 tx=0x7f0b74007f10 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:14.740 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.733+0000 7f0b88ff9640 10 client.4292.objecter ms_handle_connect 0x7f0b6c06c850 2023-11-05T08:07:14.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.735+0000 7f0b88ff9640 1 -- 172.21.15.52:0/2621978028 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f0b840595d0 con 0x7f0b8c0ae350 2023-11-05T08:07:14.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.735+0000 7f0b88ff9640 10 client.4292.objecter ms_dispatch 0x7f0b8c000b90 osd_map(23..23 src has 1..23) v4 2023-11-05T08:07:14.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.735+0000 7f0b88ff9640 3 client.4292.objecter handle_osd_map got epochs [23,23] > 0 2023-11-05T08:07:14.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.735+0000 7f0b88ff9640 3 client.4292.objecter handle_osd_map decoding full epoch 23 2023-11-05T08:07:14.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.735+0000 7f0b88ff9640 20 client.4292.objecter dump_active .. 0 homeless 2023-11-05T08:07:14.814 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-05T08:07:14.922 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.920+0000 7fb8f1c90640 10 monclient: get_monmap_and_config 2023-11-05T08:07:14.922 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.920+0000 7fb8f1c90640 10 monclient: build_initial_monmap 2023-11-05T08:07:14.923 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.920+0000 7fb8f1c90640 10 monclient: monmap: 2023-11-05T08:07:14.923 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:07:14.923 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:14.923 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:07:14.922472+0000 2023-11-05T08:07:14.923 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:07:14.922472+0000 2023-11-05T08:07:14.924 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:07:14.924 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:14.924 INFO:teuthology.orchestra.run.smithi052.stderr:0: v1:172.21.15.52:6789/0 mon.noname-a-legacy 2023-11-05T08:07:14.924 INFO:teuthology.orchestra.run.smithi052.stderr:1: v1:172.21.15.156:6789/0 mon.noname-c-legacy 2023-11-05T08:07:14.924 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-b 2023-11-05T08:07:14.925 INFO:teuthology.orchestra.run.smithi052.stderr:3: v2:172.21.15.52:3300/0 mon.noname-a 2023-11-05T08:07:14.925 INFO:teuthology.orchestra.run.smithi052.stderr:4: v2:172.21.15.156:3300/0 mon.noname-c 2023-11-05T08:07:14.925 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:14.927 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.921+0000 7fb8f1c90640 1 Processor -- start 2023-11-05T08:07:14.927 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.921+0000 7fb8f1c90640 1 -- start start 2023-11-05T08:07:14.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.921+0000 7fb8f1c90640 10 monclient: init 2023-11-05T08:07:14.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.922+0000 7fb8f1c90640 10 monclient: _reopen_session rank -1 2023-11-05T08:07:14.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.922+0000 7fb8f1c90640 10 monclient: _add_conns ranks=[3,1,0,2,4] 2023-11-05T08:07:14.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.922+0000 7fb8f1c90640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb8ec0b4240 0x7fb8ec0b1150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:14.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.922+0000 7fb8f1c90640 10 monclient(hunting): picked mon.noname-a con 0x7fb8ec0b4240 addr v2:172.21.15.52:3300/0 2023-11-05T08:07:14.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.922+0000 7fb8f1c90640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fb8ec0b38d0 addr v1:172.21.15.156:6789/0 2023-11-05T08:07:14.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.922+0000 7fb8f1c90640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fb8ec0ade00 addr v1:172.21.15.52:6789/0 2023-11-05T08:07:14.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.922+0000 7fb8f1c90640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8ec0b0cc0 con 0x7fb8ec0ade00 2023-11-05T08:07:14.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.922+0000 7fb8f1c90640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8ec0b1690 con 0x7fb8ec0b38d0 2023-11-05T08:07:14.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.922+0000 7fb8f1c90640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:14.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.922+0000 7fb8f1c90640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8ec0b4620 con 0x7fb8ec0b4240 2023-11-05T08:07:14.930 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.922+0000 7fb8f1c90640 10 monclient(hunting): _renew_subs 2023-11-05T08:07:14.930 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.922+0000 7fb8f1c90640 10 monclient(hunting): authenticate will time out at 1381.128341s 2023-11-05T08:07:14.930 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.923+0000 7fb8eb7fe640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb8ec0b4240 0x7fb8ec0b1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:14.930 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.923+0000 7fb8eaffd640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fb8ec0b38d0 0x7fb8ec0ae640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.52:35556/0 (socket says 172.21.15.52:35556) 2023-11-05T08:07:14.930 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.923+0000 7fb8eaffd640 1 -- 172.21.15.52:0/1404314120 learned_addr learned my addr 172.21.15.52:0/1404314120 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-11-05T08:07:14.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.923+0000 7fb8eb7fe640 10 monclient(hunting): get_auth_request con 0x7fb8ec0b4240 auth_method 0 2023-11-05T08:07:14.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.923+0000 7fb8eb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:14.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.923+0000 7fb8eb7fe640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:14.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.923+0000 7fb8eb7fe640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:14.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.924+0000 7fb8eb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:14.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.924+0000 7fb8eb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:14.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.924+0000 7fb8eb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:14.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.925+0000 7fb8ea7fc640 1 -- 172.21.15.52:0/1404314120 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3250058956 0 0) 0x7fb8ec0b1690 con 0x7fb8ec0b38d0 2023-11-05T08:07:14.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.925+0000 7fb8ea7fc640 10 monclient(hunting): _negotiate 2023-11-05T08:07:14.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.925+0000 7fb8ea7fc640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:14.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.925+0000 7fb8ea7fc640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:14.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.925+0000 7fb8ea7fc640 10 monclient(hunting): my global_id is 4393 2023-11-05T08:07:14.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.925+0000 7fb8ea7fc640 1 -- 172.21.15.52:0/1404314120 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8d8003520 con 0x7fb8ec0b38d0 2023-11-05T08:07:14.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.926+0000 7fb8eb7fe640 10 monclient(hunting): handle_auth_done global_id 4356 payload 274 2023-11-05T08:07:14.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.926+0000 7fb8eb7fe640 1 -- 172.21.15.52:0/1404314120 >> v1:172.21.15.156:6789/0 conn(0x7fb8ec0b38d0 legacy=0x7fb8ec0ae640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:14.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.926+0000 7fb8eb7fe640 1 -- 172.21.15.52:0/1404314120 >> v1:172.21.15.52:6789/0 conn(0x7fb8ec0ade00 legacy=0x7fb8ec13b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:14.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.926+0000 7fb8eb7fe640 10 monclient: _finish_hunting 0 2023-11-05T08:07:14.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.926+0000 7fb8eb7fe640 1 monclient: found mon.noname-a 2023-11-05T08:07:14.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.926+0000 7fb8eb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:07:14.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.926+0000 7fb8eb7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.52:3300/0 2023-11-05T08:07:14.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.926+0000 7fb8eb7fe640 1 -- 172.21.15.52:0/1404314120 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8ec13f5f0 con 0x7fb8ec0b4240 2023-11-05T08:07:14.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.929+0000 7fb8eb7fe640 1 --2- 172.21.15.52:0/1404314120 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb8ec0b4240 0x7fb8ec0b1150 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb8d40097d0 tx=0x7fb8d402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6cc132f44d2a985 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:14.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.935+0000 7fb8ea7fc640 1 -- 172.21.15.52:0/1404314120 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d4031830 con 0x7fb8ec0b4240 2023-11-05T08:07:14.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.935+0000 7fb8ea7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:14.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.935+0000 7fb8ea7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-11-05T08:07:14.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.935+0000 7fb8ea7fc640 10 monclient: dump: 2023-11-05T08:07:14.937 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:14.938 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:14.938 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:14.938 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:14.938 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:14.938 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:14.939 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:14.939 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:14.939 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:14.939 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:14.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.935+0000 7fb8ea7fc640 10 monclient: _finish_auth 0 2023-11-05T08:07:14.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.935+0000 7fb8ea7fc640 10 monclient: _check_auth_tickets 2023-11-05T08:07:14.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.935+0000 7fb8ea7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:07:14.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.935+0000 7fb8ea7fc640 1 -- 172.21.15.52:0/1404314120 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8d4031990 con 0x7fb8ec0b4240 2023-11-05T08:07:14.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.935+0000 7fb8f1c90640 5 monclient: authenticate success, global_id 4356 2023-11-05T08:07:14.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.935+0000 7fb8f1c90640 20 monclient: get_monmap_and_config waiting for monmap|config 2023-11-05T08:07:14.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.935+0000 7fb8ea7fc640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:07:14.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.935+0000 7fb8f1c90640 10 monclient: get_monmap_and_config success 2023-11-05T08:07:14.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.935+0000 7fb8f1c90640 4 set_mon_vals no callback set 2023-11-05T08:07:14.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.935+0000 7fb8ea7fc640 1 -- 172.21.15.52:0/1404314120 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d4031d20 con 0x7fb8ec0b4240 2023-11-05T08:07:14.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.935+0000 7fb8ea7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:14.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.935+0000 7fb8ea7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-11-05T08:07:14.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.935+0000 7fb8ea7fc640 10 monclient: dump: 2023-11-05T08:07:14.942 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:14.942 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:14.942 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:14.942 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:14.943 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:14.943 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:14.943 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:14.943 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:14.943 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:14.943 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:14.947 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.936+0000 7fb8f1c90640 10 monclient: shutdown 2023-11-05T08:07:14.947 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.936+0000 7fb8f1c90640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:07:14.947 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.936+0000 7fb8f1c90640 1 -- 172.21.15.52:0/1404314120 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb8ec0b4240 msgr2=0x7fb8ec0b1150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:14.947 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.936+0000 7fb8f1c90640 1 --2- 172.21.15.52:0/1404314120 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb8ec0b4240 0x7fb8ec0b1150 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb8d40097d0 tx=0x7fb8d402b8d0 comp rx=0 tx=0).stop 2023-11-05T08:07:14.947 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.936+0000 7fb8f1c90640 1 -- 172.21.15.52:0/1404314120 shutdown_connections 2023-11-05T08:07:14.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.936+0000 7fb8f1c90640 1 --2- 172.21.15.52:0/1404314120 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb8ec0b4240 0x7fb8ec0b1150 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:14.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.936+0000 7fb8f1c90640 1 -- 172.21.15.52:0/1404314120 >> 172.21.15.52:0/1404314120 conn(0x7fb8ec065cd0 msgr2=0x7fb8ec0660e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:07:14.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.936+0000 7fb8f1c90640 1 -- 172.21.15.52:0/1404314120 shutdown_connections 2023-11-05T08:07:14.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.936+0000 7fb8f1c90640 1 -- 172.21.15.52:0/1404314120 wait complete. 2023-11-05T08:07:14.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.936+0000 7fb8f1c90640 10 monclient: build_initial_monmap 2023-11-05T08:07:14.949 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.936+0000 7fb8f1c90640 10 monclient: monmap: 2023-11-05T08:07:14.949 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:07:14.949 INFO:teuthology.orchestra.run.smithi052.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-05T08:07:14.949 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 0.000000 2023-11-05T08:07:14.949 INFO:teuthology.orchestra.run.smithi052.stderr:created 0.000000 2023-11-05T08:07:14.950 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:07:14.950 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:14.950 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.noname-a 2023-11-05T08:07:14.950 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.noname-b 2023-11-05T08:07:14.950 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-c 2023-11-05T08:07:14.950 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:14.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.937+0000 7fb8f1c90640 1 librados: starting msgr at 2023-11-05T08:07:14.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.937+0000 7fb8f1c90640 1 librados: starting objecter 2023-11-05T08:07:14.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.937+0000 7fb8f1c90640 1 Processor -- start 2023-11-05T08:07:14.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.937+0000 7fb8f1c90640 1 -- start start 2023-11-05T08:07:14.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.937+0000 7fb8f1c90640 1 librados: setting wanted keys 2023-11-05T08:07:14.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.937+0000 7fb8f1c90640 1 librados: calling monclient init 2023-11-05T08:07:14.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.937+0000 7fb8f1c90640 10 monclient: init 2023-11-05T08:07:14.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.938+0000 7fb8f1c90640 10 monclient: _reopen_session rank -1 2023-11-05T08:07:14.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.938+0000 7fb8f1c90640 10 monclient: _add_conns ranks=[0,1,2] 2023-11-05T08:07:14.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.938+0000 7fb8f1c90640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb8ec0ade00 0x7fb8ec1d6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:14.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.938+0000 7fb8f1c90640 10 monclient(hunting): picked mon.noname-a con 0x7fb8ec0ade00 addr [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] 2023-11-05T08:07:14.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.938+0000 7fb8f1c90640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb8ec0b4240 0x7fb8ec1d7130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:14.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.938+0000 7fb8f1c90640 10 monclient(hunting): picked mon.noname-b con 0x7fb8ec0b4240 addr [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] 2023-11-05T08:07:14.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.938+0000 7fb8f1c90640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb8ec144130 0x7fb8ec13d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:14.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.938+0000 7fb8f1c90640 10 monclient(hunting): picked mon.noname-c con 0x7fb8ec144130 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:07:14.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.938+0000 7fb8f1c90640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:14.954 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.938+0000 7fb8f1c90640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ec1d6760 con 0x7fb8ec0ade00 2023-11-05T08:07:14.954 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.938+0000 7fb8f1c90640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:14.954 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.938+0000 7fb8f1c90640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ec13f130 con 0x7fb8ec0b4240 2023-11-05T08:07:14.954 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.938+0000 7fb8f1c90640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:14.954 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.938+0000 7fb8f1c90640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ec13caf0 con 0x7fb8ec144130 2023-11-05T08:07:14.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.938+0000 7fb8f1c90640 10 monclient(hunting): _renew_subs 2023-11-05T08:07:14.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.938+0000 7fb8f1c90640 10 monclient(hunting): authenticate will time out at 1381.144044s 2023-11-05T08:07:14.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.938+0000 7fb8eb7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb8ec0ade00 0x7fb8ec1d6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:14.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.938+0000 7fb8eaffd640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb8ec0b4240 0x7fb8ec1d7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:14.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.938+0000 7fb8eb7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb8ec0ade00 0x7fb8ec1d6bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47136/0 (socket says 172.21.15.52:47136) 2023-11-05T08:07:14.956 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.938+0000 7fb8eb7fe640 1 -- 172.21.15.52:0/1656901163 learned_addr learned my addr 172.21.15.52:0/1656901163 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-11-05T08:07:14.956 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.938+0000 7fb8eb7fe640 10 monclient(hunting): get_auth_request con 0x7fb8ec0ade00 auth_method 0 2023-11-05T08:07:14.956 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.938+0000 7fb8eb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:14.956 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.938+0000 7fb8eb7fe640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:14.956 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.938+0000 7fb8eb7fe640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:14.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.939+0000 7fb8eaffd640 10 monclient(hunting): get_auth_request con 0x7fb8ec0b4240 auth_method 0 2023-11-05T08:07:14.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.939+0000 7fb8eaffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:14.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.939+0000 7fb8eaffd640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:14.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.939+0000 7fb8eaffd640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:14.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.939+0000 7fb8eb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:14.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.939+0000 7fb8eb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:14.958 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.939+0000 7fb8eb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:14.958 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.939+0000 7fb8eaffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:14.958 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.939+0000 7fb8eaffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:14.958 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.939+0000 7fb8eaffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:14.958 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.942+0000 7fb8eb7fe640 10 monclient(hunting): handle_auth_done global_id 4362 payload 824 2023-11-05T08:07:14.959 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.942+0000 7fb8eb7fe640 1 -- 172.21.15.52:0/1656901163 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb8ec144130 msgr2=0x7fb8ec13d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:14.959 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.942+0000 7fb8eb7fe640 1 --2- 172.21.15.52:0/1656901163 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb8ec144130 0x7fb8ec13d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:14.959 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.942+0000 7fb8eb7fe640 1 -- 172.21.15.52:0/1656901163 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb8ec0b4240 msgr2=0x7fb8ec1d7130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:14.959 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.942+0000 7fb8eb7fe640 1 --2- 172.21.15.52:0/1656901163 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb8ec0b4240 0x7fb8ec1d7130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:14.959 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.942+0000 7fb8eb7fe640 10 monclient: _finish_hunting 0 2023-11-05T08:07:14.960 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.942+0000 7fb8eb7fe640 1 monclient: found mon.noname-a 2023-11-05T08:07:14.960 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.942+0000 7fb8eb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:07:14.960 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.942+0000 7fb8eb7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.52:3300/0 2023-11-05T08:07:14.960 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.942+0000 7fb8eb7fe640 1 -- 172.21.15.52:0/1656901163 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8d4009400 con 0x7fb8ec0ade00 2023-11-05T08:07:14.960 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.944+0000 7fb8eb7fe640 1 --2- 172.21.15.52:0/1656901163 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb8ec0ade00 0x7fb8ec1d6bf0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb8d40098f0 tx=0x7fb8d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:14.961 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.944+0000 7fb8e3fff640 10 client.?.objecter ms_handle_connect 0x7fb8ec0ade00 2023-11-05T08:07:14.961 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.944+0000 7fb8e3fff640 10 client.?.objecter resend_mon_ops 2023-11-05T08:07:14.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.948+0000 7fb8e3fff640 1 -- 172.21.15.52:0/1656901163 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d403a9e0 con 0x7fb8ec0ade00 2023-11-05T08:07:14.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.948+0000 7fb8e3fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:14.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.948+0000 7fb8e3fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-11-05T08:07:14.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.948+0000 7fb8e3fff640 10 monclient: dump: 2023-11-05T08:07:14.963 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:14.963 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:14.963 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:14.964 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:14.964 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:14.964 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:14.964 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:14.964 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:14.965 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:14.965 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:14.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.948+0000 7fb8e3fff640 10 monclient: _finish_auth 0 2023-11-05T08:07:14.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.948+0000 7fb8e3fff640 10 monclient: _check_auth_tickets 2023-11-05T08:07:14.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.948+0000 7fb8e3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:07:14.966 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.948+0000 7fb8e3fff640 1 -- 172.21.15.52:0/1656901163 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8d403ab60 con 0x7fb8ec0ade00 2023-11-05T08:07:14.966 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.948+0000 7fb8f1c90640 5 monclient: authenticate success, global_id 4362 2023-11-05T08:07:14.966 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.948+0000 7fb8e3fff640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:07:14.966 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.948+0000 7fb8e3fff640 1 -- 172.21.15.52:0/1656901163 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d40443f0 con 0x7fb8ec0ade00 2023-11-05T08:07:14.966 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.948+0000 7fb8e3fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:14.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.948+0000 7fb8e3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-11-05T08:07:14.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.948+0000 7fb8e9ffb640 4 set_mon_vals no callback set 2023-11-05T08:07:14.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.948+0000 7fb8e3fff640 10 monclient: dump: 2023-11-05T08:07:14.967 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:14.967 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:14.968 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:14.968 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:14.968 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:14.968 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:14.968 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:14.969 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:14.969 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:14.969 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:14.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.948+0000 7fb8f1c90640 10 monclient: _renew_subs 2023-11-05T08:07:14.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.948+0000 7fb8f1c90640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.52:3300/0 2023-11-05T08:07:14.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.948+0000 7fb8f1c90640 1 -- 172.21.15.52:0/1656901163 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8ec13cd10 con 0x7fb8ec0ade00 2023-11-05T08:07:14.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.948+0000 7fb8f1c90640 10 client.4362.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-05T08:07:14.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.948+0000 7fb8f1c90640 10 monclient: _renew_subs 2023-11-05T08:07:14.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.948+0000 7fb8f1c90640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.52:3300/0 2023-11-05T08:07:14.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.948+0000 7fb8f1c90640 1 -- 172.21.15.52:0/1656901163 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8ec13df20 con 0x7fb8ec0ade00 2023-11-05T08:07:14.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.948+0000 7fb8f1c90640 1 librados: init done 2023-11-05T08:07:14.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.949+0000 7fb8f1c90640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-05T08:07:14.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.949+0000 7fb8f1c90640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:07:14.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.949+0000 7fb8f1c90640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.52:3300/0 2023-11-05T08:07:14.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.949+0000 7fb8f1c90640 1 -- 172.21.15.52:0/1656901163 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8ec04e9f0 con 0x7fb8ec0ade00 2023-11-05T08:07:14.974 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.967+0000 7fb8e3fff640 1 -- 172.21.15.52:0/1656901163 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb8d4044550 con 0x7fb8ec0ade00 2023-11-05T08:07:14.974 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.968+0000 7fb8e3fff640 1 --2- 172.21.15.52:0/1656901163 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7fb8cc06c850 0x7fb8cc06ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:14.974 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.968+0000 7fb8eaffd640 1 --2- 172.21.15.52:0/1656901163 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7fb8cc06c850 0x7fb8cc06ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:14.974 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.968+0000 7fb8eaffd640 10 monclient: get_auth_request con 0x7fb8cc06c850 auth_method 0 2023-11-05T08:07:14.975 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.968+0000 7fb8eaffd640 1 --2- 172.21.15.52:0/1656901163 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7fb8cc06c850 0x7fb8cc06ed10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb8ec13e750 tx=0x7fb8dc007d30 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:14.975 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.968+0000 7fb8e3fff640 10 client.4362.objecter ms_handle_connect 0x7fb8cc06c850 2023-11-05T08:07:14.992 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.990+0000 7f0b88ff9640 1 -- 172.21.15.52:0/2621978028 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0b84055910 con 0x7f0b8c0ae350 2023-11-05T08:07:14.992 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.990+0000 7f0b88ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:07:14.992 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:14.990+0000 7f0b88ff9640 10 monclient: _finish_command 1 = system:0 2023-11-05T08:07:15.171 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.169+0000 7f0b923ce640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 4}] 2023-11-05T08:07:15.171 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.169+0000 7f0b923ce640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2023-11-05T08:07:15.171 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.169+0000 7f0b923ce640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.52:3301/0 2023-11-05T08:07:15.171 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.169+0000 7f0b923ce640 1 -- 172.21.15.52:0/2621978028 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f0b8c145630 con 0x7f0b8c0ae350 2023-11-05T08:07:15.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.173+0000 7f0b88ff9640 1 -- 172.21.15.52:0/2621978028 <== mon.2 v2:172.21.15.52:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0b8c145630 con 0x7f0b8c0ae350 2023-11-05T08:07:15.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.173+0000 7f0b88ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2023-11-05T08:07:15.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.173+0000 7f0b88ff9640 10 monclient: _finish_command 2 = system:0 2023-11-05T08:07:15.175 INFO:teuthology.orchestra.run.smithi052.stdout:60129542151 2023-11-05T08:07:15.176 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.174+0000 7f0b923ce640 10 librados: watch_flush enter 2023-11-05T08:07:15.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.174+0000 7f0b923ce640 10 librados: watch_flush exit 2023-11-05T08:07:15.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.174+0000 7f0b923ce640 20 client.4292.objecter shutdown clearing up homeless session... 2023-11-05T08:07:15.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.174+0000 7f0b923ce640 10 client.4292.objecter successfully canceled tick 2023-11-05T08:07:15.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.175+0000 7f0b923ce640 1 -- 172.21.15.52:0/2621978028 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f0b6c06c850 msgr2=0x7f0b6c06ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:15.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.175+0000 7f0b923ce640 1 --2- 172.21.15.52:0/2621978028 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f0b6c06c850 0x7f0b6c06ed10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0b74004e60 tx=0x7f0b74007f10 comp rx=0 tx=0).stop 2023-11-05T08:07:15.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.175+0000 7f0b923ce640 10 monclient: shutdown 2023-11-05T08:07:15.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.175+0000 7f0b923ce640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:07:15.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.175+0000 7f0b923ce640 1 -- 172.21.15.52:0/2621978028 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0b8c0ae350 msgr2=0x7f0b8c0af9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:15.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.175+0000 7f0b923ce640 1 --2- 172.21.15.52:0/2621978028 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0b8c0ae350 0x7f0b8c0af9d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0b84009d90 tx=0x7f0b8400c490 comp rx=0 tx=0).stop 2023-11-05T08:07:15.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.175+0000 7f0b923ce640 1 -- 172.21.15.52:0/2621978028 shutdown_connections 2023-11-05T08:07:15.179 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.175+0000 7f0b923ce640 1 --2- 172.21.15.52:0/2621978028 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f0b6c06c850 0x7f0b6c06ed10 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:15.179 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.175+0000 7f0b923ce640 1 --2- 172.21.15.52:0/2621978028 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0b8c0ae350 0x7f0b8c0af9d0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:15.179 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.175+0000 7f0b923ce640 1 --2- 172.21.15.52:0/2621978028 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0b8c13ebf0 0x7f0b8c145910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:15.179 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.175+0000 7f0b923ce640 1 --2- 172.21.15.52:0/2621978028 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b8c0a8720 0x7f0b8c0b6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:15.179 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.175+0000 7f0b923ce640 1 -- 172.21.15.52:0/2621978028 >> 172.21.15.52:0/2621978028 conn(0x7f0b8c0b7280 msgr2=0x7f0b8c13d9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:07:15.179 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.175+0000 7f0b923ce640 1 -- 172.21.15.52:0/2621978028 shutdown_connections 2023-11-05T08:07:15.180 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.175+0000 7f0b923ce640 1 -- 172.21.15.52:0/2621978028 wait complete. 2023-11-05T08:07:15.180 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.175+0000 7f0b923ce640 1 librados: shutdown 2023-11-05T08:07:15.187 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542151 for osd.4 2023-11-05T08:07:15.188 DEBUG:teuthology.parallel:result is None 2023-11-05T08:07:15.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.230+0000 7fb8e3fff640 1 -- 172.21.15.52:0/1656901163 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fb8d407b2a0 con 0x7fb8ec0ade00 2023-11-05T08:07:15.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.230+0000 7fb8e3fff640 10 client.4362.objecter ms_dispatch 0x7fb8ec000b90 osd_map(23..23 src has 1..23) v4 2023-11-05T08:07:15.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.230+0000 7fb8e3fff640 3 client.4362.objecter handle_osd_map got epochs [23,23] > 0 2023-11-05T08:07:15.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.230+0000 7fb8e3fff640 3 client.4362.objecter handle_osd_map decoding full epoch 23 2023-11-05T08:07:15.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.230+0000 7fb8e3fff640 20 client.4362.objecter dump_active .. 0 homeless 2023-11-05T08:07:15.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.230+0000 7fb8e3fff640 1 -- 172.21.15.52:0/1656901163 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb8d40775e0 con 0x7fb8ec0ade00 2023-11-05T08:07:15.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.230+0000 7fb8e3fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:07:15.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.230+0000 7fb8e3fff640 10 monclient: _finish_command 1 = system:0 2023-11-05T08:07:15.422 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.421+0000 7fb8f1c90640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 1}] 2023-11-05T08:07:15.423 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.421+0000 7fb8f1c90640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2023-11-05T08:07:15.423 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.421+0000 7fb8f1c90640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.52:3300/0 2023-11-05T08:07:15.423 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.421+0000 7fb8f1c90640 1 -- 172.21.15.52:0/1656901163 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb8ec14d1b0 con 0x7fb8ec0ade00 2023-11-05T08:07:15.426 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.424+0000 7fb8e3fff640 1 -- 172.21.15.52:0/1656901163 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb8d4035090 con 0x7fb8ec0ade00 2023-11-05T08:07:15.426 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.424+0000 7fb8e3fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2023-11-05T08:07:15.426 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.424+0000 7fb8e3fff640 10 monclient: _finish_command 2 = system:0 2023-11-05T08:07:15.427 INFO:teuthology.orchestra.run.smithi052.stdout:64424509446 2023-11-05T08:07:15.429 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.427+0000 7fb8f1c90640 10 librados: watch_flush enter 2023-11-05T08:07:15.429 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.427+0000 7fb8f1c90640 10 librados: watch_flush exit 2023-11-05T08:07:15.429 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.427+0000 7fb8f1c90640 20 client.4362.objecter shutdown clearing up homeless session... 2023-11-05T08:07:15.429 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.427+0000 7fb8f1c90640 10 client.4362.objecter successfully canceled tick 2023-11-05T08:07:15.430 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.427+0000 7fb8f1c90640 1 -- 172.21.15.52:0/1656901163 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7fb8cc06c850 msgr2=0x7fb8cc06ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:15.430 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.427+0000 7fb8f1c90640 1 --2- 172.21.15.52:0/1656901163 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7fb8cc06c850 0x7fb8cc06ed10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb8ec13e750 tx=0x7fb8dc007d30 comp rx=0 tx=0).stop 2023-11-05T08:07:15.430 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.427+0000 7fb8f1c90640 10 monclient: shutdown 2023-11-05T08:07:15.430 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.427+0000 7fb8f1c90640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:07:15.430 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.427+0000 7fb8f1c90640 1 -- 172.21.15.52:0/1656901163 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb8ec0ade00 msgr2=0x7fb8ec1d6bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:15.431 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.427+0000 7fb8f1c90640 1 --2- 172.21.15.52:0/1656901163 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb8ec0ade00 0x7fb8ec1d6bf0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb8d40098f0 tx=0x7fb8d40046c0 comp rx=0 tx=0).stop 2023-11-05T08:07:15.431 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.427+0000 7fb8f1c90640 1 -- 172.21.15.52:0/1656901163 shutdown_connections 2023-11-05T08:07:15.431 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.427+0000 7fb8f1c90640 1 --2- 172.21.15.52:0/1656901163 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7fb8cc06c850 0x7fb8cc06ed10 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:15.431 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.427+0000 7fb8f1c90640 1 --2- 172.21.15.52:0/1656901163 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb8ec144130 0x7fb8ec13d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:15.431 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.427+0000 7fb8f1c90640 1 --2- 172.21.15.52:0/1656901163 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb8ec0b4240 0x7fb8ec1d7130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:15.431 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.427+0000 7fb8f1c90640 1 --2- 172.21.15.52:0/1656901163 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb8ec0ade00 0x7fb8ec1d6bf0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:15.432 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.427+0000 7fb8f1c90640 1 -- 172.21.15.52:0/1656901163 >> 172.21.15.52:0/1656901163 conn(0x7fb8ec065cd0 msgr2=0x7fb8ec0b1ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:07:15.432 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.427+0000 7fb8f1c90640 1 -- 172.21.15.52:0/1656901163 shutdown_connections 2023-11-05T08:07:15.432 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.427+0000 7fb8f1c90640 1 -- 172.21.15.52:0/1656901163 wait complete. 2023-11-05T08:07:15.432 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.427+0000 7fb8f1c90640 1 librados: shutdown 2023-11-05T08:07:15.439 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509446 for osd.1 2023-11-05T08:07:15.439 DEBUG:teuthology.parallel:result is None 2023-11-05T08:07:15.441 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-05T08:07:15.441 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-05T08:07:15.547 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.546+0000 7f934261a640 10 monclient: get_monmap_and_config 2023-11-05T08:07:15.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.546+0000 7f934261a640 10 monclient: build_initial_monmap 2023-11-05T08:07:15.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.546+0000 7f934261a640 10 monclient: monmap: 2023-11-05T08:07:15.548 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:07:15.548 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:15.549 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:07:15.547858+0000 2023-11-05T08:07:15.549 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:07:15.547858+0000 2023-11-05T08:07:15.549 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:07:15.549 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:15.550 INFO:teuthology.orchestra.run.smithi052.stderr:0: v1:172.21.15.52:6789/0 mon.noname-a-legacy 2023-11-05T08:07:15.550 INFO:teuthology.orchestra.run.smithi052.stderr:1: v1:172.21.15.156:6789/0 mon.noname-c-legacy 2023-11-05T08:07:15.550 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-b 2023-11-05T08:07:15.550 INFO:teuthology.orchestra.run.smithi052.stderr:3: v2:172.21.15.52:3300/0 mon.noname-a 2023-11-05T08:07:15.550 INFO:teuthology.orchestra.run.smithi052.stderr:4: v2:172.21.15.156:3300/0 mon.noname-c 2023-11-05T08:07:15.551 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:15.553 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.547+0000 7f934261a640 1 Processor -- start 2023-11-05T08:07:15.553 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.547+0000 7f934261a640 1 -- start start 2023-11-05T08:07:15.553 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.547+0000 7f934261a640 10 monclient: init 2023-11-05T08:07:15.554 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.547+0000 7f934261a640 10 monclient: _reopen_session rank -1 2023-11-05T08:07:15.554 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.547+0000 7f934261a640 10 monclient: _add_conns ranks=[0,2,1,4,3] 2023-11-05T08:07:15.554 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.547+0000 7f934261a640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f933c0ac830 addr v1:172.21.15.52:6789/0 2023-11-05T08:07:15.554 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.547+0000 7f934261a640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f933c071bd0 0x7f933c13bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:15.554 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.547+0000 7f934261a640 10 monclient(hunting): picked mon.noname-b con 0x7f933c071bd0 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:07:15.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.547+0000 7f934261a640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f933c13e640 addr v1:172.21.15.156:6789/0 2023-11-05T08:07:15.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.547+0000 7f934261a640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f933c13f200 con 0x7f933c0ac830 2023-11-05T08:07:15.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.547+0000 7f934261a640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f933c0ac310 con 0x7f933c13e640 2023-11-05T08:07:15.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.547+0000 7f934261a640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:15.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.547+0000 7f934261a640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f933c0aad80 con 0x7f933c071bd0 2023-11-05T08:07:15.556 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.547+0000 7f934261a640 10 monclient(hunting): _renew_subs 2023-11-05T08:07:15.556 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.547+0000 7f934261a640 10 monclient(hunting): authenticate will time out at 1381.753640s 2023-11-05T08:07:15.556 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.548+0000 7f933b7fe640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f933c071bd0 0x7f933c13bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:15.556 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.548+0000 7f933bfff640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f933c0ac830 0x7f933c0acc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:47134/0 (socket says 172.21.15.52:47134) 2023-11-05T08:07:15.557 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.548+0000 7f933bfff640 1 -- 172.21.15.52:0/3287490255 learned_addr learned my addr 172.21.15.52:0/3287490255 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-11-05T08:07:15.557 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.548+0000 7f933b7fe640 10 monclient(hunting): get_auth_request con 0x7f933c071bd0 auth_method 0 2023-11-05T08:07:15.557 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.548+0000 7f933b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:15.557 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.548+0000 7f933b7fe640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:15.558 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.548+0000 7f933b7fe640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:15.558 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.549+0000 7f933b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:15.558 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.549+0000 7f933b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:15.558 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.549+0000 7f933b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:15.559 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.550+0000 7f933affd640 1 -- 172.21.15.52:0/3287490255 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1869444902 0 0) 0x7f933c0ac310 con 0x7f933c13e640 2023-11-05T08:07:15.559 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.550+0000 7f933affd640 10 monclient(hunting): _negotiate 2023-11-05T08:07:15.559 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.550+0000 7f933affd640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:15.559 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.550+0000 7f933affd640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:15.560 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.550+0000 7f933affd640 10 monclient(hunting): my global_id is 4399 2023-11-05T08:07:15.560 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.550+0000 7f933affd640 1 -- 172.21.15.52:0/3287490255 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9328005730 con 0x7f933c13e640 2023-11-05T08:07:15.560 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.550+0000 7f933b7fe640 10 monclient(hunting): handle_auth_done global_id 4295 payload 274 2023-11-05T08:07:15.560 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.550+0000 7f933b7fe640 1 -- 172.21.15.52:0/3287490255 >> v1:172.21.15.156:6789/0 conn(0x7f933c13e640 legacy=0x7f933c13eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:15.560 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.550+0000 7f933b7fe640 1 -- 172.21.15.52:0/3287490255 >> v1:172.21.15.52:6789/0 conn(0x7f933c0ac830 legacy=0x7f933c0acc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:15.561 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.550+0000 7f933b7fe640 10 monclient: _finish_hunting 0 2023-11-05T08:07:15.561 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.550+0000 7f933b7fe640 1 monclient: found mon.noname-b 2023-11-05T08:07:15.561 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.550+0000 7f933b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:07:15.561 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.550+0000 7f933b7fe640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.52:3301/0 2023-11-05T08:07:15.561 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.550+0000 7f933b7fe640 1 -- 172.21.15.52:0/3287490255 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f933c0ab2a0 con 0x7f933c071bd0 2023-11-05T08:07:15.565 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.553+0000 7f933b7fe640 1 --2- 172.21.15.52:0/3287490255 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f933c071bd0 0x7f933c13bc60 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f932c0097d0 tx=0x7f932c02b810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=21d183097c9e633c server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:15.565 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.556+0000 7f933affd640 1 -- 172.21.15.52:0/3287490255 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f932c031770 con 0x7f933c071bd0 2023-11-05T08:07:15.566 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.556+0000 7f933affd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:15.566 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.557+0000 7f933affd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-05T08:07:15.566 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.557+0000 7f933affd640 10 monclient: dump: 2023-11-05T08:07:15.566 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:15.566 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:15.567 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:15.567 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:15.567 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:15.567 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:15.568 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:15.568 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:15.568 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:15.568 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:15.568 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.557+0000 7f933affd640 10 monclient: _finish_auth 0 2023-11-05T08:07:15.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.557+0000 7f933affd640 10 monclient: _check_auth_tickets 2023-11-05T08:07:15.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.557+0000 7f933affd640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:07:15.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.557+0000 7f933affd640 1 -- 172.21.15.52:0/3287490255 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f932c0318d0 con 0x7f933c071bd0 2023-11-05T08:07:15.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.557+0000 7f933affd640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:07:15.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.557+0000 7f933affd640 1 -- 172.21.15.52:0/3287490255 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f932c031c60 con 0x7f933c071bd0 2023-11-05T08:07:15.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.557+0000 7f934261a640 5 monclient: authenticate success, global_id 4295 2023-11-05T08:07:15.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.557+0000 7f934261a640 10 monclient: get_monmap_and_config success 2023-11-05T08:07:15.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.557+0000 7f934261a640 4 set_mon_vals no callback set 2023-11-05T08:07:15.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.557+0000 7f933affd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:15.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.557+0000 7f933affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-11-05T08:07:15.571 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.557+0000 7f933affd640 10 monclient: dump: 2023-11-05T08:07:15.571 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:15.571 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:15.571 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:15.571 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:15.571 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:15.572 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:15.572 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:15.572 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:15.572 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:15.572 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:15.573 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.557+0000 7f934261a640 10 monclient: shutdown 2023-11-05T08:07:15.573 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.557+0000 7f934261a640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:07:15.573 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.557+0000 7f934261a640 1 -- 172.21.15.52:0/3287490255 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f933c071bd0 msgr2=0x7f933c13bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:15.573 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.557+0000 7f934261a640 1 --2- 172.21.15.52:0/3287490255 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f933c071bd0 0x7f933c13bc60 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f932c0097d0 tx=0x7f932c02b810 comp rx=0 tx=0).stop 2023-11-05T08:07:15.573 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.557+0000 7f934261a640 1 -- 172.21.15.52:0/3287490255 shutdown_connections 2023-11-05T08:07:15.574 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.557+0000 7f934261a640 1 --2- 172.21.15.52:0/3287490255 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f933c071bd0 0x7f933c13bc60 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:15.574 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.557+0000 7f934261a640 1 -- 172.21.15.52:0/3287490255 >> 172.21.15.52:0/3287490255 conn(0x7f933c0b2ff0 msgr2=0x7f933c0b3400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:07:15.574 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.557+0000 7f934261a640 1 -- 172.21.15.52:0/3287490255 shutdown_connections 2023-11-05T08:07:15.574 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.557+0000 7f934261a640 1 -- 172.21.15.52:0/3287490255 wait complete. 2023-11-05T08:07:15.574 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.558+0000 7f934261a640 10 monclient: build_initial_monmap 2023-11-05T08:07:15.575 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.558+0000 7f934261a640 10 monclient: monmap: 2023-11-05T08:07:15.575 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:07:15.575 INFO:teuthology.orchestra.run.smithi052.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-05T08:07:15.575 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 0.000000 2023-11-05T08:07:15.575 INFO:teuthology.orchestra.run.smithi052.stderr:created 0.000000 2023-11-05T08:07:15.576 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:07:15.576 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:15.576 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.noname-a 2023-11-05T08:07:15.576 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.noname-b 2023-11-05T08:07:15.576 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-c 2023-11-05T08:07:15.576 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:15.577 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.558+0000 7f934261a640 1 librados: starting msgr at 2023-11-05T08:07:15.577 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.558+0000 7f934261a640 1 librados: starting objecter 2023-11-05T08:07:15.577 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.558+0000 7f934261a640 1 Processor -- start 2023-11-05T08:07:15.577 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.559+0000 7f934261a640 1 -- start start 2023-11-05T08:07:15.577 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.559+0000 7f934261a640 1 librados: setting wanted keys 2023-11-05T08:07:15.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.559+0000 7f934261a640 1 librados: calling monclient init 2023-11-05T08:07:15.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.559+0000 7f934261a640 10 monclient: init 2023-11-05T08:07:15.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.559+0000 7f934261a640 10 monclient: _reopen_session rank -1 2023-11-05T08:07:15.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.559+0000 7f934261a640 10 monclient: _add_conns ranks=[0,2,1] 2023-11-05T08:07:15.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.559+0000 7f934261a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f933c071bd0 0x7f933c137a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:15.579 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.559+0000 7f934261a640 10 monclient(hunting): picked mon.noname-a con 0x7f933c071bd0 addr [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] 2023-11-05T08:07:15.579 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.559+0000 7f934261a640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f933c0ac830 0x7f933c1d59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:15.579 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.559+0000 7f934261a640 10 monclient(hunting): picked mon.noname-c con 0x7f933c0ac830 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:07:15.579 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.559+0000 7f934261a640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f933c13e640 0x7f933c1d2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:15.579 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.559+0000 7f934261a640 10 monclient(hunting): picked mon.noname-b con 0x7f933c13e640 addr [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] 2023-11-05T08:07:15.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.559+0000 7f934261a640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:15.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.559+0000 7f934261a640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f933c1d6940 con 0x7f933c071bd0 2023-11-05T08:07:15.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.559+0000 7f934261a640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:15.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.559+0000 7f934261a640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f933c1387b0 con 0x7f933c13e640 2023-11-05T08:07:15.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.559+0000 7f934261a640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:15.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.559+0000 7f934261a640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f933c1d6440 con 0x7f933c0ac830 2023-11-05T08:07:15.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.559+0000 7f934261a640 10 monclient(hunting): _renew_subs 2023-11-05T08:07:15.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.559+0000 7f934261a640 10 monclient(hunting): authenticate will time out at 1381.765904s 2023-11-05T08:07:15.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.560+0000 7f9340bb7640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f933c13e640 0x7f933c1d2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:15.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.561+0000 7f9340bb7640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f933c13e640 0x7f933c1d2460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.52:59338/0 (socket says 172.21.15.52:59338) 2023-11-05T08:07:15.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.561+0000 7f9340bb7640 1 -- 172.21.15.52:0/590650517 learned_addr learned my addr 172.21.15.52:0/590650517 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-11-05T08:07:15.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.561+0000 7f9340bb7640 10 monclient(hunting): get_auth_request con 0x7f933c13e640 auth_method 0 2023-11-05T08:07:15.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.561+0000 7f9340bb7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:15.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.561+0000 7f9340bb7640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:15.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.561+0000 7f9340bb7640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:15.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.561+0000 7f933bfff640 1 --2- 172.21.15.52:0/590650517 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f933c071bd0 0x7f933c137a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:15.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.561+0000 7f933bfff640 10 monclient(hunting): get_auth_request con 0x7f933c071bd0 auth_method 0 2023-11-05T08:07:15.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.561+0000 7f933bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:15.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.561+0000 7f933bfff640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:15.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.561+0000 7f933bfff640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:15.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.561+0000 7f9340bb7640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:15.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.561+0000 7f9340bb7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:15.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.561+0000 7f9340bb7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:15.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.562+0000 7f933bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:15.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.562+0000 7f933bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:15.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.562+0000 7f933bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:15.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.562+0000 7f933b7fe640 1 --2- 172.21.15.52:0/590650517 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f933c0ac830 0x7f933c1d59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:15.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.562+0000 7f933b7fe640 10 monclient(hunting): get_auth_request con 0x7f933c0ac830 auth_method 0 2023-11-05T08:07:15.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.562+0000 7f933b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:15.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.562+0000 7f933b7fe640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:15.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.562+0000 7f933b7fe640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:15.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.563+0000 7f933b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:15.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.563+0000 7f933b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:15.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.563+0000 7f933b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:15.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.564+0000 7f9340bb7640 10 monclient(hunting): handle_auth_done global_id 4402 payload 824 2023-11-05T08:07:15.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.564+0000 7f9340bb7640 1 -- 172.21.15.52:0/590650517 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f933c0ac830 msgr2=0x7f933c1d59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:15.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.564+0000 7f9340bb7640 1 --2- 172.21.15.52:0/590650517 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f933c0ac830 0x7f933c1d59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:15.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.564+0000 7f9340bb7640 1 -- 172.21.15.52:0/590650517 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f933c071bd0 msgr2=0x7f933c137a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:15.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.564+0000 7f9340bb7640 1 --2- 172.21.15.52:0/590650517 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f933c071bd0 0x7f933c137a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:15.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.564+0000 7f9340bb7640 10 monclient: _finish_hunting 0 2023-11-05T08:07:15.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.564+0000 7f9340bb7640 1 monclient: found mon.noname-b 2023-11-05T08:07:15.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.564+0000 7f9340bb7640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:07:15.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.564+0000 7f9340bb7640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.156:3300/0 2023-11-05T08:07:15.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.564+0000 7f9340bb7640 1 -- 172.21.15.52:0/590650517 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f932c009400 con 0x7f933c13e640 2023-11-05T08:07:15.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.566+0000 7f9340bb7640 1 --2- 172.21.15.52:0/590650517 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f933c13e640 0x7f933c1d2460 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f933400c790 tx=0x7f933400cc50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:15.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.566+0000 7f9338ff9640 10 client.?.objecter ms_handle_connect 0x7f933c13e640 2023-11-05T08:07:15.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.566+0000 7f9338ff9640 10 client.?.objecter resend_mon_ops 2023-11-05T08:07:15.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.570+0000 7f9338ff9640 1 -- 172.21.15.52:0/590650517 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f933400cea0 con 0x7f933c13e640 2023-11-05T08:07:15.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.570+0000 7f9338ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:15.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.570+0000 7f9338ff9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-05T08:07:15.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.570+0000 7f9338ff9640 10 monclient: dump: 2023-11-05T08:07:15.591 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:15.591 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:15.592 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:15.592 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:15.592 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:15.592 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:15.592 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:15.592 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:15.593 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:15.593 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:15.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.570+0000 7f9338ff9640 10 monclient: _finish_auth 0 2023-11-05T08:07:15.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.570+0000 7f9338ff9640 10 monclient: _check_auth_tickets 2023-11-05T08:07:15.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.570+0000 7f9338ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:07:15.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.570+0000 7f9338ff9640 1 -- 172.21.15.52:0/590650517 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9334003b70 con 0x7f933c13e640 2023-11-05T08:07:15.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.570+0000 7f934261a640 5 monclient: authenticate success, global_id 4402 2023-11-05T08:07:15.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.570+0000 7f9338ff9640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:07:15.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.570+0000 7f9338ff9640 1 -- 172.21.15.52:0/590650517 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f933400a850 con 0x7f933c13e640 2023-11-05T08:07:15.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.570+0000 7f9338ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:15.595 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.570+0000 7f9338ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-05T08:07:15.595 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.570+0000 7f9338ff9640 10 monclient: dump: 2023-11-05T08:07:15.595 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:15.595 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:15.595 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:15.596 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:15.596 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:15.596 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:15.596 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:15.596 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:15.597 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:15.597 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:15.597 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.570+0000 7f933a7fc640 4 set_mon_vals no callback set 2023-11-05T08:07:15.597 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.570+0000 7f934261a640 10 monclient: _renew_subs 2023-11-05T08:07:15.597 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.570+0000 7f934261a640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:07:15.598 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.570+0000 7f934261a640 1 -- 172.21.15.52:0/590650517 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f933c1d5f00 con 0x7f933c13e640 2023-11-05T08:07:15.598 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.570+0000 7f934261a640 10 client.4402.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-05T08:07:15.598 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.570+0000 7f934261a640 10 monclient: _renew_subs 2023-11-05T08:07:15.598 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.570+0000 7f934261a640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:07:15.598 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.570+0000 7f934261a640 1 -- 172.21.15.52:0/590650517 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f933c1d29a0 con 0x7f933c13e640 2023-11-05T08:07:15.599 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.570+0000 7f934261a640 1 librados: init done 2023-11-05T08:07:15.599 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.571+0000 7f934261a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-05T08:07:15.599 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.571+0000 7f934261a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:07:15.599 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.571+0000 7f934261a640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:07:15.599 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.571+0000 7f934261a640 1 -- 172.21.15.52:0/590650517 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f933c1d6600 con 0x7f933c13e640 2023-11-05T08:07:15.600 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.589+0000 7f9338ff9640 1 -- 172.21.15.52:0/590650517 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f933400a9b0 con 0x7f933c13e640 2023-11-05T08:07:15.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.589+0000 7f9338ff9640 1 --2- 172.21.15.52:0/590650517 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f931c06c800 0x7f931c06ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:15.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.590+0000 7f933bfff640 1 --2- 172.21.15.52:0/590650517 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f931c06c800 0x7f931c06ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:15.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.590+0000 7f933bfff640 10 monclient: get_auth_request con 0x7f931c06c800 auth_method 0 2023-11-05T08:07:15.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.590+0000 7f933bfff640 1 --2- 172.21.15.52:0/590650517 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f931c06c800 0x7f931c06ecc0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9324005880 tx=0x7f9324009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:15.602 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.590+0000 7f9338ff9640 10 client.4402.objecter ms_handle_connect 0x7f931c06c800 2023-11-05T08:07:15.602 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.593+0000 7f9338ff9640 1 -- 172.21.15.52:0/590650517 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f9334058d20 con 0x7f933c13e640 2023-11-05T08:07:15.602 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.593+0000 7f9338ff9640 10 client.4402.objecter ms_dispatch 0x7f933c000b90 osd_map(23..23 src has 1..23) v4 2023-11-05T08:07:15.602 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.593+0000 7f9338ff9640 3 client.4402.objecter handle_osd_map got epochs [23,23] > 0 2023-11-05T08:07:15.602 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.593+0000 7f9338ff9640 3 client.4402.objecter handle_osd_map decoding full epoch 23 2023-11-05T08:07:15.603 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.593+0000 7f9338ff9640 20 client.4402.objecter dump_active .. 0 homeless 2023-11-05T08:07:15.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.867+0000 7f9338ff9640 1 -- 172.21.15.52:0/590650517 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9334055060 con 0x7f933c13e640 2023-11-05T08:07:15.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.867+0000 7f9338ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:07:15.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:15.867+0000 7f9338ff9640 10 monclient: _finish_command 1 = system:0 2023-11-05T08:07:16.042 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.040+0000 7f934261a640 1 -- 172.21.15.52:0/590650517 --> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f933c13c1a0 con 0x7f931c06c800 2023-11-05T08:07:16.044 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.043+0000 7f9338ff9640 1 -- 172.21.15.52:0/590650517 <== mgr.4108 v2:172.21.15.156:6800/3320012339 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48008 (secure 0 0 0) 0x7f932400f820 con 0x7f931c06c800 2023-11-05T08:07:16.045 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:07:16.045 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2023-11-05T08:07:16.046 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.044+0000 7f934261a640 10 librados: watch_flush enter 2023-11-05T08:07:16.047 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.044+0000 7f934261a640 10 librados: watch_flush exit 2023-11-05T08:07:16.047 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.044+0000 7f934261a640 20 client.4402.objecter shutdown clearing up homeless session... 2023-11-05T08:07:16.047 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.044+0000 7f934261a640 10 client.4402.objecter successfully canceled tick 2023-11-05T08:07:16.047 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.044+0000 7f934261a640 1 -- 172.21.15.52:0/590650517 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f931c06c800 msgr2=0x7f931c06ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:16.048 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.044+0000 7f934261a640 1 --2- 172.21.15.52:0/590650517 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f931c06c800 0x7f931c06ecc0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9324005880 tx=0x7f9324009040 comp rx=0 tx=0).stop 2023-11-05T08:07:16.048 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.044+0000 7f934261a640 10 monclient: shutdown 2023-11-05T08:07:16.048 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.044+0000 7f934261a640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:07:16.048 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.044+0000 7f934261a640 1 -- 172.21.15.52:0/590650517 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f933c13e640 msgr2=0x7f933c1d2460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:16.048 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.044+0000 7f934261a640 1 --2- 172.21.15.52:0/590650517 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f933c13e640 0x7f933c1d2460 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f933400c790 tx=0x7f933400cc50 comp rx=0 tx=0).stop 2023-11-05T08:07:16.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.044+0000 7f934261a640 1 -- 172.21.15.52:0/590650517 shutdown_connections 2023-11-05T08:07:16.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.044+0000 7f934261a640 1 --2- 172.21.15.52:0/590650517 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f931c06c800 0x7f931c06ecc0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:16.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.044+0000 7f934261a640 1 --2- 172.21.15.52:0/590650517 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f933c13e640 0x7f933c1d2460 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:16.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.044+0000 7f934261a640 1 --2- 172.21.15.52:0/590650517 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f933c0ac830 0x7f933c1d59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:16.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.044+0000 7f934261a640 1 --2- 172.21.15.52:0/590650517 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f933c071bd0 0x7f933c137a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:16.050 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.044+0000 7f934261a640 1 -- 172.21.15.52:0/590650517 >> 172.21.15.52:0/590650517 conn(0x7f933c0b2ff0 msgr2=0x7f933c0a84b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:07:16.050 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.044+0000 7f934261a640 1 -- 172.21.15.52:0/590650517 shutdown_connections 2023-11-05T08:07:16.050 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.044+0000 7f934261a640 1 -- 172.21.15.52:0/590650517 wait complete. 2023-11-05T08:07:16.050 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.044+0000 7f934261a640 1 librados: shutdown 2023-11-05T08:07:16.056 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2023-11-05T08:07:15.121720+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":113,"num_write_kb":1372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218960,"kb_used_data":2596,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755760,"statfs":{"total":773094113280,"available":772869898240,"internally_reserved":0,"allocated":2658304,"data_stored":1434788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":76,"apply_latency_ms":76,"commit_latency_ns":76000000,"apply_latency_ns":76000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":196608,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":45,"num_write":59,"num_write_kb":980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001530"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-05T08:07:09.443866+0000","last_change":"2023-11-05T08:07:07.897554+0000","last_active":"2023-11-05T08:07:09.443866+0000","last_peered":"2023-11-05T08:07:09.443866+0000","last_clean":"2023-11-05T08:07:09.443866+0000","last_became_active":"2023-11-05T08:07:07.890422+0000","last_became_peered":"2023-11-05T08:07:07.890422+0000","last_unstale":"2023-11-05T08:07:09.443866+0000","last_undegraded":"2023-11-05T08:07:09.443866+0000","last_fullsized":"2023-11-05T08:07:09.443866+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:07:05.115520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:07:05.115520+0000","last_clean_scrub_stamp":"2023-11-05T08:07:05.115520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T18:33:54.492130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-05T08:07:09.424252+0000","last_change":"2023-11-05T08:07:07.935570+0000","last_active":"2023-11-05T08:07:09.424252+0000","last_peered":"2023-11-05T08:07:09.424252+0000","last_clean":"2023-11-05T08:07:09.424252+0000","last_became_active":"2023-11-05T08:07:07.908128+0000","last_became_peered":"2023-11-05T08:07:07.908128+0000","last_unstale":"2023-11-05T08:07:09.424252+0000","last_undegraded":"2023-11-05T08:07:09.424252+0000","last_fullsized":"2023-11-05T08:07:09.424252+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:07:05.115520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:07:05.115520+0000","last_clean_scrub_stamp":"2023-11-05T08:07:05.115520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T15:25:37.194219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-05T08:07:09.439568+0000","last_change":"2023-11-05T08:07:07.213210+0000","last_active":"2023-11-05T08:07:09.439568+0000","last_peered":"2023-11-05T08:07:09.439568+0000","last_clean":"2023-11-05T08:07:09.439568+0000","last_became_active":"2023-11-05T08:07:07.203649+0000","last_became_peered":"2023-11-05T08:07:07.203649+0000","last_unstale":"2023-11-05T08:07:09.439568+0000","last_undegraded":"2023-11-05T08:07:09.439568+0000","last_fullsized":"2023-11-05T08:07:09.439568+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:07:05.115520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:07:05.115520+0000","last_clean_scrub_stamp":"2023-11-05T08:07:05.115520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T13:05:27.884687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-05T08:07:09.368931+0000","last_change":"2023-11-05T08:07:07.403639+0000","last_active":"2023-11-05T08:07:09.368931+0000","last_peered":"2023-11-05T08:07:09.368931+0000","last_clean":"2023-11-05T08:07:09.368931+0000","last_became_active":"2023-11-05T08:07:07.371569+0000","last_became_peered":"2023-11-05T08:07:07.371569+0000","last_unstale":"2023-11-05T08:07:09.368931+0000","last_undegraded":"2023-11-05T08:07:09.368931+0000","last_fullsized":"2023-11-05T08:07:09.368931+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:07:05.115520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:07:05.115520+0000","last_clean_scrub_stamp":"2023-11-05T08:07:05.115520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T14:58:41.385179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-05T08:07:09.427353+0000","last_change":"2023-11-05T08:07:07.350626+0000","last_active":"2023-11-05T08:07:09.427353+0000","last_peered":"2023-11-05T08:07:09.427353+0000","last_clean":"2023-11-05T08:07:09.427353+0000","last_became_active":"2023-11-05T08:07:07.344890+0000","last_became_peered":"2023-11-05T08:07:07.344890+0000","last_unstale":"2023-11-05T08:07:09.427353+0000","last_undegraded":"2023-11-05T08:07:09.427353+0000","last_fullsized":"2023-11-05T08:07:09.427353+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:07:05.115520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:07:05.115520+0000","last_clean_scrub_stamp":"2023-11-05T08:07:05.115520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T10:17:35.666271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-05T08:07:10.291382+0000","last_change":"2023-11-05T08:07:07.085537+0000","last_active":"2023-11-05T08:07:10.291382+0000","last_peered":"2023-11-05T08:07:10.291382+0000","last_clean":"2023-11-05T08:07:10.291382+0000","last_became_active":"2023-11-05T08:07:07.051923+0000","last_became_peered":"2023-11-05T08:07:07.051923+0000","last_unstale":"2023-11-05T08:07:10.291382+0000","last_undegraded":"2023-11-05T08:07:10.291382+0000","last_fullsized":"2023-11-05T08:07:10.291382+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:07:05.115520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:07:05.115520+0000","last_clean_scrub_stamp":"2023-11-05T08:07:05.115520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T09:32:20.473313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-05T08:07:09.419103+0000","last_change":"2023-11-05T08:07:07.161269+0000","last_active":"2023-11-05T08:07:09.419103+0000","last_peered":"2023-11-05T08:07:09.419103+0000","last_clean":"2023-11-05T08:07:09.419103+0000","last_became_active":"2023-11-05T08:07:07.131650+0000","last_became_peered":"2023-11-05T08:07:07.131650+0000","last_unstale":"2023-11-05T08:07:09.419103+0000","last_undegraded":"2023-11-05T08:07:09.419103+0000","last_fullsized":"2023-11-05T08:07:09.419103+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:07:05.115520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:07:05.115520+0000","last_clean_scrub_stamp":"2023-11-05T08:07:05.115520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T11:45:49.611005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-05T08:07:09.435336+0000","last_change":"2023-11-05T08:07:07.482345+0000","last_active":"2023-11-05T08:07:09.435336+0000","last_peered":"2023-11-05T08:07:09.435336+0000","last_clean":"2023-11-05T08:07:09.435336+0000","last_became_active":"2023-11-05T08:07:07.467692+0000","last_became_peered":"2023-11-05T08:07:07.467692+0000","last_unstale":"2023-11-05T08:07:09.435336+0000","last_undegraded":"2023-11-05T08:07:09.435336+0000","last_fullsized":"2023-11-05T08:07:09.435336+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:07:05.115520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:07:05.115520+0000","last_clean_scrub_stamp":"2023-11-05T08:07:05.115520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T09:41:35.204221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"23'76","reported_seq":119,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-05T08:07:12.149672+0000","last_change":"2023-11-05T08:07:00.997710+0000","last_active":"2023-11-05T08:07:12.149672+0000","last_peered":"2023-11-05T08:07:12.149672+0000","last_clean":"2023-11-05T08:07:12.149672+0000","last_became_active":"2023-11-05T08:07:00.966209+0000","last_became_peered":"2023-11-05T08:07:00.966209+0000","last_unstale":"2023-11-05T08:07:12.149672+0000","last_undegraded":"2023-11-05T08:07:12.149672+0000","last_fullsized":"2023-11-05T08:07:12.149672+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:06:58.242946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:06:58.242946+0000","last_clean_scrub_stamp":"2023-11-05T08:06:58.242946+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T10:17:50.722686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":113,"num_write_kb":1372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":113,"num_write_kb":1372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":802816,"data_stored":795680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":0,"up_from":16,"seq":68719476743,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":80607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":21.210999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":16.187999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":39.198999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":35.924999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":18.622}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":20.407}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":33.511000000000003}]}]},{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":80607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":9.3770000000000007}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":11.49}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":13.637}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":20.088999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":15.210000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":12.109999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":21.067}]}]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":233472,"data_stored":80607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":14.583}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":12.044}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":19.957999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":9.1699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":12.705}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":18.704000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":15.901}]}]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":620,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":634880,"data_stored":478447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":43,"apply_latency_ms":43,"commit_latency_ns":43000000,"apply_latency_ns":43000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":8.2129999999999992}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":25.608000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":23.015000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":24.027999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":21.545000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":20.036999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":19.393999999999998}]}]},{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":80607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":25.545000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":23.855}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.907}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":21.457999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":18.983000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":17.276}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":23.148}]}]},{"osd":5,"up_from":14,"seq":60129542150,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27644,"kb_used_data":620,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344196,"statfs":{"total":96636764160,"available":96608456704,"internally_reserved":0,"allocated":634880,"data_stored":478447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":13.169}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":10.898}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":12.323}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":16.960999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":18.763000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":22.872}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":21.562999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542151,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":233472,"data_stored":80607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":10.898999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":9.3650000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":15.781000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.9610000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":17.215}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":12.362}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":16.609000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":74859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":8.7669999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":10.676}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":26.402000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":27.256}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":14.792}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":11.099}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":12.324}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-05T08:07:16.059 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-05T08:07:16.167 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.166+0000 7f4fab39e640 10 monclient: get_monmap_and_config 2023-11-05T08:07:16.168 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.166+0000 7f4fab39e640 10 monclient: build_initial_monmap 2023-11-05T08:07:16.168 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.166+0000 7f4fab39e640 10 monclient: monmap: 2023-11-05T08:07:16.168 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:07:16.168 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:16.169 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:07:16.167749+0000 2023-11-05T08:07:16.169 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:07:16.167749+0000 2023-11-05T08:07:16.169 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:07:16.169 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:16.169 INFO:teuthology.orchestra.run.smithi052.stderr:0: v1:172.21.15.52:6789/0 mon.noname-a-legacy 2023-11-05T08:07:16.169 INFO:teuthology.orchestra.run.smithi052.stderr:1: v1:172.21.15.156:6789/0 mon.noname-c-legacy 2023-11-05T08:07:16.170 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-b 2023-11-05T08:07:16.170 INFO:teuthology.orchestra.run.smithi052.stderr:3: v2:172.21.15.52:3300/0 mon.noname-a 2023-11-05T08:07:16.170 INFO:teuthology.orchestra.run.smithi052.stderr:4: v2:172.21.15.156:3300/0 mon.noname-c 2023-11-05T08:07:16.170 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:16.173 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.166+0000 7f4fab39e640 1 Processor -- start 2023-11-05T08:07:16.173 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.167+0000 7f4fab39e640 1 -- start start 2023-11-05T08:07:16.173 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.167+0000 7f4fab39e640 10 monclient: init 2023-11-05T08:07:16.173 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.167+0000 7f4fab39e640 10 monclient: _reopen_session rank -1 2023-11-05T08:07:16.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.167+0000 7f4fab39e640 10 monclient: _add_conns ranks=[0,1,2,4,3] 2023-11-05T08:07:16.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.167+0000 7f4fab39e640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f4fa40b4240 addr v1:172.21.15.52:6789/0 2023-11-05T08:07:16.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.167+0000 7f4fab39e640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f4fa40b38d0 addr v1:172.21.15.156:6789/0 2023-11-05T08:07:16.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.167+0000 7f4fab39e640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4fa40ade00 0x7f4fa413b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:16.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.167+0000 7f4fab39e640 10 monclient(hunting): picked mon.noname-b con 0x7f4fa40ade00 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:07:16.175 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.167+0000 7f4fab39e640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fa40b0cc0 con 0x7f4fa40b4240 2023-11-05T08:07:16.175 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.167+0000 7f4fab39e640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fa413f5f0 con 0x7f4fa40b38d0 2023-11-05T08:07:16.175 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.167+0000 7f4fab39e640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:16.175 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.167+0000 7f4fab39e640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa40b4620 con 0x7f4fa40ade00 2023-11-05T08:07:16.175 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.167+0000 7f4fab39e640 10 monclient(hunting): _renew_subs 2023-11-05T08:07:16.175 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.167+0000 7f4fab39e640 10 monclient(hunting): authenticate will time out at 1382.373819s 2023-11-05T08:07:16.176 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.168+0000 7f4fa993b640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4fa40ade00 0x7f4fa413b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:16.176 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.168+0000 7f4fa913a640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f4fa40b4240 0x7f4fa40b1150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:47138/0 (socket says 172.21.15.52:47138) 2023-11-05T08:07:16.176 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.168+0000 7f4fa913a640 1 -- 172.21.15.52:0/4212566058 learned_addr learned my addr 172.21.15.52:0/4212566058 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-11-05T08:07:16.176 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.168+0000 7f4fa993b640 10 monclient(hunting): get_auth_request con 0x7f4fa40ade00 auth_method 0 2023-11-05T08:07:16.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.168+0000 7f4fa993b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:16.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.168+0000 7f4fa993b640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:16.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.168+0000 7f4fa993b640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:16.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.169+0000 7f4fa993b640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:16.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.169+0000 7f4fa993b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:16.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.169+0000 7f4fa993b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:16.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.171+0000 7f4fa993b640 10 monclient(hunting): handle_auth_done global_id 4301 payload 274 2023-11-05T08:07:16.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.171+0000 7f4fa993b640 1 -- 172.21.15.52:0/4212566058 >> v1:172.21.15.156:6789/0 conn(0x7f4fa40b38d0 legacy=0x7f4fa40ae640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:16.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.171+0000 7f4fa993b640 1 -- 172.21.15.52:0/4212566058 >> v1:172.21.15.52:6789/0 conn(0x7f4fa40b4240 legacy=0x7f4fa40b1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:16.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.171+0000 7f4fa993b640 10 monclient: _finish_hunting 0 2023-11-05T08:07:16.179 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.171+0000 7f4f9bfff640 1 -- 172.21.15.52:0/4212566058 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1836925247 0 0) 0x7f4fa40b0cc0 con 0x7f4fa40b4240 2023-11-05T08:07:16.179 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.171+0000 7f4fa993b640 1 monclient: found mon.noname-b 2023-11-05T08:07:16.179 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.171+0000 7f4fa993b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:07:16.179 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.171+0000 7f4fa993b640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.52:3301/0 2023-11-05T08:07:16.179 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.171+0000 7f4fa993b640 1 -- 172.21.15.52:0/4212566058 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fa413b960 con 0x7f4fa40ade00 2023-11-05T08:07:16.180 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.171+0000 7f4f9bfff640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) v1 2023-11-05T08:07:16.183 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.173+0000 7f4fa993b640 1 --2- 172.21.15.52:0/4212566058 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4fa40ade00 0x7f4fa413b420 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c009df0 tx=0x7f4f9c02be70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e4efc9bce1a927d server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:16.183 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.177+0000 7f4f9bfff640 1 -- 172.21.15.52:0/4212566058 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f9c02cc20 con 0x7f4fa40ade00 2023-11-05T08:07:16.183 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.177+0000 7f4f9bfff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:16.184 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.177+0000 7f4f9bfff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-05T08:07:16.184 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.177+0000 7f4f9bfff640 10 monclient: dump: 2023-11-05T08:07:16.184 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:16.184 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:16.185 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:16.185 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:16.185 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:16.185 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:16.185 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:16.186 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:16.186 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:16.186 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:16.186 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.177+0000 7f4f9bfff640 10 monclient: _finish_auth 0 2023-11-05T08:07:16.186 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.177+0000 7f4f9bfff640 10 monclient: _check_auth_tickets 2023-11-05T08:07:16.187 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.177+0000 7f4f9bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:07:16.187 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.177+0000 7f4f9bfff640 1 -- 172.21.15.52:0/4212566058 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f9c02cd80 con 0x7f4fa40ade00 2023-11-05T08:07:16.187 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.177+0000 7f4f9bfff640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:07:16.187 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.177+0000 7f4f9bfff640 1 -- 172.21.15.52:0/4212566058 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f9c034660 con 0x7f4fa40ade00 2023-11-05T08:07:16.187 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.177+0000 7f4f9bfff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:16.188 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.177+0000 7f4f9bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-11-05T08:07:16.188 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.177+0000 7f4f9bfff640 10 monclient: dump: 2023-11-05T08:07:16.188 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:16.188 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:16.188 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:16.189 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:16.189 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:16.189 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:16.189 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:16.190 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:16.190 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:16.190 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:16.190 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.177+0000 7f4fab39e640 5 monclient: authenticate success, global_id 4301 2023-11-05T08:07:16.190 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.177+0000 7f4fab39e640 10 monclient: get_monmap_and_config success 2023-11-05T08:07:16.191 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.177+0000 7f4fab39e640 4 set_mon_vals no callback set 2023-11-05T08:07:16.191 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.178+0000 7f4fab39e640 10 monclient: shutdown 2023-11-05T08:07:16.191 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.178+0000 7f4fab39e640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:07:16.191 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.178+0000 7f4fab39e640 1 -- 172.21.15.52:0/4212566058 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4fa40ade00 msgr2=0x7f4fa413b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:16.191 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.178+0000 7f4fab39e640 1 --2- 172.21.15.52:0/4212566058 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4fa40ade00 0x7f4fa413b420 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c009df0 tx=0x7f4f9c02be70 comp rx=0 tx=0).stop 2023-11-05T08:07:16.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.178+0000 7f4fab39e640 1 -- 172.21.15.52:0/4212566058 shutdown_connections 2023-11-05T08:07:16.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.178+0000 7f4fab39e640 1 --2- 172.21.15.52:0/4212566058 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4fa40ade00 0x7f4fa413b420 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:16.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.178+0000 7f4fab39e640 1 -- 172.21.15.52:0/4212566058 >> 172.21.15.52:0/4212566058 conn(0x7f4fa4065cd0 msgr2=0x7f4fa40660e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:07:16.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.178+0000 7f4fab39e640 1 -- 172.21.15.52:0/4212566058 shutdown_connections 2023-11-05T08:07:16.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.178+0000 7f4fab39e640 1 -- 172.21.15.52:0/4212566058 wait complete. 2023-11-05T08:07:16.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.179+0000 7f4fab39e640 10 monclient: build_initial_monmap 2023-11-05T08:07:16.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.179+0000 7f4fab39e640 10 monclient: monmap: 2023-11-05T08:07:16.193 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:07:16.193 INFO:teuthology.orchestra.run.smithi052.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-05T08:07:16.193 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 0.000000 2023-11-05T08:07:16.194 INFO:teuthology.orchestra.run.smithi052.stderr:created 0.000000 2023-11-05T08:07:16.194 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:07:16.194 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:16.194 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.noname-a 2023-11-05T08:07:16.194 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.noname-b 2023-11-05T08:07:16.195 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-c 2023-11-05T08:07:16.195 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:16.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.179+0000 7f4fab39e640 1 librados: starting msgr at 2023-11-05T08:07:16.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.179+0000 7f4fab39e640 1 librados: starting objecter 2023-11-05T08:07:16.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.179+0000 7f4fab39e640 1 Processor -- start 2023-11-05T08:07:16.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.179+0000 7f4fab39e640 1 -- start start 2023-11-05T08:07:16.196 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.179+0000 7f4fab39e640 1 librados: setting wanted keys 2023-11-05T08:07:16.196 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.179+0000 7f4fab39e640 1 librados: calling monclient init 2023-11-05T08:07:16.196 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.179+0000 7f4fab39e640 10 monclient: init 2023-11-05T08:07:16.196 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.180+0000 7f4fab39e640 10 monclient: _reopen_session rank -1 2023-11-05T08:07:16.197 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.180+0000 7f4fab39e640 10 monclient: _add_conns ranks=[1,0,2] 2023-11-05T08:07:16.197 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.180+0000 7f4fab39e640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4fa40ade00 0x7f4fa41d9af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:16.197 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.180+0000 7f4fab39e640 10 monclient(hunting): picked mon.noname-b con 0x7f4fa40ade00 addr [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] 2023-11-05T08:07:16.197 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.180+0000 7f4fab39e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4fa40b4240 0x7f4fa413c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:16.197 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.180+0000 7f4fab39e640 10 monclient(hunting): picked mon.noname-a con 0x7f4fa40b4240 addr [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] 2023-11-05T08:07:16.198 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.180+0000 7f4fab39e640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4fa4136990 0x7f4fa41da0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:16.198 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.180+0000 7f4fab39e640 10 monclient(hunting): picked mon.noname-c con 0x7f4fa4136990 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:07:16.198 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.180+0000 7f4fab39e640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:16.198 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.180+0000 7f4fab39e640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa4137fe0 con 0x7f4fa40b4240 2023-11-05T08:07:16.198 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.180+0000 7f4fab39e640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:16.199 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.180+0000 7f4fab39e640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa4138230 con 0x7f4fa40ade00 2023-11-05T08:07:16.199 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.180+0000 7f4fab39e640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:16.199 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.180+0000 7f4fab39e640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa413e2c0 con 0x7f4fa4136990 2023-11-05T08:07:16.199 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.180+0000 7f4fab39e640 10 monclient(hunting): _renew_subs 2023-11-05T08:07:16.199 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.180+0000 7f4fab39e640 10 monclient(hunting): authenticate will time out at 1382.386063s 2023-11-05T08:07:16.200 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.180+0000 7f4fa993b640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4fa4136990 0x7f4fa41da0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:16.200 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.180+0000 7f4fa8939640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4fa40b4240 0x7f4fa413c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:16.200 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.180+0000 7f4fa993b640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4fa4136990 0x7f4fa41da0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.52:40554/0 (socket says 172.21.15.52:40554) 2023-11-05T08:07:16.200 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.180+0000 7f4fa993b640 1 -- 172.21.15.52:0/3304182991 learned_addr learned my addr 172.21.15.52:0/3304182991 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-11-05T08:07:16.200 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.180+0000 7f4fa993b640 10 monclient(hunting): get_auth_request con 0x7f4fa4136990 auth_method 0 2023-11-05T08:07:16.201 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.180+0000 7f4fa913a640 1 --2- 172.21.15.52:0/3304182991 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4fa40ade00 0x7f4fa41d9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:16.201 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.180+0000 7f4fa993b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:16.201 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.180+0000 7f4fa993b640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:16.201 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.180+0000 7f4fa993b640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:16.201 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.181+0000 7f4fa8939640 10 monclient(hunting): get_auth_request con 0x7f4fa40b4240 auth_method 0 2023-11-05T08:07:16.201 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.181+0000 7f4fa8939640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:16.202 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.181+0000 7f4fa8939640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:16.202 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.181+0000 7f4fa8939640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:16.202 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.181+0000 7f4fa913a640 10 monclient(hunting): get_auth_request con 0x7f4fa40ade00 auth_method 0 2023-11-05T08:07:16.202 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.181+0000 7f4fa913a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:16.202 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.181+0000 7f4fa913a640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:16.203 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.181+0000 7f4fa913a640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:16.203 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.181+0000 7f4fa993b640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:16.203 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.181+0000 7f4fa993b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:16.203 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.181+0000 7f4fa993b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:16.203 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.181+0000 7f4fa913a640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:16.204 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.181+0000 7f4fa913a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:16.204 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.181+0000 7f4fa913a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:16.204 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.181+0000 7f4fa8939640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:16.204 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.181+0000 7f4fa8939640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:16.204 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.181+0000 7f4fa8939640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:16.206 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.184+0000 7f4fa913a640 10 monclient(hunting): handle_auth_done global_id 4408 payload 824 2023-11-05T08:07:16.206 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.184+0000 7f4fa913a640 1 -- 172.21.15.52:0/3304182991 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4fa4136990 msgr2=0x7f4fa41da0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:16.206 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.184+0000 7f4fa913a640 1 --2- 172.21.15.52:0/3304182991 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4fa4136990 0x7f4fa41da0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:16.207 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.184+0000 7f4fa913a640 1 -- 172.21.15.52:0/3304182991 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4fa40b4240 msgr2=0x7f4fa413c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:16.207 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.184+0000 7f4fa913a640 1 --2- 172.21.15.52:0/3304182991 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4fa40b4240 0x7f4fa413c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:16.207 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.184+0000 7f4fa913a640 10 monclient: _finish_hunting 0 2023-11-05T08:07:16.207 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.184+0000 7f4fa913a640 1 monclient: found mon.noname-b 2023-11-05T08:07:16.207 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.184+0000 7f4fa913a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:07:16.208 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.184+0000 7f4fa913a640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.156:3300/0 2023-11-05T08:07:16.208 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.184+0000 7f4fa913a640 1 -- 172.21.15.52:0/3304182991 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f9c009a70 con 0x7f4fa40ade00 2023-11-05T08:07:16.208 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.186+0000 7f4fa913a640 1 --2- 172.21.15.52:0/3304182991 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4fa40ade00 0x7f4fa41d9af0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4fa000c410 tx=0x7f4fa000c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:16.208 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.186+0000 7f4f99ffb640 10 client.?.objecter ms_handle_connect 0x7f4fa40ade00 2023-11-05T08:07:16.208 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.186+0000 7f4f99ffb640 10 client.?.objecter resend_mon_ops 2023-11-05T08:07:16.208 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.190+0000 7f4f99ffb640 1 -- 172.21.15.52:0/3304182991 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa00074e0 con 0x7f4fa40ade00 2023-11-05T08:07:16.209 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.190+0000 7f4f99ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:16.209 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.190+0000 7f4f99ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-05T08:07:16.209 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.190+0000 7f4f99ffb640 10 monclient: dump: 2023-11-05T08:07:16.209 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:16.209 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:16.210 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:16.210 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:16.210 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:16.210 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:16.210 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:16.211 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:16.211 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:16.211 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:16.211 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.190+0000 7f4f99ffb640 10 monclient: _finish_auth 0 2023-11-05T08:07:16.211 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.190+0000 7f4f99ffb640 10 monclient: _check_auth_tickets 2023-11-05T08:07:16.211 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.190+0000 7f4f99ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:07:16.212 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.190+0000 7f4f99ffb640 1 -- 172.21.15.52:0/3304182991 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fa0007640 con 0x7f4fa40ade00 2023-11-05T08:07:16.212 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.190+0000 7f4f99ffb640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:07:16.212 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.190+0000 7f4f99ffb640 1 -- 172.21.15.52:0/3304182991 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa0004a20 con 0x7f4fa40ade00 2023-11-05T08:07:16.212 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.190+0000 7f4f99ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:16.212 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.190+0000 7f4f99ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-05T08:07:16.213 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.190+0000 7f4f99ffb640 10 monclient: dump: 2023-11-05T08:07:16.213 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:16.213 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:16.213 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:16.213 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:16.214 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:16.214 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:16.214 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:16.214 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:16.214 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:16.215 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:16.215 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.190+0000 7f4fab39e640 5 monclient: authenticate success, global_id 4408 2023-11-05T08:07:16.215 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.190+0000 7f4fab39e640 10 monclient: _renew_subs 2023-11-05T08:07:16.215 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.190+0000 7f4fab39e640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:07:16.215 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.190+0000 7f4fab39e640 1 -- 172.21.15.52:0/3304182991 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fa41da620 con 0x7f4fa40ade00 2023-11-05T08:07:16.215 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.190+0000 7f4f9b7fe640 4 set_mon_vals no callback set 2023-11-05T08:07:16.216 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.190+0000 7f4fab39e640 10 client.4408.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-05T08:07:16.216 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.190+0000 7f4fab39e640 10 monclient: _renew_subs 2023-11-05T08:07:16.216 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.190+0000 7f4fab39e640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:07:16.216 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.190+0000 7f4fab39e640 1 -- 172.21.15.52:0/3304182991 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fa4135510 con 0x7f4fa40ade00 2023-11-05T08:07:16.216 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.190+0000 7f4fab39e640 1 librados: init done 2023-11-05T08:07:16.216 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.191+0000 7f4fab39e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-05T08:07:16.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.191+0000 7f4fab39e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:07:16.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.191+0000 7f4fab39e640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:07:16.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.191+0000 7f4fab39e640 1 -- 172.21.15.52:0/3304182991 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fa413ef00 con 0x7f4fa40ade00 2023-11-05T08:07:16.218 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.209+0000 7f4f99ffb640 1 -- 172.21.15.52:0/3304182991 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4fa0004b80 con 0x7f4fa40ade00 2023-11-05T08:07:16.218 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.209+0000 7f4f99ffb640 1 --2- 172.21.15.52:0/3304182991 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f4f8806c850 0x7f4f8806ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:16.218 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.210+0000 7f4fa8939640 1 --2- 172.21.15.52:0/3304182991 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f4f8806c850 0x7f4f8806ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:16.219 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.210+0000 7f4fa8939640 10 monclient: get_auth_request con 0x7f4f8806c850 auth_method 0 2023-11-05T08:07:16.219 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.210+0000 7f4f99ffb640 10 client.4408.objecter ms_handle_connect 0x7f4f8806c850 2023-11-05T08:07:16.219 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.210+0000 7f4fa8939640 1 --2- 172.21.15.52:0/3304182991 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f4f8806c850 0x7f4f8806ed10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4fa4137e80 tx=0x7f4f94009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:16.219 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.211+0000 7f4f99ffb640 1 -- 172.21.15.52:0/3304182991 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f4fa0058630 con 0x7f4fa40ade00 2023-11-05T08:07:16.219 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.211+0000 7f4f99ffb640 10 client.4408.objecter ms_dispatch 0x7f4fa4000b90 osd_map(23..23 src has 1..23) v4 2023-11-05T08:07:16.220 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.211+0000 7f4f99ffb640 3 client.4408.objecter handle_osd_map got epochs [23,23] > 0 2023-11-05T08:07:16.220 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.211+0000 7f4f99ffb640 3 client.4408.objecter handle_osd_map decoding full epoch 23 2023-11-05T08:07:16.220 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.211+0000 7f4f99ffb640 20 client.4408.objecter dump_active .. 0 homeless 2023-11-05T08:07:16.447 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.445+0000 7f4f99ffb640 1 -- 172.21.15.52:0/3304182991 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4fa0054970 con 0x7f4fa40ade00 2023-11-05T08:07:16.447 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.445+0000 7f4f99ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:07:16.448 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.445+0000 7f4f99ffb640 10 monclient: _finish_command 1 = system:0 2023-11-05T08:07:16.626 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.625+0000 7f4fab39e640 1 -- 172.21.15.52:0/3304182991 --> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4fa414d3d0 con 0x7f4f8806c850 2023-11-05T08:07:16.629 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.627+0000 7f4f99ffb640 1 -- 172.21.15.52:0/3304182991 <== mgr.4108 v2:172.21.15.156:6800/3320012339 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48008 (secure 0 0 0) 0x7f4f94001480 con 0x7f4f8806c850 2023-11-05T08:07:16.630 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:07:16.630 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2023-11-05T08:07:16.631 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.629+0000 7f4fab39e640 10 librados: watch_flush enter 2023-11-05T08:07:16.632 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.629+0000 7f4fab39e640 10 librados: watch_flush exit 2023-11-05T08:07:16.632 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.629+0000 7f4fab39e640 20 client.4408.objecter shutdown clearing up homeless session... 2023-11-05T08:07:16.632 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.629+0000 7f4fab39e640 10 client.4408.objecter successfully canceled tick 2023-11-05T08:07:16.632 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.629+0000 7f4fab39e640 1 -- 172.21.15.52:0/3304182991 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f4f8806c850 msgr2=0x7f4f8806ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:16.633 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.629+0000 7f4fab39e640 1 --2- 172.21.15.52:0/3304182991 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f4f8806c850 0x7f4f8806ed10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4fa4137e80 tx=0x7f4f94009040 comp rx=0 tx=0).stop 2023-11-05T08:07:16.633 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.629+0000 7f4fab39e640 10 monclient: shutdown 2023-11-05T08:07:16.633 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.629+0000 7f4fab39e640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:07:16.633 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.629+0000 7f4fab39e640 1 -- 172.21.15.52:0/3304182991 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4fa40ade00 msgr2=0x7f4fa41d9af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:16.633 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.629+0000 7f4fab39e640 1 --2- 172.21.15.52:0/3304182991 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4fa40ade00 0x7f4fa41d9af0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4fa000c410 tx=0x7f4fa000c8d0 comp rx=0 tx=0).stop 2023-11-05T08:07:16.633 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.629+0000 7f4fab39e640 1 -- 172.21.15.52:0/3304182991 shutdown_connections 2023-11-05T08:07:16.634 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.629+0000 7f4fab39e640 1 --2- 172.21.15.52:0/3304182991 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f4f8806c850 0x7f4f8806ed10 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:16.634 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.629+0000 7f4fab39e640 1 --2- 172.21.15.52:0/3304182991 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4fa4136990 0x7f4fa41da0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:16.634 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.629+0000 7f4fab39e640 1 --2- 172.21.15.52:0/3304182991 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4fa40b4240 0x7f4fa413c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:16.634 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.629+0000 7f4fab39e640 1 --2- 172.21.15.52:0/3304182991 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4fa40ade00 0x7f4fa41d9af0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:16.634 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.630+0000 7f4fab39e640 1 -- 172.21.15.52:0/3304182991 >> 172.21.15.52:0/3304182991 conn(0x7f4fa4065cd0 msgr2=0x7f4fa40b1150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:07:16.635 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.630+0000 7f4fab39e640 1 -- 172.21.15.52:0/3304182991 shutdown_connections 2023-11-05T08:07:16.635 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.630+0000 7f4fab39e640 1 -- 172.21.15.52:0/3304182991 wait complete. 2023-11-05T08:07:16.635 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.630+0000 7f4fab39e640 1 librados: shutdown 2023-11-05T08:07:16.642 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2023-11-05T08:07:15.121720+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":113,"num_write_kb":1372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218960,"kb_used_data":2596,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755760,"statfs":{"total":773094113280,"available":772869898240,"internally_reserved":0,"allocated":2658304,"data_stored":1434788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":76,"apply_latency_ms":76,"commit_latency_ns":76000000,"apply_latency_ns":76000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":196608,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":45,"num_write":59,"num_write_kb":980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001530"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-05T08:07:09.443866+0000","last_change":"2023-11-05T08:07:07.897554+0000","last_active":"2023-11-05T08:07:09.443866+0000","last_peered":"2023-11-05T08:07:09.443866+0000","last_clean":"2023-11-05T08:07:09.443866+0000","last_became_active":"2023-11-05T08:07:07.890422+0000","last_became_peered":"2023-11-05T08:07:07.890422+0000","last_unstale":"2023-11-05T08:07:09.443866+0000","last_undegraded":"2023-11-05T08:07:09.443866+0000","last_fullsized":"2023-11-05T08:07:09.443866+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:07:05.115520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:07:05.115520+0000","last_clean_scrub_stamp":"2023-11-05T08:07:05.115520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T18:33:54.492130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-05T08:07:09.424252+0000","last_change":"2023-11-05T08:07:07.935570+0000","last_active":"2023-11-05T08:07:09.424252+0000","last_peered":"2023-11-05T08:07:09.424252+0000","last_clean":"2023-11-05T08:07:09.424252+0000","last_became_active":"2023-11-05T08:07:07.908128+0000","last_became_peered":"2023-11-05T08:07:07.908128+0000","last_unstale":"2023-11-05T08:07:09.424252+0000","last_undegraded":"2023-11-05T08:07:09.424252+0000","last_fullsized":"2023-11-05T08:07:09.424252+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:07:05.115520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:07:05.115520+0000","last_clean_scrub_stamp":"2023-11-05T08:07:05.115520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T15:25:37.194219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-05T08:07:09.439568+0000","last_change":"2023-11-05T08:07:07.213210+0000","last_active":"2023-11-05T08:07:09.439568+0000","last_peered":"2023-11-05T08:07:09.439568+0000","last_clean":"2023-11-05T08:07:09.439568+0000","last_became_active":"2023-11-05T08:07:07.203649+0000","last_became_peered":"2023-11-05T08:07:07.203649+0000","last_unstale":"2023-11-05T08:07:09.439568+0000","last_undegraded":"2023-11-05T08:07:09.439568+0000","last_fullsized":"2023-11-05T08:07:09.439568+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:07:05.115520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:07:05.115520+0000","last_clean_scrub_stamp":"2023-11-05T08:07:05.115520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T13:05:27.884687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-05T08:07:09.368931+0000","last_change":"2023-11-05T08:07:07.403639+0000","last_active":"2023-11-05T08:07:09.368931+0000","last_peered":"2023-11-05T08:07:09.368931+0000","last_clean":"2023-11-05T08:07:09.368931+0000","last_became_active":"2023-11-05T08:07:07.371569+0000","last_became_peered":"2023-11-05T08:07:07.371569+0000","last_unstale":"2023-11-05T08:07:09.368931+0000","last_undegraded":"2023-11-05T08:07:09.368931+0000","last_fullsized":"2023-11-05T08:07:09.368931+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:07:05.115520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:07:05.115520+0000","last_clean_scrub_stamp":"2023-11-05T08:07:05.115520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T14:58:41.385179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-05T08:07:09.427353+0000","last_change":"2023-11-05T08:07:07.350626+0000","last_active":"2023-11-05T08:07:09.427353+0000","last_peered":"2023-11-05T08:07:09.427353+0000","last_clean":"2023-11-05T08:07:09.427353+0000","last_became_active":"2023-11-05T08:07:07.344890+0000","last_became_peered":"2023-11-05T08:07:07.344890+0000","last_unstale":"2023-11-05T08:07:09.427353+0000","last_undegraded":"2023-11-05T08:07:09.427353+0000","last_fullsized":"2023-11-05T08:07:09.427353+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:07:05.115520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:07:05.115520+0000","last_clean_scrub_stamp":"2023-11-05T08:07:05.115520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T10:17:35.666271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-05T08:07:10.291382+0000","last_change":"2023-11-05T08:07:07.085537+0000","last_active":"2023-11-05T08:07:10.291382+0000","last_peered":"2023-11-05T08:07:10.291382+0000","last_clean":"2023-11-05T08:07:10.291382+0000","last_became_active":"2023-11-05T08:07:07.051923+0000","last_became_peered":"2023-11-05T08:07:07.051923+0000","last_unstale":"2023-11-05T08:07:10.291382+0000","last_undegraded":"2023-11-05T08:07:10.291382+0000","last_fullsized":"2023-11-05T08:07:10.291382+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:07:05.115520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:07:05.115520+0000","last_clean_scrub_stamp":"2023-11-05T08:07:05.115520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T09:32:20.473313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-05T08:07:09.419103+0000","last_change":"2023-11-05T08:07:07.161269+0000","last_active":"2023-11-05T08:07:09.419103+0000","last_peered":"2023-11-05T08:07:09.419103+0000","last_clean":"2023-11-05T08:07:09.419103+0000","last_became_active":"2023-11-05T08:07:07.131650+0000","last_became_peered":"2023-11-05T08:07:07.131650+0000","last_unstale":"2023-11-05T08:07:09.419103+0000","last_undegraded":"2023-11-05T08:07:09.419103+0000","last_fullsized":"2023-11-05T08:07:09.419103+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:07:05.115520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:07:05.115520+0000","last_clean_scrub_stamp":"2023-11-05T08:07:05.115520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T11:45:49.611005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-05T08:07:09.435336+0000","last_change":"2023-11-05T08:07:07.482345+0000","last_active":"2023-11-05T08:07:09.435336+0000","last_peered":"2023-11-05T08:07:09.435336+0000","last_clean":"2023-11-05T08:07:09.435336+0000","last_became_active":"2023-11-05T08:07:07.467692+0000","last_became_peered":"2023-11-05T08:07:07.467692+0000","last_unstale":"2023-11-05T08:07:09.435336+0000","last_undegraded":"2023-11-05T08:07:09.435336+0000","last_fullsized":"2023-11-05T08:07:09.435336+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:07:05.115520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:07:05.115520+0000","last_clean_scrub_stamp":"2023-11-05T08:07:05.115520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T09:41:35.204221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"23'76","reported_seq":119,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-05T08:07:12.149672+0000","last_change":"2023-11-05T08:07:00.997710+0000","last_active":"2023-11-05T08:07:12.149672+0000","last_peered":"2023-11-05T08:07:12.149672+0000","last_clean":"2023-11-05T08:07:12.149672+0000","last_became_active":"2023-11-05T08:07:00.966209+0000","last_became_peered":"2023-11-05T08:07:00.966209+0000","last_unstale":"2023-11-05T08:07:12.149672+0000","last_undegraded":"2023-11-05T08:07:12.149672+0000","last_fullsized":"2023-11-05T08:07:12.149672+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:06:58.242946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:06:58.242946+0000","last_clean_scrub_stamp":"2023-11-05T08:06:58.242946+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T10:17:50.722686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":113,"num_write_kb":1372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":113,"num_write_kb":1372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":802816,"data_stored":795680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":0,"up_from":16,"seq":68719476743,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":80607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":21.210999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":16.187999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":39.198999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":35.924999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":18.622}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":20.407}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":33.511000000000003}]}]},{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":80607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":9.3770000000000007}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":11.49}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":13.637}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":20.088999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":15.210000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":12.109999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":21.067}]}]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":233472,"data_stored":80607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":14.583}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":12.044}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":19.957999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":9.1699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":12.705}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":18.704000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":15.901}]}]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":620,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":634880,"data_stored":478447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":43,"apply_latency_ms":43,"commit_latency_ns":43000000,"apply_latency_ns":43000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":8.2129999999999992}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":25.608000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":23.015000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":24.027999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":21.545000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":20.036999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":19.393999999999998}]}]},{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":80607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":25.545000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":23.855}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.907}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":21.457999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":18.983000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":17.276}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":23.148}]}]},{"osd":5,"up_from":14,"seq":60129542150,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27644,"kb_used_data":620,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344196,"statfs":{"total":96636764160,"available":96608456704,"internally_reserved":0,"allocated":634880,"data_stored":478447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":13.169}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":10.898}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":12.323}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":16.960999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":18.763000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":22.872}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":21.562999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542151,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":233472,"data_stored":80607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":10.898999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":9.3650000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":15.781000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.9610000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":17.215}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":12.362}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":16.609000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":74859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":8.7669999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":10.676}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":26.402000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":27.256}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":14.792}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":11.099}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":12.324}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-05T08:07:16.643 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-05T08:07:16.644 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-11-05T08:07:16.644 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-11-05T08:07:16.644 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-05T08:07:16.752 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.751+0000 7f3a5e97c640 10 monclient: get_monmap_and_config 2023-11-05T08:07:16.752 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.751+0000 7f3a5e97c640 10 monclient: build_initial_monmap 2023-11-05T08:07:16.753 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.751+0000 7f3a5e97c640 10 monclient: monmap: 2023-11-05T08:07:16.753 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:07:16.753 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:16.753 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:07:16.752717+0000 2023-11-05T08:07:16.753 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:07:16.752717+0000 2023-11-05T08:07:16.754 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:07:16.754 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:16.754 INFO:teuthology.orchestra.run.smithi052.stderr:0: v1:172.21.15.52:6789/0 mon.noname-a-legacy 2023-11-05T08:07:16.754 INFO:teuthology.orchestra.run.smithi052.stderr:1: v1:172.21.15.156:6789/0 mon.noname-c-legacy 2023-11-05T08:07:16.754 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-b 2023-11-05T08:07:16.755 INFO:teuthology.orchestra.run.smithi052.stderr:3: v2:172.21.15.52:3300/0 mon.noname-a 2023-11-05T08:07:16.755 INFO:teuthology.orchestra.run.smithi052.stderr:4: v2:172.21.15.156:3300/0 mon.noname-c 2023-11-05T08:07:16.755 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:16.757 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.751+0000 7f3a5e97c640 1 Processor -- start 2023-11-05T08:07:16.758 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.752+0000 7f3a5e97c640 1 -- start start 2023-11-05T08:07:16.758 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.752+0000 7f3a5e97c640 10 monclient: init 2023-11-05T08:07:16.758 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.752+0000 7f3a5e97c640 10 monclient: _reopen_session rank -1 2023-11-05T08:07:16.758 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.752+0000 7f3a5e97c640 10 monclient: _add_conns ranks=[2,0,4,3,1] 2023-11-05T08:07:16.759 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.752+0000 7f3a5e97c640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3a580b4240 0x7f3a580b1150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:16.759 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.752+0000 7f3a5e97c640 10 monclient(hunting): picked mon.noname-b con 0x7f3a580b4240 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:07:16.759 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.752+0000 7f3a5e97c640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f3a580b38d0 addr v1:172.21.15.52:6789/0 2023-11-05T08:07:16.759 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.752+0000 7f3a5e97c640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f3a580ade00 0x7f3a5813b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:16.759 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.752+0000 7f3a5e97c640 10 monclient(hunting): picked mon.noname-c con 0x7f3a580ade00 addr v2:172.21.15.156:3300/0 2023-11-05T08:07:16.760 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.752+0000 7f3a5e97c640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a580b0cc0 con 0x7f3a580b38d0 2023-11-05T08:07:16.760 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.752+0000 7f3a5e97c640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:16.760 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.752+0000 7f3a5e97c640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a580b4620 con 0x7f3a580ade00 2023-11-05T08:07:16.760 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.752+0000 7f3a5e97c640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:16.760 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.752+0000 7f3a5e97c640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a580b1690 con 0x7f3a580b4240 2023-11-05T08:07:16.761 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.752+0000 7f3a5e97c640 10 monclient(hunting): _renew_subs 2023-11-05T08:07:16.761 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.752+0000 7f3a5e97c640 10 monclient(hunting): authenticate will time out at 1382.958624s 2023-11-05T08:07:16.761 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.753+0000 7f3a57fff640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3a580b4240 0x7f3a580b1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:16.761 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.753+0000 7f3a577fe640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f3a580b38d0 0x7f3a580ae640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:55252/0 (socket says 172.21.15.52:55252) 2023-11-05T08:07:16.761 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.753+0000 7f3a577fe640 1 -- 172.21.15.52:0/1300468125 learned_addr learned my addr 172.21.15.52:0/1300468125 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-11-05T08:07:16.762 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.753+0000 7f3a57fff640 10 monclient(hunting): get_auth_request con 0x7f3a580b4240 auth_method 0 2023-11-05T08:07:16.762 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.753+0000 7f3a57fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:16.762 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.753+0000 7f3a57fff640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:16.762 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.753+0000 7f3a57fff640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:16.762 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.753+0000 7f3a5cf19640 1 --2- 172.21.15.52:0/1300468125 >> v2:172.21.15.156:3300/0 conn(0x7f3a580ade00 0x7f3a5813b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:16.763 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.753+0000 7f3a5cf19640 10 monclient(hunting): get_auth_request con 0x7f3a580ade00 auth_method 0 2023-11-05T08:07:16.763 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.753+0000 7f3a5cf19640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:16.763 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.753+0000 7f3a5cf19640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:16.763 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.753+0000 7f3a5cf19640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:16.763 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.754+0000 7f3a57fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:16.764 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.754+0000 7f3a57fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:16.764 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.754+0000 7f3a57fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:16.764 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.754+0000 7f3a5cf19640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:16.764 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.754+0000 7f3a5cf19640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:16.764 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.754+0000 7f3a5cf19640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:16.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.755+0000 7f3a5cf19640 10 monclient(hunting): handle_auth_done global_id 4411 payload 274 2023-11-05T08:07:16.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.755+0000 7f3a5cf19640 1 -- 172.21.15.52:0/1300468125 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3a580b4240 msgr2=0x7f3a580b1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-05T08:07:16.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.755+0000 7f3a5cf19640 1 --2- 172.21.15.52:0/1300468125 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3a580b4240 0x7f3a580b1150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:16.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.756+0000 7f3a5cf19640 1 -- 172.21.15.52:0/1300468125 >> v1:172.21.15.52:6789/0 conn(0x7f3a580b38d0 legacy=0x7f3a580ae640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:16.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.756+0000 7f3a5cf19640 10 monclient: _finish_hunting 0 2023-11-05T08:07:16.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.756+0000 7f3a5cf19640 1 monclient: found mon.noname-c 2023-11-05T08:07:16.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.756+0000 7f3a5cf19640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:07:16.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.756+0000 7f3a5cf19640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.156:3300/0 2023-11-05T08:07:16.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.756+0000 7f3a5cf19640 1 -- 172.21.15.52:0/1300468125 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a5813f5f0 con 0x7f3a580ade00 2023-11-05T08:07:16.771 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.758+0000 7f3a5cf19640 1 --2- 172.21.15.52:0/1300468125 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3a580ade00 0x7f3a5813b420 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3a50009d90 tx=0x7f3a5002be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b0cd9e4653746f3 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:16.771 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.761+0000 7f3a56ffd640 1 -- 172.21.15.52:0/1300468125 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a5002cbc0 con 0x7f3a580ade00 2023-11-05T08:07:16.771 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.761+0000 7f3a56ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:16.771 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.761+0000 7f3a56ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-11-05T08:07:16.771 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.761+0000 7f3a56ffd640 10 monclient: dump: 2023-11-05T08:07:16.772 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:16.772 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:16.772 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:16.772 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:16.772 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:16.773 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:16.773 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:16.773 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:16.773 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:16.773 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:16.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.761+0000 7f3a56ffd640 10 monclient: _finish_auth 0 2023-11-05T08:07:16.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.761+0000 7f3a56ffd640 10 monclient: _check_auth_tickets 2023-11-05T08:07:16.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.761+0000 7f3a56ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:07:16.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.761+0000 7f3a56ffd640 1 -- 172.21.15.52:0/1300468125 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a5002cd20 con 0x7f3a580ade00 2023-11-05T08:07:16.775 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.761+0000 7f3a5e97c640 5 monclient: authenticate success, global_id 4411 2023-11-05T08:07:16.775 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.761+0000 7f3a5e97c640 20 monclient: get_monmap_and_config waiting for monmap|config 2023-11-05T08:07:16.775 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.761+0000 7f3a56ffd640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:07:16.775 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.761+0000 7f3a5e97c640 10 monclient: get_monmap_and_config success 2023-11-05T08:07:16.776 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.761+0000 7f3a5e97c640 4 set_mon_vals no callback set 2023-11-05T08:07:16.776 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.761+0000 7f3a56ffd640 1 -- 172.21.15.52:0/1300468125 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a50034660 con 0x7f3a580ade00 2023-11-05T08:07:16.776 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.761+0000 7f3a56ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:16.776 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.761+0000 7f3a56ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-05T08:07:16.776 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.761+0000 7f3a56ffd640 10 monclient: dump: 2023-11-05T08:07:16.776 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:16.777 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:16.777 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:16.777 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:16.777 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:16.777 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:16.778 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:16.778 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:16.778 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:16.778 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:16.778 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.762+0000 7f3a5e97c640 10 monclient: shutdown 2023-11-05T08:07:16.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.762+0000 7f3a5e97c640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:07:16.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.762+0000 7f3a5e97c640 1 -- 172.21.15.52:0/1300468125 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3a580ade00 msgr2=0x7f3a5813b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:16.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.762+0000 7f3a5e97c640 1 --2- 172.21.15.52:0/1300468125 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3a580ade00 0x7f3a5813b420 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3a50009d90 tx=0x7f3a5002be10 comp rx=0 tx=0).stop 2023-11-05T08:07:16.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.762+0000 7f3a5e97c640 1 -- 172.21.15.52:0/1300468125 shutdown_connections 2023-11-05T08:07:16.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.762+0000 7f3a5e97c640 1 --2- 172.21.15.52:0/1300468125 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3a580ade00 0x7f3a5813b420 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:16.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.762+0000 7f3a5e97c640 1 --2- 172.21.15.52:0/1300468125 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3a580b4240 0x7f3a580b1150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:16.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.762+0000 7f3a5e97c640 1 -- 172.21.15.52:0/1300468125 >> 172.21.15.52:0/1300468125 conn(0x7f3a58065cd0 msgr2=0x7f3a580660e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:07:16.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.762+0000 7f3a5e97c640 1 -- 172.21.15.52:0/1300468125 shutdown_connections 2023-11-05T08:07:16.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.762+0000 7f3a5e97c640 1 -- 172.21.15.52:0/1300468125 wait complete. 2023-11-05T08:07:16.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.763+0000 7f3a5e97c640 10 monclient: build_initial_monmap 2023-11-05T08:07:16.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.763+0000 7f3a5e97c640 10 monclient: monmap: 2023-11-05T08:07:16.781 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:07:16.781 INFO:teuthology.orchestra.run.smithi052.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-05T08:07:16.781 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 0.000000 2023-11-05T08:07:16.781 INFO:teuthology.orchestra.run.smithi052.stderr:created 0.000000 2023-11-05T08:07:16.781 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:07:16.782 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:16.782 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.noname-a 2023-11-05T08:07:16.782 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.noname-b 2023-11-05T08:07:16.782 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-c 2023-11-05T08:07:16.782 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:16.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.763+0000 7f3a5e97c640 1 librados: starting msgr at 2023-11-05T08:07:16.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.763+0000 7f3a5e97c640 1 librados: starting objecter 2023-11-05T08:07:16.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.764+0000 7f3a5e97c640 1 Processor -- start 2023-11-05T08:07:16.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.764+0000 7f3a5e97c640 1 -- start start 2023-11-05T08:07:16.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.764+0000 7f3a5e97c640 1 librados: setting wanted keys 2023-11-05T08:07:16.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.764+0000 7f3a5e97c640 1 librados: calling monclient init 2023-11-05T08:07:16.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.764+0000 7f3a5e97c640 10 monclient: init 2023-11-05T08:07:16.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.764+0000 7f3a5e97c640 10 monclient: _reopen_session rank -1 2023-11-05T08:07:16.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.764+0000 7f3a5e97c640 10 monclient: _add_conns ranks=[0,2,1] 2023-11-05T08:07:16.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.764+0000 7f3a5e97c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a580ade00 0x7f3a5813d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:16.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.764+0000 7f3a5e97c640 10 monclient(hunting): picked mon.noname-a con 0x7f3a580ade00 addr [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] 2023-11-05T08:07:16.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.764+0000 7f3a5e97c640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3a580b4240 0x7f3a581447e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:16.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.764+0000 7f3a5e97c640 10 monclient(hunting): picked mon.noname-c con 0x7f3a580b4240 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:07:16.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.764+0000 7f3a5e97c640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3a58144d20 0x7f3a581d7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:16.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.764+0000 7f3a5e97c640 10 monclient(hunting): picked mon.noname-b con 0x7f3a58144d20 addr [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] 2023-11-05T08:07:16.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.764+0000 7f3a5e97c640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:16.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.764+0000 7f3a5e97c640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a58145770 con 0x7f3a580ade00 2023-11-05T08:07:16.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.764+0000 7f3a5e97c640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:16.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.764+0000 7f3a5e97c640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a581d68c0 con 0x7f3a58144d20 2023-11-05T08:07:16.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.764+0000 7f3a5e97c640 10 monclient(hunting): start opening mon connection 2023-11-05T08:07:16.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.764+0000 7f3a5e97c640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a581d6b10 con 0x7f3a580b4240 2023-11-05T08:07:16.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.764+0000 7f3a5e97c640 10 monclient(hunting): _renew_subs 2023-11-05T08:07:16.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.764+0000 7f3a5e97c640 10 monclient(hunting): authenticate will time out at 1382.970852s 2023-11-05T08:07:16.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.765+0000 7f3a57fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a580ade00 0x7f3a5813d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:16.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.765+0000 7f3a577fe640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3a580b4240 0x7f3a581447e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:16.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.765+0000 7f3a5cf19640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3a58144d20 0x7f3a581d7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:16.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.765+0000 7f3a577fe640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3a580b4240 0x7f3a581447e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.52:48492/0 (socket says 172.21.15.52:48492) 2023-11-05T08:07:16.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.765+0000 7f3a577fe640 1 -- 172.21.15.52:0/3792598551 learned_addr learned my addr 172.21.15.52:0/3792598551 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-11-05T08:07:16.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.765+0000 7f3a577fe640 10 monclient(hunting): get_auth_request con 0x7f3a580b4240 auth_method 0 2023-11-05T08:07:16.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.765+0000 7f3a577fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:16.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.765+0000 7f3a577fe640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:16.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.765+0000 7f3a577fe640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:16.789 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.765+0000 7f3a57fff640 10 monclient(hunting): get_auth_request con 0x7f3a580ade00 auth_method 0 2023-11-05T08:07:16.789 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.765+0000 7f3a57fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:16.789 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.765+0000 7f3a57fff640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:16.789 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.765+0000 7f3a57fff640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:16.789 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.765+0000 7f3a5cf19640 10 monclient(hunting): get_auth_request con 0x7f3a58144d20 auth_method 0 2023-11-05T08:07:16.790 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.765+0000 7f3a5cf19640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:07:16.790 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.765+0000 7f3a5cf19640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:07:16.790 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.765+0000 7f3a5cf19640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:07:16.790 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.766+0000 7f3a577fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:16.790 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.766+0000 7f3a577fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:16.790 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.766+0000 7f3a577fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:16.791 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.766+0000 7f3a5cf19640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:16.791 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.766+0000 7f3a5cf19640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:16.791 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.766+0000 7f3a5cf19640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:16.791 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.766+0000 7f3a57fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:07:16.791 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.766+0000 7f3a57fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:07:16.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.766+0000 7f3a57fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:07:16.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.768+0000 7f3a5cf19640 10 monclient(hunting): handle_auth_done global_id 4414 payload 824 2023-11-05T08:07:16.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.768+0000 7f3a5cf19640 1 -- 172.21.15.52:0/3792598551 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3a580b4240 msgr2=0x7f3a581447e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:16.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.768+0000 7f3a5cf19640 1 --2- 172.21.15.52:0/3792598551 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3a580b4240 0x7f3a581447e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:16.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.768+0000 7f3a5cf19640 1 -- 172.21.15.52:0/3792598551 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a580ade00 msgr2=0x7f3a5813d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:16.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.768+0000 7f3a5cf19640 1 --2- 172.21.15.52:0/3792598551 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a580ade00 0x7f3a5813d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:16.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.768+0000 7f3a5cf19640 10 monclient: _finish_hunting 0 2023-11-05T08:07:16.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.768+0000 7f3a5cf19640 1 monclient: found mon.noname-b 2023-11-05T08:07:16.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.768+0000 7f3a5cf19640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:07:16.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.768+0000 7f3a5cf19640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.156:3300/0 2023-11-05T08:07:16.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.768+0000 7f3a5cf19640 1 -- 172.21.15.52:0/3792598551 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a50009a70 con 0x7f3a58144d20 2023-11-05T08:07:16.795 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.773+0000 7f3a5cf19640 1 --2- 172.21.15.52:0/3792598551 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3a58144d20 0x7f3a581d7030 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3a50033000 tx=0x7f3a50004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:16.795 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.773+0000 7f3a54ff9640 10 client.?.objecter ms_handle_connect 0x7f3a58144d20 2023-11-05T08:07:16.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.773+0000 7f3a54ff9640 10 client.?.objecter resend_mon_ops 2023-11-05T08:07:16.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.777+0000 7f3a54ff9640 1 -- 172.21.15.52:0/3792598551 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a50040650 con 0x7f3a58144d20 2023-11-05T08:07:16.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.777+0000 7f3a54ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:16.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.777+0000 7f3a54ff9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-05T08:07:16.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.777+0000 7f3a54ff9640 10 monclient: dump: 2023-11-05T08:07:16.797 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:16.797 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:16.797 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:16.797 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:16.797 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:16.798 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:16.798 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:16.798 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:16.798 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:16.798 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:16.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.777+0000 7f3a54ff9640 10 monclient: _finish_auth 0 2023-11-05T08:07:16.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.777+0000 7f3a54ff9640 10 monclient: _check_auth_tickets 2023-11-05T08:07:16.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.777+0000 7f3a54ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:07:16.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.777+0000 7f3a54ff9640 1 -- 172.21.15.52:0/3792598551 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a5002ce90 con 0x7f3a58144d20 2023-11-05T08:07:16.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.777+0000 7f3a54ff9640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:07:16.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.777+0000 7f3a5e97c640 5 monclient: authenticate success, global_id 4414 2023-11-05T08:07:16.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.777+0000 7f3a5e97c640 10 monclient: _renew_subs 2023-11-05T08:07:16.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.777+0000 7f3a54ff9640 1 -- 172.21.15.52:0/3792598551 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a500409f0 con 0x7f3a58144d20 2023-11-05T08:07:16.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.777+0000 7f3a5e97c640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:07:16.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.777+0000 7f3a5e97c640 1 -- 172.21.15.52:0/3792598551 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a58143130 con 0x7f3a58144d20 2023-11-05T08:07:16.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.777+0000 7f3a54ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:07:16.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.777+0000 7f3a54ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-05T08:07:16.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.777+0000 7f3a54ff9640 10 monclient: dump: 2023-11-05T08:07:16.801 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:07:16.801 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:07:16.801 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:16.802 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:07:16.802 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:07:16.802 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:07:16.802 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:07:16.802 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:07:16.803 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:07:16.803 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:07:16.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.777+0000 7f3a567fc640 4 set_mon_vals no callback set 2023-11-05T08:07:16.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.777+0000 7f3a5e97c640 10 client.4414.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-05T08:07:16.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.777+0000 7f3a5e97c640 10 monclient: _renew_subs 2023-11-05T08:07:16.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.777+0000 7f3a5e97c640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:07:16.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.777+0000 7f3a5e97c640 1 -- 172.21.15.52:0/3792598551 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a581d7570 con 0x7f3a58144d20 2023-11-05T08:07:16.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.777+0000 7f3a5e97c640 1 librados: init done 2023-11-05T08:07:16.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.778+0000 7f3a5e97c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-05T08:07:16.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.778+0000 7f3a5e97c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:07:16.804 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.778+0000 7f3a5e97c640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:07:16.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.778+0000 7f3a5e97c640 1 -- 172.21.15.52:0/3792598551 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a5804e9f0 con 0x7f3a58144d20 2023-11-05T08:07:16.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.797+0000 7f3a54ff9640 1 -- 172.21.15.52:0/3792598551 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3a50040b50 con 0x7f3a58144d20 2023-11-05T08:07:16.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.797+0000 7f3a54ff9640 1 --2- 172.21.15.52:0/3792598551 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f3a4406c880 0x7f3a4406ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:07:16.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.798+0000 7f3a57fff640 1 --2- 172.21.15.52:0/3792598551 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f3a4406c880 0x7f3a4406ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:07:16.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.798+0000 7f3a57fff640 10 monclient: get_auth_request con 0x7f3a4406c880 auth_method 0 2023-11-05T08:07:16.807 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.798+0000 7f3a57fff640 1 --2- 172.21.15.52:0/3792598551 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f3a4406c880 0x7f3a4406ed40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3a48009aa0 tx=0x7f3a48009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:07:16.807 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.798+0000 7f3a54ff9640 10 client.4414.objecter ms_handle_connect 0x7f3a4406c880 2023-11-05T08:07:16.807 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.800+0000 7f3a54ff9640 1 -- 172.21.15.52:0/3792598551 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f3a5007b380 con 0x7f3a58144d20 2023-11-05T08:07:16.807 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.800+0000 7f3a54ff9640 10 client.4414.objecter ms_dispatch 0x7f3a58000b90 osd_map(23..23 src has 1..23) v4 2023-11-05T08:07:16.807 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.800+0000 7f3a54ff9640 3 client.4414.objecter handle_osd_map got epochs [23,23] > 0 2023-11-05T08:07:16.808 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.800+0000 7f3a54ff9640 3 client.4414.objecter handle_osd_map decoding full epoch 23 2023-11-05T08:07:16.808 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:16.800+0000 7f3a54ff9640 20 client.4414.objecter dump_active .. 0 homeless 2023-11-05T08:07:17.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:17.033+0000 7f3a54ff9640 1 -- 172.21.15.52:0/3792598551 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3a500776c0 con 0x7f3a58144d20 2023-11-05T08:07:17.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:17.033+0000 7f3a54ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:07:17.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:17.033+0000 7f3a54ff9640 10 monclient: _finish_command 1 = system:0 2023-11-05T08:07:17.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:17.266+0000 7f3a5e97c640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2023-11-05T08:07:17.268 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:17.266+0000 7f3a5e97c640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2023-11-05T08:07:17.268 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:17.266+0000 7f3a5e97c640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:07:17.268 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:17.266+0000 7f3a5e97c640 1 -- 172.21.15.52:0/3792598551 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f3a581d6cd0 con 0x7f3a58144d20 2023-11-05T08:07:17.275 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:17.274+0000 7f3a54ff9640 1 -- 172.21.15.52:0/3792598551 <== mon.1 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f3a50009450 con 0x7f3a58144d20 2023-11-05T08:07:17.275 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:17.274+0000 7f3a54ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2023-11-05T08:07:17.276 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:17.274+0000 7f3a54ff9640 10 monclient: _finish_command 2 = system:0 2023-11-05T08:07:17.276 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:07:17.276 INFO:teuthology.orchestra.run.smithi052.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-11-05T08:07:17.278 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:17.276+0000 7f3a5e97c640 10 librados: watch_flush enter 2023-11-05T08:07:17.278 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:17.276+0000 7f3a5e97c640 10 librados: watch_flush exit 2023-11-05T08:07:17.279 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:17.276+0000 7f3a5e97c640 20 client.4414.objecter shutdown clearing up homeless session... 2023-11-05T08:07:17.279 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:17.276+0000 7f3a5e97c640 10 client.4414.objecter successfully canceled tick 2023-11-05T08:07:17.279 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:17.276+0000 7f3a5e97c640 1 -- 172.21.15.52:0/3792598551 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f3a4406c880 msgr2=0x7f3a4406ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:17.279 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:17.276+0000 7f3a5e97c640 1 --2- 172.21.15.52:0/3792598551 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f3a4406c880 0x7f3a4406ed40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3a48009aa0 tx=0x7f3a48009190 comp rx=0 tx=0).stop 2023-11-05T08:07:17.279 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:17.276+0000 7f3a5e97c640 10 monclient: shutdown 2023-11-05T08:07:17.280 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:17.276+0000 7f3a5e97c640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:07:17.280 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:17.276+0000 7f3a5e97c640 1 -- 172.21.15.52:0/3792598551 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3a58144d20 msgr2=0x7f3a581d7030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:07:17.280 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:17.276+0000 7f3a5e97c640 1 --2- 172.21.15.52:0/3792598551 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3a58144d20 0x7f3a581d7030 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3a50033000 tx=0x7f3a50004a40 comp rx=0 tx=0).stop 2023-11-05T08:07:17.280 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:17.276+0000 7f3a5e97c640 1 -- 172.21.15.52:0/3792598551 shutdown_connections 2023-11-05T08:07:17.280 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:17.276+0000 7f3a5e97c640 1 --2- 172.21.15.52:0/3792598551 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f3a4406c880 0x7f3a4406ed40 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:17.280 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:17.276+0000 7f3a5e97c640 1 --2- 172.21.15.52:0/3792598551 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3a58144d20 0x7f3a581d7030 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:17.281 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:17.276+0000 7f3a5e97c640 1 --2- 172.21.15.52:0/3792598551 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3a580b4240 0x7f3a581447e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:17.281 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:17.276+0000 7f3a5e97c640 1 --2- 172.21.15.52:0/3792598551 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a580ade00 0x7f3a5813d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:07:17.281 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:17.276+0000 7f3a5e97c640 1 -- 172.21.15.52:0/3792598551 >> 172.21.15.52:0/3792598551 conn(0x7f3a58065cd0 msgr2=0x7f3a580b7990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:07:17.281 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:17.276+0000 7f3a5e97c640 1 -- 172.21.15.52:0/3792598551 shutdown_connections 2023-11-05T08:07:17.281 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:17.276+0000 7f3a5e97c640 1 -- 172.21.15.52:0/3792598551 wait complete. 2023-11-05T08:07:17.282 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:07:17.276+0000 7f3a5e97c640 1 librados: shutdown 2023-11-05T08:07:17.290 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-11-05T08:07:17.290 INFO:teuthology.run_tasks:Running task workunit... 2023-11-05T08:07:17.304 INFO:tasks.workunit:Pulling workunits from ref 420cd129397301b1521ceb74e1bdbd9b855d2189 2023-11-05T08:07:17.305 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-11-05T08:07:17.305 DEBUG:teuthology.orchestra.run.smithi052:> stat -- /home/ubuntu/cephtest/mnt.0 2023-11-05T08:07:17.321 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-05T08:07:17.321 INFO:teuthology.orchestra.run.smithi052.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-11-05T08:07:17.322 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -- /home/ubuntu/cephtest/mnt.0 2023-11-05T08:07:17.377 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2023-11-05T08:07:17.378 DEBUG:teuthology.orchestra.run.smithi052:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2023-11-05T08:07:17.433 INFO:tasks.workunit:timeout=6h 2023-11-05T08:07:17.433 INFO:tasks.workunit:cleanup=True 2023-11-05T08:07:17.434 DEBUG:teuthology.orchestra.run.smithi052:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 420cd129397301b1521ceb74e1bdbd9b855d2189 2023-11-05T08:07:17.490 INFO:tasks.workunit.client.0.smithi052.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-11-05T08:07:27.109 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:01:30.224 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:07:27.157 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:01:30.232 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:07:27.159 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:01:30.233 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:07:27.174 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:01:30.290 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:07:27.198 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:01:30.273 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:07:27.222 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:01:30.337 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:07:27.227 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:01:30.343 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:07:27.234 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:01:30.350 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:07:27.279 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:01:30.395 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:07:47.312 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:01:50.427 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:07:47.316 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:01:50.431 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:07:47.336 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:01:50.452 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:07:47.357 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:01:50.431 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:07:47.360 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:01:50.434 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:07:47.376 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:01:50.450 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:07:47.397 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:01:50.512 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:07:47.400 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:01:50.516 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:07:47.432 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:01:50.547 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:08:06.752 INFO:tasks.workunit.client.0.smithi052.stderr:Note: switching to '420cd129397301b1521ceb74e1bdbd9b855d2189'. 2023-11-05T08:08:06.753 INFO:tasks.workunit.client.0.smithi052.stderr: 2023-11-05T08:08:06.753 INFO:tasks.workunit.client.0.smithi052.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-11-05T08:08:06.753 INFO:tasks.workunit.client.0.smithi052.stderr:changes and commit them, and you can discard any commits you make in this 2023-11-05T08:08:06.753 INFO:tasks.workunit.client.0.smithi052.stderr:state without impacting any branches by switching back to a branch. 2023-11-05T08:08:06.753 INFO:tasks.workunit.client.0.smithi052.stderr: 2023-11-05T08:08:06.754 INFO:tasks.workunit.client.0.smithi052.stderr:If you want to create a new branch to retain commits you create, you may 2023-11-05T08:08:06.754 INFO:tasks.workunit.client.0.smithi052.stderr:do so (now or later) by using -c with the switch command. Example: 2023-11-05T08:08:06.754 INFO:tasks.workunit.client.0.smithi052.stderr: 2023-11-05T08:08:06.754 INFO:tasks.workunit.client.0.smithi052.stderr: git switch -c 2023-11-05T08:08:06.755 INFO:tasks.workunit.client.0.smithi052.stderr: 2023-11-05T08:08:06.755 INFO:tasks.workunit.client.0.smithi052.stderr:Or undo this operation with: 2023-11-05T08:08:06.755 INFO:tasks.workunit.client.0.smithi052.stderr: 2023-11-05T08:08:06.755 INFO:tasks.workunit.client.0.smithi052.stderr: git switch - 2023-11-05T08:08:06.755 INFO:tasks.workunit.client.0.smithi052.stderr: 2023-11-05T08:08:06.756 INFO:tasks.workunit.client.0.smithi052.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-11-05T08:08:06.756 INFO:tasks.workunit.client.0.smithi052.stderr: 2023-11-05T08:08:06.756 INFO:tasks.workunit.client.0.smithi052.stderr:HEAD is now at 420cd129397 Added pg-id debug info to help track which pg is being processed 2023-11-05T08:08:06.758 DEBUG:teuthology.orchestra.run.smithi052:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-11-05T08:08:06.819 INFO:tasks.workunit.client.0.smithi052.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-11-05T08:08:06.821 INFO:tasks.workunit.client.0.smithi052.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-11-05T08:08:06.822 INFO:tasks.workunit.client.0.smithi052.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-11-05T08:08:07.299 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:02:10.414 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:08:07.302 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:02:10.418 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:08:07.319 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:02:10.434 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:08:07.353 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:02:10.469 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:08:07.355 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:02:10.429 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:08:07.356 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:02:10.431 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:08:07.360 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:02:10.475 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:08:07.370 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:02:10.444 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:08:07.374 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:02:10.490 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:08:07.433 INFO:tasks.workunit.client.0.smithi052.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-11-05T08:08:07.493 INFO:tasks.workunit.client.0.smithi052.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-11-05T08:08:07.537 INFO:tasks.workunit.client.0.smithi052.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-11-05T08:08:07.538 INFO:tasks.workunit.client.0.smithi052.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-11-05T08:08:07.539 INFO:tasks.workunit.client.0.smithi052.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-11-05T08:08:07.581 INFO:tasks.workunit.client.0.smithi052.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-11-05T08:08:07.584 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-11-05T08:08:07.585 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-11-05T08:08:07.641 INFO:tasks.workunit:Running workunits matching rados/test.sh on client.0... 2023-11-05T08:08:07.643 INFO:tasks.workunit:Running workunit rados/test.sh... 2023-11-05T08:08:07.643 DEBUG:teuthology.orchestra.run.smithi052:workunit test rados/test.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=420cd129397301b1521ceb74e1bdbd9b855d2189 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 ALLOW_TIMEOUTS=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh 2023-11-05T08:08:07.702 INFO:tasks.workunit.client.0.smithi052.stderr:+ parallel=1 2023-11-05T08:08:07.702 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' '' = --serial ']' 2023-11-05T08:08:07.703 INFO:tasks.workunit.client.0.smithi052.stderr:+ color= 2023-11-05T08:08:07.703 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' -t 1 ']' 2023-11-05T08:08:07.704 INFO:tasks.workunit.client.0.smithi052.stderr:+ trap cleanup EXIT ERR HUP INT QUIT 2023-11-05T08:08:07.704 INFO:tasks.workunit.client.0.smithi052.stderr:+ declare -A pids 2023-11-05T08:08:07.704 INFO:tasks.workunit.client.0.smithi052.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-11-05T08:08:07.704 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' 1 -eq 1 ']' 2023-11-05T08:08:07.704 INFO:tasks.workunit.client.0.smithi052.stderr:++ printf %25s api_aio 2023-11-05T08:08:07.705 INFO:tasks.workunit.client.0.smithi052.stderr:+ r=' api_aio' 2023-11-05T08:08:07.706 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo api_aio 2023-11-05T08:08:07.706 INFO:tasks.workunit.client.0.smithi052.stderr:++ awk '{print $1}' 2023-11-05T08:08:07.707 INFO:tasks.workunit.client.0.smithi052.stderr:+ ff=api_aio 2023-11-05T08:08:07.707 INFO:tasks.workunit.client.0.smithi052.stderr:+ pid=91522 2023-11-05T08:08:07.708 INFO:tasks.workunit.client.0.smithi052.stderr:+ echo 'test api_aio on pid 91522' 2023-11-05T08:08:07.708 INFO:tasks.workunit.client.0.smithi052.stdout:test api_aio on pid 91522 2023-11-05T08:08:07.711 INFO:tasks.workunit.client.0.smithi052.stderr:+ pids[$f]=91522 2023-11-05T08:08:07.712 INFO:tasks.workunit.client.0.smithi052.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-11-05T08:08:07.712 INFO:tasks.workunit.client.0.smithi052.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_aio 2>&1 | tee ceph_test_rados_api_aio.log | sed "s/^/ api_aio: /"' 2023-11-05T08:08:07.712 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' 1 -eq 1 ']' 2023-11-05T08:08:07.712 INFO:tasks.workunit.client.0.smithi052.stderr:++ printf %25s api_aio_pp 2023-11-05T08:08:07.712 INFO:tasks.workunit.client.0.smithi052.stderr:+ r=' api_aio_pp' 2023-11-05T08:08:07.713 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo api_aio_pp 2023-11-05T08:08:07.713 INFO:tasks.workunit.client.0.smithi052.stderr:++ awk '{print $1}' 2023-11-05T08:08:07.713 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' -f /etc/bashrc ']' 2023-11-05T08:08:07.713 INFO:tasks.workunit.client.0.smithi052.stderr:+ . /etc/bashrc 2023-11-05T08:08:07.713 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -z '' ']' 2023-11-05T08:08:07.714 INFO:tasks.workunit.client.0.smithi052.stderr:++ BASHRCSOURCED=Y 2023-11-05T08:08:07.714 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.714 INFO:tasks.workunit.client.0.smithi052.stderr:++ shopt -q login_shell 2023-11-05T08:08:07.714 INFO:tasks.workunit.client.0.smithi052.stderr:+++ umask 2023-11-05T08:08:07.714 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' 0022 -eq 0 ']' 2023-11-05T08:08:07.715 INFO:tasks.workunit.client.0.smithi052.stderr:++ SHELL=/bin/bash 2023-11-05T08:08:07.715 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.715 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-11-05T08:08:07.715 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.716 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/bash_completion.sh 2023-11-05T08:08:07.716 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-11-05T08:08:07.716 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.716 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-11-05T08:08:07.716 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.717 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/cobbler.sh 2023-11-05T08:08:07.717 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-11-05T08:08:07.717 INFO:tasks.workunit.client.0.smithi052.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-11-05T08:08:07.717 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.717 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-11-05T08:08:07.718 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.718 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorgrep.sh 2023-11-05T08:08:07.718 INFO:tasks.workunit.client.0.smithi052.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-05T08:08:07.718 INFO:tasks.workunit.client.0.smithi052.stderr:+ ff=api_aio_pp 2023-11-05T08:08:07.718 INFO:tasks.workunit.client.0.smithi052.stderr:+ pid=91529 2023-11-05T08:08:07.719 INFO:tasks.workunit.client.0.smithi052.stdout:test api_aio_pp on pid 91529 2023-11-05T08:08:07.722 INFO:tasks.workunit.client.0.smithi052.stderr:+ echo 'test api_aio_pp on pid 91529' 2023-11-05T08:08:07.723 INFO:tasks.workunit.client.0.smithi052.stderr:+ pids[$f]=91529 2023-11-05T08:08:07.723 INFO:tasks.workunit.client.0.smithi052.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-11-05T08:08:07.723 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' 1 -eq 1 ']' 2023-11-05T08:08:07.723 INFO:tasks.workunit.client.0.smithi052.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_aio_pp 2>&1 | tee ceph_test_rados_api_aio_pp.log | sed "s/^/ api_aio_pp: /"' 2023-11-05T08:08:07.724 INFO:tasks.workunit.client.0.smithi052.stderr:++ printf %25s api_io 2023-11-05T08:08:07.724 INFO:tasks.workunit.client.0.smithi052.stderr:+ r=' api_io' 2023-11-05T08:08:07.724 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo api_io 2023-11-05T08:08:07.724 INFO:tasks.workunit.client.0.smithi052.stderr:++ awk '{print $1}' 2023-11-05T08:08:07.724 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' -f /etc/bashrc ']' 2023-11-05T08:08:07.724 INFO:tasks.workunit.client.0.smithi052.stderr:+ . /etc/bashrc 2023-11-05T08:08:07.725 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -z '' ']' 2023-11-05T08:08:07.725 INFO:tasks.workunit.client.0.smithi052.stderr:++ BASHRCSOURCED=Y 2023-11-05T08:08:07.725 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.725 INFO:tasks.workunit.client.0.smithi052.stderr:++ shopt -q login_shell 2023-11-05T08:08:07.725 INFO:tasks.workunit.client.0.smithi052.stderr:+++ umask 2023-11-05T08:08:07.726 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'grep=grep --color=auto' 2023-11-05T08:08:07.726 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' 0022 -eq 0 ']' 2023-11-05T08:08:07.726 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'egrep=egrep --color=auto' 2023-11-05T08:08:07.726 INFO:tasks.workunit.client.0.smithi052.stderr:++ SHELL=/bin/bash 2023-11-05T08:08:07.726 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-11-05T08:08:07.727 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.727 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-11-05T08:08:07.727 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.727 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorls.sh 2023-11-05T08:08:07.727 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' '!' -t 0 ']' 2023-11-05T08:08:07.727 INFO:tasks.workunit.client.0.smithi052.stderr:+++ return 2023-11-05T08:08:07.728 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.728 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.728 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-11-05T08:08:07.728 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.729 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-11-05T08:08:07.729 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-11-05T08:08:07.729 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.729 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export S_COLORS=auto 2023-11-05T08:08:07.729 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/bash_completion.sh 2023-11-05T08:08:07.730 INFO:tasks.workunit.client.0.smithi052.stderr:+++ S_COLORS=auto 2023-11-05T08:08:07.730 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.730 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-11-05T08:08:07.730 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.730 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-11-05T08:08:07.731 INFO:tasks.workunit.client.0.smithi052.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-05T08:08:07.731 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-11-05T08:08:07.731 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.731 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-11-05T08:08:07.731 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.732 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/cobbler.sh 2023-11-05T08:08:07.732 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-11-05T08:08:07.732 INFO:tasks.workunit.client.0.smithi052.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-11-05T08:08:07.732 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.732 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-11-05T08:08:07.732 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.733 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorgrep.sh 2023-11-05T08:08:07.733 INFO:tasks.workunit.client.0.smithi052.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-05T08:08:07.733 INFO:tasks.workunit.client.0.smithi052.stderr:+ ff=api_io 2023-11-05T08:08:07.733 INFO:tasks.workunit.client.0.smithi052.stderr:+ pid=91538 2023-11-05T08:08:07.734 INFO:tasks.workunit.client.0.smithi052.stdout:test api_io on pid 91538 2023-11-05T08:08:07.738 INFO:tasks.workunit.client.0.smithi052.stderr:+ echo 'test api_io on pid 91538' 2023-11-05T08:08:07.738 INFO:tasks.workunit.client.0.smithi052.stderr:+ pids[$f]=91538 2023-11-05T08:08:07.738 INFO:tasks.workunit.client.0.smithi052.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-11-05T08:08:07.738 INFO:tasks.workunit.client.0.smithi052.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_io 2>&1 | tee ceph_test_rados_api_io.log | sed "s/^/ api_io: /"' 2023-11-05T08:08:07.739 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' 1 -eq 1 ']' 2023-11-05T08:08:07.739 INFO:tasks.workunit.client.0.smithi052.stderr:++ printf %25s api_io_pp 2023-11-05T08:08:07.739 INFO:tasks.workunit.client.0.smithi052.stderr:+ r=' api_io_pp' 2023-11-05T08:08:07.739 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo api_io_pp 2023-11-05T08:08:07.739 INFO:tasks.workunit.client.0.smithi052.stderr:++ awk '{print $1}' 2023-11-05T08:08:07.739 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' -f /etc/bashrc ']' 2023-11-05T08:08:07.740 INFO:tasks.workunit.client.0.smithi052.stderr:+ . /etc/bashrc 2023-11-05T08:08:07.740 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -z '' ']' 2023-11-05T08:08:07.740 INFO:tasks.workunit.client.0.smithi052.stderr:++ BASHRCSOURCED=Y 2023-11-05T08:08:07.740 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.740 INFO:tasks.workunit.client.0.smithi052.stderr:++ shopt -q login_shell 2023-11-05T08:08:07.741 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-11-05T08:08:07.741 INFO:tasks.workunit.client.0.smithi052.stderr:+++ umask 2023-11-05T08:08:07.741 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-11-05T08:08:07.741 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-11-05T08:08:07.741 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.742 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-11-05T08:08:07.742 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.742 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-11-05T08:08:07.742 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' 0022 -eq 0 ']' 2023-11-05T08:08:07.742 INFO:tasks.workunit.client.0.smithi052.stderr:++ SHELL=/bin/bash 2023-11-05T08:08:07.742 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-11-05T08:08:07.743 INFO:tasks.workunit.client.0.smithi052.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-05T08:08:07.743 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.743 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-11-05T08:08:07.743 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.743 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/bash_completion.sh 2023-11-05T08:08:07.744 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-11-05T08:08:07.744 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.744 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-11-05T08:08:07.744 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.744 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/cobbler.sh 2023-11-05T08:08:07.744 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-11-05T08:08:07.745 INFO:tasks.workunit.client.0.smithi052.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-11-05T08:08:07.745 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'grep=grep --color=auto' 2023-11-05T08:08:07.745 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.745 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-11-05T08:08:07.745 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.746 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorgrep.sh 2023-11-05T08:08:07.746 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'egrep=egrep --color=auto' 2023-11-05T08:08:07.746 INFO:tasks.workunit.client.0.smithi052.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-05T08:08:07.746 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-11-05T08:08:07.746 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.747 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-11-05T08:08:07.747 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.747 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorls.sh 2023-11-05T08:08:07.747 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' '!' -t 0 ']' 2023-11-05T08:08:07.747 INFO:tasks.workunit.client.0.smithi052.stderr:+++ return 2023-11-05T08:08:07.748 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.748 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-11-05T08:08:07.748 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.748 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-11-05T08:08:07.748 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export S_COLORS=auto 2023-11-05T08:08:07.748 INFO:tasks.workunit.client.0.smithi052.stderr:+++ S_COLORS=auto 2023-11-05T08:08:07.749 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.749 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-11-05T08:08:07.749 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.749 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-11-05T08:08:07.749 INFO:tasks.workunit.client.0.smithi052.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-05T08:08:07.750 INFO:tasks.workunit.client.0.smithi052.stderr:+ ff=api_io_pp 2023-11-05T08:08:07.750 INFO:tasks.workunit.client.0.smithi052.stderr:+ pid=91549 2023-11-05T08:08:07.750 INFO:tasks.workunit.client.0.smithi052.stdout:test api_io_pp on pid 91549 2023-11-05T08:08:07.756 INFO:tasks.workunit.client.0.smithi052.stderr:+ echo 'test api_io_pp on pid 91549' 2023-11-05T08:08:07.756 INFO:tasks.workunit.client.0.smithi052.stderr:+ pids[$f]=91549 2023-11-05T08:08:07.756 INFO:tasks.workunit.client.0.smithi052.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_io_pp 2>&1 | tee ceph_test_rados_api_io_pp.log | sed "s/^/ api_io_pp: /"' 2023-11-05T08:08:07.756 INFO:tasks.workunit.client.0.smithi052.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-11-05T08:08:07.756 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' 1 -eq 1 ']' 2023-11-05T08:08:07.757 INFO:tasks.workunit.client.0.smithi052.stderr:++ printf %25s api_asio 2023-11-05T08:08:07.757 INFO:tasks.workunit.client.0.smithi052.stderr:+ r=' api_asio' 2023-11-05T08:08:07.757 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo api_asio 2023-11-05T08:08:07.757 INFO:tasks.workunit.client.0.smithi052.stderr:++ awk '{print $1}' 2023-11-05T08:08:07.757 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' -f /etc/bashrc ']' 2023-11-05T08:08:07.758 INFO:tasks.workunit.client.0.smithi052.stderr:+ . /etc/bashrc 2023-11-05T08:08:07.758 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -z '' ']' 2023-11-05T08:08:07.758 INFO:tasks.workunit.client.0.smithi052.stderr:++ BASHRCSOURCED=Y 2023-11-05T08:08:07.758 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.758 INFO:tasks.workunit.client.0.smithi052.stderr:++ shopt -q login_shell 2023-11-05T08:08:07.759 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-11-05T08:08:07.759 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-11-05T08:08:07.759 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-11-05T08:08:07.759 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.759 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-11-05T08:08:07.760 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.760 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/debuginfod.sh 2023-11-05T08:08:07.760 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-11-05T08:08:07.760 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.760 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-11-05T08:08:07.761 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.761 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/gawk.sh 2023-11-05T08:08:07.761 INFO:tasks.workunit.client.0.smithi052.stderr:+++ umask 2023-11-05T08:08:07.761 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.761 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-11-05T08:08:07.761 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.762 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/lang.sh 2023-11-05T08:08:07.762 INFO:tasks.workunit.client.0.smithi052.stderr:+++ unset LANG_backup 2023-11-05T08:08:07.762 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' 0022 -eq 0 ']' 2023-11-05T08:08:07.762 INFO:tasks.workunit.client.0.smithi052.stderr:++ SHELL=/bin/bash 2023-11-05T08:08:07.763 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'grep=grep --color=auto' 2023-11-05T08:08:07.763 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'egrep=egrep --color=auto' 2023-11-05T08:08:07.763 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.763 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-11-05T08:08:07.763 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.763 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-11-05T08:08:07.764 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/bash_completion.sh 2023-11-05T08:08:07.764 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.764 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-11-05T08:08:07.764 INFO:tasks.workunit.client.0.smithi052.stderr:++++ /usr/bin/locale 2023-11-05T08:08:07.764 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.764 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-11-05T08:08:07.765 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorls.sh 2023-11-05T08:08:07.765 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.765 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-11-05T08:08:07.765 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.765 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/cobbler.sh 2023-11-05T08:08:07.766 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' '!' -t 0 ']' 2023-11-05T08:08:07.766 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-11-05T08:08:07.766 INFO:tasks.workunit.client.0.smithi052.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-11-05T08:08:07.766 INFO:tasks.workunit.client.0.smithi052.stderr:+++ return 2023-11-05T08:08:07.766 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.767 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.767 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-11-05T08:08:07.767 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-11-05T08:08:07.767 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.767 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorgrep.sh 2023-11-05T08:08:07.767 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.768 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-11-05T08:08:07.768 INFO:tasks.workunit.client.0.smithi052.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-05T08:08:07.768 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export S_COLORS=auto 2023-11-05T08:08:07.768 INFO:tasks.workunit.client.0.smithi052.stderr:+++ S_COLORS=auto 2023-11-05T08:08:07.768 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-11-05T08:08:07.769 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.769 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-11-05T08:08:07.769 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-11-05T08:08:07.769 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.769 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-11-05T08:08:07.769 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-11-05T08:08:07.770 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.770 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-11-05T08:08:07.770 INFO:tasks.workunit.client.0.smithi052.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-05T08:08:07.770 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.770 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-11-05T08:08:07.771 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-11-05T08:08:07.771 INFO:tasks.workunit.client.0.smithi052.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-05T08:08:07.771 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n '' ']' 2023-11-05T08:08:07.771 INFO:tasks.workunit.client.0.smithi052.stderr:+++ LANG_backup=en_US.UTF-8 2023-11-05T08:08:07.771 INFO:tasks.workunit.client.0.smithi052.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-05T08:08:07.772 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -f /etc/locale.conf ']' 2023-11-05T08:08:07.772 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -x /usr/bin/sed ']' 2023-11-05T08:08:07.772 INFO:tasks.workunit.client.0.smithi052.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-11-05T08:08:07.772 INFO:tasks.workunit.client.0.smithi052.stderr:+ ff=api_asio 2023-11-05T08:08:07.772 INFO:tasks.workunit.client.0.smithi052.stderr:+ pid=91564 2023-11-05T08:08:07.773 INFO:tasks.workunit.client.0.smithi052.stdout:test api_asio on pid 91564 2023-11-05T08:08:07.779 INFO:tasks.workunit.client.0.smithi052.stderr:+ echo 'test api_asio on pid 91564' 2023-11-05T08:08:07.780 INFO:tasks.workunit.client.0.smithi052.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_asio 2>&1 | tee ceph_test_rados_api_asio.log | sed "s/^/ api_asio: /"' 2023-11-05T08:08:07.780 INFO:tasks.workunit.client.0.smithi052.stderr:+ pids[$f]=91564 2023-11-05T08:08:07.780 INFO:tasks.workunit.client.0.smithi052.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-11-05T08:08:07.780 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' 1 -eq 1 ']' 2023-11-05T08:08:07.780 INFO:tasks.workunit.client.0.smithi052.stderr:++ printf %25s api_list 2023-11-05T08:08:07.781 INFO:tasks.workunit.client.0.smithi052.stderr:+ r=' api_list' 2023-11-05T08:08:07.781 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo api_list 2023-11-05T08:08:07.781 INFO:tasks.workunit.client.0.smithi052.stderr:++ awk '{print $1}' 2023-11-05T08:08:07.781 INFO:tasks.workunit.client.0.smithi052.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-11-05T08:08:07.781 INFO:tasks.workunit.client.0.smithi052.stderr:++++ export LANG=en_US.UTF-8 2023-11-05T08:08:07.782 INFO:tasks.workunit.client.0.smithi052.stderr:++++ LANG=en_US.UTF-8 2023-11-05T08:08:07.782 INFO:tasks.workunit.client.0.smithi052.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-05T08:08:07.782 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-11-05T08:08:07.782 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-05T08:08:07.782 INFO:tasks.workunit.client.0.smithi052.stderr:+++ LANG=en_US.UTF-8 2023-11-05T08:08:07.782 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' -f /etc/bashrc ']' 2023-11-05T08:08:07.783 INFO:tasks.workunit.client.0.smithi052.stderr:+++ unset LANG_backup config 2023-11-05T08:08:07.783 INFO:tasks.workunit.client.0.smithi052.stderr:+ . /etc/bashrc 2023-11-05T08:08:07.783 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n '' ']' 2023-11-05T08:08:07.783 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-05T08:08:07.783 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' dumb = linux ']' 2023-11-05T08:08:07.784 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.784 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-11-05T08:08:07.784 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-11-05T08:08:07.784 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.784 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -z '' ']' 2023-11-05T08:08:07.785 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/less.sh 2023-11-05T08:08:07.785 INFO:tasks.workunit.client.0.smithi052.stderr:++ BASHRCSOURCED=Y 2023-11-05T08:08:07.785 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-11-05T08:08:07.785 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.785 INFO:tasks.workunit.client.0.smithi052.stderr:++ shopt -q login_shell 2023-11-05T08:08:07.785 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-11-05T08:08:07.786 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-11-05T08:08:07.786 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.786 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.786 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-11-05T08:08:07.786 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-11-05T08:08:07.786 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.787 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.787 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/debuginfod.sh 2023-11-05T08:08:07.787 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/which2.sh 2023-11-05T08:08:07.787 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'grep=grep --color=auto' 2023-11-05T08:08:07.787 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'egrep=egrep --color=auto' 2023-11-05T08:08:07.788 INFO:tasks.workunit.client.0.smithi052.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-11-05T08:08:07.788 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-11-05T08:08:07.788 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.788 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-11-05T08:08:07.788 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-11-05T08:08:07.789 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-11-05T08:08:07.789 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.789 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/gawk.sh 2023-11-05T08:08:07.789 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.789 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-11-05T08:08:07.790 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-11-05T08:08:07.790 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.790 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorls.sh 2023-11-05T08:08:07.790 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-11-05T08:08:07.790 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.791 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-11-05T08:08:07.791 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.791 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' '!' -t 0 ']' 2023-11-05T08:08:07.791 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.791 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-11-05T08:08:07.792 INFO:tasks.workunit.client.0.smithi052.stderr:+++ return 2023-11-05T08:08:07.792 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/lang.sh 2023-11-05T08:08:07.792 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.792 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.792 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-11-05T08:08:07.792 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-11-05T08:08:07.793 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.793 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-11-05T08:08:07.793 INFO:tasks.workunit.client.0.smithi052.stderr:+++ unset LANG_backup 2023-11-05T08:08:07.793 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-11-05T08:08:07.793 INFO:tasks.workunit.client.0.smithi052.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-05T08:08:07.794 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export S_COLORS=auto 2023-11-05T08:08:07.794 INFO:tasks.workunit.client.0.smithi052.stderr:+++ S_COLORS=auto 2023-11-05T08:08:07.794 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.794 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-11-05T08:08:07.794 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.795 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-11-05T08:08:07.795 INFO:tasks.workunit.client.0.smithi052.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-05T08:08:07.795 INFO:tasks.workunit.client.0.smithi052.stderr:+++ umask 2023-11-05T08:08:07.795 INFO:tasks.workunit.client.0.smithi052.stderr:+++++ readlink /proc/91522/exe 2023-11-05T08:08:07.795 INFO:tasks.workunit.client.0.smithi052.stderr:++++ /usr/bin/locale 2023-11-05T08:08:07.796 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' 0022 -eq 0 ']' 2023-11-05T08:08:07.796 INFO:tasks.workunit.client.0.smithi052.stderr:++ SHELL=/bin/bash 2023-11-05T08:08:07.796 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.796 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-11-05T08:08:07.796 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.796 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/bash_completion.sh 2023-11-05T08:08:07.797 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-11-05T08:08:07.797 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.797 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-11-05T08:08:07.797 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.797 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/cobbler.sh 2023-11-05T08:08:07.798 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-11-05T08:08:07.798 INFO:tasks.workunit.client.0.smithi052.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-11-05T08:08:07.798 INFO:tasks.workunit.client.0.smithi052.stderr:++++ basename /usr/bin/bash 2023-11-05T08:08:07.798 INFO:tasks.workunit.client.0.smithi052.stderr:+ ff=api_list 2023-11-05T08:08:07.798 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.799 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-11-05T08:08:07.799 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.799 INFO:tasks.workunit.client.0.smithi052.stderr:+ pid=91580 2023-11-05T08:08:07.799 INFO:tasks.workunit.client.0.smithi052.stderr:+ echo 'test api_list on pid 91580' 2023-11-05T08:08:07.800 INFO:tasks.workunit.client.0.smithi052.stdout:test api_list on pid 91580 2023-11-05T08:08:07.808 INFO:tasks.workunit.client.0.smithi052.stderr:+ pids[$f]=91580 2023-11-05T08:08:07.808 INFO:tasks.workunit.client.0.smithi052.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_list 2>&1 | tee ceph_test_rados_api_list.log | sed "s/^/ api_list: /"' 2023-11-05T08:08:07.808 INFO:tasks.workunit.client.0.smithi052.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-11-05T08:08:07.808 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' 1 -eq 1 ']' 2023-11-05T08:08:07.809 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorgrep.sh 2023-11-05T08:08:07.809 INFO:tasks.workunit.client.0.smithi052.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-05T08:08:07.809 INFO:tasks.workunit.client.0.smithi052.stderr:++ printf %25s api_lock 2023-11-05T08:08:07.809 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n '' ']' 2023-11-05T08:08:07.809 INFO:tasks.workunit.client.0.smithi052.stderr:+++ LANG_backup=en_US.UTF-8 2023-11-05T08:08:07.810 INFO:tasks.workunit.client.0.smithi052.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-05T08:08:07.810 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -f /etc/locale.conf ']' 2023-11-05T08:08:07.810 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -x /usr/bin/sed ']' 2023-11-05T08:08:07.810 INFO:tasks.workunit.client.0.smithi052.stderr:+ r=' api_lock' 2023-11-05T08:08:07.810 INFO:tasks.workunit.client.0.smithi052.stderr:+++ which_declare='declare -f' 2023-11-05T08:08:07.811 INFO:tasks.workunit.client.0.smithi052.stderr:+++ which_opt=-f 2023-11-05T08:08:07.811 INFO:tasks.workunit.client.0.smithi052.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-11-05T08:08:07.811 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export which_declare 2023-11-05T08:08:07.811 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export -f which 2023-11-05T08:08:07.811 INFO:tasks.workunit.client.0.smithi052.stderr:++ unset i 2023-11-05T08:08:07.811 INFO:tasks.workunit.client.0.smithi052.stderr:++ unset -f pathmunge 2023-11-05T08:08:07.812 INFO:tasks.workunit.client.0.smithi052.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-11-05T08:08:07.812 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo api_lock 2023-11-05T08:08:07.812 INFO:tasks.workunit.client.0.smithi052.stderr:+ export PATH 2023-11-05T08:08:07.812 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-11-05T08:08:07.812 INFO:tasks.workunit.client.0.smithi052.stderr:+ unset rc 2023-11-05T08:08:07.813 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' -f /etc/bashrc ']' 2023-11-05T08:08:07.813 INFO:tasks.workunit.client.0.smithi052.stderr:+ . /etc/bashrc 2023-11-05T08:08:07.813 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-11-05T08:08:07.813 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-11-05T08:08:07.813 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-11-05T08:08:07.814 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -z '' ']' 2023-11-05T08:08:07.814 INFO:tasks.workunit.client.0.smithi052.stderr:++ BASHRCSOURCED=Y 2023-11-05T08:08:07.814 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.814 INFO:tasks.workunit.client.0.smithi052.stderr:++ shopt -q login_shell 2023-11-05T08:08:07.814 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.815 INFO:tasks.workunit.client.0.smithi052.stderr:+ ceph_test_rados_api_aio 2023-11-05T08:08:07.815 INFO:tasks.workunit.client.0.smithi052.stderr:+ tee ceph_test_rados_api_aio.log 2023-11-05T08:08:07.815 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-11-05T08:08:07.815 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.815 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/debuginfod.sh 2023-11-05T08:08:07.815 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-11-05T08:08:07.816 INFO:tasks.workunit.client.0.smithi052.stderr:++ awk '{print $1}' 2023-11-05T08:08:07.816 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-11-05T08:08:07.816 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-11-05T08:08:07.816 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.816 INFO:tasks.workunit.client.0.smithi052.stderr:+ sed 's/^/ api_aio: /' 2023-11-05T08:08:07.817 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-11-05T08:08:07.817 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-11-05T08:08:07.817 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.817 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/gawk.sh 2023-11-05T08:08:07.817 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.818 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-11-05T08:08:07.818 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.818 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-11-05T08:08:07.818 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-11-05T08:08:07.818 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.818 INFO:tasks.workunit.client.0.smithi052.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-05T08:08:07.819 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-11-05T08:08:07.819 INFO:tasks.workunit.client.0.smithi052.stderr:+++ umask 2023-11-05T08:08:07.819 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.819 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/lang.sh 2023-11-05T08:08:07.819 INFO:tasks.workunit.client.0.smithi052.stderr:+++ unset LANG_backup 2023-11-05T08:08:07.820 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' 0022 -eq 0 ']' 2023-11-05T08:08:07.820 INFO:tasks.workunit.client.0.smithi052.stderr:++ SHELL=/bin/bash 2023-11-05T08:08:07.820 INFO:tasks.workunit.client.0.smithi052.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-11-05T08:08:07.820 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.820 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-11-05T08:08:07.820 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.821 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/bash_completion.sh 2023-11-05T08:08:07.821 INFO:tasks.workunit.client.0.smithi052.stderr:++++ export LANG=en_US.UTF-8 2023-11-05T08:08:07.821 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-11-05T08:08:07.821 INFO:tasks.workunit.client.0.smithi052.stderr:++++ LANG=en_US.UTF-8 2023-11-05T08:08:07.821 INFO:tasks.workunit.client.0.smithi052.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-05T08:08:07.822 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.822 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-11-05T08:08:07.822 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.822 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/cobbler.sh 2023-11-05T08:08:07.822 INFO:tasks.workunit.client.0.smithi052.stderr:++++ /usr/bin/locale 2023-11-05T08:08:07.823 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-11-05T08:08:07.823 INFO:tasks.workunit.client.0.smithi052.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-11-05T08:08:07.823 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.823 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-11-05T08:08:07.823 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.824 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorgrep.sh 2023-11-05T08:08:07.824 INFO:tasks.workunit.client.0.smithi052.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-05T08:08:07.824 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-11-05T08:08:07.824 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-05T08:08:07.824 INFO:tasks.workunit.client.0.smithi052.stderr:+++ LANG=en_US.UTF-8 2023-11-05T08:08:07.825 INFO:tasks.workunit.client.0.smithi052.stderr:+++ unset LANG_backup config 2023-11-05T08:08:07.825 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n '' ']' 2023-11-05T08:08:07.825 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-05T08:08:07.825 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' dumb = linux ']' 2023-11-05T08:08:07.825 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.826 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-11-05T08:08:07.826 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.826 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/less.sh 2023-11-05T08:08:07.826 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-11-05T08:08:07.826 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.826 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-11-05T08:08:07.827 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.827 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/which2.sh 2023-11-05T08:08:07.827 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n '' ']' 2023-11-05T08:08:07.827 INFO:tasks.workunit.client.0.smithi052.stderr:+++ LANG_backup=en_US.UTF-8 2023-11-05T08:08:07.827 INFO:tasks.workunit.client.0.smithi052.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-05T08:08:07.828 INFO:tasks.workunit.client.0.smithi052.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-11-05T08:08:07.828 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -f /etc/locale.conf ']' 2023-11-05T08:08:07.828 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -x /usr/bin/sed ']' 2023-11-05T08:08:07.828 INFO:tasks.workunit.client.0.smithi052.stderr:+ ff=api_lock 2023-11-05T08:08:07.828 INFO:tasks.workunit.client.0.smithi052.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-11-05T08:08:07.828 INFO:tasks.workunit.client.0.smithi052.stderr:+ pid=91600 2023-11-05T08:08:07.829 INFO:tasks.workunit.client.0.smithi052.stdout:test api_lock on pid 91600 2023-11-05T08:08:07.841 INFO:tasks.workunit.client.0.smithi052.stderr:+ echo 'test api_lock on pid 91600' 2023-11-05T08:08:07.841 INFO:tasks.workunit.client.0.smithi052.stderr:+ pids[$f]=91600 2023-11-05T08:08:07.841 INFO:tasks.workunit.client.0.smithi052.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-11-05T08:08:07.841 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' 1 -eq 1 ']' 2023-11-05T08:08:07.842 INFO:tasks.workunit.client.0.smithi052.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_lock 2>&1 | tee ceph_test_rados_api_lock.log | sed "s/^/ api_lock: /"' 2023-11-05T08:08:07.842 INFO:tasks.workunit.client.0.smithi052.stderr:+++++ readlink /proc/91529/exe 2023-11-05T08:08:07.842 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'grep=grep --color=auto' 2023-11-05T08:08:07.842 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'egrep=egrep --color=auto' 2023-11-05T08:08:07.842 INFO:tasks.workunit.client.0.smithi052.stderr:++ printf %25s api_lock_pp 2023-11-05T08:08:07.843 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-11-05T08:08:07.843 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.843 INFO:tasks.workunit.client.0.smithi052.stderr:+ r=' api_lock_pp' 2023-11-05T08:08:07.843 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-11-05T08:08:07.843 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-11-05T08:08:07.843 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-11-05T08:08:07.844 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.844 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorls.sh 2023-11-05T08:08:07.844 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' '!' -t 0 ']' 2023-11-05T08:08:07.844 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-11-05T08:08:07.844 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.845 INFO:tasks.workunit.client.0.smithi052.stderr:+++ return 2023-11-05T08:08:07.845 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.845 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-11-05T08:08:07.845 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.845 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-11-05T08:08:07.846 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export S_COLORS=auto 2023-11-05T08:08:07.846 INFO:tasks.workunit.client.0.smithi052.stderr:+++ S_COLORS=auto 2023-11-05T08:08:07.846 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.846 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-11-05T08:08:07.846 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.846 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-11-05T08:08:07.847 INFO:tasks.workunit.client.0.smithi052.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-05T08:08:07.847 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-11-05T08:08:07.847 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.847 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/debuginfod.sh 2023-11-05T08:08:07.847 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-11-05T08:08:07.848 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.848 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-11-05T08:08:07.848 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.848 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/gawk.sh 2023-11-05T08:08:07.848 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.849 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-11-05T08:08:07.849 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.849 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/lang.sh 2023-11-05T08:08:07.849 INFO:tasks.workunit.client.0.smithi052.stderr:+++ unset LANG_backup 2023-11-05T08:08:07.849 INFO:tasks.workunit.client.0.smithi052.stderr:++++ basename /usr/bin/bash 2023-11-05T08:08:07.850 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo api_lock_pp 2023-11-05T08:08:07.850 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' -f /etc/bashrc ']' 2023-11-05T08:08:07.850 INFO:tasks.workunit.client.0.smithi052.stderr:+ . /etc/bashrc 2023-11-05T08:08:07.850 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -z '' ']' 2023-11-05T08:08:07.850 INFO:tasks.workunit.client.0.smithi052.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-11-05T08:08:07.851 INFO:tasks.workunit.client.0.smithi052.stderr:++++ export LANG=en_US.UTF-8 2023-11-05T08:08:07.851 INFO:tasks.workunit.client.0.smithi052.stderr:++++ LANG=en_US.UTF-8 2023-11-05T08:08:07.851 INFO:tasks.workunit.client.0.smithi052.stderr:++ BASHRCSOURCED=Y 2023-11-05T08:08:07.851 INFO:tasks.workunit.client.0.smithi052.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-05T08:08:07.851 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-11-05T08:08:07.852 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-05T08:08:07.852 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.852 INFO:tasks.workunit.client.0.smithi052.stderr:++ awk '{print $1}' 2023-11-05T08:08:07.852 INFO:tasks.workunit.client.0.smithi052.stderr:++ shopt -q login_shell 2023-11-05T08:08:07.852 INFO:tasks.workunit.client.0.smithi052.stderr:+++ LANG=en_US.UTF-8 2023-11-05T08:08:07.853 INFO:tasks.workunit.client.0.smithi052.stderr:+++ unset LANG_backup config 2023-11-05T08:08:07.853 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n '' ']' 2023-11-05T08:08:07.853 INFO:tasks.workunit.client.0.smithi052.stderr:++++ /usr/bin/locale 2023-11-05T08:08:07.853 INFO:tasks.workunit.client.0.smithi052.stderr:+++ umask 2023-11-05T08:08:07.853 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'grep=grep --color=auto' 2023-11-05T08:08:07.854 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-05T08:08:07.854 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' dumb = linux ']' 2023-11-05T08:08:07.854 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.854 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-11-05T08:08:07.854 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.855 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/less.sh 2023-11-05T08:08:07.855 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-11-05T08:08:07.855 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'egrep=egrep --color=auto' 2023-11-05T08:08:07.855 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' 0022 -eq 0 ']' 2023-11-05T08:08:07.855 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-11-05T08:08:07.856 INFO:tasks.workunit.client.0.smithi052.stderr:++ SHELL=/bin/bash 2023-11-05T08:08:07.856 INFO:tasks.workunit.client.0.smithi052.stderr:+++ which_declare='declare -f' 2023-11-05T08:08:07.856 INFO:tasks.workunit.client.0.smithi052.stderr:+++ which_opt=-f 2023-11-05T08:08:07.856 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.856 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-11-05T08:08:07.857 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.857 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export which_declare 2023-11-05T08:08:07.857 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorls.sh 2023-11-05T08:08:07.857 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export -f which 2023-11-05T08:08:07.857 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.858 INFO:tasks.workunit.client.0.smithi052.stderr:++ unset i 2023-11-05T08:08:07.858 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-11-05T08:08:07.858 INFO:tasks.workunit.client.0.smithi052.stderr:++ unset -f pathmunge 2023-11-05T08:08:07.858 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' '!' -t 0 ']' 2023-11-05T08:08:07.858 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.859 INFO:tasks.workunit.client.0.smithi052.stderr:+++ return 2023-11-05T08:08:07.859 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/bash_completion.sh 2023-11-05T08:08:07.859 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.859 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-11-05T08:08:07.859 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.860 INFO:tasks.workunit.client.0.smithi052.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-11-05T08:08:07.860 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-11-05T08:08:07.860 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export S_COLORS=auto 2023-11-05T08:08:07.860 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.860 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-11-05T08:08:07.861 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.861 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-11-05T08:08:07.861 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/which2.sh 2023-11-05T08:08:07.861 INFO:tasks.workunit.client.0.smithi052.stderr:+++ S_COLORS=auto 2023-11-05T08:08:07.861 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.862 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.862 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-11-05T08:08:07.862 INFO:tasks.workunit.client.0.smithi052.stderr:+ export PATH 2023-11-05T08:08:07.862 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-11-05T08:08:07.862 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.863 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/cobbler.sh 2023-11-05T08:08:07.863 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.863 INFO:tasks.workunit.client.0.smithi052.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-11-05T08:08:07.863 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-11-05T08:08:07.863 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-11-05T08:08:07.864 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-11-05T08:08:07.864 INFO:tasks.workunit.client.0.smithi052.stderr:+ unset rc 2023-11-05T08:08:07.864 INFO:tasks.workunit.client.0.smithi052.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-11-05T08:08:07.864 INFO:tasks.workunit.client.0.smithi052.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-05T08:08:07.864 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.864 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-11-05T08:08:07.865 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.865 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorgrep.sh 2023-11-05T08:08:07.865 INFO:tasks.workunit.client.0.smithi052.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-05T08:08:07.865 INFO:tasks.workunit.client.0.smithi052.stderr:+++++ readlink /proc/91538/exe 2023-11-05T08:08:07.865 INFO:tasks.workunit.client.0.smithi052.stderr:+ tee ceph_test_rados_api_aio_pp.log 2023-11-05T08:08:07.866 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n '' ']' 2023-11-05T08:08:07.866 INFO:tasks.workunit.client.0.smithi052.stderr:+++ LANG_backup=en_US.UTF-8 2023-11-05T08:08:07.866 INFO:tasks.workunit.client.0.smithi052.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-05T08:08:07.866 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -f /etc/locale.conf ']' 2023-11-05T08:08:07.866 INFO:tasks.workunit.client.0.smithi052.stderr:+ sed 's/^/ api_aio_pp: /' 2023-11-05T08:08:07.867 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -x /usr/bin/sed ']' 2023-11-05T08:08:07.867 INFO:tasks.workunit.client.0.smithi052.stderr:+ ceph_test_rados_api_aio_pp 2023-11-05T08:08:07.867 INFO:tasks.workunit.client.0.smithi052.stderr:++++ basename /usr/bin/bash 2023-11-05T08:08:07.867 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-11-05T08:08:07.867 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-11-05T08:08:07.867 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-11-05T08:08:07.868 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.868 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-11-05T08:08:07.868 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.868 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-11-05T08:08:07.868 INFO:tasks.workunit.client.0.smithi052.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-11-05T08:08:07.869 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-11-05T08:08:07.869 INFO:tasks.workunit.client.0.smithi052.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-05T08:08:07.869 INFO:tasks.workunit.client.0.smithi052.stderr:+++ which_declare='declare -f' 2023-11-05T08:08:07.869 INFO:tasks.workunit.client.0.smithi052.stderr:+++ which_opt=-f 2023-11-05T08:08:07.869 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export which_declare 2023-11-05T08:08:07.870 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export -f which 2023-11-05T08:08:07.870 INFO:tasks.workunit.client.0.smithi052.stderr:++ unset i 2023-11-05T08:08:07.870 INFO:tasks.workunit.client.0.smithi052.stderr:++ unset -f pathmunge 2023-11-05T08:08:07.870 INFO:tasks.workunit.client.0.smithi052.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-11-05T08:08:07.870 INFO:tasks.workunit.client.0.smithi052.stderr:+ ff=api_lock_pp 2023-11-05T08:08:07.871 INFO:tasks.workunit.client.0.smithi052.stderr:+ export PATH 2023-11-05T08:08:07.871 INFO:tasks.workunit.client.0.smithi052.stderr:+ pid=91623 2023-11-05T08:08:07.871 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-11-05T08:08:07.871 INFO:tasks.workunit.client.0.smithi052.stderr:+ unset rc 2023-11-05T08:08:07.871 INFO:tasks.workunit.client.0.smithi052.stderr:+ echo 'test api_lock_pp on pid 91623' 2023-11-05T08:08:07.871 INFO:tasks.workunit.client.0.smithi052.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_lock_pp 2>&1 | tee ceph_test_rados_api_lock_pp.log | sed "s/^/ api_lock_pp: /"' 2023-11-05T08:08:07.872 INFO:tasks.workunit.client.0.smithi052.stdout:test api_lock_pp on pid 91623 2023-11-05T08:08:07.881 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'grep=grep --color=auto' 2023-11-05T08:08:07.881 INFO:tasks.workunit.client.0.smithi052.stderr:+ pids[$f]=91623 2023-11-05T08:08:07.881 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'egrep=egrep --color=auto' 2023-11-05T08:08:07.881 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-11-05T08:08:07.882 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.882 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-11-05T08:08:07.882 INFO:tasks.workunit.client.0.smithi052.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-11-05T08:08:07.882 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.882 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorls.sh 2023-11-05T08:08:07.883 INFO:tasks.workunit.client.0.smithi052.stderr:++++ export LANG=en_US.UTF-8 2023-11-05T08:08:07.883 INFO:tasks.workunit.client.0.smithi052.stderr:++++ LANG=en_US.UTF-8 2023-11-05T08:08:07.883 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' '!' -t 0 ']' 2023-11-05T08:08:07.883 INFO:tasks.workunit.client.0.smithi052.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-05T08:08:07.883 INFO:tasks.workunit.client.0.smithi052.stderr:+++ return 2023-11-05T08:08:07.884 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-11-05T08:08:07.884 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.884 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-11-05T08:08:07.884 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-05T08:08:07.884 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.885 INFO:tasks.workunit.client.0.smithi052.stderr:+++ LANG=en_US.UTF-8 2023-11-05T08:08:07.885 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-11-05T08:08:07.885 INFO:tasks.workunit.client.0.smithi052.stderr:+++ unset LANG_backup config 2023-11-05T08:08:07.885 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export S_COLORS=auto 2023-11-05T08:08:07.885 INFO:tasks.workunit.client.0.smithi052.stderr:+++ S_COLORS=auto 2023-11-05T08:08:07.886 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n '' ']' 2023-11-05T08:08:07.886 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.886 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-11-05T08:08:07.886 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.886 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-11-05T08:08:07.886 INFO:tasks.workunit.client.0.smithi052.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-05T08:08:07.887 INFO:tasks.workunit.client.0.smithi052.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-11-05T08:08:07.887 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-05T08:08:07.887 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' dumb = linux ']' 2023-11-05T08:08:07.887 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' 1 -eq 1 ']' 2023-11-05T08:08:07.887 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.888 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-11-05T08:08:07.888 INFO:tasks.workunit.client.0.smithi052.stderr:+ ceph_test_rados_api_io 2023-11-05T08:08:07.888 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.888 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/less.sh 2023-11-05T08:08:07.888 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-11-05T08:08:07.888 INFO:tasks.workunit.client.0.smithi052.stderr:+ tee ceph_test_rados_api_io.log 2023-11-05T08:08:07.889 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.889 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-11-05T08:08:07.889 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.889 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/which2.sh 2023-11-05T08:08:07.890 INFO:tasks.workunit.client.0.smithi052.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-11-05T08:08:07.890 INFO:tasks.workunit.client.0.smithi052.stderr:++ printf %25s api_misc 2023-11-05T08:08:07.890 INFO:tasks.workunit.client.0.smithi052.stderr:+ r=' api_misc' 2023-11-05T08:08:07.890 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-11-05T08:08:07.890 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-11-05T08:08:07.890 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-11-05T08:08:07.891 INFO:tasks.workunit.client.0.smithi052.stderr:+ sed 's/^/ api_io: /' 2023-11-05T08:08:07.891 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.891 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-11-05T08:08:07.891 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.891 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-11-05T08:08:07.892 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-11-05T08:08:07.892 INFO:tasks.workunit.client.0.smithi052.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-05T08:08:07.892 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' -f /etc/bashrc ']' 2023-11-05T08:08:07.892 INFO:tasks.workunit.client.0.smithi052.stderr:+ . /etc/bashrc 2023-11-05T08:08:07.892 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -z '' ']' 2023-11-05T08:08:07.893 INFO:tasks.workunit.client.0.smithi052.stderr:++ BASHRCSOURCED=Y 2023-11-05T08:08:07.893 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-11-05T08:08:07.893 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.893 INFO:tasks.workunit.client.0.smithi052.stderr:++ shopt -q login_shell 2023-11-05T08:08:07.893 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-11-05T08:08:07.893 INFO:tasks.workunit.client.0.smithi052.stderr:+++++ readlink /proc/91549/exe 2023-11-05T08:08:07.894 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-11-05T08:08:07.894 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.894 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-11-05T08:08:07.894 INFO:tasks.workunit.client.0.smithi052.stderr:+++ umask 2023-11-05T08:08:07.894 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.895 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/debuginfod.sh 2023-11-05T08:08:07.895 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-11-05T08:08:07.895 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.895 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-11-05T08:08:07.895 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.896 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' 0022 -eq 0 ']' 2023-11-05T08:08:07.896 INFO:tasks.workunit.client.0.smithi052.stderr:++ SHELL=/bin/bash 2023-11-05T08:08:07.896 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/gawk.sh 2023-11-05T08:08:07.896 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.896 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-11-05T08:08:07.896 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.897 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/bash_completion.sh 2023-11-05T08:08:07.897 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-11-05T08:08:07.897 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.897 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-11-05T08:08:07.897 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.898 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/cobbler.sh 2023-11-05T08:08:07.898 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-11-05T08:08:07.898 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.898 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-11-05T08:08:07.898 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.898 INFO:tasks.workunit.client.0.smithi052.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-11-05T08:08:07.899 INFO:tasks.workunit.client.0.smithi052.stderr:++ awk '{print $1}' 2023-11-05T08:08:07.899 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.899 INFO:tasks.workunit.client.0.smithi052.stderr:++++ basename /usr/bin/bash 2023-11-05T08:08:07.899 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-11-05T08:08:07.899 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.900 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorgrep.sh 2023-11-05T08:08:07.900 INFO:tasks.workunit.client.0.smithi052.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-05T08:08:07.900 INFO:tasks.workunit.client.0.smithi052.stderr:+++ which_declare='declare -f' 2023-11-05T08:08:07.900 INFO:tasks.workunit.client.0.smithi052.stderr:+++ which_opt=-f 2023-11-05T08:08:07.900 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export which_declare 2023-11-05T08:08:07.900 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export -f which 2023-11-05T08:08:07.901 INFO:tasks.workunit.client.0.smithi052.stderr:++ unset i 2023-11-05T08:08:07.901 INFO:tasks.workunit.client.0.smithi052.stderr:++ unset -f pathmunge 2023-11-05T08:08:07.901 INFO:tasks.workunit.client.0.smithi052.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-11-05T08:08:07.901 INFO:tasks.workunit.client.0.smithi052.stderr:+ export PATH 2023-11-05T08:08:07.901 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-11-05T08:08:07.902 INFO:tasks.workunit.client.0.smithi052.stderr:+ unset rc 2023-11-05T08:08:07.902 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo api_misc 2023-11-05T08:08:07.902 INFO:tasks.workunit.client.0.smithi052.stderr:+ ceph_test_rados_api_io_pp 2023-11-05T08:08:07.902 INFO:tasks.workunit.client.0.smithi052.stderr:+ tee ceph_test_rados_api_io_pp.log 2023-11-05T08:08:07.902 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-11-05T08:08:07.903 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/lang.sh 2023-11-05T08:08:07.903 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-11-05T08:08:07.903 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-11-05T08:08:07.903 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.903 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-11-05T08:08:07.904 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.904 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/debuginfod.sh 2023-11-05T08:08:07.904 INFO:tasks.workunit.client.0.smithi052.stderr:+ ff=api_misc 2023-11-05T08:08:07.904 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-11-05T08:08:07.904 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.905 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-11-05T08:08:07.905 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.905 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/gawk.sh 2023-11-05T08:08:07.905 INFO:tasks.workunit.client.0.smithi052.stderr:+++ unset LANG_backup 2023-11-05T08:08:07.905 INFO:tasks.workunit.client.0.smithi052.stderr:+ pid=91644 2023-11-05T08:08:07.906 INFO:tasks.workunit.client.0.smithi052.stderr:+ echo 'test api_misc on pid 91644' 2023-11-05T08:08:07.906 INFO:tasks.workunit.client.0.smithi052.stdout:test api_misc on pid 91644 2023-11-05T08:08:07.916 INFO:tasks.workunit.client.0.smithi052.stderr:+ pids[$f]=91644 2023-11-05T08:08:07.916 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.916 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-11-05T08:08:07.916 INFO:tasks.workunit.client.0.smithi052.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-11-05T08:08:07.916 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' 1 -eq 1 ']' 2023-11-05T08:08:07.917 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.917 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/lang.sh 2023-11-05T08:08:07.917 INFO:tasks.workunit.client.0.smithi052.stderr:+++ unset LANG_backup 2023-11-05T08:08:07.917 INFO:tasks.workunit.client.0.smithi052.stderr:++++ /usr/bin/locale 2023-11-05T08:08:07.917 INFO:tasks.workunit.client.0.smithi052.stderr:++++ /usr/bin/locale 2023-11-05T08:08:07.918 INFO:tasks.workunit.client.0.smithi052.stderr:+ sed 's/^/ api_io_pp: /' 2023-11-05T08:08:07.918 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-11-05T08:08:07.918 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-11-05T08:08:07.918 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-11-05T08:08:07.918 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.918 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-11-05T08:08:07.919 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.919 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-11-05T08:08:07.919 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-11-05T08:08:07.919 INFO:tasks.workunit.client.0.smithi052.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-05T08:08:07.919 INFO:tasks.workunit.client.0.smithi052.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_misc 2>&1 | tee ceph_test_rados_api_misc.log | sed "s/^/ api_misc: /"' 2023-11-05T08:08:07.920 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n '' ']' 2023-11-05T08:08:07.920 INFO:tasks.workunit.client.0.smithi052.stderr:+++ LANG_backup=en_US.UTF-8 2023-11-05T08:08:07.920 INFO:tasks.workunit.client.0.smithi052.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-05T08:08:07.920 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -f /etc/locale.conf ']' 2023-11-05T08:08:07.920 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -x /usr/bin/sed ']' 2023-11-05T08:08:07.921 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' -f /etc/bashrc ']' 2023-11-05T08:08:07.921 INFO:tasks.workunit.client.0.smithi052.stderr:+ . /etc/bashrc 2023-11-05T08:08:07.921 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -z '' ']' 2023-11-05T08:08:07.921 INFO:tasks.workunit.client.0.smithi052.stderr:++ BASHRCSOURCED=Y 2023-11-05T08:08:07.921 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.922 INFO:tasks.workunit.client.0.smithi052.stderr:++ shopt -q login_shell 2023-11-05T08:08:07.922 INFO:tasks.workunit.client.0.smithi052.stderr:+++ umask 2023-11-05T08:08:07.922 INFO:tasks.workunit.client.0.smithi052.stderr:++ printf %25s api_misc_pp 2023-11-05T08:08:07.922 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' 0022 -eq 0 ']' 2023-11-05T08:08:07.922 INFO:tasks.workunit.client.0.smithi052.stderr:++ SHELL=/bin/bash 2023-11-05T08:08:07.923 INFO:tasks.workunit.client.0.smithi052.stderr:+ r=' api_misc_pp' 2023-11-05T08:08:07.923 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.923 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-11-05T08:08:07.923 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.923 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/bash_completion.sh 2023-11-05T08:08:07.924 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-11-05T08:08:07.924 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n '' ']' 2023-11-05T08:08:07.924 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.924 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-11-05T08:08:07.924 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.925 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/cobbler.sh 2023-11-05T08:08:07.925 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-11-05T08:08:07.925 INFO:tasks.workunit.client.0.smithi052.stderr:+++ LANG_backup=en_US.UTF-8 2023-11-05T08:08:07.925 INFO:tasks.workunit.client.0.smithi052.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-11-05T08:08:07.925 INFO:tasks.workunit.client.0.smithi052.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-05T08:08:07.925 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.926 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-11-05T08:08:07.926 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.926 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorgrep.sh 2023-11-05T08:08:07.926 INFO:tasks.workunit.client.0.smithi052.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-05T08:08:07.926 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -f /etc/locale.conf ']' 2023-11-05T08:08:07.927 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -x /usr/bin/sed ']' 2023-11-05T08:08:07.927 INFO:tasks.workunit.client.0.smithi052.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-11-05T08:08:07.927 INFO:tasks.workunit.client.0.smithi052.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-11-05T08:08:07.927 INFO:tasks.workunit.client.0.smithi052.stderr:++ awk '{print $1}' 2023-11-05T08:08:07.927 INFO:tasks.workunit.client.0.smithi052.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-11-05T08:08:07.927 INFO:tasks.workunit.client.0.smithi052.stderr:++++ export LANG=en_US.UTF-8 2023-11-05T08:08:07.928 INFO:tasks.workunit.client.0.smithi052.stderr:++++ LANG=en_US.UTF-8 2023-11-05T08:08:07.928 INFO:tasks.workunit.client.0.smithi052.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-05T08:08:07.928 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-11-05T08:08:07.928 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-05T08:08:07.928 INFO:tasks.workunit.client.0.smithi052.stderr:+++ LANG=en_US.UTF-8 2023-11-05T08:08:07.928 INFO:tasks.workunit.client.0.smithi052.stderr:+++ unset LANG_backup config 2023-11-05T08:08:07.929 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n '' ']' 2023-11-05T08:08:07.929 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-05T08:08:07.929 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' dumb = linux ']' 2023-11-05T08:08:07.929 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.929 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-11-05T08:08:07.930 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.930 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/less.sh 2023-11-05T08:08:07.930 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-11-05T08:08:07.930 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.930 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-11-05T08:08:07.930 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.931 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/which2.sh 2023-11-05T08:08:07.931 INFO:tasks.workunit.client.0.smithi052.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-11-05T08:08:07.931 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo api_misc_pp 2023-11-05T08:08:07.931 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-11-05T08:08:07.931 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-11-05T08:08:07.932 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-11-05T08:08:07.932 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'grep=grep --color=auto' 2023-11-05T08:08:07.932 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.932 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-11-05T08:08:07.932 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'egrep=egrep --color=auto' 2023-11-05T08:08:07.933 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.933 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/debuginfod.sh 2023-11-05T08:08:07.933 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-11-05T08:08:07.933 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.933 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-11-05T08:08:07.934 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.934 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-11-05T08:08:07.934 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.934 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/gawk.sh 2023-11-05T08:08:07.934 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-11-05T08:08:07.934 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.935 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.935 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-11-05T08:08:07.935 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.935 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/lang.sh 2023-11-05T08:08:07.935 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorls.sh 2023-11-05T08:08:07.936 INFO:tasks.workunit.client.0.smithi052.stderr:+++ unset LANG_backup 2023-11-05T08:08:07.936 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' '!' -t 0 ']' 2023-11-05T08:08:07.936 INFO:tasks.workunit.client.0.smithi052.stderr:+++ return 2023-11-05T08:08:07.936 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.936 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-11-05T08:08:07.936 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.937 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-11-05T08:08:07.937 INFO:tasks.workunit.client.0.smithi052.stderr:+ ff=api_misc_pp 2023-11-05T08:08:07.937 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'grep=grep --color=auto' 2023-11-05T08:08:07.937 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'egrep=egrep --color=auto' 2023-11-05T08:08:07.937 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-11-05T08:08:07.937 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.938 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-11-05T08:08:07.938 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.938 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorls.sh 2023-11-05T08:08:07.938 INFO:tasks.workunit.client.0.smithi052.stderr:+ pid=91662 2023-11-05T08:08:07.938 INFO:tasks.workunit.client.0.smithi052.stderr:+ echo 'test api_misc_pp on pid 91662' 2023-11-05T08:08:07.939 INFO:tasks.workunit.client.0.smithi052.stdout:test api_misc_pp on pid 91662 2023-11-05T08:08:07.958 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' '!' -t 0 ']' 2023-11-05T08:08:07.959 INFO:tasks.workunit.client.0.smithi052.stderr:+ pids[$f]=91662 2023-11-05T08:08:07.959 INFO:tasks.workunit.client.0.smithi052.stderr:+++ return 2023-11-05T08:08:07.959 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.959 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-11-05T08:08:07.960 INFO:tasks.workunit.client.0.smithi052.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-11-05T08:08:07.960 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.960 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-11-05T08:08:07.960 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' 1 -eq 1 ']' 2023-11-05T08:08:07.960 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export S_COLORS=auto 2023-11-05T08:08:07.960 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export S_COLORS=auto 2023-11-05T08:08:07.961 INFO:tasks.workunit.client.0.smithi052.stderr:+++ S_COLORS=auto 2023-11-05T08:08:07.961 INFO:tasks.workunit.client.0.smithi052.stderr:+++ S_COLORS=auto 2023-11-05T08:08:07.961 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.961 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.961 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-11-05T08:08:07.962 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-11-05T08:08:07.962 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.962 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-11-05T08:08:07.962 INFO:tasks.workunit.client.0.smithi052.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_misc_pp 2>&1 | tee ceph_test_rados_api_misc_pp.log | sed "s/^/ api_misc_pp: /"' 2023-11-05T08:08:07.962 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.963 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-11-05T08:08:07.963 INFO:tasks.workunit.client.0.smithi052.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-05T08:08:07.963 INFO:tasks.workunit.client.0.smithi052.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-05T08:08:07.963 INFO:tasks.workunit.client.0.smithi052.stderr:++++ /usr/bin/locale 2023-11-05T08:08:07.963 INFO:tasks.workunit.client.0.smithi052.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-11-05T08:08:07.963 INFO:tasks.workunit.client.0.smithi052.stderr:++++ export LANG=en_US.UTF-8 2023-11-05T08:08:07.964 INFO:tasks.workunit.client.0.smithi052.stderr:++++ LANG=en_US.UTF-8 2023-11-05T08:08:07.964 INFO:tasks.workunit.client.0.smithi052.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-05T08:08:07.964 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-11-05T08:08:07.964 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-05T08:08:07.964 INFO:tasks.workunit.client.0.smithi052.stderr:+++ LANG=en_US.UTF-8 2023-11-05T08:08:07.965 INFO:tasks.workunit.client.0.smithi052.stderr:+++ unset LANG_backup config 2023-11-05T08:08:07.965 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n '' ']' 2023-11-05T08:08:07.965 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-05T08:08:07.965 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' dumb = linux ']' 2023-11-05T08:08:07.965 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.966 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' -f /etc/bashrc ']' 2023-11-05T08:08:07.966 INFO:tasks.workunit.client.0.smithi052.stderr:+ . /etc/bashrc 2023-11-05T08:08:07.966 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-11-05T08:08:07.966 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.967 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/less.sh 2023-11-05T08:08:07.967 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -z '' ']' 2023-11-05T08:08:07.967 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-11-05T08:08:07.967 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.967 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-11-05T08:08:07.968 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.968 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/which2.sh 2023-11-05T08:08:07.968 INFO:tasks.workunit.client.0.smithi052.stderr:++ BASHRCSOURCED=Y 2023-11-05T08:08:07.968 INFO:tasks.workunit.client.0.smithi052.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-11-05T08:08:07.969 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.969 INFO:tasks.workunit.client.0.smithi052.stderr:++ shopt -q login_shell 2023-11-05T08:08:07.969 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n '' ']' 2023-11-05T08:08:07.969 INFO:tasks.workunit.client.0.smithi052.stderr:+++ LANG_backup=en_US.UTF-8 2023-11-05T08:08:07.969 INFO:tasks.workunit.client.0.smithi052.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-05T08:08:07.969 INFO:tasks.workunit.client.0.smithi052.stderr:+++ umask 2023-11-05T08:08:07.970 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -f /etc/locale.conf ']' 2023-11-05T08:08:07.970 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -x /usr/bin/sed ']' 2023-11-05T08:08:07.970 INFO:tasks.workunit.client.0.smithi052.stderr:+++++ readlink /proc/91564/exe 2023-11-05T08:08:07.970 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' 0022 -eq 0 ']' 2023-11-05T08:08:07.971 INFO:tasks.workunit.client.0.smithi052.stderr:++ SHELL=/bin/bash 2023-11-05T08:08:07.971 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.971 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-11-05T08:08:07.971 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.971 INFO:tasks.workunit.client.0.smithi052.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-11-05T08:08:07.972 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/bash_completion.sh 2023-11-05T08:08:07.972 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-11-05T08:08:07.972 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.972 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-11-05T08:08:07.972 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.972 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/cobbler.sh 2023-11-05T08:08:07.973 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-11-05T08:08:07.973 INFO:tasks.workunit.client.0.smithi052.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-11-05T08:08:07.973 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.973 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-11-05T08:08:07.973 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.974 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorgrep.sh 2023-11-05T08:08:07.974 INFO:tasks.workunit.client.0.smithi052.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-05T08:08:07.974 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-11-05T08:08:07.974 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-11-05T08:08:07.974 INFO:tasks.workunit.client.0.smithi052.stderr:++++ basename /usr/bin/bash 2023-11-05T08:08:07.975 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-11-05T08:08:07.975 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.975 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-11-05T08:08:07.975 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.975 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-11-05T08:08:07.975 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-11-05T08:08:07.976 INFO:tasks.workunit.client.0.smithi052.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-05T08:08:07.976 INFO:tasks.workunit.client.0.smithi052.stderr:+++ which_declare='declare -f' 2023-11-05T08:08:07.976 INFO:tasks.workunit.client.0.smithi052.stderr:+++ which_opt=-f 2023-11-05T08:08:07.976 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export which_declare 2023-11-05T08:08:07.977 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export -f which 2023-11-05T08:08:07.977 INFO:tasks.workunit.client.0.smithi052.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-11-05T08:08:07.977 INFO:tasks.workunit.client.0.smithi052.stderr:++++ export LANG=en_US.UTF-8 2023-11-05T08:08:07.977 INFO:tasks.workunit.client.0.smithi052.stderr:++++ LANG=en_US.UTF-8 2023-11-05T08:08:07.977 INFO:tasks.workunit.client.0.smithi052.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-05T08:08:07.978 INFO:tasks.workunit.client.0.smithi052.stderr:++ unset i 2023-11-05T08:08:07.978 INFO:tasks.workunit.client.0.smithi052.stderr:++ unset -f pathmunge 2023-11-05T08:08:07.978 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-11-05T08:08:07.978 INFO:tasks.workunit.client.0.smithi052.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-11-05T08:08:07.978 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-05T08:08:07.978 INFO:tasks.workunit.client.0.smithi052.stderr:+++ LANG=en_US.UTF-8 2023-11-05T08:08:07.979 INFO:tasks.workunit.client.0.smithi052.stderr:+ export PATH 2023-11-05T08:08:07.979 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-11-05T08:08:07.979 INFO:tasks.workunit.client.0.smithi052.stderr:+++ unset LANG_backup config 2023-11-05T08:08:07.979 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n '' ']' 2023-11-05T08:08:07.979 INFO:tasks.workunit.client.0.smithi052.stderr:+ unset rc 2023-11-05T08:08:07.980 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-05T08:08:07.980 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' dumb = linux ']' 2023-11-05T08:08:07.980 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.980 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-11-05T08:08:07.980 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.981 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/less.sh 2023-11-05T08:08:07.981 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-11-05T08:08:07.981 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.981 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-11-05T08:08:07.981 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.981 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/which2.sh 2023-11-05T08:08:07.982 INFO:tasks.workunit.client.0.smithi052.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-11-05T08:08:07.982 INFO:tasks.workunit.client.0.smithi052.stderr:+ sed 's/^/ api_asio: /' 2023-11-05T08:08:07.982 INFO:tasks.workunit.client.0.smithi052.stderr:+ ceph_test_rados_api_asio 2023-11-05T08:08:07.982 INFO:tasks.workunit.client.0.smithi052.stderr:+ tee ceph_test_rados_api_asio.log 2023-11-05T08:08:07.982 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'grep=grep --color=auto' 2023-11-05T08:08:07.983 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'egrep=egrep --color=auto' 2023-11-05T08:08:07.983 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-11-05T08:08:07.983 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-11-05T08:08:07.983 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-11-05T08:08:07.983 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-11-05T08:08:07.984 INFO:tasks.workunit.client.0.smithi052.stderr:+++++ readlink /proc/91600/exe 2023-11-05T08:08:07.984 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.984 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.984 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-11-05T08:08:07.984 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-11-05T08:08:07.985 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.985 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorls.sh 2023-11-05T08:08:07.985 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.985 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/debuginfod.sh 2023-11-05T08:08:07.985 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' '!' -t 0 ']' 2023-11-05T08:08:07.985 INFO:tasks.workunit.client.0.smithi052.stderr:+++ return 2023-11-05T08:08:07.986 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.986 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-11-05T08:08:07.986 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-11-05T08:08:07.986 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.986 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.987 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-11-05T08:08:07.987 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-11-05T08:08:07.987 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.987 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/gawk.sh 2023-11-05T08:08:07.987 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export S_COLORS=auto 2023-11-05T08:08:07.987 INFO:tasks.workunit.client.0.smithi052.stderr:+++ S_COLORS=auto 2023-11-05T08:08:07.988 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.988 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-11-05T08:08:07.988 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.988 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/lang.sh 2023-11-05T08:08:07.988 INFO:tasks.workunit.client.0.smithi052.stderr:+++ unset LANG_backup 2023-11-05T08:08:07.989 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.989 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-11-05T08:08:07.989 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.989 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-11-05T08:08:07.989 INFO:tasks.workunit.client.0.smithi052.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-05T08:08:07.990 INFO:tasks.workunit.client.0.smithi052.stderr:++++ basename /usr/bin/bash 2023-11-05T08:08:07.990 INFO:tasks.workunit.client.0.smithi052.stderr:++++ /usr/bin/locale 2023-11-05T08:08:07.990 INFO:tasks.workunit.client.0.smithi052.stderr:+++ which_declare='declare -f' 2023-11-05T08:08:07.990 INFO:tasks.workunit.client.0.smithi052.stderr:+++ which_opt=-f 2023-11-05T08:08:07.990 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n '' ']' 2023-11-05T08:08:07.991 INFO:tasks.workunit.client.0.smithi052.stderr:+++ LANG_backup=en_US.UTF-8 2023-11-05T08:08:07.991 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export which_declare 2023-11-05T08:08:07.991 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export -f which 2023-11-05T08:08:07.991 INFO:tasks.workunit.client.0.smithi052.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-05T08:08:07.991 INFO:tasks.workunit.client.0.smithi052.stderr:++ unset i 2023-11-05T08:08:07.991 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -f /etc/locale.conf ']' 2023-11-05T08:08:07.992 INFO:tasks.workunit.client.0.smithi052.stderr:++ unset -f pathmunge 2023-11-05T08:08:07.992 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -x /usr/bin/sed ']' 2023-11-05T08:08:07.992 INFO:tasks.workunit.client.0.smithi052.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-11-05T08:08:07.992 INFO:tasks.workunit.client.0.smithi052.stderr:+ export PATH 2023-11-05T08:08:07.992 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-11-05T08:08:07.993 INFO:tasks.workunit.client.0.smithi052.stderr:+ unset rc 2023-11-05T08:08:07.993 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-11-05T08:08:07.993 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-11-05T08:08:07.993 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-11-05T08:08:07.993 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.994 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-11-05T08:08:07.994 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.994 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-11-05T08:08:07.994 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-11-05T08:08:07.994 INFO:tasks.workunit.client.0.smithi052.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-05T08:08:07.995 INFO:tasks.workunit.client.0.smithi052.stderr:+ tee ceph_test_rados_api_lock.log 2023-11-05T08:08:07.995 INFO:tasks.workunit.client.0.smithi052.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-11-05T08:08:07.995 INFO:tasks.workunit.client.0.smithi052.stderr:+++++ readlink /proc/91580/exe 2023-11-05T08:08:07.995 INFO:tasks.workunit.client.0.smithi052.stderr:++ printf %25s api_tier_pp 2023-11-05T08:08:07.995 INFO:tasks.workunit.client.0.smithi052.stderr:+ r=' api_tier_pp' 2023-11-05T08:08:07.996 INFO:tasks.workunit.client.0.smithi052.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-11-05T08:08:07.996 INFO:tasks.workunit.client.0.smithi052.stderr:++++ export LANG=en_US.UTF-8 2023-11-05T08:08:07.996 INFO:tasks.workunit.client.0.smithi052.stderr:++++ LANG=en_US.UTF-8 2023-11-05T08:08:07.996 INFO:tasks.workunit.client.0.smithi052.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-05T08:08:07.996 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-11-05T08:08:07.997 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-05T08:08:07.997 INFO:tasks.workunit.client.0.smithi052.stderr:+++ LANG=en_US.UTF-8 2023-11-05T08:08:07.997 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-11-05T08:08:07.997 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo api_tier_pp 2023-11-05T08:08:07.997 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-11-05T08:08:07.998 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-11-05T08:08:07.998 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:07.998 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-11-05T08:08:07.998 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:07.999 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-11-05T08:08:07.999 INFO:tasks.workunit.client.0.smithi052.stderr:+++ unset LANG_backup config 2023-11-05T08:08:07.999 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-11-05T08:08:07.999 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n '' ']' 2023-11-05T08:08:07.999 INFO:tasks.workunit.client.0.smithi052.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-05T08:08:08.000 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-05T08:08:08.000 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' dumb = linux ']' 2023-11-05T08:08:08.000 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.000 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-11-05T08:08:08.000 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.000 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/less.sh 2023-11-05T08:08:08.001 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-11-05T08:08:08.001 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.001 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-11-05T08:08:08.001 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.001 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/which2.sh 2023-11-05T08:08:08.002 INFO:tasks.workunit.client.0.smithi052.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-11-05T08:08:08.002 INFO:tasks.workunit.client.0.smithi052.stderr:++++ basename /usr/bin/bash 2023-11-05T08:08:08.002 INFO:tasks.workunit.client.0.smithi052.stderr:+++++ readlink /proc/91644/exe 2023-11-05T08:08:08.002 INFO:tasks.workunit.client.0.smithi052.stderr:+++ which_declare='declare -f' 2023-11-05T08:08:08.002 INFO:tasks.workunit.client.0.smithi052.stderr:+++ which_opt=-f 2023-11-05T08:08:08.003 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export which_declare 2023-11-05T08:08:08.003 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export -f which 2023-11-05T08:08:08.003 INFO:tasks.workunit.client.0.smithi052.stderr:++ unset i 2023-11-05T08:08:08.003 INFO:tasks.workunit.client.0.smithi052.stderr:++ unset -f pathmunge 2023-11-05T08:08:08.003 INFO:tasks.workunit.client.0.smithi052.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-11-05T08:08:08.004 INFO:tasks.workunit.client.0.smithi052.stderr:+ export PATH 2023-11-05T08:08:08.004 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-11-05T08:08:08.004 INFO:tasks.workunit.client.0.smithi052.stderr:+ unset rc 2023-11-05T08:08:08.004 INFO:tasks.workunit.client.0.smithi052.stderr:++++ basename /usr/bin/bash 2023-11-05T08:08:08.004 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-11-05T08:08:08.004 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-11-05T08:08:08.005 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-11-05T08:08:08.005 INFO:tasks.workunit.client.0.smithi052.stderr:+ tee ceph_test_rados_api_list.log 2023-11-05T08:08:08.005 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.005 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-11-05T08:08:08.005 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.006 INFO:tasks.workunit.client.0.smithi052.stderr:++ awk '{print $1}' 2023-11-05T08:08:08.006 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/debuginfod.sh 2023-11-05T08:08:08.006 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-11-05T08:08:08.006 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.006 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-11-05T08:08:08.007 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.007 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/gawk.sh 2023-11-05T08:08:08.007 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.007 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-11-05T08:08:08.007 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.007 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/lang.sh 2023-11-05T08:08:08.008 INFO:tasks.workunit.client.0.smithi052.stderr:+++ which_declare='declare -f' 2023-11-05T08:08:08.008 INFO:tasks.workunit.client.0.smithi052.stderr:+++ which_opt=-f 2023-11-05T08:08:08.008 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export which_declare 2023-11-05T08:08:08.008 INFO:tasks.workunit.client.0.smithi052.stderr:+++ unset LANG_backup 2023-11-05T08:08:08.008 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export -f which 2023-11-05T08:08:08.009 INFO:tasks.workunit.client.0.smithi052.stderr:++ unset i 2023-11-05T08:08:08.009 INFO:tasks.workunit.client.0.smithi052.stderr:++ unset -f pathmunge 2023-11-05T08:08:08.009 INFO:tasks.workunit.client.0.smithi052.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-11-05T08:08:08.009 INFO:tasks.workunit.client.0.smithi052.stderr:++++ /usr/bin/locale 2023-11-05T08:08:08.009 INFO:tasks.workunit.client.0.smithi052.stderr:+ export PATH 2023-11-05T08:08:08.010 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-11-05T08:08:08.010 INFO:tasks.workunit.client.0.smithi052.stderr:+ unset rc 2023-11-05T08:08:08.010 INFO:tasks.workunit.client.0.smithi052.stderr:+ tee ceph_test_rados_api_misc.log 2023-11-05T08:08:08.010 INFO:tasks.workunit.client.0.smithi052.stderr:+ sed 's/^/ api_lock: /' 2023-11-05T08:08:08.010 INFO:tasks.workunit.client.0.smithi052.stderr:+ ff=api_tier_pp 2023-11-05T08:08:08.011 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n '' ']' 2023-11-05T08:08:08.011 INFO:tasks.workunit.client.0.smithi052.stderr:+++ LANG_backup=en_US.UTF-8 2023-11-05T08:08:08.011 INFO:tasks.workunit.client.0.smithi052.stderr:+ ceph_test_rados_api_misc 2023-11-05T08:08:08.011 INFO:tasks.workunit.client.0.smithi052.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-05T08:08:08.011 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -f /etc/locale.conf ']' 2023-11-05T08:08:08.011 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -x /usr/bin/sed ']' 2023-11-05T08:08:08.012 INFO:tasks.workunit.client.0.smithi052.stderr:+ pid=91712 2023-11-05T08:08:08.012 INFO:tasks.workunit.client.0.smithi052.stderr:+ echo 'test api_tier_pp on pid 91712' 2023-11-05T08:08:08.012 INFO:tasks.workunit.client.0.smithi052.stdout:test api_tier_pp on pid 91712 2023-11-05T08:08:08.018 INFO:tasks.workunit.client.0.smithi052.stderr:+ pids[$f]=91712 2023-11-05T08:08:08.018 INFO:tasks.workunit.client.0.smithi052.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_tier_pp 2>&1 | tee ceph_test_rados_api_tier_pp.log | sed "s/^/ api_tier_pp: /"' 2023-11-05T08:08:08.019 INFO:tasks.workunit.client.0.smithi052.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-11-05T08:08:08.019 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' 1 -eq 1 ']' 2023-11-05T08:08:08.019 INFO:tasks.workunit.client.0.smithi052.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-11-05T08:08:08.019 INFO:tasks.workunit.client.0.smithi052.stderr:++ printf %25s api_pool 2023-11-05T08:08:08.019 INFO:tasks.workunit.client.0.smithi052.stderr:+ r=' api_pool' 2023-11-05T08:08:08.019 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' -f /etc/bashrc ']' 2023-11-05T08:08:08.020 INFO:tasks.workunit.client.0.smithi052.stderr:++ awk '{print $1}' 2023-11-05T08:08:08.020 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo api_pool 2023-11-05T08:08:08.020 INFO:tasks.workunit.client.0.smithi052.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-11-05T08:08:08.020 INFO:tasks.workunit.client.0.smithi052.stderr:++++ export LANG=en_US.UTF-8 2023-11-05T08:08:08.020 INFO:tasks.workunit.client.0.smithi052.stderr:++++ LANG=en_US.UTF-8 2023-11-05T08:08:08.020 INFO:tasks.workunit.client.0.smithi052.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-05T08:08:08.021 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-11-05T08:08:08.021 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-05T08:08:08.021 INFO:tasks.workunit.client.0.smithi052.stderr:+++ LANG=en_US.UTF-8 2023-11-05T08:08:08.021 INFO:tasks.workunit.client.0.smithi052.stderr:+++ unset LANG_backup config 2023-11-05T08:08:08.021 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n '' ']' 2023-11-05T08:08:08.022 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-05T08:08:08.022 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' dumb = linux ']' 2023-11-05T08:08:08.022 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.022 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-11-05T08:08:08.022 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.023 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/less.sh 2023-11-05T08:08:08.023 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-11-05T08:08:08.023 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.023 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-11-05T08:08:08.023 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.023 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/which2.sh 2023-11-05T08:08:08.024 INFO:tasks.workunit.client.0.smithi052.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-11-05T08:08:08.024 INFO:tasks.workunit.client.0.smithi052.stderr:+ . /etc/bashrc 2023-11-05T08:08:08.024 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -z '' ']' 2023-11-05T08:08:08.024 INFO:tasks.workunit.client.0.smithi052.stderr:++ BASHRCSOURCED=Y 2023-11-05T08:08:08.025 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.025 INFO:tasks.workunit.client.0.smithi052.stderr:++ shopt -q login_shell 2023-11-05T08:08:08.025 INFO:tasks.workunit.client.0.smithi052.stderr:+++++ readlink /proc/91662/exe 2023-11-05T08:08:08.025 INFO:tasks.workunit.client.0.smithi052.stderr:+++ umask 2023-11-05T08:08:08.025 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' 0022 -eq 0 ']' 2023-11-05T08:08:08.026 INFO:tasks.workunit.client.0.smithi052.stderr:++ SHELL=/bin/bash 2023-11-05T08:08:08.026 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.026 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-11-05T08:08:08.026 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.026 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/bash_completion.sh 2023-11-05T08:08:08.027 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-11-05T08:08:08.027 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.027 INFO:tasks.workunit.client.0.smithi052.stderr:++++ basename /usr/bin/bash 2023-11-05T08:08:08.027 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-11-05T08:08:08.027 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.028 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/cobbler.sh 2023-11-05T08:08:08.028 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-11-05T08:08:08.028 INFO:tasks.workunit.client.0.smithi052.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-11-05T08:08:08.028 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.028 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-11-05T08:08:08.028 INFO:tasks.workunit.client.0.smithi052.stderr:+ ceph_test_rados_api_list 2023-11-05T08:08:08.029 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.029 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorgrep.sh 2023-11-05T08:08:08.029 INFO:tasks.workunit.client.0.smithi052.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-05T08:08:08.029 INFO:tasks.workunit.client.0.smithi052.stderr:+ ff=api_pool 2023-11-05T08:08:08.029 INFO:tasks.workunit.client.0.smithi052.stderr:+ ceph_test_rados_api_lock 2023-11-05T08:08:08.030 INFO:tasks.workunit.client.0.smithi052.stderr:+++ which_declare='declare -f' 2023-11-05T08:08:08.030 INFO:tasks.workunit.client.0.smithi052.stderr:+++ which_opt=-f 2023-11-05T08:08:08.030 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export which_declare 2023-11-05T08:08:08.030 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export -f which 2023-11-05T08:08:08.030 INFO:tasks.workunit.client.0.smithi052.stderr:++ unset i 2023-11-05T08:08:08.031 INFO:tasks.workunit.client.0.smithi052.stderr:++ unset -f pathmunge 2023-11-05T08:08:08.031 INFO:tasks.workunit.client.0.smithi052.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-11-05T08:08:08.031 INFO:tasks.workunit.client.0.smithi052.stderr:+ export PATH 2023-11-05T08:08:08.031 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-11-05T08:08:08.031 INFO:tasks.workunit.client.0.smithi052.stderr:+ unset rc 2023-11-05T08:08:08.031 INFO:tasks.workunit.client.0.smithi052.stderr:+ pid=91733 2023-11-05T08:08:08.032 INFO:tasks.workunit.client.0.smithi052.stderr:+ echo 'test api_pool on pid 91733' 2023-11-05T08:08:08.032 INFO:tasks.workunit.client.0.smithi052.stdout:test api_pool on pid 91733 2023-11-05T08:08:08.035 INFO:tasks.workunit.client.0.smithi052.stderr:+ pids[$f]=91733 2023-11-05T08:08:08.036 INFO:tasks.workunit.client.0.smithi052.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-11-05T08:08:08.036 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' 1 -eq 1 ']' 2023-11-05T08:08:08.036 INFO:tasks.workunit.client.0.smithi052.stderr:+ ceph_test_rados_api_misc_pp 2023-11-05T08:08:08.036 INFO:tasks.workunit.client.0.smithi052.stderr:++ printf %25s api_snapshots 2023-11-05T08:08:08.036 INFO:tasks.workunit.client.0.smithi052.stderr:+ r=' api_snapshots' 2023-11-05T08:08:08.037 INFO:tasks.workunit.client.0.smithi052.stderr:+ sed 's/^/ api_list: /' 2023-11-05T08:08:08.037 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo api_snapshots 2023-11-05T08:08:08.037 INFO:tasks.workunit.client.0.smithi052.stderr:+ sed 's/^/ api_misc_pp: /' 2023-11-05T08:08:08.037 INFO:tasks.workunit.client.0.smithi052.stderr:+ tee ceph_test_rados_api_misc_pp.log 2023-11-05T08:08:08.037 INFO:tasks.workunit.client.0.smithi052.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_pool 2>&1 | tee ceph_test_rados_api_pool.log | sed "s/^/ api_pool: /"' 2023-11-05T08:08:08.038 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' -f /etc/bashrc ']' 2023-11-05T08:08:08.038 INFO:tasks.workunit.client.0.smithi052.stderr:+ . /etc/bashrc 2023-11-05T08:08:08.038 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -z '' ']' 2023-11-05T08:08:08.038 INFO:tasks.workunit.client.0.smithi052.stderr:++ BASHRCSOURCED=Y 2023-11-05T08:08:08.038 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.039 INFO:tasks.workunit.client.0.smithi052.stderr:++ shopt -q login_shell 2023-11-05T08:08:08.039 INFO:tasks.workunit.client.0.smithi052.stderr:+ sed 's/^/ api_misc: /' 2023-11-05T08:08:08.039 INFO:tasks.workunit.client.0.smithi052.stderr:++ awk '{print $1}' 2023-11-05T08:08:08.039 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-11-05T08:08:08.041 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-11-05T08:08:08.041 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-11-05T08:08:08.041 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.041 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-11-05T08:08:08.041 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.042 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/debuginfod.sh 2023-11-05T08:08:08.042 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-11-05T08:08:08.042 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.042 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-11-05T08:08:08.042 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.043 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/gawk.sh 2023-11-05T08:08:08.043 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.043 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-11-05T08:08:08.043 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.043 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/lang.sh 2023-11-05T08:08:08.043 INFO:tasks.workunit.client.0.smithi052.stderr:+++ unset LANG_backup 2023-11-05T08:08:08.044 INFO:tasks.workunit.client.0.smithi052.stderr:++++ /usr/bin/locale 2023-11-05T08:08:08.044 INFO:tasks.workunit.client.0.smithi052.stderr:+ ff=api_snapshots 2023-11-05T08:08:08.044 INFO:tasks.workunit.client.0.smithi052.stderr:+ pid=91757 2023-11-05T08:08:08.044 INFO:tasks.workunit.client.0.smithi052.stdout:test api_snapshots on pid 91757 2023-11-05T08:08:08.050 INFO:tasks.workunit.client.0.smithi052.stderr:+ echo 'test api_snapshots on pid 91757' 2023-11-05T08:08:08.050 INFO:tasks.workunit.client.0.smithi052.stderr:+ pids[$f]=91757 2023-11-05T08:08:08.050 INFO:tasks.workunit.client.0.smithi052.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-11-05T08:08:08.050 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' 1 -eq 1 ']' 2023-11-05T08:08:08.051 INFO:tasks.workunit.client.0.smithi052.stderr:+++ umask 2023-11-05T08:08:08.051 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' 0022 -eq 0 ']' 2023-11-05T08:08:08.051 INFO:tasks.workunit.client.0.smithi052.stderr:++ SHELL=/bin/bash 2023-11-05T08:08:08.051 INFO:tasks.workunit.client.0.smithi052.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_snapshots 2>&1 | tee ceph_test_rados_api_snapshots.log | sed "s/^/ api_snapshots: /"' 2023-11-05T08:08:08.051 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.052 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-11-05T08:08:08.052 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.052 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/bash_completion.sh 2023-11-05T08:08:08.052 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-11-05T08:08:08.052 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.052 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-11-05T08:08:08.053 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.053 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/cobbler.sh 2023-11-05T08:08:08.053 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-11-05T08:08:08.053 INFO:tasks.workunit.client.0.smithi052.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-11-05T08:08:08.053 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.054 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-11-05T08:08:08.054 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.054 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorgrep.sh 2023-11-05T08:08:08.054 INFO:tasks.workunit.client.0.smithi052.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-05T08:08:08.054 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n '' ']' 2023-11-05T08:08:08.054 INFO:tasks.workunit.client.0.smithi052.stderr:+++ LANG_backup=en_US.UTF-8 2023-11-05T08:08:08.055 INFO:tasks.workunit.client.0.smithi052.stderr:++ printf %25s api_snapshots_pp 2023-11-05T08:08:08.055 INFO:tasks.workunit.client.0.smithi052.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-05T08:08:08.055 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -f /etc/locale.conf ']' 2023-11-05T08:08:08.055 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -x /usr/bin/sed ']' 2023-11-05T08:08:08.055 INFO:tasks.workunit.client.0.smithi052.stderr:+ r=' api_snapshots_pp' 2023-11-05T08:08:08.056 INFO:tasks.workunit.client.0.smithi052.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-11-05T08:08:08.056 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo api_snapshots_pp 2023-11-05T08:08:08.056 INFO:tasks.workunit.client.0.smithi052.stderr:++ awk '{print $1}' 2023-11-05T08:08:08.056 INFO:tasks.workunit.client.0.smithi052.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-11-05T08:08:08.056 INFO:tasks.workunit.client.0.smithi052.stderr:++++ export LANG=en_US.UTF-8 2023-11-05T08:08:08.056 INFO:tasks.workunit.client.0.smithi052.stderr:++++ LANG=en_US.UTF-8 2023-11-05T08:08:08.057 INFO:tasks.workunit.client.0.smithi052.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-05T08:08:08.057 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-11-05T08:08:08.057 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-05T08:08:08.057 INFO:tasks.workunit.client.0.smithi052.stderr:+++ LANG=en_US.UTF-8 2023-11-05T08:08:08.057 INFO:tasks.workunit.client.0.smithi052.stderr:+++ unset LANG_backup config 2023-11-05T08:08:08.058 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n '' ']' 2023-11-05T08:08:08.058 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-05T08:08:08.058 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' dumb = linux ']' 2023-11-05T08:08:08.058 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.058 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-11-05T08:08:08.058 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.059 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/less.sh 2023-11-05T08:08:08.059 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-11-05T08:08:08.059 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.059 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-11-05T08:08:08.059 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.060 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/which2.sh 2023-11-05T08:08:08.060 INFO:tasks.workunit.client.0.smithi052.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-11-05T08:08:08.060 INFO:tasks.workunit.client.0.smithi052.stderr:+ ff=api_snapshots_pp 2023-11-05T08:08:08.060 INFO:tasks.workunit.client.0.smithi052.stderr:+++++ readlink /proc/91623/exe 2023-11-05T08:08:08.060 INFO:tasks.workunit.client.0.smithi052.stderr:+ pid=91772 2023-11-05T08:08:08.060 INFO:tasks.workunit.client.0.smithi052.stderr:+ echo 'test api_snapshots_pp on pid 91772' 2023-11-05T08:08:08.061 INFO:tasks.workunit.client.0.smithi052.stdout:test api_snapshots_pp on pid 91772 2023-11-05T08:08:08.064 INFO:tasks.workunit.client.0.smithi052.stderr:+ pids[$f]=91772 2023-11-05T08:08:08.064 INFO:tasks.workunit.client.0.smithi052.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-11-05T08:08:08.065 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' -f /etc/bashrc ']' 2023-11-05T08:08:08.065 INFO:tasks.workunit.client.0.smithi052.stderr:+ . /etc/bashrc 2023-11-05T08:08:08.065 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' 1 -eq 1 ']' 2023-11-05T08:08:08.065 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -z '' ']' 2023-11-05T08:08:08.065 INFO:tasks.workunit.client.0.smithi052.stderr:++++ basename /usr/bin/bash 2023-11-05T08:08:08.066 INFO:tasks.workunit.client.0.smithi052.stderr:++ printf %25s api_stat 2023-11-05T08:08:08.066 INFO:tasks.workunit.client.0.smithi052.stderr:+ r=' api_stat' 2023-11-05T08:08:08.066 INFO:tasks.workunit.client.0.smithi052.stderr:++ awk '{print $1}' 2023-11-05T08:08:08.066 INFO:tasks.workunit.client.0.smithi052.stderr:++ BASHRCSOURCED=Y 2023-11-05T08:08:08.066 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'grep=grep --color=auto' 2023-11-05T08:08:08.067 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'egrep=egrep --color=auto' 2023-11-05T08:08:08.067 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-11-05T08:08:08.067 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.067 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.067 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-11-05T08:08:08.067 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.068 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorls.sh 2023-11-05T08:08:08.068 INFO:tasks.workunit.client.0.smithi052.stderr:++ shopt -q login_shell 2023-11-05T08:08:08.068 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' '!' -t 0 ']' 2023-11-05T08:08:08.068 INFO:tasks.workunit.client.0.smithi052.stderr:+++ return 2023-11-05T08:08:08.068 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.069 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-11-05T08:08:08.069 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.069 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-11-05T08:08:08.069 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export S_COLORS=auto 2023-11-05T08:08:08.069 INFO:tasks.workunit.client.0.smithi052.stderr:+++ S_COLORS=auto 2023-11-05T08:08:08.069 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.070 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-11-05T08:08:08.070 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.070 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-11-05T08:08:08.070 INFO:tasks.workunit.client.0.smithi052.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-05T08:08:08.070 INFO:tasks.workunit.client.0.smithi052.stderr:+++ which_declare='declare -f' 2023-11-05T08:08:08.071 INFO:tasks.workunit.client.0.smithi052.stderr:+++ which_opt=-f 2023-11-05T08:08:08.071 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export which_declare 2023-11-05T08:08:08.071 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export -f which 2023-11-05T08:08:08.071 INFO:tasks.workunit.client.0.smithi052.stderr:++ unset i 2023-11-05T08:08:08.071 INFO:tasks.workunit.client.0.smithi052.stderr:++ unset -f pathmunge 2023-11-05T08:08:08.072 INFO:tasks.workunit.client.0.smithi052.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-11-05T08:08:08.072 INFO:tasks.workunit.client.0.smithi052.stderr:+ export PATH 2023-11-05T08:08:08.072 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-11-05T08:08:08.072 INFO:tasks.workunit.client.0.smithi052.stderr:+ unset rc 2023-11-05T08:08:08.072 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo api_stat 2023-11-05T08:08:08.073 INFO:tasks.workunit.client.0.smithi052.stdout:test api_stat on pid 91782 2023-11-05T08:08:08.089 INFO:tasks.workunit.client.0.smithi052.stderr:+ ff=api_stat 2023-11-05T08:08:08.089 INFO:tasks.workunit.client.0.smithi052.stderr:+ pid=91782 2023-11-05T08:08:08.089 INFO:tasks.workunit.client.0.smithi052.stderr:+ echo 'test api_stat on pid 91782' 2023-11-05T08:08:08.090 INFO:tasks.workunit.client.0.smithi052.stderr:+ pids[$f]=91782 2023-11-05T08:08:08.090 INFO:tasks.workunit.client.0.smithi052.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-11-05T08:08:08.090 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' 1 -eq 1 ']' 2023-11-05T08:08:08.090 INFO:tasks.workunit.client.0.smithi052.stderr:+ tee ceph_test_rados_api_lock_pp.log 2023-11-05T08:08:08.091 INFO:tasks.workunit.client.0.smithi052.stderr:+ sed 's/^/ api_lock_pp: /' 2023-11-05T08:08:08.091 INFO:tasks.workunit.client.0.smithi052.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_stat 2>&1 | tee ceph_test_rados_api_stat.log | sed "s/^/ api_stat: /"' 2023-11-05T08:08:08.091 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' -f /etc/bashrc ']' 2023-11-05T08:08:08.091 INFO:tasks.workunit.client.0.smithi052.stderr:+ . /etc/bashrc 2023-11-05T08:08:08.091 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -z '' ']' 2023-11-05T08:08:08.092 INFO:tasks.workunit.client.0.smithi052.stderr:++ BASHRCSOURCED=Y 2023-11-05T08:08:08.092 INFO:tasks.workunit.client.0.smithi052.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_snapshots_pp 2>&1 | tee ceph_test_rados_api_snapshots_pp.log | sed "s/^/ api_snapshots_pp: /"' 2023-11-05T08:08:08.092 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.092 INFO:tasks.workunit.client.0.smithi052.stderr:++ shopt -q login_shell 2023-11-05T08:08:08.092 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' -f /etc/bashrc ']' 2023-11-05T08:08:08.093 INFO:tasks.workunit.client.0.smithi052.stderr:+ . /etc/bashrc 2023-11-05T08:08:08.093 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -z '' ']' 2023-11-05T08:08:08.093 INFO:tasks.workunit.client.0.smithi052.stderr:++ BASHRCSOURCED=Y 2023-11-05T08:08:08.093 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.093 INFO:tasks.workunit.client.0.smithi052.stderr:++ shopt -q login_shell 2023-11-05T08:08:08.093 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-11-05T08:08:08.094 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-11-05T08:08:08.094 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-11-05T08:08:08.094 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.094 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-11-05T08:08:08.094 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.095 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-11-05T08:08:08.095 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-11-05T08:08:08.095 INFO:tasks.workunit.client.0.smithi052.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-05T08:08:08.095 INFO:tasks.workunit.client.0.smithi052.stderr:+++ umask 2023-11-05T08:08:08.095 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' 0022 -eq 0 ']' 2023-11-05T08:08:08.096 INFO:tasks.workunit.client.0.smithi052.stderr:++ SHELL=/bin/bash 2023-11-05T08:08:08.096 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.096 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-11-05T08:08:08.096 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.096 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/bash_completion.sh 2023-11-05T08:08:08.097 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-11-05T08:08:08.097 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.097 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-11-05T08:08:08.097 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.097 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/cobbler.sh 2023-11-05T08:08:08.098 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-11-05T08:08:08.098 INFO:tasks.workunit.client.0.smithi052.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-11-05T08:08:08.098 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.098 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-11-05T08:08:08.098 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.099 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorgrep.sh 2023-11-05T08:08:08.099 INFO:tasks.workunit.client.0.smithi052.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-05T08:08:08.099 INFO:tasks.workunit.client.0.smithi052.stderr:+ ceph_test_rados_api_lock_pp 2023-11-05T08:08:08.099 INFO:tasks.workunit.client.0.smithi052.stderr:+++ umask 2023-11-05T08:08:08.099 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' 0022 -eq 0 ']' 2023-11-05T08:08:08.100 INFO:tasks.workunit.client.0.smithi052.stderr:++ SHELL=/bin/bash 2023-11-05T08:08:08.100 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.100 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-11-05T08:08:08.100 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.100 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/bash_completion.sh 2023-11-05T08:08:08.100 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-11-05T08:08:08.101 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.101 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-11-05T08:08:08.101 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.101 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/cobbler.sh 2023-11-05T08:08:08.102 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-11-05T08:08:08.102 INFO:tasks.workunit.client.0.smithi052.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-11-05T08:08:08.102 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.102 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-11-05T08:08:08.102 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.103 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorgrep.sh 2023-11-05T08:08:08.103 INFO:tasks.workunit.client.0.smithi052.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-05T08:08:08.103 INFO:tasks.workunit.client.0.smithi052.stderr:++ printf %25s api_stat_pp 2023-11-05T08:08:08.103 INFO:tasks.workunit.client.0.smithi052.stderr:+ r=' api_stat_pp' 2023-11-05T08:08:08.103 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-11-05T08:08:08.104 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-11-05T08:08:08.104 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-11-05T08:08:08.104 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.104 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-11-05T08:08:08.104 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.105 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/debuginfod.sh 2023-11-05T08:08:08.105 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-11-05T08:08:08.105 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.105 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-11-05T08:08:08.105 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.106 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/gawk.sh 2023-11-05T08:08:08.106 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.106 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-11-05T08:08:08.106 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.106 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/lang.sh 2023-11-05T08:08:08.106 INFO:tasks.workunit.client.0.smithi052.stderr:+++ unset LANG_backup 2023-11-05T08:08:08.107 INFO:tasks.workunit.client.0.smithi052.stderr:++++ /usr/bin/locale 2023-11-05T08:08:08.107 INFO:tasks.workunit.client.0.smithi052.stderr:+++ umask 2023-11-05T08:08:08.107 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' 0022 -eq 0 ']' 2023-11-05T08:08:08.107 INFO:tasks.workunit.client.0.smithi052.stderr:++ SHELL=/bin/bash 2023-11-05T08:08:08.107 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.108 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-11-05T08:08:08.108 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.108 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/bash_completion.sh 2023-11-05T08:08:08.108 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-11-05T08:08:08.108 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.109 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-11-05T08:08:08.109 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.109 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/cobbler.sh 2023-11-05T08:08:08.109 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-11-05T08:08:08.109 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n '' ']' 2023-11-05T08:08:08.109 INFO:tasks.workunit.client.0.smithi052.stderr:+++ LANG_backup=en_US.UTF-8 2023-11-05T08:08:08.110 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'grep=grep --color=auto' 2023-11-05T08:08:08.110 INFO:tasks.workunit.client.0.smithi052.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-05T08:08:08.110 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -f /etc/locale.conf ']' 2023-11-05T08:08:08.110 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -x /usr/bin/sed ']' 2023-11-05T08:08:08.110 INFO:tasks.workunit.client.0.smithi052.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-11-05T08:08:08.111 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.111 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-11-05T08:08:08.111 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.111 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorgrep.sh 2023-11-05T08:08:08.111 INFO:tasks.workunit.client.0.smithi052.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-05T08:08:08.112 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'egrep=egrep --color=auto' 2023-11-05T08:08:08.112 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-11-05T08:08:08.112 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.112 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-11-05T08:08:08.112 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.113 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorls.sh 2023-11-05T08:08:08.113 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' '!' -t 0 ']' 2023-11-05T08:08:08.113 INFO:tasks.workunit.client.0.smithi052.stderr:+++ return 2023-11-05T08:08:08.113 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.113 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-11-05T08:08:08.114 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.114 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-11-05T08:08:08.114 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export S_COLORS=auto 2023-11-05T08:08:08.114 INFO:tasks.workunit.client.0.smithi052.stderr:+++ S_COLORS=auto 2023-11-05T08:08:08.114 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.115 INFO:tasks.workunit.client.0.smithi052.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-11-05T08:08:08.115 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-11-05T08:08:08.115 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.115 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-11-05T08:08:08.115 INFO:tasks.workunit.client.0.smithi052.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-05T08:08:08.116 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'grep=grep --color=auto' 2023-11-05T08:08:08.116 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'egrep=egrep --color=auto' 2023-11-05T08:08:08.116 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-11-05T08:08:08.116 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.116 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-11-05T08:08:08.116 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.117 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorls.sh 2023-11-05T08:08:08.117 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' '!' -t 0 ']' 2023-11-05T08:08:08.117 INFO:tasks.workunit.client.0.smithi052.stderr:+++ return 2023-11-05T08:08:08.117 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.117 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-11-05T08:08:08.118 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.118 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-11-05T08:08:08.118 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export S_COLORS=auto 2023-11-05T08:08:08.118 INFO:tasks.workunit.client.0.smithi052.stderr:+++ S_COLORS=auto 2023-11-05T08:08:08.118 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.118 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-11-05T08:08:08.119 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.119 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-11-05T08:08:08.119 INFO:tasks.workunit.client.0.smithi052.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-05T08:08:08.119 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'grep=grep --color=auto' 2023-11-05T08:08:08.119 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'egrep=egrep --color=auto' 2023-11-05T08:08:08.120 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-11-05T08:08:08.120 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.120 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-11-05T08:08:08.120 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.120 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorls.sh 2023-11-05T08:08:08.121 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' '!' -t 0 ']' 2023-11-05T08:08:08.121 INFO:tasks.workunit.client.0.smithi052.stderr:+++ return 2023-11-05T08:08:08.121 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.121 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-11-05T08:08:08.121 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.121 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-11-05T08:08:08.122 INFO:tasks.workunit.client.0.smithi052.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-11-05T08:08:08.122 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export S_COLORS=auto 2023-11-05T08:08:08.122 INFO:tasks.workunit.client.0.smithi052.stderr:+++ S_COLORS=auto 2023-11-05T08:08:08.122 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.122 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-11-05T08:08:08.123 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.123 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-11-05T08:08:08.123 INFO:tasks.workunit.client.0.smithi052.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-05T08:08:08.123 INFO:tasks.workunit.client.0.smithi052.stderr:++++ export LANG=en_US.UTF-8 2023-11-05T08:08:08.123 INFO:tasks.workunit.client.0.smithi052.stderr:++++ LANG=en_US.UTF-8 2023-11-05T08:08:08.124 INFO:tasks.workunit.client.0.smithi052.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-05T08:08:08.124 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-11-05T08:08:08.124 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-05T08:08:08.124 INFO:tasks.workunit.client.0.smithi052.stderr:+++ LANG=en_US.UTF-8 2023-11-05T08:08:08.124 INFO:tasks.workunit.client.0.smithi052.stderr:+++ unset LANG_backup config 2023-11-05T08:08:08.124 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n '' ']' 2023-11-05T08:08:08.125 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-05T08:08:08.125 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' dumb = linux ']' 2023-11-05T08:08:08.125 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.125 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-11-05T08:08:08.125 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.126 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/less.sh 2023-11-05T08:08:08.126 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-11-05T08:08:08.126 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.126 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-11-05T08:08:08.126 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.127 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/which2.sh 2023-11-05T08:08:08.127 INFO:tasks.workunit.client.0.smithi052.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-11-05T08:08:08.127 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-11-05T08:08:08.127 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-11-05T08:08:08.127 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-11-05T08:08:08.127 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.128 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-11-05T08:08:08.128 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.128 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-11-05T08:08:08.128 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-11-05T08:08:08.128 INFO:tasks.workunit.client.0.smithi052.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-05T08:08:08.129 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'grep=grep --color=auto' 2023-11-05T08:08:08.129 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'egrep=egrep --color=auto' 2023-11-05T08:08:08.129 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-11-05T08:08:08.129 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.129 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-11-05T08:08:08.129 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.130 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorls.sh 2023-11-05T08:08:08.130 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' '!' -t 0 ']' 2023-11-05T08:08:08.130 INFO:tasks.workunit.client.0.smithi052.stderr:+++ return 2023-11-05T08:08:08.130 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.130 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-11-05T08:08:08.131 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.131 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-11-05T08:08:08.131 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo api_stat_pp 2023-11-05T08:08:08.131 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export S_COLORS=auto 2023-11-05T08:08:08.131 INFO:tasks.workunit.client.0.smithi052.stderr:+++ S_COLORS=auto 2023-11-05T08:08:08.131 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.132 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-11-05T08:08:08.132 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.132 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-11-05T08:08:08.132 INFO:tasks.workunit.client.0.smithi052.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-05T08:08:08.132 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-11-05T08:08:08.133 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-11-05T08:08:08.133 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-11-05T08:08:08.133 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.133 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-11-05T08:08:08.133 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.134 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-11-05T08:08:08.134 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-11-05T08:08:08.134 INFO:tasks.workunit.client.0.smithi052.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-05T08:08:08.134 INFO:tasks.workunit.client.0.smithi052.stderr:++ awk '{print $1}' 2023-11-05T08:08:08.134 INFO:tasks.workunit.client.0.smithi052.stderr:+ ff=api_stat_pp 2023-11-05T08:08:08.134 INFO:tasks.workunit.client.0.smithi052.stderr:+ pid=91854 2023-11-05T08:08:08.135 INFO:tasks.workunit.client.0.smithi052.stderr:+ echo 'test api_stat_pp on pid 91854' 2023-11-05T08:08:08.135 INFO:tasks.workunit.client.0.smithi052.stdout:test api_stat_pp on pid 91854 2023-11-05T08:08:08.145 INFO:tasks.workunit.client.0.smithi052.stderr:+ pids[$f]=91854 2023-11-05T08:08:08.145 INFO:tasks.workunit.client.0.smithi052.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-11-05T08:08:08.145 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' 1 -eq 1 ']' 2023-11-05T08:08:08.146 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-11-05T08:08:08.146 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-11-05T08:08:08.146 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-11-05T08:08:08.146 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.147 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-11-05T08:08:08.147 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-11-05T08:08:08.147 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-11-05T08:08:08.147 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-11-05T08:08:08.147 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.148 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-11-05T08:08:08.148 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.148 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-11-05T08:08:08.148 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-11-05T08:08:08.148 INFO:tasks.workunit.client.0.smithi052.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-05T08:08:08.148 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.149 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/debuginfod.sh 2023-11-05T08:08:08.149 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-11-05T08:08:08.149 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.149 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-11-05T08:08:08.149 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.150 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/gawk.sh 2023-11-05T08:08:08.150 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.150 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-11-05T08:08:08.150 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.150 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/lang.sh 2023-11-05T08:08:08.151 INFO:tasks.workunit.client.0.smithi052.stderr:+++ unset LANG_backup 2023-11-05T08:08:08.151 INFO:tasks.workunit.client.0.smithi052.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_stat_pp 2>&1 | tee ceph_test_rados_api_stat_pp.log | sed "s/^/ api_stat_pp: /"' 2023-11-05T08:08:08.151 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' -f /etc/bashrc ']' 2023-11-05T08:08:08.151 INFO:tasks.workunit.client.0.smithi052.stderr:+++++ readlink /proc/91712/exe 2023-11-05T08:08:08.151 INFO:tasks.workunit.client.0.smithi052.stderr:+ . /etc/bashrc 2023-11-05T08:08:08.152 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -z '' ']' 2023-11-05T08:08:08.152 INFO:tasks.workunit.client.0.smithi052.stderr:++ BASHRCSOURCED=Y 2023-11-05T08:08:08.152 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.152 INFO:tasks.workunit.client.0.smithi052.stderr:++ shopt -q login_shell 2023-11-05T08:08:08.152 INFO:tasks.workunit.client.0.smithi052.stderr:+++ umask 2023-11-05T08:08:08.153 INFO:tasks.workunit.client.0.smithi052.stderr:++ printf %25s api_watch_notify 2023-11-05T08:08:08.153 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' 0022 -eq 0 ']' 2023-11-05T08:08:08.153 INFO:tasks.workunit.client.0.smithi052.stderr:++ SHELL=/bin/bash 2023-11-05T08:08:08.153 INFO:tasks.workunit.client.0.smithi052.stderr:+ r=' api_watch_notify' 2023-11-05T08:08:08.153 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.154 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-11-05T08:08:08.154 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.154 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/bash_completion.sh 2023-11-05T08:08:08.154 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-11-05T08:08:08.154 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.155 INFO:tasks.workunit.client.0.smithi052.stderr:++++ /usr/bin/locale 2023-11-05T08:08:08.155 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-11-05T08:08:08.155 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.155 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/cobbler.sh 2023-11-05T08:08:08.155 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-11-05T08:08:08.155 INFO:tasks.workunit.client.0.smithi052.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-11-05T08:08:08.156 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.156 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-11-05T08:08:08.156 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.156 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorgrep.sh 2023-11-05T08:08:08.156 INFO:tasks.workunit.client.0.smithi052.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-05T08:08:08.157 INFO:tasks.workunit.client.0.smithi052.stderr:++++ basename /usr/bin/bash 2023-11-05T08:08:08.157 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n '' ']' 2023-11-05T08:08:08.157 INFO:tasks.workunit.client.0.smithi052.stderr:+++ LANG_backup=en_US.UTF-8 2023-11-05T08:08:08.157 INFO:tasks.workunit.client.0.smithi052.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-05T08:08:08.157 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -f /etc/locale.conf ']' 2023-11-05T08:08:08.158 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -x /usr/bin/sed ']' 2023-11-05T08:08:08.158 INFO:tasks.workunit.client.0.smithi052.stderr:++ awk '{print $1}' 2023-11-05T08:08:08.158 INFO:tasks.workunit.client.0.smithi052.stderr:+++ which_declare='declare -f' 2023-11-05T08:08:08.158 INFO:tasks.workunit.client.0.smithi052.stderr:+++ which_opt=-f 2023-11-05T08:08:08.158 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export which_declare 2023-11-05T08:08:08.159 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export -f which 2023-11-05T08:08:08.159 INFO:tasks.workunit.client.0.smithi052.stderr:++ unset i 2023-11-05T08:08:08.159 INFO:tasks.workunit.client.0.smithi052.stderr:++ unset -f pathmunge 2023-11-05T08:08:08.159 INFO:tasks.workunit.client.0.smithi052.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-11-05T08:08:08.159 INFO:tasks.workunit.client.0.smithi052.stderr:+ export PATH 2023-11-05T08:08:08.160 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-11-05T08:08:08.160 INFO:tasks.workunit.client.0.smithi052.stderr:+ unset rc 2023-11-05T08:08:08.160 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-11-05T08:08:08.160 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-11-05T08:08:08.160 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-11-05T08:08:08.160 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.161 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-11-05T08:08:08.161 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.161 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-11-05T08:08:08.161 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-11-05T08:08:08.161 INFO:tasks.workunit.client.0.smithi052.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-05T08:08:08.161 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-11-05T08:08:08.162 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-11-05T08:08:08.162 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-11-05T08:08:08.162 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.162 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-11-05T08:08:08.162 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.163 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/debuginfod.sh 2023-11-05T08:08:08.163 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-11-05T08:08:08.163 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.163 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-11-05T08:08:08.163 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.163 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/gawk.sh 2023-11-05T08:08:08.164 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo api_watch_notify 2023-11-05T08:08:08.164 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.164 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-11-05T08:08:08.164 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.164 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/lang.sh 2023-11-05T08:08:08.165 INFO:tasks.workunit.client.0.smithi052.stderr:+++ unset LANG_backup 2023-11-05T08:08:08.165 INFO:tasks.workunit.client.0.smithi052.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-11-05T08:08:08.165 INFO:tasks.workunit.client.0.smithi052.stderr:+ ff=api_watch_notify 2023-11-05T08:08:08.165 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-11-05T08:08:08.165 INFO:tasks.workunit.client.0.smithi052.stderr:++++ /usr/bin/locale 2023-11-05T08:08:08.165 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-11-05T08:08:08.166 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-11-05T08:08:08.166 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.166 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-11-05T08:08:08.166 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.166 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/debuginfod.sh 2023-11-05T08:08:08.167 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-11-05T08:08:08.167 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.167 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-11-05T08:08:08.167 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.167 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/gawk.sh 2023-11-05T08:08:08.167 INFO:tasks.workunit.client.0.smithi052.stderr:+ pid=91902 2023-11-05T08:08:08.168 INFO:tasks.workunit.client.0.smithi052.stderr:+ echo 'test api_watch_notify on pid 91902' 2023-11-05T08:08:08.168 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.168 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-11-05T08:08:08.168 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.168 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/lang.sh 2023-11-05T08:08:08.169 INFO:tasks.workunit.client.0.smithi052.stderr:+++ unset LANG_backup 2023-11-05T08:08:08.169 INFO:tasks.workunit.client.0.smithi052.stdout:test api_watch_notify on pid 91902 2023-11-05T08:08:08.178 INFO:tasks.workunit.client.0.smithi052.stderr:+ pids[$f]=91902 2023-11-05T08:08:08.178 INFO:tasks.workunit.client.0.smithi052.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-11-05T08:08:08.178 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' 1 -eq 1 ']' 2023-11-05T08:08:08.178 INFO:tasks.workunit.client.0.smithi052.stderr:++ printf %25s api_watch_notify_pp 2023-11-05T08:08:08.178 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n '' ']' 2023-11-05T08:08:08.179 INFO:tasks.workunit.client.0.smithi052.stderr:+ r=' api_watch_notify_pp' 2023-11-05T08:08:08.179 INFO:tasks.workunit.client.0.smithi052.stderr:+++ LANG_backup=en_US.UTF-8 2023-11-05T08:08:08.179 INFO:tasks.workunit.client.0.smithi052.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_watch_notify 2>&1 | tee ceph_test_rados_api_watch_notify.log | sed "s/^/ api_watch_notify: /"' 2023-11-05T08:08:08.179 INFO:tasks.workunit.client.0.smithi052.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-05T08:08:08.179 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -f /etc/locale.conf ']' 2023-11-05T08:08:08.180 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'grep=grep --color=auto' 2023-11-05T08:08:08.180 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'egrep=egrep --color=auto' 2023-11-05T08:08:08.180 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -x /usr/bin/sed ']' 2023-11-05T08:08:08.180 INFO:tasks.workunit.client.0.smithi052.stderr:+ ceph_test_rados_api_tier_pp 2023-11-05T08:08:08.180 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-11-05T08:08:08.181 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.181 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-11-05T08:08:08.181 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.181 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorls.sh 2023-11-05T08:08:08.181 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' '!' -t 0 ']' 2023-11-05T08:08:08.181 INFO:tasks.workunit.client.0.smithi052.stderr:+++ return 2023-11-05T08:08:08.182 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.182 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-11-05T08:08:08.182 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.182 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-11-05T08:08:08.182 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export S_COLORS=auto 2023-11-05T08:08:08.183 INFO:tasks.workunit.client.0.smithi052.stderr:+++ S_COLORS=auto 2023-11-05T08:08:08.183 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.183 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-11-05T08:08:08.183 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.183 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-11-05T08:08:08.184 INFO:tasks.workunit.client.0.smithi052.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-05T08:08:08.184 INFO:tasks.workunit.client.0.smithi052.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-11-05T08:08:08.184 INFO:tasks.workunit.client.0.smithi052.stderr:++++ export LANG=en_US.UTF-8 2023-11-05T08:08:08.184 INFO:tasks.workunit.client.0.smithi052.stderr:++++ LANG=en_US.UTF-8 2023-11-05T08:08:08.184 INFO:tasks.workunit.client.0.smithi052.stderr:++++ /usr/bin/locale 2023-11-05T08:08:08.184 INFO:tasks.workunit.client.0.smithi052.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-05T08:08:08.185 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-11-05T08:08:08.185 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-05T08:08:08.185 INFO:tasks.workunit.client.0.smithi052.stderr:+++ LANG=en_US.UTF-8 2023-11-05T08:08:08.185 INFO:tasks.workunit.client.0.smithi052.stderr:+++ unset LANG_backup config 2023-11-05T08:08:08.185 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n '' ']' 2023-11-05T08:08:08.186 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-05T08:08:08.186 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' dumb = linux ']' 2023-11-05T08:08:08.186 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.186 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-11-05T08:08:08.186 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.187 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/less.sh 2023-11-05T08:08:08.187 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' -f /etc/bashrc ']' 2023-11-05T08:08:08.187 INFO:tasks.workunit.client.0.smithi052.stderr:+ . /etc/bashrc 2023-11-05T08:08:08.187 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-11-05T08:08:08.187 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.188 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -z '' ']' 2023-11-05T08:08:08.188 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-11-05T08:08:08.188 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.188 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/which2.sh 2023-11-05T08:08:08.188 INFO:tasks.workunit.client.0.smithi052.stderr:++ BASHRCSOURCED=Y 2023-11-05T08:08:08.189 INFO:tasks.workunit.client.0.smithi052.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-11-05T08:08:08.189 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.189 INFO:tasks.workunit.client.0.smithi052.stderr:++ shopt -q login_shell 2023-11-05T08:08:08.189 INFO:tasks.workunit.client.0.smithi052.stderr:++ awk '{print $1}' 2023-11-05T08:08:08.189 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n '' ']' 2023-11-05T08:08:08.190 INFO:tasks.workunit.client.0.smithi052.stderr:+++ LANG_backup=en_US.UTF-8 2023-11-05T08:08:08.190 INFO:tasks.workunit.client.0.smithi052.stderr:+++++ readlink /proc/91757/exe 2023-11-05T08:08:08.190 INFO:tasks.workunit.client.0.smithi052.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-05T08:08:08.190 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -f /etc/locale.conf ']' 2023-11-05T08:08:08.190 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -x /usr/bin/sed ']' 2023-11-05T08:08:08.191 INFO:tasks.workunit.client.0.smithi052.stderr:+ tee ceph_test_rados_api_tier_pp.log 2023-11-05T08:08:08.191 INFO:tasks.workunit.client.0.smithi052.stderr:+ sed 's/^/ api_tier_pp: /' 2023-11-05T08:08:08.191 INFO:tasks.workunit.client.0.smithi052.stderr:++++ basename /usr/bin/bash 2023-11-05T08:08:08.191 INFO:tasks.workunit.client.0.smithi052.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-11-05T08:08:08.191 INFO:tasks.workunit.client.0.smithi052.stderr:+++ which_declare='declare -f' 2023-11-05T08:08:08.191 INFO:tasks.workunit.client.0.smithi052.stderr:+++ which_opt=-f 2023-11-05T08:08:08.192 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export which_declare 2023-11-05T08:08:08.192 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export -f which 2023-11-05T08:08:08.192 INFO:tasks.workunit.client.0.smithi052.stderr:++ unset i 2023-11-05T08:08:08.192 INFO:tasks.workunit.client.0.smithi052.stderr:++ unset -f pathmunge 2023-11-05T08:08:08.193 INFO:tasks.workunit.client.0.smithi052.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-11-05T08:08:08.193 INFO:tasks.workunit.client.0.smithi052.stderr:+ export PATH 2023-11-05T08:08:08.193 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-11-05T08:08:08.193 INFO:tasks.workunit.client.0.smithi052.stderr:+ unset rc 2023-11-05T08:08:08.193 INFO:tasks.workunit.client.0.smithi052.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-11-05T08:08:08.193 INFO:tasks.workunit.client.0.smithi052.stderr:++++ export LANG=en_US.UTF-8 2023-11-05T08:08:08.194 INFO:tasks.workunit.client.0.smithi052.stderr:+ tee ceph_test_rados_api_snapshots.log 2023-11-05T08:08:08.194 INFO:tasks.workunit.client.0.smithi052.stderr:++++ LANG=en_US.UTF-8 2023-11-05T08:08:08.194 INFO:tasks.workunit.client.0.smithi052.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-05T08:08:08.194 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-11-05T08:08:08.194 INFO:tasks.workunit.client.0.smithi052.stderr:+ sed 's/^/ api_snapshots: /' 2023-11-05T08:08:08.195 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-05T08:08:08.195 INFO:tasks.workunit.client.0.smithi052.stderr:+++ LANG=en_US.UTF-8 2023-11-05T08:08:08.195 INFO:tasks.workunit.client.0.smithi052.stderr:+++ unset LANG_backup config 2023-11-05T08:08:08.195 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n '' ']' 2023-11-05T08:08:08.195 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-05T08:08:08.196 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' dumb = linux ']' 2023-11-05T08:08:08.196 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.196 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-11-05T08:08:08.196 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.196 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/less.sh 2023-11-05T08:08:08.196 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-11-05T08:08:08.197 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.197 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-11-05T08:08:08.197 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.197 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/which2.sh 2023-11-05T08:08:08.197 INFO:tasks.workunit.client.0.smithi052.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-11-05T08:08:08.198 INFO:tasks.workunit.client.0.smithi052.stderr:+++++ readlink /proc/91772/exe 2023-11-05T08:08:08.198 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo api_watch_notify_pp 2023-11-05T08:08:08.198 INFO:tasks.workunit.client.0.smithi052.stderr:+ ff=api_watch_notify_pp 2023-11-05T08:08:08.198 INFO:tasks.workunit.client.0.smithi052.stderr:+ pid=91931 2023-11-05T08:08:08.198 INFO:tasks.workunit.client.0.smithi052.stderr:+ echo 'test api_watch_notify_pp on pid 91931' 2023-11-05T08:08:08.199 INFO:tasks.workunit.client.0.smithi052.stdout:test api_watch_notify_pp on pid 91931 2023-11-05T08:08:08.215 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-11-05T08:08:08.215 INFO:tasks.workunit.client.0.smithi052.stderr:+ pids[$f]=91931 2023-11-05T08:08:08.215 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-11-05T08:08:08.215 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-11-05T08:08:08.215 INFO:tasks.workunit.client.0.smithi052.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-11-05T08:08:08.216 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' 1 -eq 1 ']' 2023-11-05T08:08:08.216 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.216 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-11-05T08:08:08.216 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.216 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/debuginfod.sh 2023-11-05T08:08:08.217 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-11-05T08:08:08.217 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.217 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-11-05T08:08:08.217 INFO:tasks.workunit.client.0.smithi052.stderr:++++ basename /usr/bin/bash 2023-11-05T08:08:08.217 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.218 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/gawk.sh 2023-11-05T08:08:08.218 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.218 INFO:tasks.workunit.client.0.smithi052.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_watch_notify_pp 2>&1 | tee ceph_test_rados_api_watch_notify_pp.log | sed "s/^/ api_watch_notify_pp: /"' 2023-11-05T08:08:08.218 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-11-05T08:08:08.218 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.219 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/lang.sh 2023-11-05T08:08:08.219 INFO:tasks.workunit.client.0.smithi052.stderr:+++ unset LANG_backup 2023-11-05T08:08:08.219 INFO:tasks.workunit.client.0.smithi052.stderr:++++ /usr/bin/locale 2023-11-05T08:08:08.219 INFO:tasks.workunit.client.0.smithi052.stderr:+++ which_declare='declare -f' 2023-11-05T08:08:08.219 INFO:tasks.workunit.client.0.smithi052.stderr:+++ which_opt=-f 2023-11-05T08:08:08.220 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-11-05T08:08:08.220 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export which_declare 2023-11-05T08:08:08.220 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export -f which 2023-11-05T08:08:08.220 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-11-05T08:08:08.220 INFO:tasks.workunit.client.0.smithi052.stderr:++ unset i 2023-11-05T08:08:08.221 INFO:tasks.workunit.client.0.smithi052.stderr:++ unset -f pathmunge 2023-11-05T08:08:08.221 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-11-05T08:08:08.221 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.221 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-11-05T08:08:08.221 INFO:tasks.workunit.client.0.smithi052.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-11-05T08:08:08.221 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.222 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-11-05T08:08:08.222 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-11-05T08:08:08.222 INFO:tasks.workunit.client.0.smithi052.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-05T08:08:08.222 INFO:tasks.workunit.client.0.smithi052.stderr:+ export PATH 2023-11-05T08:08:08.222 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-11-05T08:08:08.223 INFO:tasks.workunit.client.0.smithi052.stderr:+ unset rc 2023-11-05T08:08:08.223 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' -f /etc/bashrc ']' 2023-11-05T08:08:08.223 INFO:tasks.workunit.client.0.smithi052.stderr:+ . /etc/bashrc 2023-11-05T08:08:08.223 INFO:tasks.workunit.client.0.smithi052.stderr:++ printf %25s api_cmd 2023-11-05T08:08:08.223 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -z '' ']' 2023-11-05T08:08:08.224 INFO:tasks.workunit.client.0.smithi052.stderr:+ r=' api_cmd' 2023-11-05T08:08:08.224 INFO:tasks.workunit.client.0.smithi052.stderr:++ BASHRCSOURCED=Y 2023-11-05T08:08:08.224 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.224 INFO:tasks.workunit.client.0.smithi052.stderr:++ shopt -q login_shell 2023-11-05T08:08:08.224 INFO:tasks.workunit.client.0.smithi052.stderr:+ ceph_test_rados_api_snapshots_pp 2023-11-05T08:08:08.225 INFO:tasks.workunit.client.0.smithi052.stderr:+ tee ceph_test_rados_api_snapshots_pp.log 2023-11-05T08:08:08.225 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n '' ']' 2023-11-05T08:08:08.225 INFO:tasks.workunit.client.0.smithi052.stderr:+++ LANG_backup=en_US.UTF-8 2023-11-05T08:08:08.225 INFO:tasks.workunit.client.0.smithi052.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-05T08:08:08.225 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -f /etc/locale.conf ']' 2023-11-05T08:08:08.226 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -x /usr/bin/sed ']' 2023-11-05T08:08:08.226 INFO:tasks.workunit.client.0.smithi052.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-11-05T08:08:08.226 INFO:tasks.workunit.client.0.smithi052.stderr:+++ umask 2023-11-05T08:08:08.226 INFO:tasks.workunit.client.0.smithi052.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-11-05T08:08:08.226 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' 0022 -eq 0 ']' 2023-11-05T08:08:08.227 INFO:tasks.workunit.client.0.smithi052.stderr:++ SHELL=/bin/bash 2023-11-05T08:08:08.227 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.227 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-11-05T08:08:08.227 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.227 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/bash_completion.sh 2023-11-05T08:08:08.227 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-11-05T08:08:08.228 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.228 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-11-05T08:08:08.228 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.228 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/cobbler.sh 2023-11-05T08:08:08.228 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-11-05T08:08:08.229 INFO:tasks.workunit.client.0.smithi052.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-11-05T08:08:08.229 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.229 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-11-05T08:08:08.229 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.229 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorgrep.sh 2023-11-05T08:08:08.229 INFO:tasks.workunit.client.0.smithi052.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-05T08:08:08.230 INFO:tasks.workunit.client.0.smithi052.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-11-05T08:08:08.230 INFO:tasks.workunit.client.0.smithi052.stderr:++++ export LANG=en_US.UTF-8 2023-11-05T08:08:08.230 INFO:tasks.workunit.client.0.smithi052.stderr:++++ LANG=en_US.UTF-8 2023-11-05T08:08:08.230 INFO:tasks.workunit.client.0.smithi052.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-05T08:08:08.230 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-11-05T08:08:08.231 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-05T08:08:08.231 INFO:tasks.workunit.client.0.smithi052.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-11-05T08:08:08.231 INFO:tasks.workunit.client.0.smithi052.stderr:++++ export LANG=en_US.UTF-8 2023-11-05T08:08:08.231 INFO:tasks.workunit.client.0.smithi052.stderr:+++ LANG=en_US.UTF-8 2023-11-05T08:08:08.231 INFO:tasks.workunit.client.0.smithi052.stderr:+++ unset LANG_backup config 2023-11-05T08:08:08.232 INFO:tasks.workunit.client.0.smithi052.stderr:++++ LANG=en_US.UTF-8 2023-11-05T08:08:08.232 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n '' ']' 2023-11-05T08:08:08.232 INFO:tasks.workunit.client.0.smithi052.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-05T08:08:08.232 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-05T08:08:08.232 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-11-05T08:08:08.233 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' dumb = linux ']' 2023-11-05T08:08:08.233 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-11-05T08:08:08.233 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.233 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-11-05T08:08:08.233 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-11-05T08:08:08.233 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.234 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/less.sh 2023-11-05T08:08:08.234 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-05T08:08:08.234 INFO:tasks.workunit.client.0.smithi052.stderr:+++ LANG=en_US.UTF-8 2023-11-05T08:08:08.234 INFO:tasks.workunit.client.0.smithi052.stderr:+++ unset LANG_backup config 2023-11-05T08:08:08.234 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-11-05T08:08:08.235 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.235 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-11-05T08:08:08.235 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-11-05T08:08:08.235 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.235 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/which2.sh 2023-11-05T08:08:08.236 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.236 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-11-05T08:08:08.236 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.236 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/debuginfod.sh 2023-11-05T08:08:08.236 INFO:tasks.workunit.client.0.smithi052.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-11-05T08:08:08.236 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-11-05T08:08:08.237 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n '' ']' 2023-11-05T08:08:08.237 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.237 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-05T08:08:08.237 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' dumb = linux ']' 2023-11-05T08:08:08.237 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-11-05T08:08:08.238 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.238 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-11-05T08:08:08.238 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.238 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/less.sh 2023-11-05T08:08:08.239 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.239 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-11-05T08:08:08.239 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.239 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-11-05T08:08:08.239 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.239 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/which2.sh 2023-11-05T08:08:08.240 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/gawk.sh 2023-11-05T08:08:08.240 INFO:tasks.workunit.client.0.smithi052.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-11-05T08:08:08.240 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.240 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-11-05T08:08:08.240 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.241 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/lang.sh 2023-11-05T08:08:08.241 INFO:tasks.workunit.client.0.smithi052.stderr:+++ unset LANG_backup 2023-11-05T08:08:08.241 INFO:tasks.workunit.client.0.smithi052.stderr:+ ceph_test_rados_api_snapshots 2023-11-05T08:08:08.241 INFO:tasks.workunit.client.0.smithi052.stderr:+++++ readlink /proc/91733/exe 2023-11-05T08:08:08.241 INFO:tasks.workunit.client.0.smithi052.stderr:+++++ readlink /proc/91782/exe 2023-11-05T08:08:08.242 INFO:tasks.workunit.client.0.smithi052.stderr:++++ /usr/bin/locale 2023-11-05T08:08:08.242 INFO:tasks.workunit.client.0.smithi052.stderr:++++ basename /usr/bin/bash 2023-11-05T08:08:08.242 INFO:tasks.workunit.client.0.smithi052.stderr:++++ basename /usr/bin/bash 2023-11-05T08:08:08.242 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'grep=grep --color=auto' 2023-11-05T08:08:08.242 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'egrep=egrep --color=auto' 2023-11-05T08:08:08.242 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-11-05T08:08:08.243 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.243 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-11-05T08:08:08.243 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.243 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorls.sh 2023-11-05T08:08:08.243 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' '!' -t 0 ']' 2023-11-05T08:08:08.244 INFO:tasks.workunit.client.0.smithi052.stderr:+++ return 2023-11-05T08:08:08.244 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.244 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-11-05T08:08:08.244 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.244 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-11-05T08:08:08.245 INFO:tasks.workunit.client.0.smithi052.stderr:+++ which_declare='declare -f' 2023-11-05T08:08:08.245 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export S_COLORS=auto 2023-11-05T08:08:08.245 INFO:tasks.workunit.client.0.smithi052.stderr:+++ S_COLORS=auto 2023-11-05T08:08:08.245 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.245 INFO:tasks.workunit.client.0.smithi052.stderr:+++ which_opt=-f 2023-11-05T08:08:08.245 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n '' ']' 2023-11-05T08:08:08.246 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export which_declare 2023-11-05T08:08:08.246 INFO:tasks.workunit.client.0.smithi052.stderr:+++ LANG_backup=en_US.UTF-8 2023-11-05T08:08:08.246 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export -f which 2023-11-05T08:08:08.246 INFO:tasks.workunit.client.0.smithi052.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-05T08:08:08.246 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -f /etc/locale.conf ']' 2023-11-05T08:08:08.246 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -x /usr/bin/sed ']' 2023-11-05T08:08:08.247 INFO:tasks.workunit.client.0.smithi052.stderr:++ unset i 2023-11-05T08:08:08.247 INFO:tasks.workunit.client.0.smithi052.stderr:++ unset -f pathmunge 2023-11-05T08:08:08.247 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-11-05T08:08:08.247 INFO:tasks.workunit.client.0.smithi052.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-11-05T08:08:08.247 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.248 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-11-05T08:08:08.248 INFO:tasks.workunit.client.0.smithi052.stderr:+ export PATH 2023-11-05T08:08:08.248 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-11-05T08:08:08.248 INFO:tasks.workunit.client.0.smithi052.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-05T08:08:08.248 INFO:tasks.workunit.client.0.smithi052.stderr:+ unset rc 2023-11-05T08:08:08.248 INFO:tasks.workunit.client.0.smithi052.stderr:+ ceph_test_rados_api_pool 2023-11-05T08:08:08.249 INFO:tasks.workunit.client.0.smithi052.stderr:+++ which_declare='declare -f' 2023-11-05T08:08:08.249 INFO:tasks.workunit.client.0.smithi052.stderr:+++ which_opt=-f 2023-11-05T08:08:08.249 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export which_declare 2023-11-05T08:08:08.249 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export -f which 2023-11-05T08:08:08.249 INFO:tasks.workunit.client.0.smithi052.stderr:++ unset i 2023-11-05T08:08:08.249 INFO:tasks.workunit.client.0.smithi052.stderr:++ unset -f pathmunge 2023-11-05T08:08:08.250 INFO:tasks.workunit.client.0.smithi052.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-11-05T08:08:08.250 INFO:tasks.workunit.client.0.smithi052.stderr:+ export PATH 2023-11-05T08:08:08.250 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-11-05T08:08:08.250 INFO:tasks.workunit.client.0.smithi052.stderr:+ unset rc 2023-11-05T08:08:08.250 INFO:tasks.workunit.client.0.smithi052.stderr:+ sed 's/^/ api_snapshots_pp: /' 2023-11-05T08:08:08.251 INFO:tasks.workunit.client.0.smithi052.stderr:+ tee ceph_test_rados_api_pool.log 2023-11-05T08:08:08.251 INFO:tasks.workunit.client.0.smithi052.stderr:+++ umask 2023-11-05T08:08:08.251 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' 0022 -eq 0 ']' 2023-11-05T08:08:08.251 INFO:tasks.workunit.client.0.smithi052.stderr:++ SHELL=/bin/bash 2023-11-05T08:08:08.251 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.251 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-11-05T08:08:08.252 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.252 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/bash_completion.sh 2023-11-05T08:08:08.252 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-11-05T08:08:08.252 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.252 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-11-05T08:08:08.253 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.253 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/cobbler.sh 2023-11-05T08:08:08.253 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-11-05T08:08:08.253 INFO:tasks.workunit.client.0.smithi052.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-11-05T08:08:08.253 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.253 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-11-05T08:08:08.254 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.254 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorgrep.sh 2023-11-05T08:08:08.254 INFO:tasks.workunit.client.0.smithi052.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-05T08:08:08.254 INFO:tasks.workunit.client.0.smithi052.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-11-05T08:08:08.254 INFO:tasks.workunit.client.0.smithi052.stderr:+ ceph_test_rados_api_stat 2023-11-05T08:08:08.255 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: [==========] Running 12 tests from 1 test suite. 2023-11-05T08:08:08.255 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: [----------] Global test environment set-up. 2023-11-05T08:08:08.255 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: [----------] 12 tests from AsioRados 2023-11-05T08:08:08.256 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.853+0000 7faaedc46780 10 monclient: get_monmap_and_config 2023-11-05T08:08:08.256 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.853+0000 7faaedc46780 10 monclient: build_initial_monmap 2023-11-05T08:08:08.256 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.853+0000 7faaedc46780 10 monclient: monmap: 2023-11-05T08:08:08.256 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: epoch 0 2023-11-05T08:08:08.256 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: fsid 00000000-0000-0000-0000-000000000000 2023-11-05T08:08:08.257 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: last_changed 0.000000 2023-11-05T08:08:08.257 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: created 0.000000 2023-11-05T08:08:08.257 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: min_mon_release 0 (unknown) 2023-11-05T08:08:08.257 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: election_strategy: 1 2023-11-05T08:08:08.257 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.noname-a 2023-11-05T08:08:08.257 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.noname-b 2023-11-05T08:08:08.258 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-c 2023-11-05T08:08:08.258 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:08.258 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.853+0000 7faaedc46780 1 Processor -- start 2023-11-05T08:08:08.258 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.853+0000 7faaedc46780 1 -- start start 2023-11-05T08:08:08.258 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.853+0000 7faaedc46780 10 monclient: init 2023-11-05T08:08:08.259 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.854+0000 7faaedc46780 10 monclient: _reopen_session rank -1 2023-11-05T08:08:08.259 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.854+0000 7faaedc46780 10 monclient: _add_conns ranks=[0,2,1] 2023-11-05T08:08:08.259 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.854+0000 7faaedc46780 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5599fa9cf3d0 0x5599faa9d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:08:08.259 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.854+0000 7faaedc46780 10 monclient(hunting): picked mon.noname-a con 0x5599fa9cf3d0 addr [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] 2023-11-05T08:08:08.259 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.854+0000 7faaedc46780 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x5599faa06c70 0x5599faa8e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:08:08.260 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.854+0000 7faaedc46780 10 monclient(hunting): picked mon.noname-c con 0x5599faa06c70 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:08:08.260 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.854+0000 7faaedc46780 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5599faa9e8a0 0x5599faa0e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:08:08.260 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.854+0000 7faaedc46780 10 monclient(hunting): picked mon.noname-b con 0x5599faa9e8a0 addr [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] 2023-11-05T08:08:08.260 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.854+0000 7faaedc46780 10 monclient(hunting): start opening mon connection 2023-11-05T08:08:08.260 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.854+0000 7faaedc46780 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599fa9294f0 con 0x5599fa9cf3d0 2023-11-05T08:08:08.261 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.854+0000 7faaedc46780 10 monclient(hunting): start opening mon connection 2023-11-05T08:08:08.261 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.854+0000 7faaedc46780 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599fa929190 con 0x5599faa9e8a0 2023-11-05T08:08:08.261 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.854+0000 7faaedc46780 10 monclient(hunting): start opening mon connection 2023-11-05T08:08:08.261 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.854+0000 7faaedc46780 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x5599fa9094e0 con 0x5599faa06c70 2023-11-05T08:08:08.261 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.854+0000 7faaedc46780 10 monclient(hunting): _renew_subs 2023-11-05T08:08:08.262 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.854+0000 7faaedc46780 10 monclient(hunting): authenticate will time out at 1434.059488s 2023-11-05T08:08:08.264 INFO:tasks.workunit.client.0.smithi052.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-11-05T08:08:08.264 INFO:tasks.workunit.client.0.smithi052.stderr:++++ export LANG=en_US.UTF-8 2023-11-05T08:08:08.264 INFO:tasks.workunit.client.0.smithi052.stderr:++++ LANG=en_US.UTF-8 2023-11-05T08:08:08.265 INFO:tasks.workunit.client.0.smithi052.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-05T08:08:08.265 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-11-05T08:08:08.265 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-05T08:08:08.265 INFO:tasks.workunit.client.0.smithi052.stderr:+++ LANG=en_US.UTF-8 2023-11-05T08:08:08.265 INFO:tasks.workunit.client.0.smithi052.stderr:+++ unset LANG_backup config 2023-11-05T08:08:08.266 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n '' ']' 2023-11-05T08:08:08.266 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-05T08:08:08.266 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' dumb = linux ']' 2023-11-05T08:08:08.266 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.266 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-11-05T08:08:08.267 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.267 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/less.sh 2023-11-05T08:08:08.267 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-11-05T08:08:08.267 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.267 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-11-05T08:08:08.267 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.268 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/which2.sh 2023-11-05T08:08:08.268 INFO:tasks.workunit.client.0.smithi052.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-11-05T08:08:08.268 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo api_cmd 2023-11-05T08:08:08.268 INFO:tasks.workunit.client.0.smithi052.stderr:++ awk '{print $1}' 2023-11-05T08:08:08.268 INFO:tasks.workunit.client.0.smithi052.stderr:+ sed 's/^/ api_pool: /' 2023-11-05T08:08:08.269 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: test api_cmd on pid 91983 2023-11-05T08:08:08.275 INFO:tasks.workunit.client.0.smithi052.stderr:+ ff=api_cmd 2023-11-05T08:08:08.276 INFO:tasks.workunit.client.0.smithi052.stderr:+ pid=91983 2023-11-05T08:08:08.276 INFO:tasks.workunit.client.0.smithi052.stderr:+ echo 'test api_cmd on pid 91983' 2023-11-05T08:08:08.276 INFO:tasks.workunit.client.0.smithi052.stderr:+ pids[$f]=91983 2023-11-05T08:08:08.276 INFO:tasks.workunit.client.0.smithi052.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-11-05T08:08:08.276 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' 1 -eq 1 ']' 2023-11-05T08:08:08.277 INFO:tasks.workunit.client.0.smithi052.stderr:+ tee ceph_test_rados_api_stat.log 2023-11-05T08:08:08.277 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-11-05T08:08:08.277 INFO:tasks.workunit.client.0.smithi052.stderr:+ sed 's/^/ api_stat: /' 2023-11-05T08:08:08.277 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-11-05T08:08:08.277 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-11-05T08:08:08.278 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.278 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-11-05T08:08:08.278 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.278 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-11-05T08:08:08.278 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-11-05T08:08:08.279 INFO:tasks.workunit.client.0.smithi052.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-05T08:08:08.279 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-11-05T08:08:08.279 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-11-05T08:08:08.279 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-11-05T08:08:08.279 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.280 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-11-05T08:08:08.280 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.280 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/debuginfod.sh 2023-11-05T08:08:08.280 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-11-05T08:08:08.280 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.281 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-11-05T08:08:08.281 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.281 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/gawk.sh 2023-11-05T08:08:08.281 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.281 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-11-05T08:08:08.281 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.282 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/lang.sh 2023-11-05T08:08:08.282 INFO:tasks.workunit.client.0.smithi052.stderr:+++ unset LANG_backup 2023-11-05T08:08:08.282 INFO:tasks.workunit.client.0.smithi052.stderr:++++ /usr/bin/locale 2023-11-05T08:08:08.282 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n '' ']' 2023-11-05T08:08:08.282 INFO:tasks.workunit.client.0.smithi052.stderr:+++ LANG_backup=en_US.UTF-8 2023-11-05T08:08:08.283 INFO:tasks.workunit.client.0.smithi052.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-05T08:08:08.283 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -f /etc/locale.conf ']' 2023-11-05T08:08:08.283 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -x /usr/bin/sed ']' 2023-11-05T08:08:08.283 INFO:tasks.workunit.client.0.smithi052.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_cmd 2>&1 | tee ceph_test_rados_api_cmd.log | sed "s/^/ api_cmd: /"' 2023-11-05T08:08:08.283 INFO:tasks.workunit.client.0.smithi052.stderr:++ printf %25s api_cmd_pp 2023-11-05T08:08:08.284 INFO:tasks.workunit.client.0.smithi052.stderr:+ r=' api_cmd_pp' 2023-11-05T08:08:08.284 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' -f /etc/bashrc ']' 2023-11-05T08:08:08.284 INFO:tasks.workunit.client.0.smithi052.stderr:+ . /etc/bashrc 2023-11-05T08:08:08.284 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -z '' ']' 2023-11-05T08:08:08.284 INFO:tasks.workunit.client.0.smithi052.stderr:++ BASHRCSOURCED=Y 2023-11-05T08:08:08.285 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.285 INFO:tasks.workunit.client.0.smithi052.stderr:++ shopt -q login_shell 2023-11-05T08:08:08.285 INFO:tasks.workunit.client.0.smithi052.stderr:+++++ readlink /proc/91854/exe 2023-11-05T08:08:08.285 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'grep=grep --color=auto' 2023-11-05T08:08:08.285 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'egrep=egrep --color=auto' 2023-11-05T08:08:08.285 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-11-05T08:08:08.286 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.286 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-11-05T08:08:08.286 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.286 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorls.sh 2023-11-05T08:08:08.286 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' '!' -t 0 ']' 2023-11-05T08:08:08.287 INFO:tasks.workunit.client.0.smithi052.stderr:+++ return 2023-11-05T08:08:08.287 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.287 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-11-05T08:08:08.287 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.287 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-11-05T08:08:08.288 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export S_COLORS=auto 2023-11-05T08:08:08.288 INFO:tasks.workunit.client.0.smithi052.stderr:+++ S_COLORS=auto 2023-11-05T08:08:08.288 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.288 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-11-05T08:08:08.288 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.289 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-11-05T08:08:08.289 INFO:tasks.workunit.client.0.smithi052.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-05T08:08:08.289 INFO:tasks.workunit.client.0.smithi052.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-11-05T08:08:08.289 INFO:tasks.workunit.client.0.smithi052.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-11-05T08:08:08.289 INFO:tasks.workunit.client.0.smithi052.stderr:++++ export LANG=en_US.UTF-8 2023-11-05T08:08:08.289 INFO:tasks.workunit.client.0.smithi052.stderr:++++ LANG=en_US.UTF-8 2023-11-05T08:08:08.290 INFO:tasks.workunit.client.0.smithi052.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-05T08:08:08.290 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-11-05T08:08:08.290 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-05T08:08:08.290 INFO:tasks.workunit.client.0.smithi052.stderr:+++ LANG=en_US.UTF-8 2023-11-05T08:08:08.290 INFO:tasks.workunit.client.0.smithi052.stderr:+++ unset LANG_backup config 2023-11-05T08:08:08.291 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n '' ']' 2023-11-05T08:08:08.291 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-05T08:08:08.291 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' dumb = linux ']' 2023-11-05T08:08:08.291 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.291 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-11-05T08:08:08.292 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.292 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/less.sh 2023-11-05T08:08:08.292 INFO:tasks.workunit.client.0.smithi052.stdout:2023-11-05T08:08:07.871+0000 7faaea734640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x5599faa06c70 0x5599faa8e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:08:08.292 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.871+0000 7faaea734640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x5599faa06c70 0x5599faa8e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.52:39416/0 (socket says 172.21.15.52:39416) 2023-11-05T08:08:08.293 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.871+0000 7faaea734640 1 -- 172.21.15.52:0/429990218 learned_addr learned my addr 172.21.15.52:0/429990218 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-11-05T08:08:08.293 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.871+0000 7faaea734640 10 monclient(hunting): get_auth_request con 0x5599faa06c70 auth_method 0 2023-11-05T08:08:08.293 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.871+0000 7faaea734640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:08:08.293 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.871+0000 7faaea734640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:08:08.294 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.871+0000 7faaea734640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:08:08.294 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.872+0000 7faaea734640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:08:08.294 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.872+0000 7faaea734640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:08:08.294 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.872+0000 7faaea734640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:08:08.294 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.874+0000 7faaea734640 10 monclient(hunting): handle_auth_done global_id 4334 payload 274 2023-11-05T08:08:08.295 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.874+0000 7faaea734640 1 -- 172.21.15.52:0/429990218 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5599faa9e8a0 msgr2=0x5599faa0e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-05T08:08:08.295 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.874+0000 7faaea734640 1 --2- 172.21.15.52:0/429990218 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5599faa9e8a0 0x5599faa0e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:08:08.295 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.874+0000 7faaea734640 1 -- 172.21.15.52:0/429990218 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5599fa9cf3d0 msgr2=0x5599faa9d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-05T08:08:08.295 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.874+0000 7faaea734640 1 --2- 172.21.15.52:0/429990218 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5599fa9cf3d0 0x5599faa9d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:08:08.295 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.874+0000 7faaea734640 10 monclient: _finish_hunting 0 2023-11-05T08:08:08.296 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.874+0000 7faaea734640 1 monclient: found mon.noname-c 2023-11-05T08:08:08.296 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.874+0000 7faaea734640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:08:08.296 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.874+0000 7faaea734640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.52:3301/0 2023-11-05T08:08:08.296 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.874+0000 7faaea734640 1 -- 172.21.15.52:0/429990218 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faadc00a1c0 con 0x5599faa06c70 2023-11-05T08:08:08.296 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.885+0000 7faaea734640 1 --2- 172.21.15.52:0/429990218 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x5599faa06c70 0x5599faa8e860 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7faad40098b0 tx=0x7faad4005a00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b719d0bb235fe47 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:08:08.297 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-11-05T08:08:08.297 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.297 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-11-05T08:08:08.298 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.298 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.903+0000 7faae9732640 1 -- 172.21.15.52:0/429990218 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad400f040 con 0x5599faa06c70 2023-11-05T08:08:08.298 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.903+0000 7faae9732640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:08:08.298 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.903+0000 7faae9732640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-11-05T08:08:08.299 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.903+0000 7faae9732640 10 monclient: dump: 2023-11-05T08:08:08.299 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: epoch 1 2023-11-05T08:08:08.299 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:08:08.299 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:08:08.300 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:08:08.300 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: min_mon_release 18 (reef) 2023-11-05T08:08:08.300 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: election_strategy: 1 2023-11-05T08:08:08.300 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:08:08.300 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:08:08.301 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:08:08.301 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:08.301 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.903+0000 7faae9732640 10 monclient: _finish_auth 0 2023-11-05T08:08:08.301 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.903+0000 7faae9732640 10 monclient: _check_auth_tickets 2023-11-05T08:08:08.301 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.903+0000 7faae9732640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:08:08.302 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.903+0000 7faae9732640 1 -- 172.21.15.52:0/429990218 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faad4008930 con 0x5599faa06c70 2023-11-05T08:08:08.302 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.903+0000 7faae9732640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:08:08.302 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.903+0000 7faae9732640 1 -- 172.21.15.52:0/429990218 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad4008ca0 con 0x5599faa06c70 2023-11-05T08:08:08.302 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.903+0000 7faae9732640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:08:08.302 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.903+0000 7faae9732640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-11-05T08:08:08.303 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.903+0000 7faae9732640 10 monclient: dump: 2023-11-05T08:08:08.303 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: epoch 1 2023-11-05T08:08:08.303 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:08:08.303 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:08:08.303 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:08:08.304 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: min_mon_release 18 (reef) 2023-11-05T08:08:08.304 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: election_strategy: 1 2023-11-05T08:08:08.304 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:08:08.304 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:08:08.305 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:08:08.305 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:08.305 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.903+0000 7faaedc46780 5 monclient: authenticate success, global_id 4334 2023-11-05T08:08:08.305 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.903+0000 7faaedc46780 10 monclient: get_monmap_and_config success 2023-11-05T08:08:08.305 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.903+0000 7faaedc46780 4 set_mon_vals no callback set 2023-11-05T08:08:08.306 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.904+0000 7faaedc46780 10 monclient: shutdown 2023-11-05T08:08:08.306 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.904+0000 7faaedc46780 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:08:08.306 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.904+0000 7faaedc46780 1 -- 172.21.15.52:0/429990218 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x5599faa06c70 msgr2=0x5599faa8e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:08:08.306 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.904+0000 7faaedc46780 1 --2- 172.21.15.52:0/429990218 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x5599faa06c70 0x5599faa8e860 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7faad40098b0 tx=0x7faad4005a00 comp rx=0 tx=0).stop 2023-11-05T08:08:08.307 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/which2.sh 2023-11-05T08:08:08.307 INFO:tasks.workunit.client.0.smithi052.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-11-05T08:08:08.307 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.904+0000 7faaedc46780 1 -- 172.21.15.52:0/429990218 shutdown_connections 2023-11-05T08:08:08.308 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.904+0000 7faaedc46780 1 --2- 172.21.15.52:0/429990218 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5599faa9e8a0 0x5599faa0e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:08:08.308 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.904+0000 7faaedc46780 1 --2- 172.21.15.52:0/429990218 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x5599faa06c70 0x5599faa8e860 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:08:08.308 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.904+0000 7faaedc46780 1 --2- 172.21.15.52:0/429990218 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5599fa9cf3d0 0x5599faa9d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:08:08.308 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.904+0000 7faaedc46780 1 -- 172.21.15.52:0/429990218 >> 172.21.15.52:0/429990218 conn(0x5599faa0c450 msgr2=0x5599faa0aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:08:08.308 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.904+0000 7faaedc46780 1 -- 172.21.15.52:0/429990218 shutdown_connections 2023-11-05T08:08:08.309 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.904+0000 7faaedc46780 1 -- 172.21.15.52:0/429990218 wait complete. 2023-11-05T08:08:08.309 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.904+0000 7faaedc46780 10 monclient: build_initial_monmap 2023-11-05T08:08:08.309 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.904+0000 7faaedc46780 10 monclient: monmap: 2023-11-05T08:08:08.309 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: epoch 0 2023-11-05T08:08:08.309 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: fsid 00000000-0000-0000-0000-000000000000 2023-11-05T08:08:08.309 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: last_changed 0.000000 2023-11-05T08:08:08.310 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: created 0.000000 2023-11-05T08:08:08.310 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: min_mon_release 0 (unknown) 2023-11-05T08:08:08.310 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: election_strategy: 1 2023-11-05T08:08:08.310 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.noname-a 2023-11-05T08:08:08.310 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.noname-b 2023-11-05T08:08:08.311 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-c 2023-11-05T08:08:08.311 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:08.311 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.905+0000 7faaedc46780 1 librados: starting msgr at 2023-11-05T08:08:08.311 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.905+0000 7faaedc46780 1 librados: starting objecter 2023-11-05T08:08:08.311 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.905+0000 7faaedc46780 1 Processor -- start 2023-11-05T08:08:08.312 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.905+0000 7faaedc46780 1 -- start start 2023-11-05T08:08:08.312 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.905+0000 7faaedc46780 1 librados: setting wanted keys 2023-11-05T08:08:08.312 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.905+0000 7faaedc46780 1 librados: calling monclient init 2023-11-05T08:08:08.312 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.905+0000 7faaedc46780 10 monclient: init 2023-11-05T08:08:08.312 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.906+0000 7faaedc46780 10 monclient: _reopen_session rank -1 2023-11-05T08:08:08.312 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.906+0000 7faaedc46780 10 monclient: _add_conns ranks=[0,1,2] 2023-11-05T08:08:08.313 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.906+0000 7faaedc46780 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5599fa9cf3d0 0x5599faa8cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:08:08.313 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.906+0000 7faaedc46780 10 monclient(hunting): picked mon.noname-a con 0x5599fa9cf3d0 addr [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] 2023-11-05T08:08:08.313 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.906+0000 7faaedc46780 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5599faa06c70 0x5599faa92100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:08:08.313 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.906+0000 7faaedc46780 10 monclient(hunting): picked mon.noname-b con 0x5599faa06c70 addr [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] 2023-11-05T08:08:08.315 INFO:tasks.workunit.client.0.smithi052.stderr:++++ basename /usr/bin/bash 2023-11-05T08:08:08.315 INFO:tasks.workunit.client.0.smithi052.stderr:++ awk '{print $1}' 2023-11-05T08:08:08.315 INFO:tasks.workunit.client.0.smithi052.stderr:+++ which_declare='declare -f' 2023-11-05T08:08:08.316 INFO:tasks.workunit.client.0.smithi052.stderr:+++ which_opt=-f 2023-11-05T08:08:08.316 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export which_declare 2023-11-05T08:08:08.316 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export -f which 2023-11-05T08:08:08.316 INFO:tasks.workunit.client.0.smithi052.stderr:++ unset i 2023-11-05T08:08:08.316 INFO:tasks.workunit.client.0.smithi052.stderr:++ unset -f pathmunge 2023-11-05T08:08:08.317 INFO:tasks.workunit.client.0.smithi052.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-11-05T08:08:08.317 INFO:tasks.workunit.client.0.smithi052.stderr:+ export PATH 2023-11-05T08:08:08.317 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-11-05T08:08:08.317 INFO:tasks.workunit.client.0.smithi052.stderr:+ unset rc 2023-11-05T08:08:08.317 INFO:tasks.workunit.client.0.smithi052.stderr:+ ceph_test_rados_api_stat_pp 2023-11-05T08:08:08.317 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo api_cmd_pp 2023-11-05T08:08:08.318 INFO:tasks.workunit.client.0.smithi052.stderr:+ ff=api_cmd_pp 2023-11-05T08:08:08.318 INFO:tasks.workunit.client.0.smithi052.stderr:+++ umask 2023-11-05T08:08:08.318 INFO:tasks.workunit.client.0.smithi052.stderr:+ pid=92026 2023-11-05T08:08:08.318 INFO:tasks.workunit.client.0.smithi052.stderr:+ echo 'test api_cmd_pp on pid 92026' 2023-11-05T08:08:08.318 INFO:tasks.workunit.client.0.smithi052.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_cmd_pp 2>&1 | tee ceph_test_rados_api_cmd_pp.log | sed "s/^/ api_cmd_pp: /"' 2023-11-05T08:08:08.319 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.906+0000 7faaedc46780 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x5599faa9e8a0 0x5599faa92640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 cryptotest api_cmd_pp on pid 92026 2023-11-05T08:08:08.326 INFO:tasks.workunit.client.0.smithi052.stderr:+ pids[$f]=92026 2023-11-05T08:08:08.326 INFO:tasks.workunit.client.0.smithi052.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-11-05T08:08:08.327 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' 0022 -eq 0 ']' 2023-11-05T08:08:08.327 INFO:tasks.workunit.client.0.smithi052.stderr:++ SHELL=/bin/bash 2023-11-05T08:08:08.327 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' 1 -eq 1 ']' 2023-11-05T08:08:08.327 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.327 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-11-05T08:08:08.327 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.328 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/bash_completion.sh 2023-11-05T08:08:08.328 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-11-05T08:08:08.328 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.328 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-11-05T08:08:08.328 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.329 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/cobbler.sh 2023-11-05T08:08:08.329 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-11-05T08:08:08.329 INFO:tasks.workunit.client.0.smithi052.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-11-05T08:08:08.329 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.329 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-11-05T08:08:08.330 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.330 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorgrep.sh 2023-11-05T08:08:08.330 INFO:tasks.workunit.client.0.smithi052.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-05T08:08:08.330 INFO:tasks.workunit.client.0.smithi052.stderr:++ printf %25s api_service 2023-11-05T08:08:08.330 INFO:tasks.workunit.client.0.smithi052.stderr:+ r=' api_service' 2023-11-05T08:08:08.331 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' -f /etc/bashrc ']' 2023-11-05T08:08:08.331 INFO:tasks.workunit.client.0.smithi052.stderr:+ . /etc/bashrc 2023-11-05T08:08:08.331 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -z '' ']' 2023-11-05T08:08:08.331 INFO:tasks.workunit.client.0.smithi052.stderr:++ BASHRCSOURCED=Y 2023-11-05T08:08:08.331 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.332 INFO:tasks.workunit.client.0.smithi052.stderr:++ shopt -q login_shell 2023-11-05T08:08:08.332 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-11-05T08:08:08.332 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-11-05T08:08:08.332 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-11-05T08:08:08.332 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.332 INFO:tasks.workunit.client.0.smithi052.stderr:+++ umask 2023-11-05T08:08:08.333 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-11-05T08:08:08.333 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.333 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-11-05T08:08:08.333 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-11-05T08:08:08.333 INFO:tasks.workunit.client.0.smithi052.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-05T08:08:08.334 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' 0022 -eq 0 ']' 2023-11-05T08:08:08.334 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo api_service 2023-11-05T08:08:08.334 INFO:tasks.workunit.client.0.smithi052.stderr:++ SHELL=/bin/bash 2023-11-05T08:08:08.334 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.334 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-11-05T08:08:08.335 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.335 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/bash_completion.sh 2023-11-05T08:08:08.335 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-11-05T08:08:08.335 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.335 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-11-05T08:08:08.336 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.336 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/cobbler.sh 2023-11-05T08:08:08.336 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-11-05T08:08:08.336 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'grep=grep --color=auto' 2023-11-05T08:08:08.336 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'egrep=egrep --color=auto' 2023-11-05T08:08:08.336 INFO:tasks.workunit.client.0.smithi052.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-11-05T08:08:08.337 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-11-05T08:08:08.337 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.337 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-11-05T08:08:08.337 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.337 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorls.sh 2023-11-05T08:08:08.338 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' '!' -t 0 ']' 2023-11-05T08:08:08.338 INFO:tasks.workunit.client.0.smithi052.stderr:+++ return 2023-11-05T08:08:08.338 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.338 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-11-05T08:08:08.338 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.339 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-11-05T08:08:08.339 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.339 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export S_COLORS=auto 2023-11-05T08:08:08.339 INFO:tasks.workunit.client.0.smithi052.stderr:+++ S_COLORS=auto 2023-11-05T08:08:08.339 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.340 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-11-05T08:08:08.340 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.340 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-11-05T08:08:08.340 INFO:tasks.workunit.client.0.smithi052.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-05T08:08:08.340 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-11-05T08:08:08.341 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.341 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorgrep.sh 2023-11-05T08:08:08.341 INFO:tasks.workunit.client.0.smithi052.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-05T08:08:08.341 INFO:tasks.workunit.client.0.smithi052.stderr:+ sed 's/^/ api_stat_pp: /' 2023-11-05T08:08:08.341 INFO:tasks.workunit.client.0.smithi052.stderr:+ tee ceph_test_rados_api_stat_pp.log 2023-11-05T08:08:08.342 INFO:tasks.workunit.client.0.smithi052.stderr:+++++ readlink /proc/91902/exe 2023-11-05T08:08:08.342 INFO:tasks.workunit.client.0.smithi052.stderr:++++ basename /usr/bin/bash 2023-11-05T08:08:08.342 INFO:tasks.workunit.client.0.smithi052.stderr:+++ which_declare='declare -f' 2023-11-05T08:08:08.342 INFO:tasks.workunit.client.0.smithi052.stderr:++ awk '{print $1}' 2023-11-05T08:08:08.342 INFO:tasks.workunit.client.0.smithi052.stderr:+++ which_opt=-f 2023-11-05T08:08:08.342 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export which_declare 2023-11-05T08:08:08.343 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export -f which 2023-11-05T08:08:08.343 INFO:tasks.workunit.client.0.smithi052.stderr:++ unset i 2023-11-05T08:08:08.343 INFO:tasks.workunit.client.0.smithi052.stderr:++ unset -f pathmunge 2023-11-05T08:08:08.343 INFO:tasks.workunit.client.0.smithi052.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-11-05T08:08:08.343 INFO:tasks.workunit.client.0.smithi052.stderr:+ export PATH 2023-11-05T08:08:08.344 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-11-05T08:08:08.344 INFO:tasks.workunit.client.0.smithi052.stderr:+ unset rc 2023-11-05T08:08:08.344 INFO:tasks.workunit.client.0.smithi052.stderr:+ tee ceph_test_rados_api_watch_notify.log 2023-11-05T08:08:08.344 INFO:tasks.workunit.client.0.smithi052.stderr:+ ceph_test_rados_api_watch_notify 2023-11-05T08:08:08.344 INFO:tasks.workunit.client.0.smithi052.stderr:+ sed 's/^/ api_watch_notify: /' 2023-11-05T08:08:08.344 INFO:tasks.workunit.client.0.smithi052.stderr:+ ff=api_service 2023-11-05T08:08:08.345 INFO:tasks.workunit.client.0.smithi052.stderr:+ pid=92065 2023-11-05T08:08:08.345 INFO:tasks.workunit.client.0.smithi052.stderr:+ echo 'test api_service on pid 92065' 2023-11-05T08:08:08.345 INFO:tasks.workunit.client.0.smithi052.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_service 2>&1 | tee ceph_test_rados_api_service.log | sed "s/^/ api_service: /"' 2023-11-05T08:08:08.345 INFO:tasks.workunit.client.0.smithi052.stdout:test api_service on pid 92065 2023-11-05T08:08:08.358 INFO:tasks.workunit.client.0.smithi052.stderr:+ pids[$f]=92065 2023-11-05T08:08:08.358 INFO:tasks.workunit.client.0.smithi052.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-11-05T08:08:08.358 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' 1 -eq 1 ']' 2023-11-05T08:08:08.359 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'grep=grep --color=auto' 2023-11-05T08:08:08.359 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'egrep=egrep --color=auto' 2023-11-05T08:08:08.359 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-11-05T08:08:08.359 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.359 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-11-05T08:08:08.360 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.360 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorls.sh 2023-11-05T08:08:08.360 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' '!' -t 0 ']' 2023-11-05T08:08:08.360 INFO:tasks.workunit.client.0.smithi052.stderr:+++ return 2023-11-05T08:08:08.360 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.361 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-11-05T08:08:08.361 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.361 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-11-05T08:08:08.361 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export S_COLORS=auto 2023-11-05T08:08:08.361 INFO:tasks.workunit.client.0.smithi052.stderr:+++ S_COLORS=auto 2023-11-05T08:08:08.362 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.362 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-11-05T08:08:08.362 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.362 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-11-05T08:08:08.362 INFO:tasks.workunit.client.0.smithi052.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-05T08:08:08.363 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-11-05T08:08:08.363 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-11-05T08:08:08.363 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-11-05T08:08:08.363 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.364 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-11-05T08:08:08.364 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.364 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/debuginfod.sh 2023-11-05T08:08:08.364 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-11-05T08:08:08.364 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.364 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-11-05T08:08:08.365 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.365 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/gawk.sh 2023-11-05T08:08:08.365 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' -f /etc/bashrc ']' 2023-11-05T08:08:08.365 INFO:tasks.workunit.client.0.smithi052.stderr:+ . /etc/bashrc 2023-11-05T08:08:08.365 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.366 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-11-05T08:08:08.366 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.366 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/lang.sh 2023-11-05T08:08:08.366 INFO:tasks.workunit.client.0.smithi052.stderr:+++ unset LANG_backup 2023-11-05T08:08:08.366 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-11-05T08:08:08.366 INFO:tasks.workunit.client.0.smithi052.stderr:++++ /usr/bin/locale 2023-11-05T08:08:08.367 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-11-05T08:08:08.367 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-11-05T08:08:08.367 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.367 INFO:tasks.workunit.client.0.smithi052.stderr:++ printf %25s api_service_pp 2023-11-05T08:08:08.367 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-11-05T08:08:08.368 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.368 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-11-05T08:08:08.368 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-11-05T08:08:08.368 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -z '' ']' 2023-11-05T08:08:08.368 INFO:tasks.workunit.client.0.smithi052.stderr:++ BASHRCSOURCED=Y 2023-11-05T08:08:08.369 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.369 INFO:tasks.workunit.client.0.smithi052.stderr:++ shopt -q login_shell 2023-11-05T08:08:08.369 INFO:tasks.workunit.client.0.smithi052.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-05T08:08:08.369 INFO:tasks.workunit.client.0.smithi052.stderr:+ r=' api_service_pp' 2023-11-05T08:08:08.369 INFO:tasks.workunit.client.0.smithi052.stderr:+++ umask 2023-11-05T08:08:08.369 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' 0022 -eq 0 ']' 2023-11-05T08:08:08.370 INFO:tasks.workunit.client.0.smithi052.stderr:++ SHELL=/bin/bash 2023-11-05T08:08:08.370 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.370 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-11-05T08:08:08.370 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.370 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/bash_completion.sh 2023-11-05T08:08:08.371 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-11-05T08:08:08.371 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.371 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-11-05T08:08:08.371 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.371 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/cobbler.sh 2023-11-05T08:08:08.371 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-11-05T08:08:08.372 INFO:tasks.workunit.client.0.smithi052.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-11-05T08:08:08.372 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.372 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-11-05T08:08:08.372 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.372 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorgrep.sh 2023-11-05T08:08:08.373 INFO:tasks.workunit.client.0.smithi052.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-05T08:08:08.373 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n '' ']' 2023-11-05T08:08:08.373 INFO:tasks.workunit.client.0.smithi052.stderr:+++ LANG_backup=en_US.UTF-8 2023-11-05T08:08:08.373 INFO:tasks.workunit.client.0.smithi052.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-05T08:08:08.373 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -f /etc/locale.conf ']' 2023-11-05T08:08:08.374 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -x /usr/bin/sed ']' 2023-11-05T08:08:08.374 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo api_service_pp 2023-11-05T08:08:08.374 INFO:tasks.workunit.client.0.smithi052.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-11-05T08:08:08.374 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-11-05T08:08:08.374 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-11-05T08:08:08.375 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-11-05T08:08:08.375 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.375 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-11-05T08:08:08.375 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.375 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-11-05T08:08:08.375 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-11-05T08:08:08.376 INFO:tasks.workunit.client.0.smithi052.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-11-05T08:08:08.376 INFO:tasks.workunit.client.0.smithi052.stderr:++++ export LANG=en_US.UTF-8 2023-11-05T08:08:08.376 INFO:tasks.workunit.client.0.smithi052.stderr:++++ LANG=en_US.UTF-8 2023-11-05T08:08:08.376 INFO:tasks.workunit.client.0.smithi052.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-05T08:08:08.376 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-11-05T08:08:08.377 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-05T08:08:08.377 INFO:tasks.workunit.client.0.smithi052.stderr:+++ LANG=en_US.UTF-8 2023-11-05T08:08:08.377 INFO:tasks.workunit.client.0.smithi052.stderr:+++ unset LANG_backup config 2023-11-05T08:08:08.377 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n '' ']' 2023-11-05T08:08:08.377 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-05T08:08:08.378 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' dumb = linux ']' 2023-11-05T08:08:08.378 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.378 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-11-05T08:08:08.378 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.378 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-11-05T08:08:08.379 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/less.sh 2023-11-05T08:08:08.379 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-11-05T08:08:08.379 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-11-05T08:08:08.379 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.379 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-11-05T08:08:08.379 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.380 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/debuginfod.sh 2023-11-05T08:08:08.380 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-11-05T08:08:08.380 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-11-05T08:08:08.380 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.380 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-11-05T08:08:08.381 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.381 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/gawk.sh 2023-11-05T08:08:08.381 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.381 INFO:tasks.workunit.client.0.smithi052.stderr:++ awk '{print $1}' 2023-11-05T08:08:08.381 INFO:tasks.workunit.client.0.smithi052.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-05T08:08:08.382 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-11-05T08:08:08.382 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.382 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/which2.sh 2023-11-05T08:08:08.382 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.382 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-11-05T08:08:08.383 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.383 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/lang.sh 2023-11-05T08:08:08.383 INFO:tasks.workunit.client.0.smithi052.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-11-05T08:08:08.383 INFO:tasks.workunit.client.0.smithi052.stderr:+++ unset LANG_backup 2023-11-05T08:08:08.383 INFO:tasks.workunit.client.0.smithi052.stderr:++++ /usr/bin/locale 2023-11-05T08:08:08.384 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'grep=grep --color=auto' 2023-11-05T08:08:08.384 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'egrep=egrep --color=auto' 2023-11-05T08:08:08.384 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-11-05T08:08:08.384 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.384 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-11-05T08:08:08.385 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.385 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorls.sh 2023-11-05T08:08:08.385 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' '!' -t 0 ']' 2023-11-05T08:08:08.385 INFO:tasks.workunit.client.0.smithi052.stderr:+++ return 2023-11-05T08:08:08.385 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.386 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-11-05T08:08:08.386 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.386 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-11-05T08:08:08.386 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export S_COLORS=auto 2023-11-05T08:08:08.386 INFO:tasks.workunit.client.0.smithi052.stderr:+++ S_COLORS=auto 2023-11-05T08:08:08.387 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.387 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-11-05T08:08:08.387 INFO:tasks.workunit.client.0.smithi052.stderr:+++++ readlink /proc/91931/exe 2023-11-05T08:08:08.387 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.387 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-11-05T08:08:08.388 INFO:tasks.workunit.client.0.smithi052.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-05T08:08:08.388 INFO:tasks.workunit.client.0.smithi052.stderr:++++ basename /usr/bin/bash 2023-11-05T08:08:08.388 INFO:tasks.workunit.client.0.smithi052.stderr:+++ which_declare='declare -f' 2023-11-05T08:08:08.388 INFO:tasks.workunit.client.0.smithi052.stderr:+++ which_opt=-f 2023-11-05T08:08:08.388 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export which_declare 2023-11-05T08:08:08.389 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export -f which 2023-11-05T08:08:08.389 INFO:tasks.workunit.client.0.smithi052.stderr:++ unset i 2023-11-05T08:08:08.389 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n '' ']' 2023-11-05T08:08:08.389 INFO:tasks.workunit.client.0.smithi052.stderr:+++ LANG_backup=en_US.UTF-8 2023-11-05T08:08:08.389 INFO:tasks.workunit.client.0.smithi052.stderr:++ unset -f pathmunge 2023-11-05T08:08:08.390 INFO:tasks.workunit.client.0.smithi052.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-05T08:08:08.390 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -f /etc/locale.conf ']' 2023-11-05T08:08:08.390 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -x /usr/bin/sed ']' 2023-11-05T08:08:08.390 INFO:tasks.workunit.client.0.smithi052.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-11-05T08:08:08.390 INFO:tasks.workunit.client.0.smithi052.stderr:+ ff=api_service_pp 2023-11-05T08:08:08.390 INFO:tasks.workunit.client.0.smithi052.stderr:+ export PATH 2023-11-05T08:08:08.391 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-11-05T08:08:08.391 INFO:tasks.workunit.client.0.smithi052.stderr:+ pid=92095 2023-11-05T08:08:08.391 INFO:tasks.workunit.client.0.smithi052.stderr:+ unset rc 2023-11-05T08:08:08.391 INFO:tasks.workunit.client.0.smithi052.stderr:+ echo 'test api_service_pp on pid 92095' 2023-11-05T08:08:08.392 INFO:tasks.workunit.client.0.smithi052.stdout:test api_service_pp on pid 92095 2023-11-05T08:08:08.393 INFO:tasks.workunit.client.0.smithi052.stderr:+ pids[$f]=92095 2023-11-05T08:08:08.394 INFO:tasks.workunit.client.0.smithi052.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-11-05T08:08:08.394 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' 1 -eq 1 ']' 2023-11-05T08:08:08.394 INFO:tasks.workunit.client.0.smithi052.stderr:+ ceph_test_rados_api_watch_notify_pp 2023-11-05T08:08:08.394 INFO:tasks.workunit.client.0.smithi052.stderr:+ tee ceph_test_rados_api_watch_notify_pp.log 2023-11-05T08:08:08.394 INFO:tasks.workunit.client.0.smithi052.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_service_pp 2>&1 | tee ceph_test_rados_api_service_pp.log | sed "s/^/ api_service_pp: /"' 2023-11-05T08:08:08.395 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-11-05T08:08:08.395 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-11-05T08:08:08.395 INFO:tasks.workunit.client.0.smithi052.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-11-05T08:08:08.395 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-11-05T08:08:08.395 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.396 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-11-05T08:08:08.396 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.396 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-11-05T08:08:08.396 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-11-05T08:08:08.396 INFO:tasks.workunit.client.0.smithi052.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-05T08:08:08.397 INFO:tasks.workunit.client.0.smithi052.stdout: rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:08:08.397 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.906+0000 7faaedc46780 10 monclient(hunting): picked mon.noname-c con 0x5599faa9e8a0 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:08:08.397 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.906+0000 7faaedc46780 10 monclient(hunting): start opening mon connection 2023-11-05T08:08:08.397 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.906+0000 7faaedc46780 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599faa9ad50 con 0x5599fa9cf3d0 2023-11-05T08:08:08.397 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.906+0000 7faaedc46780 10 monclient(hunting): start opening mon connection 2023-11-05T08:08:08.398 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.906+0000 7faaedc46780 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599faa91440 con 0x5599faa06c70 2023-11-05T08:08:08.398 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.906+0000 7faaedc46780 10 monclient(hunting): start opening mon connection 2023-11-05T08:08:08.398 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.906+0000 7faaedc46780 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x5599faa91720 con 0x5599faa9e8a0 2023-11-05T08:08:08.398 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.906+0000 7faaedc46780 10 monclient(hunting): _renew_subs 2023-11-05T08:08:08.398 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.906+0000 7faaedc46780 10 monclient(hunting): authenticate will time out at 1434.111234s 2023-11-05T08:08:08.399 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.928+0000 7faaea734640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5599faa06c70 0x5599faa92100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:08:08.399 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.931+0000 7faaea734640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5599faa06c70 0x5599faa92100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.52:44816/0 (socket says 172.21.15.52:44816) 2023-11-05T08:08:08.399 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.931+0000 7faaea734640 1 -- 172.21.15.52:0/3032579076 learned_addr learned my addr 172.21.15.52:0/3032579076 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-11-05T08:08:08.399 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.931+0000 7faaea734640 10 monclient(hunting): get_auth_request con 0x5599faa06c70 auth_method 0 2023-11-05T08:08:08.399 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.931+0000 7faaea734640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:08:08.400 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.931+0000 7faaea734640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:08:08.400 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.931+0000 7faaea734640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:08:08.400 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.932+0000 7faaea734640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:08:08.400 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.932+0000 7faaea734640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:08:08.400 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.932+0000 7faaea734640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:08:08.401 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.936+0000 7faaea734640 10 monclient(hunting): handle_auth_done global_id 4459 payload 824 2023-11-05T08:08:08.401 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.936+0000 7faaea734640 1 -- 172.21.15.52:0/3032579076 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x5599faa9e8a0 msgr2=0x5599faa92640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:08:08.401 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.936+0000 7faaea734640 1 --2- 172.21.15.52:0/3032579076 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x5599faa9e8a0 0x5599faa92640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:08:08.401 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.936+0000 7faaea734640 1 -- 172.21.15.52:0/3032579076 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5599fa9cf3d0 msgr2=0x5599faa8cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:08:08.409 INFO:tasks.workunit.client.0.smithi052.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-11-05T08:08:08.409 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-11-05T08:08:08.409 INFO:tasks.workunit.client.0.smithi052.stderr:++++ export LANG=en_US.UTF-8 2023-11-05T08:08:08.409 INFO:tasks.workunit.client.0.smithi052.stderr:++++ LANG=en_US.UTF-8 2023-11-05T08:08:08.410 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-11-05T08:08:08.410 INFO:tasks.workunit.client.0.smithi052.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-05T08:08:08.410 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-11-05T08:08:08.410 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-11-05T08:08:08.410 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.411 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-05T08:08:08.411 INFO:tasks.workunit.client.0.smithi052.stderr:+++ LANG=en_US.UTF-8 2023-11-05T08:08:08.411 INFO:tasks.workunit.client.0.smithi052.stderr:+++ unset LANG_backup config 2023-11-05T08:08:08.411 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n '' ']' 2023-11-05T08:08:08.411 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-11-05T08:08:08.411 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.412 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-05T08:08:08.412 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' dumb = linux ']' 2023-11-05T08:08:08.412 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.412 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-11-05T08:08:08.412 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.413 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/less.sh 2023-11-05T08:08:08.413 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/debuginfod.sh 2023-11-05T08:08:08.413 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' -f /etc/bashrc ']' 2023-11-05T08:08:08.413 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-11-05T08:08:08.413 INFO:tasks.workunit.client.0.smithi052.stderr:+ . /etc/bashrc 2023-11-05T08:08:08.414 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.414 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-11-05T08:08:08.414 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.414 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/which2.sh 2023-11-05T08:08:08.414 INFO:tasks.workunit.client.0.smithi052.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-11-05T08:08:08.414 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-11-05T08:08:08.415 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -z '' ']' 2023-11-05T08:08:08.415 INFO:tasks.workunit.client.0.smithi052.stderr:++ BASHRCSOURCED=Y 2023-11-05T08:08:08.415 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.415 INFO:tasks.workunit.client.0.smithi052.stderr:++ shopt -q login_shell 2023-11-05T08:08:08.415 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.416 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-11-05T08:08:08.416 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.416 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/gawk.sh 2023-11-05T08:08:08.416 INFO:tasks.workunit.client.0.smithi052.stderr:+ sed 's/^/ api_watch_notify_pp: /' 2023-11-05T08:08:08.416 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.416 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-11-05T08:08:08.417 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.417 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/lang.sh 2023-11-05T08:08:08.417 INFO:tasks.workunit.client.0.smithi052.stderr:+++ unset LANG_backup 2023-11-05T08:08:08.417 INFO:tasks.workunit.client.0.smithi052.stderr:+++++ readlink /proc/91983/exe 2023-11-05T08:08:08.417 INFO:tasks.workunit.client.0.smithi052.stderr:+++ umask 2023-11-05T08:08:08.418 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' 0022 -eq 0 ']' 2023-11-05T08:08:08.418 INFO:tasks.workunit.client.0.smithi052.stderr:++ SHELL=/bin/bash 2023-11-05T08:08:08.418 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.418 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-11-05T08:08:08.418 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.418 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/bash_completion.sh 2023-11-05T08:08:08.419 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-11-05T08:08:08.419 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.419 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-11-05T08:08:08.419 INFO:tasks.workunit.client.0.smithi052.stderr:++++ basename /usr/bin/bash 2023-11-05T08:08:08.419 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.420 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/cobbler.sh 2023-11-05T08:08:08.420 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-11-05T08:08:08.420 INFO:tasks.workunit.client.0.smithi052.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-11-05T08:08:08.420 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.420 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-11-05T08:08:08.420 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.421 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorgrep.sh 2023-11-05T08:08:08.421 INFO:tasks.workunit.client.0.smithi052.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-05T08:08:08.421 INFO:tasks.workunit.client.0.smithi052.stderr:++++ /usr/bin/locale 2023-11-05T08:08:08.421 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-11-05T08:08:08.421 INFO:tasks.workunit.client.0.smithi052.stderr:+++ which_declare='declare -f' 2023-11-05T08:08:08.422 INFO:tasks.workunit.client.0.smithi052.stderr:+++ which_opt=-f 2023-11-05T08:08:08.422 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export which_declare 2023-11-05T08:08:08.422 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-11-05T08:08:08.422 INFO:tasks.workunit.client.0.smithi052.stderr:++ printf %25s api_c_write_operations 2023-11-05T08:08:08.422 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-11-05T08:08:08.423 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export -f which 2023-11-05T08:08:08.423 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.423 INFO:tasks.workunit.client.0.smithi052.stderr:++ unset i 2023-11-05T08:08:08.423 INFO:tasks.workunit.client.0.smithi052.stderr:++ unset -f pathmunge 2023-11-05T08:08:08.423 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-11-05T08:08:08.423 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.424 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/debuginfod.sh 2023-11-05T08:08:08.424 INFO:tasks.workunit.client.0.smithi052.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-11-05T08:08:08.424 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-11-05T08:08:08.424 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.424 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-11-05T08:08:08.425 INFO:tasks.workunit.client.0.smithi052.stderr:+ r=' api_c_write_operations' 2023-11-05T08:08:08.425 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.425 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/gawk.sh 2023-11-05T08:08:08.425 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.425 INFO:tasks.workunit.client.0.smithi052.stderr:+ export PATH 2023-11-05T08:08:08.426 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-11-05T08:08:08.426 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-11-05T08:08:08.426 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.426 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/lang.sh 2023-11-05T08:08:08.426 INFO:tasks.workunit.client.0.smithi052.stderr:+ unset rc 2023-11-05T08:08:08.427 INFO:tasks.workunit.client.0.smithi052.stderr:+++ unset LANG_backup 2023-11-05T08:08:08.427 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo api_c_write_operations 2023-11-05T08:08:08.427 INFO:tasks.workunit.client.0.smithi052.stderr:+ tee ceph_test_rados_api_cmd.log 2023-11-05T08:08:08.427 INFO:tasks.workunit.client.0.smithi052.stderr:++ awk '{print $1}' 2023-11-05T08:08:08.427 INFO:tasks.workunit.client.0.smithi052.stderr:+ ceph_test_rados_api_cmd 2023-11-05T08:08:08.427 INFO:tasks.workunit.client.0.smithi052.stderr:+ ff=api_c_write_operations 2023-11-05T08:08:08.428 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n '' ']' 2023-11-05T08:08:08.428 INFO:tasks.workunit.client.0.smithi052.stderr:+++ LANG_backup=en_US.UTF-8 2023-11-05T08:08:08.428 INFO:tasks.workunit.client.0.smithi052.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-05T08:08:08.428 INFO:tasks.workunit.client.0.smithi052.stderr:+ pid=92117 2023-11-05T08:08:08.429 INFO:tasks.workunit.client.0.smithi052.stdout: test api_c_write_operations on pid 92117 2023-11-05T08:08:08.440 INFO:tasks.workunit.client.0.smithi052.stderr:+ echo 'test api_c_write_operations on pid 92117' 2023-11-05T08:08:08.440 INFO:tasks.workunit.client.0.smithi052.stderr:+ pids[$f]=92117 2023-11-05T08:08:08.440 INFO:tasks.workunit.client.0.smithi052.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-11-05T08:08:08.441 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' 1 -eq 1 ']' 2023-11-05T08:08:08.441 INFO:tasks.workunit.client.0.smithi052.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_c_write_operations 2>&1 | tee ceph_test_rados_api_c_write_operations.log | sed "s/^/ api_c_write_operations: /"' 2023-11-05T08:08:08.441 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -f /etc/locale.conf ']' 2023-11-05T08:08:08.441 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -x /usr/bin/sed ']' 2023-11-05T08:08:08.441 INFO:tasks.workunit.client.0.smithi052.stderr:++ printf %25s api_c_read_operations 2023-11-05T08:08:08.442 INFO:tasks.workunit.client.0.smithi052.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-11-05T08:08:08.442 INFO:tasks.workunit.client.0.smithi052.stderr:+ r=' api_c_read_operations' 2023-11-05T08:08:08.442 INFO:tasks.workunit.client.0.smithi052.stderr:+ sed 's/^/ api_cmd: /' 2023-11-05T08:08:08.442 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'grep=grep --color=auto' 2023-11-05T08:08:08.442 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'egrep=egrep --color=auto' 2023-11-05T08:08:08.442 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-11-05T08:08:08.443 INFO:tasks.workunit.client.0.smithi052.stderr:++++ /usr/bin/locale 2023-11-05T08:08:08.443 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.443 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-11-05T08:08:08.443 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.443 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorls.sh 2023-11-05T08:08:08.444 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' '!' -t 0 ']' 2023-11-05T08:08:08.444 INFO:tasks.workunit.client.0.smithi052.stderr:+++ return 2023-11-05T08:08:08.444 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.444 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-11-05T08:08:08.444 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.445 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-11-05T08:08:08.445 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export S_COLORS=auto 2023-11-05T08:08:08.445 INFO:tasks.workunit.client.0.smithi052.stderr:+++ S_COLORS=auto 2023-11-05T08:08:08.445 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.445 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-11-05T08:08:08.445 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.446 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-11-05T08:08:08.446 INFO:tasks.workunit.client.0.smithi052.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-05T08:08:08.446 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n '' ']' 2023-11-05T08:08:08.446 INFO:tasks.workunit.client.0.smithi052.stderr:+++ LANG_backup=en_US.UTF-8 2023-11-05T08:08:08.446 INFO:tasks.workunit.client.0.smithi052.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-05T08:08:08.447 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -f /etc/locale.conf ']' 2023-11-05T08:08:08.447 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -x /usr/bin/sed ']' 2023-11-05T08:08:08.447 INFO:tasks.workunit.client.0.smithi052.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-11-05T08:08:08.447 INFO:tasks.workunit.client.0.smithi052.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-11-05T08:08:08.447 INFO:tasks.workunit.client.0.smithi052.stderr:++++ export LANG=en_US.UTF-8 2023-11-05T08:08:08.449 INFO:tasks.workunit.client.0.smithi052.stderr:++++ LANG=en_US.UTF-8 2023-11-05T08:08:08.449 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-11-05T08:08:08.449 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-11-05T08:08:08.450 INFO:tasks.workunit.client.0.smithi052.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-05T08:08:08.450 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-11-05T08:08:08.450 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-05T08:08:08.450 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-11-05T08:08:08.450 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.451 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-11-05T08:08:08.451 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.451 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-11-05T08:08:08.451 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-11-05T08:08:08.451 INFO:tasks.workunit.client.0.smithi052.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-05T08:08:08.452 INFO:tasks.workunit.client.0.smithi052.stderr:+++ LANG=en_US.UTF-8 2023-11-05T08:08:08.452 INFO:tasks.workunit.client.0.smithi052.stderr:+++ unset LANG_backup config 2023-11-05T08:08:08.452 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n '' ']' 2023-11-05T08:08:08.452 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-05T08:08:08.452 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' dumb = linux ']' 2023-11-05T08:08:08.453 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.453 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-11-05T08:08:08.453 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.453 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' -f /etc/bashrc ']' 2023-11-05T08:08:08.453 INFO:tasks.workunit.client.0.smithi052.stderr:+ . /etc/bashrc 2023-11-05T08:08:08.453 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/less.sh 2023-11-05T08:08:08.454 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-11-05T08:08:08.454 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -z '' ']' 2023-11-05T08:08:08.454 INFO:tasks.workunit.client.0.smithi052.stderr:++ BASHRCSOURCED=Y 2023-11-05T08:08:08.454 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.454 INFO:tasks.workunit.client.0.smithi052.stderr:++ shopt -q login_shell 2023-11-05T08:08:08.455 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.455 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-11-05T08:08:08.455 INFO:tasks.workunit.client.0.smithi052.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-11-05T08:08:08.455 INFO:tasks.workunit.client.0.smithi052.stderr:++++ export LANG=en_US.UTF-8 2023-11-05T08:08:08.455 INFO:tasks.workunit.client.0.smithi052.stderr:++++ LANG=en_US.UTF-8 2023-11-05T08:08:08.456 INFO:tasks.workunit.client.0.smithi052.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-05T08:08:08.456 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-11-05T08:08:08.456 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-05T08:08:08.456 INFO:tasks.workunit.client.0.smithi052.stderr:+++ LANG=en_US.UTF-8 2023-11-05T08:08:08.456 INFO:tasks.workunit.client.0.smithi052.stderr:+++ unset LANG_backup config 2023-11-05T08:08:08.457 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n '' ']' 2023-11-05T08:08:08.457 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.457 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/which2.sh 2023-11-05T08:08:08.457 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-05T08:08:08.457 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' dumb = linux ']' 2023-11-05T08:08:08.458 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.458 INFO:tasks.workunit.client.0.smithi052.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-11-05T08:08:08.458 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-11-05T08:08:08.458 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.458 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/less.sh 2023-11-05T08:08:08.459 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-11-05T08:08:08.459 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.459 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-11-05T08:08:08.459 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.459 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/which2.sh 2023-11-05T08:08:08.460 INFO:tasks.workunit.client.0.smithi052.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-11-05T08:08:08.460 INFO:tasks.workunit.client.0.smithi052.stderr:+++ umask 2023-11-05T08:08:08.460 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' 0022 -eq 0 ']' 2023-11-05T08:08:08.460 INFO:tasks.workunit.client.0.smithi052.stderr:++ SHELL=/bin/bash 2023-11-05T08:08:08.460 INFO:tasks.workunit.client.0.smithi052.stderr:+++++ readlink /proc/92026/exe 2023-11-05T08:08:08.460 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.461 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-11-05T08:08:08.461 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.461 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/bash_completion.sh 2023-11-05T08:08:08.461 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-11-05T08:08:08.461 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.462 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-11-05T08:08:08.462 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.462 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/cobbler.sh 2023-11-05T08:08:08.462 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-11-05T08:08:08.462 INFO:tasks.workunit.client.0.smithi052.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-11-05T08:08:08.462 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.463 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-11-05T08:08:08.463 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.463 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorgrep.sh 2023-11-05T08:08:08.463 INFO:tasks.workunit.client.0.smithi052.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-05T08:08:08.463 INFO:tasks.workunit.client.0.smithi052.stderr:++++ basename /usr/bin/bash 2023-11-05T08:08:08.464 INFO:tasks.workunit.client.0.smithi052.stderr:+++ which_declare='declare -f' 2023-11-05T08:08:08.464 INFO:tasks.workunit.client.0.smithi052.stderr:+++ which_opt=-f 2023-11-05T08:08:08.464 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export which_declare 2023-11-05T08:08:08.464 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export -f which 2023-11-05T08:08:08.464 INFO:tasks.workunit.client.0.smithi052.stderr:++ unset i 2023-11-05T08:08:08.464 INFO:tasks.workunit.client.0.smithi052.stderr:++ unset -f pathmunge 2023-11-05T08:08:08.465 INFO:tasks.workunit.client.0.smithi052.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-11-05T08:08:08.465 INFO:tasks.workunit.client.0.smithi052.stderr:+ export PATH 2023-11-05T08:08:08.465 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-11-05T08:08:08.465 INFO:tasks.workunit.client.0.smithi052.stderr:+ unset rc 2023-11-05T08:08:08.465 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-11-05T08:08:08.465 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-11-05T08:08:08.466 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-11-05T08:08:08.466 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.466 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-11-05T08:08:08.466 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.466 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/debuginfod.sh 2023-11-05T08:08:08.467 INFO:tasks.workunit.client.0.smithi052.stderr:+ ceph_test_rados_api_cmd_pp 2023-11-05T08:08:08.467 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-11-05T08:08:08.467 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.467 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-11-05T08:08:08.467 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.468 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/gawk.sh 2023-11-05T08:08:08.468 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.468 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-11-05T08:08:08.468 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.468 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/lang.sh 2023-11-05T08:08:08.468 INFO:tasks.workunit.client.0.smithi052.stderr:+++ unset LANG_backup 2023-11-05T08:08:08.469 INFO:tasks.workunit.client.0.smithi052.stderr:+ sed 's/^/ api_cmd_pp: /' 2023-11-05T08:08:08.469 INFO:tasks.workunit.client.0.smithi052.stderr:+ tee ceph_test_rados_api_cmd_pp.log 2023-11-05T08:08:08.469 INFO:tasks.workunit.client.0.smithi052.stderr:+++++ readlink /proc/92065/exe 2023-11-05T08:08:08.469 INFO:tasks.workunit.client.0.smithi052.stderr:++ awk '{print $1}' 2023-11-05T08:08:08.469 INFO:tasks.workunit.client.0.smithi052.stderr:++++ basename /usr/bin/bash 2023-11-05T08:08:08.470 INFO:tasks.workunit.client.0.smithi052.stderr:+++ which_declare='declare -f' 2023-11-05T08:08:08.470 INFO:tasks.workunit.client.0.smithi052.stderr:+++ which_opt=-f 2023-11-05T08:08:08.470 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export which_declare 2023-11-05T08:08:08.470 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export -f which 2023-11-05T08:08:08.470 INFO:tasks.workunit.client.0.smithi052.stderr:++ unset i 2023-11-05T08:08:08.471 INFO:tasks.workunit.client.0.smithi052.stderr:++ unset -f pathmunge 2023-11-05T08:08:08.471 INFO:tasks.workunit.client.0.smithi052.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-11-05T08:08:08.471 INFO:tasks.workunit.client.0.smithi052.stderr:+ export PATH 2023-11-05T08:08:08.471 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-11-05T08:08:08.471 INFO:tasks.workunit.client.0.smithi052.stderr:+ unset rc 2023-11-05T08:08:08.472 INFO:tasks.workunit.client.0.smithi052.stderr:+ ceph_test_rados_api_service 2023-11-05T08:08:08.472 INFO:tasks.workunit.client.0.smithi052.stderr:++++ /usr/bin/locale 2023-11-05T08:08:08.472 INFO:tasks.workunit.client.0.smithi052.stderr:+ sed 's/^/ api_service: /' 2023-11-05T08:08:08.472 INFO:tasks.workunit.client.0.smithi052.stderr:+ tee ceph_test_rados_api_service.log 2023-11-05T08:08:08.472 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo api_c_read_operations 2023-11-05T08:08:08.472 INFO:tasks.workunit.client.0.smithi052.stderr:+ ff=api_c_read_operations 2023-11-05T08:08:08.473 INFO:tasks.workunit.client.0.smithi052.stderr:+ pid=92160 2023-11-05T08:08:08.473 INFO:tasks.workunit.client.0.smithi052.stderr:+ echo 'test api_c_read_operations on pid 92160' 2023-11-05T08:08:08.473 INFO:tasks.workunit.client.0.smithi052.stdout:test api_c_read_operations on pid 92160 2023-11-05T08:08:08.482 INFO:tasks.workunit.client.0.smithi052.stderr:+ pids[$f]=92160 2023-11-05T08:08:08.482 INFO:tasks.workunit.client.0.smithi052.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-11-05T08:08:08.482 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' 1 -eq 1 ']' 2023-11-05T08:08:08.482 INFO:tasks.workunit.client.0.smithi052.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_c_read_operations 2>&1 | tee ceph_test_rados_api_c_read_operations.log | sed "s/^/ api_c_read_operations: /"' 2023-11-05T08:08:08.482 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' -f /etc/bashrc ']' 2023-11-05T08:08:08.483 INFO:tasks.workunit.client.0.smithi052.stderr:+ . /etc/bashrc 2023-11-05T08:08:08.483 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -z '' ']' 2023-11-05T08:08:08.483 INFO:tasks.workunit.client.0.smithi052.stderr:++ BASHRCSOURCED=Y 2023-11-05T08:08:08.483 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.483 INFO:tasks.workunit.client.0.smithi052.stderr:++ shopt -q login_shell 2023-11-05T08:08:08.484 INFO:tasks.workunit.client.0.smithi052.stderr:+++ umask 2023-11-05T08:08:08.484 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' 0022 -eq 0 ']' 2023-11-05T08:08:08.484 INFO:tasks.workunit.client.0.smithi052.stderr:++ SHELL=/bin/bash 2023-11-05T08:08:08.484 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.484 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-11-05T08:08:08.485 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.485 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/bash_completion.sh 2023-11-05T08:08:08.485 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n '' ']' 2023-11-05T08:08:08.485 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-11-05T08:08:08.485 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.485 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-11-05T08:08:08.486 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.486 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/cobbler.sh 2023-11-05T08:08:08.486 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-11-05T08:08:08.486 INFO:tasks.workunit.client.0.smithi052.stderr:+++ LANG_backup=en_US.UTF-8 2023-11-05T08:08:08.486 INFO:tasks.workunit.client.0.smithi052.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-11-05T08:08:08.487 INFO:tasks.workunit.client.0.smithi052.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-05T08:08:08.487 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.487 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-11-05T08:08:08.487 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.487 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorgrep.sh 2023-11-05T08:08:08.487 INFO:tasks.workunit.client.0.smithi052.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-05T08:08:08.488 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -f /etc/locale.conf ']' 2023-11-05T08:08:08.488 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -x /usr/bin/sed ']' 2023-11-05T08:08:08.488 INFO:tasks.workunit.client.0.smithi052.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-11-05T08:08:08.488 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'grep=grep --color=auto' 2023-11-05T08:08:08.488 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'egrep=egrep --color=auto' 2023-11-05T08:08:08.489 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-11-05T08:08:08.489 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.489 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-11-05T08:08:08.489 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.489 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorls.sh 2023-11-05T08:08:08.490 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' '!' -t 0 ']' 2023-11-05T08:08:08.490 INFO:tasks.workunit.client.0.smithi052.stderr:+++ return 2023-11-05T08:08:08.490 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.490 INFO:tasks.workunit.client.0.smithi052.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-11-05T08:08:08.490 INFO:tasks.workunit.client.0.smithi052.stderr:++++ export LANG=en_US.UTF-8 2023-11-05T08:08:08.490 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-11-05T08:08:08.491 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.491 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-11-05T08:08:08.491 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'grep=grep --color=auto' 2023-11-05T08:08:08.491 INFO:tasks.workunit.client.0.smithi052.stderr:++++ LANG=en_US.UTF-8 2023-11-05T08:08:08.491 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export S_COLORS=auto 2023-11-05T08:08:08.492 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'egrep=egrep --color=auto' 2023-11-05T08:08:08.492 INFO:tasks.workunit.client.0.smithi052.stderr:+++ S_COLORS=auto 2023-11-05T08:08:08.492 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.492 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-11-05T08:08:08.492 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-11-05T08:08:08.493 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.493 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-11-05T08:08:08.493 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.493 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-11-05T08:08:08.493 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.493 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorls.sh 2023-11-05T08:08:08.494 INFO:tasks.workunit.client.0.smithi052.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-05T08:08:08.494 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' '!' -t 0 ']' 2023-11-05T08:08:08.494 INFO:tasks.workunit.client.0.smithi052.stderr:+++ return 2023-11-05T08:08:08.494 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.494 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-11-05T08:08:08.495 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.495 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-11-05T08:08:08.495 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export S_COLORS=auto 2023-11-05T08:08:08.495 INFO:tasks.workunit.client.0.smithi052.stderr:+++ S_COLORS=auto 2023-11-05T08:08:08.495 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.495 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-11-05T08:08:08.496 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.496 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-11-05T08:08:08.496 INFO:tasks.workunit.client.0.smithi052.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-05T08:08:08.496 INFO:tasks.workunit.client.0.smithi052.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-05T08:08:08.496 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-11-05T08:08:08.496 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-05T08:08:08.497 INFO:tasks.workunit.client.0.smithi052.stderr:+++ LANG=en_US.UTF-8 2023-11-05T08:08:08.497 INFO:tasks.workunit.client.0.smithi052.stderr:+++ unset LANG_backup config 2023-11-05T08:08:08.497 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n '' ']' 2023-11-05T08:08:08.497 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-05T08:08:08.497 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' dumb = linux ']' 2023-11-05T08:08:08.498 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.498 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-11-05T08:08:08.498 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.498 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/less.sh 2023-11-05T08:08:08.498 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-11-05T08:08:08.499 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.499 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-11-05T08:08:08.499 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.499 INFO:tasks.workunit.client.0.smithi052.stderr:++ printf %25s api_cls_remote_reads 2023-11-05T08:08:08.499 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/which2.sh 2023-11-05T08:08:08.500 INFO:tasks.workunit.client.0.smithi052.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-11-05T08:08:08.500 INFO:tasks.workunit.client.0.smithi052.stderr:+ r=' api_cls_remote_reads' 2023-11-05T08:08:08.500 INFO:tasks.workunit.client.0.smithi052.stderr:+++++ readlink /proc/92095/exe 2023-11-05T08:08:08.500 INFO:tasks.workunit.client.0.smithi052.stderr:++ awk '{print $1}' 2023-11-05T08:08:08.500 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo api_cls_remote_reads 2023-11-05T08:08:08.500 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-11-05T08:08:08.501 INFO:tasks.workunit.client.0.smithi052.stderr:++++ basename /usr/bin/bash 2023-11-05T08:08:08.501 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-11-05T08:08:08.501 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-11-05T08:08:08.501 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.501 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-11-05T08:08:08.502 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.502 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-11-05T08:08:08.502 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-11-05T08:08:08.502 INFO:tasks.workunit.client.0.smithi052.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-05T08:08:08.502 INFO:tasks.workunit.client.0.smithi052.stderr:+ ff=api_cls_remote_reads 2023-11-05T08:08:08.502 INFO:tasks.workunit.client.0.smithi052.stderr:+ pid=92201 2023-11-05T08:08:08.503 INFO:tasks.workunit.client.0.smithi052.stderr:+ echo 'test api_cls_remote_reads on pid 92201' 2023-11-05T08:08:08.503 INFO:tasks.workunit.client.0.smithi052.stdout:test api_cls_remote_reads on pid 92201 2023-11-05T08:08:08.510 INFO:tasks.workunit.client.0.smithi052.stderr:+ pids[$f]=92201 2023-11-05T08:08:08.511 INFO:tasks.workunit.client.0.smithi052.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-11-05T08:08:08.511 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' 1 -eq 1 ']' 2023-11-05T08:08:08.511 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-11-05T08:08:08.511 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-11-05T08:08:08.511 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-11-05T08:08:08.512 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.512 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-11-05T08:08:08.512 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.512 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-11-05T08:08:08.512 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-11-05T08:08:08.513 INFO:tasks.workunit.client.0.smithi052.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-05T08:08:08.513 INFO:tasks.workunit.client.0.smithi052.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_cls_remote_reads 2>&1 | tee ceph_test_rados_api_cls_remote_reads.log | sed "s/^/ api_cls_remote_reads: /"' 2023-11-05T08:08:08.513 INFO:tasks.workunit.client.0.smithi052.stderr:++ printf %25s list_parallel 2023-11-05T08:08:08.513 INFO:tasks.workunit.client.0.smithi052.stderr:+ r=' list_parallel' 2023-11-05T08:08:08.513 INFO:tasks.workunit.client.0.smithi052.stderr:+++ which_declare='declare -f' 2023-11-05T08:08:08.514 INFO:tasks.workunit.client.0.smithi052.stderr:+++ which_opt=-f 2023-11-05T08:08:08.514 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export which_declare 2023-11-05T08:08:08.514 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export -f which 2023-11-05T08:08:08.514 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' -f /etc/bashrc ']' 2023-11-05T08:08:08.515 INFO:tasks.workunit.client.0.smithi052.stderr:++ unset i 2023-11-05T08:08:08.515 INFO:tasks.workunit.client.0.smithi052.stderr:++ unset -f pathmunge 2023-11-05T08:08:08.515 INFO:tasks.workunit.client.0.smithi052.stderr:+ . /etc/bashrc 2023-11-05T08:08:08.515 INFO:tasks.workunit.client.0.smithi052.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-11-05T08:08:08.516 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo list_parallel 2023-11-05T08:08:08.516 INFO:tasks.workunit.client.0.smithi052.stderr:+ export PATH 2023-11-05T08:08:08.516 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-11-05T08:08:08.516 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -z '' ']' 2023-11-05T08:08:08.516 INFO:tasks.workunit.client.0.smithi052.stderr:++ BASHRCSOURCED=Y 2023-11-05T08:08:08.517 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.517 INFO:tasks.workunit.client.0.smithi052.stderr:++ shopt -q login_shell 2023-11-05T08:08:08.517 INFO:tasks.workunit.client.0.smithi052.stderr:++ awk '{print $1}' 2023-11-05T08:08:08.517 INFO:tasks.workunit.client.0.smithi052.stderr:+ unset rc 2023-11-05T08:08:08.517 INFO:tasks.workunit.client.0.smithi052.stderr:+ tee ceph_test_rados_api_service_pp.log 2023-11-05T08:08:08.518 INFO:tasks.workunit.client.0.smithi052.stderr:+++ umask 2023-11-05T08:08:08.518 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-11-05T08:08:08.518 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-11-05T08:08:08.518 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' 0022 -eq 0 ']' 2023-11-05T08:08:08.518 INFO:tasks.workunit.client.0.smithi052.stderr:++ SHELL=/bin/bash 2023-11-05T08:08:08.518 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-11-05T08:08:08.519 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.519 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-11-05T08:08:08.519 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.519 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/bash_completion.sh 2023-11-05T08:08:08.519 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.520 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-11-05T08:08:08.520 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-11-05T08:08:08.520 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.520 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/debuginfod.sh 2023-11-05T08:08:08.520 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.520 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-11-05T08:08:08.521 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.521 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-11-05T08:08:08.521 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.521 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/gawk.sh 2023-11-05T08:08:08.521 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-11-05T08:08:08.522 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.522 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/cobbler.sh 2023-11-05T08:08:08.522 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.522 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-11-05T08:08:08.522 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.523 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/lang.sh 2023-11-05T08:08:08.523 INFO:tasks.workunit.client.0.smithi052.stderr:+++ unset LANG_backup 2023-11-05T08:08:08.523 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-11-05T08:08:08.523 INFO:tasks.workunit.client.0.smithi052.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-11-05T08:08:08.523 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.523 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-11-05T08:08:08.524 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.524 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorgrep.sh 2023-11-05T08:08:08.524 INFO:tasks.workunit.client.0.smithi052.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-05T08:08:08.524 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-11-05T08:08:08.524 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-11-05T08:08:08.525 INFO:tasks.workunit.client.0.smithi052.stderr:+ ceph_test_rados_api_service_pp 2023-11-05T08:08:08.525 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-11-05T08:08:08.525 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.525 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-11-05T08:08:08.525 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.525 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/debuginfod.sh 2023-11-05T08:08:08.526 INFO:tasks.workunit.client.0.smithi052.stderr:+ sed 's/^/ api_service_pp: /' 2023-11-05T08:08:08.526 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-11-05T08:08:08.526 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.526 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-11-05T08:08:08.526 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.527 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/gawk.sh 2023-11-05T08:08:08.527 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.527 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-11-05T08:08:08.527 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.527 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/lang.sh 2023-11-05T08:08:08.528 INFO:tasks.workunit.client.0.smithi052.stderr:+++ unset LANG_backup 2023-11-05T08:08:08.528 INFO:tasks.workunit.client.0.smithi052.stderr:+ ff=list_parallel 2023-11-05T08:08:08.528 INFO:tasks.workunit.client.0.smithi052.stderr:++++ /usr/bin/locale 2023-11-05T08:08:08.528 INFO:tasks.workunit.client.0.smithi052.stderr:+ pid=92221 2023-11-05T08:08:08.528 INFO:tasks.workunit.client.0.smithi052.stderr:+ echo 'test list_parallel on pid 92221' 2023-11-05T08:08:08.529 INFO:tasks.workunit.client.0.smithi052.stdout:test list_parallel on pid 92221 2023-11-05T08:08:08.529 INFO:tasks.workunit.client.0.smithi052.stderr:+ pids[$f]=92221 2023-11-05T08:08:08.530 INFO:tasks.workunit.client.0.smithi052.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-11-05T08:08:08.530 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' 1 -eq 1 ']' 2023-11-05T08:08:08.530 INFO:tasks.workunit.client.0.smithi052.stderr:++++ /usr/bin/locale 2023-11-05T08:08:08.530 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.936+0000 7faaea734640 1 --2- 172.21.15.52:0/3032579076 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5599fa9cf3d0 0x5599faa8cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:08:08.531 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.937+0000 7faaea734640 10 monclient: _finish_hunting 0 2023-11-05T08:08:08.531 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.937+0000 7faaea734640 1 monclient: found mon.noname-b 2023-11-05T08:08:08.531 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.937+0000 7faaea734640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:08:08.531 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.937+0000 7faaea734640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.156:3300/0 2023-11-05T08:08:08.531 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.937+0000 7faaea734640 1 -- 172.21.15.52:0/3032579076 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faad4009510 con 0x5599faa06c70 2023-11-05T08:08:08.531 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.974+0000 7faaea734640 1 --2- 172.21.15.52:0/3032579076 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5599faa06c70 0x5599faa92100 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7faad4000c00 tx=0x7faad4003020 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:08:08.532 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.974+0000 7faad3fff640 10 client.?.objecter ms_handle_connect 0x5599faa06c70 2023-11-05T08:08:08.532 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.974+0000 7faad3fff640 10 client.?.objecter resend_mon_ops 2023-11-05T08:08:08.532 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.993+0000 7faad3fff640 1 -- 172.21.15.52:0/3032579076 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad400f040 con 0x5599faa06c70 2023-11-05T08:08:08.532 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.993+0000 7faad3fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:08:08.532 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.993+0000 7faad3fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-05T08:08:08.533 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.993+0000 7faad3fff640 10 monclient: dump: 2023-11-05T08:08:08.533 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: epoch 1 2023-11-05T08:08:08.533 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:08:08.533 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:08:08.533 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:08:08.533 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: min_mon_release 18 (reef) 2023-11-05T08:08:08.534 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: election_strategy: 1 2023-11-05T08:08:08.534 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:08:08.534 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:08:08.534 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:08:08.534 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:08.535 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.993+0000 7faad3fff640 10 monclient: _finish_auth 0 2023-11-05T08:08:08.535 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.993+0000 7faad3fff640 10 monclient: _check_auth_tickets 2023-11-05T08:08:08.535 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.993+0000 7faad3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:08:08.535 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.993+0000 7faad3fff640 1 -- 172.21.15.52:0/3032579076 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faad4021070 con 0x5599faa06c70 2023-11-05T08:08:08.535 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.993+0000 7faad3fff640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:08:08.536 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.993+0000 7faad3fff640 1 -- 172.21.15.52:0/3032579076 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad4026890 con 0x5599faa06c70 2023-11-05T08:08:08.536 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.993+0000 7faad3fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:08:08.536 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.993+0000 7faad3fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-05T08:08:08.536 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.993+0000 7faad3fff640 10 monclient: dump: 2023-11-05T08:08:08.536 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: epoch 1 2023-11-05T08:08:08.536 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:08:08.546 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n '' ']' 2023-11-05T08:08:08.547 INFO:tasks.workunit.client.0.smithi052.stderr:+++ LANG_backup=en_US.UTF-8 2023-11-05T08:08:08.547 INFO:tasks.workunit.client.0.smithi052.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-05T08:08:08.547 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -f /etc/locale.conf ']' 2023-11-05T08:08:08.547 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -x /usr/bin/sed ']' 2023-11-05T08:08:08.547 INFO:tasks.workunit.client.0.smithi052.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-11-05T08:08:08.548 INFO:tasks.workunit.client.0.smithi052.stderr:++ printf %25s open_pools_parallel 2023-11-05T08:08:08.548 INFO:tasks.workunit.client.0.smithi052.stderr:+ r=' open_pools_parallel' 2023-11-05T08:08:08.548 INFO:tasks.workunit.client.0.smithi052.stderr:+ bash -o pipefail -exc 'ceph_test_rados_list_parallel 2>&1 | tee ceph_test_rados_list_parallel.log | sed "s/^/ list_parallel: /"' 2023-11-05T08:08:08.548 INFO:tasks.workunit.client.0.smithi052.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-11-05T08:08:08.548 INFO:tasks.workunit.client.0.smithi052.stderr:++++ export LANG=en_US.UTF-8 2023-11-05T08:08:08.548 INFO:tasks.workunit.client.0.smithi052.stderr:++++ LANG=en_US.UTF-8 2023-11-05T08:08:08.549 INFO:tasks.workunit.client.0.smithi052.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-05T08:08:08.549 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-11-05T08:08:08.549 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-05T08:08:08.549 INFO:tasks.workunit.client.0.smithi052.stderr:+++ LANG=en_US.UTF-8 2023-11-05T08:08:08.549 INFO:tasks.workunit.client.0.smithi052.stderr:+++ unset LANG_backup config 2023-11-05T08:08:08.550 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n '' ']' 2023-11-05T08:08:08.550 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo open_pools_parallel 2023-11-05T08:08:08.550 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-05T08:08:08.550 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' dumb = linux ']' 2023-11-05T08:08:08.550 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.550 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-11-05T08:08:08.551 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.551 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/less.sh 2023-11-05T08:08:08.551 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-11-05T08:08:08.551 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.551 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-11-05T08:08:08.552 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.552 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/which2.sh 2023-11-05T08:08:08.552 INFO:tasks.workunit.client.0.smithi052.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-11-05T08:08:08.552 INFO:tasks.workunit.client.0.smithi052.stderr:+++++ readlink /proc/92160/exe 2023-11-05T08:08:08.552 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n '' ']' 2023-11-05T08:08:08.553 INFO:tasks.workunit.client.0.smithi052.stderr:+++ LANG_backup=en_US.UTF-8 2023-11-05T08:08:08.553 INFO:tasks.workunit.client.0.smithi052.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-05T08:08:08.553 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -f /etc/locale.conf ']' 2023-11-05T08:08:08.553 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -x /usr/bin/sed ']' 2023-11-05T08:08:08.553 INFO:tasks.workunit.client.0.smithi052.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-11-05T08:08:08.553 INFO:tasks.workunit.client.0.smithi052.stderr:++++ basename /usr/bin/bash 2023-11-05T08:08:08.554 INFO:tasks.workunit.client.0.smithi052.stderr:+++ which_declare='declare -f' 2023-11-05T08:08:08.554 INFO:tasks.workunit.client.0.smithi052.stderr:+++ which_opt=-f 2023-11-05T08:08:08.554 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'grep=grep --color=auto' 2023-11-05T08:08:08.554 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'egrep=egrep --color=auto' 2023-11-05T08:08:08.554 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-11-05T08:08:08.555 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.555 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-11-05T08:08:08.555 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.555 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorls.sh 2023-11-05T08:08:08.555 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' -f /etc/bashrc ']' 2023-11-05T08:08:08.556 INFO:tasks.workunit.client.0.smithi052.stderr:+ . /etc/bashrc 2023-11-05T08:08:08.556 INFO:tasks.workunit.client.0.smithi052.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-11-05T08:08:08.556 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' '!' -t 0 ']' 2023-11-05T08:08:08.556 INFO:tasks.workunit.client.0.smithi052.stderr:+++ return 2023-11-05T08:08:08.556 INFO:tasks.workunit.client.0.smithi052.stderr:++++ export LANG=en_US.UTF-8 2023-11-05T08:08:08.556 INFO:tasks.workunit.client.0.smithi052.stderr:++++ LANG=en_US.UTF-8 2023-11-05T08:08:08.557 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.557 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-11-05T08:08:08.557 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.557 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-11-05T08:08:08.557 INFO:tasks.workunit.client.0.smithi052.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-05T08:08:08.558 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-11-05T08:08:08.558 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export S_COLORS=auto 2023-11-05T08:08:08.558 INFO:tasks.workunit.client.0.smithi052.stderr:+++ S_COLORS=auto 2023-11-05T08:08:08.558 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-05T08:08:08.559 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.559 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-11-05T08:08:08.559 INFO:tasks.workunit.client.0.smithi052.stderr:+++ LANG=en_US.UTF-8 2023-11-05T08:08:08.559 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -z '' ']' 2023-11-05T08:08:08.559 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.559 INFO:tasks.workunit.client.0.smithi052.stderr:++ BASHRCSOURCED=Y 2023-11-05T08:08:08.560 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-11-05T08:08:08.560 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.560 INFO:tasks.workunit.client.0.smithi052.stderr:+++ unset LANG_backup config 2023-11-05T08:08:08.560 INFO:tasks.workunit.client.0.smithi052.stderr:++ shopt -q login_shell 2023-11-05T08:08:08.560 INFO:tasks.workunit.client.0.smithi052.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-05T08:08:08.561 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n '' ']' 2023-11-05T08:08:08.561 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export which_declare 2023-11-05T08:08:08.561 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-05T08:08:08.561 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export -f which 2023-11-05T08:08:08.561 INFO:tasks.workunit.client.0.smithi052.stderr:++ unset i 2023-11-05T08:08:08.561 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' dumb = linux ']' 2023-11-05T08:08:08.562 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.562 INFO:tasks.workunit.client.0.smithi052.stderr:++ unset -f pathmunge 2023-11-05T08:08:08.562 INFO:tasks.workunit.client.0.smithi052.stderr:++ awk '{print $1}' 2023-11-05T08:08:08.562 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-11-05T08:08:08.562 INFO:tasks.workunit.client.0.smithi052.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-11-05T08:08:08.563 INFO:tasks.workunit.client.0.smithi052.stderr:+++ umask 2023-11-05T08:08:08.563 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.563 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/less.sh 2023-11-05T08:08:08.563 INFO:tasks.workunit.client.0.smithi052.stderr:+ export PATH 2023-11-05T08:08:08.563 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-11-05T08:08:08.564 INFO:tasks.workunit.client.0.smithi052.stderr:+ unset rc 2023-11-05T08:08:08.564 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' 0022 -eq 0 ']' 2023-11-05T08:08:08.564 INFO:tasks.workunit.client.0.smithi052.stderr:++ SHELL=/bin/bash 2023-11-05T08:08:08.564 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.564 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-11-05T08:08:08.565 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.565 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-11-05T08:08:08.565 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.565 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-11-05T08:08:08.565 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.566 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/which2.sh 2023-11-05T08:08:08.566 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/bash_completion.sh 2023-11-05T08:08:08.566 INFO:tasks.workunit.client.0.smithi052.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-11-05T08:08:08.566 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-11-05T08:08:08.566 INFO:tasks.workunit.client.0.smithi052.stderr:+ sed 's/^/ api_c_read_operations: /' 2023-11-05T08:08:08.567 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.567 INFO:tasks.workunit.client.0.smithi052.stderr:+ tee ceph_test_rados_api_c_read_operations.log 2023-11-05T08:08:08.567 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-11-05T08:08:08.567 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.567 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/cobbler.sh 2023-11-05T08:08:08.568 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-11-05T08:08:08.568 INFO:tasks.workunit.client.0.smithi052.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-11-05T08:08:08.568 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.568 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-11-05T08:08:08.568 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.568 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorgrep.sh 2023-11-05T08:08:08.569 INFO:tasks.workunit.client.0.smithi052.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-05T08:08:08.569 INFO:tasks.workunit.client.0.smithi052.stderr:+++++ readlink /proc/92117/exe 2023-11-05T08:08:08.569 INFO:tasks.workunit.client.0.smithi052.stderr:+ ceph_test_rados_api_c_read_operations 2023-11-05T08:08:08.569 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-11-05T08:08:08.569 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-11-05T08:08:08.570 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-11-05T08:08:08.570 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.570 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-11-05T08:08:08.570 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.570 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-11-05T08:08:08.570 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-11-05T08:08:08.571 INFO:tasks.workunit.client.0.smithi052.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-05T08:08:08.571 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'grep=grep --color=auto' 2023-11-05T08:08:08.571 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'egrep=egrep --color=auto' 2023-11-05T08:08:08.571 INFO:tasks.workunit.client.0.smithi052.stderr:+ ff=open_pools_parallel 2023-11-05T08:08:08.571 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-11-05T08:08:08.572 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.572 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-11-05T08:08:08.572 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.572 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorls.sh 2023-11-05T08:08:08.572 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' '!' -t 0 ']' 2023-11-05T08:08:08.573 INFO:tasks.workunit.client.0.smithi052.stderr:+++ return 2023-11-05T08:08:08.573 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.573 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-11-05T08:08:08.573 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.573 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-11-05T08:08:08.574 INFO:tasks.workunit.client.0.smithi052.stderr:+ pid=92253 2023-11-05T08:08:08.574 INFO:tasks.workunit.client.0.smithi052.stdout: test open_pools_parallel on pid 92253 2023-11-05T08:08:08.579 INFO:tasks.workunit.client.0.smithi052.stderr:+ echo 'test open_pools_parallel on pid 92253' 2023-11-05T08:08:08.579 INFO:tasks.workunit.client.0.smithi052.stderr:+ pids[$f]=92253 2023-11-05T08:08:08.579 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export S_COLORS=auto 2023-11-05T08:08:08.579 INFO:tasks.workunit.client.0.smithi052.stderr:+++ S_COLORS=auto 2023-11-05T08:08:08.580 INFO:tasks.workunit.client.0.smithi052.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-11-05T08:08:08.580 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.580 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-11-05T08:08:08.580 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' 1 -eq 1 ']' 2023-11-05T08:08:08.580 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.581 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-11-05T08:08:08.581 INFO:tasks.workunit.client.0.smithi052.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-05T08:08:08.581 INFO:tasks.workunit.client.0.smithi052.stderr:+ bash -o pipefail -exc 'ceph_test_rados_open_pools_parallel 2>&1 | tee ceph_test_rados_open_pools_parallel.log | sed "s/^/ open_pools_parallel: /"' 2023-11-05T08:08:08.581 INFO:tasks.workunit.client.0.smithi052.stderr:++++ basename /usr/bin/bash 2023-11-05T08:08:08.581 INFO:tasks.workunit.client.0.smithi052.stderr:+++ which_declare='declare -f' 2023-11-05T08:08:08.582 INFO:tasks.workunit.client.0.smithi052.stderr:+++ which_opt=-f 2023-11-05T08:08:08.582 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export which_declare 2023-11-05T08:08:08.582 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export -f which 2023-11-05T08:08:08.582 INFO:tasks.workunit.client.0.smithi052.stderr:++ unset i 2023-11-05T08:08:08.582 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' -f /etc/bashrc ']' 2023-11-05T08:08:08.582 INFO:tasks.workunit.client.0.smithi052.stderr:+ . /etc/bashrc 2023-11-05T08:08:08.583 INFO:tasks.workunit.client.0.smithi052.stderr:++ unset -f pathmunge 2023-11-05T08:08:08.583 INFO:tasks.workunit.client.0.smithi052.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-11-05T08:08:08.583 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -z '' ']' 2023-11-05T08:08:08.583 INFO:tasks.workunit.client.0.smithi052.stderr:++ BASHRCSOURCED=Y 2023-11-05T08:08:08.583 INFO:tasks.workunit.client.0.smithi052.stderr:+ export PATH 2023-11-05T08:08:08.584 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-11-05T08:08:08.584 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.584 INFO:tasks.workunit.client.0.smithi052.stderr:++ shopt -q login_shell 2023-11-05T08:08:08.584 INFO:tasks.workunit.client.0.smithi052.stderr:+ unset rc 2023-11-05T08:08:08.584 INFO:tasks.workunit.client.0.smithi052.stderr:+++ umask 2023-11-05T08:08:08.585 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' 0022 -eq 0 ']' 2023-11-05T08:08:08.585 INFO:tasks.workunit.client.0.smithi052.stderr:++ SHELL=/bin/bash 2023-11-05T08:08:08.585 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.585 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-11-05T08:08:08.585 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.585 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/bash_completion.sh 2023-11-05T08:08:08.586 INFO:tasks.workunit.client.0.smithi052.stderr:++ printf %25s delete_pools_parallel 2023-11-05T08:08:08.586 INFO:tasks.workunit.client.0.smithi052.stderr:+ r=' delete_pools_parallel' 2023-11-05T08:08:08.586 INFO:tasks.workunit.client.0.smithi052.stderr:+ tee ceph_test_rados_api_c_write_operations.log 2023-11-05T08:08:08.586 INFO:tasks.workunit.client.0.smithi052.stderr:+ ceph_test_rados_api_c_write_operations 2023-11-05T08:08:08.586 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-11-05T08:08:08.587 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-11-05T08:08:08.587 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-11-05T08:08:08.587 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-11-05T08:08:08.587 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.587 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-11-05T08:08:08.587 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.588 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.588 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-11-05T08:08:08.588 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-11-05T08:08:08.588 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.588 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/cobbler.sh 2023-11-05T08:08:08.589 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-11-05T08:08:08.589 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-11-05T08:08:08.589 INFO:tasks.workunit.client.0.smithi052.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-11-05T08:08:08.589 INFO:tasks.workunit.client.0.smithi052.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-05T08:08:08.589 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.590 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-11-05T08:08:08.590 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.590 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorgrep.sh 2023-11-05T08:08:08.590 INFO:tasks.workunit.client.0.smithi052.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-05T08:08:08.590 INFO:tasks.workunit.client.0.smithi052.stderr:+ sed 's/^/ api_c_write_operations: /' 2023-11-05T08:08:08.590 INFO:tasks.workunit.client.0.smithi052.stderr:++ awk '{print $1}' 2023-11-05T08:08:08.591 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo delete_pools_parallel 2023-11-05T08:08:08.591 INFO:tasks.workunit.client.0.smithi052.stderr:+ ff=delete_pools_parallel 2023-11-05T08:08:08.591 INFO:tasks.workunit.client.0.smithi052.stderr:+ pid=92273 2023-11-05T08:08:08.591 INFO:tasks.workunit.client.0.smithi052.stderr:+ echo 'test delete_pools_parallel on pid 92273' 2023-11-05T08:08:08.591 INFO:tasks.workunit.client.0.smithi052.stderr:+ bash -o pipefail -exc 'ceph_test_rados_delete_pools_parallel 2>&1 | tee ceph_test_rados_delete_pools_parallel.log | sed "s/^/ delete_pools_parallel: /"' 2023-11-05T08:08:08.592 INFO:tasks.workunit.client.0.smithi052.stdout:test delete_pools_parallel on pid 92273 2023-11-05T08:08:08.617 INFO:tasks.workunit.client.0.smithi052.stderr:+ pids[$f]=92273 2023-11-05T08:08:08.617 INFO:tasks.workunit.client.0.smithi052.stderr:+ ret=0 2023-11-05T08:08:08.617 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' 1 -eq 1 ']' 2023-11-05T08:08:08.617 INFO:tasks.workunit.client.0.smithi052.stderr:+ for t in "${!pids[@]}" 2023-11-05T08:08:08.618 INFO:tasks.workunit.client.0.smithi052.stderr:+ pid=91712 2023-11-05T08:08:08.618 INFO:tasks.workunit.client.0.smithi052.stderr:+ wait 91712 2023-11-05T08:08:08.618 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' -f /etc/bashrc ']' 2023-11-05T08:08:08.618 INFO:tasks.workunit.client.0.smithi052.stderr:+ . /etc/bashrc 2023-11-05T08:08:08.618 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -z '' ']' 2023-11-05T08:08:08.619 INFO:tasks.workunit.client.0.smithi052.stderr:++ BASHRCSOURCED=Y 2023-11-05T08:08:08.619 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.619 INFO:tasks.workunit.client.0.smithi052.stderr:++ shopt -q login_shell 2023-11-05T08:08:08.619 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-11-05T08:08:08.619 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-11-05T08:08:08.620 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-11-05T08:08:08.620 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.620 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-11-05T08:08:08.620 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.620 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/debuginfod.sh 2023-11-05T08:08:08.621 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-11-05T08:08:08.621 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.621 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-11-05T08:08:08.621 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.621 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/gawk.sh 2023-11-05T08:08:08.621 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.622 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-11-05T08:08:08.622 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.622 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/lang.sh 2023-11-05T08:08:08.622 INFO:tasks.workunit.client.0.smithi052.stderr:+++ unset LANG_backup 2023-11-05T08:08:08.623 INFO:tasks.workunit.client.0.smithi052.stderr:+++ umask 2023-11-05T08:08:08.623 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' 0022 -eq 0 ']' 2023-11-05T08:08:08.623 INFO:tasks.workunit.client.0.smithi052.stderr:++ SHELL=/bin/bash 2023-11-05T08:08:08.623 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.623 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-11-05T08:08:08.623 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.624 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/bash_completion.sh 2023-11-05T08:08:08.624 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'grep=grep --color=auto' 2023-11-05T08:08:08.624 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'egrep=egrep --color=auto' 2023-11-05T08:08:08.624 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-11-05T08:08:08.624 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.625 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-11-05T08:08:08.625 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.625 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorls.sh 2023-11-05T08:08:08.625 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' '!' -t 0 ']' 2023-11-05T08:08:08.625 INFO:tasks.workunit.client.0.smithi052.stderr:+++ return 2023-11-05T08:08:08.626 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.626 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-11-05T08:08:08.626 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.626 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-11-05T08:08:08.626 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export S_COLORS=auto 2023-11-05T08:08:08.627 INFO:tasks.workunit.client.0.smithi052.stderr:+++ S_COLORS=auto 2023-11-05T08:08:08.627 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.627 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-11-05T08:08:08.627 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.627 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-11-05T08:08:08.628 INFO:tasks.workunit.client.0.smithi052.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-05T08:08:08.628 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-11-05T08:08:08.628 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.628 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-11-05T08:08:08.628 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.629 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/cobbler.sh 2023-11-05T08:08:08.629 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-11-05T08:08:08.629 INFO:tasks.workunit.client.0.smithi052.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-11-05T08:08:08.629 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.629 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-11-05T08:08:08.630 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.630 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorgrep.sh 2023-11-05T08:08:08.630 INFO:tasks.workunit.client.0.smithi052.stderr:++++ /usr/bin/locale 2023-11-05T08:08:08.630 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-11-05T08:08:08.630 INFO:tasks.workunit.client.0.smithi052.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-05T08:08:08.630 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-11-05T08:08:08.631 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-11-05T08:08:08.631 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.631 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-11-05T08:08:08.631 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.631 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/debuginfod.sh 2023-11-05T08:08:08.631 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-11-05T08:08:08.632 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.632 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-11-05T08:08:08.632 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.632 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/gawk.sh 2023-11-05T08:08:08.632 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.633 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-11-05T08:08:08.633 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.633 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/lang.sh 2023-11-05T08:08:08.633 INFO:tasks.workunit.client.0.smithi052.stderr:+++ unset LANG_backup 2023-11-05T08:08:08.633 INFO:tasks.workunit.client.0.smithi052.stderr:++++ /usr/bin/locale 2023-11-05T08:08:08.633 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n '' ']' 2023-11-05T08:08:08.634 INFO:tasks.workunit.client.0.smithi052.stderr:+++ LANG_backup=en_US.UTF-8 2023-11-05T08:08:08.634 INFO:tasks.workunit.client.0.smithi052.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-05T08:08:08.634 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -f /etc/locale.conf ']' 2023-11-05T08:08:08.634 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -x /usr/bin/sed ']' 2023-11-05T08:08:08.634 INFO:tasks.workunit.client.0.smithi052.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-11-05T08:08:08.635 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n '' ']' 2023-11-05T08:08:08.635 INFO:tasks.workunit.client.0.smithi052.stderr:+++ LANG_backup=en_US.UTF-8 2023-11-05T08:08:08.635 INFO:tasks.workunit.client.0.smithi052.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-05T08:08:08.635 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -f /etc/locale.conf ']' 2023-11-05T08:08:08.635 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -x /usr/bin/sed ']' 2023-11-05T08:08:08.636 INFO:tasks.workunit.client.0.smithi052.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-11-05T08:08:08.636 INFO:tasks.workunit.client.0.smithi052.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-11-05T08:08:08.636 INFO:tasks.workunit.client.0.smithi052.stderr:++++ export LANG=en_US.UTF-8 2023-11-05T08:08:08.636 INFO:tasks.workunit.client.0.smithi052.stderr:++++ LANG=en_US.UTF-8 2023-11-05T08:08:08.636 INFO:tasks.workunit.client.0.smithi052.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-05T08:08:08.637 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-11-05T08:08:08.637 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-05T08:08:08.637 INFO:tasks.workunit.client.0.smithi052.stderr:+++ LANG=en_US.UTF-8 2023-11-05T08:08:08.637 INFO:tasks.workunit.client.0.smithi052.stderr:+++ unset LANG_backup config 2023-11-05T08:08:08.637 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n '' ']' 2023-11-05T08:08:08.638 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-05T08:08:08.638 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' dumb = linux ']' 2023-11-05T08:08:08.638 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.638 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-11-05T08:08:08.638 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.639 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/less.sh 2023-11-05T08:08:08.639 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-11-05T08:08:08.639 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-11-05T08:08:08.639 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-11-05T08:08:08.639 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.640 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-11-05T08:08:08.640 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.640 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/which2.sh 2023-11-05T08:08:08.640 INFO:tasks.workunit.client.0.smithi052.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-11-05T08:08:08.640 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-11-05T08:08:08.641 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.641 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-11-05T08:08:08.641 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.641 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-11-05T08:08:08.641 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-11-05T08:08:08.641 INFO:tasks.workunit.client.0.smithi052.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-05T08:08:08.642 INFO:tasks.workunit.client.0.smithi052.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-11-05T08:08:08.642 INFO:tasks.workunit.client.0.smithi052.stderr:++++ export LANG=en_US.UTF-8 2023-11-05T08:08:08.642 INFO:tasks.workunit.client.0.smithi052.stderr:++++ LANG=en_US.UTF-8 2023-11-05T08:08:08.642 INFO:tasks.workunit.client.0.smithi052.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-05T08:08:08.642 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-11-05T08:08:08.643 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-05T08:08:08.643 INFO:tasks.workunit.client.0.smithi052.stderr:+++ LANG=en_US.UTF-8 2023-11-05T08:08:08.643 INFO:tasks.workunit.client.0.smithi052.stderr:+++ unset LANG_backup config 2023-11-05T08:08:08.643 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n '' ']' 2023-11-05T08:08:08.643 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-05T08:08:08.644 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' dumb = linux ']' 2023-11-05T08:08:08.644 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.644 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-11-05T08:08:08.644 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.644 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/less.sh 2023-11-05T08:08:08.645 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-11-05T08:08:08.645 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.645 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-11-05T08:08:08.645 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.645 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/which2.sh 2023-11-05T08:08:08.645 INFO:tasks.workunit.client.0.smithi052.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-11-05T08:08:08.646 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'grep=grep --color=auto' 2023-11-05T08:08:08.646 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'egrep=egrep --color=auto' 2023-11-05T08:08:08.646 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-11-05T08:08:08.646 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.646 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-11-05T08:08:08.647 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.647 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorls.sh 2023-11-05T08:08:08.647 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' '!' -t 0 ']' 2023-11-05T08:08:08.647 INFO:tasks.workunit.client.0.smithi052.stderr:+++ return 2023-11-05T08:08:08.647 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.648 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-11-05T08:08:08.648 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.648 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-11-05T08:08:08.648 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export S_COLORS=auto 2023-11-05T08:08:08.648 INFO:tasks.workunit.client.0.smithi052.stderr:+++ S_COLORS=auto 2023-11-05T08:08:08.648 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.649 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-11-05T08:08:08.649 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.649 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-11-05T08:08:08.649 INFO:tasks.workunit.client.0.smithi052.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-05T08:08:08.649 INFO:tasks.workunit.client.0.smithi052.stderr:+++++ readlink /proc/92221/exe 2023-11-05T08:08:08.650 INFO:tasks.workunit.client.0.smithi052.stderr:+++++ readlink /proc/92201/exe 2023-11-05T08:08:08.650 INFO:tasks.workunit.client.0.smithi052.stderr:++++ basename /usr/bin/bash 2023-11-05T08:08:08.650 INFO:tasks.workunit.client.0.smithi052.stderr:+++ which_declare='declare -f' 2023-11-05T08:08:08.650 INFO:tasks.workunit.client.0.smithi052.stderr:+++ which_opt=-f 2023-11-05T08:08:08.650 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export which_declare 2023-11-05T08:08:08.650 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-11-05T08:08:08.651 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export -f which 2023-11-05T08:08:08.651 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-11-05T08:08:08.651 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-11-05T08:08:08.651 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.651 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-11-05T08:08:08.652 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.652 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/debuginfod.sh 2023-11-05T08:08:08.652 INFO:tasks.workunit.client.0.smithi052.stderr:++ unset i 2023-11-05T08:08:08.652 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-11-05T08:08:08.652 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.653 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-11-05T08:08:08.653 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.653 INFO:tasks.workunit.client.0.smithi052.stderr:++ unset -f pathmunge 2023-11-05T08:08:08.653 INFO:tasks.workunit.client.0.smithi052.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-11-05T08:08:08.653 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/gawk.sh 2023-11-05T08:08:08.653 INFO:tasks.workunit.client.0.smithi052.stderr:++++ basename /usr/bin/bash 2023-11-05T08:08:08.654 INFO:tasks.workunit.client.0.smithi052.stderr:+ export PATH 2023-11-05T08:08:08.654 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.654 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-11-05T08:08:08.654 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.654 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/lang.sh 2023-11-05T08:08:08.655 INFO:tasks.workunit.client.0.smithi052.stderr:+++ unset LANG_backup 2023-11-05T08:08:08.655 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-11-05T08:08:08.655 INFO:tasks.workunit.client.0.smithi052.stderr:+ unset rc 2023-11-05T08:08:08.655 INFO:tasks.workunit.client.0.smithi052.stderr:+ tee ceph_test_rados_list_parallel.log 2023-11-05T08:08:08.655 INFO:tasks.workunit.client.0.smithi052.stderr:+++ which_declare='declare -f' 2023-11-05T08:08:08.656 INFO:tasks.workunit.client.0.smithi052.stderr:+++ which_opt=-f 2023-11-05T08:08:08.656 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export which_declare 2023-11-05T08:08:08.656 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export -f which 2023-11-05T08:08:08.656 INFO:tasks.workunit.client.0.smithi052.stderr:++ unset i 2023-11-05T08:08:08.656 INFO:tasks.workunit.client.0.smithi052.stderr:++ unset -f pathmunge 2023-11-05T08:08:08.656 INFO:tasks.workunit.client.0.smithi052.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-11-05T08:08:08.657 INFO:tasks.workunit.client.0.smithi052.stderr:+ export PATH 2023-11-05T08:08:08.657 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-11-05T08:08:08.657 INFO:tasks.workunit.client.0.smithi052.stderr:+ unset rc 2023-11-05T08:08:08.657 INFO:tasks.workunit.client.0.smithi052.stderr:+ sed 's/^/ list_parallel: /' 2023-11-05T08:08:08.657 INFO:tasks.workunit.client.0.smithi052.stderr:++++ /usr/bin/locale 2023-11-05T08:08:08.658 INFO:tasks.workunit.client.0.smithi052.stderr:+ ceph_test_rados_list_parallel 2023-11-05T08:08:08.658 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n '' ']' 2023-11-05T08:08:08.658 INFO:tasks.workunit.client.0.smithi052.stderr:+++ LANG_backup=en_US.UTF-8 2023-11-05T08:08:08.658 INFO:tasks.workunit.client.0.smithi052.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-05T08:08:08.658 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -f /etc/locale.conf ']' 2023-11-05T08:08:08.659 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -x /usr/bin/sed ']' 2023-11-05T08:08:08.659 INFO:tasks.workunit.client.0.smithi052.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-11-05T08:08:08.659 INFO:tasks.workunit.client.0.smithi052.stderr:+ ceph_test_rados_api_cls_remote_reads 2023-11-05T08:08:08.659 INFO:tasks.workunit.client.0.smithi052.stderr:+ sed 's/^/ api_cls_remote_reads: /' 2023-11-05T08:08:08.659 INFO:tasks.workunit.client.0.smithi052.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-11-05T08:08:08.660 INFO:tasks.workunit.client.0.smithi052.stderr:++++ export LANG=en_US.UTF-8 2023-11-05T08:08:08.660 INFO:tasks.workunit.client.0.smithi052.stderr:++++ LANG=en_US.UTF-8 2023-11-05T08:08:08.660 INFO:tasks.workunit.client.0.smithi052.stderr:+ tee ceph_test_rados_api_cls_remote_reads.log 2023-11-05T08:08:08.660 INFO:tasks.workunit.client.0.smithi052.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-05T08:08:08.660 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-11-05T08:08:08.660 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-05T08:08:08.661 INFO:tasks.workunit.client.0.smithi052.stderr:+++ LANG=en_US.UTF-8 2023-11-05T08:08:08.661 INFO:tasks.workunit.client.0.smithi052.stderr:+++ unset LANG_backup config 2023-11-05T08:08:08.661 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n '' ']' 2023-11-05T08:08:08.661 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-05T08:08:08.661 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' dumb = linux ']' 2023-11-05T08:08:08.662 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.662 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-11-05T08:08:08.662 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.662 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/less.sh 2023-11-05T08:08:08.662 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-11-05T08:08:08.663 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.663 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-11-05T08:08:08.663 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.663 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/which2.sh 2023-11-05T08:08:08.663 INFO:tasks.workunit.client.0.smithi052.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-11-05T08:08:08.663 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-11-05T08:08:08.664 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-11-05T08:08:08.664 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-11-05T08:08:08.664 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.664 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-11-05T08:08:08.664 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.665 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-11-05T08:08:08.665 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-11-05T08:08:08.665 INFO:tasks.workunit.client.0.smithi052.stderr:+++ /usr/libexec/grepconf.sh -c 2023-11-05T08:08:08.665 INFO:tasks.workunit.client.0.smithi052.stderr:+++++ readlink /proc/92253/exe 2023-11-05T08:08:08.665 INFO:tasks.workunit.client.0.smithi052.stderr:++++ basename /usr/bin/bash 2023-11-05T08:08:08.665 INFO:tasks.workunit.client.0.smithi052.stderr:+++ which_declare='declare -f' 2023-11-05T08:08:08.666 INFO:tasks.workunit.client.0.smithi052.stderr:+++ which_opt=-f 2023-11-05T08:08:08.666 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export which_declare 2023-11-05T08:08:08.666 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export -f which 2023-11-05T08:08:08.666 INFO:tasks.workunit.client.0.smithi052.stderr:++ unset i 2023-11-05T08:08:08.666 INFO:tasks.workunit.client.0.smithi052.stderr:++ unset -f pathmunge 2023-11-05T08:08:08.667 INFO:tasks.workunit.client.0.smithi052.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-11-05T08:08:08.667 INFO:tasks.workunit.client.0.smithi052.stderr:+ export PATH 2023-11-05T08:08:08.667 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-11-05T08:08:08.667 INFO:tasks.workunit.client.0.smithi052.stderr:+ unset rc 2023-11-05T08:08:08.667 INFO:tasks.workunit.client.0.smithi052.stderr:+ tee ceph_test_rados_open_pools_parallel.log 2023-11-05T08:08:08.668 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-11-05T08:08:08.668 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-11-05T08:08:08.668 INFO:tasks.workunit.client.0.smithi052.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-11-05T08:08:08.668 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.668 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-11-05T08:08:08.668 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.669 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/debuginfod.sh 2023-11-05T08:08:08.669 INFO:tasks.workunit.client.0.smithi052.stderr:+ ceph_test_rados_open_pools_parallel 2023-11-05T08:08:08.669 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-11-05T08:08:08.669 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.669 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-11-05T08:08:08.670 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.670 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/gawk.sh 2023-11-05T08:08:08.670 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.670 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-11-05T08:08:08.670 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.671 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/lang.sh 2023-11-05T08:08:08.671 INFO:tasks.workunit.client.0.smithi052.stderr:+++ unset LANG_backup 2023-11-05T08:08:08.671 INFO:tasks.workunit.client.0.smithi052.stderr:++++ /usr/bin/locale 2023-11-05T08:08:08.671 INFO:tasks.workunit.client.0.smithi052.stderr:+ sed 's/^/ open_pools_parallel: /' 2023-11-05T08:08:08.671 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n '' ']' 2023-11-05T08:08:08.671 INFO:tasks.workunit.client.0.smithi052.stderr:+++ LANG_backup=en_US.UTF-8 2023-11-05T08:08:08.672 INFO:tasks.workunit.client.0.smithi052.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-05T08:08:08.672 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -f /etc/locale.conf ']' 2023-11-05T08:08:08.672 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -x /usr/bin/sed ']' 2023-11-05T08:08:08.672 INFO:tasks.workunit.client.0.smithi052.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-11-05T08:08:08.672 INFO:tasks.workunit.client.0.smithi052.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-11-05T08:08:08.672 INFO:tasks.workunit.client.0.smithi052.stderr:++++ export LANG=en_US.UTF-8 2023-11-05T08:08:08.673 INFO:tasks.workunit.client.0.smithi052.stderr:++++ LANG=en_US.UTF-8 2023-11-05T08:08:08.673 INFO:tasks.workunit.client.0.smithi052.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-11-05T08:08:08.673 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-11-05T08:08:08.673 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-05T08:08:08.673 INFO:tasks.workunit.client.0.smithi052.stderr:+++ LANG=en_US.UTF-8 2023-11-05T08:08:08.674 INFO:tasks.workunit.client.0.smithi052.stderr:+++ unset LANG_backup config 2023-11-05T08:08:08.674 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n '' ']' 2023-11-05T08:08:08.674 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-11-05T08:08:08.674 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' dumb = linux ']' 2023-11-05T08:08:08.674 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.675 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-11-05T08:08:08.675 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.675 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/less.sh 2023-11-05T08:08:08.675 INFO:tasks.workunit.client.0.smithi052.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-11-05T08:08:08.675 INFO:tasks.workunit.client.0.smithi052.stderr:++ for i in /etc/profile.d/*.sh 2023-11-05T08:08:08.675 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-11-05T08:08:08.676 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' ']' 2023-11-05T08:08:08.676 INFO:tasks.workunit.client.0.smithi052.stderr:++ . /etc/profile.d/which2.sh 2023-11-05T08:08:08.676 INFO:tasks.workunit.client.0.smithi052.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-11-05T08:08:08.676 INFO:tasks.workunit.client.0.smithi052.stderr:+++++ readlink /proc/92273/exe 2023-11-05T08:08:08.676 INFO:tasks.workunit.client.0.smithi052.stderr:++++ basename /usr/bin/bash 2023-11-05T08:08:08.677 INFO:tasks.workunit.client.0.smithi052.stderr:+++ which_declare='declare -f' 2023-11-05T08:08:08.677 INFO:tasks.workunit.client.0.smithi052.stderr:+++ which_opt=-f 2023-11-05T08:08:08.677 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export which_declare 2023-11-05T08:08:08.677 INFO:tasks.workunit.client.0.smithi052.stderr:+++ export -f which 2023-11-05T08:08:08.677 INFO:tasks.workunit.client.0.smithi052.stderr:++ unset i 2023-11-05T08:08:08.677 INFO:tasks.workunit.client.0.smithi052.stderr:++ unset -f pathmunge 2023-11-05T08:08:08.678 INFO:tasks.workunit.client.0.smithi052.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-11-05T08:08:08.678 INFO:tasks.workunit.client.0.smithi052.stderr:+ export PATH 2023-11-05T08:08:08.678 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-11-05T08:08:08.678 INFO:tasks.workunit.client.0.smithi052.stderr:+ unset rc 2023-11-05T08:08:08.678 INFO:tasks.workunit.client.0.smithi052.stderr:+ ceph_test_rados_delete_pools_parallel 2023-11-05T08:08:08.679 INFO:tasks.workunit.client.0.smithi052.stderr:+ sed 's/^/ delete_pools_parallel: /' 2023-11-05T08:08:08.679 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:08:08.679 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:08:08.679 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: min_mon_release 18 (reef) 2023-11-05T08:08:08.680 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: election_strategy: 1 2023-11-05T08:08:08.680 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:08:08.680 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:08:08.680 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:08:08.680 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:08.681 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.993+0000 7faaedc46780 5 monclient: authenticate success, global_id 4459 2023-11-05T08:08:08.681 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.993+0000 7faaedc46780 10 monclient: _renew_subs 2023-11-05T08:08:08.681 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.993+0000 7faaedc46780 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:08:08.681 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.993+0000 7faaedc46780 1 -- 172.21.15.52:0/3032579076 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5599fa935770 con 0x5599faa06c70 2023-11-05T08:08:08.681 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.993+0000 7faae9732640 4 set_mon_vals no callback set 2023-11-05T08:08:08.682 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.993+0000 7faaedc46780 10 client.4459.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-05T08:08:08.682 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.993+0000 7faaedc46780 10 monclient: _renew_subs 2023-11-05T08:08:08.682 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.993+0000 7faaedc46780 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:08:08.682 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.993+0000 7faaedc46780 1 -- 172.21.15.52:0/3032579076 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5599fa928920 con 0x5599faa06c70 2023-11-05T08:08:08.682 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.993+0000 7faaedc46780 1 librados: init done 2023-11-05T08:08:08.683 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:07.993+0000 7faaedc46780 10 librados: wait_for_osdmap waiting 2023-11-05T08:08:08.683 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:08.072+0000 7faad3fff640 1 -- 172.21.15.52:0/3032579076 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7faad4023030 con 0x5599faa06c70 2023-11-05T08:08:08.683 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:08.072+0000 7faad3fff640 1 --2- 172.21.15.52:0/3032579076 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7faacc06aa70 0x7faacc06cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:08:08.683 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:08.073+0000 7faaeaf35640 1 --2- 172.21.15.52:0/3032579076 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7faacc06aa70 0x7faacc06cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:08:08.683 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:08.073+0000 7faaeaf35640 10 monclient: get_auth_request con 0x7faacc06aa70 auth_method 0 2023-11-05T08:08:08.684 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:08.073+0000 7faaeaf35640 1 --2- 172.21.15.52:0/3032579076 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7faacc06aa70 0x7faacc06cf30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7faae0003f70 tx=0x7faae0003500 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:08:08.684 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:08.073+0000 7faad3fff640 10 client.4459.objecter ms_handle_connect 0x7faacc06aa70 2023-11-05T08:08:08.684 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:08.075+0000 7faad3fff640 1 -- 172.21.15.52:0/3032579076 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5210+0+0 (secure 0 0 0) 0x7faad4058ff0 con 0x5599faa06c70 2023-11-05T08:08:08.684 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:08.075+0000 7faad3fff640 10 client.4459.objecter ms_dispatch 0x5599fa95fee0 osd_map(23..23 src has 1..23) v4 2023-11-05T08:08:08.684 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:08.075+0000 7faad3fff640 3 client.4459.objecter handle_osd_map got epochs [23,23] > 0 2023-11-05T08:08:08.685 INFO:tasks.workunit.client.0.smithi052.stderr:+ tee ceph_test_rados_delete_pools_parallel.log 2023-11-05T08:08:09.336 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:08.075+0000 7faad3fff640 3 client.4459.objecter handle_osd_map decoding full epoch 23 2023-11-05T08:08:09.336 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:08.075+0000 7faad3fff640 20 client.4459.objecter dump_active .. 0 homeless 2023-11-05T08:08:09.336 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:08.075+0000 7faaedc46780 10 librados: wait_for_osdmap done waiting 2023-11-05T08:08:09.337 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:08.075+0000 7faaedc46780 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:08:09.337 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:08.075+0000 7faaedc46780 1 -- 172.21.15.52:0/3032579076 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x5599fa9872c0 con 0x5599faa06c70 2023-11-05T08:08:09.337 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:08.250+0000 7faad3fff640 1 -- 172.21.15.52:0/3032579076 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7faad4054c30 con 0x5599faa06c70 2023-11-05T08:08:09.337 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:08.250+0000 7faad3fff640 10 monclient: handle_get_version_reply finishing 1 version 23 2023-11-05T08:08:09.337 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:08.250+0000 7faae8f31640 10 client.4459.objecter _get_latest_version latest 23, have it 2023-11-05T08:08:09.338 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:08.250+0000 7faaedc46780 10 client.4459.objecter create_pool name=ceph_test_rados_api_asio 2023-11-05T08:08:09.338 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:08.250+0000 7faaedc46780 10 client.4459.objecter pool_op_submit 1 2023-11-05T08:08:09.338 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:08.250+0000 7faaedc46780 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:08:09.338 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:08.250+0000 7faaedc46780 1 -- 172.21.15.52:0/3032579076 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- pool_op(create pool 0 tid 1 name ceph_test_rados_api_asio v0) v4 -- 0x5599fa998260 con 0x5599faa06c70 2023-11-05T08:08:09.338 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:09.258+0000 7faad3fff640 1 -- 172.21.15.52:0/3032579076 <== mon.1 v2:172.21.15.156:3300/0 7 ==== pool_op_reply(tid 1 (0) Success v24) v1 ==== 43+0+0 (secure 0 0 0) 0x7faad40586c0 con 0x5599faa06c70 2023-11-05T08:08:09.339 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:09.258+0000 7faad3fff640 10 client.4459.objecter ms_dispatch 0x5599fa95fee0 pool_op_reply(tid 1 (0) Success v24) v1 2023-11-05T08:08:09.339 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:09.258+0000 7faad3fff640 10 client.4459.objecter handle_pool_op_reply pool_op_reply(tid 1 (0) Success v24) v1 2023-11-05T08:08:09.339 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:09.258+0000 7faad3fff640 10 client.4459.objecter have request 1 at 0x5599faa918e0 Op: create 2023-11-05T08:08:09.339 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:09.258+0000 7faad3fff640 20 client.4459.objecter waiting for client to reach epoch 24 before calling back 2023-11-05T08:08:09.339 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:09.258+0000 7faad3fff640 10 client.4459.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-05T08:08:09.340 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:09.258+0000 7faad3fff640 10 monclient: _renew_subs 2023-11-05T08:08:09.340 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:09.258+0000 7faad3fff640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:08:09.340 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:09.258+0000 7faad3fff640 1 -- 172.21.15.52:0/3032579076 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=24}) v3 -- 0x7faacc0707b0 con 0x5599faa06c70 2023-11-05T08:08:09.340 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:09.258+0000 7faad3fff640 10 client.4459.objecter done 2023-11-05T08:08:09.340 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:09.335+0000 7faad3fff640 1 -- 172.21.15.52:0/3032579076 <== mon.1 v2:172.21.15.156:3300/0 8 ==== osd_map(24..24 src has 1..24) v4 ==== 5471+0+0 (secure 0 0 0) 0x7faad40588f0 con 0x5599faa06c70 2023-11-05T08:08:09.341 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:09.335+0000 7faad3fff640 10 client.4459.objecter ms_dispatch 0x5599fa95fee0 osd_map(24..24 src has 1..24) v4 2023-11-05T08:08:09.341 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:09.335+0000 7faad3fff640 3 client.4459.objecter handle_osd_map got epochs [24,24] > 23 2023-11-05T08:08:09.341 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:09.335+0000 7faad3fff640 3 client.4459.objecter handle_osd_map decoding incremental epoch 24 2023-11-05T08:08:11.906 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:09.335+0000 7faad3fff640 20 client.4459.objecter dump_active .. 0 homeless 2023-11-05T08:08:11.907 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:09.335+0000 7faaedc46780 10 librados: set snap read head -> 1 2023-11-05T08:08:11.907 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:09.335+0000 7faaedc46780 10 librados: writefull oid=exist nspace= 2023-11-05T08:08:11.907 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:09.335+0000 7faaedc46780 10 client.4459.objecter _op_submit op 0x5599faa059f0 2023-11-05T08:08:11.908 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:09.335+0000 7faaedc46780 20 client.4459.objecter _calc_target epoch 24 base exist @12 precalc_pgid 0 pgid 0.0 is_write 2023-11-05T08:08:11.908 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:09.335+0000 7faaedc46780 20 client.4459.objecter _calc_target target exist @12 -> pgid 12.d3a59201 2023-11-05T08:08:11.908 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:09.335+0000 7faaedc46780 10 client.4459.objecter _calc_target raw pgid 12.d3a59201 -> actual 12.1 acting [1,6] primary 1 2023-11-05T08:08:11.909 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:09.335+0000 7faaedc46780 1 --2- 172.21.15.52:0/3032579076 >> [v2:172.21.15.52:6824/544646809,v1:172.21.15.52:6825/544646809] conn(0x5599fab4cc70 0x5599fab4f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:08:11.909 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:09.335+0000 7faaedc46780 20 client.4459.objecter _get_session s=0x5599fa94cf80 osd=1 3 2023-11-05T08:08:11.909 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:09.335+0000 7faaedc46780 10 client.4459.objecter _op_submit oid exist '@12' '@12' [writefull 0~5 in=5b] tid 2 osd.1 2023-11-05T08:08:11.909 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:09.335+0000 7faaedc46780 20 client.4459.objecter get_session s=0x5599fa94cf80 osd=1 3 2023-11-05T08:08:11.909 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:09.335+0000 7faaedc46780 15 client.4459.objecter _session_op_assign 1 2 2023-11-05T08:08:11.910 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:09.335+0000 7faaedc46780 15 client.4459.objecter _send_op 2 to 12.1 on osd.1 2023-11-05T08:08:11.910 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:09.335+0000 7faaedc46780 1 -- 172.21.15.52:0/3032579076 --> [v2:172.21.15.52:6824/544646809,v1:172.21.15.52:6825/544646809] -- osd_op(unknown.0.0:2 12.1 12:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24) v8 -- 0x5599fab4f5a0 con 0x5599fab4cc70 2023-11-05T08:08:11.910 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:09.335+0000 7faaedc46780 20 client.4459.objecter put_session s=0x5599fa94cf80 osd=1 4 2023-11-05T08:08:11.911 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:09.335+0000 7faaedc46780 5 client.4459.objecter 1 in flight 2023-11-05T08:08:11.911 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:09.389+0000 7faaeb736640 1 --2- 172.21.15.52:0/3032579076 >> [v2:172.21.15.52:6824/544646809,v1:172.21.15.52:6825/544646809] conn(0x5599fab4cc70 0x5599fab4f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:08:11.912 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:09.391+0000 7faaeb736640 10 monclient: get_auth_request con 0x5599fab4cc70 auth_method 0 2023-11-05T08:08:11.912 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:09.394+0000 7faad3fff640 10 client.4459.objecter ms_handle_connect 0x5599fab4cc70 2023-11-05T08:08:11.912 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:09.394+0000 7faaeb736640 1 --2- 172.21.15.52:0/3032579076 >> [v2:172.21.15.52:6824/544646809,v1:172.21.15.52:6825/544646809] conn(0x5599fab4cc70 0x5599fab4f060 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:08:11.913 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:10.906+0000 7faad2ffd640 10 monclient: tick 2023-11-05T08:08:11.913 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:10.906+0000 7faad2ffd640 10 monclient: _check_auth_tickets 2023-11-05T08:08:11.913 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:10.906+0000 7faad2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:08:11.914 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:10.906+0000 7faad2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:08:11.914 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:11.906+0000 7faad2ffd640 10 monclient: tick 2023-11-05T08:08:11.914 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:11.906+0000 7faad2ffd640 10 monclient: _check_auth_tickets 2023-11-05T08:08:18.600 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:11.906+0000 7faad2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:08:18.601 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:12.906+0000 7faad2ffd640 10 monclient: tick 2023-11-05T08:08:18.601 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:12.906+0000 7faad2ffd640 10 monclient: _check_auth_tickets 2023-11-05T08:08:18.601 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:12.906+0000 7faad2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:08:18.601 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:12.994+0000 7faaed199640 10 client.4459.objecter tick 2023-11-05T08:08:18.602 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:13.906+0000 7faad2ffd640 10 monclient: tick 2023-11-05T08:08:18.602 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:13.906+0000 7faad2ffd640 10 monclient: _check_auth_tickets 2023-11-05T08:08:18.602 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:13.906+0000 7faad2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:08:18.602 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:14.906+0000 7faad2ffd640 10 monclient: tick 2023-11-05T08:08:18.603 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:14.906+0000 7faad2ffd640 10 monclient: _check_auth_tickets 2023-11-05T08:08:18.603 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:14.906+0000 7faad2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:08:18.603 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:15.906+0000 7faad2ffd640 10 monclient: tick 2023-11-05T08:08:18.603 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:15.906+0000 7faad2ffd640 10 monclient: _check_auth_tickets 2023-11-05T08:08:18.603 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:15.906+0000 7faad2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:08:18.603 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:16.906+0000 7faad2ffd640 10 monclient: tick 2023-11-05T08:08:18.604 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:16.906+0000 7faad2ffd640 10 monclient: _check_auth_tickets 2023-11-05T08:08:18.604 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:16.906+0000 7faad2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:08:18.604 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:17.906+0000 7faad2ffd640 10 monclient: tick 2023-11-05T08:08:18.604 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:17.906+0000 7faad2ffd640 10 monclient: _check_auth_tickets 2023-11-05T08:08:18.604 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:17.906+0000 7faad2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:08:18.605 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:17.995+0000 7faaed199640 10 client.4459.objecter tick 2023-11-05T08:08:18.605 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:18.600+0000 7faad3fff640 1 -- 172.21.15.52:0/3032579076 <== osd.1 v2:172.21.15.52:6824/544646809 1 ==== osd_map(25..27 src has 1..27) v4 ==== 15044+0+0 (crc 0 0 0) 0x7faadc04acb0 con 0x5599fab4cc70 2023-11-05T08:08:18.605 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:18.600+0000 7faad3fff640 10 client.4459.objecter ms_dispatch 0x5599fa95fee0 osd_map(25..27 src has 1..27) v4 2023-11-05T08:08:18.605 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:18.600+0000 7faad3fff640 3 client.4459.objecter handle_osd_map got epochs [25,27] > 24 2023-11-05T08:08:18.605 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:18.600+0000 7faad3fff640 3 client.4459.objecter handle_osd_map decoding incremental epoch 25 2023-11-05T08:08:18.605 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:18.600+0000 7faad3fff640 10 client.4459.objecter checking op 2 2023-11-05T08:08:18.606 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:18.600+0000 7faad3fff640 20 client.4459.objecter _calc_target epoch 25 base exist @12 precalc_pgid 0 pgid 0.0 is_write 2023-11-05T08:08:18.606 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:18.600+0000 7faad3fff640 20 client.4459.objecter _calc_target target exist @12 -> pgid 12.d3a59201 2023-11-05T08:08:18.606 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:18.600+0000 7faad3fff640 3 client.4459.objecter handle_osd_map decoding incremental epoch 26 2023-11-05T08:08:18.606 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:18.600+0000 7faad3fff640 10 client.4459.objecter checking op 2 2023-11-05T08:08:18.606 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:18.600+0000 7faad3fff640 20 client.4459.objecter _calc_target epoch 26 base exist @12 precalc_pgid 0 pgid 0.0 is_write 2023-11-05T08:08:18.607 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:18.600+0000 7faad3fff640 20 client.4459.objecter _calc_target target exist @12 -> pgid 12.d3a59201 2023-11-05T08:08:18.607 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:18.600+0000 7faad3fff640 3 client.4459.objecter handle_osd_map decoding incremental epoch 27 2023-11-05T08:08:18.607 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:18.600+0000 7faad3fff640 10 client.4459.objecter checking op 2 2023-11-05T08:08:21.530 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:18.600+0000 7faad3fff640 20 client.4459.objecter _calc_target epoch 27 base exist @12 precalc_pgid 0 pgid 0.0 is_write 2023-11-05T08:08:21.531 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:18.600+0000 7faad3fff640 20 client.4459.objecter _calc_target target exist @12 -> pgid 12.d3a59201 2023-11-05T08:08:21.531 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:18.600+0000 7faad3fff640 20 client.4459.objecter dump_active .. 0 homeless 2023-11-05T08:08:21.531 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:18.600+0000 7faad3fff640 20 client.4459.objecter 2 12.d3a59201 osd.1 exist [writefull 0~5 in=5b] 2023-11-05T08:08:21.531 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:18.907+0000 7faad2ffd640 10 monclient: tick 2023-11-05T08:08:21.531 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:18.907+0000 7faad2ffd640 10 monclient: _check_auth_tickets 2023-11-05T08:08:21.532 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:18.907+0000 7faad2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:08:21.532 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:19.907+0000 7faad2ffd640 10 monclient: tick 2023-11-05T08:08:21.532 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:19.907+0000 7faad2ffd640 10 monclient: _check_auth_tickets 2023-11-05T08:08:21.532 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:19.907+0000 7faad2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:08:21.532 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:20.907+0000 7faad2ffd640 10 monclient: tick 2023-11-05T08:08:21.533 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:20.907+0000 7faad2ffd640 10 monclient: _check_auth_tickets 2023-11-05T08:08:21.533 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:20.907+0000 7faad2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:08:21.533 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:20.907+0000 7faad2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:08:21.533 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:21.530+0000 7faaeb736640 1 -- 172.21.15.52:0/3032579076 <== osd.1 v2:172.21.15.52:6824/544646809 2 ==== osd_op_reply(2 exist [writefull 0~5] v27'1 uv1 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7faadc04f070 con 0x5599fab4cc70 2023-11-05T08:08:21.533 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:21.530+0000 7faaeb736640 10 client.4459.objecter ms_dispatch 0x5599fa95fee0 osd_op_reply(2 exist [writefull 0~5] v27'1 uv1 ondisk = 0) v8 2023-11-05T08:08:21.534 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:21.530+0000 7faaeb736640 10 client.4459.objecter in handle_osd_op_reply 2023-11-05T08:08:21.534 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: [ RUN ] AsioRados.AsyncReadCallback 2023-11-05T08:08:21.534 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:21.530+0000 7faaeb736640 7 client.4459.objecter handle_osd_op_reply 2 ondisk uv 1 in 12.1 attempt 0 2023-11-05T08:08:21.534 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:21.530+0000 7faaeb736640 10 client.4459.objecter op 0 rval 0 len 0 2023-11-05T08:08:21.534 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:21.530+0000 7faaeb736640 15 client.4459.objecter handle_osd_op_reply completed tid 2 2023-11-05T08:08:21.534 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:21.530+0000 7faaeb736640 15 client.4459.objecter _finish_op 2 2023-11-05T08:08:21.535 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:21.530+0000 7faaeb736640 20 client.4459.objecter put_session s=0x5599fa94cf80 osd=1 4 2023-11-05T08:08:21.535 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:21.530+0000 7faaeb736640 15 client.4459.objecter _session_op_remove 1 2 2023-11-05T08:08:21.535 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:21.530+0000 7faaeb736640 5 client.4459.objecter 0 in flight 2023-11-05T08:08:21.535 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:21.530+0000 7faaedc46780 10 librados: Objecter returned from writefull r=0 2023-11-05T08:08:21.535 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:21.530+0000 7faaedc46780 10 client.4459.objecter _op_submit op 0x5599faa059f0 2023-11-05T08:08:21.536 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:21.530+0000 7faaedc46780 20 client.4459.objecter _calc_target epoch 27 base exist @12 precalc_pgid 0 pgid 0.0 is_read 2023-11-05T08:08:21.536 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:21.530+0000 7faaedc46780 20 client.4459.objecter _calc_target target exist @12 -> pgid 12.d3a59201 2023-11-05T08:08:21.536 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:21.530+0000 7faaedc46780 10 client.4459.objecter _calc_target raw pgid 12.d3a59201 -> actual 12.1 acting [1,6] primary 1 2023-11-05T08:08:21.536 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:21.530+0000 7faaedc46780 20 client.4459.objecter _get_session s=0x5599fa94cf80 osd=1 3 2023-11-05T08:08:21.536 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:21.530+0000 7faaedc46780 10 client.4459.objecter _op_submit oid exist '@12' '@12' [read 0~256] tid 3 osd.1 2023-11-05T08:08:24.908 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:21.530+0000 7faaedc46780 20 client.4459.objecter get_session s=0x5599fa94cf80 osd=1 3 2023-11-05T08:08:24.908 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:21.530+0000 7faaedc46780 15 client.4459.objecter _session_op_assign 1 3 2023-11-05T08:08:24.908 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:21.530+0000 7faaedc46780 15 client.4459.objecter _send_op 3 to 12.1 on osd.1 2023-11-05T08:08:24.908 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:21.530+0000 7faaedc46780 1 -- 172.21.15.52:0/3032579076 --> [v2:172.21.15.52:6824/544646809,v1:172.21.15.52:6825/544646809] -- osd_op(unknown.0.0:3 12.1 12:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5599faaa0620 con 0x5599fab4cc70 2023-11-05T08:08:24.909 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:21.530+0000 7faaedc46780 20 client.4459.objecter put_session s=0x5599fa94cf80 osd=1 4 2023-11-05T08:08:24.909 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:21.530+0000 7faaedc46780 5 client.4459.objecter 1 in flight 2023-11-05T08:08:24.909 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:21.530+0000 7faaedc46780 10 client.4459.objecter _op_submit op 0x5599faaa0980 2023-11-05T08:08:24.909 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:21.530+0000 7faaedc46780 20 client.4459.objecter _calc_target epoch 27 base noexist @12 precalc_pgid 0 pgid 0.0 is_read 2023-11-05T08:08:24.909 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:21.530+0000 7faaedc46780 20 client.4459.objecter _calc_target target noexist @12 -> pgid 12.a7bbaa1 2023-11-05T08:08:24.910 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:21.530+0000 7faaedc46780 10 client.4459.objecter _calc_target raw pgid 12.a7bbaa1 -> actual 12.1 acting [1,6] primary 1 2023-11-05T08:08:24.910 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:21.530+0000 7faaedc46780 20 client.4459.objecter _get_session s=0x5599fa94cf80 osd=1 4 2023-11-05T08:08:24.910 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:21.530+0000 7faaedc46780 10 client.4459.objecter _op_submit oid noexist '@12' '@12' [read 0~256] tid 4 osd.1 2023-11-05T08:08:24.910 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:21.530+0000 7faaedc46780 20 client.4459.objecter get_session s=0x5599fa94cf80 osd=1 4 2023-11-05T08:08:24.910 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:21.530+0000 7faaedc46780 15 client.4459.objecter _session_op_assign 1 4 2023-11-05T08:08:24.911 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:21.530+0000 7faaedc46780 15 client.4459.objecter _send_op 4 to 12.1 on osd.1 2023-11-05T08:08:24.911 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:21.530+0000 7faaedc46780 1 -- 172.21.15.52:0/3032579076 --> [v2:172.21.15.52:6824/544646809,v1:172.21.15.52:6825/544646809] -- osd_op(unknown.0.0:4 12.1 12:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) v8 -- 0x5599faaa0e20 con 0x5599fab4cc70 2023-11-05T08:08:24.911 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:21.530+0000 7faaedc46780 20 client.4459.objecter put_session s=0x5599fa94cf80 osd=1 5 2023-11-05T08:08:24.911 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:21.530+0000 7faaedc46780 5 client.4459.objecter 2 in flight 2023-11-05T08:08:24.911 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:21.907+0000 7faad2ffd640 10 monclient: tick 2023-11-05T08:08:24.911 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:21.907+0000 7faad2ffd640 10 monclient: _check_auth_tickets 2023-11-05T08:08:24.912 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:21.907+0000 7faad2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:08:24.912 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:22.907+0000 7faad2ffd640 10 monclient: tick 2023-11-05T08:08:24.912 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:22.907+0000 7faad2ffd640 10 monclient: _check_auth_tickets 2023-11-05T08:08:24.912 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:22.907+0000 7faad2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:08:24.912 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:22.996+0000 7faaed199640 10 client.4459.objecter tick 2023-11-05T08:08:24.913 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:23.907+0000 7faad2ffd640 10 monclient: tick 2023-11-05T08:08:24.913 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:23.907+0000 7faad2ffd640 10 monclient: _check_auth_tickets 2023-11-05T08:08:24.913 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:23.907+0000 7faad2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:08:24.913 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:24.907+0000 7faad2ffd640 10 monclient: tick 2023-11-05T08:08:24.913 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:24.907+0000 7faad2ffd640 10 monclient: _check_auth_tickets 2023-11-05T08:08:32.624 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:24.907+0000 7faad2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:08:32.624 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:25.907+0000 7faad2ffd640 10 monclient: tick 2023-11-05T08:08:32.624 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:25.907+0000 7faad2ffd640 10 monclient: _check_auth_tickets 2023-11-05T08:08:32.624 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:25.907+0000 7faad2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:08:32.625 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:26.906+0000 7faad2ffd640 10 monclient: tick 2023-11-05T08:08:32.625 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:26.906+0000 7faad2ffd640 10 monclient: _check_auth_tickets 2023-11-05T08:08:32.625 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:26.906+0000 7faad2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:08:32.625 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:27.906+0000 7faad2ffd640 10 monclient: tick 2023-11-05T08:08:32.626 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:27.906+0000 7faad2ffd640 10 monclient: _check_auth_tickets 2023-11-05T08:08:32.626 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:27.906+0000 7faad2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:08:32.626 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:27.996+0000 7faaed199640 10 client.4459.objecter tick 2023-11-05T08:08:32.626 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:28.906+0000 7faad2ffd640 10 monclient: tick 2023-11-05T08:08:32.626 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:28.906+0000 7faad2ffd640 10 monclient: _check_auth_tickets 2023-11-05T08:08:32.627 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:28.906+0000 7faad2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:08:32.627 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:29.907+0000 7faad2ffd640 10 monclient: tick 2023-11-05T08:08:32.627 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:29.907+0000 7faad2ffd640 10 monclient: _check_auth_tickets 2023-11-05T08:08:32.627 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:29.907+0000 7faad2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:08:32.627 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:30.907+0000 7faad2ffd640 10 monclient: tick 2023-11-05T08:08:32.627 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:30.907+0000 7faad2ffd640 10 monclient: _check_auth_tickets 2023-11-05T08:08:32.628 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:30.907+0000 7faad2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:08:32.628 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:30.907+0000 7faad2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:08:32.628 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:31.907+0000 7faad2ffd640 10 monclient: tick 2023-11-05T08:08:32.628 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:31.907+0000 7faad2ffd640 10 monclient: _check_auth_tickets 2023-11-05T08:08:32.629 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:31.907+0000 7faad2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:08:32.629 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faad3fff640 1 -- 172.21.15.52:0/3032579076 <== osd.1 v2:172.21.15.52:6824/544646809 3 ==== osd_map(28..38 src has 1..39) v4 ==== 7940+0+0 (crc 0 0 0) 0x7faadc05d4c0 con 0x5599fab4cc70 2023-11-05T08:08:32.629 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faaeb736640 1 -- 172.21.15.52:0/3032579076 <== osd.1 v2:172.21.15.52:6824/544646809 4 ==== osd_op_reply(3 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) v8 ==== 149+0+5 (crc 0 0 0) 0x7faadc04f070 con 0x5599fab4cc70 2023-11-05T08:08:32.629 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faad3fff640 10 client.4459.objecter ms_dispatch 0x5599fa95fee0 osd_map(28..38 src has 1..39) v4 2023-11-05T08:08:32.629 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faaeb736640 10 client.4459.objecter ms_dispatch 0x5599fa95fee0 osd_op_reply(3 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) v8 2023-11-05T08:08:32.629 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faaeb736640 10 client.4459.objecter in handle_osd_op_reply 2023-11-05T08:08:32.630 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faad3fff640 3 client.4459.objecter handle_osd_map got epochs [28,38] > 27 2023-11-05T08:08:32.630 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faad3fff640 3 client.4459.objecter handle_osd_map decoding incremental epoch 28 2023-11-05T08:08:32.630 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faad3fff640 10 client.4459.objecter checking op 3 2023-11-05T08:08:32.630 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faad3fff640 20 client.4459.objecter _calc_target epoch 28 base exist @12 precalc_pgid 0 pgid 0.0 is_read 2023-11-05T08:08:32.631 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faad3fff640 20 client.4459.objecter _calc_target target exist @12 -> pgid 12.d3a59201 2023-11-05T08:08:32.631 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faad3fff640 10 client.4459.objecter checking op 4 2023-11-05T08:08:32.631 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faad3fff640 20 client.4459.objecter _calc_target epoch 28 base noexist @12 precalc_pgid 0 pgid 0.0 is_read 2023-11-05T08:08:32.631 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faad3fff640 20 client.4459.objecter _calc_target target noexist @12 -> pgid 12.a7bbaa1 2023-11-05T08:08:32.632 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faad3fff640 3 client.4459.objecter handle_osd_map decoding incremental epoch 29 2023-11-05T08:08:32.632 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faad3fff640 10 client.4459.objecter checking op 3 2023-11-05T08:08:32.632 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faad3fff640 20 client.4459.objecter _calc_target epoch 29 base exist @12 precalc_pgid 0 pgid 0.0 is_read 2023-11-05T08:08:32.632 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faad3fff640 20 client.4459.objecter _calc_target target exist @12 -> pgid 12.d3a59201 2023-11-05T08:08:32.632 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faad3fff640 10 client.4459.objecter checking op 4 2023-11-05T08:08:32.632 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faad3fff640 20 client.4459.objecter _calc_target epoch 29 base noexist @12 precalc_pgid 0 pgid 0.0 is_read 2023-11-05T08:08:32.633 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faad3fff640 20 client.4459.objecter _calc_target target noexist @12 -> pgid 12.a7bbaa1 2023-11-05T08:08:32.633 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faad3fff640 3 client.4459.objecter handle_osd_map decoding incremental epoch 30 2023-11-05T08:08:32.633 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faad3fff640 10 client.4459.objecter checking op 3 2023-11-05T08:08:32.633 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faad3fff640 20 client.4459.objecter _calc_target epoch 30 base exist @12 precalc_pgid 0 pgid 0.0 is_read 2023-11-05T08:08:32.633 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faad3fff640 20 client.4459.objecter _calc_target target exist @12 -> pgid 12.d3a59201 2023-11-05T08:08:32.633 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faad3fff640 10 client.4459.objecter checking op 4 2023-11-05T08:08:32.634 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faad3fff640 20 client.4459.objecter _calc_target epoch 30 base noexist @12 precalc_pgid 0 pgid 0.0 is_read 2023-11-05T08:08:32.634 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faad3fff640 20 client.4459.objecter _calc_target target noexist @12 -> pgid 12.a7bbaa1 2023-11-05T08:08:32.634 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faad3fff640 3 client.4459.objecter handle_osd_map decoding incremental epoch 31 2023-11-05T08:08:32.634 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faad3fff640 10 client.4459.objecter checking op 3 2023-11-05T08:08:32.634 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faad3fff640 20 client.4459.objecter _calc_target epoch 31 base exist @12 precalc_pgid 0 pgid 0.0 is_read 2023-11-05T08:08:32.635 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faad3fff640 20 client.4459.objecter _calc_target target exist @12 -> pgid 12.d3a59201 2023-11-05T08:08:32.635 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faad3fff640 10 client.4459.objecter checking op 4 2023-11-05T08:08:32.635 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faad3fff640 20 client.4459.objecter _calc_target epoch 31 base noexist @12 precalc_pgid 0 pgid 0.0 is_read 2023-11-05T08:08:32.635 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faad3fff640 20 client.4459.objecter _calc_target target noexist @12 -> pgid 12.a7bbaa1 2023-11-05T08:08:32.635 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faad3fff640 3 client.4459.objecter handle_osd_map decoding incremental epoch 32 2023-11-05T08:08:32.635 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faad3fff640 10 client.4459.objecter checking op 3 2023-11-05T08:08:32.636 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faad3fff640 20 client.4459.objecter _calc_target epoch 32 base exist @12 precalc_pgid 0 pgid 0.0 is_read 2023-11-05T08:08:32.636 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faad3fff640 20 client.4459.objecter _calc_target target exist @12 -> pgid 12.d3a59201 2023-11-05T08:08:32.636 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faad3fff640 10 client.4459.objecter checking op 4 2023-11-05T08:08:32.636 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faad3fff640 20 client.4459.objecter _calc_target epoch 32 base noexist @12 precalc_pgid 0 pgid 0.0 is_read 2023-11-05T08:08:32.636 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faad3fff640 20 client.4459.objecter _calc_target target noexist @12 -> pgid 12.a7bbaa1 2023-11-05T08:08:32.637 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faad3fff640 3 client.4459.objecter handle_osd_map decoding incremental epoch 33 2023-11-05T08:08:32.637 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faad3fff640 10 client.4459.objecter checking op 3 2023-11-05T08:08:32.637 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faad3fff640 20 client.4459.objecter _calc_target epoch 33 base exist @12 precalc_pgid 0 pgid 0.0 is_read 2023-11-05T08:08:32.637 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faad3fff640 20 client.4459.objecter _calc_target target exist @12 -> pgid 12.d3a59201 2023-11-05T08:08:32.637 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faad3fff640 10 client.4459.objecter checking op 4 2023-11-05T08:08:32.638 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faad3fff640 20 client.4459.objecter _calc_target epoch 33 base noexist @12 precalc_pgid 0 pgid 0.0 is_read 2023-11-05T08:08:32.638 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faad3fff640 20 client.4459.objecter _calc_target target noexist @12 -> pgid 12.a7bbaa1 2023-11-05T08:08:32.638 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faad3fff640 3 client.4459.objecter handle_osd_map decoding incremental epoch 34 2023-11-05T08:08:32.638 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faad3fff640 10 client.4459.objecter checking op 3 2023-11-05T08:08:32.638 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faad3fff640 20 client.4459.objecter _calc_target epoch 34 base exist @12 precalc_pgid 0 pgid 0.0 is_read 2023-11-05T08:08:32.639 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faad3fff640 20 client.4459.objecter _calc_target target exist @12 -> pgid 12.d3a59201 2023-11-05T08:08:32.639 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faad3fff640 10 client.4459.objecter checking op 4 2023-11-05T08:08:32.639 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faad3fff640 20 client.4459.objecter _calc_target epoch 34 base noexist @12 precalc_pgid 0 pgid 0.0 is_read 2023-11-05T08:08:32.639 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faad3fff640 20 client.4459.objecter _calc_target target noexist @12 -> pgid 12.a7bbaa1 2023-11-05T08:08:32.639 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faad3fff640 3 client.4459.objecter handle_osd_map decoding incremental epoch 35 2023-11-05T08:08:32.639 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faad3fff640 10 client.4459.objecter checking op 3 2023-11-05T08:08:32.640 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faad3fff640 20 client.4459.objecter _calc_target epoch 35 base exist @12 precalc_pgid 0 pgid 0.0 is_read 2023-11-05T08:08:32.640 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faad3fff640 20 client.4459.objecter _calc_target target exist @12 -> pgid 12.d3a59201 2023-11-05T08:08:32.640 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faad3fff640 10 client.4459.objecter checking op 4 2023-11-05T08:08:32.640 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faad3fff640 20 client.4459.objecter _calc_target epoch 35 base noexist @12 precalc_pgid 0 pgid 0.0 is_read 2023-11-05T08:08:32.640 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faad3fff640 20 client.4459.objecter _calc_target target noexist @12 -> pgid 12.a7bbaa1 2023-11-05T08:08:32.641 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faad3fff640 3 client.4459.objecter handle_osd_map decoding incremental epoch 36 2023-11-05T08:08:32.641 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faad3fff640 10 client.4459.objecter checking op 3 2023-11-05T08:08:32.641 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faad3fff640 20 client.4459.objecter _calc_target epoch 36 base exist @12 precalc_pgid 0 pgid 0.0 is_read 2023-11-05T08:08:32.641 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faad3fff640 20 client.4459.objecter _calc_target target exist @12 -> pgid 12.d3a59201 2023-11-05T08:08:32.641 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faad3fff640 10 client.4459.objecter checking op 4 2023-11-05T08:08:32.642 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faad3fff640 20 client.4459.objecter _calc_target epoch 36 base noexist @12 precalc_pgid 0 pgid 0.0 is_read 2023-11-05T08:08:32.642 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faad3fff640 20 client.4459.objecter _calc_target target noexist @12 -> pgid 12.a7bbaa1 2023-11-05T08:08:32.642 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faad3fff640 3 client.4459.objecter handle_osd_map decoding incremental epoch 37 2023-11-05T08:08:32.642 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faad3fff640 10 client.4459.objecter checking op 3 2023-11-05T08:08:32.642 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faad3fff640 20 client.4459.objecter _calc_target epoch 37 base exist @12 precalc_pgid 0 pgid 0.0 is_read 2023-11-05T08:08:32.642 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faad3fff640 20 client.4459.objecter _calc_target target exist @12 -> pgid 12.d3a59201 2023-11-05T08:08:32.643 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faad3fff640 10 client.4459.objecter checking op 4 2023-11-05T08:08:32.643 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faad3fff640 20 client.4459.objecter _calc_target epoch 37 base noexist @12 precalc_pgid 0 pgid 0.0 is_read 2023-11-05T08:08:32.643 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faad3fff640 20 client.4459.objecter _calc_target target noexist @12 -> pgid 12.a7bbaa1 2023-11-05T08:08:32.643 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faad3fff640 3 client.4459.objecter handle_osd_map decoding incremental epoch 38 2023-11-05T08:08:32.643 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faad3fff640 10 client.4459.objecter checking op 3 2023-11-05T08:08:32.644 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faad3fff640 20 client.4459.objecter _calc_target epoch 38 base exist @12 precalc_pgid 0 pgid 0.0 is_read 2023-11-05T08:08:32.644 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faad3fff640 20 client.4459.objecter _calc_target target exist @12 -> pgid 12.d3a59201 2023-11-05T08:08:32.644 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faad3fff640 10 client.4459.objecter checking op 4 2023-11-05T08:08:32.644 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faad3fff640 20 client.4459.objecter _calc_target epoch 38 base noexist @12 precalc_pgid 0 pgid 0.0 is_read 2023-11-05T08:08:32.644 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faad3fff640 20 client.4459.objecter _calc_target target noexist @12 -> pgid 12.a7bbaa1 2023-11-05T08:08:32.645 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faad3fff640 20 client.4459.objecter dump_active .. 0 homeless 2023-11-05T08:08:32.645 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faad3fff640 20 client.4459.objecter 3 12.d3a59201 osd.1 exist [read 0~256] 2023-11-05T08:08:32.645 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faad3fff640 20 client.4459.objecter 4 12.a7bbaa1 osd.1 noexist [read 0~256] 2023-11-05T08:08:32.645 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faaeb736640 7 client.4459.objecter handle_osd_op_reply 3 ondisk uv 1 in 12.1 attempt 0 2023-11-05T08:08:32.645 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faaeb736640 10 client.4459.objecter op 0 rval 0 len 5 2023-11-05T08:08:32.646 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faaeb736640 15 client.4459.objecter handle_osd_op_reply completed tid 3 2023-11-05T08:08:32.646 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faaeb736640 15 client.4459.objecter _finish_op 3 2023-11-05T08:08:32.647 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faaeb736640 20 client.4459.objecter put_session s=0x5599fa94cf80 osd=1 5 2023-11-05T08:08:32.647 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faaeb736640 15 client.4459.objecter _session_op_remove 1 3 2023-11-05T08:08:32.647 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faaeb736640 5 client.4459.objecter 1 in flight 2023-11-05T08:08:32.647 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: [ OK ] AsioRados.AsyncReadCallback (11094 ms) 2023-11-05T08:08:32.648 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: [ RUN ] AsioRados.AsyncReadFuture 2023-11-05T08:08:32.648 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faaeb736640 1 -- 172.21.15.52:0/3032579076 <== osd.1 v2:172.21.15.52:6824/544646809 5 ==== osd_op_reply(4 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7faadc04f070 con 0x5599fab4cc70 2023-11-05T08:08:32.648 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faaeb736640 10 client.4459.objecter ms_dispatch 0x5599fa95fee0 osd_op_reply(4 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 2023-11-05T08:08:32.648 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faaeb736640 10 client.4459.objecter in handle_osd_op_reply 2023-11-05T08:08:32.649 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faaeb736640 7 client.4459.objecter handle_osd_op_reply 4 ondisk uv 0 in 12.1 attempt 0 2023-11-05T08:08:32.649 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faaeb736640 10 client.4459.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2023-11-05T08:08:32.649 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faaeb736640 10 client.4459.objecter op 0 rval 0 len 0 2023-11-05T08:08:32.649 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faaeb736640 15 client.4459.objecter handle_osd_op_reply completed tid 4 2023-11-05T08:08:32.650 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faaeb736640 15 client.4459.objecter _finish_op 4 2023-11-05T08:08:32.650 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faaeb736640 20 client.4459.objecter put_session s=0x5599fa94cf80 osd=1 4 2023-11-05T08:08:32.650 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faaeb736640 15 client.4459.objecter _session_op_remove 1 4 2023-11-05T08:08:32.650 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faaeb736640 5 client.4459.objecter 0 in flight 2023-11-05T08:08:32.650 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faaedc46780 10 client.4459.objecter _op_submit op 0x5599faaa0980 2023-11-05T08:08:32.651 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faaedc46780 20 client.4459.objecter _calc_target epoch 38 base exist @12 precalc_pgid 0 pgid 0.0 is_read 2023-11-05T08:08:32.651 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faaedc46780 20 client.4459.objecter _calc_target target exist @12 -> pgid 12.d3a59201 2023-11-05T08:08:32.651 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faaedc46780 10 client.4459.objecter _calc_target raw pgid 12.d3a59201 -> actual 12.1 acting [1,6] primary 1 2023-11-05T08:08:32.651 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faaedc46780 20 client.4459.objecter _get_session s=0x5599fa94cf80 osd=1 3 2023-11-05T08:08:32.651 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faaedc46780 10 client.4459.objecter _op_submit oid exist '@12' '@12' [read 0~256] tid 5 osd.1 2023-11-05T08:08:32.652 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faaedc46780 20 client.4459.objecter get_session s=0x5599fa94cf80 osd=1 3 2023-11-05T08:08:32.652 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.622+0000 7faaedc46780 15 client.4459.objecter _session_op_assign 1 5 2023-11-05T08:08:32.652 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.623+0000 7faaedc46780 15 client.4459.objecter _send_op 5 to 12.1 on osd.1 2023-11-05T08:08:32.652 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.623+0000 7faaedc46780 1 -- 172.21.15.52:0/3032579076 --> [v2:172.21.15.52:6824/544646809,v1:172.21.15.52:6825/544646809] -- osd_op(unknown.0.0:5 12.1 12:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38) v8 -- 0x5599faa059f0 con 0x5599fab4cc70 2023-11-05T08:08:32.652 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.623+0000 7faaedc46780 20 client.4459.objecter put_session s=0x5599fa94cf80 osd=1 4 2023-11-05T08:08:32.652 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.623+0000 7faaedc46780 5 client.4459.objecter 1 in flight 2023-11-05T08:08:32.653 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.623+0000 7faaedc46780 10 client.4459.objecter _op_submit op 0x5599faaa1180 2023-11-05T08:08:32.653 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.623+0000 7faaedc46780 20 client.4459.objecter _calc_target epoch 38 base noexist @12 precalc_pgid 0 pgid 0.0 is_read 2023-11-05T08:08:32.653 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.623+0000 7faaedc46780 20 client.4459.objecter _calc_target target noexist @12 -> pgid 12.a7bbaa1 2023-11-05T08:08:32.653 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.623+0000 7faaedc46780 10 client.4459.objecter _calc_target raw pgid 12.a7bbaa1 -> actual 12.1 acting [1,6] primary 1 2023-11-05T08:08:32.653 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.623+0000 7faaedc46780 20 client.4459.objecter _get_session s=0x5599fa94cf80 osd=1 4 2023-11-05T08:08:32.654 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.623+0000 7faaedc46780 10 client.4459.objecter _op_submit oid noexist '@12' '@12' [read 0~256] tid 6 osd.1 2023-11-05T08:08:32.654 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.623+0000 7faaedc46780 20 client.4459.objecter get_session s=0x5599fa94cf80 osd=1 4 2023-11-05T08:08:32.654 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.623+0000 7faaedc46780 15 client.4459.objecter _session_op_assign 1 6 2023-11-05T08:08:32.654 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.623+0000 7faaedc46780 15 client.4459.objecter _send_op 6 to 12.1 on osd.1 2023-11-05T08:08:33.100 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:02:36.174 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:08:33.101 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:02:36.176 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:08:33.113 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:02:36.228 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:08:33.160 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:02:36.276 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:08:33.189 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:02:36.305 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:08:33.192 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:02:36.308 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:08:33.305 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:02:36.379 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:08:33.381 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:02:36.497 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:08:33.567 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:02:36.682 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:08:36.747 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.623+0000 7faaedc46780 1 -- 172.21.15.52:0/3032579076 --> [v2:172.21.15.52:6824/544646809,v1:172.21.15.52:6825/5446468 api_service: [==========] Running 4 tests from 1 test suite. 2023-11-05T08:08:36.747 INFO:tasks.workunit.client.0.smithi052.stdout: api_service: [----------] Global test environment set-up. 2023-11-05T08:08:36.748 INFO:tasks.workunit.client.0.smithi052.stdout: api_service: [----------] 4 tests from LibRadosService 2023-11-05T08:08:36.748 INFO:tasks.workunit.client.0.smithi052.stdout: api_service: [ RUN ] LibRadosService.RegisterEarly 2023-11-05T08:08:36.748 INFO:tasks.workunit.client.0.smithi052.stdout: api_service: [ OK ] LibRadosService.RegisterEarly (5372 ms) 2023-11-05T08:08:36.748 INFO:tasks.workunit.client.0.smithi052.stdout: api_service: [ RUN ] LibRadosService.RegisterLate 2023-11-05T08:08:36.749 INFO:tasks.workunit.client.0.smithi052.stdout: api_service: [ OK ] LibRadosService.RegisterLate (118 ms) 2023-11-05T08:08:36.749 INFO:tasks.workunit.client.0.smithi052.stdout: api_service: [ RUN ] LibRadosService.StatusFormat 2023-11-05T08:08:36.749 INFO:tasks.workunit.client.0.smithi052.stdout: api_service: cluster: 2023-11-05T08:08:36.749 INFO:tasks.workunit.client.0.smithi052.stdout: api_service: id: b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:08:36.749 INFO:tasks.workunit.client.0.smithi052.stdout: api_service: health: HEALTH_WARN 2023-11-05T08:08:36.749 INFO:tasks.workunit.client.0.smithi052.stdout: api_service: 10 pool(s) do not have an application enabled 2023-11-05T08:08:36.750 INFO:tasks.workunit.client.0.smithi052.stdout: api_service: 2023-11-05T08:08:36.750 INFO:tasks.workunit.client.0.smithi052.stdout: api_service: services: 2023-11-05T08:08:36.750 INFO:tasks.workunit.client.0.smithi052.stdout: api_service: mon: 3 daemons, quorum a,b,c (age 2m) 2023-11-05T08:08:36.750 INFO:tasks.workunit.client.0.smithi052.stdout: api_service: mgr: x(active, since 119s), standbys: y 2023-11-05T08:08:36.751 INFO:tasks.workunit.client.0.smithi052.stdout: api_service: osd: 8 osds: 8 up (since 76s), 8 in (since 119s) 2023-11-05T08:08:36.751 INFO:tasks.workunit.client.0.smithi052.stdout: api_service: laundry: 2 daemons active (1 hosts) 2023-11-05T08:08:36.751 INFO:tasks.workunit.client.0.smithi052.stdout: api_service: 2023-11-05T08:08:36.751 INFO:tasks.workunit.client.0.smithi052.stdout: api_service: data: 2023-11-05T08:08:36.751 INFO:tasks.workunit.client.0.smithi052.stdout: api_service: pools: 29 pools, 849 pgs 2023-11-05T08:08:36.752 INFO:tasks.workunit.client.0.smithi052.stdout: api_service: objects: 2 objects, 449 KiB 2023-11-05T08:08:36.752 INFO:tasks.workunit.client.0.smithi052.stdout: api_service: usage: 214 MiB used, 720 GiB / 720 GiB avail 2023-11-05T08:08:36.752 INFO:tasks.workunit.client.0.smithi052.stdout: api_service: pgs: 75.736% pgs unknown 2023-11-05T08:08:36.752 INFO:tasks.workunit.client.0.smithi052.stdout: api_service: 23.204% pgs not active 2023-11-05T08:08:36.752 INFO:tasks.workunit.client.0.smithi052.stdout: api_service: 643 unknown 2023-11-05T08:08:36.753 INFO:tasks.workunit.client.0.smithi052.stdout: api_service: 197 creating+peering 2023-11-05T08:08:36.753 INFO:tasks.workunit.client.0.smithi052.stdout: api_service: 9 active+clean 2023-11-05T08:08:36.753 INFO:tasks.workunit.client.0.smithi052.stdout: api_service: 2023-11-05T08:08:36.753 INFO:tasks.workunit.client.0.smithi052.stdout: api_service: 2023-11-05T08:08:36.753 INFO:tasks.workunit.client.0.smithi052.stdout: api_service: cluster: 2023-11-05T08:08:36.754 INFO:tasks.workunit.client.0.smithi052.stdout: api_service: id: b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:08:36.754 INFO:tasks.workunit.client.0.smithi052.stdout: api_service: health: HEALTH_WARN 2023-11-05T08:08:36.754 INFO:tasks.workunit.client.0.smithi052.stdout: api_service: 7 pool(s) do not have an application enabled 2023-11-05T08:08:36.754 INFO:tasks.workunit.client.0.smithi052.stdout: api_service: 2023-11-05T08:08:36.754 INFO:tasks.workunit.client.0.smithi052.stdout: api_service: services: 2023-11-05T08:08:36.755 INFO:tasks.workunit.client.0.smithi052.stdout: api_service: mon: 3 daemons, quorum a,b,c (age 2m) 2023-11-05T08:08:36.755 INFO:tasks.workunit.client.0.smithi052.stdout: api_service: mgr: x(active, since 2m), standbys: y 2023-11-05T08:08:36.755 INFO:tasks.workunit.client.0.smithi052.stdout: api_service: osd: 8 osds: 8 up (since 78s), 8 in (since 2m) 2023-11-05T08:08:36.755 INFO:tasks.workunit.client.0.smithi052.stdout: api_service: foo: 16 portals active (1 hosts, 3 zones) 2023-11-05T08:08:36.755 INFO:tasks.workunit.client.0.smithi052.stdout: api_service: laundry: 1 daemon active (1 hosts) 2023-11-05T08:08:36.756 INFO:tasks.workunit.client.0.smithi052.stdout: api_service: 2023-11-05T08:08:36.756 INFO:tasks.workunit.client.0.smithi052.stdout: api_service: data: 2023-11-05T08:08:36.756 INFO:tasks.workunit.client.0.smithi052.stdout: api_service: pools: 29 pools, 849 pgs 2023-11-05T08:08:36.756 INFO:tasks.workunit.client.0.smithi052.stdout: api_service: objects: 2 objects, 449 KiB 2023-11-05T08:08:36.756 INFO:tasks.workunit.client.0.smithi052.stdout: api_service: usage: 214 MiB used, 720 GiB / 720 GiB avail 2023-11-05T08:08:36.757 INFO:tasks.workunit.client.0.smithi052.stdout: api_service: pgs: 56.184% pgs unknown 2023-11-05T08:08:36.757 INFO:tasks.workunit.client.0.smithi052.stdout: api_service: 42.756% pgs not active 2023-11-05T08:08:36.757 INFO:tasks.workunit.client.0.smithi052.stdout: api_service: 477 unknown 2023-11-05T08:08:36.757 INFO:tasks.workunit.client.0.smithi052.stdout: api_service: 307 creating+peering 2023-11-05T08:08:36.757 INFO:tasks.workunit.client.0.smithi052.stdout: api_service: 56 creating+activating 2023-11-05T08:08:36.758 INFO:tasks.workunit.client.0.smithi052.stdout: api_service: 9 active+clean 2023-11-05T08:08:36.758 INFO:tasks.workunit.client.0.smithi052.stdout: api_service: 2023-11-05T08:08:36.758 INFO:tasks.workunit.client.0.smithi052.stdout: api_service: 2023-11-05T08:08:36.758 INFO:tasks.workunit.client.0.smithi052.stdout: api_service: [ OK ] LibRadosService.StatusFormat (3171 ms) 2023-11-05T08:08:36.759 INFO:tasks.workunit.client.0.smithi052.stdout: api_service: [ RUN ] LibRadosService.Status 2023-11-05T08:08:36.759 INFO:tasks.workunit.client.0.smithi052.stdout: api_service: [ OK ] LibRadosService.Status (20068 ms) 2023-11-05T08:08:36.759 INFO:tasks.workunit.client.0.smithi052.stdout: api_service: [----------] 4 tests from LibRadosService (28729 ms total) 2023-11-05T08:08:36.759 INFO:tasks.workunit.client.0.smithi052.stdout: api_service: 2023-11-05T08:08:36.759 INFO:tasks.workunit.client.0.smithi052.stdout: api_service: [----------] Global test environment tear-down 2023-11-05T08:08:36.760 INFO:tasks.workunit.client.0.smithi052.stdout: api_service: [==========] 4 tests from 1 test suite ran. (28729 ms total) 2023-11-05T08:08:36.760 INFO:tasks.workunit.client.0.smithi052.stdout: api_service: [ PASSED ] 4 tests. 2023-11-05T08:08:38.682 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc: [==========] Running 12 tests from 4 test suites. 2023-11-05T08:08:38.682 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc: [----------] Global test environment set-up. 2023-11-05T08:08:38.683 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc: [----------] 1 test from LibRadosMiscVersion 2023-11-05T08:08:38.683 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc: [ RUN ] LibRadosMiscVersion.Version 2023-11-05T08:08:38.683 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc: [ OK ] LibRadosMiscVersion.Version (0 ms) 2023-11-05T08:08:38.683 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc: [----------] 1 test from LibRadosMiscVersion (0 ms total) 2023-11-05T08:08:38.683 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc: 2023-11-05T08:08:38.684 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc: [----------] 2 tests from LibRadosMiscConnectFailure 2023-11-05T08:08:38.684 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc: [ RUN ] LibRadosMiscConnectFailure.ConnectFailure 2023-11-05T08:08:38.684 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc: unable to get monitor info from DNS SRV with service name: ceph-mon 2023-11-05T08:08:38.684 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc: 2023-11-05T08:08:08.345+0000 7f2034844780 -1 failed for service _ceph-mon._tcp 2023-11-05T08:08:38.684 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc: 2023-11-05T08:08:08.345+0000 7f2034844780 -1 monclient: get_monmap_and_config cannot identify monitors to contact 2023-11-05T08:08:38.685 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc: [ OK ] LibRadosMiscConnectFailure.ConnectFailure (525 ms) 2023-11-05T08:08:38.685 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc: [ RUN ] LibRadosMiscConnectFailure.ConnectTimeout 2023-11-05T08:08:38.685 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc: [ OK ] LibRadosMiscConnectFailure.ConnectTimeout (2009 ms) 2023-11-05T08:08:38.685 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc: [----------] 2 tests from LibRadosMiscConnectFailure (2534 ms total) 2023-11-05T08:08:38.685 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc: 2023-11-05T08:08:38.686 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc: [----------] 1 test from LibRadosMiscPool 2023-11-05T08:08:38.686 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc: [ RUN ] LibRadosMiscPool.PoolCreationRace 2023-11-05T08:08:38.686 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc: started 0x55df765d0420 2023-11-05T08:08:38.686 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc: started 0x55df759beca0 2023-11-05T08:08:38.686 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc: started 0x55df75ba5630 2023-11-05T08:08:38.687 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc: started 0x55df75d1ef30 2023-11-05T08:08:38.687 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc: started 0x55df75d1f980 2023-11-05T08:08:38.687 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc: started 0x55df75d20380 2023-11-05T08:08:38.687 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc: started 0x55df75d20e80 2023-11-05T08:08:38.687 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc: started 0x55df75d21980 2023-11-05T08:08:38.687 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc: started 0x55df75d22490 2023-11-05T08:08:38.688 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc: started 0x55df75d22ed0 2023-11-05T08:08:38.688 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc: started 0x55df75d22220 2023-11-05T08:08:38.688 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc: started 0x55df75d23d40 2023-11-05T08:08:38.688 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc: started 0x55df75d22d30 2023-11-05T08:08:38.688 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc: started 0x55df75d24c50 2023-11-05T08:08:38.688 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc: started 0x55df75d23b10 2023-11-05T08:08:38.689 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc: started 0x55df75d25a90 2023-11-05T08:08:38.689 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc: started 0x55df75d24a10 2023-11-05T08:08:38.689 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc: started 0x55df75d26940 2023-11-05T08:08:38.689 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc: started 0x55df75d25810 2023-11-05T08:08:38.689 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc: started 0x55df75d277e0 2023-11-05T08:08:38.690 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc: started 0x55df75d26740 2023-11-05T08:08:38.690 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc: started 21 aios 2023-11-05T08:08:38.690 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc: waiting 0x55df765d0420 2023-11-05T08:08:38.690 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc: waiting 0x55df759beca0 2023-11-05T08:08:38.690 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc: waiting 0x55df75ba5630 2023-11-05T08:08:38.691 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc: waiting 0x55df75d1ef30 2023-11-05T08:08:38.691 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc: waiting 0x55df75d1f980 2023-11-05T08:08:38.691 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc: waiting 0x55df75d20380 2023-11-05T08:08:38.691 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc: waiting 0x55df75d20e80 2023-11-05T08:08:38.691 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc: waiting 0x55df75d21980 2023-11-05T08:08:38.691 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc: waiting 0x55df75d22490 2023-11-05T08:08:38.692 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc: waiting 0x55df75d22ed0 2023-11-05T08:08:38.692 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc: waiting 0x55df75d22220 2023-11-05T08:08:38.692 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc: waiting 0x55df75d23d40 2023-11-05T08:08:38.692 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc: waiting 0x55df75d22d30 2023-11-05T08:08:38.692 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc: waiting 0x55df75d24c50 2023-11-05T08:08:38.693 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc: waiting 0x55df75d23b10 2023-11-05T08:08:38.693 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc: waiting 0x55df75d25a90 2023-11-05T08:08:38.693 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc: waiting 0x55df75d24a10 2023-11-05T08:08:38.693 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc: waiting 0x55df75d26940 2023-11-05T08:08:38.693 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc: waiting 0x55df75d25810 2023-11-05T08:08:38.694 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc: waiting 0x55df75d277e0 2023-11-05T08:08:38.694 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc: waiting 0x55df75d26740 2023-11-05T08:08:38.694 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc: done. 2023-11-05T08:08:38.694 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc: [ OK ] LibRadosMiscPool.PoolCreationRace (26427 ms) 2023-11-05T08:08:38.694 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc: [----------] 1 test from LibRadosMiscPool (26427 ms total) 2023-11-05T08:08:38.695 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc: 2023-11-05T08:08:38.695 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc: [----------] 8 tests from LibRadosMisc 2023-11-05T08:08:38.695 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc: [ RUN ] LibRadosMisc.ClusterFSID 2023-11-05T08:08:38.695 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc: [ OK ] LibRadosMisc.ClusterFSID (0 ms) 2023-11-05T08:08:38.842 INFO:tasks.workunit.client.0.smithi052.stdout: 09] -- osd_op(unknown.0.0:6 12.1 12:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38) v8 -- 0x5599fab4f900 con 0x5599fab4cc70 2023-11-05T08:08:38.843 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.623+0000 7faaedc46780 20 client.4459.objecter put_session s=0x5599fa94cf80 osd=1 5 2023-11-05T08:08:38.843 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.623+0000 7faaedc46780 5 client.4459.objecter 2 in flight 2023-11-05T08:08:38.843 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.907+0000 7faad2ffd640 10 monclient: tick 2023-11-05T08:08:38.843 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.907+0000 7faad2ffd640 10 monclient: _check_auth_tickets 2023-11-05T08:08:38.844 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.907+0000 7faad2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:08:38.844 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:32.997+0000 7faaed199640 10 client.4459.objecter tick 2023-11-05T08:08:38.844 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:33.907+0000 7faad2ffd640 10 monclient: tick 2023-11-05T08:08:38.844 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:33.907+0000 7faad2ffd640 10 monclient: _check_auth_tickets 2023-11-05T08:08:38.844 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:33.907+0000 7faad2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:08:38.845 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:34.907+0000 7faad2ffd640 10 monclient: tick 2023-11-05T08:08:38.845 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:34.907+0000 7faad2ffd640 10 monclient: _check_auth_tickets 2023-11-05T08:08:38.845 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:34.907+0000 7faad2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:08:38.845 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:35.907+0000 7faad2ffd640 10 monclient: tick 2023-11-05T08:08:38.845 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:35.907+0000 7faad2ffd640 10 monclient: _check_auth_tickets 2023-11-05T08:08:38.846 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:35.907+0000 7faad2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:08:38.846 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:36.907+0000 7faad2ffd640 10 monclient: tick 2023-11-05T08:08:38.846 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:36.907+0000 7faad2ffd640 10 monclient: _check_auth_tickets 2023-11-05T08:08:38.846 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:36.907+0000 7faad2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:08:38.846 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:37.907+0000 7faad2ffd640 10 monclient: tick 2023-11-05T08:08:38.847 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:37.907+0000 7faad2ffd640 10 monclient: _check_auth_tickets 2023-11-05T08:08:38.847 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:37.907+0000 7faad2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:08:38.847 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:37.998+0000 7faaed199640 10 client.4459.objecter tick 2023-11-05T08:08:38.847 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:38.840+0000 7faad3fff640 1 -- 172.21.15.52:0/3032579076 <== osd.1 v2:172.21.15.52:6824/544646809 6 ==== osd_map(39..45 src has 1..45) v4 ==== 4168+0+0 (crc 0 0 0) 0x7faadc05d680 con 0x5599fab4cc70 2023-11-05T08:08:38.847 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:38.840+0000 7faaeb736640 1 -- 172.21.15.52:0/3032579076 <== osd.1 v2:172.21.15.52:6824/544646809 7 ==== osd_op_reply(5 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) v8 ==== 149+0+5 (crc 0 0 0) 0x7faadc04f070 con 0x5599fab4cc70 2023-11-05T08:08:38.848 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:38.840+0000 7faad3fff640 10 client.4459.objecter ms_dispatch 0x5599fa95fee0 osd_map(39..45 src has 1..45) v4 2023-11-05T08:08:38.848 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:38.840+0000 7faaeb736640 10 client.4459.objecter ms_dispatch 0x5599fa95fee0 osd_op_reply(5 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) v8 2023-11-05T08:08:38.848 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:38.840+0000 7faaeb736640 10 client.4459.objecter in handle_osd_op_reply 2023-11-05T08:08:38.848 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:38.840+0000 7faad3fff640 3 client.4459.objecter handle_osd_map got epochs [39,45] > 38 2023-11-05T08:08:38.848 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:38.840+0000 7faad3fff640 3 client.4459.objecter handle_osd_map decoding incremental epoch 39 2023-11-05T08:08:38.848 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:38.840+0000 7faad3fff640 10 client.4459.objecter checking op 5 2023-11-05T08:08:38.849 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:38.840+0000 7faad3fff640 20 client.4459.objecter _calc_target epoch 39 base exist @12 precalc_pgid 0 pgid 0.0 is_read 2023-11-05T08:08:38.849 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:38.840+0000 7faad3fff640 20 client.4459.objecter _calc_target target exist @12 -> pgid 12.d3a59201 2023-11-05T08:08:38.849 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:38.840+0000 7faad3fff640 10 client.4459.objecter checking op 6 2023-11-05T08:08:38.849 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:38.840+0000 7faad3fff640 20 client.4459.objecter _calc_target epoch 39 base noexist @12 precalc_pgid 0 pgid 0.0 is_read 2023-11-05T08:08:38.849 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:38.840+0000 7faad3fff640 20 client.4459.objecter _calc_target target noexist @12 -> pgid 12.a7bbaa1 2023-11-05T08:08:38.850 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:38.840+0000 7faad3fff640 3 client.4459.objecter handle_osd_map decoding incremental epoch 40 2023-11-05T08:08:38.850 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:38.840+0000 7faad3fff640 10 client.4459.objecter checking op 5 2023-11-05T08:08:38.850 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:38.840+0000 7faad3fff640 20 client.4459.objecter _calc_target epoch 40 base exist @12 precalc_pgid 0 pgid 0.0 is_read 2023-11-05T08:08:38.850 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:38.840+0000 7faad3fff640 20 client.4459.objecter _calc_target target exist @12 -> pgid 12.d3a59201 2023-11-05T08:08:38.850 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:38.840+0000 7faad3fff640 10 client.4459.objecter checking op 6 2023-11-05T08:08:38.851 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:38.840+0000 7faad3fff640 20 client.4459.objecter _calc_target epoch 40 base noexist @12 precalc_pgid 0 pgid 0.0 is_read 2023-11-05T08:08:38.851 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:38.840+0000 7faad3fff640 20 client.4459.objecter _calc_target target noexist @12 -> pgid 12.a7bbaa1 2023-11-05T08:08:38.851 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:38.840+0000 7faad3fff640 3 client.4459.objecter handle_osd_map decoding incremental epoch 41 2023-11-05T08:08:38.851 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:38.841+0000 7faad3fff640 10 client.4459.objecter checking op 5 2023-11-05T08:08:38.851 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:38.841+0000 7faad3fff640 20 client.4459.objecter _calc_target epoch 41 base exist @12 precalc_pgid 0 pgid 0.0 is_read 2023-11-05T08:08:38.851 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:38.841+0000 7faad3fff640 20 client.4459.objecter _calc_target target exist @12 -> pgid 12.d3a59201 2023-11-05T08:08:38.852 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:38.841+0000 7faad3fff640 10 client.4459.objecter checking op 6 2023-11-05T08:08:38.852 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:38.841+0000 7faad3fff640 20 client.4459.objecter _calc_target epoch 41 base noexist @12 precalc_pgid 0 pgid 0.0 is_read 2023-11-05T08:08:38.852 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:38.841+0000 7faad3fff640 20 client.4459.objecter _calc_target target noexist @12 -> pgid 12.a7bbaa1 2023-11-05T08:08:38.852 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:38.841+0000 7faad3fff640 3 client.4459.objecter handle_osd_map decoding incremental epoch 42 2023-11-05T08:08:38.852 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:38.841+0000 7faad3fff640 10 client.4459.objecter checking op 5 2023-11-05T08:08:38.853 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:38.841+0000 7faad3fff640 20 client.4459.objecter _calc_target epoch 42 base exist @12 precalc_pgid 0 pgid 0.0 is_read 2023-11-05T08:08:38.853 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:38.841+0000 7faad3fff640 20 client.4459.objecter _calc_target target exist @12 -> pgid 12.d3a59201 2023-11-05T08:08:38.853 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:38.841+0000 7faad3fff640 10 client.4459.objecter checking op 6 2023-11-05T08:08:38.853 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:38.841+0000 7faad3fff640 20 client.4459.objecter _calc_target epoch 42 base noexist @12 precalc_pgid 0 pgid 0.0 is_read 2023-11-05T08:08:38.853 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:38.841+0000 7faad3fff640 20 client.4459.objecter _calc_target target noexist @12 -> pgid 12.a7bbaa1 2023-11-05T08:08:38.854 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:38.841+0000 7faad3fff640 3 client.4459.objecter handle_osd_map decoding incremental epoch 43 2023-11-05T08:08:38.854 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:38.841+0000 7faad3fff640 10 client.4459.objecter checking op 5 2023-11-05T08:08:38.854 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:38.841+0000 7faad3fff640 20 client.4459.objecter _calc_target epoch 43 base exist @12 precalc_pgid 0 pgid 0.0 is_read 2023-11-05T08:08:38.854 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:38.841+0000 7faad3fff640 20 client.4459.objecter _calc_target target exist @12 -> pgid 12.d3a59201 2023-11-05T08:08:38.854 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:38.841+0000 7faad3fff640 10 client.4459.objecter checking op 6 2023-11-05T08:08:38.855 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:38.841+0000 7faad3fff640 20 client.4459.objecter _calc_target epoch 43 base noexist @12 precalc_pgid 0 pgid 0.0 is_read 2023-11-05T08:08:38.855 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:38.841+0000 7faad3fff640 20 client.4459.objecter _calc_target target noexist @12 -> pgid 12.a7bbaa1 2023-11-05T08:08:38.855 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:38.841+0000 7faad3fff640 3 client.4459.objecter handle_osd_map decoding incremental epoch 44 2023-11-05T08:08:38.855 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:38.841+0000 7faad3fff640 10 client.4459.objecter checking op 5 2023-11-05T08:08:38.856 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:38.841+0000 7faad3fff640 20 client.4459.objecter _calc_target epoch 44 base exist @12 precalc_pgid 0 pgid 0.0 is_read 2023-11-05T08:08:38.856 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:38.841+0000 7faad3fff640 20 client.4459.objecter _calc_target target exist @12 -> pgid 12.d3a59201 2023-11-05T08:08:38.856 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:38.841+0000 7faad3fff640 10 client.4459.objecter checking op 6 2023-11-05T08:08:38.856 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:38.841+0000 7faad3fff640 20 client.4459.objecter _calc_target epoch 44 base noexist @12 precalc_pgid 0 pgid 0.0 is_read 2023-11-05T08:08:38.856 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:38.841+0000 7faad3fff640 20 client.4459.objecter _calc_target target noexist @12 -> pgid 12.a7bbaa1 2023-11-05T08:08:38.856 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:38.841+0000 7faad3fff640 3 client.4459.objecter handle_osd_map decoding incremental epoch 45 2023-11-05T08:08:38.857 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:38.841+0000 7faad3fff640 10 client.4459.objecter checking op 5 2023-11-05T08:08:38.857 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:38.841+0000 7faad3fff640 20 client.4459.objecter _calc_target epoch 45 base exist @12 precalc_pgid 0 pgid 0.0 is_read 2023-11-05T08:08:38.857 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:38.841+0000 7faad3fff640 20 client.4459.objecter _calc_target target exist @12 -> pgid 12.d3a59201 2023-11-05T08:08:38.857 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:38.841+0000 7faad3fff640 10 client.4459.objecter checking op 6 2023-11-05T08:08:38.857 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:38.841+0000 7faad3fff640 20 client.4459.objecter _calc_target epoch 45 base noexist @12 precalc_pgid 0 pgid 0.0 is_read 2023-11-05T08:08:38.858 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:38.841+0000 7faad3fff640 20 client.4459.objecter _calc_target target noexist @12 -> pgid 12.a7bbaa1 2023-11-05T08:08:38.858 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:38.841+0000 7faad3fff640 20 client.4459.objecter dump_active .. 0 homeless 2023-11-05T08:08:38.858 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:38.841+0000 7faad3fff640 20 client.4459.objecter 5 12.d3a59201 osd.1 exist [read 0~256] 2023-11-05T08:08:38.858 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:38.841+0000 7faad3fff640 20 client.4459.objecter 6 12.a7bbaa1 osd.1 noexist [read 0~256] 2023-11-05T08:08:38.858 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:38.841+0000 7faaeb736640 7 client.4459.objecter handle_osd_op_reply 5 ondisk uv 1 in 12.1 attempt 0 2023-11-05T08:08:38.859 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:38.841+0000 7faaeb736640 10 client.4459.objecter op 0 rval 0 len 5 2023-11-05T08:08:38.859 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:38.841+0000 7faaeb736640 15 client.4459.objecter handle_osd_op_reply completed tid 5 2023-11-05T08:08:38.859 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:38.841+0000 7faaeb736640 15 client.4459.objecter _finish_op 5 2023-11-05T08:08:38.859 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:38.841+0000 7faaeb736640 20 client.4459.objecter put_session s=0x5599fa94cf80 osd=1 5 2023-11-05T08:08:38.859 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:38.841+0000 7faaeb736640 15 client.4459.objecter _session_op_remove 1 5 2023-11-05T08:08:38.860 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:38.841+0000 7faaeb736640 5 client.4459.objecter 1 in flight 2023-11-05T08:08:38.860 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:38.841+0000 7faaeb736640 1 -- 172.21.15.52:0/3032579076 <== osd.1 v2:172.21.15.52:6824/544646809 8 ==== osd_op_reply(6 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7faadc04f070 con 0x5599fab4cc70 2023-11-05T08:08:38.860 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:38.841+0000 7faaeb736640 10 client.4459.objecter ms_dispatch 0x5599fa95fee0 osd_op_reply(6 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 2023-11-05T08:08:38.860 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:38.841+0000 7faaeb736640 10 client.4459.objecter in handle_osd_op_reply 2023-11-05T08:08:38.860 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:38.841+0000 7faaeb736640 7 client.4459.objecter handle_osd_op_reply 6 ondisk uv 0 in 12.1 attempt 0 2023-11-05T08:08:38.861 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:38.841+0000 7faaeb736640 10 client.4459.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2023-11-05T08:08:38.861 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:38.841+0000 7faaeb736640 10 client.4459.objecter op 0 rval 0 len 0 2023-11-05T08:08:38.861 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: [ OK ] AsioRados.AsyncReadFuture (6218 ms) 2023-11-05T08:08:38.861 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:38.841+0000 7faaeb736640 15 client.4459.objecter handle_osd_op_reply completed tid 6 2023-11-05T08:08:38.861 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: [ RUN ] AsioRados.AsyncReadYield 2023-11-05T08:08:38.862 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:38.841+0000 7faaeb736640 15 client.4459.objecter _finish_op 6 2023-11-05T08:08:38.862 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:38.841+0000 7faaeb736640 20 client.4459.objecter put_session s=0x5599fa94cf80 osd=1 4 2023-11-05T08:08:38.862 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:38.841+0000 7faaeb736640 15 client.4459.objecter _session_op_remove 1 6 2023-11-05T08:08:38.862 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:38.841+0000 7faaeb736640 5 client.4459.objecter 0 in flight 2023-11-05T08:08:38.862 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:38.841+0000 7faaedc46780 10 client.4459.objecter _op_submit op 0x5599faaa0980 2023-11-05T08:08:38.863 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:38.841+0000 7faaedc46780 20 client.4459.objecter _calc_target epoch 45 base exist @12 precalc_pgid 0 pgid 0.0 is_read 2023-11-05T08:08:38.863 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:38.841+0000 7faaedc46780 20 client.4459.objecter _calc_target target exist @12 -> pgid 12.d3a59201 2023-11-05T08:08:38.863 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:38.841+0000 7faaedc46780 10 client.4459.objecter _calc_target raw pgid 12.d3a59201 -> actual 12.1 acting [1,6] primary 1 2023-11-05T08:08:38.863 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:38.841+0000 7faaedc46780 20 client.4459.objecter _get_session s=0x5599fa94cf80 osd=1 3 2023-11-05T08:08:38.864 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:38.841+0000 7faaedc46780 10 client.4459.objecter _op_submit oid exist '@12' '@12' [read 0~256] tid 7 osd.1 2023-11-05T08:08:38.864 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:38.841+0000 7faaedc46780 20 client.4459.objecter get_session s=0x5599fa94cf80 osd=1 3 2023-11-05T08:08:38.864 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:38.841+0000 7faaedc46780 15 client.4459.objecter _session_op_assign 1 7 2023-11-05T08:08:38.864 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:38.841+0000 7faaedc46780 15 client.4459.objecter _send_op 7 to 12.1 on osd.1 2023-11-05T08:08:38.864 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:38.841+0000 7faaedc46780 1 -- 172.21.15.52:0/3032579076 --> [v2:172.21.15.52:6824/544646809,v1:172.21.15.52:6825/544646809] -- osd_op(unknown.0.0:7 12.1 12:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45) v8 -- 0x5599faaa1180 con 0x5599fab4cc70 2023-11-05T08:08:38.865 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:38.841+0000 7faaedc46780 20 client.4459.objecter put_session s=0x5599fa94cf80 osd=1 4 2023-11-05T08:08:38.865 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:38.841+0000 7faaedc46780 5 client.4459.objecter 1 in flight 2023-11-05T08:08:38.865 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:38.841+0000 7faaedc46780 10 client.4459.objecter _op_submit op 0x5599fab902f0 2023-11-05T08:08:38.865 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:38.841+0000 7faaedc46780 20 client.4459.objecter _calc_target epoch 45 base noexist @12 precalc_pgid 0 pgid 0.0 is_read 2023-11-05T08:08:38.865 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:38.841+0000 7faaedc46780 20 client.4459.objecter _calc_target target noexist @12 -> pgid 12.a7bbaa1 2023-11-05T08:08:38.865 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:38.841+0000 7faaedc46780 10 client.4459.objecter _calc_target raw pgid 12.a7bbaa1 -> actual 12.1 acting [1,6] primary 1 2023-11-05T08:08:38.866 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:38.841+0000 7faaedc46780 20 client.4459.objecter _get_session s=0x5599fa94cf80 osd=1 4 2023-11-05T08:08:38.866 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:38.841+0000 7faaedc46780 10 client.4459.objecter _op_submit oid noexist '@12' '@12' [read 0~256] tid 8 osd.1 2023-11-05T08:08:38.866 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:38.841+0000 7faaedc46780 20 client.4459.objecter get_session s=0x5599fa94cf80 osd=1 4 2023-11-05T08:08:38.866 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:38.841+0000 7faaedc46780 15 client.4459.objecter _session_op_assign 1 8 2023-11-05T08:08:39.811 INFO:tasks.ceph.osd.6.smithi156.stderr:2023-11-05T08:08:39.802+0000 ea58640 -1 osd.6 47 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4540.0:2 16.1a 16:5c6776db:::0.obj:head [write 0~99 in=99b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24) 2023-11-05T08:08:40.872 INFO:tasks.ceph.osd.6.smithi156.stderr:2023-11-05T08:08:40.858+0000 ea58640 -1 osd.6 48 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4540.0:2 16.1a 16:5c6776db:::0.obj:head [write 0~99 in=99b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24) 2023-11-05T08:08:41.900 INFO:tasks.ceph.osd.6.smithi156.stderr:2023-11-05T08:08:41.899+0000 ea58640 -1 osd.6 49 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4540.0:2 16.1a 16:5c6776db:::0.obj:head [write 0~99 in=99b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24) 2023-11-05T08:08:42.893 INFO:tasks.ceph.osd.6.smithi156.stderr:2023-11-05T08:08:42.892+0000 ea58640 -1 osd.6 50 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4540.0:2 16.1a 16:5c6776db:::0.obj:head [write 0~99 in=99b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24) 2023-11-05T08:08:43.200 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:38.841+0000 7faaedc46780 15 client.4459.objecter _send_op 8 to 12.1 on osd.1 2023-11-05T08:08:43.200 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:38.841+0000 7faaedc46780 1 -- 172.21.15.52:0/3032579076 --> [v2:172.21.15.52:6824/544646809,v1:172.21.15.52:6825/544646809] -- osd_op(unknown.0.0:8 12.1 12:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45) v8 -- 0x5599fab90790 con 0x5599fab4cc70 2023-11-05T08:08:43.201 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:38.841+0000 7faaedc46780 20 client.4459.objecter put_session s=0x5599fa94cf80 osd=1 5 2023-11-05T08:08:43.201 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:38.841+0000 7faaedc46780 5 client.4459.objecter 2 in flight 2023-11-05T08:08:43.201 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:38.907+0000 7faad2ffd640 10 monclient: tick 2023-11-05T08:08:43.201 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:38.907+0000 7faad2ffd640 10 monclient: _check_auth_tickets 2023-11-05T08:08:43.201 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:38.907+0000 7faad2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:08:43.201 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:39.907+0000 7faad2ffd640 10 monclient: tick 2023-11-05T08:08:43.202 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:39.907+0000 7faad2ffd640 10 monclient: _check_auth_tickets 2023-11-05T08:08:43.202 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:39.907+0000 7faad2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:08:43.202 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:40.908+0000 7faad2ffd640 10 monclient: tick 2023-11-05T08:08:43.202 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:40.908+0000 7faad2ffd640 10 monclient: _check_auth_tickets 2023-11-05T08:08:43.203 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:40.908+0000 7faad2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:08:43.203 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:40.908+0000 7faad2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:08:43.203 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:41.908+0000 7faad2ffd640 10 monclient: tick 2023-11-05T08:08:43.203 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:41.908+0000 7faad2ffd640 10 monclient: _check_auth_tickets 2023-11-05T08:08:43.203 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:41.908+0000 7faad2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:08:43.203 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:42.908+0000 7faad2ffd640 10 monclient: tick 2023-11-05T08:08:43.204 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:42.908+0000 7faad2ffd640 10 monclient: _check_auth_tickets 2023-11-05T08:08:43.204 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:42.908+0000 7faad2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:08:43.204 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:42.999+0000 7faaed199640 10 client.4459.objecter tick 2023-11-05T08:08:43.204 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:43.198+0000 7faad3fff640 1 -- 172.21.15.52:0/3032579076 <== osd.1 v2:172.21.15.52:6824/544646809 9 ==== osd_map(46..48 src has 1..50) v4 ==== 4392+0+0 (crc 0 0 0) 0x7faadc05da50 con 0x5599fab4cc70 2023-11-05T08:08:43.204 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:43.198+0000 7faaeb736640 1 -- 172.21.15.52:0/3032579076 <== osd.1 v2:172.21.15.52:6824/544646809 10 ==== osd_op_reply(7 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) v8 ==== 149+0+5 (crc 0 0 0) 0x7faadc04f070 con 0x5599fab4cc70 2023-11-05T08:08:43.205 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:43.198+0000 7faad3fff640 10 client.4459.objecter ms_dispatch 0x5599fa95fee0 osd_map(46..48 src has 1..50) v4 2023-11-05T08:08:43.205 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:43.198+0000 7faaeb736640 10 client.4459.objecter ms_dispatch 0x5599fa95fee0 osd_op_reply(7 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) v8 2023-11-05T08:08:43.205 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:43.198+0000 7faaeb736640 10 client.4459.objecter in handle_osd_op_reply 2023-11-05T08:08:43.205 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:43.198+0000 7faad3fff640 3 client.4459.objecter handle_osd_map got epochs [46,48] > 45 2023-11-05T08:08:43.205 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:43.198+0000 7faad3fff640 3 client.4459.objecter handle_osd_map decoding incremental epoch 46 2023-11-05T08:08:43.206 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:43.198+0000 7faad3fff640 10 client.4459.objecter checking op 7 2023-11-05T08:08:43.206 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:43.198+0000 7faad3fff640 20 client.4459.objecter _calc_target epoch 46 base exist @12 precalc_pgid 0 pgid 0.0 is_read 2023-11-05T08:08:43.206 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:43.198+0000 7faad3fff640 20 client.4459.objecter _calc_target target exist @12 -> pgid 12.d3a59201 2023-11-05T08:08:43.206 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:43.198+0000 7faad3fff640 10 client.4459.objecter checking op 8 2023-11-05T08:08:43.206 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:43.198+0000 7faad3fff640 20 client.4459.objecter _calc_target epoch 46 base noexist @12 precalc_pgid 0 pgid 0.0 is_read 2023-11-05T08:08:43.206 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:43.198+0000 7faad3fff640 20 client.4459.objecter _calc_target target noexist @12 -> pgid 12.a7bbaa1 2023-11-05T08:08:43.207 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:43.198+0000 7faad3fff640 3 client.4459.objecter handle_osd_map decoding incremental epoch 47 2023-11-05T08:08:43.207 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:43.198+0000 7faad3fff640 10 client.4459.objecter checking op 7 2023-11-05T08:08:43.207 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:43.198+0000 7faad3fff640 20 client.4459.objecter _calc_target epoch 47 base exist @12 precalc_pgid 0 pgid 0.0 is_read 2023-11-05T08:08:43.207 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:43.198+0000 7faad3fff640 20 client.4459.objecter _calc_target target exist @12 -> pgid 12.d3a59201 2023-11-05T08:08:43.207 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:43.198+0000 7faad3fff640 10 client.4459.objecter checking op 8 2023-11-05T08:08:43.208 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:43.198+0000 7faad3fff640 20 client.4459.objecter _calc_target epoch 47 base noexist @12 precalc_pgid 0 pgid 0.0 is_read 2023-11-05T08:08:43.208 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:43.198+0000 7faad3fff640 20 client.4459.objecter _calc_target target noexist @12 -> pgid 12.a7bbaa1 2023-11-05T08:08:43.208 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:43.198+0000 7faad3fff640 3 client.4459.objecter handle_osd_map decoding incremental epoch 48 2023-11-05T08:08:43.208 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:43.198+0000 7faad3fff640 10 client.4459.objecter checking op 7 2023-11-05T08:08:43.208 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:43.198+0000 7faad3fff640 20 client.4459.objecter _calc_target epoch 48 base exist @12 precalc_pgid 0 pgid 0.0 is_read 2023-11-05T08:08:43.209 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:43.198+0000 7faad3fff640 20 client.4459.objecter _calc_target target exist @12 -> pgid 12.d3a59201 2023-11-05T08:08:43.209 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:43.198+0000 7faad3fff640 10 client.4459.objecter checking op 8 2023-11-05T08:08:43.209 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:43.198+0000 7faad3fff640 20 client.4459.objecter _calc_target epoch 48 base noexist @12 precalc_pgid 0 pgid 0.0 is_read 2023-11-05T08:08:43.209 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:43.198+0000 7faad3fff640 20 client.4459.objecter _calc_target target noexist @12 -> pgid 12.a7bbaa1 2023-11-05T08:08:43.209 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:43.198+0000 7faad3fff640 10 client.4459.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-05T08:08:43.209 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:43.198+0000 7faad3fff640 10 monclient: _renew_subs 2023-11-05T08:08:43.210 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:43.198+0000 7faad3fff640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:08:43.210 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:43.198+0000 7faad3fff640 1 -- 172.21.15.52:0/3032579076 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=49}) v3 -- 0x7faacc07bc10 con 0x5599faa06c70 2023-11-05T08:08:43.210 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:43.198+0000 7faad3fff640 20 client.4459.objecter dump_active .. 0 homeless 2023-11-05T08:08:43.210 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:43.198+0000 7faad3fff640 20 client.4459.objecter 7 12.d3a59201 osd.1 exist [read 0~256] 2023-11-05T08:08:43.210 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:43.198+0000 7faad3fff640 20 client.4459.objecter 8 12.a7bbaa1 osd.1 noexist [read 0~256] 2023-11-05T08:08:43.211 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:43.198+0000 7faaeb736640 7 client.4459.objecter handle_osd_op_reply 7 ondisk uv 1 in 12.1 attempt 0 2023-11-05T08:08:43.211 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:43.198+0000 7faaeb736640 10 client.4459.objecter op 0 rval 0 len 5 2023-11-05T08:08:43.211 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:43.198+0000 7faaeb736640 15 client.4459.objecter handle_osd_op_reply completed tid 7 2023-11-05T08:08:43.211 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:43.198+0000 7faaeb736640 15 client.4459.objecter _finish_op 7 2023-11-05T08:08:43.211 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:43.198+0000 7faaeb736640 20 client.4459.objecter put_session s=0x5599fa94cf80 osd=1 5 2023-11-05T08:08:43.212 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:43.198+0000 7faaeb736640 15 client.4459.objecter _session_op_remove 1 7 2023-11-05T08:08:43.212 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:43.198+0000 7faaeb736640 5 client.4459.objecter 1 in flight 2023-11-05T08:08:43.212 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:43.198+0000 7faaeb736640 1 -- 172.21.15.52:0/3032579076 <== osd.1 v2:172.21.15.52:6824/544646809 11 ==== osd_op_reply(8 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7faadc04f070 con 0x5599fab4cc70 2023-11-05T08:08:43.212 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:43.198+0000 7faaeb736640 10 client.4459.objecter ms_dispatch 0x5599fa95fee0 osd_op_reply(8 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 2023-11-05T08:08:43.212 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:43.198+0000 7faaeb736640 10 client.4459.objecter in handle_osd_op_reply 2023-11-05T08:08:43.213 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:43.198+0000 7faaeb736640 7 client.4459.objecter handle_osd_op_reply 8 ondisk uv 0 in 12.1 attempt 0 2023-11-05T08:08:43.213 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: [ OK ] AsioRados.AsyncReadYield (4358 ms) 2023-11-05T08:08:43.213 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:43.198+0000 7faaeb736640 10 client.4459.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2023-11-05T08:08:43.213 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:43.198+0000 7faaeb736640 10 client.4459.objecter op 0 rval 0 len 0 2023-11-05T08:08:43.214 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteCallback 2023-11-05T08:08:43.214 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:43.198+0000 7faaeb736640 15 client.4459.objecter handle_osd_op_reply completed tid 8 2023-11-05T08:08:43.214 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:43.198+0000 7faaeb736640 15 client.4459.objecter _finish_op 8 2023-11-05T08:08:43.214 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:43.198+0000 7faaeb736640 20 client.4459.objecter put_session s=0x5599fa94cf80 osd=1 4 2023-11-05T08:08:43.214 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:43.198+0000 7faaeb736640 15 client.4459.objecter _session_op_remove 1 8 2023-11-05T08:08:43.215 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:43.198+0000 7faaeb736640 5 client.4459.objecter 0 in flight 2023-11-05T08:08:43.215 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:43.198+0000 7faaedc46780 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=head 2023-11-05T08:08:43.215 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:43.198+0000 7faaedc46780 20 librados: queue_aio_write 0x5599fa986fe0 completion 0x5599faa8d3d0 write_seq 1 2023-11-05T08:08:43.215 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:43.198+0000 7faaedc46780 10 client.4459.objecter _op_submit op 0x5599faaa0980 2023-11-05T08:08:43.215 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:43.198+0000 7faaedc46780 20 client.4459.objecter _calc_target epoch 48 base exist @12 precalc_pgid 0 pgid 0.0 is_write 2023-11-05T08:08:43.216 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:43.198+0000 7faaedc46780 20 client.4459.objecter _calc_target target exist @12 -> pgid 12.d3a59201 2023-11-05T08:08:43.216 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:43.199+0000 7faaedc46780 10 client.4459.objecter _calc_target raw pgid 12.d3a59201 -> actual 12.1 acting [1,6] primary 1 2023-11-05T08:08:43.216 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:43.199+0000 7faaedc46780 20 client.4459.objecter _get_session s=0x5599fa94cf80 osd=1 3 2023-11-05T08:08:43.216 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:43.199+0000 7faaedc46780 10 client.4459.objecter _op_submit oid exist '@12' '@12' [write 0~5 in=5b] tid 9 osd.1 2023-11-05T08:08:43.216 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:43.199+0000 7faaedc46780 20 client.4459.objecter get_session s=0x5599fa94cf80 osd=1 3 2023-11-05T08:08:43.217 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:43.199+0000 7faaedc46780 15 client.4459.objecter _session_op_assign 1 9 2023-11-05T08:08:43.217 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:43.199+0000 7faaedc46780 15 client.4459.objecter _send_op 9 to 12.1 on osd.1 2023-11-05T08:08:43.217 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:43.199+0000 7faaedc46780 1 -- 172.21.15.52:0/3032579076 --> [v2:172.21.15.52:6824/544646809,v1:172.21.15.52:6825/544646809] -- osd_op(unknown.0.0:9 12.1 12:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) v8 -- 0x5599fa9d2d80 con 0x5599fab4cc70 2023-11-05T08:08:43.217 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:43.199+0000 7faaedc46780 20 client.4459.objecter put_session s=0x5599fa94cf80 osd=1 4 2023-11-05T08:08:43.217 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:43.199+0000 7faaedc46780 5 client.4459.objecter 1 in flight 2023-11-05T08:08:43.319 INFO:tasks.ceph.osd.1.smithi052.stderr:2023-11-05T08:08:43.216+0000 ea58640 -1 osd.1 49 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4355.0:2 17.2 17:4638622d:test-rados-api-smithi052-91779-2::foo:head [call lock.lock in=57b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26) 2023-11-05T08:08:43.864 INFO:tasks.ceph.osd.6.smithi156.stderr:2023-11-05T08:08:43.862+0000 ea58640 -1 osd.6 51 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4540.0:2 16.1a 16:5c6776db:::0.obj:head [write 0~99 in=99b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24) 2023-11-05T08:08:44.170 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:43.199+0000 7faaedc46780 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=1 2023-11-05T08:08:44.170 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:43.201+0000 7faad3fff640 1 -- 172.21.15.52:0/3032579076 <== mon.1 v2:172.21.15.156:3300/0 9 ==== osd_map(49..51 src has 1..51) v4 ==== 3377+0+0 (secure 0 0 0) 0x7faad4060bf0 con 0x5599faa06c70 2023-11-05T08:08:44.171 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:43.201+0000 7faad3fff640 10 client.4459.objecter ms_dispatch 0x5599fa95fee0 osd_map(49..51 src has 1..51) v4 2023-11-05T08:08:44.171 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:43.201+0000 7faad3fff640 3 client.4459.objecter handle_osd_map got epochs [49,51] > 48 2023-11-05T08:08:44.171 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:43.201+0000 7faad3fff640 3 client.4459.objecter handle_osd_map decoding incremental epoch 49 2023-11-05T08:08:44.171 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:43.201+0000 7faad3fff640 10 client.4459.objecter checking op 9 2023-11-05T08:08:44.172 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:43.201+0000 7faad3fff640 20 client.4459.objecter _calc_target epoch 49 base exist @12 precalc_pgid 0 pgid 0.0 is_write 2023-11-05T08:08:44.172 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:43.201+0000 7faad3fff640 20 client.4459.objecter _calc_target target exist @12 -> pgid 12.d3a59201 2023-11-05T08:08:44.172 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:43.201+0000 7faad3fff640 3 client.4459.objecter handle_osd_map decoding incremental epoch 50 2023-11-05T08:08:44.172 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:43.201+0000 7faad3fff640 10 client.4459.objecter checking op 9 2023-11-05T08:08:44.172 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:43.201+0000 7faad3fff640 20 client.4459.objecter _calc_target epoch 50 base exist @12 precalc_pgid 0 pgid 0.0 is_write 2023-11-05T08:08:44.173 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:43.201+0000 7faad3fff640 20 client.4459.objecter _calc_target target exist @12 -> pgid 12.d3a59201 2023-11-05T08:08:44.173 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:43.201+0000 7faad3fff640 3 client.4459.objecter handle_osd_map decoding incremental epoch 51 2023-11-05T08:08:44.173 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:43.201+0000 7faad3fff640 10 client.4459.objecter checking op 9 2023-11-05T08:08:44.173 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:43.201+0000 7faad3fff640 20 client.4459.objecter _calc_target epoch 51 base exist @12 precalc_pgid 0 pgid 0.0 is_write 2023-11-05T08:08:44.173 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:43.201+0000 7faad3fff640 20 client.4459.objecter _calc_target target exist @12 -> pgid 12.d3a59201 2023-11-05T08:08:44.173 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:43.201+0000 7faad3fff640 10 client.4459.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-05T08:08:44.174 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:43.201+0000 7faad3fff640 10 monclient: _renew_subs 2023-11-05T08:08:44.174 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:43.201+0000 7faad3fff640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:08:44.174 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:43.201+0000 7faad3fff640 1 -- 172.21.15.52:0/3032579076 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=52}) v3 -- 0x7faacc0800e0 con 0x5599faa06c70 2023-11-05T08:08:44.174 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:43.201+0000 7faad3fff640 20 client.4459.objecter dump_active .. 0 homeless 2023-11-05T08:08:44.174 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:43.201+0000 7faad3fff640 20 client.4459.objecter 9 12.d3a59201 osd.1 exist [write 0~5 in=5b] 2023-11-05T08:08:44.175 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:43.908+0000 7faad2ffd640 10 monclient: tick 2023-11-05T08:08:44.175 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:43.908+0000 7faad2ffd640 10 monclient: _check_auth_tickets 2023-11-05T08:08:44.175 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:43.908+0000 7faad2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:08:44.176 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:44.168+0000 7faad3fff640 1 -- 172.21.15.52:0/3032579076 <== mon.1 v2:172.21.15.156:3300/0 10 ==== osd_map(52..52 src has 1..52) v4 ==== 1067+0+0 (secure 0 0 0) 0x7faad40700e0 con 0x5599faa06c70 2023-11-05T08:08:44.176 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:44.168+0000 7faad3fff640 10 client.4459.objecter ms_dispatch 0x5599fa95fee0 osd_map(52..52 src has 1..52) v4 2023-11-05T08:08:44.176 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:44.168+0000 7faad3fff640 3 client.4459.objecter handle_osd_map got epochs [52,52] > 51 2023-11-05T08:08:44.536 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:44.168+0000 7faad3fff640 3 client.4459.objecter handle_osd_map decoding increme api_service_pp: [==========] Running 4 tests from 1 test suite. 2023-11-05T08:08:44.537 INFO:tasks.workunit.client.0.smithi052.stdout: api_service_pp: [----------] Global test environment set-up. 2023-11-05T08:08:44.537 INFO:tasks.workunit.client.0.smithi052.stdout: api_service_pp: [----------] 4 tests from LibRadosServicePP 2023-11-05T08:08:44.537 INFO:tasks.workunit.client.0.smithi052.stdout: api_service_pp: [ RUN ] LibRadosServicePP.RegisterEarly 2023-11-05T08:08:44.537 INFO:tasks.workunit.client.0.smithi052.stdout: api_service_pp: [ OK ] LibRadosServicePP.RegisterEarly (5378 ms) 2023-11-05T08:08:44.538 INFO:tasks.workunit.client.0.smithi052.stdout: api_service_pp: [ RUN ] LibRadosServicePP.RegisterLate 2023-11-05T08:08:44.538 INFO:tasks.workunit.client.0.smithi052.stdout: api_service_pp: [ OK ] LibRadosServicePP.RegisterLate (153 ms) 2023-11-05T08:08:44.538 INFO:tasks.workunit.client.0.smithi052.stdout: api_service_pp: [ RUN ] LibRadosServicePP.Status 2023-11-05T08:08:44.538 INFO:tasks.workunit.client.0.smithi052.stdout: api_service_pp: [ OK ] LibRadosServicePP.Status (20103 ms) 2023-11-05T08:08:44.538 INFO:tasks.workunit.client.0.smithi052.stdout: api_service_pp: [ RUN ] LibRadosServicePP.Close 2023-11-05T08:08:44.539 INFO:tasks.workunit.client.0.smithi052.stdout: api_service_pp: attempt 0 of 20 2023-11-05T08:08:44.539 INFO:tasks.workunit.client.0.smithi052.stdout: api_service_pp: failed to deregister: 2023-11-05T08:08:44.539 INFO:tasks.workunit.client.0.smithi052.stdout: api_service_pp: { 2023-11-05T08:08:44.539 INFO:tasks.workunit.client.0.smithi052.stdout: api_service_pp: "epoch": 10, 2023-11-05T08:08:44.539 INFO:tasks.workunit.client.0.smithi052.stdout: api_service_pp: "modified": "2023-11-05T08:08:37.147913+0000", 2023-11-05T08:08:44.540 INFO:tasks.workunit.client.0.smithi052.stdout: api_service_pp: "services": { 2023-11-05T08:08:44.540 INFO:tasks.workunit.client.0.smithi052.stdout: api_service_pp: "laundry": { 2023-11-05T08:08:44.540 INFO:tasks.workunit.client.0.smithi052.stdout: api_service_pp: "daemons": { 2023-11-05T08:08:44.540 INFO:tasks.workunit.client.0.smithi052.stdout: api_service_pp: "summary": "", 2023-11-05T08:08:44.540 INFO:tasks.workunit.client.0.smithi052.stdout: api_service_pp: "close-test-pid92214": { 2023-11-05T08:08:44.541 INFO:tasks.workunit.client.0.smithi052.stdout: api_service_pp: "start_epoch": 9, 2023-11-05T08:08:44.541 INFO:tasks.workunit.client.0.smithi052.stdout: api_service_pp: "start_stamp": "2023-11-05T08:08:34.199743+0000", 2023-11-05T08:08:44.541 INFO:tasks.workunit.client.0.smithi052.stdout: api_service_pp: "gid": 4587, 2023-11-05T08:08:44.541 INFO:tasks.workunit.client.0.smithi052.stdout: api_service_pp: "addr": "172.21.15.52:0/4207622429", 2023-11-05T08:08:44.541 INFO:tasks.workunit.client.0.smithi052.stdout: api_service_pp: "metadata": { 2023-11-05T08:08:44.542 INFO:tasks.workunit.client.0.smithi052.stdout: api_service_pp: "arch": "x86_64", 2023-11-05T08:08:44.542 INFO:tasks.workunit.client.0.smithi052.stdout: api_service_pp: "ceph_release": "reef", 2023-11-05T08:08:44.542 INFO:tasks.workunit.client.0.smithi052.stdout: api_service_pp: "ceph_version": "ceph version 18.0.0-6776-g420cd129 (420cd129397301b1521ceb74e1bdbd9b855d2189) reef (dev)", 2023-11-05T08:08:44.542 INFO:tasks.workunit.client.0.smithi052.stdout: api_service_pp: "ceph_version_short": "18.0.0-6776-g420cd129", 2023-11-05T08:08:44.542 INFO:tasks.workunit.client.0.smithi052.stdout: api_service_pp: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v3 @ 3.50GHz", 2023-11-05T08:08:44.543 INFO:tasks.workunit.client.0.smithi052.stdout: api_service_pp: "distro": "centos", 2023-11-05T08:08:44.543 INFO:tasks.workunit.client.0.smithi052.stdout: api_service_pp: "distro_description": "CentOS Stream 9", 2023-11-05T08:08:44.543 INFO:tasks.workunit.client.0.smithi052.stdout: api_service_pp: "distro_version": "9", 2023-11-05T08:08:44.543 INFO:tasks.workunit.client.0.smithi052.stdout: api_service_pp: "foo": "bar", 2023-11-05T08:08:44.543 INFO:tasks.workunit.client.0.smithi052.stdout: api_service_pp: "hostname": "smithi052", 2023-11-05T08:08:44.544 INFO:tasks.workunit.client.0.smithi052.stdout: api_service_pp: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Thu Oct 19 18:39:36 UTC 2023", 2023-11-05T08:08:44.544 INFO:tasks.workunit.client.0.smithi052.stdout: api_service_pp: "kernel_version": "5.14.0-378.el9.x86_64", 2023-11-05T08:08:44.544 INFO:tasks.workunit.client.0.smithi052.stdout: api_service_pp: "mem_swap_kb": "0", 2023-11-05T08:08:44.544 INFO:tasks.workunit.client.0.smithi052.stdout: api_service_pp: "mem_total_kb": "32494904", 2023-11-05T08:08:44.544 INFO:tasks.workunit.client.0.smithi052.stdout: api_service_pp: "os": "Linux", 2023-11-05T08:08:44.545 INFO:tasks.workunit.client.0.smithi052.stdout: api_service_pp: "this": "that" 2023-11-05T08:08:44.545 INFO:tasks.workunit.client.0.smithi052.stdout: api_service_pp: }, 2023-11-05T08:08:44.545 INFO:tasks.workunit.client.0.smithi052.stdout: api_service_pp: "task_status": {} 2023-11-05T08:08:44.545 INFO:tasks.workunit.client.0.smithi052.stdout: api_service_pp: } 2023-11-05T08:08:44.545 INFO:tasks.workunit.client.0.smithi052.stdout: api_service_pp: } 2023-11-05T08:08:44.546 INFO:tasks.workunit.client.0.smithi052.stdout: api_service_pp: } 2023-11-05T08:08:44.546 INFO:tasks.workunit.client.0.smithi052.stdout: api_service_pp: } 2023-11-05T08:08:44.546 INFO:tasks.workunit.client.0.smithi052.stdout: api_service_pp: } 2023-11-05T08:08:44.546 INFO:tasks.workunit.client.0.smithi052.stdout: api_service_pp: 2023-11-05T08:08:44.547 INFO:tasks.workunit.client.0.smithi052.stdout: api_service_pp: attempt 1 of 20 2023-11-05T08:08:44.547 INFO:tasks.workunit.client.0.smithi052.stdout: api_service_pp: [ OK ] LibRadosServicePP.Close (10854 ms) 2023-11-05T08:08:44.547 INFO:tasks.workunit.client.0.smithi052.stdout: api_service_pp: [----------] 4 tests from LibRadosServicePP (36488 ms total) 2023-11-05T08:08:44.547 INFO:tasks.workunit.client.0.smithi052.stdout: api_service_pp: 2023-11-05T08:08:44.548 INFO:tasks.workunit.client.0.smithi052.stdout: api_service_pp: [----------] Global test environment tear-down 2023-11-05T08:08:44.548 INFO:tasks.workunit.client.0.smithi052.stdout: api_service_pp: [==========] 4 tests from 1 test suite ran. (36488 ms total) 2023-11-05T08:08:44.548 INFO:tasks.workunit.client.0.smithi052.stdout: api_service_pp: [ PASSED ] 4 tests. 2023-11-05T08:08:44.945 INFO:tasks.ceph.osd.6.smithi156.stderr:2023-11-05T08:08:44.870+0000 ea58640 -1 osd.6 52 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4540.0:2 16.1a 16:5c6776db:::0.obj:head [write 0~99 in=99b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24) 2023-11-05T08:08:45.153 INFO:tasks.workunit.client.0.smithi052.stdout:ntal epoch 52 2023-11-05T08:08:45.153 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:44.168+0000 7faad3fff640 10 client.4459.objecter checking op 9 2023-11-05T08:08:45.153 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:44.168+0000 7faad3fff640 20 client.4459.objecter _calc_target epoch 52 base exist @12 precalc_pgid 0 pgid 0.0 is_write 2023-11-05T08:08:45.154 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:44.168+0000 7faad3fff640 20 client.4459.objecter _calc_target target exist @12 -> pgid 12.d3a59201 2023-11-05T08:08:45.154 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:44.168+0000 7faad3fff640 10 client.4459.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-05T08:08:45.154 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:44.168+0000 7faad3fff640 10 monclient: _renew_subs 2023-11-05T08:08:45.154 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:44.168+0000 7faad3fff640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:08:45.154 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:44.168+0000 7faad3fff640 1 -- 172.21.15.52:0/3032579076 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=53}) v3 -- 0x7faacc0800e0 con 0x5599faa06c70 2023-11-05T08:08:45.155 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:44.168+0000 7faad3fff640 20 client.4459.objecter dump_active .. 0 homeless 2023-11-05T08:08:45.155 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:44.168+0000 7faad3fff640 20 client.4459.objecter 9 12.d3a59201 osd.1 exist [write 0~5 in=5b] 2023-11-05T08:08:45.155 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:44.317+0000 7faad3fff640 1 -- 172.21.15.52:0/3032579076 <== osd.1 v2:172.21.15.52:6824/544646809 12 ==== osd_map(49..50 src has 1..51) v4 ==== 975+0+0 (crc 0 0 0) 0x7faadc052840 con 0x5599fab4cc70 2023-11-05T08:08:45.155 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:44.317+0000 7faad3fff640 10 client.4459.objecter ms_dispatch 0x5599fa95fee0 osd_map(49..50 src has 1..51) v4 2023-11-05T08:08:45.155 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:44.317+0000 7faad3fff640 3 client.4459.objecter handle_osd_map ignoring epochs [49,50] <= 52 2023-11-05T08:08:45.156 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:44.317+0000 7faad3fff640 10 client.4459.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-05T08:08:45.156 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:44.317+0000 7faad3fff640 20 client.4459.objecter dump_active .. 0 homeless 2023-11-05T08:08:45.156 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:44.317+0000 7faad3fff640 20 client.4459.objecter 9 12.d3a59201 osd.1 exist [write 0~5 in=5b] 2023-11-05T08:08:45.156 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:44.908+0000 7faad2ffd640 10 monclient: tick 2023-11-05T08:08:45.156 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:44.908+0000 7faad2ffd640 10 monclient: _check_auth_tickets 2023-11-05T08:08:45.157 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:44.908+0000 7faad2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:08:45.157 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:45.151+0000 7faad3fff640 1 -- 172.21.15.52:0/3032579076 <== mon.1 v2:172.21.15.156:3300/0 11 ==== osd_map(53..53 src has 1..53) v4 ==== 1051+0+0 (secure 0 0 0) 0x7faad4055000 con 0x5599faa06c70 2023-11-05T08:08:45.157 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:45.151+0000 7faad3fff640 10 client.4459.objecter ms_dispatch 0x5599fa95fee0 osd_map(53..53 src has 1..53) v4 2023-11-05T08:08:45.157 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:45.151+0000 7faad3fff640 3 client.4459.objecter handle_osd_map got epochs [53,53] > 52 2023-11-05T08:08:45.157 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:45.151+0000 7faad3fff640 3 client.4459.objecter handle_osd_map decoding incremental epoch 53 2023-11-05T08:08:45.158 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:45.151+0000 7faad3fff640 10 client.4459.objecter checking op 9 2023-11-05T08:08:45.158 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:45.151+0000 7faad3fff640 20 client.4459.objecter _calc_target epoch 53 base exist @12 precalc_pgid 0 pgid 0.0 is_write 2023-11-05T08:08:45.158 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:45.151+0000 7faad3fff640 20 client.4459.objecter _calc_target target exist @12 -> pgid 12.d3a59201 2023-11-05T08:08:45.158 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:45.151+0000 7faad3fff640 10 client.4459.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-05T08:08:45.159 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:45.151+0000 7faad3fff640 10 monclient: _renew_subs 2023-11-05T08:08:45.159 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:45.151+0000 7faad3fff640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:08:45.539 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:45.151+0000 7faad3fff640 1 -- 172.21.15.52:0/3032579076 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=54}) v3 -- 0x7faacc0800e0 con 0x5599faa06c70 2023-11-05T08:08:45.539 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:45.151+0000 7faad3fff640 20 client.4459.objecter dump_active .. 0 homeless 2023-11-05T08:08:45.540 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:45.151+0000 7faad3fff640 20 client.4459.objecter 9 12.d3a59201 osd.1 exist [write 0~5 in=5b] 2023-11-05T08:08:45.540 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:45.537+0000 7faaeb736640 1 -- 172.21.15.52:0/3032579076 <== osd.1 v2:172.21.15.52:6824/544646809 13 ==== osd_op_reply(9 exist [write 0~5] v50'2 uv2 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7faadc04f070 con 0x5599fab4cc70 2023-11-05T08:08:45.540 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:45.537+0000 7faaeb736640 10 client.4459.objecter ms_dispatch 0x5599fa95fee0 osd_op_reply(9 exist [write 0~5] v50'2 uv2 ondisk = 0) v8 2023-11-05T08:08:45.540 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:45.537+0000 7faaeb736640 10 client.4459.objecter in handle_osd_op_reply 2023-11-05T08:08:45.540 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:45.537+0000 7faaeb736640 7 client.4459.objecter handle_osd_op_reply 9 ondisk uv 2 in 12.1 attempt 0 2023-11-05T08:08:45.541 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:45.537+0000 7faaeb736640 10 client.4459.objecter op 0 rval 0 len 0 2023-11-05T08:08:45.541 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:45.537+0000 7faaeb736640 15 client.4459.objecter handle_osd_op_reply completed tid 9 2023-11-05T08:08:45.541 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:45.538+0000 7faaeb736640 15 client.4459.objecter _finish_op 9 2023-11-05T08:08:45.541 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:45.538+0000 7faaeb736640 20 client.4459.objecter put_session s=0x5599fa94cf80 osd=1 4 2023-11-05T08:08:45.541 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:45.538+0000 7faaeb736640 15 client.4459.objecter _session_op_remove 1 9 2023-11-05T08:08:45.542 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:45.538+0000 7faaeb736640 5 client.4459.objecter 0 in flight 2023-11-05T08:08:45.542 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:45.538+0000 7faaeb736640 20 librados: complete_aio_write 0x5599faa8d3d0 2023-11-05T08:08:45.542 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: [ OK ] AsioRados.AsyncWriteCallback (2339 ms) 2023-11-05T08:08:45.542 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteFuture 2023-11-05T08:08:45.542 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:45.538+0000 7faaedc46780 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=head 2023-11-05T08:08:45.543 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:45.538+0000 7faaedc46780 20 librados: queue_aio_write 0x5599fa986fe0 completion 0x5599fa9d30e0 write_seq 2 2023-11-05T08:08:45.543 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:45.538+0000 7faaedc46780 10 client.4459.objecter _op_submit op 0x5599faaa0980 2023-11-05T08:08:45.543 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:45.538+0000 7faaedc46780 20 client.4459.objecter _calc_target epoch 53 base exist @12 precalc_pgid 0 pgid 0.0 is_write 2023-11-05T08:08:45.543 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:45.538+0000 7faaedc46780 20 client.4459.objecter _calc_target target exist @12 -> pgid 12.d3a59201 2023-11-05T08:08:45.543 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:45.538+0000 7faaedc46780 10 client.4459.objecter _calc_target raw pgid 12.d3a59201 -> actual 12.1 acting [1,6] primary 1 2023-11-05T08:08:45.544 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:45.538+0000 7faaedc46780 20 client.4459.objecter _get_session s=0x5599fa94cf80 osd=1 3 2023-11-05T08:08:45.544 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:45.538+0000 7faaedc46780 10 client.4459.objecter _op_submit oid exist '@12' '@12' [write 0~5 in=5b] tid 10 osd.1 2023-11-05T08:08:45.544 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:45.538+0000 7faaedc46780 20 client.4459.objecter get_session s=0x5599fa94cf80 osd=1 3 2023-11-05T08:08:45.544 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:45.538+0000 7faaedc46780 15 client.4459.objecter _session_op_assign 1 10 2023-11-05T08:08:45.544 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:45.538+0000 7faaedc46780 15 client.4459.objecter _send_op 10 to 12.1 on osd.1 2023-11-05T08:08:45.545 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:45.538+0000 7faaedc46780 1 -- 172.21.15.52:0/3032579076 --> [v2:172.21.15.52:6824/544646809,v1:172.21.15.52:6825/544646809] -- osd_op(unknown.0.0:10 12.1 12:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53) v8 -- 0x5599fa9d2d80 con 0x5599fab4cc70 2023-11-05T08:08:45.545 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:45.538+0000 7faaedc46780 20 client.4459.objecter put_session s=0x5599fa94cf80 osd=1 4 2023-11-05T08:08:46.026 INFO:tasks.ceph.osd.6.smithi156.stderr:2023-11-05T08:08:45.911+0000 ea58640 -1 osd.6 53 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4540.0:2 16.1a 16:5c6776db:::0.obj:head [write 0~99 in=99b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24) 2023-11-05T08:08:47.263 INFO:tasks.ceph.osd.6.smithi156.stderr:2023-11-05T08:08:47.252+0000 ea58640 -1 osd.6 54 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4540.0:2 16.1a 16:5c6776db:::0.obj:head [write 0~99 in=99b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24) 2023-11-05T08:08:47.510 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:45.538+0000 7faaedc46780 5 client.4459.objecter 1 in flight 2023-11-05T08:08:47.511 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:45.538+0000 7faaedc46780 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=1 2023-11-05T08:08:47.511 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:45.908+0000 7faad2ffd640 10 monclient: tick 2023-11-05T08:08:47.511 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:45.908+0000 7faad2ffd640 10 monclient: _check_auth_tickets 2023-11-05T08:08:47.511 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:45.908+0000 7faad2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:08:47.512 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:46.274+0000 7faad3fff640 1 -- 172.21.15.52:0/3032579076 <== mon.1 v2:172.21.15.156:3300/0 12 ==== osd_map(54..54 src has 1..54) v4 ==== 1016+0+0 (secure 0 0 0) 0x7faad4055000 con 0x5599faa06c70 2023-11-05T08:08:47.512 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:46.274+0000 7faad3fff640 10 client.4459.objecter ms_dispatch 0x5599fa95fee0 osd_map(54..54 src has 1..54) v4 2023-11-05T08:08:47.512 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:46.274+0000 7faad3fff640 3 client.4459.objecter handle_osd_map got epochs [54,54] > 53 2023-11-05T08:08:47.512 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:46.274+0000 7faad3fff640 3 client.4459.objecter handle_osd_map decoding incremental epoch 54 2023-11-05T08:08:47.513 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:46.274+0000 7faad3fff640 10 client.4459.objecter checking op 10 2023-11-05T08:08:47.513 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:46.274+0000 7faad3fff640 20 client.4459.objecter _calc_target epoch 54 base exist @12 precalc_pgid 0 pgid 0.0 is_write 2023-11-05T08:08:47.513 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:46.274+0000 7faad3fff640 20 client.4459.objecter _calc_target target exist @12 -> pgid 12.d3a59201 2023-11-05T08:08:47.513 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:46.274+0000 7faad3fff640 10 client.4459.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-05T08:08:47.513 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:46.274+0000 7faad3fff640 10 monclient: _renew_subs 2023-11-05T08:08:47.514 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:46.274+0000 7faad3fff640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:08:47.514 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:46.274+0000 7faad3fff640 1 -- 172.21.15.52:0/3032579076 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=55}) v3 -- 0x7faacc0800e0 con 0x5599faa06c70 2023-11-05T08:08:47.514 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:46.274+0000 7faad3fff640 20 client.4459.objecter dump_active .. 0 homeless 2023-11-05T08:08:47.514 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:46.274+0000 7faad3fff640 20 client.4459.objecter 10 12.d3a59201 osd.1 exist [write 0~5 in=5b] 2023-11-05T08:08:47.515 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:46.908+0000 7faad2ffd640 10 monclient: tick 2023-11-05T08:08:47.515 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:46.908+0000 7faad2ffd640 10 monclient: _check_auth_tickets 2023-11-05T08:08:47.515 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:46.908+0000 7faad2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:08:47.515 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:47.508+0000 7faad3fff640 1 -- 172.21.15.52:0/3032579076 <== mon.1 v2:172.21.15.156:3300/0 13 ==== osd_map(55..55 src has 1..55) v4 ==== 692+0+0 (secure 0 0 0) 0x7faad4058b50 con 0x5599faa06c70 2023-11-05T08:08:47.515 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:47.509+0000 7faad3fff640 10 client.4459.objecter ms_dispatch 0x5599fa95fee0 osd_map(55..55 src has 1..55) v4 2023-11-05T08:08:47.516 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:47.509+0000 7faad3fff640 3 client.4459.objecter handle_osd_map got epochs [55,55] > 54 2023-11-05T08:08:47.516 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:47.509+0000 7faad3fff640 3 client.4459.objecter handle_osd_map decoding incremental epoch 55 2023-11-05T08:08:47.516 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:47.509+0000 7faad3fff640 10 client.4459.objecter checking op 10 2023-11-05T08:08:47.516 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:47.509+0000 7faad3fff640 20 client.4459.objecter _calc_target epoch 55 base exist @12 precalc_pgid 0 pgid 0.0 is_write 2023-11-05T08:08:47.516 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:47.509+0000 7faad3fff640 20 client.4459.objecter _calc_target target exist @12 -> pgid 12.d3a59201 2023-11-05T08:08:47.517 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:47.509+0000 7faad3fff640 10 client.4459.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-05T08:08:48.242 INFO:tasks.ceph.osd.6.smithi156.stderr:2023-11-05T08:08:48.232+0000 ea58640 -1 osd.6 55 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4540.0:2 16.1a 16:5c6776db:::0.obj:head [write 0~99 in=99b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24) 2023-11-05T08:08:48.638 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:47.509+0000 7faad3fff640 10 monclient: _renew_subs 2023-11-05T08:08:48.638 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:47.509+0000 7faad3fff640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:08:48.638 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:47.509+0000 7faad3fff640 1 -- 172.21.15.52:0/3032579076 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=56}) v3 -- 0x7faacc0800e0 con 0x5599faa06c70 2023-11-05T08:08:48.639 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:47.509+0000 7faad3fff640 20 client.4459.objecter dump_active .. 0 homeless 2023-11-05T08:08:48.639 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:47.509+0000 7faad3fff640 20 client.4459.objecter 10 12.d3a59201 osd.1 exist [write 0~5 in=5b] 2023-11-05T08:08:48.639 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:47.908+0000 7faad2ffd640 10 monclient: tick 2023-11-05T08:08:48.639 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:47.908+0000 7faad2ffd640 10 monclient: _check_auth_tickets 2023-11-05T08:08:48.639 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:47.908+0000 7faad2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:08:48.639 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:48.000+0000 7faaed199640 10 client.4459.objecter tick 2023-11-05T08:08:48.640 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:48.499+0000 7faad3fff640 1 -- 172.21.15.52:0/3032579076 <== mon.1 v2:172.21.15.156:3300/0 14 ==== osd_map(56..56 src has 1..56) v4 ==== 1039+0+0 (secure 0 0 0) 0x7faad4058b50 con 0x5599faa06c70 2023-11-05T08:08:48.640 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:48.499+0000 7faad3fff640 10 client.4459.objecter ms_dispatch 0x5599fa95fee0 osd_map(56..56 src has 1..56) v4 2023-11-05T08:08:48.640 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:48.499+0000 7faad3fff640 3 client.4459.objecter handle_osd_map got epochs [56,56] > 55 2023-11-05T08:08:48.640 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:48.499+0000 7faad3fff640 3 client.4459.objecter handle_osd_map decoding incremental epoch 56 2023-11-05T08:08:48.640 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:48.499+0000 7faad3fff640 10 client.4459.objecter checking op 10 2023-11-05T08:08:48.641 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:48.499+0000 7faad3fff640 20 client.4459.objecter _calc_target epoch 56 base exist @12 precalc_pgid 0 pgid 0.0 is_write 2023-11-05T08:08:48.641 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:48.499+0000 7faad3fff640 20 client.4459.objecter _calc_target target exist @12 -> pgid 12.d3a59201 2023-11-05T08:08:48.641 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:48.499+0000 7faad3fff640 10 client.4459.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-05T08:08:48.641 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:48.499+0000 7faad3fff640 10 monclient: _renew_subs 2023-11-05T08:08:48.641 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:48.499+0000 7faad3fff640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:08:48.642 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:48.499+0000 7faad3fff640 1 -- 172.21.15.52:0/3032579076 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=57}) v3 -- 0x7faacc0800e0 con 0x5599faa06c70 2023-11-05T08:08:48.642 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:48.499+0000 7faad3fff640 20 client.4459.objecter dump_active .. 0 homeless 2023-11-05T08:08:48.642 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:48.499+0000 7faad3fff640 20 client.4459.objecter 10 12.d3a59201 osd.1 exist [write 0~5 in=5b] 2023-11-05T08:08:48.642 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:48.636+0000 7faaeb736640 1 -- 172.21.15.52:0/3032579076 <== osd.1 v2:172.21.15.52:6824/544646809 14 ==== osd_op_reply(10 exist [write 0~5] v53'3 uv3 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7faadc063040 con 0x5599fab4cc70 2023-11-05T08:08:48.642 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:48.636+0000 7faaeb736640 10 client.4459.objecter ms_dispatch 0x5599fa95fee0 osd_op_reply(10 exist [write 0~5] v53'3 uv3 ondisk = 0) v8 2023-11-05T08:08:48.643 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:48.636+0000 7faaeb736640 10 client.4459.objecter in handle_osd_op_reply 2023-11-05T08:08:48.643 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:48.636+0000 7faaeb736640 7 client.4459.objecter handle_osd_op_reply 10 ondisk uv 3 in 12.1 attempt 0 2023-11-05T08:08:48.643 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:48.636+0000 7faaeb736640 10 client.4459.objecter op 0 rval 0 len 0 2023-11-05T08:08:48.643 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:48.636+0000 7faaeb736640 15 client.4459.objecter handle_osd_op_reply completed tid 10 2023-11-05T08:08:48.644 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:48.636+0000 7faaeb736640 15 client.4459.objecter _finish_op 10 2023-11-05T08:08:49.465 INFO:tasks.ceph.osd.6.smithi156.stderr:2023-11-05T08:08:49.462+0000 ea58640 -1 osd.6 56 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4540.0:2 16.1a 16:5c6776db:::0.obj:head [write 0~99 in=99b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24) 2023-11-05T08:08:49.497 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:48.636+0000 7faaeb736640 20 client.4459.objecter put_session s=0x5599fa94cf80 osd=1 4 2023-11-05T08:08:49.497 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:48.636+0000 7faaeb736640 15 client.4459.objecter _session_op_remove 1 10 2023-11-05T08:08:49.498 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:48.636+0000 7faaeb736640 5 client.4459.objecter 0 in flight 2023-11-05T08:08:49.498 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:48.636+0000 7faaeb736640 20 librados: complete_aio_write 0x5599fa9d30e0 2023-11-05T08:08:49.498 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: [ OK ] AsioRados.AsyncWriteFuture (3099 ms) 2023-11-05T08:08:49.498 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteYield 2023-11-05T08:08:49.498 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:48.636+0000 7faaedc46780 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=head 2023-11-05T08:08:49.499 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:48.636+0000 7faaedc46780 20 librados: queue_aio_write 0x5599fa986fe0 completion 0x5599fa9d2f60 write_seq 3 2023-11-05T08:08:49.499 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:48.636+0000 7faaedc46780 10 client.4459.objecter _op_submit op 0x5599faaa0980 2023-11-05T08:08:49.499 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:48.636+0000 7faaedc46780 20 client.4459.objecter _calc_target epoch 56 base exist @12 precalc_pgid 0 pgid 0.0 is_write 2023-11-05T08:08:49.499 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:48.636+0000 7faaedc46780 20 client.4459.objecter _calc_target target exist @12 -> pgid 12.d3a59201 2023-11-05T08:08:49.500 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:48.636+0000 7faaedc46780 10 client.4459.objecter _calc_target raw pgid 12.d3a59201 -> actual 12.1 acting [1,6] primary 1 2023-11-05T08:08:49.500 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:48.636+0000 7faaedc46780 20 client.4459.objecter _get_session s=0x5599fa94cf80 osd=1 3 2023-11-05T08:08:49.500 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:48.636+0000 7faaedc46780 10 client.4459.objecter _op_submit oid exist '@12' '@12' [write 0~5 in=5b] tid 11 osd.1 2023-11-05T08:08:49.500 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:48.636+0000 7faaedc46780 20 client.4459.objecter get_session s=0x5599fa94cf80 osd=1 3 2023-11-05T08:08:49.500 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:48.636+0000 7faaedc46780 15 client.4459.objecter _session_op_assign 1 11 2023-11-05T08:08:49.501 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:48.636+0000 7faaedc46780 15 client.4459.objecter _send_op 11 to 12.1 on osd.1 2023-11-05T08:08:49.501 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:48.636+0000 7faaedc46780 1 -- 172.21.15.52:0/3032579076 --> [v2:172.21.15.52:6824/544646809,v1:172.21.15.52:6825/544646809] -- osd_op(unknown.0.0:11 12.1 12:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56) v8 -- 0x5599fa9d55c0 con 0x5599fab4cc70 2023-11-05T08:08:49.501 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:48.636+0000 7faaedc46780 20 client.4459.objecter put_session s=0x5599fa94cf80 osd=1 4 2023-11-05T08:08:49.501 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:48.636+0000 7faaedc46780 5 client.4459.objecter 1 in flight 2023-11-05T08:08:49.501 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:48.636+0000 7faaedc46780 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=1 2023-11-05T08:08:49.501 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:48.908+0000 7faad2ffd640 10 monclient: tick 2023-11-05T08:08:49.502 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:48.908+0000 7faad2ffd640 10 monclient: _check_auth_tickets 2023-11-05T08:08:49.502 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:48.908+0000 7faad2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:08:49.502 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:49.495+0000 7faad3fff640 1 -- 172.21.15.52:0/3032579076 <== mon.1 v2:172.21.15.156:3300/0 15 ==== osd_map(57..57 src has 1..57) v4 ==== 714+0+0 (secure 0 0 0) 0x7faad405f0c0 con 0x5599faa06c70 2023-11-05T08:08:49.502 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:49.495+0000 7faad3fff640 10 client.4459.objecter ms_dispatch 0x5599fa95fee0 osd_map(57..57 src has 1..57) v4 2023-11-05T08:08:49.502 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:49.495+0000 7faad3fff640 3 client.4459.objecter handle_osd_map got epochs [57,57] > 56 2023-11-05T08:08:49.503 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:49.495+0000 7faad3fff640 3 client.4459.objecter handle_osd_map decoding incremental epoch 57 2023-11-05T08:08:49.503 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:49.495+0000 7faad3fff640 10 client.4459.objecter checking op 11 2023-11-05T08:08:49.503 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:49.495+0000 7faad3fff640 20 client.4459.objecter _calc_target epoch 57 base exist @12 precalc_pgid 0 pgid 0.0 is_write 2023-11-05T08:08:50.715 INFO:tasks.ceph.osd.6.smithi156.stderr:2023-11-05T08:08:50.690+0000 ea58640 -1 osd.6 57 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4540.0:2 16.1a 16:5c6776db:::0.obj:head [write 0~99 in=99b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24) 2023-11-05T08:08:51.591 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:49.495+0000 7faad3fff640 20 client.4459.objecter _calc_target target exist @12 -> pgid 12.d3a59201 2023-11-05T08:08:51.591 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:49.495+0000 7faad3fff640 20 client.4459.objecter dump_active .. 0 homeless 2023-11-05T08:08:51.591 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:49.495+0000 7faad3fff640 20 client.4459.objecter 11 12.d3a59201 osd.1 exist [write 0~5 in=5b] 2023-11-05T08:08:51.591 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:49.908+0000 7faad2ffd640 10 monclient: tick 2023-11-05T08:08:51.592 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:49.908+0000 7faad2ffd640 10 monclient: _check_auth_tickets 2023-11-05T08:08:51.592 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:49.908+0000 7faad2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:08:51.592 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:50.909+0000 7faad2ffd640 10 monclient: tick 2023-11-05T08:08:51.592 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:50.909+0000 7faad2ffd640 10 monclient: _check_auth_tickets 2023-11-05T08:08:51.592 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:50.909+0000 7faad2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:08:51.593 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:50.909+0000 7faad2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:08:51.593 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:51.589+0000 7faaeb736640 1 -- 172.21.15.52:0/3032579076 <== osd.1 v2:172.21.15.52:6824/544646809 15 ==== osd_op_reply(11 exist [write 0~5] v56'4 uv4 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7faadc063040 con 0x5599fab4cc70 2023-11-05T08:08:51.593 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:51.589+0000 7faaeb736640 10 client.4459.objecter ms_dispatch 0x5599fa95fee0 osd_op_reply(11 exist [write 0~5] v56'4 uv4 ondisk = 0) v8 2023-11-05T08:08:51.593 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:51.589+0000 7faaeb736640 10 client.4459.objecter in handle_osd_op_reply 2023-11-05T08:08:51.593 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:51.589+0000 7faaeb736640 7 client.4459.objecter handle_osd_op_reply 11 ondisk uv 4 in 12.1 attempt 0 2023-11-05T08:08:51.594 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:51.589+0000 7faaeb736640 10 client.4459.objecter op 0 rval 0 len 0 2023-11-05T08:08:51.594 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:51.589+0000 7faaeb736640 15 client.4459.objecter handle_osd_op_reply completed tid 11 2023-11-05T08:08:51.594 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:51.589+0000 7faaeb736640 15 client.4459.objecter _finish_op 11 2023-11-05T08:08:51.594 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:51.589+0000 7faaeb736640 20 client.4459.objecter put_session s=0x5599fa94cf80 osd=1 4 2023-11-05T08:08:51.595 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:51.589+0000 7faaeb736640 15 client.4459.objecter _session_op_remove 1 11 2023-11-05T08:08:51.595 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:51.589+0000 7faaeb736640 5 client.4459.objecter 0 in flight 2023-11-05T08:08:51.595 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:51.589+0000 7faaeb736640 20 librados: complete_aio_write 0x5599fa9d2f60 2023-11-05T08:08:51.595 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: [ OK ] AsioRados.AsyncWriteYield (2953 ms) 2023-11-05T08:08:51.595 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationCallback 2023-11-05T08:08:51.596 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:51.589+0000 7faaedc46780 10 client.4459.objecter _op_submit op 0x5599faaa0980 2023-11-05T08:08:51.596 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:51.589+0000 7faaedc46780 20 client.4459.objecter _calc_target epoch 57 base exist @12 precalc_pgid 0 pgid 0.0 is_read 2023-11-05T08:08:51.596 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:51.589+0000 7faaedc46780 20 client.4459.objecter _calc_target target exist @12 -> pgid 12.d3a59201 2023-11-05T08:08:51.596 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:51.589+0000 7faaedc46780 10 client.4459.objecter _calc_target raw pgid 12.d3a59201 -> actual 12.1 acting [1,6] primary 1 2023-11-05T08:08:51.596 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:51.589+0000 7faaedc46780 20 client.4459.objecter _get_session s=0x5599fa94cf80 osd=1 3 2023-11-05T08:08:51.597 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:51.589+0000 7faaedc46780 10 client.4459.objecter _op_submit oid exist '@12' '@12' [read 0~0] tid 12 osd.1 2023-11-05T08:08:51.597 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:51.589+0000 7faaedc46780 20 client.4459.objecter get_session s=0x5599fa94cf80 osd=1 3 2023-11-05T08:08:51.597 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:51.589+0000 7faaedc46780 15 client.4459.objecter _session_op_assign 1 12 2023-11-05T08:08:51.597 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:51.589+0000 7faaedc46780 15 client.4459.objecter _send_op 12 to 12.1 on osd.1 2023-11-05T08:08:51.733 INFO:tasks.ceph.osd.6.smithi156.stderr:2023-11-05T08:08:51.731+0000 ea58640 -1 osd.6 57 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4540.0:2 16.1a 16:5c6776db:::0.obj:head [write 0~99 in=99b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24) 2023-11-05T08:08:52.304 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:51.589+0000 7faaedc46780 1 -- 172.21.15.52:0/3032579076 --> [v2:172.21.15.52:6824/544646809,v1:172.21.15.52:6825/544646809] -- osd_op(unknown.0.0:12 12.1 12:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) v8 -- 0x5599fa9d4f50 con 0x5599fab4cc70 2023-11-05T08:08:52.304 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:51.589+0000 7faaedc46780 20 client.4459.objecter put_session s=0x5599fa94cf80 osd=1 4 2023-11-05T08:08:52.305 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:51.589+0000 7faaedc46780 5 client.4459.objecter 1 in flight 2023-11-05T08:08:52.305 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:51.589+0000 7faaedc46780 10 client.4459.objecter _op_submit op 0x5599fa9d53c0 2023-11-05T08:08:52.305 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:51.589+0000 7faaedc46780 20 client.4459.objecter _calc_target epoch 57 base noexist @12 precalc_pgid 0 pgid 0.0 is_read 2023-11-05T08:08:52.305 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:51.589+0000 7faaedc46780 20 client.4459.objecter _calc_target target noexist @12 -> pgid 12.a7bbaa1 2023-11-05T08:08:52.305 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:51.589+0000 7faaedc46780 10 client.4459.objecter _calc_target raw pgid 12.a7bbaa1 -> actual 12.1 acting [1,6] primary 1 2023-11-05T08:08:52.306 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:51.589+0000 7faaedc46780 20 client.4459.objecter _get_session s=0x5599fa94cf80 osd=1 4 2023-11-05T08:08:52.306 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:51.589+0000 7faaedc46780 10 client.4459.objecter _op_submit oid noexist '@12' '@12' [read 0~0] tid 13 osd.1 2023-11-05T08:08:52.306 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:51.589+0000 7faaedc46780 20 client.4459.objecter get_session s=0x5599fa94cf80 osd=1 4 2023-11-05T08:08:52.306 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:51.589+0000 7faaedc46780 15 client.4459.objecter _session_op_assign 1 13 2023-11-05T08:08:52.306 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:51.589+0000 7faaedc46780 15 client.4459.objecter _send_op 13 to 12.1 on osd.1 2023-11-05T08:08:52.307 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:51.589+0000 7faaedc46780 1 -- 172.21.15.52:0/3032579076 --> [v2:172.21.15.52:6824/544646809,v1:172.21.15.52:6825/544646809] -- osd_op(unknown.0.0:13 12.1 12:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) v8 -- 0x5599fa9d1d70 con 0x5599fab4cc70 2023-11-05T08:08:52.307 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:51.589+0000 7faaedc46780 20 client.4459.objecter put_session s=0x5599fa94cf80 osd=1 5 2023-11-05T08:08:52.307 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:51.589+0000 7faaedc46780 5 client.4459.objecter 2 in flight 2023-11-05T08:08:52.307 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:51.909+0000 7faad2ffd640 10 monclient: tick 2023-11-05T08:08:52.307 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:51.909+0000 7faad2ffd640 10 monclient: _check_auth_tickets 2023-11-05T08:08:52.308 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:51.909+0000 7faad2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:08:52.308 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.302+0000 7faaeb736640 1 -- 172.21.15.52:0/3032579076 <== osd.1 v2:172.21.15.52:6824/544646809 16 ==== osd_op_reply(12 exist [read 0~5 out=5b] v0'0 uv4 ondisk = 0) v8 ==== 149+0+5 (crc 0 0 0) 0x7faadc063040 con 0x5599fab4cc70 2023-11-05T08:08:52.308 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.302+0000 7faaeb736640 10 client.4459.objecter ms_dispatch 0x5599fa95fee0 osd_op_reply(12 exist [read 0~5 out=5b] v0'0 uv4 ondisk = 0) v8 2023-11-05T08:08:52.308 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.302+0000 7faaeb736640 10 client.4459.objecter in handle_osd_op_reply 2023-11-05T08:08:52.308 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.302+0000 7faaeb736640 7 client.4459.objecter handle_osd_op_reply 12 ondisk uv 4 in 12.1 attempt 0 2023-11-05T08:08:52.309 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.302+0000 7faaeb736640 10 client.4459.objecter op 0 rval 0 len 5 2023-11-05T08:08:52.309 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.302+0000 7faaeb736640 15 client.4459.objecter handle_osd_op_reply completed tid 12 2023-11-05T08:08:52.309 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.302+0000 7faaeb736640 15 client.4459.objecter _finish_op 12 2023-11-05T08:08:52.309 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.302+0000 7faaeb736640 20 client.4459.objecter put_session s=0x5599fa94cf80 osd=1 5 2023-11-05T08:08:52.309 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.302+0000 7faaeb736640 15 client.4459.objecter _session_op_remove 1 12 2023-11-05T08:08:52.309 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.302+0000 7faaeb736640 5 client.4459.objecter 1 in flight 2023-11-05T08:08:52.310 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.302+0000 7faaeb736640 1 -- 172.21.15.52:0/3032579076 <== osd.1 v2:172.21.15.52:6824/544646809 17 ==== osd_op_reply(13 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7faadc063040 con 0x5599fab4cc70 2023-11-05T08:08:52.310 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.302+0000 7faaeb736640 10 client.4459.objecter ms_dispatch 0x5599fa95fee0 osd_op_reply(13 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 2023-11-05T08:08:52.310 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.302+0000 7faaeb736640 10 client.4459.objecter in handle_osd_op_reply 2023-11-05T08:08:52.310 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.302+0000 7faaeb736640 7 client.4459.objecter handle_osd_op_reply 13 ondisk uv 0 in 12.1 attempt 0 2023-11-05T08:08:52.311 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.302+0000 7faaeb736640 10 client.4459.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2023-11-05T08:08:52.311 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.302+0000 7faaeb736640 10 client.4459.objecter op 0 rval 0 len 0 2023-11-05T08:08:52.311 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.302+0000 7faaeb736640 15 client.4459.objecter handle_osd_op_reply completed tid 13 2023-11-05T08:08:52.311 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.302+0000 7faaeb736640 15 client.4459.objecter _finish_op 13 2023-11-05T08:08:52.311 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.302+0000 7faaeb736640 20 client.4459.objecter put_session s=0x5599fa94cf80 osd=1 4 2023-11-05T08:08:52.312 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.302+0000 7faaeb736640 15 client.4459.objecter _session_op_remove 1 13 2023-11-05T08:08:52.312 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.302+0000 7faaeb736640 5 client.4459.objecter 0 in flight 2023-11-05T08:08:52.312 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationCallback (713 ms) 2023-11-05T08:08:52.312 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationFuture 2023-11-05T08:08:52.312 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.302+0000 7faaedc46780 10 client.4459.objecter _op_submit op 0x5599faaa0980 2023-11-05T08:08:52.312 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.302+0000 7faaedc46780 20 client.4459.objecter _calc_target epoch 57 base exist @12 precalc_pgid 0 pgid 0.0 is_read 2023-11-05T08:08:52.313 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.302+0000 7faaedc46780 20 client.4459.objecter _calc_target target exist @12 -> pgid 12.d3a59201 2023-11-05T08:08:52.313 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.302+0000 7faaedc46780 10 client.4459.objecter _calc_target raw pgid 12.d3a59201 -> actual 12.1 acting [1,6] primary 1 2023-11-05T08:08:52.313 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.302+0000 7faaedc46780 20 client.4459.objecter _get_session s=0x5599fa94cf80 osd=1 3 2023-11-05T08:08:52.313 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.302+0000 7faaedc46780 10 client.4459.objecter _op_submit oid exist '@12' '@12' [read 0~0] tid 14 osd.1 2023-11-05T08:08:52.313 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.302+0000 7faaedc46780 20 client.4459.objecter get_session s=0x5599fa94cf80 osd=1 3 2023-11-05T08:08:52.314 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.302+0000 7faaedc46780 15 client.4459.objecter _session_op_assign 1 14 2023-11-05T08:08:52.314 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.302+0000 7faaedc46780 15 client.4459.objecter _send_op 14 to 12.1 on osd.1 2023-11-05T08:08:52.314 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.302+0000 7faaedc46780 1 -- 172.21.15.52:0/3032579076 --> [v2:172.21.15.52:6824/544646809,v1:172.21.15.52:6825/544646809] -- osd_op(unknown.0.0:14 12.1 12:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) v8 -- 0x5599fa9d53c0 con 0x5599fab4cc70 2023-11-05T08:08:52.314 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.302+0000 7faaedc46780 20 client.4459.objecter put_session s=0x5599fa94cf80 osd=1 4 2023-11-05T08:08:52.314 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.302+0000 7faaedc46780 5 client.4459.objecter 1 in flight 2023-11-05T08:08:52.315 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.302+0000 7faaedc46780 10 client.4459.objecter _op_submit op 0x5599fa9d1d70 2023-11-05T08:08:52.315 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.302+0000 7faaedc46780 20 client.4459.objecter _calc_target epoch 57 base noexist @12 precalc_pgid 0 pgid 0.0 is_read 2023-11-05T08:08:52.315 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.302+0000 7faaedc46780 20 client.4459.objecter _calc_target target noexist @12 -> pgid 12.a7bbaa1 2023-11-05T08:08:52.486 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.302+0000 7faaedc46780 10 client.4459.objecter _calc_target raw pgid 12.a7bbaa1 -> actual 12.1 acting [1,6] primary 1 2023-11-05T08:08:52.487 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.302+0000 7faaedc46780 20 client.4459.objecter _get_session s=0x5599fa94cf80 osd=1 4 2023-11-05T08:08:52.487 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.302+0000 7faaedc46780 10 client.4459.objecter _op_submit oid noexist '@12' '@12' [read 0~0] tid 15 osd.1 2023-11-05T08:08:52.487 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.302+0000 7faaedc46780 20 client.4459.objecter get_session s=0x5599fa94cf80 osd=1 4 2023-11-05T08:08:52.487 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.302+0000 7faaedc46780 15 client.4459.objecter _session_op_assign 1 15 2023-11-05T08:08:52.487 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.302+0000 7faaedc46780 15 client.4459.objecter _send_op 15 to 12.1 on osd.1 2023-11-05T08:08:52.488 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.302+0000 7faaedc46780 1 -- 172.21.15.52:0/3032579076 --> [v2:172.21.15.52:6824/544646809,v1:172.21.15.52:6825/544646809] -- osd_op(unknown.0.0:15 12.1 12:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) v8 -- 0x5599fa9d2210 con 0x5599fab4cc70 2023-11-05T08:08:52.488 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.302+0000 7faaedc46780 20 client.4459.objecter put_session s=0x5599fa94cf80 osd=1 5 2023-11-05T08:08:52.488 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.302+0000 7faaedc46780 5 client.4459.objecter 2 in flight 2023-11-05T08:08:52.488 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.484+0000 7faaeb736640 1 -- 172.21.15.52:0/3032579076 <== osd.1 v2:172.21.15.52:6824/544646809 18 ==== osd_op_reply(14 exist [read 0~5 out=5b] v0'0 uv4 ondisk = 0) v8 ==== 149+0+5 (crc 0 0 0) 0x7faadc063040 con 0x5599fab4cc70 2023-11-05T08:08:52.489 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.484+0000 7faaeb736640 10 client.4459.objecter ms_dispatch 0x5599fa95fee0 osd_op_reply(14 exist [read 0~5 out=5b] v0'0 uv4 ondisk = 0) v8 2023-11-05T08:08:52.489 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.485+0000 7faaeb736640 10 client.4459.objecter in handle_osd_op_reply 2023-11-05T08:08:52.489 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.485+0000 7faaeb736640 7 client.4459.objecter handle_osd_op_reply 14 ondisk uv 4 in 12.1 attempt 0 2023-11-05T08:08:52.489 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.485+0000 7faaeb736640 10 client.4459.objecter op 0 rval 0 len 5 2023-11-05T08:08:52.489 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.485+0000 7faaeb736640 15 client.4459.objecter handle_osd_op_reply completed tid 14 2023-11-05T08:08:52.490 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.485+0000 7faaeb736640 15 client.4459.objecter _finish_op 14 2023-11-05T08:08:52.490 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.485+0000 7faaeb736640 20 client.4459.objecter put_session s=0x5599fa94cf80 osd=1 5 2023-11-05T08:08:52.490 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.485+0000 7faaeb736640 15 client.4459.objecter _session_op_remove 1 14 2023-11-05T08:08:52.490 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.485+0000 7faaeb736640 5 client.4459.objecter 1 in flight 2023-11-05T08:08:52.490 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.485+0000 7faaeb736640 1 -- 172.21.15.52:0/3032579076 <== osd.1 v2:172.21.15.52:6824/544646809 19 ==== osd_op_reply(15 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7faadc063040 con 0x5599fab4cc70 2023-11-05T08:08:52.491 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.485+0000 7faaeb736640 10 client.4459.objecter ms_dispatch 0x5599fa95fee0 osd_op_reply(15 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 2023-11-05T08:08:52.491 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.485+0000 7faaeb736640 10 client.4459.objecter in handle_osd_op_reply 2023-11-05T08:08:52.491 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.485+0000 7faaeb736640 7 client.4459.objecter handle_osd_op_reply 15 ondisk uv 0 in 12.1 attempt 0 2023-11-05T08:08:52.491 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.485+0000 7faaeb736640 10 client.4459.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2023-11-05T08:08:52.491 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.485+0000 7faaeb736640 10 client.4459.objecter op 0 rval 0 len 0 2023-11-05T08:08:52.492 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.485+0000 7faaeb736640 15 client.4459.objecter handle_osd_op_reply completed tid 15 2023-11-05T08:08:52.492 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.485+0000 7faaeb736640 15 client.4459.objecter _finish_op 15 2023-11-05T08:08:52.492 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.485+0000 7faaeb736640 20 client.4459.objecter put_session s=0x5599fa94cf80 osd=1 4 2023-11-05T08:08:52.492 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.485+0000 7faaeb736640 15 client.4459.objecter _session_op_remove 1 15 2023-11-05T08:08:52.492 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.485+0000 7faaeb736640 5 client.4459.objecter 0 in flight 2023-11-05T08:08:52.493 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationFuture (182 ms) 2023-11-05T08:08:52.493 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationYield 2023-11-05T08:08:52.493 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.485+0000 7faaedc46780 10 client.4459.objecter _op_submit op 0x5599faaa0980 2023-11-05T08:08:52.493 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.485+0000 7faaedc46780 20 client.4459.objecter _calc_target epoch 57 base exist @12 precalc_pgid 0 pgid 0.0 is_read 2023-11-05T08:08:52.493 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.485+0000 7faaedc46780 20 client.4459.objecter _calc_target target exist @12 -> pgid 12.d3a59201 2023-11-05T08:08:52.494 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.485+0000 7faaedc46780 10 client.4459.objecter _calc_target raw pgid 12.d3a59201 -> actual 12.1 acting [1,6] primary 1 2023-11-05T08:08:52.494 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.485+0000 7faaedc46780 20 client.4459.objecter _get_session s=0x5599fa94cf80 osd=1 3 2023-11-05T08:08:52.494 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.485+0000 7faaedc46780 10 client.4459.objecter _op_submit oid exist '@12' '@12' [read 0~0] tid 16 osd.1 2023-11-05T08:08:52.494 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.485+0000 7faaedc46780 20 client.4459.objecter get_session s=0x5599fa94cf80 osd=1 3 2023-11-05T08:08:52.494 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.485+0000 7faaedc46780 15 client.4459.objecter _session_op_assign 1 16 2023-11-05T08:08:52.495 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.485+0000 7faaedc46780 15 client.4459.objecter _send_op 16 to 12.1 on osd.1 2023-11-05T08:08:52.495 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.485+0000 7faaedc46780 1 -- 172.21.15.52:0/3032579076 --> [v2:172.21.15.52:6824/544646809,v1:172.21.15.52:6825/544646809] -- osd_op(unknown.0.0:16 12.1 12:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) v8 -- 0x5599fa9d53c0 con 0x5599fab4cc70 2023-11-05T08:08:52.495 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.485+0000 7faaedc46780 20 client.4459.objecter put_session s=0x5599fa94cf80 osd=1 4 2023-11-05T08:08:52.495 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.485+0000 7faaedc46780 5 client.4459.objecter 1 in flight 2023-11-05T08:08:52.495 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.485+0000 7faaedc46780 10 client.4459.objecter _op_submit op 0x5599fa9d23e0 2023-11-05T08:08:52.496 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.485+0000 7faaedc46780 20 client.4459.objecter _calc_target epoch 57 base noexist @12 precalc_pgid 0 pgid 0.0 is_read 2023-11-05T08:08:52.496 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.485+0000 7faaedc46780 20 client.4459.objecter _calc_target target noexist @12 -> pgid 12.a7bbaa1 2023-11-05T08:08:52.496 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.485+0000 7faaedc46780 10 client.4459.objecter _calc_target raw pgid 12.a7bbaa1 -> actual 12.1 acting [1,6] primary 1 2023-11-05T08:08:52.496 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.485+0000 7faaedc46780 20 client.4459.objecter _get_session s=0x5599fa94cf80 osd=1 4 2023-11-05T08:08:52.496 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.485+0000 7faaedc46780 10 client.4459.objecter _op_submit oid noexist '@12' '@12' [read 0~0] tid 17 osd.1 2023-11-05T08:08:52.496 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.485+0000 7faaedc46780 20 client.4459.objecter get_session s=0x5599fa94cf80 osd=1 4 2023-11-05T08:08:52.497 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.485+0000 7faaedc46780 15 client.4459.objecter _session_op_assign 1 17 2023-11-05T08:08:52.497 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.485+0000 7faaedc46780 15 client.4459.objecter _send_op 17 to 12.1 on osd.1 2023-11-05T08:08:52.497 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.485+0000 7faaedc46780 1 -- 172.21.15.52:0/3032579076 --> [v2:172.21.15.52:6824/544646809,v1:172.21.15.52:6825/544646809] -- osd_op(unknown.0.0:17 12.1 12:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) v8 -- 0x5599fa9d2880 con 0x5599fab4cc70 2023-11-05T08:08:52.497 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.485+0000 7faaedc46780 20 client.4459.objecter put_session s=0x5599fa94cf80 osd=1 5 2023-11-05T08:08:52.808 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.485+0000 7faaedc46780 5 client.4459.objecter 2 in flight 2023-11-05T08:08:52.809 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.807+0000 7faaeb736640 1 -- 172.21.15.52:0/3032579076 <== osd.1 v2:172.21.15.52:6824/544646809 20 ==== osd_op_reply(16 exist [read 0~5 out=5b] v0'0 uv4 ondisk = 0) v8 ==== 149+0+5 (crc 0 0 0) 0x7faadc063040 con 0x5599fab4cc70 2023-11-05T08:08:52.809 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.807+0000 7faaeb736640 10 client.4459.objecter ms_dispatch 0x5599fa95fee0 osd_op_reply(16 exist [read 0~5 out=5b] v0'0 uv4 ondisk = 0) v8 2023-11-05T08:08:52.809 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.807+0000 7faaeb736640 10 client.4459.objecter in handle_osd_op_reply 2023-11-05T08:08:52.809 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.807+0000 7faaeb736640 7 client.4459.objecter handle_osd_op_reply 16 ondisk uv 4 in 12.1 attempt 0 2023-11-05T08:08:52.810 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.807+0000 7faaeb736640 10 client.4459.objecter op 0 rval 0 len 5 2023-11-05T08:08:52.810 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.807+0000 7faaeb736640 15 client.4459.objecter handle_osd_op_reply completed tid 16 2023-11-05T08:08:52.810 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.807+0000 7faaeb736640 15 client.4459.objecter _finish_op 16 2023-11-05T08:08:52.810 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.807+0000 7faaeb736640 20 client.4459.objecter put_session s=0x5599fa94cf80 osd=1 5 2023-11-05T08:08:52.810 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.807+0000 7faaeb736640 15 client.4459.objecter _session_op_remove 1 16 2023-11-05T08:08:52.811 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.807+0000 7faaeb736640 5 client.4459.objecter 1 in flight 2023-11-05T08:08:52.811 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.807+0000 7faaeb736640 1 -- 172.21.15.52:0/3032579076 <== osd.1 v2:172.21.15.52:6824/544646809 21 ==== osd_op_reply(17 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7faadc063040 con 0x5599fab4cc70 2023-11-05T08:08:52.811 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.807+0000 7faaeb736640 10 client.4459.objecter ms_dispatch 0x5599fa95fee0 osd_op_reply(17 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 2023-11-05T08:08:52.811 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.807+0000 7faaeb736640 10 client.4459.objecter in handle_osd_op_reply 2023-11-05T08:08:52.811 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.807+0000 7faaeb736640 7 client.4459.objecter handle_osd_op_reply 17 ondisk uv 0 in 12.1 attempt 0 2023-11-05T08:08:52.811 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.807+0000 7faaeb736640 10 client.4459.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2023-11-05T08:08:52.812 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.807+0000 7faaeb736640 10 client.4459.objecter op 0 rval 0 len 0 2023-11-05T08:08:52.812 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.807+0000 7faaeb736640 15 client.4459.objecter handle_osd_op_reply completed tid 17 2023-11-05T08:08:52.812 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.807+0000 7faaeb736640 15 client.4459.objecter _finish_op 17 2023-11-05T08:08:52.812 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.807+0000 7faaeb736640 20 client.4459.objecter put_session s=0x5599fa94cf80 osd=1 4 2023-11-05T08:08:52.812 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.807+0000 7faaeb736640 15 client.4459.objecter _session_op_remove 1 17 2023-11-05T08:08:52.813 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.807+0000 7faaeb736640 5 client.4459.objecter 0 in flight 2023-11-05T08:08:52.813 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationYield (322 ms) 2023-11-05T08:08:52.813 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationCallback 2023-11-05T08:08:52.813 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.807+0000 7faaedc46780 20 librados: queue_aio_write 0x5599fa986fe0 completion 0x5599fa9d2c60 write_seq 4 2023-11-05T08:08:52.813 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.807+0000 7faaedc46780 10 client.4459.objecter _op_submit op 0x5599faaa0980 2023-11-05T08:08:52.814 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.807+0000 7faaedc46780 20 client.4459.objecter _calc_target epoch 57 base exist @12 precalc_pgid 0 pgid 0.0 is_write 2023-11-05T08:08:52.814 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.807+0000 7faaedc46780 20 client.4459.objecter _calc_target target exist @12 -> pgid 12.d3a59201 2023-11-05T08:08:52.814 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.807+0000 7faaedc46780 10 client.4459.objecter _calc_target raw pgid 12.d3a59201 -> actual 12.1 acting [1,6] primary 1 2023-11-05T08:08:53.198 INFO:tasks.ceph.osd.6.smithi156.stderr:2023-11-05T08:08:53.160+0000 ea58640 -1 osd.6 59 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4540.0:2 16.1a 16:5c6776db:::0.obj:head [write 0~99 in=99b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24) 2023-11-05T08:08:53.485 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:02:56.600 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:08:53.489 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:02:56.605 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:08:53.554 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:02:56.669 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:08:53.558 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:02:56.633 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:08:53.566 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:02:56.640 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:08:53.582 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:02:56.697 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:08:53.610 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:02:56.725 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:08:53.659 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:02:56.733 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:08:53.674 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.807+0000 7faaedc46780 20 client.4459.objecter _get_session s=0x5599fa94cf80 osd=1 3 2023-11-05T08:08:53.675 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.807+0000 7faaedc46780 10 client.4459.objecter _op_submit oid exist '@12' '@12' [writefull 0~5 in=5b] tid 18 osd.1 2023-11-05T08:08:53.675 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.807+0000 7faaedc46780 20 client.4459.objecter get_session s=0x5599fa94cf80 osd=1 3 2023-11-05T08:08:53.675 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.807+0000 7faaedc46780 15 client.4459.objecter _session_op_assign 1 18 2023-11-05T08:08:53.675 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.807+0000 7faaedc46780 15 client.4459.objecter _send_op 18 to 12.1 on osd.1 2023-11-05T08:08:53.676 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.807+0000 7faaedc46780 1 -- 172.21.15.52:0/3032579076 --> [v2:172.21.15.52:6824/544646809,v1:172.21.15.52:6825/544646809] -- osd_op(unknown.0.0:18 12.1 12:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) v8 -- 0x5599fa9d53c0 con 0x5599fab4cc70 2023-11-05T08:08:53.676 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.807+0000 7faaedc46780 20 client.4459.objecter put_session s=0x5599fa94cf80 osd=1 4 2023-11-05T08:08:53.676 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.807+0000 7faaedc46780 5 client.4459.objecter 1 in flight 2023-11-05T08:08:53.676 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.909+0000 7faad2ffd640 10 monclient: tick 2023-11-05T08:08:53.676 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.909+0000 7faad2ffd640 10 monclient: _check_auth_tickets 2023-11-05T08:08:53.677 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:52.909+0000 7faad2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:08:53.677 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:53.001+0000 7faaed199640 10 client.4459.objecter tick 2023-11-05T08:08:53.677 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:53.299+0000 7faad3fff640 1 -- 172.21.15.52:0/3032579076 <== osd.1 v2:172.21.15.52:6824/544646809 22 ==== osd_map(58..58 src has 1..58) v4 ==== 1741+0+0 (crc 0 0 0) 0x7faadc069040 con 0x5599fab4cc70 2023-11-05T08:08:53.677 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:53.299+0000 7faad3fff640 10 client.4459.objecter ms_dispatch 0x5599fa95fee0 osd_map(58..58 src has 1..58) v4 2023-11-05T08:08:53.677 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:53.299+0000 7faad3fff640 3 client.4459.objecter handle_osd_map got epochs [58,58] > 57 2023-11-05T08:08:53.678 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:53.299+0000 7faad3fff640 3 client.4459.objecter handle_osd_map decoding incremental epoch 58 2023-11-05T08:08:53.678 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:53.299+0000 7faad3fff640 10 client.4459.objecter checking op 18 2023-11-05T08:08:53.678 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:53.299+0000 7faad3fff640 20 client.4459.objecter _calc_target epoch 58 base exist @12 precalc_pgid 0 pgid 0.0 is_write 2023-11-05T08:08:53.678 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:53.299+0000 7faad3fff640 20 client.4459.objecter _calc_target target exist @12 -> pgid 12.d3a59201 2023-11-05T08:08:53.678 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:53.299+0000 7faad3fff640 20 client.4459.objecter dump_active .. 0 homeless 2023-11-05T08:08:53.679 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:53.299+0000 7faad3fff640 20 client.4459.objecter 18 12.d3a59201 osd.1 exist [writefull 0~5 in=5b] 2023-11-05T08:08:53.679 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:53.673+0000 7faaeb736640 1 -- 172.21.15.52:0/3032579076 <== osd.1 v2:172.21.15.52:6824/544646809 23 ==== osd_op_reply(18 exist [writefull 0~5] v58'5 uv5 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7faadc063040 con 0x5599fab4cc70 2023-11-05T08:08:53.679 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:53.673+0000 7faaeb736640 10 client.4459.objecter ms_dispatch 0x5599fa95fee0 osd_op_reply(18 exist [writefull 0~5] v58'5 uv5 ondisk = 0) v8 2023-11-05T08:08:53.679 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:53.673+0000 7faaeb736640 10 client.4459.objecter in handle_osd_op_reply 2023-11-05T08:08:53.679 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:53.673+0000 7faaeb736640 7 client.4459.objecter handle_osd_op_reply 18 ondisk uv 5 in 12.1 attempt 0 2023-11-05T08:08:53.680 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:53.673+0000 7faaeb736640 10 client.4459.objecter op 0 rval 0 len 0 2023-11-05T08:08:53.680 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:53.673+0000 7faaeb736640 15 client.4459.objecter handle_osd_op_reply completed tid 18 2023-11-05T08:08:53.680 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:53.673+0000 7faaeb736640 15 client.4459.objecter _finish_op 18 2023-11-05T08:08:53.689 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:02:56.805 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:08:54.431 INFO:tasks.ceph.osd.6.smithi156.stderr:2023-11-05T08:08:54.378+0000 ea58640 -1 osd.6 60 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4540.0:2 16.1a 16:5c6776db:::0.obj:head [write 0~99 in=99b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24) 2023-11-05T08:08:55.048 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:53.673+0000 7faaeb736640 20 client.4459.objecter put_session s=0x5599fa94cf80 osd=1 4 2023-11-05T08:08:55.048 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:53.673+0000 7faaeb736640 15 client.4459.objecter _session_op_remove 1 18 2023-11-05T08:08:55.049 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:53.673+0000 7faaeb736640 5 client.4459.objecter 0 in flight 2023-11-05T08:08:55.049 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:53.673+0000 7faaeb736640 20 librados: complete_aio_write 0x5599fa9d2c60 2023-11-05T08:08:55.049 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationCallback (867 ms) 2023-11-05T08:08:55.049 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationFuture 2023-11-05T08:08:55.049 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:53.673+0000 7faaedc46780 20 librados: queue_aio_write 0x5599fa986fe0 completion 0x5599fa9d1d70 write_seq 5 2023-11-05T08:08:55.049 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:53.673+0000 7faaedc46780 10 client.4459.objecter _op_submit op 0x5599faaa0980 2023-11-05T08:08:55.050 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:53.673+0000 7faaedc46780 20 client.4459.objecter _calc_target epoch 58 base exist @12 precalc_pgid 0 pgid 0.0 is_write 2023-11-05T08:08:55.050 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:53.673+0000 7faaedc46780 20 client.4459.objecter _calc_target target exist @12 -> pgid 12.d3a59201 2023-11-05T08:08:55.050 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:53.673+0000 7faaedc46780 10 client.4459.objecter _calc_target raw pgid 12.d3a59201 -> actual 12.1 acting [1,6] primary 1 2023-11-05T08:08:55.050 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:53.673+0000 7faaedc46780 20 client.4459.objecter _get_session s=0x5599fa94cf80 osd=1 3 2023-11-05T08:08:55.050 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:53.673+0000 7faaedc46780 10 client.4459.objecter _op_submit oid exist '@12' '@12' [writefull 0~5 in=5b] tid 19 osd.1 2023-11-05T08:08:55.051 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:53.673+0000 7faaedc46780 20 client.4459.objecter get_session s=0x5599fa94cf80 osd=1 3 2023-11-05T08:08:55.051 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:53.673+0000 7faaedc46780 15 client.4459.objecter _session_op_assign 1 19 2023-11-05T08:08:55.051 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:53.673+0000 7faaedc46780 15 client.4459.objecter _send_op 19 to 12.1 on osd.1 2023-11-05T08:08:55.051 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:53.673+0000 7faaedc46780 1 -- 172.21.15.52:0/3032579076 --> [v2:172.21.15.52:6824/544646809,v1:172.21.15.52:6825/544646809] -- osd_op(unknown.0.0:19 12.1 12:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58) v8 -- 0x5599fa9d53c0 con 0x5599fab4cc70 2023-11-05T08:08:55.051 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:53.673+0000 7faaedc46780 20 client.4459.objecter put_session s=0x5599fa94cf80 osd=1 4 2023-11-05T08:08:55.052 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:53.673+0000 7faaedc46780 5 client.4459.objecter 1 in flight 2023-11-05T08:08:55.052 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:53.909+0000 7faad2ffd640 10 monclient: tick 2023-11-05T08:08:55.052 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:53.909+0000 7faad2ffd640 10 monclient: _check_auth_tickets 2023-11-05T08:08:55.052 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:53.909+0000 7faad2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:08:55.052 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:54.909+0000 7faad2ffd640 10 monclient: tick 2023-11-05T08:08:55.053 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:54.909+0000 7faad2ffd640 10 monclient: _check_auth_tickets 2023-11-05T08:08:55.053 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:54.909+0000 7faad2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:08:55.053 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:55.046+0000 7faaeb736640 1 -- 172.21.15.52:0/3032579076 <== osd.1 v2:172.21.15.52:6824/544646809 24 ==== osd_op_reply(19 exist [writefull 0~5] v58'6 uv6 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7faadc063040 con 0x5599fab4cc70 2023-11-05T08:08:55.053 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:55.046+0000 7faaeb736640 10 client.4459.objecter ms_dispatch 0x5599fa95fee0 osd_op_reply(19 exist [writefull 0~5] v58'6 uv6 ondisk = 0) v8 2023-11-05T08:08:55.053 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:55.046+0000 7faaeb736640 10 client.4459.objecter in handle_osd_op_reply 2023-11-05T08:08:55.054 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:55.046+0000 7faaeb736640 7 client.4459.objecter handle_osd_op_reply 19 ondisk uv 6 in 12.1 attempt 0 2023-11-05T08:08:55.054 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:55.046+0000 7faaeb736640 10 client.4459.objecter op 0 rval 0 len 0 2023-11-05T08:08:55.305 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:55.046+0000 7faaeb736640 15 client.4459.objecter handle api_pool: Running main() from gmock_main.cc 2023-11-05T08:08:55.306 INFO:tasks.workunit.client.0.smithi052.stdout: api_pool: [==========] Running 9 tests from 1 test suite. 2023-11-05T08:08:55.306 INFO:tasks.workunit.client.0.smithi052.stdout: api_pool: [----------] Global test environment set-up. 2023-11-05T08:08:55.306 INFO:tasks.workunit.client.0.smithi052.stdout: api_pool: [----------] 9 tests from LibRadosPools 2023-11-05T08:08:55.306 INFO:tasks.workunit.client.0.smithi052.stdout: api_pool: [ RUN ] LibRadosPools.PoolList 2023-11-05T08:08:55.307 INFO:tasks.workunit.client.0.smithi052.stdout: api_pool: [ OK ] LibRadosPools.PoolList (4260 ms) 2023-11-05T08:08:55.307 INFO:tasks.workunit.client.0.smithi052.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookup 2023-11-05T08:08:55.307 INFO:tasks.workunit.client.0.smithi052.stdout: api_pool: [ OK ] LibRadosPools.PoolLookup (4260 ms) 2023-11-05T08:08:55.307 INFO:tasks.workunit.client.0.smithi052.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookup2 2023-11-05T08:08:55.308 INFO:tasks.workunit.client.0.smithi052.stdout: api_pool: [ OK ] LibRadosPools.PoolLookup2 (3911 ms) 2023-11-05T08:08:55.308 INFO:tasks.workunit.client.0.smithi052.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookupOtherInstance 2023-11-05T08:08:55.308 INFO:tasks.workunit.client.0.smithi052.stdout: api_pool: [ OK ] LibRadosPools.PoolLookupOtherInstance (3924 ms) 2023-11-05T08:08:55.308 INFO:tasks.workunit.client.0.smithi052.stdout: api_pool: [ RUN ] LibRadosPools.PoolReverseLookupOtherInstance 2023-11-05T08:08:55.308 INFO:tasks.workunit.client.0.smithi052.stdout: api_pool: [ OK ] LibRadosPools.PoolReverseLookupOtherInstance (3756 ms) 2023-11-05T08:08:55.309 INFO:tasks.workunit.client.0.smithi052.stdout: api_pool: [ RUN ] LibRadosPools.PoolDelete 2023-11-05T08:08:55.309 INFO:tasks.workunit.client.0.smithi052.stdout: api_pool: [ OK ] LibRadosPools.PoolDelete (7327 ms) 2023-11-05T08:08:55.309 INFO:tasks.workunit.client.0.smithi052.stdout: api_pool: [ RUN ] LibRadosPools.PoolCreateDelete 2023-11-05T08:08:55.309 INFO:tasks.workunit.client.0.smithi052.stdout: api_pool: [ OK ] LibRadosPools.PoolCreateDelete (5442 ms) 2023-11-05T08:08:55.309 INFO:tasks.workunit.client.0.smithi052.stdout: api_pool: [ RUN ] LibRadosPools.PoolCreateWithCrushRule 2023-11-05T08:08:55.310 INFO:tasks.workunit.client.0.smithi052.stdout: api_pool: [ OK ] LibRadosPools.PoolCreateWithCrushRule (5611 ms) 2023-11-05T08:08:55.310 INFO:tasks.workunit.client.0.smithi052.stdout: api_pool: [ RUN ] LibRadosPools.PoolGetBaseTier 2023-11-05T08:08:55.310 INFO:tasks.workunit.client.0.smithi052.stdout: api_pool: [ OK ] LibRadosPools.PoolGetBaseTier (8929 ms) 2023-11-05T08:08:55.310 INFO:tasks.workunit.client.0.smithi052.stdout: api_pool: [----------] 9 tests from LibRadosPools (47420 ms total) 2023-11-05T08:08:55.311 INFO:tasks.workunit.client.0.smithi052.stdout: api_pool: 2023-11-05T08:08:55.311 INFO:tasks.workunit.client.0.smithi052.stdout: api_pool: [----------] Global test environment tear-down 2023-11-05T08:08:55.311 INFO:tasks.workunit.client.0.smithi052.stdout: api_pool: [==========] 9 tests from 1 test suite ran. (47420 ms total) 2023-11-05T08:08:55.311 INFO:tasks.workunit.client.0.smithi052.stdout: api_pool: [ PASSED ] 9 tests. 2023-11-05T08:08:55.379 INFO:tasks.workunit.client.0.smithi052.stdout:_osd_op_reply completed tid 19 2023-11-05T08:08:55.380 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:55.046+0000 7faaeb736640 15 client.4459.objecter _finish_op 19 2023-11-05T08:08:55.380 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:55.046+0000 7faaeb736640 20 client.4459.objecter put_session s=0x5599fa94cf80 osd=1 4 2023-11-05T08:08:55.380 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:55.046+0000 7faaeb736640 15 client.4459.objecter _session_op_remove 1 19 2023-11-05T08:08:55.380 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:55.046+0000 7faaeb736640 5 client.4459.objecter 0 in flight 2023-11-05T08:08:55.380 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:55.046+0000 7faaeb736640 20 librados: complete_aio_write 0x5599fa9d1d70 2023-11-05T08:08:55.381 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationFuture (1373 ms) 2023-11-05T08:08:55.381 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationYield 2023-11-05T08:08:55.381 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:55.046+0000 7faaedc46780 20 librados: queue_aio_write 0x5599fa986fe0 completion 0x5599fa9d1e80 write_seq 6 2023-11-05T08:08:55.381 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:55.046+0000 7faaedc46780 10 client.4459.objecter _op_submit op 0x5599faaa0980 2023-11-05T08:08:55.381 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:55.047+0000 7faaedc46780 20 client.4459.objecter _calc_target epoch 58 base exist @12 precalc_pgid 0 pgid 0.0 is_write 2023-11-05T08:08:55.382 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:55.047+0000 7faaedc46780 20 client.4459.objecter _calc_target target exist @12 -> pgid 12.d3a59201 2023-11-05T08:08:55.382 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:55.047+0000 7faaedc46780 10 client.4459.objecter _calc_target raw pgid 12.d3a59201 -> actual 12.1 acting [1,6] primary 1 2023-11-05T08:08:55.382 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:55.047+0000 7faaedc46780 20 client.4459.objecter _get_session s=0x5599fa94cf80 osd=1 3 2023-11-05T08:08:55.382 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:55.047+0000 7faaedc46780 10 client.4459.objecter _op_submit oid exist '@12' '@12' [writefull 0~5 in=5b] tid 20 osd.1 2023-11-05T08:08:55.382 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:55.047+0000 7faaedc46780 20 client.4459.objecter get_session s=0x5599fa94cf80 osd=1 3 2023-11-05T08:08:55.383 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:55.047+0000 7faaedc46780 15 client.4459.objecter _session_op_assign 1 20 2023-11-05T08:08:55.383 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:55.047+0000 7faaedc46780 15 client.4459.objecter _send_op 20 to 12.1 on osd.1 2023-11-05T08:08:55.383 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:55.047+0000 7faaedc46780 1 -- 172.21.15.52:0/3032579076 --> [v2:172.21.15.52:6824/544646809,v1:172.21.15.52:6825/544646809] -- osd_op(unknown.0.0:20 12.1 12:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58) v8 -- 0x5599fa9d53c0 con 0x5599fab4cc70 2023-11-05T08:08:55.383 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:55.047+0000 7faaedc46780 20 client.4459.objecter put_session s=0x5599fa94cf80 osd=1 4 2023-11-05T08:08:55.383 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:55.047+0000 7faaedc46780 5 client.4459.objecter 1 in flight 2023-11-05T08:08:55.384 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:55.378+0000 7faad3fff640 1 -- 172.21.15.52:0/3032579076 <== osd.1 v2:172.21.15.52:6824/544646809 25 ==== osd_map(59..60 src has 1..60) v4 ==== 3395+0+0 (crc 0 0 0) 0x7faadc069040 con 0x5599fab4cc70 2023-11-05T08:08:55.384 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:55.378+0000 7faad3fff640 10 client.4459.objecter ms_dispatch 0x5599fa95fee0 osd_map(59..60 src has 1..60) v4 2023-11-05T08:08:55.384 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:55.378+0000 7faad3fff640 3 client.4459.objecter handle_osd_map got epochs [59,60] > 58 2023-11-05T08:08:55.384 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:55.378+0000 7faad3fff640 3 client.4459.objecter handle_osd_map decoding incremental epoch 59 2023-11-05T08:08:55.384 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:55.378+0000 7faad3fff640 10 client.4459.objecter checking op 20 2023-11-05T08:08:55.385 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:55.378+0000 7faad3fff640 20 client.4459.objecter _calc_target epoch 59 base exist @12 precalc_pgid 0 pgid 0.0 is_write 2023-11-05T08:08:55.385 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:55.378+0000 7faad3fff640 20 client.4459.objecter _calc_target target exist @12 -> pgid 12.d3a59201 2023-11-05T08:08:55.385 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:55.378+0000 7faad3fff640 3 client.4459.objecter handle_osd_map decoding incremental epoch 60 2023-11-05T08:08:55.385 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:55.378+0000 7faad3fff640 10 client.4459.objecter checking op 20 2023-11-05T08:08:55.729 INFO:tasks.ceph.osd.6.smithi156.stderr:2023-11-05T08:08:55.711+0000 ea58640 -1 osd.6 61 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4540.0:2 16.1a 16:5c6776db:::0.obj:head [write 0~99 in=99b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24) 2023-11-05T08:08:56.289 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:55.378+0000 7faad3fff640 20 client.4459.objecter _calc_target epoch 60 base exist @12 precalc_pgid 0 pgid 0.0 is_write 2023-11-05T08:08:56.289 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:55.378+0000 7faad3fff640 20 client.4459.objecter _calc_target target exist @12 -> pgid 12.d3a59201 2023-11-05T08:08:56.289 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:55.378+0000 7faad3fff640 20 client.4459.objecter dump_active .. 0 homeless 2023-11-05T08:08:56.289 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:55.378+0000 7faad3fff640 20 client.4459.objecter 20 12.d3a59201 osd.1 exist [writefull 0~5 in=5b] 2023-11-05T08:08:56.290 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:55.909+0000 7faad2ffd640 10 monclient: tick 2023-11-05T08:08:56.290 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:55.909+0000 7faad2ffd640 10 monclient: _check_auth_tickets 2023-11-05T08:08:56.290 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:55.909+0000 7faad2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:08:56.290 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:56.286+0000 7faaeb736640 1 -- 172.21.15.52:0/3032579076 <== osd.1 v2:172.21.15.52:6824/544646809 26 ==== osd_op_reply(20 exist [writefull 0~5] v60'7 uv7 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7faadc063040 con 0x5599fab4cc70 2023-11-05T08:08:56.290 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:56.286+0000 7faaeb736640 10 client.4459.objecter ms_dispatch 0x5599fa95fee0 osd_op_reply(20 exist [writefull 0~5] v60'7 uv7 ondisk = 0) v8 2023-11-05T08:08:56.290 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:56.286+0000 7faaeb736640 10 client.4459.objecter in handle_osd_op_reply 2023-11-05T08:08:56.291 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:56.286+0000 7faaeb736640 7 client.4459.objecter handle_osd_op_reply 20 ondisk uv 7 in 12.1 attempt 0 2023-11-05T08:08:56.291 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:56.286+0000 7faaeb736640 10 client.4459.objecter op 0 rval 0 len 0 2023-11-05T08:08:56.291 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:56.286+0000 7faaeb736640 15 client.4459.objecter handle_osd_op_reply completed tid 20 2023-11-05T08:08:56.291 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:56.286+0000 7faaeb736640 15 client.4459.objecter _finish_op 20 2023-11-05T08:08:56.292 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:56.286+0000 7faaeb736640 20 client.4459.objecter put_session s=0x5599fa94cf80 osd=1 4 2023-11-05T08:08:56.292 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:56.286+0000 7faaeb736640 15 client.4459.objecter _session_op_remove 1 20 2023-11-05T08:08:56.292 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:56.286+0000 7faaeb736640 5 client.4459.objecter 0 in flight 2023-11-05T08:08:56.292 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:56.286+0000 7faaeb736640 20 librados: complete_aio_write 0x5599fa9d1e80 2023-11-05T08:08:56.292 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationYield (1240 ms) 2023-11-05T08:08:56.292 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:56.287+0000 7faaedc46780 10 librados: watch_flush enter 2023-11-05T08:08:56.293 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:56.287+0000 7faaedc46780 10 librados: watch_flush exit 2023-11-05T08:08:56.293 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:56.287+0000 7faaedc46780 10 client.4459.objecter close_session for osd.1 2023-11-05T08:08:56.293 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:56.287+0000 7faaedc46780 1 -- 172.21.15.52:0/3032579076 >> [v2:172.21.15.52:6824/544646809,v1:172.21.15.52:6825/544646809] conn(0x5599fab4cc70 msgr2=0x5599fab4f060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:08:56.293 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:56.287+0000 7faaedc46780 1 --2- 172.21.15.52:0/3032579076 >> [v2:172.21.15.52:6824/544646809,v1:172.21.15.52:6825/544646809] conn(0x5599fab4cc70 0x5599fab4f060 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:08:56.293 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:56.287+0000 7faaedc46780 20 client.4459.objecter put_session s=0x5599fa94cf80 osd=1 1 2023-11-05T08:08:56.294 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:56.287+0000 7faaedc46780 20 client.4459.objecter shutdown clearing up homeless session... 2023-11-05T08:08:56.294 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:56.287+0000 7faaedc46780 10 client.4459.objecter successfully canceled tick 2023-11-05T08:08:56.294 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:56.287+0000 7faaedc46780 1 -- 172.21.15.52:0/3032579076 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7faacc06aa70 msgr2=0x7faacc06cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:08:56.294 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:56.287+0000 7faaedc46780 1 --2- 172.21.15.52:0/3032579076 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7faacc06aa70 0x7faacc06cf30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7faae0003f70 tx=0x7faae0003500 comp rx=0 tx=0).stop 2023-11-05T08:08:56.295 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:56.287+0000 7faaedc46780 10 monclient: shutdown 2023-11-05T08:08:56.295 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:56.287+0000 7faaedc46780 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:08:56.295 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:56.287+0000 7faaedc46780 1 -- 172.21.15.52:0/3032579076 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5599faa06c70 msgr2=0x5599faa92100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:08:56.295 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:56.287+0000 7faaedc46780 1 --2- 172.21.15.52:0/3032579076 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5599faa06c70 0x5599faa92100 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7faad4000c00 tx=0x7faad4003020 comp rx=0 tx=0).stop 2023-11-05T08:08:56.296 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:56.287+0000 7faaeb736640 1 -- 172.21.15.52:0/3032579076 reap_dead start 2023-11-05T08:08:56.296 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:56.287+0000 7faaedc46780 1 -- 172.21.15.52:0/3032579076 shutdown_connections 2023-11-05T08:08:56.296 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:56.287+0000 7faaedc46780 1 -- 172.21.15.52:0/3032579076 >> 172.21.15.52:0/3032579076 conn(0x5599faa0c450 msgr2=0x5599faa0e110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:08:56.296 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: [----------] 12 tests from AsioRados (34758 ms total) 2023-11-05T08:08:56.296 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:56.296 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: [----------] Global test environment tear-down 2023-11-05T08:08:56.297 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: [==========] 12 tests from 1 test suite ran. (48436 ms total) 2023-11-05T08:08:56.297 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: [ PASSED ] 12 tests. 2023-11-05T08:08:56.297 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:56.287+0000 7faaedc46780 1 -- 172.21.15.52:0/3032579076 shutdown_connections 2023-11-05T08:08:56.297 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:56.287+0000 7faaedc46780 1 -- 172.21.15.52:0/3032579076 wait complete. 2023-11-05T08:08:56.297 INFO:tasks.workunit.client.0.smithi052.stdout: api_asio: 2023-11-05T08:08:56.287+0000 7faaedc46780 1 librados: shutdown 2023-11-05T08:08:56.976 INFO:tasks.ceph.osd.6.smithi156.stderr:2023-11-05T08:08:56.903+0000 ea58640 -1 osd.6 62 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4540.0:2 16.1a 16:5c6776db:::0.obj:head [write 0~99 in=99b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24) 2023-11-05T08:08:58.068 INFO:tasks.ceph.osd.6.smithi156.stderr:2023-11-05T08:08:58.061+0000 ea58640 -1 osd.6 63 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4540.0:2 16.1a 16:5c6776db:::0.obj:head [write 0~99 in=99b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24) 2023-11-05T08:08:59.046 INFO:tasks.ceph.osd.6.smithi156.stderr:2023-11-05T08:08:59.043+0000 ea58640 -1 osd.6 64 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4540.0:2 16.1a 16:5c6776db:::0.obj:head [write 0~99 in=99b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24) 2023-11-05T08:09:00.057 INFO:tasks.ceph.osd.6.smithi156.stderr:2023-11-05T08:09:00.046+0000 ea58640 -1 osd.6 65 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4540.0:2 16.1a 16:5c6776db:::0.obj:head [write 0~99 in=99b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24) 2023-11-05T08:09:01.178 INFO:tasks.ceph.osd.6.smithi156.stderr:2023-11-05T08:09:01.168+0000 ea58640 -1 osd.6 67 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4540.0:2 16.1a 16:5c6776db:::0.obj:head [write 0~99 in=99b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24) 2023-11-05T08:09:02.331 INFO:tasks.ceph.osd.6.smithi156.stderr:2023-11-05T08:09:02.316+0000 ea58640 -1 osd.6 68 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4540.0:2 16.1a 16:5c6776db:::0.obj:head [write 0~99 in=99b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24) 2023-11-05T08:09:03.614 INFO:tasks.ceph.osd.6.smithi156.stderr:2023-11-05T08:09:03.602+0000 ea58640 -1 osd.6 69 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4540.0:2 16.1a 16:5c6776db:::0.obj:head [write 0~99 in=99b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24) 2023-11-05T08:09:04.771 INFO:tasks.ceph.osd.6.smithi156.stderr:2023-11-05T08:09:04.740+0000 ea58640 -1 osd.6 70 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4540.0:2 16.1a 16:5c6776db:::0.obj:head [write 0~99 in=99b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24) 2023-11-05T08:09:05.937 INFO:tasks.ceph.osd.6.smithi156.stderr:2023-11-05T08:09:05.921+0000 ea58640 -1 osd.6 71 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4540.0:2 16.1a 16:5c6776db:::0.obj:head [write 0~99 in=99b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24) 2023-11-05T08:09:09.650 INFO:tasks.ceph.osd.6.smithi156.stderr:2023-11-05T08:09:09.567+0000 ea58640 -1 osd.6 75 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4702.0:2 40.13 40.6bb47433 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e47) 2023-11-05T08:09:10.525 INFO:tasks.ceph.osd.6.smithi156.stderr:2023-11-05T08:09:10.524+0000 ea58640 -1 osd.6 75 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4702.0:2 40.13 40.6bb47433 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e47) 2023-11-05T08:09:11.647 INFO:tasks.ceph.osd.6.smithi156.stderr:2023-11-05T08:09:11.637+0000 ea58640 -1 osd.6 77 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4702.0:2 40.13 40.6bb47433 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e47) 2023-11-05T08:09:12.825 INFO:tasks.ceph.osd.6.smithi156.stderr:2023-11-05T08:09:12.802+0000 ea58640 -1 osd.6 78 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4702.0:2 40.13 40.6bb47433 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e47) 2023-11-05T08:09:13.992 INFO:tasks.ceph.osd.6.smithi156.stderr:2023-11-05T08:09:13.877+0000 ea58640 -1 osd.6 79 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4702.0:2 40.13 40.6bb47433 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e47) 2023-11-05T08:09:14.123 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:03:17.197 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:09:14.127 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:03:17.202 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:09:14.136 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:03:17.252 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:09:14.147 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:03:17.263 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:09:14.213 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:03:17.328 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:09:14.229 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:03:17.303 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:09:14.235 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:03:17.350 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:09:14.278 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:03:17.394 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:09:14.359 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:03:17.475 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:09:15.024 INFO:tasks.ceph.osd.6.smithi156.stderr:2023-11-05T08:09:14.909+0000 ea58640 -1 osd.6 80 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4702.0:2 40.13 40.6bb47433 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e47) 2023-11-05T08:09:16.137 INFO:tasks.ceph.osd.6.smithi156.stderr:2023-11-05T08:09:16.117+0000 ea58640 -1 osd.6 81 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4702.0:2 40.13 40.6bb47433 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e47) 2023-11-05T08:09:17.182 INFO:tasks.ceph.osd.6.smithi156.stderr:2023-11-05T08:09:17.178+0000 ea58640 -1 osd.6 82 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4702.0:2 40.13 40.6bb47433 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e47) 2023-11-05T08:09:25.360 INFO:tasks.workunit.client.0.smithi052.stdout: api_cls_remote_reads: [==========] Running 1 test from 1 test suite. 2023-11-05T08:09:25.360 INFO:tasks.workunit.client.0.smithi052.stdout: api_cls_remote_reads: [----------] Global test environment set-up. 2023-11-05T08:09:25.360 INFO:tasks.workunit.client.0.smithi052.stdout: api_cls_remote_reads: [----------] 1 test from ClsTestRemoteReads 2023-11-05T08:09:25.361 INFO:tasks.workunit.client.0.smithi052.stdout: api_cls_remote_reads: [ RUN ] ClsTestRemoteReads.TestGather 2023-11-05T08:09:25.361 INFO:tasks.workunit.client.0.smithi052.stdout: api_cls_remote_reads: [ OK ] ClsTestRemoteReads.TestGather (77273 ms) 2023-11-05T08:09:25.361 INFO:tasks.workunit.client.0.smithi052.stdout: api_cls_remote_reads: [----------] 1 test from ClsTestRemoteReads (77273 ms total) 2023-11-05T08:09:25.361 INFO:tasks.workunit.client.0.smithi052.stdout: api_cls_remote_reads: 2023-11-05T08:09:25.361 INFO:tasks.workunit.client.0.smithi052.stdout: api_cls_remote_reads: [----------] Global test environment tear-down 2023-11-05T08:09:25.362 INFO:tasks.workunit.client.0.smithi052.stdout: api_cls_remote_reads: [==========] 1 test from 1 test suite ran. (77273 ms total) 2023-11-05T08:09:25.362 INFO:tasks.workunit.client.0.smithi052.stdout: api_cls_remote_reads: [ PASSED ] 1 test. 2023-11-05T08:09:31.531 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:09:31.469+0000 ea58640 -1 osd.7 96 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4768.0:2 52.1f 52.e57571bf (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e67) 2023-11-05T08:09:52.126 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify_pp: Running main() from gmock_main.cc 2023-11-05T08:09:52.126 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify_pp: [==========] Running 16 tests from 2 test suites. 2023-11-05T08:09:52.127 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify_pp: [----------] Global test environment set-up. 2023-11-05T08:09:52.127 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify_pp: [----------] 2 tests from LibRadosWatchNotifyECPP 2023-11-05T08:09:52.127 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyECPP.WatchNotify 2023-11-05T08:09:52.127 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify_pp: notify 2023-11-05T08:09:52.128 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyECPP.WatchNotify (34053 ms) 2023-11-05T08:09:52.128 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyECPP.WatchNotifyTimeout 2023-11-05T08:09:52.128 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyECPP.WatchNotifyTimeout (25013 ms) 2023-11-05T08:09:52.128 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify_pp: [----------] 2 tests from LibRadosWatchNotifyECPP (59066 ms total) 2023-11-05T08:09:52.128 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify_pp: 2023-11-05T08:09:52.129 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify_pp: [----------] 14 tests from LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP 2023-11-05T08:09:52.129 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/0 2023-11-05T08:09:52.129 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify_pp: notify 2023-11-05T08:09:52.129 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/0 (1938 ms) 2023-11-05T08:09:52.129 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 2023-11-05T08:09:52.130 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify_pp: notify 2023-11-05T08:09:52.130 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 (24106 ms) 2023-11-05T08:09:52.130 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/0 2023-11-05T08:09:52.130 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/0 (1518 ms) 2023-11-05T08:09:52.130 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/1 2023-11-05T08:09:52.130 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/1 (1753 ms) 2023-11-05T08:09:52.131 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/0 2023-11-05T08:09:52.131 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify_pp: handle_notify cookie 94250825744272 notify_id 446676598785 notifier_gid 4801 2023-11-05T08:09:52.131 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/0 (528 ms) 2023-11-05T08:09:52.131 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/1 2023-11-05T08:09:52.131 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify_pp: handle_notify cookie 94250824944560 notify_id 446676598786 notifier_gid 4801 2023-11-05T08:09:52.132 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/1 (228 ms) 2023-11-05T08:09:52.132 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/0 2023-11-05T08:09:52.132 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify_pp: handle_notify cookie 94250824944560 notify_id 446676598786 notifier_gid 4801 2023-11-05T08:09:52.132 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/0 (350 ms) 2023-11-05T08:09:52.132 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/1 2023-11-05T08:09:52.133 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify_pp: handle_notify cookie 94250825673008 notify_id 446676598787 notifier_gid 4801 2023-11-05T08:09:52.133 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/1 (299 ms) 2023-11-05T08:09:52.133 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/0 2023-11-05T08:09:52.133 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify_pp: handle_notify cookie 94250825693744 notify_id 446676598788 notifier_gid 4801 2023-11-05T08:09:52.133 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/0 (333 ms) 2023-11-05T08:09:52.134 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/1 2023-11-05T08:09:52.134 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify_pp: handle_notify cookie 94250825693744 notify_id 446676598789 notifier_gid 4801 2023-11-05T08:09:52.134 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/1 (261 ms) 2023-11-05T08:09:52.134 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/0 2023-11-05T08:09:52.134 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify_pp: trying... 2023-11-05T08:09:52.135 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify_pp: handle_notify cookie 94250825693744 notify_id 450971566080 notifier_gid 4801 2023-11-05T08:09:52.135 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify_pp: timed out 2023-11-05T08:09:53.607 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify_pp: flus api_cmd_pp: Running main() from gmock_main.cc 2023-11-05T08:09:53.608 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd_pp: [==========] Running 3 tests from 1 test suite. 2023-11-05T08:09:53.608 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd_pp: [----------] Global test environment set-up. 2023-11-05T08:09:53.608 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd_pp: [----------] 3 tests from LibRadosCmd 2023-11-05T08:09:53.608 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.MonDescribePP 2023-11-05T08:09:53.608 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd_pp: [ OK ] LibRadosCmd.MonDescribePP (987 ms) 2023-11-05T08:09:53.609 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.OSDCmdPP 2023-11-05T08:09:53.609 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd_pp: [ OK ] LibRadosCmd.OSDCmdPP (73 ms) 2023-11-05T08:09:53.609 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.PGCmdPP 2023-11-05T08:09:53.609 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd_pp: [ OK ] LibRadosCmd.PGCmdPP (104540 ms) 2023-11-05T08:09:53.609 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd_pp: [----------] 3 tests from LibRadosCmd (105600 ms total) 2023-11-05T08:09:53.610 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd_pp: 2023-11-05T08:09:53.610 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd_pp: [----------] Global test environment tear-down 2023-11-05T08:09:53.610 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd_pp: [==========] 3 tests from 1 test suite ran. (105600 ms total) 2023-11-05T08:09:53.610 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd_pp: [ PASSED ] 3 tests. 2023-11-05T08:09:56.783 INFO:tasks.workunit.client.0.smithi052.stdout: api_c_read_operations: Running main() from gmock_main.cc 2023-11-05T08:09:56.783 INFO:tasks.workunit.client.0.smithi052.stdout: api_c_read_operations: [==========] Running 17 tests from 1 test suite. 2023-11-05T08:09:56.784 INFO:tasks.workunit.client.0.smithi052.stdout: api_c_read_operations: [----------] Global test environment set-up. 2023-11-05T08:09:56.784 INFO:tasks.workunit.client.0.smithi052.stdout: api_c_read_operations: [----------] 17 tests from CReadOpsTest 2023-11-05T08:09:56.784 INFO:tasks.workunit.client.0.smithi052.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.NewDelete 2023-11-05T08:09:56.784 INFO:tasks.workunit.client.0.smithi052.stdout: api_c_read_operations: [ OK ] CReadOpsTest.NewDelete (1 ms) 2023-11-05T08:09:56.784 INFO:tasks.workunit.client.0.smithi052.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.SetOpFlags 2023-11-05T08:09:56.785 INFO:tasks.workunit.client.0.smithi052.stdout: api_c_read_operations: [ OK ] CReadOpsTest.SetOpFlags (32498 ms) 2023-11-05T08:09:56.785 INFO:tasks.workunit.client.0.smithi052.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.AssertExists 2023-11-05T08:09:56.785 INFO:tasks.workunit.client.0.smithi052.stdout: api_c_read_operations: [ OK ] CReadOpsTest.AssertExists (5156 ms) 2023-11-05T08:09:56.785 INFO:tasks.workunit.client.0.smithi052.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.AssertVersion 2023-11-05T08:09:56.786 INFO:tasks.workunit.client.0.smithi052.stdout: api_c_read_operations: [ OK ] CReadOpsTest.AssertVersion (5400 ms) 2023-11-05T08:09:56.786 INFO:tasks.workunit.client.0.smithi052.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.CmpXattr 2023-11-05T08:09:56.786 INFO:tasks.workunit.client.0.smithi052.stdout: api_c_read_operations: [ OK ] CReadOpsTest.CmpXattr (12270 ms) 2023-11-05T08:09:56.786 INFO:tasks.workunit.client.0.smithi052.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Read 2023-11-05T08:09:56.786 INFO:tasks.workunit.client.0.smithi052.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Read (25652 ms) 2023-11-05T08:09:56.787 INFO:tasks.workunit.client.0.smithi052.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Checksum 2023-11-05T08:09:56.787 INFO:tasks.workunit.client.0.smithi052.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Checksum (4809 ms) 2023-11-05T08:09:56.787 INFO:tasks.workunit.client.0.smithi052.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.RWOrderedRead 2023-11-05T08:09:56.787 INFO:tasks.workunit.client.0.smithi052.stdout: api_c_read_operations: [ OK ] CReadOpsTest.RWOrderedRead (111 ms) 2023-11-05T08:09:56.787 INFO:tasks.workunit.client.0.smithi052.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.ShortRead 2023-11-05T08:09:56.788 INFO:tasks.workunit.client.0.smithi052.stdout: api_c_read_operations: [ OK ] CReadOpsTest.ShortRead (980 ms) 2023-11-05T08:09:56.788 INFO:tasks.workunit.client.0.smithi052.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Exec 2023-11-05T08:09:56.788 INFO:tasks.workunit.client.0.smithi052.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Exec (3183 ms) 2023-11-05T08:09:56.788 INFO:tasks.workunit.client.0.smithi052.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.ExecUserBuf 2023-11-05T08:09:56.788 INFO:tasks.workunit.client.0.smithi052.stdout: api_c_read_operations: [ OK ] CReadOpsTest.ExecUserBuf (237 ms) 2023-11-05T08:09:56.788 INFO:tasks.workunit.client.0.smithi052.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Stat 2023-11-05T08:09:56.789 INFO:tasks.workunit.client.0.smithi052.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Stat (1241 ms) 2023-11-05T08:09:56.789 INFO:tasks.workunit.client.0.smithi052.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Stat2 2023-11-05T08:09:56.789 INFO:tasks.workunit.client.0.smithi052.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Stat2 (1139 ms) 2023-11-05T08:09:56.789 INFO:tasks.workunit.client.0.smithi052.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Omap 2023-11-05T08:09:56.790 INFO:tasks.workunit.client.0.smithi052.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Omap (1892 ms) 2023-11-05T08:09:56.790 INFO:tasks.workunit.client.0.smithi052.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.OmapNuls 2023-11-05T08:09:56.790 INFO:tasks.workunit.client.0.smithi052.stdout: api_c_read_operations: [ OK ] CReadOpsTest.OmapNuls (433 ms) 2023-11-05T08:09:56.790 INFO:tasks.workunit.client.0.smithi052.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.GetXattrs 2023-11-05T08:09:56.790 INFO:tasks.workunit.client.0.smithi052.stdout: api_c_read_operations: [ OK ] CReadOpsTest.GetXattrs (464 ms) 2023-11-05T08:09:56.791 INFO:tasks.workunit.client.0.smithi052.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.CmpExt 2023-11-05T08:09:56.791 INFO:tasks.workunit.client.0.smithi052.stdout: api_c_read_operations: [ OK ] CReadOpsTest.CmpExt (276 ms) 2023-11-05T08:09:56.791 INFO:tasks.workunit.client.0.smithi052.stdout: api_c_read_operations: [----------] 17 tests from CReadOpsTest (95742 ms total) 2023-11-05T08:09:56.791 INFO:tasks.workunit.client.0.smithi052.stdout: api_c_read_operations: 2023-11-05T08:09:56.791 INFO:tasks.workunit.client.0.smithi052.stdout: api_c_read_operations: [----------] Global test environment tear-down 2023-11-05T08:09:56.792 INFO:tasks.workunit.client.0.smithi052.stdout: api_c_read_operations: [==========] 17 tests from 1 test suite ran. (108746 ms total) 2023-11-05T08:09:56.792 INFO:tasks.workunit.client.0.smithi052.stdout: api_c_read_operations: [ PASSED ] 17 tests. 2023-11-05T08:09:57.545 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:04:00.660 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:09:57.568 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:04:00.683 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:09:57.921 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:04:01.037 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:09:58.582 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:04:01.657 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:09:58.591 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:04:01.665 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:09:58.723 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:04:01.838 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:09:58.724 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:04:01.798 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:09:58.736 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:04:01.851 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:09:58.962 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:04:02.078 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:09:59.407 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd: Running main() from gmock_main.cc 2023-11-05T08:09:59.407 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd: [==========] Running 4 tests from 1 test suite. 2023-11-05T08:09:59.407 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd: [----------] Global test environment set-up. 2023-11-05T08:09:59.408 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd: [----------] 4 tests from LibRadosCmd 2023-11-05T08:09:59.408 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd: [ RUN ] LibRadosCmd.MonDescribe 2023-11-05T08:09:59.408 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd: [ OK ] LibRadosCmd.MonDescribe (1109 ms) 2023-11-05T08:09:59.408 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd: [ RUN ] LibRadosCmd.OSDCmd 2023-11-05T08:09:59.408 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd: [ OK ] LibRadosCmd.OSDCmd (350 ms) 2023-11-05T08:09:59.409 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd: [ RUN ] LibRadosCmd.PGCmd 2023-11-05T08:09:59.409 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd: [ OK ] LibRadosCmd.PGCmd (101054 ms) 2023-11-05T08:09:59.409 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd: [ RUN ] LibRadosCmd.WatchLog 2023-11-05T08:09:59.409 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd: got: 2023-11-05T08:09:42.770471+0000 mon.c [INF] from='client.? 172.21.15.52:0/3078286159' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi052-91894-6", "tierpool": "test-rados-api-smithi052-91894-7", "force_nonempty": "--force-nonempty" }]: dispatch 2023-11-05T08:09:59.409 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd: got: 2023-11-05T08:09:43.053658+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi052-91894-6", "tierpool": "test-rados-api-smithi052-91894-7", "force_nonempty": "--force-nonempty" }]: dispatch 2023-11-05T08:09:59.410 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd: got: 2023-11-05T08:09:46.693189+0000 mon.a [INF] Health check cleared: SLOW_OPS (was: 0 slow ops, oldest one blocked for 34 sec, osd.7 has slow ops) 2023-11-05T08:09:59.410 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd: got: 2023-11-05T08:09:47.914152+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi052-91894-6", "tierpool": "test-rados-api-smithi052-91894-7", "force_nonempty": "--force-nonempty" }]': finished 2023-11-05T08:09:59.410 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd: got: 2023-11-05T08:09:49.482430+0000 mon.b [INF] from='client.? 172.21.15.52:0/3056641797' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi052-92016-7"}]: dispatch 2023-11-05T08:09:59.410 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd: got: 2023-11-05T08:09:49.586239+0000 mon.c [INF] from='client.? 172.21.15.52:0/3078286159' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi052-91894-6", "overlaypool": "test-rados-api-smithi052-91894-7"}]: dispatch 2023-11-05T08:09:59.410 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd: got: 2023-11-05T08:09:50.180355+0000 mon.c [INF] from='client.4641 172.21.15.52:0/2421995323' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi052-91959-7"}]: dispatch 2023-11-05T08:09:59.411 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd: got: 2023-11-05T08:09:51.329932+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi052-92016-7"}]: dispatch 2023-11-05T08:09:59.411 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd: got: 2023-11-05T08:09:52.059013+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi052-91894-6", "overlaypool": "test-rados-api-smithi052-91894-7"}]: dispatch 2023-11-05T08:09:59.411 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd: got: 2023-11-05T08:09:52.068785+0000 mon.a [INF] from='client.4641 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi052-91959-7"}]: dispatch 2023-11-05T08:09:59.411 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd: got: 2023-11-05T08:09:52.128844+0000 mon.b [INF] from='client.? 172.21.15.52:0/1249158201' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi052-91779-10"}]: dispatch 2023-11-05T08:09:59.411 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd: got: 2023-11-05T08:09:52.434451+0000 mon.c [INF] from='client.? 172.21.15.52:0/447086353' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2023-11-05T08:09:59.412 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd: got: 2023-11-05T08:09:53.162743+0000 mon.a [INF] from='client.? 172.21.15.52:0/1167327960' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi052-91614-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2023-11-05T08:10:00.153 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd: got: 2023-11-05 api_list: [==========] Running 11 tests from 3 test suites. 2023-11-05T08:10:00.153 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: [----------] Global test environment set-up. 2023-11-05T08:10:00.153 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: [----------] 7 tests from LibRadosList 2023-11-05T08:10:00.153 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: [ RUN ] LibRadosList.ListObjects 2023-11-05T08:10:00.154 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: [ OK ] LibRadosList.ListObjects (86100 ms) 2023-11-05T08:10:00.154 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: [ RUN ] LibRadosList.ListObjectsZeroInName 2023-11-05T08:10:00.154 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: [ OK ] LibRadosList.ListObjectsZeroInName (7793 ms) 2023-11-05T08:10:00.154 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: [ RUN ] LibRadosList.ListObjectsNS 2023-11-05T08:10:00.154 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: myset foo1,foo2,foo3 2023-11-05T08:10:00.155 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: foo1 2023-11-05T08:10:00.155 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: foo2 2023-11-05T08:10:00.155 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: foo3 2023-11-05T08:10:00.155 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: myset foo1,foo4,foo5 2023-11-05T08:10:00.155 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: foo4 2023-11-05T08:10:00.156 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: foo5 2023-11-05T08:10:00.156 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: foo1 2023-11-05T08:10:00.156 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: myset foo6,foo7 2023-11-05T08:10:00.156 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: foo7 2023-11-05T08:10:00.156 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: foo6 2023-11-05T08:10:00.156 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: myset :foo1,:foo2,:foo3,ns1:foo1,ns1:foo4,ns1:foo5,ns2:foo6,ns2:foo7 2023-11-05T08:10:00.157 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: ns1:foo4 2023-11-05T08:10:00.157 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: ns1:foo5 2023-11-05T08:10:00.157 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: ns2:foo7 2023-11-05T08:10:00.157 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: ns2:foo6 2023-11-05T08:10:00.157 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: ns1:foo1 2023-11-05T08:10:00.158 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: :foo1 2023-11-05T08:10:00.158 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: :foo2 2023-11-05T08:10:00.158 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: :foo3 2023-11-05T08:10:00.158 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: [ OK ] LibRadosList.ListObjectsNS (6915 ms) 2023-11-05T08:10:00.158 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: [ RUN ] LibRadosList.ListObjectsStart 2023-11-05T08:10:00.159 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: 1 0 2023-11-05T08:10:00.159 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: 10 0 2023-11-05T08:10:00.159 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: 13 0 2023-11-05T08:10:00.159 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: 7 0 2023-11-05T08:10:00.159 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: 14 0 2023-11-05T08:10:00.160 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: 0 0 2023-11-05T08:10:00.160 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: 15 0 2023-11-05T08:10:00.160 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: 11 0 2023-11-05T08:10:00.160 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: 5 0 2023-11-05T08:10:00.160 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: 8 0 2023-11-05T08:10:00.160 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: 6 0 2023-11-05T08:10:00.161 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: 3 0 2023-11-05T08:10:00.161 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: 4 0 2023-11-05T08:10:00.161 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: 12 0 2023-11-05T08:10:00.161 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: 9 0 2023-11-05T08:10:00.161 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: 2 0 2023-11-05T08:10:00.161 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: have 1 expect one of 0,1,10,11,12,13,14,15,2,3,4,5,6,7,8,9 2023-11-05T08:10:00.162 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: [ OK ] LibRadosList.ListObjectsStart (4133 ms) 2023-11-05T08:10:00.162 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: [ RUN ] LibRadosList.ListObjectsCursor 2023-11-05T08:10:00.162 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: x cursor=MIN 2023-11-05T08:10:00.162 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: > oid=1 cursor=6:02547ec2:::1:head 2023-11-05T08:10:00.162 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: > oid=10 cursor=6:52ea6a34:::10:head 2023-11-05T08:10:00.163 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: > oid=13 cursor=6:566253c9:::13:head 2023-11-05T08:10:00.163 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: > oid=7 cursor=6:5c6b0b28:::7:head 2023-11-05T08:10:00.163 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: > oid=14 cursor=6:62a1935d:::14:head 2023-11-05T08:10:00.163 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: > oid=0 cursor=6:6cac518f:::0:head 2023-11-05T08:10:00.163 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: > oid=15 cursor=6:863748b0:::15:head 2023-11-05T08:10:00.164 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: > oid=11 cursor=6:89d3ae78:::11:head 2023-11-05T08:10:00.164 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: > oid=5 cursor=6:b29083e3:::5:head 2023-11-05T08:10:00.164 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: > oid=8 cursor=6:bd63b0f1:::8:head 2023-11-05T08:10:00.164 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: > oid=6 cursor=6:c4fdafeb:::6:head 2023-11-05T08:10:00.164 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: > oid=3 cursor=6:cfc208b3:::3:head 2023-11-05T08:10:00.165 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: > oid=4 cursor=6:d83876eb:::4:head 2023-11-05T08:10:00.165 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: > oid=12 cursor=6:de5d7c5f:::12:head 2023-11-05T08:10:00.165 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: > oid=9 cursor=6:e960b815:::9:head 2023-11-05T08:10:00.165 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: > oid=2 cursor=6:f905c69b:::2:head 2023-11-05T08:10:00.165 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: FIRST> seek to MIN oid=1 2023-11-05T08:10:00.165 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: : oid=1 cursor=6:02547ec2:::1:head 2023-11-05T08:10:00.166 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: : seek to 6:02547ec2:::1:head 2023-11-05T08:10:00.166 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: > 6:02547ec2:::1:head -> 1 2023-11-05T08:10:00.166 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: : oid=10 cursor=6:52ea6a34:::10:head 2023-11-05T08:10:00.166 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: : seek to 6:52ea6a34:::10:head 2023-11-05T08:10:00.167 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: > 6:52ea6a34:::10:head -> 10 2023-11-05T08:10:00.167 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: : oid=13 cursor=6:566253c9:::13:head 2023-11-05T08:10:00.167 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: : seek to 6:566253c9:::13:head 2023-11-05T08:10:00.167 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: > 6:566253c9:::13:head -> 13 2023-11-05T08:10:00.167 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: : oid=7 cursor=6:5c6b0b28:::7:head 2023-11-05T08:10:00.167 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: : seek to 6:5c6b0b28:::7:head 2023-11-05T08:10:00.168 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: > 6:5c6b0b28:::7:head -> 7 2023-11-05T08:10:06.100 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: : oid=14 cursor=6:62a1935d:::14:head 2023-11-05T08:10:06.100 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: : seek to 6:62a1935d:::14:head 2023-11-05T08:10:06.100 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: > 6:62a1935d:::14:head -> 14 2023-11-05T08:10:06.100 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: : oid=0 cursor=6:6cac518f:::0:head 2023-11-05T08:10:06.101 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: : seek to 6:6cac518f:::0:head 2023-11-05T08:10:06.101 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: > 6:6cac518f:::0:head -> 0 2023-11-05T08:10:06.101 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: : oid=15 cursor=6:863748b0:::15:head 2023-11-05T08:10:06.101 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: : seek to 6:863748b0:::15:head 2023-11-05T08:10:06.101 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: > 6:863748b0:::15:head -> 15 2023-11-05T08:10:06.102 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: : oid=11 cursor=6:89d3ae78:::11:head 2023-11-05T08:10:06.102 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: : seek to 6:89d3ae78:::11:head 2023-11-05T08:10:06.102 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: > 6:89d3ae78:::11:head -> 11 2023-11-05T08:10:06.102 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: : oid=5 cursor=6:b29083e3:::5:head 2023-11-05T08:10:06.102 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: : seek to 6:b29083e3:::5:head 2023-11-05T08:10:06.103 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: > 6:b29083e3:::5:head -> 5 2023-11-05T08:10:06.103 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: : oid=8 cursor=6:bd63b0f1:::8:head 2023-11-05T08:10:06.103 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: : seek to 6:bd63b0f1:::8:head 2023-11-05T08:10:06.103 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: > 6:bd63b0f1:::8:head -> 8 2023-11-05T08:10:06.103 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: : oid=6 cursor=6:c4fdafeb:::6:head 2023-11-05T08:10:06.104 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: : seek to 6:c4fdafeb:::6:head 2023-11-05T08:10:06.104 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: > 6:c4fdafeb:::6:head -> 6 2023-11-05T08:10:06.104 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: : oid=3 cursor=6:cfc208b3:::3:head 2023-11-05T08:10:06.104 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: : seek to 6:cfc208b3:::3:head 2023-11-05T08:10:06.104 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: > 6:cfc208b3:::3:head -> 3 2023-11-05T08:10:06.105 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: : oid=4 cursor=6:d83876eb:::4:head 2023-11-05T08:10:06.105 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: : seek to 6:d83876eb:::4:head 2023-11-05T08:10:06.105 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: > 6:d83876eb:::4:head -> 4 2023-11-05T08:10:06.105 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: : oid=12 cursor=6:de5d7c5f:::12:head 2023-11-05T08:10:06.105 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: : seek to 6:de5d7c5f:::12:head 2023-11-05T08:10:06.105 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: > 6:de5d7c5f:::12:head -> 12 2023-11-05T08:10:06.106 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: : oid=9 cursor=6:e960b815:::9:head 2023-11-05T08:10:06.106 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: : seek to 6:e960b815:::9:head 2023-11-05T08:10:06.106 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: > 6:e960b815:::9:head -> 9 2023-11-05T08:10:06.106 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: : oid=2 cursor=6:f905c69b:::2:head 2023-11-05T08:10:06.106 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: : seek to 6:f905c69b:::2:head 2023-11-05T08:10:06.107 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: > 6:f905c69b:::2:head -> 2 2023-11-05T08:10:06.107 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: : seek to 6:bd63b0f1:::8:head 2023-11-05T08:10:06.107 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: : cursor()=6:bd63b0f1:::8:head expected=6:bd63b0f1:::8:head 2023-11-05T08:10:06.107 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: > 6:bd63b0f1:::8:head -> 8 2023-11-05T08:10:06.107 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: : entry=8 expected=8 2023-11-05T08:10:06.108 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: : seek to 6:566253c9:::13:head 2023-11-05T08:10:06.108 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: : cursor()=6:566253c9:::13:head expected=6:566253c9:::13:head 2023-11-05T08:10:06.108 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: > 6:566253c9:::13:head -> 13 2023-11-05T08:10:06.108 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: : entry=13 expected=13 2023-11-05T08:10:06.108 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: : seek to 6:52ea6a34:::10:head 2023-11-05T08:10:06.109 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: : cursor()=6:52ea6a34:::10:head expected=6:52ea6a34:::10:head 2023-11-05T08:10:06.109 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: > 6:52ea6a34:::10:head -> 10 2023-11-05T08:10:06.109 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: : entry=10 expected=10 2023-11-05T08:10:06.109 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: : seek to 6:cfc208b3:::3:head 2023-11-05T08:10:06.109 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: : cursor()=6:cfc208b3:::3:head expected=6:cfc208b3:::3:head 2023-11-05T08:10:06.109 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: > 6:cfc208b3:::3:head -> 3 2023-11-05T08:10:06.110 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: : entry=3 expected=3 2023-11-05T08:10:06.110 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: : seek to 6:6cac518f:::0:head 2023-11-05T08:10:06.110 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: : cursor()=6:6cac518f:::0:head expected=6:6cac518f:::0:head 2023-11-05T08:10:06.110 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: > 6:6cac518f:::0:head -> 0 2023-11-05T08:10:06.110 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: : entry=0 expected=0 2023-11-05T08:10:06.111 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: : seek to 6:62a1935d:::14:head 2023-11-05T08:10:06.111 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: : cursor()=6:62a1935d:::14:head expected=6:62a1935d:::14:head 2023-11-05T08:10:06.111 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: > 6:62a1935d:::14:head -> 14 2023-11-05T08:10:06.111 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: : entry=14 expected=14 2023-11-05T08:10:06.111 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: : seek to 6:f905c69b:::2:head 2023-11-05T08:10:06.112 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: : cursor()=6:f905c69b:::2:head expected=6:f905c69b:::2:head 2023-11-05T08:10:06.112 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: > 6:f905c69b:::2:head -> 2 2023-11-05T08:10:06.112 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: : entry=2 expected=2 2023-11-05T08:10:06.112 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: : seek to 6:c4fdafeb:::6:head 2023-11-05T08:10:06.112 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: : cursor()=6:c4fdafeb:::6:head expected=6:c4fdafeb:::6:head 2023-11-05T08:10:06.113 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: > 6:c4fdafeb:::6:head -> 6 2023-11-05T08:10:06.113 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: : entry=6 expected=6 2023-11-05T08:10:06.113 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: : seek to 6:02547ec2:::1:head 2023-11-05T08:10:07.026 INFO:tasks.workunit.client.0.smithi052.stdout: api_stat: Running main() from gmock_main.cc 2023-11-05T08:10:07.026 INFO:tasks.workunit.client.0.smithi052.stdout: api_stat: [==========] Running 9 tests from 2 test suites. 2023-11-05T08:10:07.027 INFO:tasks.workunit.client.0.smithi052.stdout: api_stat: [----------] Global test environment set-up. 2023-11-05T08:10:07.027 INFO:tasks.workunit.client.0.smithi052.stdout: api_stat: [----------] 5 tests from LibRadosStat 2023-11-05T08:10:07.027 INFO:tasks.workunit.client.0.smithi052.stdout: api_stat: [ RUN ] LibRadosStat.Stat 2023-11-05T08:10:07.027 INFO:tasks.workunit.client.0.smithi052.stdout: api_stat: [ OK ] LibRadosStat.Stat (11141 ms) 2023-11-05T08:10:07.027 INFO:tasks.workunit.client.0.smithi052.stdout: api_stat: [ RUN ] LibRadosStat.Stat2 2023-11-05T08:10:07.027 INFO:tasks.workunit.client.0.smithi052.stdout: api_stat: [ OK ] LibRadosStat.Stat2 (20250 ms) 2023-11-05T08:10:07.028 INFO:tasks.workunit.client.0.smithi052.stdout: api_stat: [ RUN ] LibRadosStat.StatNS 2023-11-05T08:10:07.028 INFO:tasks.workunit.client.0.smithi052.stdout: api_stat: [ OK ] LibRadosStat.StatNS (13318 ms) 2023-11-05T08:10:07.028 INFO:tasks.workunit.client.0.smithi052.stdout: api_stat: [ RUN ] LibRadosStat.ClusterStat 2023-11-05T08:10:07.028 INFO:tasks.workunit.client.0.smithi052.stdout: api_stat: [ OK ] LibRadosStat.ClusterStat (12 ms) 2023-11-05T08:10:07.028 INFO:tasks.workunit.client.0.smithi052.stdout: api_stat: [ RUN ] LibRadosStat.PoolStat 2023-11-05T08:10:07.029 INFO:tasks.workunit.client.0.smithi052.stdout: api_stat: [ OK ] LibRadosStat.PoolStat (11022 ms) 2023-11-05T08:10:07.029 INFO:tasks.workunit.client.0.smithi052.stdout: api_stat: [----------] 5 tests from LibRadosStat (55743 ms total) 2023-11-05T08:10:07.029 INFO:tasks.workunit.client.0.smithi052.stdout: api_stat: 2023-11-05T08:10:07.029 INFO:tasks.workunit.client.0.smithi052.stdout: api_stat: [----------] 4 tests from LibRadosStatEC 2023-11-05T08:10:07.029 INFO:tasks.workunit.client.0.smithi052.stdout: api_stat: [ RUN ] LibRadosStatEC.Stat 2023-11-05T08:10:07.030 INFO:tasks.workunit.client.0.smithi052.stdout: api_stat: [ OK ] LibRadosStatEC.Stat (17200 ms) 2023-11-05T08:10:07.030 INFO:tasks.workunit.client.0.smithi052.stdout: api_stat: [ RUN ] LibRadosStatEC.StatNS 2023-11-05T08:10:07.030 INFO:tasks.workunit.client.0.smithi052.stdout: api_stat: [ OK ] LibRadosStatEC.StatNS (13305 ms) 2023-11-05T08:10:07.030 INFO:tasks.workunit.client.0.smithi052.stdout: api_stat: [ RUN ] LibRadosStatEC.ClusterStat 2023-11-05T08:10:07.030 INFO:tasks.workunit.client.0.smithi052.stdout: api_stat: [ OK ] LibRadosStatEC.ClusterStat (362 ms) 2023-11-05T08:10:07.031 INFO:tasks.workunit.client.0.smithi052.stdout: api_stat: [ RUN ] LibRadosStatEC.PoolStat 2023-11-05T08:10:07.031 INFO:tasks.workunit.client.0.smithi052.stdout: api_stat: [ OK ] LibRadosStatEC.PoolStat (502 ms) 2023-11-05T08:10:07.031 INFO:tasks.workunit.client.0.smithi052.stdout: api_stat: [----------] 4 tests from LibRadosStatEC (31369 ms total) 2023-11-05T08:10:07.031 INFO:tasks.workunit.client.0.smithi052.stdout: api_stat: 2023-11-05T08:10:07.031 INFO:tasks.workunit.client.0.smithi052.stdout: api_stat: [----------] Global test environment tear-down 2023-11-05T08:10:07.032 INFO:tasks.workunit.client.0.smithi052.stdout: api_stat: [==========] 9 tests from 2 test suites ran. (119135 ms total) 2023-11-05T08:10:07.032 INFO:tasks.workunit.client.0.smithi052.stdout: api_stat: [ PASSED ] 9 tests. 2023-11-05T08:10:07.354 INFO:tasks.workunit.client.0.smithi052.stdout: api_stat_pp: Running main() from gmock_main.cc 2023-11-05T08:10:07.354 INFO:tasks.workunit.client.0.smithi052.stdout: api_stat_pp: [==========] Running 9 tests from 2 test suites. 2023-11-05T08:10:07.355 INFO:tasks.workunit.client.0.smithi052.stdout: api_stat_pp: [----------] Global test environment set-up. 2023-11-05T08:10:07.355 INFO:tasks.workunit.client.0.smithi052.stdout: api_stat_pp: [----------] 5 tests from LibRadosStatPP 2023-11-05T08:10:07.355 INFO:tasks.workunit.client.0.smithi052.stdout: api_stat_pp: seed 92016 2023-11-05T08:10:07.355 INFO:tasks.workunit.client.0.smithi052.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.StatPP 2023-11-05T08:10:07.355 INFO:tasks.workunit.client.0.smithi052.stdout: api_stat_pp: [ OK ] LibRadosStatPP.StatPP (24572 ms) 2023-11-05T08:10:07.356 INFO:tasks.workunit.client.0.smithi052.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.Stat2Mtime2PP 2023-11-05T08:10:07.356 INFO:tasks.workunit.client.0.smithi052.stdout: api_stat_pp: [ OK ] LibRadosStatPP.Stat2Mtime2PP (10422 ms) 2023-11-05T08:10:07.356 INFO:tasks.workunit.client.0.smithi052.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.ClusterStatPP 2023-11-05T08:10:07.356 INFO:tasks.workunit.client.0.smithi052.stdout: api_stat_pp: [ OK ] LibRadosStatPP.ClusterStatPP (357 ms) 2023-11-05T08:10:07.356 INFO:tasks.workunit.client.0.smithi052.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.PoolStatPP 2023-11-05T08:10:07.356 INFO:tasks.workunit.client.0.smithi052.stdout: api_stat_pp: [ OK ] LibRadosStatPP.PoolStatPP (2162 ms) 2023-11-05T08:10:07.357 INFO:tasks.workunit.client.0.smithi052.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.StatPPNS 2023-11-05T08:10:07.357 INFO:tasks.workunit.client.0.smithi052.stdout: api_stat_pp: [ OK ] LibRadosStatPP.StatPPNS (24689 ms) 2023-11-05T08:10:07.357 INFO:tasks.workunit.client.0.smithi052.stdout: api_stat_pp: [----------] 5 tests from LibRadosStatPP (62203 ms total) 2023-11-05T08:10:07.357 INFO:tasks.workunit.client.0.smithi052.stdout: api_stat_pp: 2023-11-05T08:10:07.358 INFO:tasks.workunit.client.0.smithi052.stdout: api_stat_pp: [----------] 4 tests from LibRadosStatECPP 2023-11-05T08:10:07.358 INFO:tasks.workunit.client.0.smithi052.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.StatPP 2023-11-05T08:10:07.358 INFO:tasks.workunit.client.0.smithi052.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.StatPP (17284 ms) 2023-11-05T08:10:07.358 INFO:tasks.workunit.client.0.smithi052.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.ClusterStatPP 2023-11-05T08:10:07.358 INFO:tasks.workunit.client.0.smithi052.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.ClusterStatPP (216 ms) 2023-11-05T08:10:07.359 INFO:tasks.workunit.client.0.smithi052.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.PoolStatPP 2023-11-05T08:10:07.359 INFO:tasks.workunit.client.0.smithi052.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.PoolStatPP (1583 ms) 2023-11-05T08:10:07.359 INFO:tasks.workunit.client.0.smithi052.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.StatPPNS 2023-11-05T08:10:07.359 INFO:tasks.workunit.client.0.smithi052.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.StatPPNS (4570 ms) 2023-11-05T08:10:07.359 INFO:tasks.workunit.client.0.smithi052.stdout: api_stat_pp: [----------] 4 tests from LibRadosStatECPP (23653 ms total) 2023-11-05T08:10:07.360 INFO:tasks.workunit.client.0.smithi052.stdout: api_stat_pp: 2023-11-05T08:10:07.360 INFO:tasks.workunit.client.0.smithi052.stdout: api_stat_pp: [----------] Global test environment tear-down 2023-11-05T08:10:07.360 INFO:tasks.workunit.client.0.smithi052.stdout: api_stat_pp: [==========] 9 tests from 2 test suites ran. (119423 ms total) 2023-11-05T08:10:07.360 INFO:tasks.workunit.client.0.smithi052.stdout: api_stat_pp: [ PASSED ] 9 tests. 2023-11-05T08:10:09.332 INFO:tasks.workunit.client.0.smithi052.stdout:T08:09:53.168660+0000 mon.a [INF] from='client.? 172.21.15.52:0/2461842754' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattr_smithi052-91588-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2023-11-05T08:10:09.332 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd: got: 2023-11-05T08:09:53.239929+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi052-91779-10"}]: dispatch 2023-11-05T08:10:09.332 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd: got: 2023-11-05T08:09:53.746899+0000 client.admin [INF] onexx 2023-11-05T08:10:09.333 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd: got: 2023-11-05T08:09:54.397912+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2023-11-05T08:10:09.333 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd: got: 2023-11-05T08:09:56.552278+0000 mon.b [INF] from='client.? 172.21.15.52:0/1249158201' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi052-91779-10"}]: dispatch 2023-11-05T08:10:09.333 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd: got: 2023-11-05T08:09:56.793305+0000 mon.b [INF] from='client.? 172.21.15.52:0/3056641797' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi052-92016-7"}]: dispatch 2023-11-05T08:10:09.333 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd: got: 2023-11-05T08:09:57.016001+0000 mon.c [INF] from='client.? 172.21.15.52:0/4102707348' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi052-91624-16"}]: dispatch 2023-11-05T08:10:09.333 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd: got: 2023-11-05T08:09:57.152404+0000 mon.b [INF] from='client.? 172.21.15.52:0/1955091667' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi052-91687-10"}]: dispatch 2023-11-05T08:10:09.334 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd: got: 2023-11-05T08:09:57.379806+0000 mon.c [INF] from='client.4641 172.21.15.52:0/2421995323' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi052-91959-7"}]: dispatch 2023-11-05T08:10:09.334 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd: got: 2023-11-05T08:09:59.506910+0000 mon.c [INF] from='client.? 172.21.15.52:0/447086353' entity='client.admin' cmd=[{"prefix":"log", "logtext":["twoxx"]}]: dispatch 2023-11-05T08:10:09.334 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd: got: 2023-11-05T08:09:59.540224+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi052-91779-10"}]: dispatch 2023-11-05T08:10:09.334 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd: got: 2023-11-05T08:09:59.553675+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi052-92016-7"}]: dispatch 2023-11-05T08:10:09.334 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd: got: 2023-11-05T08:09:59.563365+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi052-91687-10"}]: dispatch 2023-11-05T08:10:09.335 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd: got: 2023-11-05T08:09:59.805211+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi052-91624-16"}]: dispatch 2023-11-05T08:10:09.335 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd: got: 2023-11-05T08:09:59.820235+0000 mon.a [INF] from='client.4641 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi052-91959-7"}]: dispatch 2023-11-05T08:10:09.335 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd: got: 2023-11-05T08:09:59.852877+0000 mon.a [INF] from='client.? 172.21.15.52:0/1167327960' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi052-91614-6","app": "rados","yes_i_really_mean_it": true}]': finished 2023-11-05T08:10:09.335 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd: got: 2023-11-05T08:09:59.854806+0000 mon.a [INF] from='client.? 172.21.15.52:0/2461842754' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattr_smithi052-91588-10","app": "rados","yes_i_really_mean_it": true}]': finished 2023-11-05T08:10:09.335 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd: got: 2023-11-05T08:09:59.856448+0000 mon.a [INF] from='client.? 172.21.15.52:0/334883497' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi052-92258-5","app": "rados","yes_i_really_mean_it": true}]': finished 2023-11-05T08:10:15.026 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd: got api_lock: Running main() from gmock_main.cc 2023-11-05T08:10:15.026 INFO:tasks.workunit.client.0.smithi052.stdout: api_lock: [==========] Running 16 tests from 2 test suites. 2023-11-05T08:10:15.026 INFO:tasks.workunit.client.0.smithi052.stdout: api_lock: [----------] Global test environment set-up. 2023-11-05T08:10:15.027 INFO:tasks.workunit.client.0.smithi052.stdout: api_lock: [----------] 8 tests from LibRadosLock 2023-11-05T08:10:15.027 INFO:tasks.workunit.client.0.smithi052.stdout: api_lock: [ RUN ] LibRadosLock.LockExclusive 2023-11-05T08:10:15.027 INFO:tasks.workunit.client.0.smithi052.stdout: api_lock: [ OK ] LibRadosLock.LockExclusive (20380 ms) 2023-11-05T08:10:15.027 INFO:tasks.workunit.client.0.smithi052.stdout: api_lock: [ RUN ] LibRadosLock.LockShared 2023-11-05T08:10:15.027 INFO:tasks.workunit.client.0.smithi052.stdout: api_lock: [ OK ] LibRadosLock.LockShared (15257 ms) 2023-11-05T08:10:15.028 INFO:tasks.workunit.client.0.smithi052.stdout: api_lock: [ RUN ] LibRadosLock.LockExclusiveDur 2023-11-05T08:10:15.028 INFO:tasks.workunit.client.0.smithi052.stdout: api_lock: [ OK ] LibRadosLock.LockExclusiveDur (5798 ms) 2023-11-05T08:10:15.028 INFO:tasks.workunit.client.0.smithi052.stdout: api_lock: [ RUN ] LibRadosLock.LockSharedDur 2023-11-05T08:10:15.028 INFO:tasks.workunit.client.0.smithi052.stdout: api_lock: [ OK ] LibRadosLock.LockSharedDur (11059 ms) 2023-11-05T08:10:15.028 INFO:tasks.workunit.client.0.smithi052.stdout: api_lock: [ RUN ] LibRadosLock.LockMayRenew 2023-11-05T08:10:15.028 INFO:tasks.workunit.client.0.smithi052.stdout: api_lock: [ OK ] LibRadosLock.LockMayRenew (8447 ms) 2023-11-05T08:10:15.029 INFO:tasks.workunit.client.0.smithi052.stdout: api_lock: [ RUN ] LibRadosLock.Unlock 2023-11-05T08:10:15.029 INFO:tasks.workunit.client.0.smithi052.stdout: api_lock: [ OK ] LibRadosLock.Unlock (5110 ms) 2023-11-05T08:10:15.029 INFO:tasks.workunit.client.0.smithi052.stdout: api_lock: [ RUN ] LibRadosLock.ListLockers 2023-11-05T08:10:15.029 INFO:tasks.workunit.client.0.smithi052.stdout: api_lock: [ OK ] LibRadosLock.ListLockers (6285 ms) 2023-11-05T08:10:15.029 INFO:tasks.workunit.client.0.smithi052.stdout: api_lock: [ RUN ] LibRadosLock.BreakLock 2023-11-05T08:10:15.030 INFO:tasks.workunit.client.0.smithi052.stdout: api_lock: [ OK ] LibRadosLock.BreakLock (1754 ms) 2023-11-05T08:10:15.030 INFO:tasks.workunit.client.0.smithi052.stdout: api_lock: [----------] 8 tests from LibRadosLock (74090 ms total) 2023-11-05T08:10:15.030 INFO:tasks.workunit.client.0.smithi052.stdout: api_lock: 2023-11-05T08:10:15.030 INFO:tasks.workunit.client.0.smithi052.stdout: api_lock: [----------] 8 tests from LibRadosLockEC 2023-11-05T08:10:15.030 INFO:tasks.workunit.client.0.smithi052.stdout: api_lock: [ RUN ] LibRadosLockEC.LockExclusive 2023-11-05T08:10:15.031 INFO:tasks.workunit.client.0.smithi052.stdout: api_lock: [ OK ] LibRadosLockEC.LockExclusive (11622 ms) 2023-11-05T08:10:15.031 INFO:tasks.workunit.client.0.smithi052.stdout: api_lock: [ RUN ] LibRadosLockEC.LockShared 2023-11-05T08:10:15.031 INFO:tasks.workunit.client.0.smithi052.stdout: api_lock: [ OK ] LibRadosLockEC.LockShared (2231 ms) 2023-11-05T08:10:15.031 INFO:tasks.workunit.client.0.smithi052.stdout: api_lock: [ RUN ] LibRadosLockEC.LockExclusiveDur 2023-11-05T08:10:15.031 INFO:tasks.workunit.client.0.smithi052.stdout: api_lock: [ OK ] LibRadosLockEC.LockExclusiveDur (1894 ms) 2023-11-05T08:10:15.031 INFO:tasks.workunit.client.0.smithi052.stdout: api_lock: [ RUN ] LibRadosLockEC.LockSharedDur 2023-11-05T08:10:15.032 INFO:tasks.workunit.client.0.smithi052.stdout: api_lock: [ OK ] LibRadosLockEC.LockSharedDur (1791 ms) 2023-11-05T08:10:15.032 INFO:tasks.workunit.client.0.smithi052.stdout: api_lock: [ RUN ] LibRadosLockEC.LockMayRenew 2023-11-05T08:10:15.032 INFO:tasks.workunit.client.0.smithi052.stdout: api_lock: [ OK ] LibRadosLockEC.LockMayRenew (367 ms) 2023-11-05T08:10:15.032 INFO:tasks.workunit.client.0.smithi052.stdout: api_lock: [ RUN ] LibRadosLockEC.Unlock 2023-11-05T08:10:15.032 INFO:tasks.workunit.client.0.smithi052.stdout: api_lock: [ OK ] LibRadosLockEC.Unlock (508 ms) 2023-11-05T08:10:15.032 INFO:tasks.workunit.client.0.smithi052.stdout: api_lock: [ RUN ] LibRadosLockEC.ListLockers 2023-11-05T08:10:15.033 INFO:tasks.workunit.client.0.smithi052.stdout: api_lock: [ OK ] LibRadosLockEC.ListLockers (366 ms) 2023-11-05T08:10:15.033 INFO:tasks.workunit.client.0.smithi052.stdout: api_lock: [ RUN ] LibRadosLockEC.BreakLock 2023-11-05T08:10:15.033 INFO:tasks.workunit.client.0.smithi052.stdout: api_lock: [ OK ] LibRadosLockEC.BreakLock (231 ms) 2023-11-05T08:10:15.033 INFO:tasks.workunit.client.0.smithi052.stdout: api_lock: [----------] 8 tests from LibRadosLockEC (19011 ms total) 2023-11-05T08:10:15.033 INFO:tasks.workunit.client.0.smithi052.stdout: api_lock: 2023-11-05T08:10:15.033 INFO:tasks.workunit.client.0.smithi052.stdout: api_lock: [----------] Global test environment tear-down 2023-11-05T08:10:15.034 INFO:tasks.workunit.client.0.smithi052.stdout: api_lock: [==========] 16 tests from 2 test suites ran. (127233 ms total) 2023-11-05T08:10:15.034 INFO:tasks.workunit.client.0.smithi052.stdout: api_lock: [ PASSED ] 16 tests. 2023-11-05T08:10:15.139 INFO:tasks.workunit.client.0.smithi052.stdout:: 2023-11-05T08:10:00.138151+0000 mon.a [WRN] overall HEALTH_WARN 1 cache pools are missing hit_sets; Slow OSD heartbeats on back (longest 33840.105ms); Slow OSD heartbeats on front (longest 33664.273ms); 5 pool(s) do not have an application enabled 2023-11-05T08:10:15.139 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd: got: 2023-11-05T08:10:00.352523+0000 mon.c [INF] from='client.? 172.21.15.52:0/3078286159' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi052-91894-6"}]: dispatch 2023-11-05T08:10:15.139 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd: got: 2023-11-05T08:10:01.695131+0000 client.admin [INF] twoxx 2023-11-05T08:10:15.140 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd: got: 2023-11-05T08:10:02.073722+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["twoxx"]}]: dispatch 2023-11-05T08:10:15.140 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd: got: 2023-11-05T08:10:02.189873+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi052-91894-6"}]: dispatch 2023-11-05T08:10:15.140 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd: got: 2023-11-05T08:10:00.837336+0000 mon.b [INF] from='client.? 172.21.15.52:0/1599959184' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi052-91640-22"}]: dispatch 2023-11-05T08:10:15.140 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd: got: 2023-11-05T08:10:00.844587+0000 mon.b [INF] from='client.? 172.21.15.52:0/1249158201' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi052-91779-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2023-11-05T08:10:15.140 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd: got: 2023-11-05T08:10:01.607454+0000 mon.c [INF] from='client.? 172.21.15.52:0/2827735190' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi052-92060-12"}]: dispatch 2023-11-05T08:10:15.141 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd: got: 2023-11-05T08:10:01.763788+0000 mon.c [INF] from='client.? 172.21.15.52:0/4102707348' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi052-91624-16"}]: dispatch 2023-11-05T08:10:15.141 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd: got: 2023-11-05T08:10:02.799557+0000 mon.a [WRN] Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-11-05T08:10:15.141 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd: got: 2023-11-05T08:10:03.196758+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi052-92060-12"}]: dispatch 2023-11-05T08:10:15.141 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd: got: 2023-11-05T08:10:03.233208+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi052-91624-16"}]: dispatch 2023-11-05T08:10:15.141 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd: got: 2023-11-05T08:10:03.441004+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi052-91640-22"}]: dispatch 2023-11-05T08:10:15.142 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd: got: 2023-11-05T08:10:03.447932+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi052-91779-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2023-11-05T08:10:15.142 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd: got: 2023-11-05T08:10:03.464943+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi052-92016-7"}]': finished 2023-11-05T08:10:15.142 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd: got: 2023-11-05T08:10:03.467560+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi052-91687-10"}]': finished 2023-11-05T08:10:15.142 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd: got: 2023-11-05T08:10:03.469372+0000 mon.a [INF] from='client.4641 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi052-91959-7"}]': finished 2023-11-05T08:10:15.143 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd: got: 2023-11-05T08:10:05.513764+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["twoxx"]}]': finished 2023-11-05T08:10:17.565 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd: got: 2023-11-05T08:10:04.709771+0000 mon.b [INF] from='client.? 172.21.15.52:0/1955091667' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi052-91687-10 list_parallel: process_1_[92350]: starting. 2023-11-05T08:10:17.565 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_1_[92350]: creating pool ceph_test_rados_list_parallel.smithi052-92307 2023-11-05T08:10:17.566 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_1_[92350]: created object 0... 2023-11-05T08:10:17.566 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_1_[92350]: created object 25... 2023-11-05T08:10:17.566 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_1_[92350]: created object 49... 2023-11-05T08:10:17.566 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_1_[92350]: finishing. 2023-11-05T08:10:17.567 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_1_[92350]: shutting down. 2023-11-05T08:10:17.567 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_2_[92351]: starting. 2023-11-05T08:10:17.567 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_2_[92351]: listing objects. 2023-11-05T08:10:17.567 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_2_[92351]: listed object 0... 2023-11-05T08:10:17.567 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_2_[92351]: listed object 25... 2023-11-05T08:10:17.567 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_2_[92351]: saw 50 objects 2023-11-05T08:10:17.568 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_2_[92351]: shutting down. 2023-11-05T08:10:17.568 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: ******************************* 2023-11-05T08:10:17.568 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_3_[107716]: starting. 2023-11-05T08:10:17.568 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_3_[107716]: creating pool ceph_test_rados_list_parallel.smithi052-92307 2023-11-05T08:10:17.568 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_3_[107716]: created object 0... 2023-11-05T08:10:17.568 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_3_[107716]: created object 25... 2023-11-05T08:10:17.569 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_3_[107716]: created object 49... 2023-11-05T08:10:17.569 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_3_[107716]: finishing. 2023-11-05T08:10:17.569 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_3_[107716]: shutting down. 2023-11-05T08:10:17.569 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: ******************************* 2023-11-05T08:10:17.569 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_4_[107717]: starting. 2023-11-05T08:10:17.569 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_4_[107717]: listing objects. 2023-11-05T08:10:17.570 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_4_[107717]: listed object 0... 2023-11-05T08:10:17.570 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_4_[107717]: listed object 25... 2023-11-05T08:10:17.570 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_4_[107717]: saw 44 objects 2023-11-05T08:10:17.570 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_4_[107717]: shutting down. 2023-11-05T08:10:17.570 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: ******************************* 2023-11-05T08:10:17.571 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_5_[107718]: starting. 2023-11-05T08:10:17.571 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_5_[107718]: removed 25 objects... 2023-11-05T08:10:17.571 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_5_[107718]: removed half of the objects 2023-11-05T08:10:17.571 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_5_[107718]: removed 50 objects... 2023-11-05T08:10:17.571 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_5_[107718]: removed 50 objects 2023-11-05T08:10:17.572 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_5_[107718]: shutting down. 2023-11-05T08:10:17.572 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: ******************************* 2023-11-05T08:10:17.572 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: ******************************* 2023-11-05T08:10:17.572 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_6_[117428]: starting. 2023-11-05T08:10:17.572 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_6_[117428]: creating pool ceph_test_rados_list_parallel.smithi052-92307 2023-11-05T08:10:17.573 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_6_[117428]: created object 0... 2023-11-05T08:10:17.573 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_6_[117428]: created object 25... 2023-11-05T08:10:17.573 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_6_[117428]: created object 49... 2023-11-05T08:10:17.573 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_6_[117428]: finishing. 2023-11-05T08:10:17.573 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_6_[117428]: shutting down. 2023-11-05T08:10:17.573 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: ******************************* 2023-11-05T08:10:17.574 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: ******************************* 2023-11-05T08:10:17.574 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_7_[117429]: starting. 2023-11-05T08:10:17.574 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_7_[117429]: listing objects. 2023-11-05T08:10:17.574 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_7_[117429]: listed object 0... 2023-11-05T08:10:17.574 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_7_[117429]: listed object 25... 2023-11-05T08:10:17.575 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_7_[117429]: listed object 50... 2023-11-05T08:10:17.575 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_7_[117429]: saw 55 objects 2023-11-05T08:10:17.575 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_7_[117429]: shutting down. 2023-11-05T08:10:17.575 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: ******************************* 2023-11-05T08:10:17.575 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: ******************************* 2023-11-05T08:10:17.575 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_8_[117430]: starting. 2023-11-05T08:10:17.576 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_8_[117430]: added 25 objects... 2023-11-05T08:10:17.576 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_8_[117430]: added half of the objects 2023-11-05T08:10:17.576 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_8_[117430]: added 50 objects... 2023-11-05T08:10:17.576 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_8_[117430]: added 50 objects 2023-11-05T08:10:17.576 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_8_[117430]: shutting down. 2023-11-05T08:10:17.577 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: ******************************* 2023-11-05T08:10:17.577 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: ******************************* 2023-11-05T08:10:19.348 INFO:tasks.workunit.client.0.smithi052.stdout: "}]: dispatch 2023-11-05T08:10:19.348 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd: got: 2023-11-05T08:10:04.761636+0000 mon.b [INF] from='client.? 172.21.15.52:0/1599959184' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi052-91640-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2023-11-05T08:10:19.348 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd: got: 2023-11-05T08:10:05.034728+0000 mon.c [INF] from='client.? 172.21.15.52:0/4102707348' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi052-91624-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2023-11-05T08:10:19.348 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd: got: 2023-11-05T08:10:05.043953+0000 mon.c [INF] from='client.? 172.21.15.52:0/2827735190' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi052-92060-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2023-11-05T08:10:19.349 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd: got: 2023-11-05T08:10:06.360858+0000 mon.b [INF] from='client.? 172.21.15.52:0/2480386033' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi052-92096-4"}]: dispatch 2023-11-05T08:10:19.349 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd: got: 2023-11-05T08:10:06.889940+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi052-91687-10"}]: dispatch 2023-11-05T08:10:19.349 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd: got: 2023-11-05T08:10:06.896163+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi052-91640-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2023-11-05T08:10:19.349 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd: got: 2023-11-05T08:10:06.970525+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi052-92096-4"}]: dispatch 2023-11-05T08:10:19.349 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd: got: 2023-11-05T08:10:07.740710+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi052-91624-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2023-11-05T08:10:19.350 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd: got: 2023-11-05T08:10:07.754344+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi052-92060-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2023-11-05T08:10:19.350 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd: got: 2023-11-05T08:10:07.790478+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi052-91894-6"}]': finished 2023-11-05T08:10:19.350 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd: got: 2023-11-05T08:10:07.792580+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi052-91779-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2023-11-05T08:10:19.350 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd: got: 2023-11-05T08:10:09.434412+0000 mon.b [INF] from='client.? 172.21.15.52:0/1249158201' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi052-91779-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi052-91779-10"}]: dispatch 2023-11-05T08:10:19.350 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd: got: 2023-11-05T08:10:10.762094+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi052-91779-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi052-91779-10"}]: dispatch 2023-11-05T08:10:19.351 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd: got: 2023-11-05T08:10:09.239880+0000 mon.c [INF] from='client.? 172.21.15.52:0/447086353' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2023-11-05T08:10:29.700 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd: got: 2023-11-05T08:10:09.387208+0000 mon.c [INF] from='client.? 172.21.15.52:0/3078286159' entity='client.admin' cmd=[{"prefix": "osd ti open_pools_parallel: process_1_[92379]: starting. 2023-11-05T08:10:29.700 INFO:tasks.workunit.client.0.smithi052.stdout: open_pools_parallel: process_1_[92379]: creating pool ceph_test_rados_open_pools_parallel.smithi052-92333 2023-11-05T08:10:29.700 INFO:tasks.workunit.client.0.smithi052.stdout: open_pools_parallel: process_1_[92379]: created object 0... 2023-11-05T08:10:29.700 INFO:tasks.workunit.client.0.smithi052.stdout: open_pools_parallel: process_1_[92379]: created object 25... 2023-11-05T08:10:29.701 INFO:tasks.workunit.client.0.smithi052.stdout: open_pools_parallel: process_1_[92379]: created object 49... 2023-11-05T08:10:29.701 INFO:tasks.workunit.client.0.smithi052.stdout: open_pools_parallel: process_1_[92379]: finishing. 2023-11-05T08:10:29.701 INFO:tasks.workunit.client.0.smithi052.stdout: open_pools_parallel: process_1_[92379]: shutting down. 2023-11-05T08:10:29.701 INFO:tasks.workunit.client.0.smithi052.stdout: open_pools_parallel: process_2_[92380]: starting. 2023-11-05T08:10:29.701 INFO:tasks.workunit.client.0.smithi052.stdout: open_pools_parallel: process_2_[92380]: rados_pool_create. 2023-11-05T08:10:29.701 INFO:tasks.workunit.client.0.smithi052.stdout: open_pools_parallel: process_2_[92380]: rados_ioctx_create. 2023-11-05T08:10:29.702 INFO:tasks.workunit.client.0.smithi052.stdout: open_pools_parallel: process_2_[92380]: shutting down. 2023-11-05T08:10:29.702 INFO:tasks.workunit.client.0.smithi052.stdout: open_pools_parallel: ******************************* 2023-11-05T08:10:29.702 INFO:tasks.workunit.client.0.smithi052.stdout: open_pools_parallel: process_3_[112193]: starting. 2023-11-05T08:10:29.702 INFO:tasks.workunit.client.0.smithi052.stdout: open_pools_parallel: process_3_[112193]: creating pool ceph_test_rados_open_pools_parallel.smithi052-92333 2023-11-05T08:10:29.702 INFO:tasks.workunit.client.0.smithi052.stdout: open_pools_parallel: process_3_[112193]: created object 0... 2023-11-05T08:10:29.703 INFO:tasks.workunit.client.0.smithi052.stdout: open_pools_parallel: process_3_[112193]: created object 25... 2023-11-05T08:10:29.703 INFO:tasks.workunit.client.0.smithi052.stdout: open_pools_parallel: process_3_[112193]: created object 49... 2023-11-05T08:10:29.703 INFO:tasks.workunit.client.0.smithi052.stdout: open_pools_parallel: process_3_[112193]: finishing. 2023-11-05T08:10:29.703 INFO:tasks.workunit.client.0.smithi052.stdout: open_pools_parallel: process_3_[112193]: shutting down. 2023-11-05T08:10:29.703 INFO:tasks.workunit.client.0.smithi052.stdout: open_pools_parallel: ******************************* 2023-11-05T08:10:29.705 INFO:tasks.workunit.client.0.smithi052.stdout: open_pools_parallel: process_4_[112194]: starting. 2023-11-05T08:10:29.705 INFO:tasks.workunit.client.0.smithi052.stdout: open_pools_parallel: process_4_[112194]: rados_pool_create. 2023-11-05T08:10:29.705 INFO:tasks.workunit.client.0.smithi052.stdout: open_pools_parallel: process_4_[112194]: rados_ioctx_create. 2023-11-05T08:10:29.705 INFO:tasks.workunit.client.0.smithi052.stdout: open_pools_parallel: process_4_[112194]: shutting down. 2023-11-05T08:10:29.706 INFO:tasks.workunit.client.0.smithi052.stdout: open_pools_parallel: ******************************* 2023-11-05T08:10:29.706 INFO:tasks.workunit.client.0.smithi052.stdout: open_pools_parallel: ******************************* 2023-11-05T08:10:29.706 INFO:tasks.workunit.client.0.smithi052.stdout: open_pools_parallel: ******* SUCCESS ********** 2023-11-05T08:10:29.981 INFO:tasks.workunit.client.0.smithi052.stdout:er remove", "pool": "test-rados-api-smithi052-91894-6", "tierpool": "test-rados-api-smithi052-91894-7"}]: dispatch 2023-11-05T08:10:29.982 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd: got: 2023-11-05T08:10:11.827947+0000 client.admin [INF] threexx 2023-11-05T08:10:29.982 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd: got: 2023-11-05T08:10:11.834888+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2023-11-05T08:10:29.982 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd: got: 2023-11-05T08:10:11.841307+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi052-91894-6", "tierpool": "test-rados-api-smithi052-91894-7"}]: dispatch 2023-11-05T08:10:29.982 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd: got: 2023-11-05T08:10:11.856724+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi052-91687-10"}]': finished 2023-11-05T08:10:29.983 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd: got: 2023-11-05T08:10:11.859234+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi052-91640-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2023-11-05T08:10:29.983 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd: got: 2023-11-05T08:10:11.862546+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi052-92096-4"}]': finished 2023-11-05T08:10:29.983 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd: got: 2023-11-05T08:10:11.864486+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi052-91624-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2023-11-05T08:10:29.983 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd: got: 2023-11-05T08:10:11.867015+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi052-92060-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2023-11-05T08:10:29.983 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd: got: 2023-11-05T08:10:13.213113+0000 mon.b [INF] from='client.? 172.21.15.52:0/2480386033' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi052-92096-4", "tierpool": "test-rados-api-smithi052-92096-6"}]: dispatch 2023-11-05T08:10:29.984 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd: got: 2023-11-05T08:10:13.223723+0000 mon.b [INF] from='client.? 172.21.15.52:0/1599959184' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi052-91640-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi052-91640-22"}]: dispatch 2023-11-05T08:10:29.984 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd: got: 2023-11-05T08:10:14.505119+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi052-92096-4", "tierpool": "test-rados-api-smithi052-92096-6"}]: dispatch 2023-11-05T08:10:29.984 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd: got: 2023-11-05T08:10:14.509348+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi052-91640-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi052-91640-22"}]: dispatch 2023-11-05T08:10:29.984 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd: [ OK ] LibRadosCmd.WatchLog (39486 ms) 2023-11-05T08:10:29.984 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd: [----------] 4 tests from LibRadosCmd (141999 ms total) 2023-11-05T08:10:29.985 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd: 2023-11-05T08:10:29.985 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd: [----------] Global test environment tear-down 2023-11-05T08:10:29.985 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd: [==========] 4 tests from 1 test suite ran. (141999 ms total) 2023-11-05T08:10:29.985 INFO:tasks.workunit.client.0.smithi052.stdout: api_cmd: [ PASSED ] 4 tests. 2023-11-05T08:10:30.970 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: ******************************* 2023-11-05T08:10:30.970 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_9_[124686]: starting. 2023-11-05T08:10:30.970 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_9_[124686]: creating pool ceph_test_rados_list_parallel.smithi052-92307 2023-11-05T08:10:30.971 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_9_[124686]: created object 0... 2023-11-05T08:10:30.971 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_9_[124686]: created object 25... 2023-11-05T08:10:30.971 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_9_[124686]: created object 49... 2023-11-05T08:10:30.971 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_9_[124686]: finishing. 2023-11-05T08:10:30.971 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_9_[124686]: shutting down. 2023-11-05T08:10:30.971 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: ******************************* 2023-11-05T08:10:30.972 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: ******************************* 2023-11-05T08:10:30.972 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: ******************************* 2023-11-05T08:10:30.972 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_10_[124687]: starting. 2023-11-05T08:10:30.972 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_10_[124687]: listing objects. 2023-11-05T08:10:30.972 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_10_[124687]: listed object 0... 2023-11-05T08:10:30.972 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_10_[124687]: listed object 25... 2023-11-05T08:10:30.973 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_10_[124687]: listed object 50... 2023-11-05T08:10:30.973 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_10_[124687]: listed object 75... 2023-11-05T08:10:30.973 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_10_[124687]: saw 99 objects 2023-11-05T08:10:30.973 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_10_[124687]: shutting down. 2023-11-05T08:10:30.973 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: ******************************* 2023-11-05T08:10:30.973 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: ******************************* 2023-11-05T08:10:30.974 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: ******************************* 2023-11-05T08:10:30.974 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_13_[124690]: starting. 2023-11-05T08:10:30.974 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_13_[124690]: removed 25 objects... 2023-11-05T08:10:30.974 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_13_[124690]: removed half of the objects 2023-11-05T08:10:30.974 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_13_[124690]: removed 50 objects... 2023-11-05T08:10:30.975 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_13_[124690]: removed 50 objects 2023-11-05T08:10:30.975 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_13_[124690]: shutting down. 2023-11-05T08:10:30.975 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: ******************************* 2023-11-05T08:10:30.975 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: ******************************* 2023-11-05T08:10:30.975 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: ******************************* 2023-11-05T08:10:30.975 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_12_[124689]: starting. 2023-11-05T08:10:30.976 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_12_[124689]: added 25 objects... 2023-11-05T08:10:30.976 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_12_[124689]: added half of the objects 2023-11-05T08:10:30.976 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_12_[124689]: added 50 objects... 2023-11-05T08:10:30.976 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_12_[124689]: added 50 objects 2023-11-05T08:10:30.976 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_12_[124689]: shutting down. 2023-11-05T08:10:30.976 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: ******************************* 2023-11-05T08:10:30.977 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: ******************************* 2023-11-05T08:10:30.977 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: ******************************* 2023-11-05T08:10:30.977 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_11_[124688]: starting. 2023-11-05T08:10:30.977 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_11_[124688]: added 25 objects... 2023-11-05T08:10:30.977 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_11_[124688]: added half of the objects 2023-11-05T08:10:30.977 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_11_[124688]: added 50 objects... 2023-11-05T08:10:30.978 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_11_[124688]: added 50 objects 2023-11-05T08:10:30.978 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_11_[124688]: shutting down. 2023-11-05T08:10:30.978 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: ******************************* 2023-11-05T08:10:30.978 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: ******************************* 2023-11-05T08:10:30.978 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: ******************************* 2023-11-05T08:10:30.978 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: ******************************* 2023-11-05T08:10:30.979 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_14_[134787]: starting. 2023-11-05T08:10:30.979 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_14_[134787]: creating pool ceph_test_rados_list_parallel.smithi052-92307 2023-11-05T08:10:30.979 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_14_[134787]: created object 0... 2023-11-05T08:10:30.979 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_14_[134787]: created object 25... 2023-11-05T08:10:30.979 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_14_[134787]: created object 49... 2023-11-05T08:10:30.979 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_14_[134787]: finishing. 2023-11-05T08:10:30.980 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_14_[134787]: shutting down. 2023-11-05T08:10:30.980 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: ******************************* 2023-11-05T08:10:30.980 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: ******************************* 2023-11-05T08:10:30.980 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: ******************************* 2023-11-05T08:10:30.980 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: ******************************* 2023-11-05T08:10:30.980 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_15_[134788]: starting. 2023-11-05T08:10:30.981 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_15_[134788]: listing objects. 2023-11-05T08:10:38.430 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_15_[134788]: api_io_pp: Running main() from gmock_main.cc 2023-11-05T08:10:38.431 INFO:tasks.workunit.client.0.smithi052.stdout: api_io_pp: [==========] Running 37 tests from 2 test suites. 2023-11-05T08:10:38.431 INFO:tasks.workunit.client.0.smithi052.stdout: api_io_pp: [----------] Global test environment set-up. 2023-11-05T08:10:38.431 INFO:tasks.workunit.client.0.smithi052.stdout: api_io_pp: [----------] 20 tests from LibRadosIoPP 2023-11-05T08:10:38.431 INFO:tasks.workunit.client.0.smithi052.stdout: api_io_pp: seed 91640 2023-11-05T08:10:38.431 INFO:tasks.workunit.client.0.smithi052.stdout: api_io_pp: [ RUN ] LibRadosIoPP.TooBigPP 2023-11-05T08:10:38.432 INFO:tasks.workunit.client.0.smithi052.stdout: api_io_pp: [ OK ] LibRadosIoPP.TooBigPP (0 ms) 2023-11-05T08:10:38.432 INFO:tasks.workunit.client.0.smithi052.stdout: api_io_pp: [ RUN ] LibRadosIoPP.SimpleWritePP 2023-11-05T08:10:38.432 INFO:tasks.workunit.client.0.smithi052.stdout: api_io_pp: [ OK ] LibRadosIoPP.SimpleWritePP (26736 ms) 2023-11-05T08:10:38.432 INFO:tasks.workunit.client.0.smithi052.stdout: api_io_pp: [ RUN ] LibRadosIoPP.ReadOpPP 2023-11-05T08:10:38.432 INFO:tasks.workunit.client.0.smithi052.stdout: api_io_pp: [ OK ] LibRadosIoPP.ReadOpPP (5271 ms) 2023-11-05T08:10:38.433 INFO:tasks.workunit.client.0.smithi052.stdout: api_io_pp: [ RUN ] LibRadosIoPP.SparseReadOpPP 2023-11-05T08:10:38.433 INFO:tasks.workunit.client.0.smithi052.stdout: api_io_pp: [ OK ] LibRadosIoPP.SparseReadOpPP (4189 ms) 2023-11-05T08:10:38.433 INFO:tasks.workunit.client.0.smithi052.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RoundTripPP 2023-11-05T08:10:38.433 INFO:tasks.workunit.client.0.smithi052.stdout: api_io_pp: [ OK ] LibRadosIoPP.RoundTripPP (3655 ms) 2023-11-05T08:10:38.433 INFO:tasks.workunit.client.0.smithi052.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RoundTripPP2 2023-11-05T08:10:38.433 INFO:tasks.workunit.client.0.smithi052.stdout: api_io_pp: [ OK ] LibRadosIoPP.RoundTripPP2 (4856 ms) 2023-11-05T08:10:38.434 INFO:tasks.workunit.client.0.smithi052.stdout: api_io_pp: [ RUN ] LibRadosIoPP.Checksum 2023-11-05T08:10:38.434 INFO:tasks.workunit.client.0.smithi052.stdout: api_io_pp: [ OK ] LibRadosIoPP.Checksum (3846 ms) 2023-11-05T08:10:38.434 INFO:tasks.workunit.client.0.smithi052.stdout: api_io_pp: [ RUN ] LibRadosIoPP.ReadIntoBufferlist 2023-11-05T08:10:38.434 INFO:tasks.workunit.client.0.smithi052.stdout: api_io_pp: [ OK ] LibRadosIoPP.ReadIntoBufferlist (2988 ms) 2023-11-05T08:10:38.435 INFO:tasks.workunit.client.0.smithi052.stdout: api_io_pp: [ RUN ] LibRadosIoPP.OverlappingWriteRoundTripPP 2023-11-05T08:10:38.435 INFO:tasks.workunit.client.0.smithi052.stdout: api_io_pp: [ OK ] LibRadosIoPP.OverlappingWriteRoundTripPP (3593 ms) 2023-11-05T08:10:38.435 INFO:tasks.workunit.client.0.smithi052.stdout: api_io_pp: [ RUN ] LibRadosIoPP.WriteFullRoundTripPP 2023-11-05T08:10:38.435 INFO:tasks.workunit.client.0.smithi052.stdout: api_io_pp: [ OK ] LibRadosIoPP.WriteFullRoundTripPP (2704 ms) 2023-11-05T08:10:38.435 INFO:tasks.workunit.client.0.smithi052.stdout: api_io_pp: [ RUN ] LibRadosIoPP.WriteFullRoundTripPP2 2023-11-05T08:10:38.436 INFO:tasks.workunit.client.0.smithi052.stdout: api_io_pp: [ OK ] LibRadosIoPP.WriteFullRoundTripPP2 (10837 ms) 2023-11-05T08:10:38.436 INFO:tasks.workunit.client.0.smithi052.stdout: api_io_pp: [ RUN ] LibRadosIoPP.AppendRoundTripPP 2023-11-05T08:10:38.436 INFO:tasks.workunit.client.0.smithi052.stdout: api_io_pp: [ OK ] LibRadosIoPP.AppendRoundTripPP (2208 ms) 2023-11-05T08:10:38.436 INFO:tasks.workunit.client.0.smithi052.stdout: api_io_pp: [ RUN ] LibRadosIoPP.TruncTestPP 2023-11-05T08:10:38.436 INFO:tasks.workunit.client.0.smithi052.stdout: api_io_pp: [ OK ] LibRadosIoPP.TruncTestPP (13075 ms) 2023-11-05T08:10:38.437 INFO:tasks.workunit.client.0.smithi052.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RemoveTestPP 2023-11-05T08:10:38.437 INFO:tasks.workunit.client.0.smithi052.stdout: api_io_pp: [ OK ] LibRadosIoPP.RemoveTestPP (4395 ms) 2023-11-05T08:10:38.437 INFO:tasks.workunit.client.0.smithi052.stdout: api_io_pp: [ RUN ] LibRadosIoPP.XattrsRoundTripPP 2023-11-05T08:10:38.437 INFO:tasks.workunit.client.0.smithi052.stdout: api_io_pp: [ OK ] LibRadosIoPP.XattrsRoundTripPP (3184 ms) 2023-11-05T08:10:38.437 INFO:tasks.workunit.client.0.smithi052.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RmXattrPP 2023-11-05T08:10:38.438 INFO:tasks.workunit.client.0.smithi052.stdout: api_io_pp: [ OK ] LibRadosIoPP.RmXattrPP (1608 ms) 2023-11-05T08:10:38.438 INFO:tasks.workunit.client.0.smithi052.stdout: api_io_pp: [ RUN ] LibRadosIoPP.XattrListPP 2023-11-05T08:10:38.438 INFO:tasks.workunit.client.0.smithi052.stdout: api_io_pp: [ OK ] LibRadosIoPP.XattrListPP (578 ms) 2023-11-05T08:10:38.438 INFO:tasks.workunit.client.0.smithi052.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtPP 2023-11-05T08:10:38.438 INFO:tasks.workunit.client.0.smithi052.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtPP (161 ms) 2023-11-05T08:10:38.439 INFO:tasks.workunit.client.0.smithi052.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtDNEPP 2023-11-05T08:10:38.439 INFO:tasks.workunit.client.0.smithi052.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtDNEPP (61 ms) 2023-11-05T08:10:38.439 INFO:tasks.workunit.client.0.smithi052.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtMismatchPP 2023-11-05T08:10:38.439 INFO:tasks.workunit.client.0.smithi052.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtMismatchPP (656 ms) 2023-11-05T08:10:38.439 INFO:tasks.workunit.client.0.smithi052.stdout: api_io_pp: [----------] 20 tests from LibRadosIoPP (94601 ms total) 2023-11-05T08:10:38.440 INFO:tasks.workunit.client.0.smithi052.stdout: api_io_pp: 2023-11-05T08:10:38.440 INFO:tasks.workunit.client.0.smithi052.stdout: api_io_pp: [----------] 17 tests from LibRadosIoECPP 2023-11-05T08:10:38.440 INFO:tasks.workunit.client.0.smithi052.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.SimpleWritePP 2023-11-05T08:10:38.440 INFO:tasks.workunit.client.0.smithi052.stdout: api_io_pp: [ OK ] LibRadosIoECPP.SimpleWritePP (7894 ms) 2023-11-05T08:10:38.440 INFO:tasks.workunit.client.0.smithi052.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.ReadOpPP 2023-11-05T08:10:38.441 INFO:tasks.workunit.client.0.smithi052.stdout: api_io_pp: [ OK ] LibRadosIoECPP.ReadOpPP (867 ms) 2023-11-05T08:10:38.441 INFO:tasks.workunit.client.0.smithi052.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.SparseReadOpPP 2023-11-05T08:10:38.441 INFO:tasks.workunit.client.0.smithi052.stdout: api_io_pp: [ OK ] LibRadosIoECPP.SparseReadOpPP (385 ms) 2023-11-05T08:10:38.441 INFO:tasks.workunit.client.0.smithi052.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RoundTripPP 2023-11-05T08:10:38.441 INFO:tasks.workunit.client.0.smithi052.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RoundTripPP (264 ms) 2023-11-05T08:10:38.441 INFO:tasks.workunit.client.0.smithi052.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RoundTripPP2 2023-11-05T08:10:38.766 INFO:tasks.workunit.client.0.smithi052.stdout: api_io_pp: [ OK ] LibRadosIoECPP.Rhing 2023-11-05T08:10:38.767 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify_pp: flushed 2023-11-05T08:10:38.767 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/0 (5277 ms) 2023-11-05T08:10:38.767 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/1 2023-11-05T08:10:38.767 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify_pp: trying... 2023-11-05T08:10:38.768 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify_pp: handle_notify cookie 94250825698816 notify_id 455266533382 notifier_gid 4801 2023-11-05T08:10:38.768 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify_pp: timed out 2023-11-05T08:10:38.768 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify_pp: flushing 2023-11-05T08:10:38.768 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify_pp: flushed 2023-11-05T08:10:38.769 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/1 (3889 ms) 2023-11-05T08:10:38.769 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/0 2023-11-05T08:10:38.769 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify_pp: List watches 2023-11-05T08:10:38.769 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify_pp: notify2 2023-11-05T08:10:38.769 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify_pp: handle_notify cookie 94250825699856 notify_id 459561500679 notifier_gid 4801 2023-11-05T08:10:38.770 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify_pp: notify2 done 2023-11-05T08:10:38.770 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify_pp: watch_check 2023-11-05T08:10:38.770 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify_pp: unwatch2 2023-11-05T08:10:38.770 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify_pp: flushing 2023-11-05T08:10:38.771 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify_pp: done 2023-11-05T08:10:38.771 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/0 (3931 ms) 2023-11-05T08:10:38.771 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/1 2023-11-05T08:10:38.771 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify_pp: List watches 2023-11-05T08:10:38.771 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify_pp: notify2 2023-11-05T08:10:38.771 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify_pp: handle_notify cookie 94250825699856 notify_id 463856467976 notifier_gid 4801 2023-11-05T08:10:38.772 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify_pp: notify2 done 2023-11-05T08:10:38.772 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify_pp: watch_check 2023-11-05T08:10:38.772 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify_pp: unwatch2 2023-11-05T08:10:38.772 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify_pp: flushing 2023-11-05T08:10:38.772 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify_pp: done 2023-11-05T08:10:38.772 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/1 (4161 ms) 2023-11-05T08:10:38.773 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify_pp: [----------] 14 tests from LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP (48572 ms total) 2023-11-05T08:10:38.773 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify_pp: 2023-11-05T08:10:38.773 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify_pp: [----------] Global test environment tear-down 2023-11-05T08:10:38.773 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify_pp: [==========] 16 tests from 2 test suites ran. (150807 ms total) 2023-11-05T08:10:38.773 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify_pp: [ PASSED ] 16 tests. 2023-11-05T08:10:39.489 INFO:tasks.workunit.client.0.smithi052.stdout: delete_pools_parallel: process_1_[92399]: starting. 2023-11-05T08:10:39.489 INFO:tasks.workunit.client.0.smithi052.stdout: delete_pools_parallel: process_1_[92399]: creating pool ceph_test_rados_delete_pools_parallel.smithi052-92369 2023-11-05T08:10:39.490 INFO:tasks.workunit.client.0.smithi052.stdout: delete_pools_parallel: process_1_[92399]: created object 0... 2023-11-05T08:10:39.490 INFO:tasks.workunit.client.0.smithi052.stdout: delete_pools_parallel: process_1_[92399]: created object 25... 2023-11-05T08:10:39.490 INFO:tasks.workunit.client.0.smithi052.stdout: delete_pools_parallel: process_1_[92399]: created object 49... 2023-11-05T08:10:39.490 INFO:tasks.workunit.client.0.smithi052.stdout: delete_pools_parallel: process_1_[92399]: finishing. 2023-11-05T08:10:39.491 INFO:tasks.workunit.client.0.smithi052.stdout: delete_pools_parallel: process_1_[92399]: shutting down. 2023-11-05T08:10:39.491 INFO:tasks.workunit.client.0.smithi052.stdout: delete_pools_parallel: process_2_[92400]: starting. 2023-11-05T08:10:39.491 INFO:tasks.workunit.client.0.smithi052.stdout: delete_pools_parallel: process_2_[92400]: deleting pool ceph_test_rados_delete_pools_parallel.smithi052-92369 2023-11-05T08:10:39.491 INFO:tasks.workunit.client.0.smithi052.stdout: delete_pools_parallel: process_2_[92400]: shutting down. 2023-11-05T08:10:39.491 INFO:tasks.workunit.client.0.smithi052.stdout: delete_pools_parallel: ******************************* 2023-11-05T08:10:39.492 INFO:tasks.workunit.client.0.smithi052.stdout: delete_pools_parallel: process_3_[115343]: starting. 2023-11-05T08:10:39.492 INFO:tasks.workunit.client.0.smithi052.stdout: delete_pools_parallel: process_3_[115343]: creating pool ceph_test_rados_delete_pools_parallel.smithi052-92369 2023-11-05T08:10:39.492 INFO:tasks.workunit.client.0.smithi052.stdout: delete_pools_parallel: process_3_[115343]: created object 0... 2023-11-05T08:10:39.492 INFO:tasks.workunit.client.0.smithi052.stdout: delete_pools_parallel: process_3_[115343]: created object 25... 2023-11-05T08:10:39.492 INFO:tasks.workunit.client.0.smithi052.stdout: delete_pools_parallel: process_3_[115343]: created object 49... 2023-11-05T08:10:39.493 INFO:tasks.workunit.client.0.smithi052.stdout: delete_pools_parallel: process_3_[115343]: finishing. 2023-11-05T08:10:39.493 INFO:tasks.workunit.client.0.smithi052.stdout: delete_pools_parallel: process_3_[115343]: shutting down. 2023-11-05T08:10:39.493 INFO:tasks.workunit.client.0.smithi052.stdout: delete_pools_parallel: ******************************* 2023-11-05T08:10:39.493 INFO:tasks.workunit.client.0.smithi052.stdout: delete_pools_parallel: process_5_[115347]: starting. 2023-11-05T08:10:39.493 INFO:tasks.workunit.client.0.smithi052.stdout: delete_pools_parallel: process_5_[115347]: listing objects. 2023-11-05T08:10:39.494 INFO:tasks.workunit.client.0.smithi052.stdout: delete_pools_parallel: process_5_[115347]: listed object 0... 2023-11-05T08:10:39.494 INFO:tasks.workunit.client.0.smithi052.stdout: delete_pools_parallel: process_5_[115347]: listed object 25... 2023-11-05T08:10:39.494 INFO:tasks.workunit.client.0.smithi052.stdout: delete_pools_parallel: process_5_[115347]: saw 50 objects 2023-11-05T08:10:39.494 INFO:tasks.workunit.client.0.smithi052.stdout: delete_pools_parallel: process_5_[115347]: shutting down. 2023-11-05T08:10:39.494 INFO:tasks.workunit.client.0.smithi052.stdout: delete_pools_parallel: ******************************* 2023-11-05T08:10:39.495 INFO:tasks.workunit.client.0.smithi052.stdout: delete_pools_parallel: process_4_[115346]: starting. 2023-11-05T08:10:39.495 INFO:tasks.workunit.client.0.smithi052.stdout: delete_pools_parallel: process_4_[115346]: deleting pool ceph_test_rados_delete_pools_parallel.smithi052-92369 2023-11-05T08:10:39.495 INFO:tasks.workunit.client.0.smithi052.stdout: delete_pools_parallel: process_4_[115346]: shutting down. 2023-11-05T08:10:39.495 INFO:tasks.workunit.client.0.smithi052.stdout: delete_pools_parallel: ******************************* 2023-11-05T08:10:39.495 INFO:tasks.workunit.client.0.smithi052.stdout: delete_pools_parallel: ******************************* 2023-11-05T08:10:39.496 INFO:tasks.workunit.client.0.smithi052.stdout: delete_pools_parallel: ******* SUCCESS ********** 2023-11-05T08:10:42.629 INFO:tasks.workunit.client.0.smithi052.stdout: listed object 0... 2023-11-05T08:10:42.630 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_15_[134788]: listed object 25... 2023-11-05T08:10:42.630 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_15_[134788]: listed object 50... 2023-11-05T08:10:42.630 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_15_[134788]: listed object 75... 2023-11-05T08:10:42.630 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_15_[134788]: listed object 100... 2023-11-05T08:10:42.631 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_15_[134788]: listed object 125... 2023-11-05T08:10:42.631 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_15_[134788]: saw 150 objects 2023-11-05T08:10:42.631 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_15_[134788]: shutting down. 2023-11-05T08:10:42.631 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: ******************************* 2023-11-05T08:10:42.632 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: ******************************* 2023-11-05T08:10:42.632 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: ******************************* 2023-11-05T08:10:42.632 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: ******************************* 2023-11-05T08:10:42.632 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_16_[134789]: starting. 2023-11-05T08:10:42.632 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_16_[134789]: added 25 objects... 2023-11-05T08:10:42.632 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_16_[134789]: added half of the objects 2023-11-05T08:10:42.633 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_16_[134789]: added 50 objects... 2023-11-05T08:10:42.633 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_16_[134789]: added 50 objects 2023-11-05T08:10:42.633 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: process_16_[134789]: shutting down. 2023-11-05T08:10:42.633 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: ******************************* 2023-11-05T08:10:42.634 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: ******************************* 2023-11-05T08:10:42.634 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: ******************************* 2023-11-05T08:10:42.634 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: ******************************* 2023-11-05T08:10:42.634 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: ******************************* 2023-11-05T08:10:42.634 INFO:tasks.workunit.client.0.smithi052.stdout: list_parallel: ******* SUCCESS ********** 2023-11-05T08:10:48.256 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc: [ RUN ] LibRadosMisc.Exec 2023-11-05T08:10:48.257 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc: [ OK ] LibRadosMisc.Exec (40668 ms) 2023-11-05T08:10:48.257 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc: [ RUN ] LibRadosMisc.WriteSame 2023-11-05T08:10:48.257 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc: [ OK ] LibRadosMisc.WriteSame (1139 ms) 2023-11-05T08:10:48.258 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc: [ RUN ] LibRadosMisc.CmpExt 2023-11-05T08:10:48.258 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc: [ OK ] LibRadosMisc.CmpExt (9386 ms) 2023-11-05T08:10:48.258 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc: [ RUN ] LibRadosMisc.Applications 2023-11-05T08:10:48.258 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc: [ OK ] LibRadosMisc.Applications (5779 ms) 2023-11-05T08:10:48.258 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc: [ RUN ] LibRadosMisc.MinCompatOSD 2023-11-05T08:10:48.259 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc: [ OK ] LibRadosMisc.MinCompatOSD (0 ms) 2023-11-05T08:10:48.259 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc: [ RUN ] LibRadosMisc.MinCompatClient 2023-11-05T08:10:48.259 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc: [ OK ] LibRadosMisc.MinCompatClient (0 ms) 2023-11-05T08:10:48.259 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc: [ RUN ] LibRadosMisc.ShutdownRace 2023-11-05T08:10:48.260 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc: [ OK ] LibRadosMisc.ShutdownRace (71408 ms) 2023-11-05T08:10:48.260 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc: [----------] 8 tests from LibRadosMisc (128380 ms total) 2023-11-05T08:10:48.260 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc: 2023-11-05T08:10:48.260 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc: [----------] Global test environment tear-down 2023-11-05T08:10:48.260 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc: [==========] 12 tests from 4 test suites ran. (160427 ms total) 2023-11-05T08:10:48.261 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc: [ PASSED ] 12 tests. 2023-11-05T08:10:49.372 INFO:tasks.workunit.client.0.smithi052.stdout: api_lock_pp: Running main() from gmock_main.cc 2023-11-05T08:10:49.373 INFO:tasks.workunit.client.0.smithi052.stdout: api_lock_pp: [==========] Running 16 tests from 2 test suites. 2023-11-05T08:10:49.373 INFO:tasks.workunit.client.0.smithi052.stdout: api_lock_pp: [----------] Global test environment set-up. 2023-11-05T08:10:49.373 INFO:tasks.workunit.client.0.smithi052.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockPP 2023-11-05T08:10:49.373 INFO:tasks.workunit.client.0.smithi052.stdout: api_lock_pp: seed 91779 2023-11-05T08:10:49.374 INFO:tasks.workunit.client.0.smithi052.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockExclusivePP 2023-11-05T08:10:49.374 INFO:tasks.workunit.client.0.smithi052.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockExclusivePP (35542 ms) 2023-11-05T08:10:49.374 INFO:tasks.workunit.client.0.smithi052.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockSharedPP 2023-11-05T08:10:49.374 INFO:tasks.workunit.client.0.smithi052.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockSharedPP (3328 ms) 2023-11-05T08:10:49.374 INFO:tasks.workunit.client.0.smithi052.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockExclusiveDurPP 2023-11-05T08:10:49.375 INFO:tasks.workunit.client.0.smithi052.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockExclusiveDurPP (2621 ms) 2023-11-05T08:10:49.375 INFO:tasks.workunit.client.0.smithi052.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockSharedDurPP 2023-11-05T08:10:49.375 INFO:tasks.workunit.client.0.smithi052.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockSharedDurPP (16178 ms) 2023-11-05T08:10:49.375 INFO:tasks.workunit.client.0.smithi052.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockMayRenewPP 2023-11-05T08:10:49.375 INFO:tasks.workunit.client.0.smithi052.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockMayRenewPP (4102 ms) 2023-11-05T08:10:49.376 INFO:tasks.workunit.client.0.smithi052.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.UnlockPP 2023-11-05T08:10:49.376 INFO:tasks.workunit.client.0.smithi052.stdout: api_lock_pp: [ OK ] LibRadosLockPP.UnlockPP (16932 ms) 2023-11-05T08:10:49.376 INFO:tasks.workunit.client.0.smithi052.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.ListLockersPP 2023-11-05T08:10:49.376 INFO:tasks.workunit.client.0.smithi052.stdout: api_lock_pp: [ OK ] LibRadosLockPP.ListLockersPP (645 ms) 2023-11-05T08:10:49.376 INFO:tasks.workunit.client.0.smithi052.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.BreakLockPP 2023-11-05T08:10:49.377 INFO:tasks.workunit.client.0.smithi052.stdout: api_lock_pp: [ OK ] LibRadosLockPP.BreakLockPP (10119 ms) 2023-11-05T08:10:49.377 INFO:tasks.workunit.client.0.smithi052.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockPP (89472 ms total) 2023-11-05T08:10:49.377 INFO:tasks.workunit.client.0.smithi052.stdout: api_lock_pp: 2023-11-05T08:10:49.377 INFO:tasks.workunit.client.0.smithi052.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockECPP 2023-11-05T08:10:49.377 INFO:tasks.workunit.client.0.smithi052.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockExclusivePP 2023-11-05T08:10:49.378 INFO:tasks.workunit.client.0.smithi052.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockExclusivePP (7825 ms) 2023-11-05T08:10:49.378 INFO:tasks.workunit.client.0.smithi052.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockSharedPP 2023-11-05T08:10:49.378 INFO:tasks.workunit.client.0.smithi052.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockSharedPP (390 ms) 2023-11-05T08:10:49.378 INFO:tasks.workunit.client.0.smithi052.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockExclusiveDurPP 2023-11-05T08:10:49.378 INFO:tasks.workunit.client.0.smithi052.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockExclusiveDurPP (1866 ms) 2023-11-05T08:10:49.379 INFO:tasks.workunit.client.0.smithi052.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockSharedDurPP 2023-11-05T08:10:49.379 INFO:tasks.workunit.client.0.smithi052.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockSharedDurPP (2855 ms) 2023-11-05T08:10:49.379 INFO:tasks.workunit.client.0.smithi052.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockMayRenewPP 2023-11-05T08:10:49.379 INFO:tasks.workunit.client.0.smithi052.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockMayRenewPP (159 ms) 2023-11-05T08:10:49.379 INFO:tasks.workunit.client.0.smithi052.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.UnlockPP 2023-11-05T08:10:49.380 INFO:tasks.workunit.client.0.smithi052.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.UnlockPP (699 ms) 2023-11-05T08:10:49.380 INFO:tasks.workunit.client.0.smithi052.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.ListLockersPP 2023-11-05T08:10:49.380 INFO:tasks.workunit.client.0.smithi052.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.ListLockersPP (1776 ms) 2023-11-05T08:10:49.380 INFO:tasks.workunit.client.0.smithi052.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.BreakLockPP 2023-11-05T08:10:49.380 INFO:tasks.workunit.client.0.smithi052.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.BreakLockPP (584 ms) 2023-11-05T08:10:49.381 INFO:tasks.workunit.client.0.smithi052.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockECPP (16154 ms total) 2023-11-05T08:10:49.381 INFO:tasks.workunit.client.0.smithi052.stdout: api_lock_pp: 2023-11-05T08:10:49.381 INFO:tasks.workunit.client.0.smithi052.stdout: api_lock_pp: [----------] Global test environment tear-down 2023-11-05T08:10:49.381 INFO:tasks.workunit.client.0.smithi052.stdout: api_lock_pp: [==========] 16 tests from 2 test suites ran. (161538 ms total) 2023-11-05T08:10:49.381 INFO:tasks.workunit.client.0.smithi052.stdout: api_lock_pp: [ PASSED ] 16 tests. 2023-11-05T08:10:49.392 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify: Running main() from gmock_main.cc 2023-11-05T08:10:49.393 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify: [==========] Running 11 tests from 2 test suites. 2023-11-05T08:10:49.393 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify: [----------] Global test environment set-up. 2023-11-05T08:10:49.393 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify: [----------] 10 tests from LibRadosWatchNotify 2023-11-05T08:10:49.393 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify 2023-11-05T08:10:49.393 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify: watch_notify_test_cb 2023-11-05T08:10:49.394 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify (14101 ms) 2023-11-05T08:10:49.394 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.Watch2Delete 2023-11-05T08:10:49.394 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify: waiting up to 300 for disconnect notification ... 2023-11-05T08:10:49.394 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94491774896640 err -107 2023-11-05T08:10:49.394 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.Watch2Delete (9134 ms) 2023-11-05T08:10:49.395 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchDelete 2023-11-05T08:10:49.395 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94491774896640 err -107waiting up to 300 2023-11-05T08:10:49.395 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify: for disconnect notification ... 2023-11-05T08:10:49.395 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchDelete (3216 ms) 2023-11-05T08:10:49.395 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2 2023-11-05T08:10:49.396 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify: watch_notify2_test_cb from 4434 notify_id 219043332097 cookie 94491777376112 2023-11-05T08:10:49.396 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2 (9767 ms) 2023-11-05T08:10:49.396 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchNotify2 2023-11-05T08:10:49.396 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify: watch_notify2_test_cb from 4434 notify_id 244813135872 cookie 94491777376112 2023-11-05T08:10:49.396 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchNotify2 (9428 ms) 2023-11-05T08:10:49.397 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioNotify 2023-11-05T08:10:49.397 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify: watch_notify2_test_cb from 4434 notify_id 313532612609 cookie 94491777425552 2023-11-05T08:10:49.397 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioNotify (24539 ms) 2023-11-05T08:10:49.397 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2Multi 2023-11-05T08:10:49.397 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify: watch_notify2_test_cb from 4434 notify_id 377957122048 cookie 94491777431648 2023-11-05T08:10:49.397 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify: watch_notify2_test_cb from 4434 notify_id 377957122048 cookie 94491777432688 2023-11-05T08:10:49.398 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2Multi (4240 ms) 2023-11-05T08:10:49.398 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2Timeout 2023-11-05T08:10:49.398 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify: watch_notify2_test_cb from 4434 notify_id 399431958530 cookie 94491777432688 2023-11-05T08:10:49.398 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify: watch_notify2_test_cb from 4434 notify_id 403726925827 cookie 94491777432688 2023-11-05T08:10:49.398 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2Timeout (9557 ms) 2023-11-05T08:10:49.399 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.Watch3Timeout 2023-11-05T08:10:49.399 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify: waiting up to 1024 for osd to time us out ... 2023-11-05T08:10:49.399 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94491777432688 err -107 2023-11-05T08:10:49.399 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify: watch_notify2_test_cb from 4434 notify_id 442381631491 cookie 94491777432688 2023-11-05T08:10:49.399 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.Watch3Timeout (10180 ms) 2023-11-05T08:10:49.400 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchDelete2 2023-11-05T08:10:49.400 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify: waiting up to 30 for disconnect notification ... 2023-11-05T08:10:49.400 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94491777432688 err -107 2023-11-05T08:10:49.400 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchDelete2 (2390 ms) 2023-11-05T08:10:49.400 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify: [----------] 10 tests from LibRadosWatchNotify (96552 ms total) 2023-11-05T08:10:49.401 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify: 2023-11-05T08:10:49.401 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify: [----------] 1 test from LibRadosWatchNotifyEC 2023-11-05T08:10:49.401 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotifyEC.WatchNotify 2023-11-05T08:10:49.401 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify: watch_notify_test_cb 2023-11-05T08:10:49.401 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify: [ OK ] LibRadosWatchNotifyEC.WatchNotify (7631 ms) 2023-11-05T08:10:49.401 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify: [----------] 1 test from LibRadosWatchNotifyEC (7631 ms total) 2023-11-05T08:10:49.402 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify: 2023-11-05T08:10:49.402 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify: [----------] Global test environment tear-down 2023-11-05T08:10:49.402 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch_notify: [==========] 11 tests from 2 test suites ran. (161452 ms total) 2023-11-05T08:10:49.403 INFO:tasks.workunit.client.0.smithi052.stdout: api_watch api_io: Running main() from gmock_main.cc 2023-11-05T08:10:49.403 INFO:tasks.workunit.client.0.smithi052.stdout: api_io: [==========] Running 24 tests from 2 test suites. 2023-11-05T08:10:49.403 INFO:tasks.workunit.client.0.smithi052.stdout: api_io: [----------] Global test environment set-up. 2023-11-05T08:10:49.403 INFO:tasks.workunit.client.0.smithi052.stdout: api_io: [----------] 14 tests from LibRadosIo 2023-11-05T08:10:49.404 INFO:tasks.workunit.client.0.smithi052.stdout: api_io: [ RUN ] LibRadosIo.SimpleWrite 2023-11-05T08:10:49.404 INFO:tasks.workunit.client.0.smithi052.stdout: api_io: [ OK ] LibRadosIo.SimpleWrite (29255 ms) 2023-11-05T08:10:49.404 INFO:tasks.workunit.client.0.smithi052.stdout: api_io: [ RUN ] LibRadosIo.TooBig 2023-11-05T08:10:49.404 INFO:tasks.workunit.client.0.smithi052.stdout: api_io: [ OK ] LibRadosIo.TooBig (0 ms) 2023-11-05T08:10:49.404 INFO:tasks.workunit.client.0.smithi052.stdout: api_io: [ RUN ] LibRadosIo.ReadTimeout 2023-11-05T08:10:49.405 INFO:tasks.workunit.client.0.smithi052.stdout: api_io: no timeout :/ 2023-11-05T08:10:49.405 INFO:tasks.workunit.client.0.smithi052.stdout: api_io: no timeout :/ 2023-11-05T08:10:49.405 INFO:tasks.workunit.client.0.smithi052.stdout: api_io: no timeout :/ 2023-11-05T08:10:49.405 INFO:tasks.workunit.client.0.smithi052.stdout: api_io: no timeout :/ 2023-11-05T08:10:49.406 INFO:tasks.workunit.client.0.smithi052.stdout: api_io: [ OK ] LibRadosIo.ReadTimeout (6334 ms) 2023-11-05T08:10:49.406 INFO:tasks.workunit.client.0.smithi052.stdout: api_io: [ RUN ] LibRadosIo.RoundTrip 2023-11-05T08:10:49.406 INFO:tasks.workunit.client.0.smithi052.stdout: api_io: [ OK ] LibRadosIo.RoundTrip (8882 ms) 2023-11-05T08:10:49.406 INFO:tasks.workunit.client.0.smithi052.stdout: api_io: [ RUN ] LibRadosIo.Checksum 2023-11-05T08:10:49.406 INFO:tasks.workunit.client.0.smithi052.stdout: api_io: [ OK ] LibRadosIo.Checksum (2188 ms) 2023-11-05T08:10:49.406 INFO:tasks.workunit.client.0.smithi052.stdout: api_io: [ RUN ] LibRadosIo.OverlappingWriteRoundTrip 2023-11-05T08:10:49.407 INFO:tasks.workunit.client.0.smithi052.stdout: api_io: [ OK ] LibRadosIo.OverlappingWriteRoundTrip (3574 ms) 2023-11-05T08:10:49.407 INFO:tasks.workunit.client.0.smithi052.stdout: api_io: [ RUN ] LibRadosIo.WriteFullRoundTrip 2023-11-05T08:10:49.407 INFO:tasks.workunit.client.0.smithi052.stdout: api_io: [ OK ] LibRadosIo.WriteFullRoundTrip (3347 ms) 2023-11-05T08:10:49.407 INFO:tasks.workunit.client.0.smithi052.stdout: api_io: [ RUN ] LibRadosIo.AppendRoundTrip 2023-11-05T08:10:49.407 INFO:tasks.workunit.client.0.smithi052.stdout: api_io: [ OK ] LibRadosIo.AppendRoundTrip (5554 ms) 2023-11-05T08:10:49.408 INFO:tasks.workunit.client.0.smithi052.stdout: api_io: [ RUN ] LibRadosIo.ZeroLenZero 2023-11-05T08:10:49.408 INFO:tasks.workunit.client.0.smithi052.stdout: api_io: [ OK ] LibRadosIo.ZeroLenZero (7580 ms) 2023-11-05T08:10:49.408 INFO:tasks.workunit.client.0.smithi052.stdout: api_io: [ RUN ] LibRadosIo.TruncTest 2023-11-05T08:10:49.408 INFO:tasks.workunit.client.0.smithi052.stdout: api_io: [ OK ] LibRadosIo.TruncTest (20401 ms) 2023-11-05T08:10:49.408 INFO:tasks.workunit.client.0.smithi052.stdout: api_io: [ RUN ] LibRadosIo.RemoveTest 2023-11-05T08:10:49.409 INFO:tasks.workunit.client.0.smithi052.stdout: api_io: [ OK ] LibRadosIo.RemoveTest (4188 ms) 2023-11-05T08:10:49.409 INFO:tasks.workunit.client.0.smithi052.stdout: api_io: [ RUN ] LibRadosIo.XattrsRoundTrip 2023-11-05T08:10:49.409 INFO:tasks.workunit.client.0.smithi052.stdout: api_io: [ OK ] LibRadosIo.XattrsRoundTrip (118 ms) 2023-11-05T08:10:49.409 INFO:tasks.workunit.client.0.smithi052.stdout: api_io: [ RUN ] LibRadosIo.RmXattr 2023-11-05T08:10:49.409 INFO:tasks.workunit.client.0.smithi052.stdout: api_io: [ OK ] LibRadosIo.RmXattr (1951 ms) 2023-11-05T08:10:49.410 INFO:tasks.workunit.client.0.smithi052.stdout: api_io: [ RUN ] LibRadosIo.XattrIter 2023-11-05T08:10:49.410 INFO:tasks.workunit.client.0.smithi052.stdout: api_io: [ OK ] LibRadosIo.XattrIter (123 ms) 2023-11-05T08:10:49.410 INFO:tasks.workunit.client.0.smithi052.stdout: api_io: [----------] 14 tests from LibRadosIo (93495 ms total) 2023-11-05T08:10:49.410 INFO:tasks.workunit.client.0.smithi052.stdout: api_io: 2023-11-05T08:10:49.410 INFO:tasks.workunit.client.0.smithi052.stdout: api_io: [----------] 10 tests from LibRadosIoEC 2023-11-05T08:10:49.411 INFO:tasks.workunit.client.0.smithi052.stdout: api_io: [ RUN ] LibRadosIoEC.SimpleWrite 2023-11-05T08:10:49.411 INFO:tasks.workunit.client.0.smithi052.stdout: api_io: [ OK ] LibRadosIoEC.SimpleWrite (7317 ms) 2023-11-05T08:10:49.411 INFO:tasks.workunit.client.0.smithi052.stdout: api_io: [ RUN ] LibRadosIoEC.RoundTrip 2023-11-05T08:10:49.411 INFO:tasks.workunit.client.0.smithi052.stdout: api_io: [ OK ] LibRadosIoEC.RoundTrip (429 ms) 2023-11-05T08:10:49.411 INFO:tasks.workunit.client.0.smithi052.stdout: api_io: [ RUN ] LibRadosIoEC.OverlappingWriteRoundTrip 2023-11-05T08:10:49.412 INFO:tasks.workunit.client.0.smithi052.stdout: api_io: [ OK ] LibRadosIoEC.OverlappingWriteRoundTrip (343 ms) 2023-11-05T08:10:49.412 INFO:tasks.workunit.client.0.smithi052.stdout: api_io: [ RUN ] LibRadosIoEC.WriteFullRoundTrip 2023-11-05T08:10:49.412 INFO:tasks.workunit.client.0.smithi052.stdout: api_io: [ OK ] LibRadosIoEC.WriteFullRoundTrip (420 ms) 2023-11-05T08:10:49.412 INFO:tasks.workunit.client.0.smithi052.stdout: api_io: [ RUN ] LibRadosIoEC.AppendRoundTrip 2023-11-05T08:10:49.412 INFO:tasks.workunit.client.0.smithi052.stdout: api_io: [ OK ] LibRadosIoEC.AppendRoundTrip (822 ms) 2023-11-05T08:10:49.413 INFO:tasks.workunit.client.0.smithi052.stdout: api_io: [ RUN ] LibRadosIoEC.TruncTest 2023-11-05T08:10:49.413 INFO:tasks.workunit.client.0.smithi052.stdout: api_io: [ OK ] LibRadosIoEC.TruncTest (132 ms) 2023-11-05T08:10:49.413 INFO:tasks.workunit.client.0.smithi052.stdout: api_io: [ RUN ] LibRadosIoEC.RemoveTest 2023-11-05T08:10:49.413 INFO:tasks.workunit.client.0.smithi052.stdout: api_io: [ OK ] LibRadosIoEC.RemoveTest (452 ms) 2023-11-05T08:10:49.413 INFO:tasks.workunit.client.0.smithi052.stdout: api_io: [ RUN ] LibRadosIoEC.XattrsRoundTrip 2023-11-05T08:10:49.413 INFO:tasks.workunit.client.0.smithi052.stdout: api_io: [ OK ] LibRadosIoEC.XattrsRoundTrip (1863 ms) 2023-11-05T08:10:49.414 INFO:tasks.workunit.client.0.smithi052.stdout: api_io: [ RUN ] LibRadosIoEC.RmXattr 2023-11-05T08:10:49.414 INFO:tasks.workunit.client.0.smithi052.stdout: api_io: [ OK ] LibRadosIoEC.RmXattr (1084 ms) 2023-11-05T08:10:49.414 INFO:tasks.workunit.client.0.smithi052.stdout: api_io: [ RUN ] LibRadosIoEC.XattrIter 2023-11-05T08:10:49.414 INFO:tasks.workunit.client.0.smithi052.stdout: api_io: [ OK ] LibRadosIoEC.XattrIter (232 ms) 2023-11-05T08:10:49.414 INFO:tasks.workunit.client.0.smithi052.stdout: api_io: [----------] 10 tests from LibRadosIoEC (13095 ms total) 2023-11-05T08:10:49.415 INFO:tasks.workunit.client.0.smithi052.stdout: api_io: 2023-11-05T08:10:49.415 INFO:tasks.workunit.client.0.smithi052.stdout: _notify: [ PASSED ] 11 tests. 2023-11-05T08:10:49.415 INFO:tasks.workunit.client.0.smithi052.stdout: api_io: [----------] Global test environment tear-down 2023-11-05T08:10:49.415 INFO:tasks.workunit.client.0.smithi052.stdout: api_io: [==========] 24 tests from 2 test suites ran. (161648 ms total) 2023-11-05T08:10:49.415 INFO:tasks.workunit.client.0.smithi052.stdout: api_io: [ PASSED ] 24 tests. 2023-11-05T08:10:50.862 INFO:tasks.workunit.client.0.smithi052.stdout:oundTripPP2 (1007 ms) 2023-11-05T08:10:50.863 INFO:tasks.workunit.client.0.smithi052.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.OverlappingWriteRoundTripPP 2023-11-05T08:10:50.863 INFO:tasks.workunit.client.0.smithi052.stdout: api_io_pp: [ OK ] LibRadosIoECPP.OverlappingWriteRoundTripPP (1693 ms) 2023-11-05T08:10:50.863 INFO:tasks.workunit.client.0.smithi052.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.WriteFullRoundTripPP 2023-11-05T08:10:50.863 INFO:tasks.workunit.client.0.smithi052.stdout: api_io_pp: [ OK ] LibRadosIoECPP.WriteFullRoundTripPP (243 ms) 2023-11-05T08:10:50.864 INFO:tasks.workunit.client.0.smithi052.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.WriteFullRoundTripPP2 2023-11-05T08:10:50.864 INFO:tasks.workunit.client.0.smithi052.stdout: api_io_pp: [ OK ] LibRadosIoECPP.WriteFullRoundTripPP2 (143 ms) 2023-11-05T08:10:50.864 INFO:tasks.workunit.client.0.smithi052.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.AppendRoundTripPP 2023-11-05T08:10:50.864 INFO:tasks.workunit.client.0.smithi052.stdout: api_io_pp: [ OK ] LibRadosIoECPP.AppendRoundTripPP (201 ms) 2023-11-05T08:10:50.864 INFO:tasks.workunit.client.0.smithi052.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.TruncTestPP 2023-11-05T08:10:50.865 INFO:tasks.workunit.client.0.smithi052.stdout: api_io_pp: [ OK ] LibRadosIoECPP.TruncTestPP (357 ms) 2023-11-05T08:10:50.865 INFO:tasks.workunit.client.0.smithi052.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RemoveTestPP 2023-11-05T08:10:50.865 INFO:tasks.workunit.client.0.smithi052.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RemoveTestPP (119 ms) 2023-11-05T08:10:50.865 INFO:tasks.workunit.client.0.smithi052.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.XattrsRoundTripPP 2023-11-05T08:10:50.865 INFO:tasks.workunit.client.0.smithi052.stdout: api_io_pp: [ OK ] LibRadosIoECPP.XattrsRoundTripPP (189 ms) 2023-11-05T08:10:50.866 INFO:tasks.workunit.client.0.smithi052.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RmXattrPP 2023-11-05T08:10:50.866 INFO:tasks.workunit.client.0.smithi052.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RmXattrPP (477 ms) 2023-11-05T08:10:50.866 INFO:tasks.workunit.client.0.smithi052.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.XattrListPP 2023-11-05T08:10:50.866 INFO:tasks.workunit.client.0.smithi052.stdout: api_io_pp: [ OK ] LibRadosIoECPP.XattrListPP (240 ms) 2023-11-05T08:10:50.866 INFO:tasks.workunit.client.0.smithi052.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtPP 2023-11-05T08:10:50.867 INFO:tasks.workunit.client.0.smithi052.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CmpExtPP (190 ms) 2023-11-05T08:10:50.867 INFO:tasks.workunit.client.0.smithi052.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtDNEPP 2023-11-05T08:10:50.867 INFO:tasks.workunit.client.0.smithi052.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CmpExtDNEPP (89 ms) 2023-11-05T08:10:50.868 INFO:tasks.workunit.client.0.smithi052.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtMismatchPP 2023-11-05T08:10:50.868 INFO:tasks.workunit.client.0.smithi052.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CmpExtMismatchPP (2124 ms) 2023-11-05T08:10:50.868 INFO:tasks.workunit.client.0.smithi052.stdout: api_io_pp: [----------] 17 tests from LibRadosIoECPP (16482 ms total) 2023-11-05T08:10:50.868 INFO:tasks.workunit.client.0.smithi052.stdout: api_io_pp: 2023-11-05T08:10:50.869 INFO:tasks.workunit.client.0.smithi052.stdout: api_io_pp: [----------] Global test environment tear-down 2023-11-05T08:10:50.869 INFO:tasks.workunit.client.0.smithi052.stdout: api_io_pp: [==========] 37 tests from 2 test suites ran. (163109 ms total) 2023-11-05T08:10:50.869 INFO:tasks.workunit.client.0.smithi052.stdout: api_io_pp: [ PASSED ] 37 tests. 2023-11-05T08:11:01.151 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:05:04.225 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:11:01.154 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:05:04.270 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:11:01.156 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:05:04.231 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:11:01.161 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:05:04.277 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:11:01.195 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:05:04.311 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:11:01.244 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:05:04.359 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:11:01.296 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:05:04.411 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:11:01.297 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:05:04.371 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:11:01.370 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:05:04.486 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:11:21.279 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:05:24.394 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:11:21.290 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:05:24.403 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:11:21.311 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:05:24.426 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:11:21.359 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:05:24.474 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:11:21.361 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:05:24.435 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:11:21.362 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:05:24.478 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:11:21.364 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:05:24.439 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:11:21.455 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:05:24.530 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:11:21.459 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:05:24.574 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:11:26.447 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots: Running main() from gmock_main.cc 2023-11-05T08:11:26.448 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots: [==========] Running 13 tests from 4 test suites. 2023-11-05T08:11:26.448 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots: [----------] Global test environment set-up. 2023-11-05T08:11:26.448 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshots 2023-11-05T08:11:26.448 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapList 2023-11-05T08:11:26.448 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapList (12003 ms) 2023-11-05T08:11:26.448 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapRemove 2023-11-05T08:11:26.449 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapRemove (20038 ms) 2023-11-05T08:11:26.449 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.Rollback 2023-11-05T08:11:26.449 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots: [ OK ] LibRadosSnapshots.Rollback (11047 ms) 2023-11-05T08:11:26.449 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapGetName 2023-11-05T08:11:26.449 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapGetName (6459 ms) 2023-11-05T08:11:26.449 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshots (49547 ms total) 2023-11-05T08:11:26.450 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots: 2023-11-05T08:11:26.450 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots: [----------] 3 tests from LibRadosSnapshotsSelfManaged 2023-11-05T08:11:26.450 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManaged.Snap 2023-11-05T08:11:26.450 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManaged.Snap (14608 ms) 2023-11-05T08:11:26.450 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManaged.Rollback 2023-11-05T08:11:26.451 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManaged.Rollback (35073 ms) 2023-11-05T08:11:26.451 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManaged.FutureSnapRollback 2023-11-05T08:11:26.451 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManaged.FutureSnapRollback (45725 ms) 2023-11-05T08:11:26.451 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots: [----------] 3 tests from LibRadosSnapshotsSelfManaged (95406 ms total) 2023-11-05T08:11:26.451 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots: 2023-11-05T08:11:26.452 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshotsEC 2023-11-05T08:11:26.452 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapList 2023-11-05T08:11:26.452 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.SnapList (4126 ms) 2023-11-05T08:11:26.452 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapRemove 2023-11-05T08:11:26.452 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.SnapRemove (2064 ms) 2023-11-05T08:11:26.452 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.Rollback 2023-11-05T08:11:26.453 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.Rollback (5092 ms) 2023-11-05T08:11:26.453 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapGetName 2023-11-05T08:11:26.453 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.SnapGetName (2269 ms) 2023-11-05T08:11:26.453 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshotsEC (13551 ms total) 2023-11-05T08:11:26.453 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots: 2023-11-05T08:11:26.454 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots: [----------] 2 tests from LibRadosSnapshotsSelfManagedEC 2023-11-05T08:11:26.454 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManagedEC.Snap 2023-11-05T08:11:26.454 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManagedEC.Snap (6498 ms) 2023-11-05T08:11:26.454 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManagedEC.Rollback 2023-11-05T08:11:26.455 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManagedEC.Rollback (7018 ms) 2023-11-05T08:11:26.455 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots: [----------] 2 tests from LibRadosSnapshotsSelfManagedEC (13516 ms total) 2023-11-05T08:11:26.455 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots: 2023-11-05T08:11:26.455 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots: [----------] Global test environment tear-down 2023-11-05T08:11:26.455 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots: [==========] 13 tests from 4 test suites ran. (198562 ms total) 2023-11-05T08:11:26.456 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots: [ PASSED ] 13 tests. 2023-11-05T08:11:41.464 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:05:44.580 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:11:41.469 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:05:44.584 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:11:41.534 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:05:44.608 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:11:41.538 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:05:44.654 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:11:41.541 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:05:44.616 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:11:41.544 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:05:44.659 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:11:41.562 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:05:44.677 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:11:41.613 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:05:44.687 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:11:41.620 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:05:44.736 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:11:43.603 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio: Running main() from gmock_main.cc 2023-11-05T08:11:43.603 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio: [==========] Running 42 tests from 2 test suites. 2023-11-05T08:11:43.603 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio: [----------] Global test environment set-up. 2023-11-05T08:11:43.603 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio: [----------] 26 tests from LibRadosAio 2023-11-05T08:11:43.604 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio: [ RUN ] LibRadosAio.TooBig 2023-11-05T08:11:43.604 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio: [ OK ] LibRadosAio.TooBig (4482 ms) 2023-11-05T08:11:43.604 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio: [ RUN ] LibRadosAio.SimpleWrite 2023-11-05T08:11:43.604 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio: [ OK ] LibRadosAio.SimpleWrite (31994 ms) 2023-11-05T08:11:43.604 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio: [ RUN ] LibRadosAio.WaitForSafe 2023-11-05T08:11:43.605 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio: [ OK ] LibRadosAio.WaitForSafe (6585 ms) 2023-11-05T08:11:43.605 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip 2023-11-05T08:11:43.605 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip (10956 ms) 2023-11-05T08:11:43.605 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip2 2023-11-05T08:11:43.605 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip2 (8291 ms) 2023-11-05T08:11:43.606 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip3 2023-11-05T08:11:43.606 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip3 (6220 ms) 2023-11-05T08:11:43.606 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripAppend 2023-11-05T08:11:43.606 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio: [ OK ] LibRadosAio.RoundTripAppend (4466 ms) 2023-11-05T08:11:43.606 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio: [ RUN ] LibRadosAio.RemoveTest 2023-11-05T08:11:43.607 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio: [ OK ] LibRadosAio.RemoveTest (9321 ms) 2023-11-05T08:11:43.607 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio: [ RUN ] LibRadosAio.XattrsRoundTrip 2023-11-05T08:11:43.607 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio: [ OK ] LibRadosAio.XattrsRoundTrip (15853 ms) 2023-11-05T08:11:43.607 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio: [ RUN ] LibRadosAio.RmXattr 2023-11-05T08:11:43.607 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio: [ OK ] LibRadosAio.RmXattr (26672 ms) 2023-11-05T08:11:43.608 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio: [ RUN ] LibRadosAio.XattrIter 2023-11-05T08:11:43.608 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio: [ OK ] LibRadosAio.XattrIter (29985 ms) 2023-11-05T08:11:43.608 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio: [ RUN ] LibRadosAio.IsComplete 2023-11-05T08:11:43.608 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio: [ OK ] LibRadosAio.IsComplete (8327 ms) 2023-11-05T08:11:43.608 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio: [ RUN ] LibRadosAio.IsSafe 2023-11-05T08:11:43.608 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio: [ OK ] LibRadosAio.IsSafe (3057 ms) 2023-11-05T08:11:43.609 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio: [ RUN ] LibRadosAio.ReturnValue 2023-11-05T08:11:43.609 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio: [ OK ] LibRadosAio.ReturnValue (3108 ms) 2023-11-05T08:11:43.609 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio: [ RUN ] LibRadosAio.Flush 2023-11-05T08:11:43.609 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio: [ OK ] LibRadosAio.Flush (5088 ms) 2023-11-05T08:11:43.609 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio: [ RUN ] LibRadosAio.FlushAsync 2023-11-05T08:11:43.610 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio: [ OK ] LibRadosAio.FlushAsync (3852 ms) 2023-11-05T08:11:43.610 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripWriteFull 2023-11-05T08:11:43.610 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio: [ OK ] LibRadosAio.RoundTripWriteFull (3104 ms) 2023-11-05T08:11:43.610 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripWriteSame 2023-11-05T08:11:43.610 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio: [ OK ] LibRadosAio.RoundTripWriteSame (5302 ms) 2023-11-05T08:11:43.610 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio: [ RUN ] LibRadosAio.SimpleStat 2023-11-05T08:11:43.611 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio: [ OK ] LibRadosAio.SimpleStat (3759 ms) 2023-11-05T08:11:43.611 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio: [ RUN ] LibRadosAio.OperateMtime 2023-11-05T08:11:43.611 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio: [ OK ] LibRadosAio.OperateMtime (5217 ms) 2023-11-05T08:11:43.611 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio: [ RUN ] LibRadosAio.Operate2Mtime 2023-11-05T08:11:43.611 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio: [ OK ] LibRadosAio.Operate2Mtime (3057 ms) 2023-11-05T08:11:43.612 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio: [ RUN ] LibRadosAio.SimpleStatNS 2023-11-05T08:11:43.612 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio: [ OK ] LibRadosAio.SimpleStatNS (3128 ms) 2023-11-05T08:11:43.612 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio: [ RUN ] LibRadosAio.StatRemove 2023-11-05T08:11:43.612 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio: [ OK ] LibRadosAio.StatRemove (2718 ms) 2023-11-05T08:11:43.612 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio: [ RUN ] LibRadosAio.ExecuteClass 2023-11-05T08:11:43.612 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio: [ OK ] LibRadosAio.ExecuteClass (3152 ms) 2023-11-05T08:11:43.613 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio: [ RUN ] LibRadosAio.MultiWrite 2023-11-05T08:11:43.613 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio: [ OK ] LibRadosAio.MultiWrite (4089 ms) 2023-11-05T08:11:43.613 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio: [ RUN ] LibRadosAio.AioUnlock 2023-11-05T08:11:43.613 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio: [ OK ] LibRadosAio.AioUnlock (4083 ms) 2023-11-05T08:11:43.613 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio: [----------] 26 tests from LibRadosAio (215866 ms total) 2023-11-05T08:11:43.614 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio: 2023-11-05T08:11:43.614 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio: [----------] 16 tests from LibRadosAioEC 2023-11-05T08:11:45.767 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio: [ RUN ] LibRadosAioEC.SimpleW api_snapshots_pp: Running main() from gmock_main.cc 2023-11-05T08:11:45.767 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots_pp: [==========] Running 19 tests from 4 test suites. 2023-11-05T08:11:45.767 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots_pp: [----------] Global test environment set-up. 2023-11-05T08:11:45.768 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots_pp: [----------] 5 tests from LibRadosSnapshotsPP 2023-11-05T08:11:45.768 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots_pp: seed 91937 2023-11-05T08:11:45.768 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapListPP 2023-11-05T08:11:45.768 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapListPP (20398 ms) 2023-11-05T08:11:45.768 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapRemovePP 2023-11-05T08:11:45.769 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapRemovePP (7289 ms) 2023-11-05T08:11:45.769 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.RollbackPP 2023-11-05T08:11:45.769 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.RollbackPP (15624 ms) 2023-11-05T08:11:45.769 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapGetNamePP 2023-11-05T08:11:45.769 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapGetNamePP (5320 ms) 2023-11-05T08:11:45.769 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapCreateRemovePP 2023-11-05T08:11:45.770 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapCreateRemovePP (25772 ms) 2023-11-05T08:11:45.770 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots_pp: [----------] 5 tests from LibRadosSnapshotsPP (74403 ms total) 2023-11-05T08:11:45.770 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots_pp: 2023-11-05T08:11:45.770 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots_pp: [----------] 7 tests from LibRadosSnapshotsSelfManagedPP 2023-11-05T08:11:45.771 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.SnapPP 2023-11-05T08:11:45.771 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.SnapPP (33669 ms) 2023-11-05T08:11:45.771 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.RollbackPP 2023-11-05T08:11:45.771 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.RollbackPP (30894 ms) 2023-11-05T08:11:45.771 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP 2023-11-05T08:11:45.771 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP (20682 ms) 2023-11-05T08:11:45.772 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.Bug11677 2023-11-05T08:11:45.772 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.Bug11677 (4315 ms) 2023-11-05T08:11:45.772 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.OrderSnap 2023-11-05T08:11:45.772 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.OrderSnap (2566 ms) 2023-11-05T08:11:45.773 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.WriteRollback 2023-11-05T08:11:45.773 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6776-g420cd129/rpm/el9/BUILD/ceph-18.0.0-6776-g420cd129/src/test/librados/snapshots_cxx.cc:463: Skipped 2023-11-05T08:11:45.773 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots_pp: 2023-11-05T08:11:45.773 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsSelfManagedPP.WriteRollback (0 ms) 2023-11-05T08:11:45.773 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.ReusePurgedSnap 2023-11-05T08:11:45.774 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots_pp: deleting snap 23 in pool LibRadosSnapshotsSelfManagedPP_smithi052-91937-7 2023-11-05T08:11:45.774 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots_pp: waiting for snaps to purge 2023-11-05T08:11:45.774 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.ReusePurgedSnap (20363 ms) 2023-11-05T08:11:45.774 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots_pp: [----------] 7 tests from LibRadosSnapshotsSelfManagedPP (112489 ms total) 2023-11-05T08:11:45.774 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots_pp: 2023-11-05T08:11:45.775 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots_pp: [----------] 4 tests from LibRadosSnapshotsECPP 2023-11-05T08:11:45.775 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.SnapListPP 2023-11-05T08:11:45.775 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.SnapListPP (4031 ms) 2023-11-05T08:11:45.775 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.SnapRemovePP 2023-11-05T08:11:45.775 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.SnapRemovePP (3757 ms) 2023-11-05T08:11:45.776 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.RollbackPP 2023-11-05T08:11:45.776 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.RollbackPP (2177 ms) 2023-11-05T08:11:45.776 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.SnapGetNamePP 2023-11-05T08:11:45.776 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.SnapGetNamePP (4082 ms) 2023-11-05T08:11:45.776 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots_pp: [----------] 4 tests from LibRadosSnapshotsECPP (14047 ms total) 2023-11-05T08:11:45.777 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots_pp: 2023-11-05T08:11:45.777 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots_pp: [----------] 3 tests from LibRadosSnapshotsSelfManagedECPP 2023-11-05T08:12:01.429 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.SnapPP 2023-11-05T08:12:01.430 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedECPP.SnapPP (4636 ms) 2023-11-05T08:12:01.430 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.RollbackPP 2023-11-05T08:12:01.430 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedECPP.RollbackPP (4053 ms) 2023-11-05T08:12:01.430 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.Bug11677 2023-11-05T08:12:01.431 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedECPP.Bug11677 (4056 ms) 2023-11-05T08:12:01.431 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots_pp: [----------] 3 tests from LibRadosSnapshotsSelfManagedECPP (12745 ms total) 2023-11-05T08:12:01.431 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots_pp: 2023-11-05T08:12:01.431 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots_pp: [----------] Global test environment tear-down 2023-11-05T08:12:01.431 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots_pp: [==========] 19 tests from 4 test suites ran. (233551 ms total) 2023-11-05T08:12:01.431 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots_pp: [ PASSED ] 18 tests. 2023-11-05T08:12:01.432 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots_pp: [ SKIPPED ] 1 test, listed below: 2023-11-05T08:12:01.432 INFO:tasks.workunit.client.0.smithi052.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsSelfManagedPP.WriteRollback 2023-11-05T08:12:01.505 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:06:04.621 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:12:01.513 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:06:04.629 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:12:01.514 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:06:04.588 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:12:01.521 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:06:04.596 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:12:01.586 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:06:04.702 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:12:01.592 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:06:04.708 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:12:01.613 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:06:04.729 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:12:01.616 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:06:04.690 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:12:01.671 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:06:04.786 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:12:14.143 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: Running main() from gmock_main.cc 2023-11-05T08:12:14.143 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [==========] Running 57 tests from 4 test suites. 2023-11-05T08:12:14.143 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [----------] Global test environment set-up. 2023-11-05T08:12:14.143 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [----------] 32 tests from LibRadosAio 2023-11-05T08:12:14.144 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ RUN ] LibRadosAio.TooBigPP 2023-11-05T08:12:14.144 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ OK ] LibRadosAio.TooBigPP (4390 ms) 2023-11-05T08:12:14.144 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ RUN ] LibRadosAio.PoolQuotaPP 2023-11-05T08:12:14.144 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ OK ] LibRadosAio.PoolQuotaPP (37526 ms) 2023-11-05T08:12:14.144 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleWritePP 2023-11-05T08:12:14.145 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleWritePP (53444 ms) 2023-11-05T08:12:14.145 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ RUN ] LibRadosAio.WaitForSafePP 2023-11-05T08:12:14.145 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ OK ] LibRadosAio.WaitForSafePP (29401 ms) 2023-11-05T08:12:14.145 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP 2023-11-05T08:12:14.145 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP (30919 ms) 2023-11-05T08:12:14.145 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP2 2023-11-05T08:12:14.146 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP2 (8453 ms) 2023-11-05T08:12:14.146 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP3 2023-11-05T08:12:14.146 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP3 (4157 ms) 2023-11-05T08:12:14.146 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripSparseReadPP 2023-11-05T08:12:14.146 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripSparseReadPP (3250 ms) 2023-11-05T08:12:14.147 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ RUN ] LibRadosAio.IsCompletePP 2023-11-05T08:12:14.147 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ OK ] LibRadosAio.IsCompletePP (5128 ms) 2023-11-05T08:12:14.147 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ RUN ] LibRadosAio.IsSafePP 2023-11-05T08:12:14.147 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ OK ] LibRadosAio.IsSafePP (4690 ms) 2023-11-05T08:12:14.147 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ RUN ] LibRadosAio.ReturnValuePP 2023-11-05T08:12:14.148 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ OK ] LibRadosAio.ReturnValuePP (4115 ms) 2023-11-05T08:12:14.148 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ RUN ] LibRadosAio.FlushPP 2023-11-05T08:12:14.148 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ OK ] LibRadosAio.FlushPP (3904 ms) 2023-11-05T08:12:14.148 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ RUN ] LibRadosAio.FlushAsyncPP 2023-11-05T08:12:14.148 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ OK ] LibRadosAio.FlushAsyncPP (4064 ms) 2023-11-05T08:12:14.149 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteFullPP 2023-11-05T08:12:14.149 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteFullPP (5226 ms) 2023-11-05T08:12:14.149 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteFullPP2 2023-11-05T08:12:14.149 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteFullPP2 (4768 ms) 2023-11-05T08:12:14.149 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteSamePP 2023-11-05T08:12:14.149 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteSamePP (3075 ms) 2023-11-05T08:12:14.150 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteSamePP2 2023-11-05T08:12:14.150 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteSamePP2 (5264 ms) 2023-11-05T08:12:14.150 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleStatPPNS 2023-11-05T08:12:14.150 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleStatPPNS (4062 ms) 2023-11-05T08:12:14.150 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleStatPP 2023-11-05T08:12:14.150 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleStatPP (3231 ms) 2023-11-05T08:12:14.151 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ RUN ] LibRadosAio.OperateMtime 2023-11-05T08:12:14.151 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ OK ] LibRadosAio.OperateMtime (3013 ms) 2023-11-05T08:12:14.151 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ RUN ] LibRadosAio.OperateMtime2 2023-11-05T08:12:14.151 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ OK ] LibRadosAio.OperateMtime2 (2500 ms) 2023-11-05T08:12:14.151 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ RUN ] LibRadosAio.StatRemovePP 2023-11-05T08:12:14.151 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ OK ] LibRadosAio.StatRemovePP (3982 ms) 2023-11-05T08:12:14.152 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ RUN ] LibRadosAio.ExecuteClassPP 2023-11-05T08:12:14.152 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ OK ] LibRadosAio.ExecuteClassPP (3198 ms) 2023-11-05T08:12:14.152 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ RUN ] LibRadosAio.OmapPP 2023-11-05T08:12:14.152 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ OK ] LibRadosAio.OmapPP (4429 ms) 2023-11-05T08:12:14.152 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ RUN ] LibRadosAio.MultiWritePP 2023-11-05T08:12:14.152 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ OK ] LibRadosAio.MultiWritePP (3469 ms) 2023-11-05T08:12:14.153 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ RUN ] LibRadosAio.AioUnlockPP 2023-11-05T08:12:14.153 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ OK ] LibRadosAio.AioUnlockPP (3324 ms) 2023-11-05T08:12:14.153 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripAppendPP 2023-11-05T08:12:21.481 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:06:24.596 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:12:21.539 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:06:24.654 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:12:21.583 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:06:24.699 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:12:21.586 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:06:24.661 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:12:21.591 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:06:24.665 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:12:21.596 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:06:24.712 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:12:21.600 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:06:24.716 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:12:21.635 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:06:24.709 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:12:21.658 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:06:24.774 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:12:40.548 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ OK ] LibRados api_list: : cursor()=6:02547ec2:::1:head expected=6:02547ec2:::1:head 2023-11-05T08:12:40.548 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: > 6:02547ec2:::1:head -> 1 2023-11-05T08:12:40.549 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: : entry=1 expected=1 2023-11-05T08:12:40.549 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: : seek to 6:b29083e3:::5:head 2023-11-05T08:12:40.549 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: : cursor()=6:b29083e3:::5:head expected=6:b29083e3:::5:head 2023-11-05T08:12:40.549 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: > 6:b29083e3:::5:head -> 5 2023-11-05T08:12:40.550 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: : entry=5 expected=5 2023-11-05T08:12:40.550 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: : seek to 6:89d3ae78:::11:head 2023-11-05T08:12:40.550 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: : cursor()=6:89d3ae78:::11:head expected=6:89d3ae78:::11:head 2023-11-05T08:12:40.550 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: > 6:89d3ae78:::11:head -> 11 2023-11-05T08:12:40.550 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: : entry=11 expected=11 2023-11-05T08:12:40.551 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: : seek to 6:863748b0:::15:head 2023-11-05T08:12:40.551 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: : cursor()=6:863748b0:::15:head expected=6:863748b0:::15:head 2023-11-05T08:12:40.551 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: > 6:863748b0:::15:head -> 15 2023-11-05T08:12:40.551 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: : entry=15 expected=15 2023-11-05T08:12:40.551 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: : seek to 6:5c6b0b28:::7:head 2023-11-05T08:12:40.551 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: : cursor()=6:5c6b0b28:::7:head expected=6:5c6b0b28:::7:head 2023-11-05T08:12:40.552 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: > 6:5c6b0b28:::7:head -> 7 2023-11-05T08:12:40.552 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: : entry=7 expected=7 2023-11-05T08:12:40.552 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: : seek to 6:e960b815:::9:head 2023-11-05T08:12:40.552 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: : cursor()=6:e960b815:::9:head expected=6:e960b815:::9:head 2023-11-05T08:12:40.552 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: > 6:e960b815:::9:head -> 9 2023-11-05T08:12:40.553 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: : entry=9 expected=9 2023-11-05T08:12:40.553 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: : seek to 6:de5d7c5f:::12:head 2023-11-05T08:12:40.553 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: : cursor()=6:de5d7c5f:::12:head expected=6:de5d7c5f:::12:head 2023-11-05T08:12:40.553 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: > 6:de5d7c5f:::12:head -> 12 2023-11-05T08:12:40.553 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: : entry=12 expected=12 2023-11-05T08:12:40.553 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: : seek to 6:d83876eb:::4:head 2023-11-05T08:12:40.554 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: : cursor()=6:d83876eb:::4:head expected=6:d83876eb:::4:head 2023-11-05T08:12:40.554 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: > 6:d83876eb:::4:head -> 4 2023-11-05T08:12:40.554 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: : entry=4 expected=4 2023-11-05T08:12:40.554 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: [ OK ] LibRadosList.ListObjectsCursor (12098 ms) 2023-11-05T08:12:40.554 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: [ RUN ] LibRadosList.EnumerateObjects 2023-11-05T08:12:40.555 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: [ OK ] LibRadosList.EnumerateObjects (109722 ms) 2023-11-05T08:12:40.555 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: [ RUN ] LibRadosList.EnumerateObjectsSplit 2023-11-05T08:12:40.555 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: split 0/5 -> MIN 6:33333333::::head 2023-11-05T08:12:40.555 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: split 1/5 -> 6:33333333::::head 6:66666666::::head 2023-11-05T08:12:40.555 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: split 2/5 -> 6:66666666::::head 6:99999999::::head 2023-11-05T08:12:40.556 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: split 3/5 -> 6:99999999::::head 6:cccccccc::::head 2023-11-05T08:12:40.556 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: split 4/5 -> 6:cccccccc::::head MAX 2023-11-05T08:12:40.556 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: [ OK ] LibRadosList.EnumerateObjectsSplit (28636 ms) 2023-11-05T08:12:40.556 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: [----------] 7 tests from LibRadosList (255398 ms total) 2023-11-05T08:12:40.556 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: 2023-11-05T08:12:40.557 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: [----------] 3 tests from LibRadosListEC 2023-11-05T08:12:40.557 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: [ RUN ] LibRadosListEC.ListObjects 2023-11-05T08:12:40.557 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: [ OK ] LibRadosListEC.ListObjects (5267 ms) 2023-11-05T08:12:40.557 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: [ RUN ] LibRadosListEC.ListObjectsNS 2023-11-05T08:12:40.557 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: myset foo1,foo2,foo3 2023-11-05T08:12:40.558 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: foo1 2023-11-05T08:12:40.558 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: foo2 2023-11-05T08:12:40.558 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: foo3 2023-11-05T08:12:40.558 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: myset foo1,foo4,foo5 2023-11-05T08:12:40.558 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: foo4 2023-11-05T08:12:40.559 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: foo5 2023-11-05T08:12:40.559 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: foo1 2023-11-05T08:12:40.559 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: myset foo6,foo7 2023-11-05T08:12:40.559 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: foo7 2023-11-05T08:12:40.559 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: foo6 2023-11-05T08:12:40.560 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: myset :foo1,:foo2,:foo3,ns1:foo1,ns1:foo4,ns1:foo5,ns2:foo6,ns2:foo7 2023-11-05T08:12:40.560 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: ns1:foo4 2023-11-05T08:12:40.560 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: ns1:foo5 2023-11-05T08:12:40.560 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: ns2:foo7 2023-11-05T08:12:40.560 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: ns2:foo6 2023-11-05T08:12:40.561 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: ns1:foo1 2023-11-05T08:12:40.561 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: :foo1 2023-11-05T08:12:40.561 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: :foo2 2023-11-05T08:12:40.561 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: :foo3 2023-11-05T08:12:40.561 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: [ OK ] LibRadosListEC.ListObjectsNS (3454 ms) 2023-11-05T08:12:40.561 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: [ RUN ] LibRadosListEC.ListObjectsStart 2023-11-05T08:12:40.562 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: 1 0 2023-11-05T08:12:40.562 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: 10 0 2023-11-05T08:12:40.562 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: 13 0 2023-11-05T08:12:41.652 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:06:44.767 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:12:41.656 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:06:44.772 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:12:41.713 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:06:44.788 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:12:41.715 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:06:44.789 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:12:41.733 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:06:44.849 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:12:41.740 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:06:44.856 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:12:41.749 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:06:44.865 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:12:41.769 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:06:44.843 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:12:41.802 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:06:44.917 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:12:48.893 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: 7 0 2023-11-05T08:12:48.893 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: 14 0 2023-11-05T08:12:48.893 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: 0 0 2023-11-05T08:12:48.894 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: 15 0 2023-11-05T08:12:48.894 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: 11 0 2023-11-05T08:12:48.894 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: 5 0 2023-11-05T08:12:48.894 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: 8 0 2023-11-05T08:12:48.894 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: 6 0 2023-11-05T08:12:48.895 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: 3 0 2023-11-05T08:12:48.895 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: 4 0 2023-11-05T08:12:48.895 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: 12 0 2023-11-05T08:12:48.895 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: 9 0 2023-11-05T08:12:48.895 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: 2 0 2023-11-05T08:12:48.895 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: have 1 expect one of 0,1,10,11,12,13,14,15,2,3,4,5,6,7,8,9 2023-11-05T08:12:48.896 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: [ OK ] LibRadosListEC.ListObjectsStart (4039 ms) 2023-11-05T08:12:48.896 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: [----------] 3 tests from LibRadosListEC (12760 ms total) 2023-11-05T08:12:48.896 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: 2023-11-05T08:12:48.896 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: [----------] 1 test from LibRadosListNP 2023-11-05T08:12:48.896 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: [ RUN ] LibRadosListNP.ListObjectsError 2023-11-05T08:12:48.897 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: [ OK ] LibRadosListNP.ListObjectsError (3411 ms) 2023-11-05T08:12:48.897 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: [----------] 1 test from LibRadosListNP (3412 ms total) 2023-11-05T08:12:48.897 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: 2023-11-05T08:12:48.897 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: [----------] Global test environment tear-down 2023-11-05T08:12:48.897 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: [==========] 11 tests from 3 test suites ran. (281086 ms total) 2023-11-05T08:12:48.898 INFO:tasks.workunit.client.0.smithi052.stdout: api_list: [ PASSED ] 11 tests. 2023-11-05T08:12:58.956 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc_pp: [==========] Running 31 tests from 7 test suites. 2023-11-05T08:12:58.956 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc_pp: [----------] Global test environment set-up. 2023-11-05T08:12:58.957 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscVersion 2023-11-05T08:12:58.957 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc_pp: [ RUN ] LibRadosMiscVersion.VersionPP 2023-11-05T08:12:58.957 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc_pp: [ OK ] LibRadosMiscVersion.VersionPP (0 ms) 2023-11-05T08:12:58.957 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscVersion (0 ms total) 2023-11-05T08:12:58.958 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc_pp: 2023-11-05T08:12:58.958 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc_pp: [----------] 22 tests from LibRadosMiscPP 2023-11-05T08:12:58.958 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc_pp: seed 91732 2023-11-05T08:12:58.958 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.WaitOSDMapPP 2023-11-05T08:12:58.958 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.WaitOSDMapPP (18 ms) 2023-11-05T08:12:58.959 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongNamePP 2023-11-05T08:12:58.959 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongNamePP (34457 ms) 2023-11-05T08:12:58.959 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongLocatorPP 2023-11-05T08:12:58.959 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongLocatorPP (16964 ms) 2023-11-05T08:12:58.959 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongNSpacePP 2023-11-05T08:12:58.960 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongNSpacePP (13193 ms) 2023-11-05T08:12:58.960 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongAttrNamePP 2023-11-05T08:12:58.960 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongAttrNamePP (22122 ms) 2023-11-05T08:12:58.960 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.ExecPP 2023-11-05T08:12:58.960 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.ExecPP (370 ms) 2023-11-05T08:12:58.961 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.BadFlagsPP 2023-11-05T08:12:58.961 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.BadFlagsPP (277 ms) 2023-11-05T08:12:58.961 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Operate1PP 2023-11-05T08:12:58.961 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Operate1PP (1558 ms) 2023-11-05T08:12:58.961 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Operate2PP 2023-11-05T08:12:58.961 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Operate2PP (842 ms) 2023-11-05T08:12:58.962 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.BigObjectPP 2023-11-05T08:12:58.962 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.BigObjectPP (2062 ms) 2023-11-05T08:12:58.962 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.AioOperatePP 2023-11-05T08:12:58.962 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.AioOperatePP (1028 ms) 2023-11-05T08:12:58.962 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.AssertExistsPP 2023-11-05T08:12:58.963 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.AssertExistsPP (107 ms) 2023-11-05T08:12:58.963 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.AssertVersionPP 2023-11-05T08:12:58.963 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.AssertVersionPP (1238 ms) 2023-11-05T08:12:58.963 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.BigAttrPP 2023-11-05T08:12:58.963 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc_pp: osd_max_attr_size = 0 2023-11-05T08:12:58.964 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc_pp: osd_max_attr_size == 0; skipping test 2023-11-05T08:12:58.964 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.BigAttrPP (94011 ms) 2023-11-05T08:12:58.964 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.CopyPP 2023-11-05T08:12:58.964 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.CopyPP (13731 ms) 2023-11-05T08:12:58.965 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.CopyScrubPP 2023-11-05T08:12:58.965 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc_pp: waiting for initial deep scrubs... 2023-11-05T08:12:58.965 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc_pp: done waiting, doing copies 2023-11-05T08:12:58.965 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc_pp: waiting for final deep scrubs... 2023-11-05T08:12:58.965 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc_pp: done waiting 2023-11-05T08:12:58.966 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.CopyScrubPP (79687 ms) 2023-11-05T08:12:58.966 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.WriteSamePP 2023-11-05T08:12:58.966 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.WriteSamePP (269 ms) 2023-11-05T08:12:58.966 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.CmpExtPP 2023-11-05T08:12:58.967 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.CmpExtPP (52 ms) 2023-11-05T08:12:58.967 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Applications 2023-11-05T08:12:58.967 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Applications (5122 ms) 2023-11-05T08:12:58.967 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.MinCompatOSD 2023-11-05T08:12:58.967 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.MinCompatOSD (0 ms) 2023-11-05T08:12:58.968 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.MinCompatClient 2023-11-05T08:12:58.968 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.MinCompatClient (0 ms) 2023-11-05T08:12:58.968 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Conf 2023-11-05T08:12:58.968 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Conf (0 ms) 2023-11-05T08:13:01.788 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:07:04.903 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:13:01.790 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:07:04.865 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:13:01.791 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:07:04.907 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:13:01.795 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:07:04.869 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:13:01.837 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:07:04.953 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:13:01.843 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:07:04.959 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:13:01.846 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:07:04.920 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:13:01.846 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:07:04.962 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:13:01.893 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:07:05.009 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:13:02.526 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc_pp: [--- api_c_write_operations: Running main() from gmock_main.cc 2023-11-05T08:13:02.527 INFO:tasks.workunit.client.0.smithi052.stdout: api_c_write_operations: [==========] Running 8 tests from 2 test suites. 2023-11-05T08:13:02.527 INFO:tasks.workunit.client.0.smithi052.stdout: api_c_write_operations: [----------] Global test environment set-up. 2023-11-05T08:13:02.527 INFO:tasks.workunit.client.0.smithi052.stdout: api_c_write_operations: [----------] 1 test from LibradosCWriteOps 2023-11-05T08:13:02.527 INFO:tasks.workunit.client.0.smithi052.stdout: api_c_write_operations: [ RUN ] LibradosCWriteOps.NewDelete 2023-11-05T08:13:02.528 INFO:tasks.workunit.client.0.smithi052.stdout: api_c_write_operations: [ OK ] LibradosCWriteOps.NewDelete (0 ms) 2023-11-05T08:13:02.528 INFO:tasks.workunit.client.0.smithi052.stdout: api_c_write_operations: [----------] 1 test from LibradosCWriteOps (0 ms total) 2023-11-05T08:13:02.528 INFO:tasks.workunit.client.0.smithi052.stdout: api_c_write_operations: 2023-11-05T08:13:02.528 INFO:tasks.workunit.client.0.smithi052.stdout: api_c_write_operations: [----------] 7 tests from LibRadosCWriteOps 2023-11-05T08:13:02.528 INFO:tasks.workunit.client.0.smithi052.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.assertExists 2023-11-05T08:13:02.529 INFO:tasks.workunit.client.0.smithi052.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.assertExists (36097 ms) 2023-11-05T08:13:02.529 INFO:tasks.workunit.client.0.smithi052.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.WriteOpAssertVersion 2023-11-05T08:13:02.529 INFO:tasks.workunit.client.0.smithi052.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.WriteOpAssertVersion (20701 ms) 2023-11-05T08:13:02.529 INFO:tasks.workunit.client.0.smithi052.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.Xattrs 2023-11-05T08:13:02.529 INFO:tasks.workunit.client.0.smithi052.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.Xattrs (6179 ms) 2023-11-05T08:13:02.530 INFO:tasks.workunit.client.0.smithi052.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.Write 2023-11-05T08:13:02.530 INFO:tasks.workunit.client.0.smithi052.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.Write (38783 ms) 2023-11-05T08:13:02.530 INFO:tasks.workunit.client.0.smithi052.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.Exec 2023-11-05T08:13:02.530 INFO:tasks.workunit.client.0.smithi052.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.Exec (18592 ms) 2023-11-05T08:13:02.530 INFO:tasks.workunit.client.0.smithi052.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.WriteSame 2023-11-05T08:13:02.531 INFO:tasks.workunit.client.0.smithi052.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.WriteSame (34242 ms) 2023-11-05T08:13:02.531 INFO:tasks.workunit.client.0.smithi052.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.CmpExt 2023-11-05T08:13:02.531 INFO:tasks.workunit.client.0.smithi052.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.CmpExt (139897 ms) 2023-11-05T08:13:02.531 INFO:tasks.workunit.client.0.smithi052.stdout: api_c_write_operations: [----------] 7 tests from LibRadosCWriteOps (294495 ms total) 2023-11-05T08:13:02.531 INFO:tasks.workunit.client.0.smithi052.stdout: api_c_write_operations: 2023-11-05T08:13:02.532 INFO:tasks.workunit.client.0.smithi052.stdout: api_c_write_operations: [----------] Global test environment tear-down 2023-11-05T08:13:02.532 INFO:tasks.workunit.client.0.smithi052.stdout: api_c_write_operations: [==========] 8 tests from 2 test suites ran. (294495 ms total) 2023-11-05T08:13:02.532 INFO:tasks.workunit.client.0.smithi052.stdout: api_c_write_operations: [ PASSED ] 8 tests. 2023-11-05T08:13:11.512 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:07:14.628 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:13:11.514 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:07:14.630 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:13:11.531 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:07:14.605 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:13:11.534 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:07:14.649 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:13:11.535 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:07:14.651 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:13:11.598 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:07:14.673 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:13:11.629 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:07:14.745 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:13:11.632 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:07:14.748 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:13:11.652 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:07:14.727 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:13:22.085 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:07:25.201 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:13:22.089 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:07:25.205 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:13:22.123 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:07:25.239 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:13:22.160 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:07:25.234 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:13:22.162 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:07:25.237 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:13:22.173 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:07:25.288 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:13:22.178 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:07:25.293 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:13:22.199 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:07:25.274 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:13:22.217 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:07:25.333 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:13:32.150 INFO:tasks.workunit.client.0.smithi052.stdout:-------] 22 tests from LibRadosMiscPP (287108 ms total) 2023-11-05T08:13:32.151 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc_pp: 2023-11-05T08:13:32.151 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc_pp: [----------] 1 test from LibRadosTwoPoolsECPP 2023-11-05T08:13:32.151 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc_pp: [ RUN ] LibRadosTwoPoolsECPP.CopyFrom 2023-11-05T08:13:32.151 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc_pp: [ OK ] LibRadosTwoPoolsECPP.CopyFrom (5486 ms) 2023-11-05T08:13:32.152 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc_pp: [----------] 1 test from LibRadosTwoPoolsECPP (5486 ms total) 2023-11-05T08:13:32.152 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc_pp: 2023-11-05T08:13:32.152 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/0, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)0, Checksummer::xxhash32, ceph_le > 2023-11-05T08:13:32.152 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/0.Subset 2023-11-05T08:13:32.152 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc_pp: [ OK ] LibRadosChecksum/0.Subset (537 ms) 2023-11-05T08:13:32.153 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/0.Chunked 2023-11-05T08:13:32.153 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc_pp: [ OK ] LibRadosChecksum/0.Chunked (46 ms) 2023-11-05T08:13:32.153 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/0 (583 ms total) 2023-11-05T08:13:32.153 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc_pp: 2023-11-05T08:13:32.154 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/1, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)1, Checksummer::xxhash64, ceph_le > 2023-11-05T08:13:32.154 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/1.Subset 2023-11-05T08:13:32.154 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc_pp: [ OK ] LibRadosChecksum/1.Subset (856 ms) 2023-11-05T08:13:32.154 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/1.Chunked 2023-11-05T08:13:32.154 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc_pp: [ OK ] LibRadosChecksum/1.Chunked (44 ms) 2023-11-05T08:13:32.155 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/1 (900 ms total) 2023-11-05T08:13:32.155 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc_pp: 2023-11-05T08:13:32.155 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/2, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)2, Checksummer::crc32c, ceph_le > 2023-11-05T08:13:32.155 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/2.Subset 2023-11-05T08:13:32.155 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc_pp: [ OK ] LibRadosChecksum/2.Subset (1195 ms) 2023-11-05T08:13:32.155 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/2.Chunked 2023-11-05T08:13:32.156 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc_pp: [ OK ] LibRadosChecksum/2.Chunked (118 ms) 2023-11-05T08:13:32.156 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/2 (1313 ms total) 2023-11-05T08:13:32.156 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc_pp: 2023-11-05T08:13:32.156 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscECPP 2023-11-05T08:13:32.157 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc_pp: [ RUN ] LibRadosMiscECPP.CompareExtentRange 2023-11-05T08:13:32.157 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc_pp: [ OK ] LibRadosMiscECPP.CompareExtentRange (1566 ms) 2023-11-05T08:13:32.157 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscECPP (1566 ms total) 2023-11-05T08:13:32.157 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc_pp: 2023-11-05T08:13:32.157 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc_pp: [----------] Global test environment tear-down 2023-11-05T08:13:32.158 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc_pp: [==========] 31 tests from 7 test suites ran. (324338 ms total) 2023-11-05T08:13:32.158 INFO:tasks.workunit.client.0.smithi052.stdout: api_misc_pp: [ PASSED ] 31 tests. 2023-11-05T08:13:42.134 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:07:45.250 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:13:42.139 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:07:45.255 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:13:42.188 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:07:45.304 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:13:42.197 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:07:45.312 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:13:42.199 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:07:45.315 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:13:42.205 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:07:45.279 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:13:42.206 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:07:45.280 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:13:42.249 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:07:45.365 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:13:42.252 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:07:45.327 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:13:52.119 INFO:tasks.workunit.client.0.smithi052.stdout:rite 2023-11-05T08:13:52.120 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio: [ OK ] LibRadosAioEC.SimpleWrite (7282 ms) 2023-11-05T08:13:52.120 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio: [ RUN ] LibRadosAioEC.WaitForComplete 2023-11-05T08:13:52.120 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio: [ OK ] LibRadosAioEC.WaitForComplete (6597 ms) 2023-11-05T08:13:52.120 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTrip 2023-11-05T08:13:52.121 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTrip (7700 ms) 2023-11-05T08:13:52.121 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTrip2 2023-11-05T08:13:52.121 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTrip2 (7867 ms) 2023-11-05T08:13:52.121 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTripAppend 2023-11-05T08:13:52.121 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTripAppend (9005 ms) 2023-11-05T08:13:52.122 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio: [ RUN ] LibRadosAioEC.IsComplete 2023-11-05T08:13:52.122 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio: [ OK ] LibRadosAioEC.IsComplete (15390 ms) 2023-11-05T08:13:52.122 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio: [ RUN ] LibRadosAioEC.IsSafe 2023-11-05T08:13:52.122 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio: [ OK ] LibRadosAioEC.IsSafe (9079 ms) 2023-11-05T08:13:52.122 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio: [ RUN ] LibRadosAioEC.ReturnValue 2023-11-05T08:13:52.122 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio: [ OK ] LibRadosAioEC.ReturnValue (7538 ms) 2023-11-05T08:13:52.123 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio: [ RUN ] LibRadosAioEC.Flush 2023-11-05T08:13:52.123 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio: [ OK ] LibRadosAioEC.Flush (7219 ms) 2023-11-05T08:13:52.123 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio: [ RUN ] LibRadosAioEC.FlushAsync 2023-11-05T08:13:52.123 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio: [ OK ] LibRadosAioEC.FlushAsync (8053 ms) 2023-11-05T08:13:52.125 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTripWriteFull 2023-11-05T08:13:52.125 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTripWriteFull (7081 ms) 2023-11-05T08:13:52.125 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio: [ RUN ] LibRadosAioEC.SimpleStat 2023-11-05T08:13:52.125 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio: [ OK ] LibRadosAioEC.SimpleStat (6774 ms) 2023-11-05T08:13:52.126 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio: [ RUN ] LibRadosAioEC.SimpleStatNS 2023-11-05T08:13:52.126 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio: [ OK ] LibRadosAioEC.SimpleStatNS (7429 ms) 2023-11-05T08:13:52.126 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio: [ RUN ] LibRadosAioEC.StatRemove 2023-11-05T08:13:52.126 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio: [ OK ] LibRadosAioEC.StatRemove (6613 ms) 2023-11-05T08:13:52.126 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio: [ RUN ] LibRadosAioEC.ExecuteClass 2023-11-05T08:13:52.127 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio: [ OK ] LibRadosAioEC.ExecuteClass (7960 ms) 2023-11-05T08:13:52.127 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio: [ RUN ] LibRadosAioEC.MultiWrite 2023-11-05T08:13:52.127 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio: [ OK ] LibRadosAioEC.MultiWrite (6926 ms) 2023-11-05T08:13:52.127 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio: [----------] 16 tests from LibRadosAioEC (128514 ms total) 2023-11-05T08:13:52.127 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio: 2023-11-05T08:13:52.128 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio: [----------] Global test environment tear-down 2023-11-05T08:13:52.128 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio: [==========] 42 tests from 2 test suites ran. (344380 ms total) 2023-11-05T08:13:52.128 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio: [ PASSED ] 42 tests. 2023-11-05T08:14:07.263 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:08:10.378 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:14:07.271 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:08:10.387 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:14:07.314 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:08:10.389 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:14:07.315 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:08:10.390 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:14:07.322 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:08:10.437 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:14:07.327 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:08:10.442 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:14:07.358 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:08:10.474 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:14:07.363 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:08:10.438 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:14:07.375 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:08:10.491 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:14:27.300 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:08:30.416 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:14:27.308 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:08:30.423 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:14:27.350 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:08:30.466 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:14:27.352 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:08:30.426 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:14:27.356 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:08:30.431 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:14:27.373 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:08:30.488 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:14:27.377 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:08:30.493 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:14:27.397 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:08:30.471 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:14:27.419 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:08:30.535 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:14:47.279 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:08:50.395 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:14:47.285 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:08:50.401 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:14:47.330 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:08:50.404 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:14:47.334 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:08:50.450 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:14:47.334 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:08:50.409 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:14:47.335 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:08:50.451 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:14:47.342 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:08:50.458 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:14:47.372 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:08:50.447 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:14:47.391 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:08:50.507 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:14:56.683 INFO:tasks.workunit.client.0.smithi052.stdout:Aio.RoundTripAppendPP (3416 ms) 2023-11-05T08:14:56.683 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ RUN ] LibRadosAio.RacingRemovePP 2023-11-05T08:14:56.683 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ OK ] LibRadosAio.RacingRemovePP (3461 ms) 2023-11-05T08:14:56.683 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripCmpExtPP 2023-11-05T08:14:56.684 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripCmpExtPP (3161 ms) 2023-11-05T08:14:56.684 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripCmpExtPP2 2023-11-05T08:14:56.684 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripCmpExtPP2 (3512 ms) 2023-11-05T08:14:56.684 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ RUN ] LibRadosAio.PoolEIOFlag 2023-11-05T08:14:56.684 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: setting pool EIO 2023-11-05T08:14:56.685 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: max_success 119, min_failed 120 2023-11-05T08:14:56.685 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ OK ] LibRadosAio.PoolEIOFlag (11077 ms) 2023-11-05T08:14:56.685 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ RUN ] LibRadosAio.MultiReads 2023-11-05T08:14:56.685 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ OK ] LibRadosAio.MultiReads (3414 ms) 2023-11-05T08:14:56.686 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [----------] 32 tests from LibRadosAio (271023 ms total) 2023-11-05T08:14:56.686 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: 2023-11-05T08:14:56.686 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [----------] 4 tests from LibRadosAioPP 2023-11-05T08:14:56.686 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.ReadIntoBufferlist 2023-11-05T08:14:56.686 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ OK ] LibRadosAioPP.ReadIntoBufferlist (3404 ms) 2023-11-05T08:14:56.687 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.XattrsRoundTripPP 2023-11-05T08:14:56.687 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ OK ] LibRadosAioPP.XattrsRoundTripPP (9737 ms) 2023-11-05T08:14:56.687 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.RmXattrPP 2023-11-05T08:14:56.687 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ OK ] LibRadosAioPP.RmXattrPP (19714 ms) 2023-11-05T08:14:56.687 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.RemoveTestPP 2023-11-05T08:14:56.688 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ OK ] LibRadosAioPP.RemoveTestPP (3533 ms) 2023-11-05T08:14:56.688 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [----------] 4 tests from LibRadosAioPP (36388 ms total) 2023-11-05T08:14:56.688 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: 2023-11-05T08:14:56.688 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [----------] 1 test from LibRadosIoPP 2023-11-05T08:14:56.688 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ RUN ] LibRadosIoPP.XattrListPP 2023-11-05T08:14:56.688 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ OK ] LibRadosIoPP.XattrListPP (4179 ms) 2023-11-05T08:14:56.689 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [----------] 1 test from LibRadosIoPP (4179 ms total) 2023-11-05T08:14:56.689 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: 2023-11-05T08:14:56.689 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [----------] 20 tests from LibRadosAioEC 2023-11-05T08:14:56.689 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.SimpleWritePP 2023-11-05T08:14:56.689 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ OK ] LibRadosAioEC.SimpleWritePP (13801 ms) 2023-11-05T08:14:56.690 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.WaitForSafePP 2023-11-05T08:14:56.690 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ OK ] LibRadosAioEC.WaitForSafePP (7426 ms) 2023-11-05T08:14:56.690 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripPP 2023-11-05T08:14:56.690 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripPP (6831 ms) 2023-11-05T08:14:56.690 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripPP2 2023-11-05T08:14:56.691 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripPP2 (8041 ms) 2023-11-05T08:14:56.691 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripPP3 2023-11-05T08:14:56.691 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripPP3 (4546 ms) 2023-11-05T08:14:56.691 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripSparseReadPP 2023-11-05T08:14:56.691 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripSparseReadPP (6829 ms) 2023-11-05T08:14:56.692 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripAppendPP 2023-11-05T08:14:56.692 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripAppendPP (6547 ms) 2023-11-05T08:14:56.692 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.IsCompletePP 2023-11-05T08:14:56.692 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ OK ] LibRadosAioEC.IsCompletePP (7734 ms) 2023-11-05T08:14:56.692 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.IsSafePP 2023-11-05T08:14:56.693 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ OK ] LibRadosAioEC.IsSafePP (7403 ms) 2023-11-05T08:14:56.693 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.ReturnValuePP 2023-11-05T08:14:56.693 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ OK ] LibRadosAioEC.ReturnValuePP (6981 ms) 2023-11-05T08:14:56.693 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.FlushPP 2023-11-05T08:14:56.693 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ OK ] LibRadosAioEC.FlushPP (6825 ms) 2023-11-05T08:14:56.693 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.FlushAsyncPP 2023-11-05T08:14:56.694 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ OK ] LibRadosAioEC.FlushAsyncPP (7480 ms) 2023-11-05T08:14:56.694 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripWriteFullPP 2023-11-05T08:14:56.694 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripWriteFullPP (6903 ms) 2023-11-05T08:14:59.873 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:09:02.988 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:14:59.885 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:09:03.001 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:14:59.899 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:09:03.014 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:14:59.904 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:09:03.019 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:14:59.944 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:09:03.018 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:14:59.950 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:09:03.025 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:14:59.986 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:09:03.060 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:15:00.026 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:09:03.142 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:15:00.045 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:09:03.160 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:15:07.493 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:09:10.609 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:15:07.495 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:09:10.611 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:15:07.514 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:09:10.630 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:15:07.535 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:09:10.610 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:15:07.539 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:09:10.613 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:15:07.549 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:09:10.664 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:15:07.551 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:09:10.667 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:15:07.559 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:09:10.633 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:15:07.573 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:09:10.688 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:15:27.558 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:09:30.674 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:15:27.563 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:09:30.678 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:15:27.613 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:09:30.687 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:15:27.613 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:09:30.728 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:15:27.614 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:09:30.688 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:15:27.615 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:09:30.729 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:15:27.626 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:09:30.742 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:15:27.660 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:09:30.776 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:15:27.663 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:09:30.737 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:15:44.059 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripWriteFullPP2 2023-11-05T08:15:44.059 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripWriteFullPP2 (3378 ms) 2023-11-05T08:15:44.060 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.SimpleStatPP 2023-11-05T08:15:44.060 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ OK ] LibRadosAioEC.SimpleStatPP (6605 ms) 2023-11-05T08:15:44.060 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.SimpleStatPPNS 2023-11-05T08:15:44.060 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ OK ] LibRadosAioEC.SimpleStatPPNS (6958 ms) 2023-11-05T08:15:44.061 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.StatRemovePP 2023-11-05T08:15:44.061 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ OK ] LibRadosAioEC.StatRemovePP (7682 ms) 2023-11-05T08:15:44.061 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.ExecuteClassPP 2023-11-05T08:15:44.061 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ OK ] LibRadosAioEC.ExecuteClassPP (6940 ms) 2023-11-05T08:15:44.061 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.OmapPP 2023-11-05T08:15:44.062 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ OK ] LibRadosAioEC.OmapPP (7877 ms) 2023-11-05T08:15:44.062 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.MultiWritePP 2023-11-05T08:15:44.062 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ OK ] LibRadosAioEC.MultiWritePP (7934 ms) 2023-11-05T08:15:44.062 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [----------] 20 tests from LibRadosAioEC (144722 ms total) 2023-11-05T08:15:44.063 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: 2023-11-05T08:15:44.063 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [----------] Global test environment tear-down 2023-11-05T08:15:44.063 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [==========] 57 tests from 4 test suites ran. (456312 ms total) 2023-11-05T08:15:44.063 INFO:tasks.workunit.client.0.smithi052.stdout: api_aio_pp: [ PASSED ] 57 tests. 2023-11-05T08:15:47.681 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:09:50.797 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:15:47.687 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:09:50.803 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:15:47.726 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:09:50.842 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:15:47.737 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:09:50.853 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:15:47.738 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:09:50.812 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:15:47.739 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:09:50.814 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:15:47.740 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:09:50.855 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:15:47.772 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:09:50.846 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:15:47.773 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:09:50.889 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:16:13.004 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:10:16.119 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:16:13.035 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:10:16.150 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:16:13.040 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:10:16.114 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:16:13.073 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:10:16.147 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:16:13.100 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:10:16.216 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:16:13.108 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:10:16.223 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:16:13.129 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:10:16.245 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:16:13.135 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:10:16.209 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:16:13.161 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:10:16.276 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:16:32.970 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:10:36.085 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:16:32.973 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:10:36.088 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:16:33.009 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:10:36.125 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:16:33.017 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:10:36.092 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:16:33.022 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:10:36.097 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:16:33.025 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:10:36.140 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:16:33.030 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:10:36.145 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:16:33.058 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:10:36.133 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:16:33.066 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:10:36.182 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:16:53.079 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:10:56.194 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:16:53.084 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:10:56.200 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:16:53.127 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:10:56.242 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:16:53.135 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:10:56.209 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:16:53.137 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:10:56.212 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:16:53.176 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:10:56.250 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:16:53.186 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:10:56.302 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:16:53.188 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:10:56.304 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:16:53.237 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:10:56.353 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:16:58.765 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:11:01.881 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:16:58.782 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:11:01.898 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:16:58.798 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:11:01.914 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:16:58.814 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:11:01.889 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:16:58.815 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:11:01.890 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:16:58.821 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:11:01.937 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:16:58.823 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:11:01.938 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:16:58.831 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:11:01.905 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:16:58.840 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:11:01.956 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:16:59.711 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [==========] Running 77 tests from 4 test suites. 2023-11-05T08:16:59.711 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [----------] Global test environment set-up. 2023-11-05T08:16:59.712 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [----------] 3 tests from LibRadosTierPP 2023-11-05T08:16:59.712 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: seed 91894 2023-11-05T08:16:59.712 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ RUN ] LibRadosTierPP.Dirty 2023-11-05T08:16:59.712 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ OK ] LibRadosTierPP.Dirty (38715 ms) 2023-11-05T08:16:59.712 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ RUN ] LibRadosTierPP.FlushWriteRaces 2023-11-05T08:16:59.712 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ OK ] LibRadosTierPP.FlushWriteRaces (31213 ms) 2023-11-05T08:16:59.713 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ RUN ] LibRadosTierPP.HitSetNone 2023-11-05T08:16:59.713 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ OK ] LibRadosTierPP.HitSetNone (809 ms) 2023-11-05T08:16:59.713 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [----------] 3 tests from LibRadosTierPP (70737 ms total) 2023-11-05T08:16:59.713 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: 2023-11-05T08:16:59.713 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [----------] 48 tests from LibRadosTwoPoolsPP 2023-11-05T08:16:59.714 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Overlay 2023-11-05T08:16:59.714 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Overlay (65661 ms) 2023-11-05T08:16:59.714 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Promote 2023-11-05T08:16:59.714 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Promote (29593 ms) 2023-11-05T08:16:59.714 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteSnap 2023-11-05T08:16:59.715 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PromoteSnap (20223 ms) 2023-11-05T08:16:59.715 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteSnapScrub 2023-11-05T08:16:59.715 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: my_snaps [4] 2023-11-05T08:16:59.715 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: my_snaps [5,4] 2023-11-05T08:16:59.715 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: my_snaps [6,5,4] 2023-11-05T08:16:59.715 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: my_snaps [7,6,5,4] 2023-11-05T08:16:59.716 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: promoting some heads 2023-11-05T08:16:59.716 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: promoting from clones for snap 7 2023-11-05T08:16:59.716 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: promoting from clones for snap 6 2023-11-05T08:16:59.716 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: promoting from clones for snap 5 2023-11-05T08:16:59.716 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: promoting from clones for snap 4 2023-11-05T08:16:59.717 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: waiting for scrubs... 2023-11-05T08:16:59.717 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: done waiting 2023-11-05T08:16:59.717 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PromoteSnapScrub (168750 ms) 2023-11-05T08:16:59.717 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteSnapTrimRace 2023-11-05T08:16:59.718 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PromoteSnapTrimRace (10591 ms) 2023-11-05T08:16:59.718 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Whiteout 2023-11-05T08:16:59.718 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Whiteout (9644 ms) 2023-11-05T08:16:59.718 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.WhiteoutDeleteCreate 2023-11-05T08:16:59.719 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.WhiteoutDeleteCreate (9095 ms) 2023-11-05T08:16:59.719 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Evict 2023-11-05T08:16:59.719 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Evict (8958 ms) 2023-11-05T08:16:59.719 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.EvictSnap 2023-11-05T08:16:59.719 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.EvictSnap (11290 ms) 2023-11-05T08:16:59.719 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.EvictSnap2 2023-11-05T08:16:59.720 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.EvictSnap2 (10299 ms) 2023-11-05T08:16:59.720 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ListSnap 2023-11-05T08:16:59.720 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ListSnap (10783 ms) 2023-11-05T08:16:59.720 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.EvictSnapRollbackReadRace 2023-11-05T08:16:59.720 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.EvictSnapRollbackReadRace (43853 ms) 2023-11-05T08:16:59.721 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.TryFlush 2023-11-05T08:16:59.721 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.TryFlush (9142 ms) 2023-11-05T08:16:59.721 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Flush 2023-11-05T08:16:59.721 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Flush (10847 ms) 2023-11-05T08:16:59.721 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.FlushSnap 2023-11-05T08:16:59.721 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.FlushSnap (16157 ms) 2023-11-05T08:16:59.722 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.FlushTryFlushRaces 2023-11-05T08:16:59.722 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.FlushTryFlushRaces (9379 ms) 2023-11-05T08:16:59.722 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.TryFlushReadRace 2023-11-05T08:16:59.722 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.TryFlushReadRace (11424 ms) 2023-11-05T08:17:13.192 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:11:16.307 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:17:13.196 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:11:16.312 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:17:13.223 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:11:16.339 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:17:13.241 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:11:16.315 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:17:13.242 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:11:16.317 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:17:13.247 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:11:16.363 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:17:13.248 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:11:16.364 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:17:13.269 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:11:16.343 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:17:13.277 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:11:16.391 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:17:22.656 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HitSetRead 2023-11-05T08:17:22.656 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: hmm, no HitSet yet 2023-11-05T08:17:22.656 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: ok, hit_set contains 200:602f83fe:::foo:head 2023-11-05T08:17:22.656 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.HitSetRead (9985 ms) 2023-11-05T08:17:22.657 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HitSetWrite 2023-11-05T08:17:22.657 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: pg_num = 32 2023-11-05T08:17:22.657 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: pg 0 ls 1699172237,0 2023-11-05T08:17:22.657 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: pg 1 ls 1699172238,0 2023-11-05T08:17:22.657 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: pg 2 ls 1699172237,0 2023-11-05T08:17:22.658 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: pg 3 ls 1699172237,0 2023-11-05T08:17:22.658 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: pg 4 ls 1699172238,0 2023-11-05T08:17:22.658 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: pg 5 ls 1699172237,0 2023-11-05T08:17:22.658 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: pg 6 ls 1699172237,0 2023-11-05T08:17:22.658 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: pg 7 ls 1699172237,0 2023-11-05T08:17:22.659 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: pg 8 ls 1699172237,0 2023-11-05T08:17:22.659 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: pg 9 ls 1699172237,0 2023-11-05T08:17:22.659 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: pg 10 ls 1699172237,0 2023-11-05T08:17:22.659 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: pg 11 ls 1699172238,0 2023-11-05T08:17:22.659 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: pg 12 ls 1699172237,0 2023-11-05T08:17:22.660 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: pg 13 ls 1699172237,0 2023-11-05T08:17:22.660 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: pg 14 ls 1699172237,0 2023-11-05T08:17:22.660 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: pg 15 ls 1699172237,0 2023-11-05T08:17:22.660 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: pg 16 ls 1699172237,0 2023-11-05T08:17:22.660 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: pg 17 ls 1699172237,0 2023-11-05T08:17:22.661 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: pg 18 ls 1699172237,0 2023-11-05T08:17:22.661 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: pg 19 ls 1699172237,0 2023-11-05T08:17:22.661 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: pg 20 ls 1699172237,0 2023-11-05T08:17:22.661 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: pg 21 ls 1699172237,0 2023-11-05T08:17:22.661 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: pg 22 ls 1699172237,0 2023-11-05T08:17:22.662 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: pg 23 ls 1699172237,0 2023-11-05T08:17:22.662 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: pg 24 ls 1699172237,0 2023-11-05T08:17:22.662 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: pg 25 ls 1699172237,0 2023-11-05T08:17:22.662 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: pg 26 ls 1699172237,0 2023-11-05T08:17:22.663 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: pg 27 ls 1699172237,0 2023-11-05T08:17:22.663 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: pg 28 ls 1699172237,0 2023-11-05T08:17:22.663 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: pg 29 ls 1699172237,0 2023-11-05T08:17:22.663 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: pg 30 ls 1699172237,0 2023-11-05T08:17:22.663 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: pg 31 ls 1699172237,0 2023-11-05T08:17:22.664 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: pg_num = 32 2023-11-05T08:17:22.664 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:6cac518f:::0:head 2023-11-05T08:17:22.664 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:02547ec2:::1:head 2023-11-05T08:17:22.664 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:f905c69b:::2:head 2023-11-05T08:17:22.664 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:cfc208b3:::3:head 2023-11-05T08:17:22.665 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:d83876eb:::4:head 2023-11-05T08:17:22.665 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:b29083e3:::5:head 2023-11-05T08:17:22.665 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:c4fdafeb:::6:head 2023-11-05T08:17:22.665 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:5c6b0b28:::7:head 2023-11-05T08:17:22.665 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:bd63b0f1:::8:head 2023-11-05T08:17:22.666 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:e960b815:::9:head 2023-11-05T08:17:22.666 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:52ea6a34:::10:head 2023-11-05T08:17:22.666 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:89d3ae78:::11:head 2023-11-05T08:17:22.666 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:de5d7c5f:::12:head 2023-11-05T08:17:22.666 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:566253c9:::13:head 2023-11-05T08:17:22.667 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:62a1935d:::14:head 2023-11-05T08:17:22.667 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:863748b0:::15:head 2023-11-05T08:17:22.667 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:3958e169:::16:head 2023-11-05T08:17:22.667 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:4d4dabf9:::17:head 2023-11-05T08:17:22.667 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:8391935d:::18:head 2023-11-05T08:17:22.668 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:28883081:::19:head 2023-11-05T08:17:22.668 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:69259c59:::20:head 2023-11-05T08:17:22.668 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:4bdb80b7:::21:head 2023-11-05T08:17:22.668 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:a11c5d71:::22:head 2023-11-05T08:17:22.668 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:271af37b:::23:head 2023-11-05T08:17:22.669 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:95b121be:::24:head 2023-11-05T08:17:22.669 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:58d1031b:::25:head 2023-11-05T08:17:22.669 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:0a050783:::26:head 2023-11-05T08:17:22.669 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:c709704c:::27:head 2023-11-05T08:17:22.669 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:cbe56eaf:::28:head 2023-11-05T08:17:22.669 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:86b4b162:::29:head 2023-11-05T08:17:22.670 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:70d89383:::30:head 2023-11-05T08:17:22.670 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:dd450c7c:::31:head 2023-11-05T08:17:22.670 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:6d5729b1:::32:head 2023-11-05T08:17:22.670 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:c388f3fb:::33:head 2023-11-05T08:17:22.670 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:56cfea31:::34:head 2023-11-05T08:17:22.671 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:9dbc1bf7:::35:head 2023-11-05T08:17:22.671 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:40b74ccd:::36:head 2023-11-05T08:17:22.671 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:4d5aaf42:::37:head 2023-11-05T08:17:22.671 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:920f362c:::38:head 2023-11-05T08:17:22.672 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:6cc53222:::39:head 2023-11-05T08:17:22.672 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:9cad833f:::40:head 2023-11-05T08:17:22.672 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:1ea84d41:::41:head 2023-11-05T08:17:22.672 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:c4480ef6:::42:head 2023-11-05T08:17:22.672 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:a694361e:::43:head 2023-11-05T08:17:22.673 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:d1bd33e9:::44:head 2023-11-05T08:17:22.673 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:ddc2cd5d:::45:head 2023-11-05T08:17:22.673 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:2b782207:::46:head 2023-11-05T08:17:22.673 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:7b187fca:::47:head 2023-11-05T08:17:22.673 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:90ecdf6f:::48:head 2023-11-05T08:17:22.674 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:a5ed95fe:::49:head 2023-11-05T08:17:22.674 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:ea0eaa55:::50:head 2023-11-05T08:17:22.674 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:f33ef17b:::51:head 2023-11-05T08:17:22.674 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:a0d1b2f6:::52:head 2023-11-05T08:17:22.674 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:60c5229e:::53:head 2023-11-05T08:17:22.675 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:edcbc575:::54:head 2023-11-05T08:17:22.675 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:102cf253:::55:head 2023-11-05T08:17:22.675 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:efb7fb0b:::56:head 2023-11-05T08:17:22.675 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:50d0a326:::57:head 2023-11-05T08:17:22.675 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:d4dc5daf:::58:head 2023-11-05T08:17:22.676 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:3a130462:::59:head 2023-11-05T08:17:22.676 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:ec87ed71:::60:head 2023-11-05T08:17:22.676 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:d5bc9454:::61:head 2023-11-05T08:17:22.676 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:3ddfe313:::62:head 2023-11-05T08:17:22.677 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:7c2816b9:::63:head 2023-11-05T08:17:22.677 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:47e00e4d:::64:head 2023-11-05T08:17:22.677 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:c6410c18:::65:head 2023-11-05T08:17:22.677 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:b48ed237:::66:head 2023-11-05T08:17:22.677 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:cd63ad31:::67:head 2023-11-05T08:17:22.678 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:b179e92b:::68:head 2023-11-05T08:17:22.678 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:0d9f741a:::69:head 2023-11-05T08:17:22.678 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:6d3352ae:::70:head 2023-11-05T08:17:22.678 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:c6d5c19e:::71:head 2023-11-05T08:17:22.678 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:bc4729c3:::72:head 2023-11-05T08:17:22.679 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:77e930b9:::73:head 2023-11-05T08:17:22.679 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:0abeecfd:::74:head 2023-11-05T08:17:22.679 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:b7c37e15:::75:head 2023-11-05T08:17:22.679 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:b6378398:::76:head 2023-11-05T08:17:22.679 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:02bd68de:::77:head 2023-11-05T08:17:22.680 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:cc795d2d:::78:head 2023-11-05T08:17:22.680 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:630d4fea:::79:head 2023-11-05T08:17:22.680 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:e0d29ef5:::80:head 2023-11-05T08:17:22.680 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:fd6f13d2:::81:head 2023-11-05T08:17:22.680 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:606461d5:::82:head 2023-11-05T08:17:22.680 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:eadbdc43:::83:head 2023-11-05T08:17:22.681 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:8761d0bb:::84:head 2023-11-05T08:17:22.681 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:9ef0186f:::85:head 2023-11-05T08:17:22.681 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:e0d41294:::86:head 2023-11-05T08:17:22.681 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:961de695:::87:head 2023-11-05T08:17:22.681 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:1423148f:::88:head 2023-11-05T08:17:22.682 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:633a8fa2:::89:head 2023-11-05T08:17:22.682 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:a8653809:::90:head 2023-11-05T08:17:22.682 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:3dac8b33:::91:head 2023-11-05T08:17:22.682 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:35aad435:::92:head 2023-11-05T08:17:22.682 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:f6dcc343:::93:head 2023-11-05T08:17:22.683 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:dbbdad87:::94:head 2023-11-05T08:17:22.683 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:1cb48ce0:::95:head 2023-11-05T08:17:22.683 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:03cd461c:::96:head 2023-11-05T08:17:22.683 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:17a4ea99:::97:head 2023-11-05T08:17:22.683 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:9993c9a7:::98:head 2023-11-05T08:17:22.684 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:6394211c:::99:head 2023-11-05T08:17:22.684 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:94c7ae57:::100:head 2023-11-05T08:17:22.684 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:6fdee5bb:::101:head 2023-11-05T08:17:22.684 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:9a477fd1:::102:head 2023-11-05T08:17:22.684 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:eb850916:::103:head 2023-11-05T08:17:22.685 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:affc56b9:::104:head 2023-11-05T08:17:22.685 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:b42dc814:::105:head 2023-11-05T08:17:22.685 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:f319f8f0:::106:head 2023-11-05T08:17:22.685 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:9a40b9de:::107:head 2023-11-05T08:17:22.685 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:8b524f28:::108:head 2023-11-05T08:17:22.686 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:e3de589f:::109:head 2023-11-05T08:17:22.686 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:90f90a5b:::110:head 2023-11-05T08:17:22.686 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:a7b4f1d7:::111:head 2023-11-05T08:17:22.686 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:af51766e:::112:head 2023-11-05T08:17:22.686 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:b6f90bd1:::113:head 2023-11-05T08:17:22.687 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:e0261208:::114:head 2023-11-05T08:17:22.687 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:c9569ef7:::115:head 2023-11-05T08:17:22.687 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:61bebe50:::116:head 2023-11-05T08:17:22.687 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:fe93412b:::117:head 2023-11-05T08:17:22.687 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:d3d38bee:::118:head 2023-11-05T08:17:22.688 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:3100ba0c:::119:head 2023-11-05T08:17:22.688 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:d0560ada:::120:head 2023-11-05T08:17:22.688 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:f0ea8b35:::121:head 2023-11-05T08:17:22.688 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:766f231a:::122:head 2023-11-05T08:17:22.688 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:a07a2582:::123:head 2023-11-05T08:17:22.689 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:bd7c6b3a:::124:head 2023-11-05T08:17:22.689 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:fb2ddaff:::125:head 2023-11-05T08:17:22.689 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:4408e1fe:::126:head 2023-11-05T08:17:22.689 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:ee1df7a7:::127:head 2023-11-05T08:17:22.689 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:c3002909:::128:head 2023-11-05T08:17:22.690 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:4f48ffa9:::129:head 2023-11-05T08:17:22.690 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:edf38733:::130:head 2023-11-05T08:17:22.690 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:c08425c0:::131:head 2023-11-05T08:17:22.690 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:5f902d98:::132:head 2023-11-05T08:17:22.690 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:41ea2c93:::133:head 2023-11-05T08:17:22.691 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:813cee13:::134:head 2023-11-05T08:17:22.691 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:0131818d:::135:head 2023-11-05T08:17:22.691 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:26ba5a85:::136:head 2023-11-05T08:17:22.691 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:381b8a5a:::137:head 2023-11-05T08:17:22.691 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:28797e47:::138:head 2023-11-05T08:17:22.692 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:bfca7f22:::139:head 2023-11-05T08:17:22.692 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:36807075:::140:head 2023-11-05T08:17:22.692 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:80b03975:::141:head 2023-11-05T08:17:22.692 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:5c15709b:::142:head 2023-11-05T08:17:22.692 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:f39ea15e:::143:head 2023-11-05T08:17:22.693 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:ea992956:::144:head 2023-11-05T08:17:22.693 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:48887b1c:::145:head 2023-11-05T08:17:22.693 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:9f24a9dd:::146:head 2023-11-05T08:17:22.693 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:987f100b:::147:head 2023-11-05T08:17:22.693 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:d2dd3581:::148:head 2023-11-05T08:17:22.694 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:7fed1808:::149:head 2023-11-05T08:17:22.694 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:c80b70e9:::150:head 2023-11-05T08:17:22.694 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:85ed90f9:::151:head 2023-11-05T08:17:22.694 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:36428b24:::152:head 2023-11-05T08:17:22.694 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:d044c34a:::153:head 2023-11-05T08:17:22.695 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:7c18bf58:::154:head 2023-11-05T08:17:22.695 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:d1c21232:::155:head 2023-11-05T08:17:22.695 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:a7a3c575:::156:head 2023-11-05T08:17:22.695 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:87da0633:::157:head 2023-11-05T08:17:22.695 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:d5ac3822:::158:head 2023-11-05T08:17:22.696 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:3f20522d:::159:head 2023-11-05T08:17:22.696 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:6ca26563:::160:head 2023-11-05T08:17:22.696 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:532ce135:::161:head 2023-11-05T08:17:22.696 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:c78863e6:::162:head 2023-11-05T08:17:33.278 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:11:36.394 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:17:33.280 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:11:36.396 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:17:33.348 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:11:36.423 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:17:33.351 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:11:36.426 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:17:33.353 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:11:36.469 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:17:33.353 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:11:36.469 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:17:33.357 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:11:36.473 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:17:33.381 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:11:36.455 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:17:33.390 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:11:36.506 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:17:53.183 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:11:56.299 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:17:53.189 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:11:56.305 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:17:53.215 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:11:56.330 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:17:53.234 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:11:56.308 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:17:53.237 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:11:56.312 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:17:53.258 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:11:56.373 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:17:53.262 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:11:56.378 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:17:53.270 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:11:56.345 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:17:53.295 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:11:56.410 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:17:58.206 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:12:01.322 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:17:58.209 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:12:01.325 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:17:58.224 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:12:01.340 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:17:58.262 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:12:01.336 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:17:58.263 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:12:01.379 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:17:58.265 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:12:01.339 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:17:58.265 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:12:01.381 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:17:58.279 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:12:01.353 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:17:58.281 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:12:01.396 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:18:13.289 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:12:16.405 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:18:13.290 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:12:16.406 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:18:13.320 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:12:16.435 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:18:13.330 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:12:16.404 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:18:13.331 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:12:16.405 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:18:13.337 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:12:16.453 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:18:13.339 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:12:16.455 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:18:13.358 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:12:16.433 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:18:13.378 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:12:16.494 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:18:14.068 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:12:17.142 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:18:14.069 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:12:17.144 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:18:14.078 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:12:17.153 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:18:14.155 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:12:17.270 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:18:14.156 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:12:17.272 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:18:14.156 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:12:17.272 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:18:14.157 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:12:17.273 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:18:14.165 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:12:17.281 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:18:14.167 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:12:17.283 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:18:28.330 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:12:31.446 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:18:28.336 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:12:31.452 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:18:28.356 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:12:31.472 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:18:28.386 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:12:31.460 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:18:28.387 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:12:31.502 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:18:28.389 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:12:31.464 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:18:28.392 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:12:31.508 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:18:28.412 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:12:31.487 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:18:28.413 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:12:31.528 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:18:31.979 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:7462ddf6:::163:head 2023-11-05T08:18:31.980 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:5d165639:::164:head 2023-11-05T08:18:31.980 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:f43765fc:::165:head 2023-11-05T08:18:31.980 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:b4c720e9:::166:head 2023-11-05T08:18:31.980 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:e694b040:::167:head 2023-11-05T08:18:31.980 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:afa38db2:::168:head 2023-11-05T08:18:31.981 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:77ba9f53:::169:head 2023-11-05T08:18:31.981 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:87495034:::170:head 2023-11-05T08:18:31.981 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:7c96bf0e:::171:head 2023-11-05T08:18:31.981 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:dbe346cc:::172:head 2023-11-05T08:18:31.981 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:e943ec24:::173:head 2023-11-05T08:18:31.981 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:f97a9c0c:::174:head 2023-11-05T08:18:31.982 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:6f26e74d:::175:head 2023-11-05T08:18:31.982 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:4f95e106:::176:head 2023-11-05T08:18:31.982 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:0e6f2f8f:::177:head 2023-11-05T08:18:31.982 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:05db05f1:::178:head 2023-11-05T08:18:31.983 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:38a78d66:::179:head 2023-11-05T08:18:31.983 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:d095610b:::180:head 2023-11-05T08:18:31.983 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:a1a9d709:::181:head 2023-11-05T08:18:31.983 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:1e5d39db:::182:head 2023-11-05T08:18:31.983 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:f7df4fb9:::183:head 2023-11-05T08:18:31.984 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:03a7f161:::184:head 2023-11-05T08:18:31.984 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:ba70721e:::185:head 2023-11-05T08:18:31.984 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:28e5662d:::186:head 2023-11-05T08:18:31.984 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:973d52de:::187:head 2023-11-05T08:18:31.984 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:4303eb1c:::188:head 2023-11-05T08:18:31.984 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:b990b48e:::189:head 2023-11-05T08:18:31.985 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:29b8165b:::190:head 2023-11-05T08:18:31.985 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:3547f197:::191:head 2023-11-05T08:18:31.985 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:7e260936:::192:head 2023-11-05T08:18:31.985 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:1abec7b1:::193:head 2023-11-05T08:18:31.985 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:10fdda93:::194:head 2023-11-05T08:18:31.986 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:15817eea:::195:head 2023-11-05T08:18:31.986 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:770bab57:::196:head 2023-11-05T08:18:31.986 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:ed9e13e7:::197:head 2023-11-05T08:18:31.986 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:71471a8f:::198:head 2023-11-05T08:18:31.986 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: checking for 201:10fb1d02:::199:head 2023-11-05T08:18:31.987 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.HitSetWrite (22871 ms) 2023-11-05T08:18:31.987 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HitSetTrim 2023-11-05T08:18:31.987 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: got ls 1699172261,0 2023-11-05T08:18:31.987 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: first is 1699172261 2023-11-05T08:18:31.987 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: got ls 1699172261,0 2023-11-05T08:18:31.987 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: got ls 1699172261,0 2023-11-05T08:18:31.988 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: got ls 1699172261,1699172263,1699172264,0 2023-11-05T08:18:31.988 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: got ls 1699172261,1699172263,1699172264,0 2023-11-05T08:18:31.988 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: got ls 1699172261,1699172263,1699172264,0 2023-11-05T08:18:31.988 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: got ls 1699172261,1699172263,1699172264,1699172266,1699172267,0 2023-11-05T08:18:31.988 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: got ls 1699172261,1699172263,1699172264,1699172266,1699172267,0 2023-11-05T08:18:31.989 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: got ls 1699172261,1699172263,1699172264,1699172266,1699172267,0 2023-11-05T08:18:31.989 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: got ls 1699172261,1699172263,1699172264,1699172266,1699172267,1699172269,1699172270,0 2023-11-05T08:18:31.989 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: got ls 1699172261,1699172263,1699172264,1699172266,1699172267,1699172269,1699172270,0 2023-11-05T08:18:31.989 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: got ls 1699172261,1699172263,1699172264,1699172266,1699172267,1699172269,1699172270,0 2023-11-05T08:18:31.989 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: got ls 1699172264,1699172266,1699172267,1699172269,1699172270,1699172272,1699172273,0 2023-11-05T08:18:31.989 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: first now 1699172264, trimmed 2023-11-05T08:18:31.990 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.HitSetTrim (22865 ms) 2023-11-05T08:18:31.990 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteOn2ndRead 2023-11-05T08:18:31.990 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: foo0 2023-11-05T08:18:31.990 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: verifying foo0 is eventually promoted 2023-11-05T08:18:31.990 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PromoteOn2ndRead (14667 ms) 2023-11-05T08:18:31.991 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ProxyRead 2023-11-05T08:18:33.358 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:12:36.473 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:18:33.366 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:12:36.481 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:18:33.401 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:12:36.516 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:18:33.413 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:12:36.488 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:18:33.415 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:12:36.490 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:18:33.418 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:12:36.534 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:18:33.422 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:12:36.538 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:18:33.430 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:12:36.505 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:18:33.438 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:12:36.554 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:18:43.330 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:12:46.446 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:18:43.397 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:12:46.513 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:18:43.436 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:12:46.551 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:18:43.446 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:12:46.562 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:18:43.448 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:12:46.522 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:18:43.450 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:12:46.566 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:18:43.452 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:12:46.527 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:18:43.473 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:12:46.589 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:18:43.475 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:12:46.550 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:18:53.381 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:12:56.496 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:18:53.450 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:12:56.566 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:18:53.471 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:12:56.586 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:18:53.485 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:12:56.601 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:18:53.487 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:12:56.562 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:18:53.488 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:12:56.604 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:18:53.491 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:12:56.566 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:18:53.502 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:12:56.618 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:18:53.509 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:12:56.584 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:18:58.603 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:13:01.719 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:18:58.612 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:13:01.728 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:18:58.637 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:13:01.753 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:18:58.663 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:13:01.738 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:18:58.670 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:13:01.745 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:18:58.671 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:13:01.787 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:18:58.674 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:13:01.790 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:18:58.687 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:13:01.762 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:18:58.693 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:13:01.809 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:19:13.494 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:13:16.610 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:19:13.545 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:13:16.620 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:19:13.546 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:13:16.621 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:19:13.548 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:13:16.664 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:19:13.549 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:13:16.665 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:19:13.550 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:13:16.666 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:19:13.589 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:13:16.704 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:19:13.589 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:13:16.664 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:19:13.616 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:13:16.731 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:19:14.406 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:13:17.480 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:19:14.407 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:13:17.482 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:19:14.418 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:13:17.492 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:19:14.471 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:13:17.587 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:19:14.472 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:13:17.588 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:19:14.483 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:13:17.598 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:19:14.590 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:13:17.706 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:19:14.591 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:13:17.707 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:19:14.600 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:13:17.716 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:19:28.729 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:13:31.844 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:19:28.734 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:13:31.850 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:19:28.762 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:13:31.878 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:19:28.778 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:13:31.852 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:19:28.838 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:13:31.853 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:19:28.838 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:13:31.879 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:19:28.838 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:13:31.907 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:19:28.839 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:13:31.909 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:19:28.839 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:13:31.946 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:19:33.618 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:13:36.733 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:19:33.626 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:13:36.742 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:19:33.639 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:13:36.755 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:19:33.677 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:13:36.792 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:19:33.679 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:13:36.795 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:19:33.680 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:13:36.754 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:19:33.683 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:13:36.758 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:19:33.692 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:13:36.808 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:19:33.693 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:13:36.768 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:19:48.831 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:13:51.947 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:19:48.835 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:13:51.950 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:19:48.852 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:13:51.968 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:19:48.878 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:13:51.952 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:19:48.880 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:13:51.954 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:19:48.896 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:13:51.971 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:19:48.898 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:13:52.014 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:19:48.902 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:13:52.018 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:19:48.920 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:13:52.036 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:19:53.702 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:13:56.817 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:19:53.706 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:13:56.822 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:19:53.720 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:13:56.836 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:19:53.746 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:13:56.821 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:19:53.750 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:13:56.824 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:19:53.762 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:13:56.836 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:19:53.770 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:13:56.886 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:19:53.773 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:13:56.889 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:19:53.784 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:13:56.900 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:20:13.866 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:14:16.982 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:20:13.919 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:14:16.993 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:20:13.921 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:14:17.036 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:20:13.922 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:14:16.996 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:20:13.922 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:14:17.038 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:20:13.944 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:14:17.059 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:20:13.954 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:14:17.070 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:20:13.957 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:14:17.031 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:20:13.982 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:14:17.098 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:20:19.019 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:14:22.135 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:20:19.020 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:14:22.136 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:20:19.042 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:14:22.157 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:20:19.080 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:14:22.154 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:20:19.081 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:14:22.156 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:20:19.083 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:14:22.199 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:20:19.087 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:14:22.202 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:20:19.101 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:14:22.175 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:20:19.110 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:14:22.225 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:20:19.773 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:14:22.848 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:20:19.778 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:14:22.852 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:20:19.866 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:14:22.940 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:20:19.928 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:14:23.044 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:20:19.930 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:14:23.046 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:20:19.933 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:14:23.048 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:20:19.948 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:14:23.063 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:20:19.950 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:14:23.065 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:20:19.979 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:14:23.095 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:20:34.068 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:14:37.184 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:20:34.072 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:14:37.188 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:20:34.097 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:14:37.171 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:20:34.100 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:14:37.175 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:20:34.102 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:14:37.218 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:20:34.124 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:14:37.240 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:20:34.126 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:14:37.201 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:20:34.127 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:14:37.242 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:20:34.160 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:14:37.276 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:20:34.644 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:14:37.718 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:20:34.645 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:14:37.720 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:20:34.653 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:14:37.727 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:20:34.680 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:14:37.796 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:20:34.682 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:14:37.797 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:20:34.691 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:14:37.806 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:20:34.733 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:14:37.849 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:20:34.734 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:14:37.850 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:20:34.743 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:14:37.859 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:20:54.117 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:14:57.233 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:20:54.120 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:14:57.236 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:20:54.155 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:14:57.270 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:20:54.165 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:14:57.239 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:20:54.167 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:14:57.283 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:20:54.167 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:14:57.242 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:20:54.170 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:14:57.286 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:20:54.184 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:14:57.259 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:20:54.190 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:14:57.306 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:20:54.791 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:14:57.865 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:20:54.792 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:14:57.866 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:20:54.801 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:14:57.875 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:20:54.824 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:14:57.940 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:20:54.825 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:14:57.941 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:20:54.835 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:14:57.951 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:20:54.852 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:14:57.968 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:20:54.853 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:14:57.969 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:20:54.863 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:14:57.979 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:21:09.155 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:15:12.270 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:21:09.159 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:15:12.275 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:21:09.182 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:15:12.297 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:21:09.209 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:15:12.283 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:21:09.210 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:15:12.284 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:21:09.210 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:15:12.326 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:21:09.213 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:15:12.329 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:21:09.228 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:15:12.303 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:21:09.235 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:15:12.351 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:21:14.176 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:15:17.292 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:21:14.179 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:15:17.295 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:21:14.192 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:15:17.308 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:21:14.223 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:15:17.298 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:21:14.225 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:15:17.300 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:21:14.238 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:15:17.312 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:21:14.244 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:15:17.360 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:21:14.246 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:15:17.361 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:21:14.259 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:15:17.375 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:21:24.298 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:15:27.414 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:21:24.300 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:15:27.416 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:21:24.343 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:15:27.458 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:21:24.353 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:15:27.427 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:21:24.354 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:15:27.429 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:21:24.359 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:15:27.475 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:21:24.361 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:15:27.477 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:21:24.377 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:15:27.452 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:21:24.383 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:15:27.498 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:21:30.364 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:15:33.480 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:21:30.397 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:15:33.513 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:21:30.420 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:15:33.535 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:21:30.424 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:15:33.499 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:21:30.425 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:15:33.500 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:21:30.436 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:15:33.552 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:21:30.438 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:15:33.553 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:21:30.443 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:15:33.518 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:21:30.457 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:15:33.572 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:21:34.236 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:15:37.352 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:21:34.238 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:15:37.354 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:21:34.251 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:15:37.367 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:21:34.285 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:15:37.359 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:21:34.288 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:15:37.362 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:21:34.288 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:15:37.404 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:21:34.290 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:15:37.406 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:21:34.299 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:15:37.373 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:21:34.301 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:15:37.417 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:21:39.253 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:15:42.368 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:21:39.256 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:15:42.371 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:21:39.268 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:15:42.384 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:21:39.301 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:15:42.375 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:21:39.305 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:15:42.420 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:21:39.305 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:15:42.379 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:21:39.310 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:15:42.426 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:21:39.315 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:15:42.390 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:21:39.321 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:15:42.437 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:21:49.413 INFO:tasks.ceph.osd.4.smithi156.stderr:2023-11-05T08:21:49.394+0000 22288640 -1 snap_mapper.add_oid found existing snaps mapped on 219:8349fa03:test-rados-api-smithi052-91894-80::foo:2, removing 2023-11-05T08:21:49.424 INFO:tasks.ceph.osd.2.smithi052.stderr:2023-11-05T08:21:49.416+0000 2568e640 -1 snap_mapper.add_oid found existing snaps mapped on 219:8349fa03:test-rados-api-smithi052-91894-80::foo:2, removing 2023-11-05T08:21:54.329 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:15:57.445 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:21:54.331 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:15:57.447 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:21:54.352 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:15:57.468 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:21:54.380 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:15:57.455 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:21:54.382 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:15:57.457 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:21:54.385 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:15:57.501 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:21:54.388 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:15:57.504 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:21:54.399 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:15:57.474 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:21:54.408 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:15:57.523 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:21:59.318 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:16:02.433 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:21:59.320 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:16:02.436 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:21:59.336 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:16:02.452 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:21:59.367 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:16:02.442 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:21:59.368 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:16:02.443 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:21:59.380 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:16:02.455 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:21:59.386 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:16:02.502 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:21:59.389 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:16:02.505 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:21:59.409 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:16:02.525 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:22:14.478 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:16:17.594 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:22:14.481 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:16:17.597 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:22:14.521 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:16:17.637 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:22:14.528 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:16:17.603 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:22:14.532 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:16:17.607 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:22:14.554 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:16:17.669 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:22:14.557 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:16:17.672 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:22:14.566 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:16:17.641 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:22:14.594 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:16:17.710 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:22:15.105 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:16:18.179 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:22:15.106 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:16:18.180 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:22:15.115 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:16:18.190 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:22:15.133 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:16:18.248 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:22:15.134 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:16:18.249 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:22:15.143 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:16:18.259 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:22:15.171 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:16:18.287 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:22:15.174 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:16:18.289 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:22:15.189 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:16:18.305 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:22:27.648 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ProxyRead (21880 ms) 2023-11-05T08:22:27.649 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.CachePin 2023-11-05T08:22:27.649 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.CachePin (26065 ms) 2023-11-05T08:22:27.649 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.SetRedirectRead 2023-11-05T08:22:27.649 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.SetRedirectRead (3729 ms) 2023-11-05T08:22:27.649 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestPromoteRead 2023-11-05T08:22:27.650 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: require_osd_release = reef 2023-11-05T08:22:27.650 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestPromoteRead (4507 ms) 2023-11-05T08:22:27.650 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestRefRead 2023-11-05T08:22:27.650 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestRefRead (4339 ms) 2023-11-05T08:22:27.650 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestUnset 2023-11-05T08:22:27.651 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: require_osd_release = reef 2023-11-05T08:22:27.651 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestUnset (4719 ms) 2023-11-05T08:22:27.651 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestDedupRefRead 2023-11-05T08:22:27.651 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: require_osd_release = reef 2023-11-05T08:22:27.651 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestDedupRefRead (5287 ms) 2023-11-05T08:22:27.651 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapRefcount 2023-11-05T08:22:27.652 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: require_osd_release = reef 2023-11-05T08:22:27.652 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestSnapRefcount (40306 ms) 2023-11-05T08:22:27.652 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapRefcount2 2023-11-05T08:22:27.652 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: require_osd_release = reef 2023-11-05T08:22:27.652 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestSnapRefcount2 (17688 ms) 2023-11-05T08:22:27.653 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestTestSnapCreate 2023-11-05T08:22:27.653 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: require_osd_release = reef 2023-11-05T08:22:27.653 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestTestSnapCreate (5427 ms) 2023-11-05T08:22:27.653 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestRedirectAfterPromote 2023-11-05T08:22:27.653 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: require_osd_release = reef 2023-11-05T08:22:27.653 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestRedirectAfterPromote (4369 ms) 2023-11-05T08:22:27.654 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestCheckRefcountWhenModification 2023-11-05T08:22:27.654 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: require_osd_release = reef 2023-11-05T08:22:27.654 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestCheckRefcountWhenModification (27270 ms) 2023-11-05T08:22:27.654 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapIncCount 2023-11-05T08:22:27.654 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: require_osd_release = reef 2023-11-05T08:22:27.655 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestSnapIncCount (16961 ms) 2023-11-05T08:22:27.655 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestEvict 2023-11-05T08:22:27.655 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: require_osd_release = reef 2023-11-05T08:22:27.655 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestEvict (6563 ms) 2023-11-05T08:22:27.655 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestEvictPromote 2023-11-05T08:22:27.656 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: require_osd_release = reef 2023-11-05T08:22:27.656 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestEvictPromote (5015 ms) 2023-11-05T08:22:27.656 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapSizeMismatch 2023-11-05T08:22:27.656 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: require_osd_release = reef 2023-11-05T08:22:27.656 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: waiting for scrubs... 2023-11-05T08:22:27.657 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: done waiting 2023-11-05T08:22:27.657 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestSnapSizeMismatch (26282 ms) 2023-11-05T08:22:27.657 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.DedupFlushRead 2023-11-05T08:22:27.657 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: require_osd_release = reef 2023-11-05T08:22:27.657 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.DedupFlushRead (12475 ms) 2023-11-05T08:22:27.657 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestFlushSnap 2023-11-05T08:22:27.658 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: require_osd_release = reef 2023-11-05T08:22:27.658 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestFlushSnap (11246 ms) 2023-11-05T08:22:27.658 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestFlushDupCount 2023-11-05T08:22:27.658 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: require_osd_release = reef 2023-11-05T08:22:27.658 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestFlushDupCount (10881 ms) 2023-11-05T08:22:27.659 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.TierFlushDuringFlush 2023-11-05T08:22:29.497 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:16:32.613 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:22:29.498 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:16:32.614 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:22:29.526 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:16:32.641 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:22:29.545 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:16:32.620 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:22:29.546 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:16:32.621 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:22:29.553 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:16:32.669 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:22:29.555 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:16:32.671 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:22:29.572 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:16:32.646 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:22:29.583 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:16:32.699 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:22:39.644 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:16:42.759 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:22:39.646 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:16:42.762 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:22:39.671 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:16:42.787 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:22:39.688 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:16:42.763 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:22:39.690 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:16:42.765 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:22:39.695 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:16:42.811 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:22:39.696 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:16:42.812 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:22:39.717 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:16:42.792 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:22:39.722 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:16:42.838 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:22:44.786 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:16:47.901 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:22:44.788 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:16:47.904 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:22:44.829 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:16:47.945 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:22:44.844 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:16:47.918 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:22:44.845 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:16:47.920 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:22:44.857 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:16:47.973 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:22:44.862 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:16:47.937 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:22:44.865 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:16:47.981 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:22:44.887 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:16:48.003 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:22:59.679 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:17:02.795 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:22:59.682 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:17:02.798 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:22:59.709 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:17:02.824 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:22:59.727 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:17:02.802 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:22:59.731 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:17:02.805 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:22:59.734 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:17:02.850 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:22:59.735 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:17:02.851 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:22:59.754 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:17:02.829 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:22:59.759 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:17:02.875 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:23:00.270 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:17:03.345 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:23:00.271 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:17:03.346 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:23:00.279 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:17:03.354 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:23:00.304 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:17:03.419 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:23:00.305 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:17:03.421 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:23:00.314 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:17:03.430 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:23:00.355 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:17:03.470 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:23:00.356 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:17:03.471 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:23:00.364 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:17:03.480 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:23:19.714 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:17:22.829 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:23:19.716 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:17:22.832 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:23:19.754 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:17:22.869 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:23:19.777 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:17:22.852 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:23:19.783 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:17:22.899 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:23:19.784 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:17:22.859 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:23:19.787 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:17:22.903 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:23:19.810 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:17:22.926 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:23:19.811 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:17:22.886 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:23:24.853 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:17:27.969 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:23:24.856 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:17:27.972 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:23:24.868 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:17:27.983 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:23:24.899 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:17:27.974 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:23:24.901 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:17:27.975 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:23:24.904 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:17:28.020 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:23:24.914 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:17:28.030 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:23:24.914 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:17:27.989 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:23:24.931 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:17:28.047 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:23:31.118 INFO:tasks.ceph.osd.1.smithi052.stderr:2023-11-05T08:23:31.110+0000 21e87640 -1 snap_mapper.add_oid found existing snaps mapped on 64:1adbacda:test-rados-api-smithi052-91894-97::foo:31, removing 2023-11-05T08:23:31.128 INFO:tasks.ceph.osd.2.smithi052.stderr:2023-11-05T08:23:31.121+0000 24e8d640 -1 snap_mapper.add_oid found existing snaps mapped on 64:1adbacda:test-rados-api-smithi052-91894-97::foo:31, removing 2023-11-05T08:23:34.754 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:17:37.870 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:23:34.757 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:17:37.873 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:23:34.771 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:17:37.887 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:23:34.802 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:17:37.876 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:23:34.803 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:17:37.878 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:23:34.807 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:17:37.923 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:23:34.808 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:17:37.924 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:23:34.816 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:17:37.891 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:23:34.823 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:17:37.938 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:23:44.917 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:17:48.033 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:23:44.919 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:17:48.035 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:23:44.954 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:17:48.070 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:23:44.967 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:17:48.041 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:23:44.970 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:17:48.045 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:23:44.986 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:17:48.102 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:23:44.990 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:17:48.106 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:23:44.994 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:17:48.069 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:23:45.016 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:17:48.131 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:23:47.792 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:17:50.908 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:23:47.797 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:17:50.913 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:23:47.818 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:17:50.933 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:23:47.858 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:17:50.932 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:23:47.874 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:17:50.949 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:23:47.876 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:17:50.992 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:23:47.884 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:17:50.999 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:23:47.890 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:17:50.965 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:23:47.900 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:17:51.016 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:23:49.895 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:17:53.010 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:23:49.900 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:17:53.016 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:23:49.911 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:17:53.027 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:23:49.945 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:17:53.060 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:23:49.947 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:17:53.022 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:23:49.949 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:17:53.065 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:23:49.955 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:17:53.030 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:23:49.963 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:17:53.079 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:23:49.965 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:17:53.040 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:24:04.871 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:18:07.986 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:24:04.873 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:18:07.989 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:24:04.901 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:18:08.017 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:24:04.924 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:18:08.040 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:24:04.925 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:18:08.041 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:24:04.926 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:18:08.000 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:24:04.929 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:18:08.004 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:24:04.957 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:18:08.072 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:24:05.009 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:18:08.083 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:24:05.572 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:18:08.646 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:24:05.572 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:18:08.647 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:24:05.582 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:18:08.656 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:24:05.649 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:18:08.764 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:24:05.650 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:18:08.765 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:24:05.651 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:18:08.767 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:24:05.653 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:18:08.769 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:24:05.659 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:18:08.775 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:24:05.664 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:18:08.780 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:24:09.987 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:18:13.102 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:24:09.994 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:18:13.110 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:24:10.010 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:18:13.126 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:24:10.039 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:18:13.114 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:24:10.042 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:18:13.117 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:24:10.048 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:18:13.164 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:24:10.051 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:18:13.167 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:24:10.057 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:18:13.132 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:24:10.068 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:18:13.184 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:24:20.123 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:18:23.239 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:24:20.125 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:18:23.241 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:24:20.154 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:18:23.269 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:24:20.175 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:18:23.249 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:24:20.176 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:18:23.250 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:24:20.178 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:18:23.294 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:24:20.179 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:18:23.295 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:24:20.198 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:18:23.273 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:24:20.203 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:18:23.319 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:24:25.040 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:18:28.156 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:24:25.043 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:18:28.159 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:24:25.061 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:18:28.176 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:24:25.090 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:18:28.165 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:24:25.091 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:18:28.166 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:24:25.095 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:18:28.210 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:24:25.097 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:18:28.213 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:24:25.104 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:18:28.179 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:24:25.112 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:18:28.228 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:24:35.133 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:18:38.248 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:24:35.134 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:18:38.250 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:24:35.158 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:18:38.274 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:24:35.176 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:18:38.251 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:24:35.179 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:18:38.254 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:24:35.184 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:18:38.300 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:24:35.185 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:18:38.301 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:24:35.203 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:18:38.278 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:24:35.227 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:18:38.343 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:24:45.164 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:18:48.280 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:24:45.169 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:18:48.285 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:24:45.195 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:18:48.311 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:24:45.214 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:18:48.288 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:24:45.216 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:18:48.291 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:24:45.238 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:18:48.354 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:24:45.239 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:18:48.314 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:24:45.240 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:18:48.356 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:24:45.284 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:18:48.400 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:24:55.209 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:18:58.325 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:24:55.212 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:18:58.328 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:24:55.236 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:18:58.352 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:24:55.253 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:18:58.327 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:24:55.257 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:18:58.332 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:24:55.265 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:18:58.381 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:24:55.266 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:18:58.382 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:24:55.280 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:18:58.355 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:24:55.291 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:18:58.407 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:25:05.229 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:19:08.345 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:25:05.231 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:19:08.347 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:25:05.254 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:19:08.370 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:25:05.284 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:19:08.358 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:25:05.286 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:19:08.360 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:25:05.302 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:19:08.418 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:25:05.303 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:19:08.419 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:25:05.308 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:19:08.383 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:25:05.326 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:19:08.442 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:25:10.242 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:19:13.358 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:25:10.245 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:19:13.360 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:25:10.262 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:19:13.378 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:25:10.299 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:19:13.373 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:25:10.302 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:19:13.377 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:25:10.314 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:19:13.430 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:25:10.317 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:19:13.432 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:25:10.319 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:19:13.394 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:25:10.333 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:19:13.448 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:25:25.296 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:19:28.412 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:25:25.299 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:19:28.414 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:25:25.319 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:19:28.435 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:25:25.342 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:19:28.416 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:25:25.347 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:19:28.421 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:25:25.350 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:19:28.466 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:25:25.352 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:19:28.468 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:25:25.367 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:19:28.442 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:25:25.383 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:19:28.498 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:25:25.925 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:19:28.999 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:25:25.925 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:19:29.000 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:25:25.933 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:19:29.008 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:25:25.998 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:19:29.114 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:25:25.999 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:19:29.115 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:25:26.000 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:19:29.115 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:25:26.001 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:19:29.117 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:25:26.008 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:19:29.124 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:25:26.009 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:19:29.125 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:25:40.452 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:19:43.568 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:25:40.456 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:19:43.572 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:25:40.480 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:19:43.595 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:25:40.508 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:19:43.624 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:25:40.510 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:19:43.626 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:25:40.511 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:19:43.585 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:25:40.514 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:19:43.589 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:25:40.537 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:19:43.611 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:25:40.542 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:19:43.658 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:25:45.517 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:19:48.633 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:25:45.519 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:19:48.635 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:25:45.538 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:19:48.654 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:25:45.566 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:19:48.641 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:25:45.572 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:19:48.647 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:25:45.588 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:19:48.704 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:25:45.591 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:19:48.707 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:25:45.591 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:19:48.666 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:25:45.606 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:19:48.722 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:25:48.145 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:19:51.261 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:25:48.154 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:19:51.270 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:25:48.186 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:19:51.302 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:25:48.212 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:19:51.286 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:25:48.213 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:19:51.288 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:25:48.225 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:19:51.341 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:25:48.228 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:19:51.303 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:25:48.232 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:19:51.348 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:25:48.253 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:19:51.369 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:25:55.396 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:19:58.512 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:25:55.399 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:19:58.515 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:25:55.425 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:19:58.541 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:25:55.445 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:19:58.519 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:25:55.445 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:19:58.520 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:25:55.462 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:19:58.537 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:25:55.470 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:19:58.586 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:25:55.471 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:19:58.587 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:25:55.489 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:19:58.605 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:26:05.561 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:20:08.676 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:26:05.618 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:20:08.733 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:26:05.659 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:20:08.775 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:26:05.679 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:20:08.754 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:26:05.685 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:20:08.760 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:26:05.686 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:20:08.802 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:26:05.690 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:20:08.806 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:26:05.722 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:20:08.797 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:26:05.724 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:20:08.840 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:26:10.465 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:20:13.580 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:26:10.467 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:20:13.583 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:26:10.487 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:20:13.603 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:26:10.511 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:20:13.586 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:26:10.512 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:20:13.587 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:26:10.521 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:20:13.636 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:26:10.524 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:20:13.640 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:26:10.525 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:20:13.600 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:26:10.538 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:20:13.654 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:26:24.365 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: require_osd_release = reef 2023-11-05T08:26:24.365 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.TierFlushDuringFlush (11653 ms) 2023-11-05T08:26:24.365 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapHasChunk 2023-11-05T08:26:24.365 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: require_osd_release = reef 2023-11-05T08:26:24.366 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestSnapHasChunk (7694 ms) 2023-11-05T08:26:24.366 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestRollback 2023-11-05T08:26:24.366 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: require_osd_release = reef 2023-11-05T08:26:24.366 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestRollback (5159 ms) 2023-11-05T08:26:24.366 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestRollbackRefcount 2023-11-05T08:26:24.367 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: require_osd_release = reef 2023-11-05T08:26:24.367 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestRollbackRefcount (27377 ms) 2023-11-05T08:26:24.367 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestEvictRollback 2023-11-05T08:26:24.367 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: require_osd_release = reef 2023-11-05T08:26:24.367 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestEvictRollback (15805 ms) 2023-11-05T08:26:24.368 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PropagateBaseTierError 2023-11-05T08:26:24.368 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PropagateBaseTierError (13597 ms) 2023-11-05T08:26:24.368 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HelloWriteReturn 2023-11-05T08:26:24.368 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: 00000000 79 6f 75 20 6d 69 67 68 74 20 73 65 65 20 74 68 |you might see th| 2023-11-05T08:26:24.368 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: 00000010 69 73 |is| 2023-11-05T08:26:24.369 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: 00000012 2023-11-05T08:26:24.369 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.HelloWriteReturn (13349 ms) 2023-11-05T08:26:24.369 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.TierFlushDuringUnsetDedupTier 2023-11-05T08:26:24.369 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: require_osd_release = reef 2023-11-05T08:26:24.369 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.TierFlushDuringUnsetDedupTier (6788 ms) 2023-11-05T08:26:24.370 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [----------] 48 tests from LibRadosTwoPoolsPP (882509 ms total) 2023-11-05T08:26:24.370 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: 2023-11-05T08:26:24.370 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [----------] 4 tests from LibRadosTierECPP 2023-11-05T08:26:24.370 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ RUN ] LibRadosTierECPP.Dirty 2023-11-05T08:26:24.370 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ OK ] LibRadosTierECPP.Dirty (1498 ms) 2023-11-05T08:26:24.371 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ RUN ] LibRadosTierECPP.FlushWriteRaces 2023-11-05T08:26:24.371 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ OK ] LibRadosTierECPP.FlushWriteRaces (11938 ms) 2023-11-05T08:26:24.371 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ RUN ] LibRadosTierECPP.CallForcesPromote 2023-11-05T08:26:24.371 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ OK ] LibRadosTierECPP.CallForcesPromote (19990 ms) 2023-11-05T08:26:24.371 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ RUN ] LibRadosTierECPP.HitSetNone 2023-11-05T08:26:24.371 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ OK ] LibRadosTierECPP.HitSetNone (23 ms) 2023-11-05T08:26:24.372 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [----------] 4 tests from LibRadosTierECPP (33449 ms total) 2023-11-05T08:26:24.372 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: 2023-11-05T08:26:24.372 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [----------] 22 tests from LibRadosTwoPoolsECPP 2023-11-05T08:26:24.372 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Overlay 2023-11-05T08:26:24.372 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.Overlay (8320 ms) 2023-11-05T08:26:24.373 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Promote 2023-11-05T08:26:24.373 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.Promote (10000 ms) 2023-11-05T08:26:24.373 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.PromoteSnap 2023-11-05T08:26:24.373 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: waiting for scrub... 2023-11-05T08:26:24.373 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: done waiting 2023-11-05T08:26:24.373 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.PromoteSnap (27761 ms) 2023-11-05T08:26:24.374 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.PromoteSnapTrimRace 2023-11-05T08:26:24.374 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.PromoteSnapTrimRace (10275 ms) 2023-11-05T08:26:24.374 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Whiteout 2023-11-05T08:26:24.374 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.Whiteout (9088 ms) 2023-11-05T08:26:24.374 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Evict 2023-11-05T08:26:24.375 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.Evict (8846 ms) 2023-11-05T08:26:24.375 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.EvictSnap 2023-11-05T08:26:24.375 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.EvictSnap (10920 ms) 2023-11-05T08:26:24.375 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.TryFlush 2023-11-05T08:26:25.597 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:20:28.671 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:26:25.598 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:20:28.714 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:26:25.601 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:20:28.675 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:26:25.607 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:20:28.723 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:26:25.652 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:20:28.768 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:26:25.658 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:20:28.732 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:26:25.662 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:20:28.777 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:26:25.672 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:20:28.787 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:26:25.712 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:20:28.828 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:26:26.130 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:20:29.205 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:26:26.183 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:20:29.257 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:26:26.191 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:20:29.266 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:26:26.229 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:20:29.345 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:26:26.230 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:20:29.346 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:26:26.241 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:20:29.357 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:26:26.261 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:20:29.376 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:26:26.262 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:20:29.378 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:26:26.270 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:20:29.386 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:26:40.585 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:20:43.701 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:26:40.587 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:20:43.703 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:26:40.611 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:20:43.727 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:26:40.634 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:20:43.708 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:26:40.635 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:20:43.751 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:26:40.635 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:20:43.710 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:26:40.638 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:20:43.754 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:26:40.659 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:20:43.734 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:26:40.665 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:20:43.781 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:26:45.687 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:20:48.802 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:26:45.691 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:20:48.807 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:26:45.708 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:20:48.824 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:26:45.738 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:20:48.812 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:26:45.740 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:20:48.815 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:26:45.743 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:20:48.858 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:26:45.744 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:20:48.860 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:26:45.756 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:20:48.831 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:26:45.761 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:20:48.877 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:26:55.678 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:20:58.794 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:26:55.680 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:20:58.796 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:26:55.707 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:20:58.822 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:26:55.724 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:20:58.799 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:26:55.729 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:20:58.803 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:26:55.730 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:20:58.846 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:26:55.738 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:20:58.854 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:26:55.749 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:20:58.824 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:26:55.759 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:20:58.875 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:27:05.953 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:21:09.069 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:27:05.954 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:21:09.028 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:27:05.957 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:21:09.072 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:27:05.957 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:21:09.032 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:27:05.992 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:21:09.066 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:27:05.994 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:21:09.110 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:27:06.036 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:21:09.151 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:27:06.042 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:21:09.158 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:27:06.077 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:21:09.193 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:27:20.843 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:21:23.958 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:27:20.848 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:21:23.964 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:27:20.878 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:21:23.994 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:27:20.898 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:21:24.013 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:27:20.900 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:21:24.016 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:27:20.913 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:21:23.987 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:27:20.914 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:21:23.989 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:27:20.929 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:21:24.045 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:27:20.946 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:21:24.021 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:27:30.882 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:21:33.997 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:27:30.885 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:21:34.000 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:27:30.906 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:21:34.022 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:27:30.921 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:21:33.996 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:27:30.925 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:21:33.999 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:27:30.935 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:21:34.050 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:27:30.936 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:21:34.052 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:27:30.946 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:21:34.020 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:27:30.958 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:21:34.074 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:27:35.918 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:21:39.033 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:27:35.923 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:21:39.039 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:27:35.945 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:21:39.060 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:27:35.974 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:21:39.048 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:27:35.979 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:21:39.054 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:27:35.988 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:21:39.103 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:27:35.997 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:21:39.072 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:27:35.998 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:21:39.113 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:27:36.022 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:21:39.138 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:27:45.896 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:21:49.011 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:27:45.948 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:21:49.063 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:27:45.949 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:21:49.023 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:27:45.952 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:21:49.026 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:27:45.956 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:21:49.071 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:27:45.974 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:21:49.049 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:27:45.986 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:21:49.102 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:27:46.015 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:21:49.131 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:27:46.040 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:21:49.155 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:27:50.954 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:21:54.069 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:27:50.954 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:21:54.028 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:27:50.958 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:21:54.074 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:27:50.958 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:21:54.033 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:27:50.971 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:21:54.046 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:27:50.973 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:21:54.089 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:27:51.006 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:21:54.122 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:27:51.010 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:21:54.126 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:27:51.020 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:21:54.136 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:27:51.500 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:21:54.574 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:27:51.503 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:21:54.577 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:27:51.511 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:21:54.585 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:27:51.575 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:21:54.691 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:27:51.577 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:21:54.693 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:27:51.588 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:21:54.704 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:27:51.602 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:21:54.718 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:27:51.604 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:21:54.720 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:27:51.612 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:21:54.728 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:28:11.147 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:22:14.263 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:28:11.151 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:22:14.267 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:28:11.185 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:22:14.300 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:28:11.204 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:22:14.279 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:28:11.206 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:22:14.280 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:28:11.206 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:22:14.321 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:28:11.208 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:22:14.324 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:28:11.235 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:22:14.310 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:28:11.245 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:22:14.361 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:28:26.042 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:22:29.157 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:28:26.086 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:22:29.161 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:28:26.087 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:22:29.162 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:28:26.109 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:22:29.184 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:28:26.110 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:22:29.226 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:28:26.115 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:22:29.230 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:28:26.117 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:22:29.233 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:28:26.151 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:22:29.267 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:28:26.155 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:22:29.271 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:28:31.109 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:22:34.225 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:28:31.112 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:22:34.228 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:28:31.122 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:22:34.238 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:28:31.160 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:22:34.235 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:28:31.161 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:22:34.236 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:28:31.162 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:22:34.278 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:28:31.163 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:22:34.279 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:28:31.170 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:22:34.245 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:28:31.174 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:22:34.290 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:28:41.161 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:22:44.277 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:28:41.166 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:22:44.282 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:28:41.200 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:22:44.316 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:28:41.211 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:22:44.286 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:28:41.214 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:22:44.288 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:28:41.218 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:22:44.334 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:28:41.221 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:22:44.337 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:28:41.237 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:22:44.312 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:28:41.246 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:22:44.362 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:28:51.283 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:22:54.399 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:28:51.285 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:22:54.401 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:28:51.285 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:22:54.401 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:28:51.303 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:22:54.419 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:28:51.327 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:22:54.402 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:28:51.329 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:22:54.403 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:28:51.334 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:22:54.450 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:28:51.347 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:22:54.421 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:28:51.354 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:22:54.470 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:28:56.201 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:22:59.317 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:28:56.205 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:22:59.321 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:28:56.216 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:22:59.332 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:28:56.256 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:22:59.330 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:28:56.257 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:22:59.331 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:28:56.267 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:22:59.342 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:28:56.274 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:22:59.390 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:28:56.276 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:22:59.392 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:28:56.286 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:22:59.402 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:29:11.444 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:23:14.560 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:29:11.446 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:23:14.562 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:29:11.479 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:23:14.595 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:29:11.494 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:23:14.569 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:29:11.499 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:23:14.574 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:29:11.508 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:23:14.624 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:29:11.510 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:23:14.626 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:29:11.527 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:23:14.602 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:29:11.540 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:23:14.656 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:29:22.652 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.TryFlush (8771 ms) 2023-11-05T08:29:22.653 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.FailedFlush 2023-11-05T08:29:22.653 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.FailedFlush (14606 ms) 2023-11-05T08:29:22.653 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Flush 2023-11-05T08:29:22.653 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.Flush (10101 ms) 2023-11-05T08:29:22.654 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.FlushSnap 2023-11-05T08:29:22.654 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.FlushSnap (15522 ms) 2023-11-05T08:29:22.654 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.FlushTryFlushRaces 2023-11-05T08:29:22.654 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.FlushTryFlushRaces (9957 ms) 2023-11-05T08:29:22.655 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.TryFlushReadRace 2023-11-05T08:29:22.655 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.TryFlushReadRace (9954 ms) 2023-11-05T08:29:22.655 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.HitSetRead 2023-11-05T08:29:22.655 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: hmm, no HitSet yet 2023-11-05T08:29:22.655 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: ok, hit_set contains 251:602f83fe:::foo:head 2023-11-05T08:29:22.656 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.HitSetRead (10152 ms) 2023-11-05T08:29:22.656 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.HitSetTrim 2023-11-05T08:29:22.656 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: got ls 1699172863,0 2023-11-05T08:29:22.656 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: first is 1699172863 2023-11-05T08:29:22.656 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: got ls 1699172863,0 2023-11-05T08:29:22.657 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: got ls 1699172863,0 2023-11-05T08:29:22.657 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: got ls 1699172863,1699172865,1699172866,0 2023-11-05T08:29:22.657 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: got ls 1699172863,1699172865,1699172866,0 2023-11-05T08:29:22.657 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: got ls 1699172863,1699172865,1699172866,0 2023-11-05T08:29:22.657 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: got ls 1699172863,1699172865,1699172866,1699172868,1699172869,0 2023-11-05T08:29:22.658 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: got ls 1699172863,1699172865,1699172866,1699172868,1699172869,0 2023-11-05T08:29:22.658 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: got ls 1699172863,1699172865,1699172866,1699172868,1699172869,0 2023-11-05T08:29:22.658 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: got ls 1699172863,1699172865,1699172866,1699172868,1699172869,1699172872,1699172873,0 2023-11-05T08:29:22.658 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: got ls 1699172863,1699172865,1699172866,1699172868,1699172869,1699172872,1699172873,0 2023-11-05T08:29:22.658 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: got ls 1699172863,1699172865,1699172866,1699172868,1699172869,1699172872,1699172873,0 2023-11-05T08:29:22.659 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: got ls 1699172866,1699172868,1699172869,1699172872,1699172873,1699172875,1699172876,0 2023-11-05T08:29:22.659 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: first now 1699172866, trimmed 2023-11-05T08:29:22.659 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.HitSetTrim (22532 ms) 2023-11-05T08:29:22.659 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.PromoteOn2ndRead 2023-11-05T08:29:22.660 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: foo0 2023-11-05T08:29:22.660 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: verifying foo0 is eventually promoted 2023-11-05T08:29:22.660 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.PromoteOn2ndRead (17746 ms) 2023-11-05T08:29:22.660 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.ProxyRead 2023-11-05T08:29:22.660 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.ProxyRead (20806 ms) 2023-11-05T08:29:22.660 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.CachePin 2023-11-05T08:29:22.661 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.CachePin (23980 ms) 2023-11-05T08:29:22.661 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.SetRedirectRead 2023-11-05T08:29:22.661 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.SetRedirectRead (5750 ms) 2023-11-05T08:29:22.661 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.SetChunkRead 2023-11-05T08:29:22.661 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.SetChunkRead (4520 ms) 2023-11-05T08:29:22.662 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.ManifestPromoteRead 2023-11-05T08:29:22.662 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.ManifestPromoteRead (4622 ms) 2023-11-05T08:29:22.662 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.TrySetDedupTier 2023-11-05T08:29:22.662 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.TrySetDedupTier (4486 ms) 2023-11-05T08:29:22.662 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [----------] 22 tests from LibRadosTwoPoolsECPP (268715 ms total) 2023-11-05T08:29:22.663 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: 2023-11-05T08:29:22.663 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [----------] Global test environment tear-down 2023-11-05T08:29:22.663 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [==========] 77 tests from 4 test suites ran. (1274763 ms total) 2023-11-05T08:29:22.663 INFO:tasks.workunit.client.0.smithi052.stdout: api_tier_pp: [ PASSED ] 77 tests. 2023-11-05T08:29:22.667 INFO:tasks.workunit.client.0.smithi052.stderr:+ for t in "${!pids[@]}" 2023-11-05T08:29:22.667 INFO:tasks.workunit.client.0.smithi052.stderr:+ pid=91564 2023-11-05T08:29:22.667 INFO:tasks.workunit.client.0.smithi052.stderr:+ wait 91564 2023-11-05T08:29:22.667 INFO:tasks.workunit.client.0.smithi052.stderr:+ for t in "${!pids[@]}" 2023-11-05T08:29:22.667 INFO:tasks.workunit.client.0.smithi052.stderr:+ pid=91757 2023-11-05T08:29:22.668 INFO:tasks.workunit.client.0.smithi052.stderr:+ wait 91757 2023-11-05T08:29:22.668 INFO:tasks.workunit.client.0.smithi052.stderr:+ for t in "${!pids[@]}" 2023-11-05T08:29:22.668 INFO:tasks.workunit.client.0.smithi052.stderr:+ pid=92273 2023-11-05T08:29:22.668 INFO:tasks.workunit.client.0.smithi052.stderr:+ wait 92273 2023-11-05T08:29:22.668 INFO:tasks.workunit.client.0.smithi052.stderr:+ for t in "${!pids[@]}" 2023-11-05T08:29:22.669 INFO:tasks.workunit.client.0.smithi052.stderr:+ pid=92026 2023-11-05T08:29:22.669 INFO:tasks.workunit.client.0.smithi052.stderr:+ wait 92026 2023-11-05T08:29:22.669 INFO:tasks.workunit.client.0.smithi052.stderr:+ for t in "${!pids[@]}" 2023-11-05T08:29:22.669 INFO:tasks.workunit.client.0.smithi052.stderr:+ pid=91854 2023-11-05T08:29:22.669 INFO:tasks.workunit.client.0.smithi052.stderr:+ wait 91854 2023-11-05T08:29:22.670 INFO:tasks.workunit.client.0.smithi052.stderr:+ for t in "${!pids[@]}" 2023-11-05T08:29:22.670 INFO:tasks.workunit.client.0.smithi052.stderr:+ pid=91644 2023-11-05T08:29:22.670 INFO:tasks.workunit.client.0.smithi052.stderr:+ wait 91644 2023-11-05T08:29:22.670 INFO:tasks.workunit.client.0.smithi052.stderr:+ for t in "${!pids[@]}" 2023-11-05T08:29:22.670 INFO:tasks.workunit.client.0.smithi052.stderr:+ pid=91931 2023-11-05T08:29:22.671 INFO:tasks.workunit.client.0.smithi052.stderr:+ wait 91931 2023-11-05T08:29:22.671 INFO:tasks.workunit.client.0.smithi052.stderr:+ for t in "${!pids[@]}" 2023-11-05T08:29:22.671 INFO:tasks.workunit.client.0.smithi052.stderr:+ pid=91662 2023-11-05T08:29:22.671 INFO:tasks.workunit.client.0.smithi052.stderr:+ wait 91662 2023-11-05T08:29:22.671 INFO:tasks.workunit.client.0.smithi052.stderr:+ for t in "${!pids[@]}" 2023-11-05T08:29:22.672 INFO:tasks.workunit.client.0.smithi052.stderr:+ pid=92201 2023-11-05T08:29:22.672 INFO:tasks.workunit.client.0.smithi052.stderr:+ wait 92201 2023-11-05T08:29:22.672 INFO:tasks.workunit.client.0.smithi052.stderr:+ for t in "${!pids[@]}" 2023-11-05T08:29:22.672 INFO:tasks.workunit.client.0.smithi052.stderr:+ pid=91538 2023-11-05T08:29:22.672 INFO:tasks.workunit.client.0.smithi052.stderr:+ wait 91538 2023-11-05T08:29:22.673 INFO:tasks.workunit.client.0.smithi052.stderr:+ for t in "${!pids[@]}" 2023-11-05T08:29:22.673 INFO:tasks.workunit.client.0.smithi052.stderr:+ pid=91600 2023-11-05T08:29:22.673 INFO:tasks.workunit.client.0.smithi052.stderr:+ wait 91600 2023-11-05T08:29:22.673 INFO:tasks.workunit.client.0.smithi052.stderr:+ for t in "${!pids[@]}" 2023-11-05T08:29:22.673 INFO:tasks.workunit.client.0.smithi052.stderr:+ pid=92221 2023-11-05T08:29:22.674 INFO:tasks.workunit.client.0.smithi052.stderr:+ wait 92221 2023-11-05T08:29:22.674 INFO:tasks.workunit.client.0.smithi052.stderr:+ for t in "${!pids[@]}" 2023-11-05T08:29:22.674 INFO:tasks.workunit.client.0.smithi052.stderr:+ pid=91529 2023-11-05T08:29:22.674 INFO:tasks.workunit.client.0.smithi052.stderr:+ wait 91529 2023-11-05T08:29:22.674 INFO:tasks.workunit.client.0.smithi052.stderr:+ for t in "${!pids[@]}" 2023-11-05T08:29:22.675 INFO:tasks.workunit.client.0.smithi052.stderr:+ pid=91549 2023-11-05T08:29:22.675 INFO:tasks.workunit.client.0.smithi052.stderr:+ wait 91549 2023-11-05T08:29:22.675 INFO:tasks.workunit.client.0.smithi052.stderr:+ for t in "${!pids[@]}" 2023-11-05T08:29:22.675 INFO:tasks.workunit.client.0.smithi052.stderr:+ pid=91772 2023-11-05T08:29:22.675 INFO:tasks.workunit.client.0.smithi052.stderr:+ wait 91772 2023-11-05T08:29:22.676 INFO:tasks.workunit.client.0.smithi052.stderr:+ for t in "${!pids[@]}" 2023-11-05T08:29:22.676 INFO:tasks.workunit.client.0.smithi052.stderr:+ pid=91902 2023-11-05T08:29:22.676 INFO:tasks.workunit.client.0.smithi052.stderr:+ wait 91902 2023-11-05T08:29:22.676 INFO:tasks.workunit.client.0.smithi052.stderr:+ for t in "${!pids[@]}" 2023-11-05T08:29:22.676 INFO:tasks.workunit.client.0.smithi052.stderr:+ pid=91782 2023-11-05T08:29:22.677 INFO:tasks.workunit.client.0.smithi052.stderr:+ wait 91782 2023-11-05T08:29:22.677 INFO:tasks.workunit.client.0.smithi052.stderr:+ for t in "${!pids[@]}" 2023-11-05T08:29:22.677 INFO:tasks.workunit.client.0.smithi052.stderr:+ pid=92253 2023-11-05T08:29:22.677 INFO:tasks.workunit.client.0.smithi052.stderr:+ wait 92253 2023-11-05T08:29:22.678 INFO:tasks.workunit.client.0.smithi052.stderr:+ for t in "${!pids[@]}" 2023-11-05T08:29:22.678 INFO:tasks.workunit.client.0.smithi052.stderr:+ pid=92160 2023-11-05T08:29:22.678 INFO:tasks.workunit.client.0.smithi052.stderr:+ wait 92160 2023-11-05T08:29:22.678 INFO:tasks.workunit.client.0.smithi052.stderr:+ for t in "${!pids[@]}" 2023-11-05T08:29:22.678 INFO:tasks.workunit.client.0.smithi052.stderr:+ pid=91733 2023-11-05T08:29:22.679 INFO:tasks.workunit.client.0.smithi052.stderr:+ wait 91733 2023-11-05T08:29:22.679 INFO:tasks.workunit.client.0.smithi052.stderr:+ for t in "${!pids[@]}" 2023-11-05T08:29:22.679 INFO:tasks.workunit.client.0.smithi052.stderr:+ pid=92065 2023-11-05T08:29:22.679 INFO:tasks.workunit.client.0.smithi052.stderr:+ wait 92065 2023-11-05T08:29:22.679 INFO:tasks.workunit.client.0.smithi052.stderr:+ for t in "${!pids[@]}" 2023-11-05T08:29:22.680 INFO:tasks.workunit.client.0.smithi052.stderr:+ pid=91522 2023-11-05T08:29:22.680 INFO:tasks.workunit.client.0.smithi052.stderr:+ wait 91522 2023-11-05T08:29:22.680 INFO:tasks.workunit.client.0.smithi052.stderr:+ for t in "${!pids[@]}" 2023-11-05T08:29:22.680 INFO:tasks.workunit.client.0.smithi052.stderr:+ pid=91580 2023-11-05T08:29:22.681 INFO:tasks.workunit.client.0.smithi052.stderr:+ wait 91580 2023-11-05T08:29:22.681 INFO:tasks.workunit.client.0.smithi052.stderr:+ for t in "${!pids[@]}" 2023-11-05T08:29:22.681 INFO:tasks.workunit.client.0.smithi052.stderr:+ pid=91983 2023-11-05T08:29:22.681 INFO:tasks.workunit.client.0.smithi052.stderr:+ wait 91983 2023-11-05T08:29:22.681 INFO:tasks.workunit.client.0.smithi052.stderr:+ for t in "${!pids[@]}" 2023-11-05T08:29:22.681 INFO:tasks.workunit.client.0.smithi052.stderr:+ pid=91623 2023-11-05T08:29:22.682 INFO:tasks.workunit.client.0.smithi052.stderr:+ wait 91623 2023-11-05T08:29:22.682 INFO:tasks.workunit.client.0.smithi052.stderr:+ for t in "${!pids[@]}" 2023-11-05T08:29:22.682 INFO:tasks.workunit.client.0.smithi052.stderr:+ pid=92095 2023-11-05T08:29:22.682 INFO:tasks.workunit.client.0.smithi052.stderr:+ wait 92095 2023-11-05T08:29:22.682 INFO:tasks.workunit.client.0.smithi052.stderr:+ for t in "${!pids[@]}" 2023-11-05T08:29:22.683 INFO:tasks.workunit.client.0.smithi052.stderr:+ pid=92117 2023-11-05T08:29:22.683 INFO:tasks.workunit.client.0.smithi052.stderr:+ wait 92117 2023-11-05T08:29:22.683 INFO:tasks.workunit.client.0.smithi052.stderr:+ exit 0 2023-11-05T08:29:22.683 INFO:tasks.workunit.client.0.smithi052.stderr:+ cleanup 2023-11-05T08:29:22.684 INFO:tasks.workunit.client.0.smithi052.stderr:+ pkill -P 91517 2023-11-05T08:29:22.685 INFO:tasks.workunit.client.0.smithi052.stderr:+ true 2023-11-05T08:29:22.685 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-11-05T08:29:22.686 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-11-05T08:29:22.718 INFO:tasks.workunit:Stopping ['rados/test.sh'] on client.0... 2023-11-05T08:29:22.719 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2023-11-05T08:29:23.058 DEBUG:teuthology.parallel:result is None 2023-11-05T08:29:23.058 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2023-11-05T08:29:23.089 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2023-11-05T08:29:23.090 DEBUG:teuthology.orchestra.run.smithi052:> rmdir -- /home/ubuntu/cephtest/mnt.0 2023-11-05T08:29:23.155 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2023-11-05T08:29:23.155 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-11-05T08:29:23.165 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-05T08:29:23.165 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-05T08:29:23.302 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.302+0000 7fe65e124640 10 monclient: get_monmap_and_config 2023-11-05T08:29:23.303 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.302+0000 7fe65e124640 10 monclient: build_initial_monmap 2023-11-05T08:29:23.303 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.302+0000 7fe65e124640 10 monclient: monmap: 2023-11-05T08:29:23.303 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:29:23.303 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:23.304 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:29:23.303154+0000 2023-11-05T08:29:23.304 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:29:23.303154+0000 2023-11-05T08:29:23.304 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:29:23.304 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:23.304 INFO:teuthology.orchestra.run.smithi052.stderr:0: v1:172.21.15.52:6789/0 mon.noname-a-legacy 2023-11-05T08:29:23.305 INFO:teuthology.orchestra.run.smithi052.stderr:1: v1:172.21.15.156:6789/0 mon.noname-c-legacy 2023-11-05T08:29:23.305 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-b 2023-11-05T08:29:23.305 INFO:teuthology.orchestra.run.smithi052.stderr:3: v2:172.21.15.52:3300/0 mon.noname-a 2023-11-05T08:29:23.305 INFO:teuthology.orchestra.run.smithi052.stderr:4: v2:172.21.15.156:3300/0 mon.noname-c 2023-11-05T08:29:23.305 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:23.307 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.303+0000 7fe65e124640 1 Processor -- start 2023-11-05T08:29:23.308 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.303+0000 7fe65e124640 1 -- start start 2023-11-05T08:29:23.308 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.303+0000 7fe65e124640 10 monclient: init 2023-11-05T08:29:23.308 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.303+0000 7fe65e124640 10 monclient: _reopen_session rank -1 2023-11-05T08:29:23.308 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.303+0000 7fe65e124640 10 monclient: _add_conns ranks=[2,4,0,1,3] 2023-11-05T08:29:23.308 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.303+0000 7fe65e124640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe6580ac830 0x7fe6580acc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:23.309 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.303+0000 7fe65e124640 10 monclient(hunting): picked mon.noname-b con 0x7fe6580ac830 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:29:23.309 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.303+0000 7fe65e124640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe658071bd0 0x7fe65813bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:23.309 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.303+0000 7fe65e124640 10 monclient(hunting): picked mon.noname-c con 0x7fe658071bd0 addr v2:172.21.15.156:3300/0 2023-11-05T08:29:23.309 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.304+0000 7fe65e124640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fe65813e640 addr v1:172.21.15.52:6789/0 2023-11-05T08:29:23.309 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.304+0000 7fe65e124640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe65813f1c0 con 0x7fe65813e640 2023-11-05T08:29:23.309 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.304+0000 7fe65e124640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:23.310 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.304+0000 7fe65e124640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6580ac310 con 0x7fe658071bd0 2023-11-05T08:29:23.310 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.304+0000 7fe65e124640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:23.310 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.304+0000 7fe65e124640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6580aad80 con 0x7fe6580ac830 2023-11-05T08:29:23.310 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.304+0000 7fe65e124640 10 monclient(hunting): _renew_subs 2023-11-05T08:29:23.311 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.304+0000 7fe65e124640 10 monclient(hunting): authenticate will time out at 2709.508948s 2023-11-05T08:29:23.311 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.304+0000 7fe657fff640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fe65813e640 0x7fe65813eab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:32958/0 (socket says 172.21.15.52:32958) 2023-11-05T08:29:23.311 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.304+0000 7fe657fff640 1 -- 172.21.15.52:0/3547550018 learned_addr learned my addr 172.21.15.52:0/3547550018 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-11-05T08:29:23.311 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.304+0000 7fe6577fe640 1 --2- 172.21.15.52:0/3547550018 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe6580ac830 0x7fe6580acc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:23.311 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.304+0000 7fe656ffd640 1 --2- 172.21.15.52:0/3547550018 >> v2:172.21.15.156:3300/0 conn(0x7fe658071bd0 0x7fe65813bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:23.312 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.305+0000 7fe6577fe640 10 monclient(hunting): get_auth_request con 0x7fe6580ac830 auth_method 0 2023-11-05T08:29:23.312 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.305+0000 7fe6577fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:29:23.312 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.305+0000 7fe6577fe640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:29:23.312 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.305+0000 7fe6577fe640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:29:23.313 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.305+0000 7fe656ffd640 10 monclient(hunting): get_auth_request con 0x7fe658071bd0 auth_method 0 2023-11-05T08:29:23.313 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.305+0000 7fe656ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:29:23.313 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.305+0000 7fe656ffd640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:29:23.313 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.305+0000 7fe656ffd640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:29:23.314 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.305+0000 7fe656ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:29:23.314 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.305+0000 7fe656ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:29:23.314 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.305+0000 7fe656ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:29:23.314 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.305+0000 7fe6577fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:29:23.314 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.305+0000 7fe6577fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:29:23.315 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.305+0000 7fe6577fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:29:23.315 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.307+0000 7fe656ffd640 10 monclient(hunting): handle_auth_done global_id 20677 payload 274 2023-11-05T08:29:23.315 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.307+0000 7fe656ffd640 1 -- 172.21.15.52:0/3547550018 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe6580ac830 msgr2=0x7fe6580acc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-05T08:29:23.315 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.307+0000 7fe656ffd640 1 --2- 172.21.15.52:0/3547550018 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe6580ac830 0x7fe6580acc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:23.316 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.307+0000 7fe656ffd640 1 -- 172.21.15.52:0/3547550018 >> v1:172.21.15.52:6789/0 conn(0x7fe65813e640 legacy=0x7fe65813eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:23.316 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.307+0000 7fe656ffd640 10 monclient: _finish_hunting 0 2023-11-05T08:29:23.316 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.307+0000 7fe656ffd640 1 monclient: found mon.noname-c 2023-11-05T08:29:23.316 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.307+0000 7fe656ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:29:23.316 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.307+0000 7fe656ffd640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.156:3300/0 2023-11-05T08:29:23.317 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.307+0000 7fe656ffd640 1 -- 172.21.15.52:0/3547550018 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6580ad150 con 0x7fe658071bd0 2023-11-05T08:29:23.321 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.309+0000 7fe656ffd640 1 --2- 172.21.15.52:0/3547550018 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe658071bd0 0x7fe65813bc60 secure :-1 s=READY pgs=4990 cs=0 l=1 rev1=1 crypto rx=0x7fe6400097a0 tx=0x7fe64002b7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c5130482b2d16fdc server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:29:23.321 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.313+0000 7fe6567fc640 1 -- 172.21.15.52:0/3547550018 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe64002f050 con 0x7fe658071bd0 2023-11-05T08:29:23.321 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.313+0000 7fe6567fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:29:23.322 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.313+0000 7fe6567fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-11-05T08:29:23.322 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.313+0000 7fe6567fc640 10 monclient: dump: 2023-11-05T08:29:23.322 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:29:23.322 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:23.323 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:23.323 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:23.323 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:29:23.323 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:23.323 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:29:23.324 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:29:23.324 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:29:23.324 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:23.324 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.313+0000 7fe6567fc640 10 monclient: _finish_auth 0 2023-11-05T08:29:23.324 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.313+0000 7fe6567fc640 10 monclient: _check_auth_tickets 2023-11-05T08:29:23.325 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.313+0000 7fe6567fc640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:29:23.325 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.313+0000 7fe6567fc640 1 -- 172.21.15.52:0/3547550018 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe640031700 con 0x7fe658071bd0 2023-11-05T08:29:23.325 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.313+0000 7fe6567fc640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:29:23.325 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.313+0000 7fe6567fc640 1 -- 172.21.15.52:0/3547550018 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe640031a90 con 0x7fe658071bd0 2023-11-05T08:29:23.325 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.313+0000 7fe65e124640 5 monclient: authenticate success, global_id 20677 2023-11-05T08:29:23.326 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.313+0000 7fe65e124640 10 monclient: get_monmap_and_config success 2023-11-05T08:29:23.326 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.313+0000 7fe6567fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:29:23.326 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.313+0000 7fe65e124640 4 set_mon_vals no callback set 2023-11-05T08:29:23.326 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.313+0000 7fe6567fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-05T08:29:23.327 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.313+0000 7fe6567fc640 10 monclient: dump: 2023-11-05T08:29:23.327 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:29:23.327 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:23.327 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:23.327 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:23.327 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:29:23.328 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:23.328 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:29:23.328 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:29:23.328 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:29:23.328 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:23.329 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.313+0000 7fe65e124640 10 monclient: shutdown 2023-11-05T08:29:23.329 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.313+0000 7fe65e124640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:29:23.329 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.313+0000 7fe65e124640 1 -- 172.21.15.52:0/3547550018 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe658071bd0 msgr2=0x7fe65813bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:23.329 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.313+0000 7fe65e124640 1 --2- 172.21.15.52:0/3547550018 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe658071bd0 0x7fe65813bc60 secure :-1 s=READY pgs=4990 cs=0 l=1 rev1=1 crypto rx=0x7fe6400097a0 tx=0x7fe64002b7a0 comp rx=0 tx=0).stop 2023-11-05T08:29:23.329 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.314+0000 7fe65e124640 1 -- 172.21.15.52:0/3547550018 shutdown_connections 2023-11-05T08:29:23.329 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.314+0000 7fe65e124640 1 --2- 172.21.15.52:0/3547550018 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe658071bd0 0x7fe65813bc60 unknown :-1 s=CLOSED pgs=4990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:23.330 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.314+0000 7fe65e124640 1 --2- 172.21.15.52:0/3547550018 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe6580ac830 0x7fe6580acc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:23.330 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.314+0000 7fe65e124640 1 -- 172.21.15.52:0/3547550018 >> 172.21.15.52:0/3547550018 conn(0x7fe6580b2ff0 msgr2=0x7fe6580b3400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:29:23.330 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.314+0000 7fe65e124640 1 -- 172.21.15.52:0/3547550018 shutdown_connections 2023-11-05T08:29:23.330 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.314+0000 7fe65e124640 1 -- 172.21.15.52:0/3547550018 wait complete. 2023-11-05T08:29:23.331 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.315+0000 7fe65e124640 10 monclient: build_initial_monmap 2023-11-05T08:29:23.331 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.315+0000 7fe65e124640 10 monclient: monmap: 2023-11-05T08:29:23.331 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:29:23.331 INFO:teuthology.orchestra.run.smithi052.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-05T08:29:23.331 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 0.000000 2023-11-05T08:29:23.332 INFO:teuthology.orchestra.run.smithi052.stderr:created 0.000000 2023-11-05T08:29:23.332 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:29:23.332 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:23.332 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.noname-a 2023-11-05T08:29:23.332 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.noname-b 2023-11-05T08:29:23.332 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-c 2023-11-05T08:29:23.333 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:23.333 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.315+0000 7fe65e124640 1 librados: starting msgr at 2023-11-05T08:29:23.333 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.315+0000 7fe65e124640 1 librados: starting objecter 2023-11-05T08:29:23.333 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.315+0000 7fe65e124640 1 Processor -- start 2023-11-05T08:29:23.334 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.316+0000 7fe65e124640 1 -- start start 2023-11-05T08:29:23.334 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.316+0000 7fe65e124640 1 librados: setting wanted keys 2023-11-05T08:29:23.334 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.316+0000 7fe65e124640 1 librados: calling monclient init 2023-11-05T08:29:23.334 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.316+0000 7fe65e124640 10 monclient: init 2023-11-05T08:29:23.334 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.316+0000 7fe65e124640 10 monclient: _reopen_session rank -1 2023-11-05T08:29:23.334 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.316+0000 7fe65e124640 10 monclient: _add_conns ranks=[2,0,1] 2023-11-05T08:29:23.335 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.316+0000 7fe65e124640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe658071bd0 0x7fe65806db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:23.335 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.316+0000 7fe65e124640 10 monclient(hunting): picked mon.noname-c con 0x7fe658071bd0 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:29:23.335 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.316+0000 7fe65e124640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6580ac830 0x7fe6581380e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:23.335 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.316+0000 7fe65e124640 10 monclient(hunting): picked mon.noname-a con 0x7fe6580ac830 addr [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] 2023-11-05T08:29:23.335 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.316+0000 7fe65e124640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe65813e640 0x7fe658138620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:23.336 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.316+0000 7fe65e124640 10 monclient(hunting): picked mon.noname-b con 0x7fe65813e640 addr [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] 2023-11-05T08:29:23.336 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.316+0000 7fe65e124640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:23.336 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.316+0000 7fe65e124640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe65806d530 con 0x7fe6580ac830 2023-11-05T08:29:23.336 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.316+0000 7fe65e124640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:23.336 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.316+0000 7fe65e124640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe65806f1e0 con 0x7fe65813e640 2023-11-05T08:29:23.337 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.316+0000 7fe65e124640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:23.337 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.316+0000 7fe65e124640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe658138b60 con 0x7fe658071bd0 2023-11-05T08:29:23.337 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.316+0000 7fe65e124640 10 monclient(hunting): _renew_subs 2023-11-05T08:29:23.337 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.316+0000 7fe65e124640 10 monclient(hunting): authenticate will time out at 2709.521467s 2023-11-05T08:29:23.337 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.317+0000 7fe656ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6580ac830 0x7fe6581380e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:23.338 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.317+0000 7fe6577fe640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe658071bd0 0x7fe65806db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:23.338 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.317+0000 7fe657fff640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe65813e640 0x7fe658138620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:23.338 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.317+0000 7fe656ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6580ac830 0x7fe6581380e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42742/0 (socket says 172.21.15.52:42742) 2023-11-05T08:29:23.338 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.317+0000 7fe656ffd640 1 -- 172.21.15.52:0/2190016911 learned_addr learned my addr 172.21.15.52:0/2190016911 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-11-05T08:29:23.338 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.317+0000 7fe656ffd640 10 monclient(hunting): get_auth_request con 0x7fe6580ac830 auth_method 0 2023-11-05T08:29:23.339 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.317+0000 7fe656ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:29:23.339 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.317+0000 7fe656ffd640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:29:23.339 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.317+0000 7fe656ffd640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:29:23.339 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.317+0000 7fe6577fe640 10 monclient(hunting): get_auth_request con 0x7fe658071bd0 auth_method 0 2023-11-05T08:29:23.339 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.317+0000 7fe6577fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:29:23.340 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.317+0000 7fe6577fe640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:29:23.340 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.317+0000 7fe6577fe640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:29:23.340 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.317+0000 7fe657fff640 10 monclient(hunting): get_auth_request con 0x7fe65813e640 auth_method 0 2023-11-05T08:29:23.340 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.317+0000 7fe657fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:29:23.340 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.317+0000 7fe657fff640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:29:23.341 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.317+0000 7fe657fff640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:29:23.341 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.317+0000 7fe656ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:29:23.341 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.317+0000 7fe656ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:29:23.341 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.317+0000 7fe656ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:29:23.341 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.318+0000 7fe657fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:29:23.342 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.318+0000 7fe657fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:29:23.342 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.318+0000 7fe657fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:29:23.342 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.318+0000 7fe6577fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:29:23.342 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.318+0000 7fe6577fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:29:23.343 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.318+0000 7fe6577fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:29:23.343 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.320+0000 7fe657fff640 10 monclient(hunting): handle_auth_done global_id 20680 payload 824 2023-11-05T08:29:23.343 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.320+0000 7fe657fff640 1 -- 172.21.15.52:0/2190016911 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe658071bd0 msgr2=0x7fe65806db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:23.343 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.320+0000 7fe657fff640 1 --2- 172.21.15.52:0/2190016911 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe658071bd0 0x7fe65806db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:23.343 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.320+0000 7fe657fff640 1 -- 172.21.15.52:0/2190016911 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6580ac830 msgr2=0x7fe6581380e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:23.344 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.320+0000 7fe657fff640 1 --2- 172.21.15.52:0/2190016911 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6580ac830 0x7fe6581380e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:23.344 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.320+0000 7fe657fff640 10 monclient: _finish_hunting 0 2023-11-05T08:29:23.344 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.320+0000 7fe657fff640 1 monclient: found mon.noname-b 2023-11-05T08:29:23.344 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.320+0000 7fe657fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:29:23.344 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.320+0000 7fe657fff640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.156:3300/0 2023-11-05T08:29:23.345 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.320+0000 7fe657fff640 1 -- 172.21.15.52:0/2190016911 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe640009400 con 0x7fe65813e640 2023-11-05T08:29:23.347 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.322+0000 7fe657fff640 1 --2- 172.21.15.52:0/2190016911 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe65813e640 0x7fe658138620 secure :-1 s=READY pgs=4991 cs=0 l=1 rev1=1 crypto rx=0x7fe65000c3f0 tx=0x7fe65000c8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:29:23.347 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.322+0000 7fe64ffff640 10 client.?.objecter ms_handle_connect 0x7fe65813e640 2023-11-05T08:29:23.347 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.322+0000 7fe64ffff640 10 client.?.objecter resend_mon_ops 2023-11-05T08:29:23.347 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.326+0000 7fe64ffff640 1 -- 172.21.15.52:0/2190016911 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe650005ce0 con 0x7fe65813e640 2023-11-05T08:29:23.348 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.326+0000 7fe64ffff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:29:23.348 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.326+0000 7fe64ffff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-05T08:29:23.348 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.326+0000 7fe64ffff640 10 monclient: dump: 2023-11-05T08:29:23.348 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:29:23.348 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:23.349 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:23.349 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:23.349 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:29:23.349 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:23.349 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:29:23.350 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:29:23.350 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:29:23.350 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:23.350 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.326+0000 7fe64ffff640 10 monclient: _finish_auth 0 2023-11-05T08:29:23.351 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.326+0000 7fe64ffff640 10 monclient: _check_auth_tickets 2023-11-05T08:29:23.351 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.326+0000 7fe64ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:29:23.351 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.326+0000 7fe64ffff640 1 -- 172.21.15.52:0/2190016911 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe650005e40 con 0x7fe65813e640 2023-11-05T08:29:23.351 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.326+0000 7fe64ffff640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:29:23.351 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.326+0000 7fe64ffff640 1 -- 172.21.15.52:0/2190016911 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6500072d0 con 0x7fe65813e640 2023-11-05T08:29:23.351 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.326+0000 7fe64ffff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:29:23.352 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.326+0000 7fe64ffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-05T08:29:23.352 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.326+0000 7fe64ffff640 10 monclient: dump: 2023-11-05T08:29:23.352 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:29:23.352 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:23.353 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:23.353 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:23.353 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:29:23.353 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:23.354 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:29:23.354 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:29:23.354 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:29:23.354 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:23.355 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.326+0000 7fe65e124640 5 monclient: authenticate success, global_id 20680 2023-11-05T08:29:23.355 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.326+0000 7fe65e124640 10 monclient: _renew_subs 2023-11-05T08:29:23.355 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.326+0000 7fe65e124640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:29:23.355 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.326+0000 7fe65e124640 1 -- 172.21.15.52:0/2190016911 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe65813c850 con 0x7fe65813e640 2023-11-05T08:29:23.355 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.326+0000 7fe655ffb640 4 set_mon_vals no callback set 2023-11-05T08:29:23.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.326+0000 7fe65e124640 10 client.20680.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-05T08:29:23.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.326+0000 7fe65e124640 10 monclient: _renew_subs 2023-11-05T08:29:23.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.326+0000 7fe65e124640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:29:23.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.326+0000 7fe65e124640 1 -- 172.21.15.52:0/2190016911 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe65806d1e0 con 0x7fe65813e640 2023-11-05T08:29:23.357 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.326+0000 7fe65e124640 1 librados: init done 2023-11-05T08:29:23.357 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.327+0000 7fe65e124640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-05T08:29:23.357 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.327+0000 7fe65e124640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:29:23.357 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.327+0000 7fe65e124640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:29:23.357 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.327+0000 7fe65e124640 1 -- 172.21.15.52:0/2190016911 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe65806d670 con 0x7fe65813e640 2023-11-05T08:29:23.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.345+0000 7fe64ffff640 1 -- 172.21.15.52:0/2190016911 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe650007430 con 0x7fe65813e640 2023-11-05T08:29:23.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.346+0000 7fe64ffff640 1 --2- 172.21.15.52:0/2190016911 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7fe63806c800 0x7fe63806ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:23.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.346+0000 7fe6577fe640 1 --2- 172.21.15.52:0/2190016911 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7fe63806c800 0x7fe63806ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:23.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.346+0000 7fe6577fe640 10 monclient: get_auth_request con 0x7fe63806c800 auth_method 0 2023-11-05T08:29:23.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.346+0000 7fe6577fe640 1 --2- 172.21.15.52:0/2190016911 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7fe63806c800 0x7fe63806ecc0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fe6480113e0 tx=0x7fe64800b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:29:23.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.346+0000 7fe64ffff640 10 client.20680.objecter ms_handle_connect 0x7fe63806c800 2023-11-05T08:29:23.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.582+0000 7fe64ffff640 1 -- 172.21.15.52:0/2190016911 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(932..932 src has 541..932) v4 ==== 6193+0+0 (secure 0 0 0) 0x7fe650057af0 con 0x7fe65813e640 2023-11-05T08:29:23.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.582+0000 7fe64ffff640 10 client.20680.objecter ms_dispatch 0x7fe658000b90 osd_map(932..932 src has 541..932) v4 2023-11-05T08:29:23.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.582+0000 7fe64ffff640 3 client.20680.objecter handle_osd_map got epochs [932,932] > 0 2023-11-05T08:29:23.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.582+0000 7fe64ffff640 3 client.20680.objecter handle_osd_map decoding full epoch 932 2023-11-05T08:29:23.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.582+0000 7fe64ffff640 20 client.20680.objecter dump_active .. 0 homeless 2023-11-05T08:29:23.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.591+0000 7fe64ffff640 1 -- 172.21.15.52:0/2190016911 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe650053e30 con 0x7fe65813e640 2023-11-05T08:29:23.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.591+0000 7fe64ffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:29:23.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.591+0000 7fe64ffff640 10 monclient: _finish_command 1 = system:0 2023-11-05T08:29:23.768 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.768+0000 7fe65e124640 1 -- 172.21.15.52:0/2190016911 --> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe6580ae260 con 0x7fe63806c800 2023-11-05T08:29:23.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.773+0000 7fe64ffff640 1 -- 172.21.15.52:0/2190016911 <== mgr.4108 v2:172.21.15.156:6800/3320012339 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+151253 (secure 0 0 0) 0x7fe64800f040 con 0x7fe63806c800 2023-11-05T08:29:23.775 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:29:23.776 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2023-11-05T08:29:23.778 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.776+0000 7fe65e124640 10 librados: watch_flush enter 2023-11-05T08:29:23.778 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.776+0000 7fe65e124640 10 librados: watch_flush exit 2023-11-05T08:29:23.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.776+0000 7fe65e124640 20 client.20680.objecter shutdown clearing up homeless session... 2023-11-05T08:29:23.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.776+0000 7fe65e124640 10 client.20680.objecter successfully canceled tick 2023-11-05T08:29:23.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.776+0000 7fe65e124640 1 -- 172.21.15.52:0/2190016911 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7fe63806c800 msgr2=0x7fe63806ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:23.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.776+0000 7fe65e124640 1 --2- 172.21.15.52:0/2190016911 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7fe63806c800 0x7fe63806ecc0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fe6480113e0 tx=0x7fe64800b040 comp rx=0 tx=0).stop 2023-11-05T08:29:23.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.776+0000 7fe65e124640 10 monclient: shutdown 2023-11-05T08:29:23.781 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.776+0000 7fe65e124640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:29:23.781 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.776+0000 7fe65e124640 1 -- 172.21.15.52:0/2190016911 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe65813e640 msgr2=0x7fe658138620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:23.781 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.776+0000 7fe65e124640 1 --2- 172.21.15.52:0/2190016911 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe65813e640 0x7fe658138620 secure :-1 s=READY pgs=4991 cs=0 l=1 rev1=1 crypto rx=0x7fe65000c3f0 tx=0x7fe65000c8b0 comp rx=0 tx=0).stop 2023-11-05T08:29:23.782 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.776+0000 7fe65e124640 1 -- 172.21.15.52:0/2190016911 shutdown_connections 2023-11-05T08:29:23.782 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.776+0000 7fe65e124640 1 --2- 172.21.15.52:0/2190016911 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7fe63806c800 0x7fe63806ecc0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:23.782 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.776+0000 7fe65e124640 1 --2- 172.21.15.52:0/2190016911 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe65813e640 0x7fe658138620 unknown :-1 s=CLOSED pgs=4991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:23.782 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.776+0000 7fe65e124640 1 --2- 172.21.15.52:0/2190016911 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6580ac830 0x7fe6581380e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:23.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.776+0000 7fe65e124640 1 --2- 172.21.15.52:0/2190016911 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe658071bd0 0x7fe65806db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:23.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.776+0000 7fe65e124640 1 -- 172.21.15.52:0/2190016911 >> 172.21.15.52:0/2190016911 conn(0x7fe6580b2ff0 msgr2=0x7fe6580a84b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:29:23.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.776+0000 7fe65e124640 1 -- 172.21.15.52:0/2190016911 shutdown_connections 2023-11-05T08:29:23.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.776+0000 7fe65e124640 1 -- 172.21.15.52:0/2190016911 wait complete. 2023-11-05T08:29:23.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.776+0000 7fe65e124640 1 librados: shutdown 2023-11-05T08:29:23.788 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":1610,"stamp":"2023-11-05T08:29:23.481560+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459285,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":102,"num_read_kb":88,"num_write":120,"num_write_kb":1379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":140,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":518336,"kb_used_data":46772,"kb_used_omap":12,"kb_used_meta":471411,"kb_avail":754456384,"statfs":{"total":773094113280,"available":772563337216,"internally_reserved":0,"allocated":47894528,"data_stored":26130876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":482725432},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":381,"apply_latency_ms":381,"commit_latency_ns":381000000,"apply_latency_ns":381000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4000299,"num_objects":-44,"num_object_clones":-1,"num_object_copies":-132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-44,"num_whiteouts":0,"num_read":-31,"num_read_kb":-11,"num_write":-71,"num_write_kb":-3969,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":-1,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.436968"},"pg_stats":[{"pgid":"12.10","version":"0'0","reported_seq":879,"reported_epoch":928,"state":"active+clean","last_fresh":"2023-11-05T08:29:17.949538+0000","last_change":"2023-11-05T08:08:27.690087+0000","last_active":"2023-11-05T08:29:17.949538+0000","last_peered":"2023-11-05T08:29:17.949538+0000","last_clean":"2023-11-05T08:29:17.949538+0000","last_became_active":"2023-11-05T08:08:27.684720+0000","last_became_peered":"2023-11-05T08:08:27.684720+0000","last_unstale":"2023-11-05T08:29:17.949538+0000","last_undegraded":"2023-11-05T08:29:17.949538+0000","last_fullsized":"2023-11-05T08:29:17.949538+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T19:41:08.111512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":880,"reported_epoch":930,"state":"active+clean","last_fresh":"2023-11-05T08:29:20.524528+0000","last_change":"2023-11-05T08:08:12.980044+0000","last_active":"2023-11-05T08:29:20.524528+0000","last_peered":"2023-11-05T08:29:20.524528+0000","last_clean":"2023-11-05T08:29:20.524528+0000","last_became_active":"2023-11-05T08:08:12.972471+0000","last_became_peered":"2023-11-05T08:08:12.972471+0000","last_unstale":"2023-11-05T08:29:20.524528+0000","last_undegraded":"2023-11-05T08:29:20.524528+0000","last_fullsized":"2023-11-05T08:29:20.524528+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T12:54:54.078770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":879,"reported_epoch":928,"state":"active+clean","last_fresh":"2023-11-05T08:29:18.321196+0000","last_change":"2023-11-05T08:08:20.798605+0000","last_active":"2023-11-05T08:29:18.321196+0000","last_peered":"2023-11-05T08:29:18.321196+0000","last_clean":"2023-11-05T08:29:18.321196+0000","last_became_active":"2023-11-05T08:08:20.791671+0000","last_became_peered":"2023-11-05T08:08:20.791671+0000","last_unstale":"2023-11-05T08:29:18.321196+0000","last_undegraded":"2023-11-05T08:29:18.321196+0000","last_fullsized":"2023-11-05T08:29:18.321196+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T13:29:00.846506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":866,"reported_epoch":929,"state":"active+clean","last_fresh":"2023-11-05T08:29:19.961924+0000","last_change":"2023-11-05T08:08:26.582880+0000","last_active":"2023-11-05T08:29:19.961924+0000","last_peered":"2023-11-05T08:29:19.961924+0000","last_clean":"2023-11-05T08:29:19.961924+0000","last_became_active":"2023-11-05T08:08:26.449074+0000","last_became_peered":"2023-11-05T08:08:26.449074+0000","last_unstale":"2023-11-05T08:29:19.961924+0000","last_undegraded":"2023-11-05T08:29:19.961924+0000","last_fullsized":"2023-11-05T08:29:19.961924+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T18:45:21.023650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":891,"reported_epoch":929,"state":"active+clean","last_fresh":"2023-11-05T08:29:19.458376+0000","last_change":"2023-11-05T08:08:32.323831+0000","last_active":"2023-11-05T08:29:19.458376+0000","last_peered":"2023-11-05T08:29:19.458376+0000","last_clean":"2023-11-05T08:29:19.458376+0000","last_became_active":"2023-11-05T08:08:32.275587+0000","last_became_peered":"2023-11-05T08:08:32.275587+0000","last_unstale":"2023-11-05T08:29:19.458376+0000","last_undegraded":"2023-11-05T08:29:19.458376+0000","last_fullsized":"2023-11-05T08:29:19.458376+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T13:12:36.530380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":878,"reported_epoch":929,"state":"active+clean","last_fresh":"2023-11-05T08:29:20.077274+0000","last_change":"2023-11-05T08:08:15.985625+0000","last_active":"2023-11-05T08:29:20.077274+0000","last_peered":"2023-11-05T08:29:20.077274+0000","last_clean":"2023-11-05T08:29:20.077274+0000","last_became_active":"2023-11-05T08:08:15.950681+0000","last_became_peered":"2023-11-05T08:08:15.950681+0000","last_unstale":"2023-11-05T08:29:20.077274+0000","last_undegraded":"2023-11-05T08:29:20.077274+0000","last_fullsized":"2023-11-05T08:29:20.077274+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T12:50:28.798998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":878,"reported_epoch":930,"state":"active+clean","last_fresh":"2023-11-05T08:29:20.537827+0000","last_change":"2023-11-05T08:08:24.751420+0000","last_active":"2023-11-05T08:29:20.537827+0000","last_peered":"2023-11-05T08:29:20.537827+0000","last_clean":"2023-11-05T08:29:20.537827+0000","last_became_active":"2023-11-05T08:08:24.718463+0000","last_became_peered":"2023-11-05T08:08:24.718463+0000","last_unstale":"2023-11-05T08:29:20.537827+0000","last_undegraded":"2023-11-05T08:29:20.537827+0000","last_fullsized":"2023-11-05T08:29:20.537827+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T18:26:27.301253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":878,"reported_epoch":929,"state":"active+clean","last_fresh":"2023-11-05T08:29:20.130566+0000","last_change":"2023-11-05T08:08:13.351797+0000","last_active":"2023-11-05T08:29:20.130566+0000","last_peered":"2023-11-05T08:29:20.130566+0000","last_clean":"2023-11-05T08:29:20.130566+0000","last_became_active":"2023-11-05T08:08:13.341684+0000","last_became_peered":"2023-11-05T08:08:13.341684+0000","last_unstale":"2023-11-05T08:29:20.130566+0000","last_undegraded":"2023-11-05T08:29:20.130566+0000","last_fullsized":"2023-11-05T08:29:20.130566+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T16:17:59.865184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":891,"reported_epoch":929,"state":"active+clean","last_fresh":"2023-11-05T08:29:19.519193+0000","last_change":"2023-11-05T08:08:15.525549+0000","last_active":"2023-11-05T08:29:19.519193+0000","last_peered":"2023-11-05T08:29:19.519193+0000","last_clean":"2023-11-05T08:29:19.519193+0000","last_became_active":"2023-11-05T08:08:15.520030+0000","last_became_peered":"2023-11-05T08:08:15.520030+0000","last_unstale":"2023-11-05T08:29:19.519193+0000","last_undegraded":"2023-11-05T08:29:19.519193+0000","last_fullsized":"2023-11-05T08:29:19.519193+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T14:24:09.563061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":891,"reported_epoch":929,"state":"active+clean","last_fresh":"2023-11-05T08:29:19.541086+0000","last_change":"2023-11-05T08:08:15.879034+0000","last_active":"2023-11-05T08:29:19.541086+0000","last_peered":"2023-11-05T08:29:19.541086+0000","last_clean":"2023-11-05T08:29:19.541086+0000","last_became_active":"2023-11-05T08:08:15.871149+0000","last_became_peered":"2023-11-05T08:08:15.871149+0000","last_unstale":"2023-11-05T08:29:19.541086+0000","last_undegraded":"2023-11-05T08:29:19.541086+0000","last_fullsized":"2023-11-05T08:29:19.541086+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T12:39:25.891428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":879,"reported_epoch":930,"state":"active+clean","last_fresh":"2023-11-05T08:29:20.519145+0000","last_change":"2023-11-05T08:08:14.156651+0000","last_active":"2023-11-05T08:29:20.519145+0000","last_peered":"2023-11-05T08:29:20.519145+0000","last_clean":"2023-11-05T08:29:20.519145+0000","last_became_active":"2023-11-05T08:08:14.060255+0000","last_became_peered":"2023-11-05T08:08:14.060255+0000","last_unstale":"2023-11-05T08:29:20.519145+0000","last_undegraded":"2023-11-05T08:29:20.519145+0000","last_fullsized":"2023-11-05T08:29:20.519145+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T09:03:54.287575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":891,"reported_epoch":929,"state":"active+clean","last_fresh":"2023-11-05T08:29:19.509110+0000","last_change":"2023-11-05T08:08:15.769320+0000","last_active":"2023-11-05T08:29:19.509110+0000","last_peered":"2023-11-05T08:29:19.509110+0000","last_clean":"2023-11-05T08:29:19.509110+0000","last_became_active":"2023-11-05T08:08:15.726426+0000","last_became_peered":"2023-11-05T08:08:15.726426+0000","last_unstale":"2023-11-05T08:29:19.509110+0000","last_undegraded":"2023-11-05T08:29:19.509110+0000","last_fullsized":"2023-11-05T08:29:19.509110+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T16:42:57.259557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":881,"reported_epoch":929,"state":"active+clean","last_fresh":"2023-11-05T08:29:19.258449+0000","last_change":"2023-11-05T08:07:07.897554+0000","last_active":"2023-11-05T08:29:19.258449+0000","last_peered":"2023-11-05T08:29:19.258449+0000","last_clean":"2023-11-05T08:29:19.258449+0000","last_became_active":"2023-11-05T08:07:07.890422+0000","last_became_peered":"2023-11-05T08:07:07.890422+0000","last_unstale":"2023-11-05T08:29:19.258449+0000","last_undegraded":"2023-11-05T08:29:19.258449+0000","last_fullsized":"2023-11-05T08:29:19.258449+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:07:05.115520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:07:05.115520+0000","last_clean_scrub_stamp":"2023-11-05T08:07:05.115520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T18:33:54.492130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":879,"reported_epoch":928,"state":"active+clean","last_fresh":"2023-11-05T08:29:17.966606+0000","last_change":"2023-11-05T08:08:38.368346+0000","last_active":"2023-11-05T08:29:17.966606+0000","last_peered":"2023-11-05T08:29:17.966606+0000","last_clean":"2023-11-05T08:29:17.966606+0000","last_became_active":"2023-11-05T08:08:38.362716+0000","last_became_peered":"2023-11-05T08:08:38.362716+0000","last_unstale":"2023-11-05T08:29:17.966606+0000","last_undegraded":"2023-11-05T08:29:17.966606+0000","last_fullsized":"2023-11-05T08:29:17.966606+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T19:21:04.243650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":884,"reported_epoch":928,"state":"active+clean","last_fresh":"2023-11-05T08:29:18.338442+0000","last_change":"2023-11-05T08:07:07.935570+0000","last_active":"2023-11-05T08:29:18.338442+0000","last_peered":"2023-11-05T08:29:18.338442+0000","last_clean":"2023-11-05T08:29:18.338442+0000","last_became_active":"2023-11-05T08:07:07.908128+0000","last_became_peered":"2023-11-05T08:07:07.908128+0000","last_unstale":"2023-11-05T08:29:18.338442+0000","last_undegraded":"2023-11-05T08:29:18.338442+0000","last_fullsized":"2023-11-05T08:29:18.338442+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:07:05.115520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:07:05.115520+0000","last_clean_scrub_stamp":"2023-11-05T08:07:05.115520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T15:25:37.194219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":892,"reported_epoch":929,"state":"active+clean","last_fresh":"2023-11-05T08:29:19.520761+0000","last_change":"2023-11-05T08:08:12.669619+0000","last_active":"2023-11-05T08:29:19.520761+0000","last_peered":"2023-11-05T08:29:19.520761+0000","last_clean":"2023-11-05T08:29:19.520761+0000","last_became_active":"2023-11-05T08:08:12.653053+0000","last_became_peered":"2023-11-05T08:08:12.653053+0000","last_unstale":"2023-11-05T08:29:19.520761+0000","last_undegraded":"2023-11-05T08:29:19.520761+0000","last_fullsized":"2023-11-05T08:29:19.520761+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T17:33:50.738772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":883,"reported_epoch":930,"state":"active+clean","last_fresh":"2023-11-05T08:29:20.271551+0000","last_change":"2023-11-05T08:07:07.213210+0000","last_active":"2023-11-05T08:29:20.271551+0000","last_peered":"2023-11-05T08:29:20.271551+0000","last_clean":"2023-11-05T08:29:20.271551+0000","last_became_active":"2023-11-05T08:07:07.203649+0000","last_became_peered":"2023-11-05T08:07:07.203649+0000","last_unstale":"2023-11-05T08:29:20.271551+0000","last_undegraded":"2023-11-05T08:29:20.271551+0000","last_fullsized":"2023-11-05T08:29:20.271551+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:07:05.115520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:07:05.115520+0000","last_clean_scrub_stamp":"2023-11-05T08:07:05.115520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T13:05:27.884687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":892,"reported_epoch":929,"state":"active+clean","last_fresh":"2023-11-05T08:29:19.555585+0000","last_change":"2023-11-05T08:08:14.906331+0000","last_active":"2023-11-05T08:29:19.555585+0000","last_peered":"2023-11-05T08:29:19.555585+0000","last_clean":"2023-11-05T08:29:19.555585+0000","last_became_active":"2023-11-05T08:08:14.900486+0000","last_became_peered":"2023-11-05T08:08:14.900486+0000","last_unstale":"2023-11-05T08:29:19.555585+0000","last_undegraded":"2023-11-05T08:29:19.555585+0000","last_fullsized":"2023-11-05T08:29:19.555585+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T14:54:34.273100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":872,"reported_epoch":929,"state":"active+clean","last_fresh":"2023-11-05T08:29:19.978553+0000","last_change":"2023-11-05T08:07:07.403639+0000","last_active":"2023-11-05T08:29:19.978553+0000","last_peered":"2023-11-05T08:29:19.978553+0000","last_clean":"2023-11-05T08:29:19.978553+0000","last_became_active":"2023-11-05T08:07:07.371569+0000","last_became_peered":"2023-11-05T08:07:07.371569+0000","last_unstale":"2023-11-05T08:29:19.978553+0000","last_undegraded":"2023-11-05T08:29:19.978553+0000","last_fullsized":"2023-11-05T08:29:19.978553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:07:05.115520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:07:05.115520+0000","last_clean_scrub_stamp":"2023-11-05T08:07:05.115520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T14:58:41.385179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":879,"reported_epoch":928,"state":"active+clean","last_fresh":"2023-11-05T08:29:18.316725+0000","last_change":"2023-11-05T08:08:29.214565+0000","last_active":"2023-11-05T08:29:18.316725+0000","last_peered":"2023-11-05T08:29:18.316725+0000","last_clean":"2023-11-05T08:29:18.316725+0000","last_became_active":"2023-11-05T08:08:29.207330+0000","last_became_peered":"2023-11-05T08:08:29.207330+0000","last_unstale":"2023-11-05T08:29:18.316725+0000","last_undegraded":"2023-11-05T08:29:18.316725+0000","last_fullsized":"2023-11-05T08:29:18.316725+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T11:12:17.103935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":883,"reported_epoch":930,"state":"active+clean","last_fresh":"2023-11-05T08:29:20.231140+0000","last_change":"2023-11-05T08:07:07.350626+0000","last_active":"2023-11-05T08:29:20.231140+0000","last_peered":"2023-11-05T08:29:20.231140+0000","last_clean":"2023-11-05T08:29:20.231140+0000","last_became_active":"2023-11-05T08:07:07.344890+0000","last_became_peered":"2023-11-05T08:07:07.344890+0000","last_unstale":"2023-11-05T08:29:20.231140+0000","last_undegraded":"2023-11-05T08:29:20.231140+0000","last_fullsized":"2023-11-05T08:29:20.231140+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:07:05.115520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:07:05.115520+0000","last_clean_scrub_stamp":"2023-11-05T08:07:05.115520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T10:17:35.666271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":892,"reported_epoch":929,"state":"active+clean","last_fresh":"2023-11-05T08:29:19.616495+0000","last_change":"2023-11-05T08:08:16.955033+0000","last_active":"2023-11-05T08:29:19.616495+0000","last_peered":"2023-11-05T08:29:19.616495+0000","last_clean":"2023-11-05T08:29:19.616495+0000","last_became_active":"2023-11-05T08:08:16.927690+0000","last_became_peered":"2023-11-05T08:08:16.927690+0000","last_unstale":"2023-11-05T08:29:19.616495+0000","last_undegraded":"2023-11-05T08:29:19.616495+0000","last_fullsized":"2023-11-05T08:29:19.616495+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T16:04:26.654084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":897,"reported_epoch":929,"state":"active+clean","last_fresh":"2023-11-05T08:29:19.530569+0000","last_change":"2023-11-05T08:07:07.085537+0000","last_active":"2023-11-05T08:29:19.530569+0000","last_peered":"2023-11-05T08:29:19.530569+0000","last_clean":"2023-11-05T08:29:19.530569+0000","last_became_active":"2023-11-05T08:07:07.051923+0000","last_became_peered":"2023-11-05T08:07:07.051923+0000","last_unstale":"2023-11-05T08:29:19.530569+0000","last_undegraded":"2023-11-05T08:29:19.530569+0000","last_fullsized":"2023-11-05T08:29:19.530569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:07:05.115520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:07:05.115520+0000","last_clean_scrub_stamp":"2023-11-05T08:07:05.115520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T09:32:20.473313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":876,"reported_epoch":929,"state":"active+clean","last_fresh":"2023-11-05T08:29:19.260837+0000","last_change":"2023-11-05T08:08:32.728546+0000","last_active":"2023-11-05T08:29:19.260837+0000","last_peered":"2023-11-05T08:29:19.260837+0000","last_clean":"2023-11-05T08:29:19.260837+0000","last_became_active":"2023-11-05T08:08:32.722827+0000","last_became_peered":"2023-11-05T08:08:32.722827+0000","last_unstale":"2023-11-05T08:29:19.260837+0000","last_undegraded":"2023-11-05T08:29:19.260837+0000","last_fullsized":"2023-11-05T08:29:19.260837+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T18:14:43.626997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":884,"reported_epoch":930,"state":"active+clean","last_fresh":"2023-11-05T08:29:20.220963+0000","last_change":"2023-11-05T08:07:07.161269+0000","last_active":"2023-11-05T08:29:20.220963+0000","last_peered":"2023-11-05T08:29:20.220963+0000","last_clean":"2023-11-05T08:29:20.220963+0000","last_became_active":"2023-11-05T08:07:07.131650+0000","last_became_peered":"2023-11-05T08:07:07.131650+0000","last_unstale":"2023-11-05T08:29:20.220963+0000","last_undegraded":"2023-11-05T08:29:20.220963+0000","last_fullsized":"2023-11-05T08:29:20.220963+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:07:05.115520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:07:05.115520+0000","last_clean_scrub_stamp":"2023-11-05T08:07:05.115520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T11:45:49.611005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":892,"reported_epoch":929,"state":"active+clean","last_fresh":"2023-11-05T08:29:19.568262+0000","last_change":"2023-11-05T08:08:13.856039+0000","last_active":"2023-11-05T08:29:19.568262+0000","last_peered":"2023-11-05T08:29:19.568262+0000","last_clean":"2023-11-05T08:29:19.568262+0000","last_became_active":"2023-11-05T08:08:13.848417+0000","last_became_peered":"2023-11-05T08:08:13.848417+0000","last_unstale":"2023-11-05T08:29:19.568262+0000","last_undegraded":"2023-11-05T08:29:19.568262+0000","last_fullsized":"2023-11-05T08:29:19.568262+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T14:27:44.987944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":883,"reported_epoch":930,"state":"active+clean","last_fresh":"2023-11-05T08:29:20.262132+0000","last_change":"2023-11-05T08:07:07.482345+0000","last_active":"2023-11-05T08:29:20.262132+0000","last_peered":"2023-11-05T08:29:20.262132+0000","last_clean":"2023-11-05T08:29:20.262132+0000","last_became_active":"2023-11-05T08:07:07.467692+0000","last_became_peered":"2023-11-05T08:07:07.467692+0000","last_unstale":"2023-11-05T08:29:20.262132+0000","last_undegraded":"2023-11-05T08:29:20.262132+0000","last_fullsized":"2023-11-05T08:29:20.262132+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:07:05.115520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:07:05.115520+0000","last_clean_scrub_stamp":"2023-11-05T08:07:05.115520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T09:41:35.204221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"23'76","reported_seq":992,"reported_epoch":929,"state":"active+clean","last_fresh":"2023-11-05T08:29:20.025376+0000","last_change":"2023-11-05T08:07:00.997710+0000","last_active":"2023-11-05T08:29:20.025376+0000","last_peered":"2023-11-05T08:29:20.025376+0000","last_clean":"2023-11-05T08:29:20.025376+0000","last_became_active":"2023-11-05T08:07:00.966209+0000","last_became_peered":"2023-11-05T08:07:00.966209+0000","last_unstale":"2023-11-05T08:29:20.025376+0000","last_undegraded":"2023-11-05T08:29:20.025376+0000","last_fullsized":"2023-11-05T08:29:20.025376+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:06:58.242946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:06:58.242946+0000","last_clean_scrub_stamp":"2023-11-05T08:06:58.242946+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T10:17:50.722686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":113,"num_write_kb":1372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":878,"reported_epoch":930,"state":"active+clean","last_fresh":"2023-11-05T08:29:20.267059+0000","last_change":"2023-11-05T08:08:16.483616+0000","last_active":"2023-11-05T08:29:20.267059+0000","last_peered":"2023-11-05T08:29:20.267059+0000","last_clean":"2023-11-05T08:29:20.267059+0000","last_became_active":"2023-11-05T08:08:16.476624+0000","last_became_peered":"2023-11-05T08:08:16.476624+0000","last_unstale":"2023-11-05T08:29:20.267059+0000","last_undegraded":"2023-11-05T08:29:20.267059+0000","last_fullsized":"2023-11-05T08:29:20.267059+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T09:35:42.050473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":892,"reported_epoch":929,"state":"active+clean","last_fresh":"2023-11-05T08:29:19.591653+0000","last_change":"2023-11-05T08:08:15.541517+0000","last_active":"2023-11-05T08:29:19.591653+0000","last_peered":"2023-11-05T08:29:19.591653+0000","last_clean":"2023-11-05T08:29:19.591653+0000","last_became_active":"2023-11-05T08:08:15.536104+0000","last_became_peered":"2023-11-05T08:08:15.536104+0000","last_unstale":"2023-11-05T08:29:19.591653+0000","last_undegraded":"2023-11-05T08:29:19.591653+0000","last_fullsized":"2023-11-05T08:29:19.591653+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T16:13:04.020842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":877,"reported_epoch":928,"state":"active+clean","last_fresh":"2023-11-05T08:29:17.990463+0000","last_change":"2023-11-05T08:08:24.468665+0000","last_active":"2023-11-05T08:29:17.990463+0000","last_peered":"2023-11-05T08:29:17.990463+0000","last_clean":"2023-11-05T08:29:17.990463+0000","last_became_active":"2023-11-05T08:08:24.441081+0000","last_became_peered":"2023-11-05T08:08:24.441081+0000","last_unstale":"2023-11-05T08:29:17.990463+0000","last_undegraded":"2023-11-05T08:29:17.990463+0000","last_fullsized":"2023-11-05T08:29:17.990463+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T18:53:30.099795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":893,"reported_epoch":929,"state":"active+clean","last_fresh":"2023-11-05T08:29:19.482775+0000","last_change":"2023-11-05T08:08:16.655549+0000","last_active":"2023-11-05T08:29:19.482775+0000","last_peered":"2023-11-05T08:29:19.482775+0000","last_clean":"2023-11-05T08:29:19.482775+0000","last_became_active":"2023-11-05T08:08:16.632044+0000","last_became_peered":"2023-11-05T08:08:16.632044+0000","last_unstale":"2023-11-05T08:29:19.482775+0000","last_undegraded":"2023-11-05T08:29:19.482775+0000","last_fullsized":"2023-11-05T08:29:19.482775+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T14:27:26.991803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":881,"reported_epoch":930,"state":"active+clean","last_fresh":"2023-11-05T08:29:20.532510+0000","last_change":"2023-11-05T08:08:14.445311+0000","last_active":"2023-11-05T08:29:20.532510+0000","last_peered":"2023-11-05T08:29:20.532510+0000","last_clean":"2023-11-05T08:29:20.532510+0000","last_became_active":"2023-11-05T08:08:14.425433+0000","last_became_peered":"2023-11-05T08:08:14.425433+0000","last_unstale":"2023-11-05T08:29:20.532510+0000","last_undegraded":"2023-11-05T08:29:20.532510+0000","last_fullsized":"2023-11-05T08:29:20.532510+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T08:24:56.987960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":880,"reported_epoch":928,"state":"active+clean","last_fresh":"2023-11-05T08:29:18.326602+0000","last_change":"2023-11-05T08:08:17.165313+0000","last_active":"2023-11-05T08:29:18.326602+0000","last_peered":"2023-11-05T08:29:18.326602+0000","last_clean":"2023-11-05T08:29:18.326602+0000","last_became_active":"2023-11-05T08:08:17.140308+0000","last_became_peered":"2023-11-05T08:08:17.140308+0000","last_unstale":"2023-11-05T08:29:18.326602+0000","last_undegraded":"2023-11-05T08:29:18.326602+0000","last_fullsized":"2023-11-05T08:29:18.326602+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T19:28:30.888743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":881,"reported_epoch":930,"state":"active+clean","last_fresh":"2023-11-05T08:29:20.517460+0000","last_change":"2023-11-05T08:08:14.150663+0000","last_active":"2023-11-05T08:29:20.517460+0000","last_peered":"2023-11-05T08:29:20.517460+0000","last_clean":"2023-11-05T08:29:20.517460+0000","last_became_active":"2023-11-05T08:08:14.137585+0000","last_became_peered":"2023-11-05T08:08:14.137585+0000","last_unstale":"2023-11-05T08:29:20.517460+0000","last_undegraded":"2023-11-05T08:29:20.517460+0000","last_fullsized":"2023-11-05T08:29:20.517460+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T15:52:07.602007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1","version":"60'7","reported_seq":893,"reported_epoch":929,"state":"active+clean","last_fresh":"2023-11-05T08:29:20.028265+0000","last_change":"2023-11-05T08:08:15.816866+0000","last_active":"2023-11-05T08:29:20.028265+0000","last_peered":"2023-11-05T08:29:20.028265+0000","last_clean":"2023-11-05T08:29:20.028265+0000","last_became_active":"2023-11-05T08:08:15.787944+0000","last_became_peered":"2023-11-05T08:08:15.787944+0000","last_unstale":"2023-11-05T08:29:20.028265+0000","last_undegraded":"2023-11-05T08:29:20.028265+0000","last_fullsized":"2023-11-05T08:29:20.028265+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T15:34:28.380916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":893,"reported_epoch":929,"state":"active+clean","last_fresh":"2023-11-05T08:29:19.437098+0000","last_change":"2023-11-05T08:08:29.552725+0000","last_active":"2023-11-05T08:29:19.437098+0000","last_peered":"2023-11-05T08:29:19.437098+0000","last_clean":"2023-11-05T08:29:19.437098+0000","last_became_active":"2023-11-05T08:08:29.547162+0000","last_became_peered":"2023-11-05T08:08:29.547162+0000","last_unstale":"2023-11-05T08:29:19.437098+0000","last_undegraded":"2023-11-05T08:29:19.437098+0000","last_fullsized":"2023-11-05T08:29:19.437098+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T19:39:29.767004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":877,"reported_epoch":929,"state":"active+clean","last_fresh":"2023-11-05T08:29:19.262775+0000","last_change":"2023-11-05T08:08:20.758068+0000","last_active":"2023-11-05T08:29:19.262775+0000","last_peered":"2023-11-05T08:29:19.262775+0000","last_clean":"2023-11-05T08:29:19.262775+0000","last_became_active":"2023-11-05T08:08:20.752405+0000","last_became_peered":"2023-11-05T08:08:20.752405+0000","last_unstale":"2023-11-05T08:29:19.262775+0000","last_undegraded":"2023-11-05T08:29:19.262775+0000","last_fullsized":"2023-11-05T08:29:19.262775+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T14:40:09.413196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":880,"reported_epoch":930,"state":"active+clean","last_fresh":"2023-11-05T08:29:20.536162+0000","last_change":"2023-11-05T08:08:14.471293+0000","last_active":"2023-11-05T08:29:20.536162+0000","last_peered":"2023-11-05T08:29:20.536162+0000","last_clean":"2023-11-05T08:29:20.536162+0000","last_became_active":"2023-11-05T08:08:14.458020+0000","last_became_peered":"2023-11-05T08:08:14.458020+0000","last_unstale":"2023-11-05T08:29:20.536162+0000","last_undegraded":"2023-11-05T08:29:20.536162+0000","last_fullsized":"2023-11-05T08:29:20.536162+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T16:29:40.591417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":878,"reported_epoch":928,"state":"active+clean","last_fresh":"2023-11-05T08:29:17.986204+0000","last_change":"2023-11-05T08:08:17.325907+0000","last_active":"2023-11-05T08:29:17.986204+0000","last_peered":"2023-11-05T08:29:17.986204+0000","last_clean":"2023-11-05T08:29:17.986204+0000","last_became_active":"2023-11-05T08:08:17.320483+0000","last_became_peered":"2023-11-05T08:08:17.320483+0000","last_unstale":"2023-11-05T08:29:17.986204+0000","last_undegraded":"2023-11-05T08:29:17.986204+0000","last_fullsized":"2023-11-05T08:29:17.986204+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T08:33:36.614472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":866,"reported_epoch":929,"state":"active+clean","last_fresh":"2023-11-05T08:29:19.976904+0000","last_change":"2023-11-05T08:08:20.224993+0000","last_active":"2023-11-05T08:29:19.976904+0000","last_peered":"2023-11-05T08:29:19.976904+0000","last_clean":"2023-11-05T08:29:19.976904+0000","last_became_active":"2023-11-05T08:08:20.218112+0000","last_became_peered":"2023-11-05T08:08:20.218112+0000","last_unstale":"2023-11-05T08:29:19.976904+0000","last_undegraded":"2023-11-05T08:29:19.976904+0000","last_fullsized":"2023-11-05T08:29:19.976904+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T10:27:58.560760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":113,"num_write_kb":1372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":802816,"data_stored":795680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":0,"up_from":16,"seq":68719477007,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59132,"kb_used_data":5740,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94312708,"statfs":{"total":96636764160,"available":96576212992,"internally_reserved":0,"allocated":5877760,"data_stored":3161489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Nov 5 08:28:43 2023","interfaces":[{"interface":"back","average":{"1min":12.737,"5min":16.405000000000001,"15min":17.103999999999999},"min":{"1min":4.6589999999999998,"5min":4.6589999999999998,"15min":4.5},"max":{"1min":57.667000000000002,"5min":109.83,"15min":214.25299999999999},"last":9.3369999999999997},{"interface":"front","average":{"1min":15.419,"5min":18.902000000000001,"15min":19.364999999999998},"min":{"1min":5.0279999999999996,"5min":5.0279999999999996,"15min":4.6989999999999998},"max":{"1min":92.010000000000005,"5min":171.31999999999999,"15min":252.74000000000001},"last":7.0910000000000002}]},{"osd":2,"last update":"Sun Nov 5 08:28:57 2023","interfaces":[{"interface":"back","average":{"1min":14.499000000000001,"5min":24.434000000000001,"15min":24.056999999999999},"min":{"1min":8.8100000000000005,"5min":6.8419999999999996,"15min":6.3369999999999997},"max":{"1min":31.861999999999998,"5min":147.30199999999999,"15min":227.87100000000001},"last":11.821},{"interface":"front","average":{"1min":16.076000000000001,"5min":28.667000000000002,"15min":28.436},"min":{"1min":9.4179999999999993,"5min":9.0510000000000002,"15min":9.0510000000000002},"max":{"1min":34.857999999999997,"5min":231.124,"15min":343.62599999999998},"last":12.460000000000001}]},{"osd":3,"last update":"Sun Nov 5 08:28:43 2023","interfaces":[{"interface":"back","average":{"1min":21.385999999999999,"5min":27.227,"15min":25.497},"min":{"1min":10.151,"5min":7.6390000000000002,"15min":7.6390000000000002},"max":{"1min":95.622,"5min":165.13900000000001,"15min":242.93899999999999},"last":30.991},{"interface":"front","average":{"1min":14.419,"5min":18.553999999999998,"15min":18.728000000000002},"min":{"1min":8.0359999999999996,"5min":6.7190000000000003,"15min":6.3310000000000004},"max":{"1min":40.043999999999997,"5min":127.40600000000001,"15min":220.85499999999999},"last":22.536999999999999}]},{"osd":4,"last update":"Sun Nov 5 08:28:43 2023","interfaces":[{"interface":"back","average":{"1min":13.835000000000001,"5min":19.640000000000001,"15min":18.901},"min":{"1min":9.0429999999999993,"5min":7.6020000000000003,"15min":6.2830000000000004},"max":{"1min":28.248000000000001,"5min":125.905,"15min":176.929},"last":10.366},{"interface":"front","average":{"1min":17.474,"5min":25.137,"15min":24.228999999999999},"min":{"1min":10.781000000000001,"5min":10.333,"15min":7.7300000000000004},"max":{"1min":39.262,"5min":156.762,"15min":230.40600000000001},"last":26.853000000000002}]},{"osd":5,"last update":"Sun Nov 5 08:28:43 2023","interfaces":[{"interface":"back","average":{"1min":16.065000000000001,"5min":22.399000000000001,"15min":22.742000000000001},"min":{"1min":9.9320000000000004,"5min":7.093,"15min":6.8940000000000001},"max":{"1min":52.027999999999999,"5min":116.42,"15min":266.36099999999999},"last":9.6959999999999997},{"interface":"front","average":{"1min":17.501999999999999,"5min":23.870000000000001,"15min":26.367999999999999},"min":{"1min":11.161,"5min":9.4139999999999997,"15min":9.4139999999999997},"max":{"1min":32.369,"5min":115.401,"15min":260.779},"last":21.030999999999999}]},{"osd":6,"last update":"Sun Nov 5 08:28:43 2023","interfaces":[{"interface":"back","average":{"1min":19.154,"5min":30.417000000000002,"15min":29.405000000000001},"min":{"1min":11.42,"5min":10.246,"15min":10.246},"max":{"1min":37.744999999999997,"5min":147.67599999999999,"15min":280.47199999999998},"last":28.875},{"interface":"front","average":{"1min":15.041,"5min":22.821999999999999,"15min":22.027999999999999},"min":{"1min":7.7000000000000002,"5min":6.5739999999999998,"15min":6.5739999999999998},"max":{"1min":40.978000000000002,"5min":216.12,"15min":216.12},"last":21.898}]},{"osd":7,"last update":"Sun Nov 5 08:28:43 2023","interfaces":[{"interface":"back","average":{"1min":21.381,"5min":34.792999999999999,"15min":29.745999999999999},"min":{"1min":12.074999999999999,"5min":11.266999999999999,"15min":10.122},"max":{"1min":44.856000000000002,"5min":281.70800000000003,"15min":281.70800000000003},"last":26.149000000000001},{"interface":"front","average":{"1min":23.933,"5min":40.325000000000003,"15min":34.375},"min":{"1min":16.882000000000001,"5min":13.933,"15min":13.242000000000001},"max":{"1min":45.856999999999999,"5min":284.21199999999999,"15min":284.21199999999999},"last":29.745999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509711,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59108,"kb_used_data":5712,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94312732,"statfs":{"total":96636764160,"available":96576237568,"internally_reserved":0,"allocated":5849088,"data_stored":3123825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":54655432},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":46,"apply_latency_ms":46,"commit_latency_ns":46000000,"apply_latency_ns":46000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 5 08:28:39 2023","interfaces":[{"interface":"back","average":{"1min":10.744999999999999,"5min":14.304,"15min":22.193000000000001},"min":{"1min":6.8170000000000002,"5min":5.7539999999999996,"15min":4.5739999999999998},"max":{"1min":20.763000000000002,"5min":112.003,"15min":261.80799999999999},"last":5.9930000000000003},{"interface":"front","average":{"1min":9.8160000000000007,"5min":12.709,"15min":21.585999999999999},"min":{"1min":7.25,"5min":4.4930000000000003,"15min":4.4199999999999999},"max":{"1min":15.653,"5min":113.303,"15min":391.05500000000001},"last":24.248999999999999}]},{"osd":1,"last update":"Sun Nov 5 08:28:39 2023","interfaces":[{"interface":"back","average":{"1min":14.669,"5min":18.469999999999999,"15min":25.491},"min":{"1min":8.0709999999999997,"5min":5.4669999999999996,"15min":5.4669999999999996},"max":{"1min":33.857999999999997,"5min":210.03999999999999,"15min":390.67000000000002},"last":28.399999999999999},{"interface":"front","average":{"1min":12.352,"5min":16.792999999999999,"15min":25.196999999999999},"min":{"1min":6.4669999999999996,"5min":6.4669999999999996,"15min":6.4279999999999999},"max":{"1min":29.837,"5min":130.197,"15min":406.154},"last":7.266}]},{"osd":2,"last update":"Sun Nov 5 08:28:55 2023","interfaces":[{"interface":"back","average":{"1min":17.161999999999999,"5min":20.928000000000001,"15min":25.690999999999999},"min":{"1min":8.8300000000000001,"5min":7.508,"15min":7.1920000000000002},"max":{"1min":83.262,"5min":143.93100000000001,"15min":356.27800000000002},"last":25.584},{"interface":"front","average":{"1min":18.815000000000001,"5min":22.913,"15min":28.707000000000001},"min":{"1min":10.121,"5min":9.8279999999999994,"15min":7.9210000000000003},"max":{"1min":60.844999999999999,"5min":147.49600000000001,"15min":394.14999999999998},"last":27.329000000000001}]},{"osd":4,"last update":"Sun Nov 5 08:28:39 2023","interfaces":[{"interface":"back","average":{"1min":14.978999999999999,"5min":23.170000000000002,"15min":27.158000000000001},"min":{"1min":9.3439999999999994,"5min":7.1180000000000003,"15min":6.3609999999999998},"max":{"1min":44.747999999999998,"5min":239.07300000000001,"15min":342.72199999999998},"last":30.724},{"interface":"front","average":{"1min":22.855,"5min":29.050999999999998,"15min":32.917000000000002},"min":{"1min":11.836,"5min":9.673,"15min":9.0600000000000005},"max":{"1min":120.264,"5min":240.12799999999999,"15min":343.30799999999999},"last":32.487000000000002}]},{"osd":5,"last update":"Sun Nov 5 08:28:39 2023","interfaces":[{"interface":"back","average":{"1min":18.943000000000001,"5min":21.934000000000001,"15min":30.952999999999999},"min":{"1min":6.3040000000000003,"5min":6.3040000000000003,"15min":6.3040000000000003},"max":{"1min":74.201999999999998,"5min":132.55199999999999,"15min":412.41300000000001},"last":20.573},{"interface":"front","average":{"1min":16.152999999999999,"5min":17.201000000000001,"15min":27.908999999999999},"min":{"1min":6.6420000000000003,"5min":6.0030000000000001,"15min":6.0030000000000001},"max":{"1min":62.115000000000002,"5min":129.458,"15min":393.334},"last":24.922000000000001}]},{"osd":6,"last update":"Sun Nov 5 08:28:39 2023","interfaces":[{"interface":"back","average":{"1min":17.960000000000001,"5min":25.992999999999999,"15min":33.616},"min":{"1min":11.5,"5min":10.747,"15min":8.5289999999999999},"max":{"1min":29.053000000000001,"5min":197.44399999999999,"15min":395.892},"last":29.710000000000001},{"interface":"front","average":{"1min":17.393999999999998,"5min":25.535,"15min":31.867999999999999},"min":{"1min":10.085000000000001,"5min":10.085000000000001,"15min":7.6959999999999997},"max":{"1min":35.482999999999997,"5min":208.23099999999999,"15min":358.10599999999999},"last":33.755000000000003}]},{"osd":7,"last update":"Sun Nov 5 08:28:39 2023","interfaces":[{"interface":"back","average":{"1min":17.265999999999998,"5min":22.513000000000002,"15min":32.591999999999999},"min":{"1min":11.039,"5min":11.039,"15min":10.02},"max":{"1min":25.888999999999999,"5min":140.971,"15min":346.93299999999999},"last":34.789999999999999},{"interface":"front","average":{"1min":14.869999999999999,"5min":18.747,"15min":29.056999999999999},"min":{"1min":8.8059999999999992,"5min":7.7640000000000002,"15min":7.415},"max":{"1min":22.791,"5min":153.31800000000001,"15min":407.678},"last":22.82}]}]},{"osd":2,"up_from":15,"seq":64424509710,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59108,"kb_used_data":5712,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94312732,"statfs":{"total":96636764160,"available":96576237568,"internally_reserved":0,"allocated":5849088,"data_stored":3123825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":67,"apply_latency_ms":67,"commit_latency_ns":67000000,"apply_latency_ns":67000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 5 08:28:49 2023","interfaces":[{"interface":"back","average":{"1min":11.885,"5min":17.285,"15min":22.297999999999998},"min":{"1min":6.4820000000000002,"5min":6.2279999999999998,"15min":5.0839999999999996},"max":{"1min":24.228000000000002,"5min":115.285,"15min":285.363},"last":9.9559999999999995},{"interface":"front","average":{"1min":16.359000000000002,"5min":22.396999999999998,"15min":28.001999999999999},"min":{"1min":7.1840000000000002,"5min":7.1840000000000002,"15min":7.1840000000000002},"max":{"1min":29.151,"5min":117.806,"15min":342.44999999999999},"last":23.140000000000001}]},{"osd":1,"last update":"Sun Nov 5 08:28:36 2023","interfaces":[{"interface":"back","average":{"1min":15.425000000000001,"5min":21.286999999999999,"15min":23.324000000000002},"min":{"1min":9.875,"5min":9.3350000000000009,"15min":5.8529999999999998},"max":{"1min":29.829999999999998,"5min":204.059,"15min":258.88600000000002},"last":23.949000000000002},{"interface":"front","average":{"1min":11.346,"5min":16.706,"15min":22.780000000000001},"min":{"1min":5.681,"5min":5.681,"15min":5.5030000000000001},"max":{"1min":26.155999999999999,"5min":231.86600000000001,"15min":312.77999999999997},"last":6.4729999999999999}]},{"osd":3,"last update":"Sun Nov 5 08:28:49 2023","interfaces":[{"interface":"back","average":{"1min":25.614000000000001,"5min":21.391999999999999,"15min":23.795999999999999},"min":{"1min":7.7069999999999999,"5min":6.976,"15min":6.2439999999999998},"max":{"1min":204.50800000000001,"5min":204.50800000000001,"15min":292.435},"last":9.3010000000000002},{"interface":"front","average":{"1min":26.190000000000001,"5min":26.041,"15min":29.667000000000002},"min":{"1min":11.888,"5min":10.894,"15min":7.9800000000000004},"max":{"1min":160.86500000000001,"5min":161.327,"15min":288.178},"last":26.855}]},{"osd":4,"last update":"Sun Nov 5 08:28:49 2023","interfaces":[{"interface":"back","average":{"1min":11.77,"5min":14.837,"15min":18.927},"min":{"1min":6.399,"5min":5.8220000000000001,"15min":5.8220000000000001},"max":{"1min":27.553000000000001,"5min":129.64699999999999,"15min":261.12},"last":7.5170000000000003},{"interface":"front","average":{"1min":18.356000000000002,"5min":20.210999999999999,"15min":24.844999999999999},"min":{"1min":11.032,"5min":8.0190000000000001,"15min":7.8559999999999999},"max":{"1min":28.463000000000001,"5min":136.566,"15min":268.09899999999999},"last":13.601000000000001}]},{"osd":5,"last update":"Sun Nov 5 08:28:49 2023","interfaces":[{"interface":"back","average":{"1min":13.5,"5min":16.428999999999998,"15min":21.143000000000001},"min":{"1min":6.8479999999999999,"5min":6.3949999999999996,"15min":6.3159999999999998},"max":{"1min":30.815999999999999,"5min":110.682,"15min":229.387},"last":27.481000000000002},{"interface":"front","average":{"1min":20.343,"5min":24.088000000000001,"15min":27.779},"min":{"1min":11.023,"5min":11.023,"15min":9.8520000000000003},"max":{"1min":38.786999999999999,"5min":118.762,"15min":301.16899999999998},"last":10.542}]},{"osd":6,"last update":"Sun Nov 5 08:28:49 2023","interfaces":[{"interface":"back","average":{"1min":15.603,"5min":24.457999999999998,"15min":27.021999999999998},"min":{"1min":8.4469999999999992,"5min":8.4469999999999992,"15min":8.4469999999999992},"max":{"1min":26.398,"5min":119.38800000000001,"15min":219.01300000000001},"last":11.177},{"interface":"front","average":{"1min":18.614999999999998,"5min":19.393999999999998,"15min":22.059000000000001},"min":{"1min":9.875,"5min":8.7929999999999993,"15min":6.5309999999999997},"max":{"1min":34.994,"5min":111.405,"15min":217.93600000000001},"last":12.709}]},{"osd":7,"last update":"Sun Nov 5 08:28:36 2023","interfaces":[{"interface":"back","average":{"1min":23.518000000000001,"5min":23.989000000000001,"15min":27.620999999999999},"min":{"1min":14.113,"5min":9.9079999999999995,"15min":8.4870000000000001},"max":{"1min":65.971000000000004,"5min":135.114,"15min":263.37099999999998},"last":24.574000000000002},{"interface":"front","average":{"1min":32.572000000000003,"5min":31.068999999999999,"15min":31.628},"min":{"1min":16.792000000000002,"5min":13.923,"15min":9.5540000000000003},"max":{"1min":141.214,"5min":141.214,"15min":258.42000000000002},"last":28.135999999999999}]}]},{"osd":1,"up_from":15,"seq":64424509709,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59544,"kb_used_data":6152,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94312296,"statfs":{"total":96636764160,"available":96575791104,"internally_reserved":0,"allocated":6299648,"data_stored":3575718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 5 08:28:48 2023","interfaces":[{"interface":"back","average":{"1min":28.224,"5min":20.513999999999999,"15min":21.202999999999999},"min":{"1min":6.6360000000000001,"5min":4.2789999999999999,"15min":4.2789999999999999},"max":{"1min":269.49200000000002,"5min":269.49200000000002,"15min":309.815},"last":7.5430000000000001},{"interface":"front","average":{"1min":18.898,"5min":18.010999999999999,"15min":19.018999999999998},"min":{"1min":5.7709999999999999,"5min":4.9089999999999998,"15min":4.4119999999999999},"max":{"1min":140.09,"5min":160.89500000000001,"15min":299.55399999999997},"last":8.7530000000000001}]},{"osd":2,"last update":"Sun Nov 5 08:28:48 2023","interfaces":[{"interface":"back","average":{"1min":36.625,"5min":23.963999999999999,"15min":24.616},"min":{"1min":6.9550000000000001,"5min":6.202,"15min":5.7999999999999998},"max":{"1min":365.68099999999998,"5min":365.68099999999998,"15min":365.68099999999998},"last":10.612},{"interface":"front","average":{"1min":27.253,"5min":24.193000000000001,"15min":24.239000000000001},"min":{"1min":9.2539999999999996,"5min":7.0990000000000002,"15min":6.8899999999999997},"max":{"1min":143.03700000000001,"5min":188.554,"15min":302.49799999999999},"last":11.268000000000001}]},{"osd":3,"last update":"Sun Nov 5 08:28:48 2023","interfaces":[{"interface":"back","average":{"1min":34.058,"5min":26.893999999999998,"15min":27.126000000000001},"min":{"1min":8.4090000000000007,"5min":7.1260000000000003,"15min":6.8019999999999996},"max":{"1min":330.101,"5min":330.101,"15min":334.85599999999999},"last":29.888999999999999},{"interface":"front","average":{"1min":32.119,"5min":27.798999999999999,"15min":28.527999999999999},"min":{"1min":7.673,"5min":7.673,"15min":6.9660000000000002},"max":{"1min":268.80900000000003,"5min":268.80900000000003,"15min":382.089},"last":18.803000000000001}]},{"osd":4,"last update":"Sun Nov 5 08:28:48 2023","interfaces":[{"interface":"back","average":{"1min":35.593000000000004,"5min":24.390999999999998,"15min":23.358000000000001},"min":{"1min":8.1560000000000006,"5min":8.0239999999999991,"15min":6.7220000000000004},"max":{"1min":309.38200000000001,"5min":309.38200000000001,"15min":309.38200000000001},"last":37.332999999999998},{"interface":"front","average":{"1min":20.195,"5min":19.210000000000001,"15min":20.236999999999998},"min":{"1min":7.415,"5min":7.1289999999999996,"15min":6.0750000000000002},"max":{"1min":112.929,"5min":161.56700000000001,"15min":161.56700000000001},"last":25.777000000000001}]},{"osd":5,"last update":"Sun Nov 5 08:28:43 2023","interfaces":[{"interface":"back","average":{"1min":36.268000000000001,"5min":25.178999999999998,"15min":24.058},"min":{"1min":11.022,"5min":8.6549999999999994,"15min":6.1600000000000001},"max":{"1min":312.33699999999999,"5min":312.33699999999999,"15min":312.33699999999999},"last":50.942},{"interface":"front","average":{"1min":23.387,"5min":23.638000000000002,"15min":27.129000000000001},"min":{"1min":11.173999999999999,"5min":10.871,"15min":8.2129999999999992},"max":{"1min":138.23699999999999,"5min":146.816,"15min":297.25299999999999},"last":19.544}]},{"osd":6,"last update":"Sun Nov 5 08:28:43 2023","interfaces":[{"interface":"back","average":{"1min":28.651,"5min":23.355,"15min":26.981999999999999},"min":{"1min":11.853999999999999,"5min":8.3930000000000007,"15min":8.0579999999999998},"max":{"1min":166.16300000000001,"5min":166.16300000000001,"15min":284.84300000000002},"last":21.771000000000001},{"interface":"front","average":{"1min":36.008000000000003,"5min":29.831,"15min":32.936},"min":{"1min":13.599,"5min":12.923999999999999,"15min":12.047000000000001},"max":{"1min":225.93899999999999,"5min":225.93899999999999,"15min":290.81099999999998},"last":24.404}]},{"osd":7,"last update":"Sun Nov 5 08:28:43 2023","interfaces":[{"interface":"back","average":{"1min":20.428000000000001,"5min":23.300000000000001,"15min":31.018999999999998},"min":{"1min":8.9469999999999992,"5min":8.3680000000000003,"15min":8.3680000000000003},"max":{"1min":136.005,"5min":248.667,"15min":248.667},"last":23.172999999999998},{"interface":"front","average":{"1min":38.408999999999999,"5min":28.378,"15min":27.754000000000001},"min":{"1min":12.801,"5min":10.247999999999999,"15min":7.7199999999999998},"max":{"1min":331.02800000000002,"5min":331.02800000000002,"15min":331.02800000000002},"last":42.988999999999997}]}]},{"osd":7,"up_from":14,"seq":60129542414,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":81324,"kb_used_data":5724,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94290516,"statfs":{"total":96636764160,"available":96553488384,"internally_reserved":0,"allocated":5861376,"data_stored":3145105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":77396427},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 5 08:28:46 2023","interfaces":[{"interface":"back","average":{"1min":14.635999999999999,"5min":19.125,"15min":17.983000000000001},"min":{"1min":5.3369999999999997,"5min":4.5030000000000001,"15min":4.3739999999999997},"max":{"1min":92.448999999999998,"5min":198.46799999999999,"15min":198.46799999999999},"last":4.6189999999999998},{"interface":"front","average":{"1min":13.433999999999999,"5min":16.824999999999999,"15min":17.916},"min":{"1min":5.8949999999999996,"5min":5.5869999999999997,"15min":4.4260000000000002},"max":{"1min":65.064999999999998,"5min":129.173,"15min":162.06200000000001},"last":7.319}]},{"osd":1,"last update":"Sun Nov 5 08:28:42 2023","interfaces":[{"interface":"back","average":{"1min":13.074999999999999,"5min":19.145,"15min":23.327999999999999},"min":{"1min":6.7039999999999997,"5min":6.4109999999999996,"15min":5.9939999999999998},"max":{"1min":25.713999999999999,"5min":109.303,"15min":415.255},"last":8.6859999999999999},{"interface":"front","average":{"1min":13.377000000000001,"5min":21.669,"15min":24.067},"min":{"1min":8.0030000000000001,"5min":7.2640000000000002,"15min":6.0999999999999996},"max":{"1min":24.722000000000001,"5min":146.83799999999999,"15min":305.72800000000001},"last":11.137}]},{"osd":2,"last update":"Sun Nov 5 08:28:46 2023","interfaces":[{"interface":"back","average":{"1min":12.632,"5min":19.882999999999999,"15min":24.516999999999999},"min":{"1min":6.8860000000000001,"5min":6.5,"15min":6.5},"max":{"1min":41.588999999999999,"5min":125.071,"15min":196.78100000000001},"last":13.4},{"interface":"front","average":{"1min":14.002000000000001,"5min":21.390000000000001,"15min":23.530999999999999},"min":{"1min":8.2460000000000004,"5min":6.7009999999999996,"15min":6.5410000000000004},"max":{"1min":23.905999999999999,"5min":154.429,"15min":193.77500000000001},"last":11.914999999999999}]},{"osd":3,"last update":"Sun Nov 5 08:28:46 2023","interfaces":[{"interface":"back","average":{"1min":16.510000000000002,"5min":25.837,"15min":28.875},"min":{"1min":9.6649999999999991,"5min":9.1050000000000004,"15min":6.6660000000000004},"max":{"1min":30.847000000000001,"5min":171.90600000000001,"15min":380.88099999999997},"last":16.693000000000001},{"interface":"front","average":{"1min":18.937000000000001,"5min":25.657,"15min":26.742999999999999},"min":{"1min":7.0309999999999997,"5min":7.0309999999999997,"15min":6.3769999999999998},"max":{"1min":46.447000000000003,"5min":143.35499999999999,"15min":233.03},"last":12.787000000000001}]},{"osd":4,"last update":"Sun Nov 5 08:28:42 2023","interfaces":[{"interface":"back","average":{"1min":12.259,"5min":23.219000000000001,"15min":24.393999999999998},"min":{"1min":5.9329999999999998,"5min":5.9329999999999998,"15min":5.9329999999999998},"max":{"1min":35.728999999999999,"5min":158.124,"15min":215.60499999999999},"last":10.308999999999999},{"interface":"front","average":{"1min":14.186,"5min":26.652000000000001,"15min":27.027999999999999},"min":{"1min":7.6790000000000003,"5min":7.6790000000000003,"15min":7.6790000000000003},"max":{"1min":25.98,"5min":158.79300000000001,"15min":347.35199999999998},"last":15.49}]},{"osd":5,"last update":"Sun Nov 5 08:28:42 2023","interfaces":[{"interface":"back","average":{"1min":15.875999999999999,"5min":26.494,"15min":28.981999999999999},"min":{"1min":7.8410000000000002,"5min":7.8410000000000002,"15min":7.7199999999999998},"max":{"1min":43.951999999999998,"5min":156.44,"15min":283.54300000000001},"last":47.112000000000002},{"interface":"front","average":{"1min":15.382999999999999,"5min":23.811,"15min":27.538},"min":{"1min":7.4290000000000003,"5min":6.5890000000000004,"15min":6.5890000000000004},"max":{"1min":34.548000000000002,"5min":168.31800000000001,"15min":582.69899999999996},"last":38.107999999999997}]},{"osd":6,"last update":"Sun Nov 5 08:28:42 2023","interfaces":[{"interface":"back","average":{"1min":18.151,"5min":25.055,"15min":26.518000000000001},"min":{"1min":12.026,"5min":9.218,"15min":8.7300000000000004},"max":{"1min":28.806000000000001,"5min":140.654,"15min":228.97200000000001},"last":18.614000000000001},{"interface":"front","average":{"1min":17.321000000000002,"5min":24.378,"15min":24.873000000000001},"min":{"1min":8.4280000000000008,"5min":7.806,"15min":7.1740000000000004},"max":{"1min":45.408999999999999,"5min":132.90199999999999,"15min":203.364},"last":16.001000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542415,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77544,"kb_used_data":6104,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94294296,"statfs":{"total":96636764160,"available":96557359104,"internally_reserved":0,"allocated":6250496,"data_stored":3521665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":62,"apply_latency_ms":62,"commit_latency_ns":62000000,"apply_latency_ns":62000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 5 08:28:41 2023","interfaces":[{"interface":"back","average":{"1min":13.449,"5min":11.827999999999999,"15min":17.780000000000001},"min":{"1min":5.0229999999999997,"5min":4.8460000000000001,"15min":4.3799999999999999},"max":{"1min":73.667000000000002,"5min":73.667000000000002,"15min":258.09699999999998},"last":7.0339999999999998},{"interface":"front","average":{"1min":17.407,"5min":17.596,"15min":21.952999999999999},"min":{"1min":8.6270000000000007,"5min":4.1600000000000001,"15min":4.1600000000000001},"max":{"1min":76.629000000000005,"5min":231.863,"15min":278.45499999999998},"last":26.381}]},{"osd":1,"last update":"Sun Nov 5 08:28:41 2023","interfaces":[{"interface":"back","average":{"1min":22.600999999999999,"5min":20.210999999999999,"15min":20.777999999999999},"min":{"1min":6.5510000000000002,"5min":6.1609999999999996,"15min":4.351},"max":{"1min":77.555000000000007,"5min":304.47800000000001,"15min":304.47800000000001},"last":9.2430000000000003},{"interface":"front","average":{"1min":23.942,"5min":22.003,"15min":24.678000000000001},"min":{"1min":9.0899999999999999,"5min":6.4649999999999999,"15min":6.2430000000000003},"max":{"1min":89.457999999999998,"5min":167.91900000000001,"15min":286.233},"last":23.526}]},{"osd":2,"last update":"Sun Nov 5 08:28:41 2023","interfaces":[{"interface":"back","average":{"1min":22.696999999999999,"5min":20.16,"15min":22.661999999999999},"min":{"1min":8.1959999999999997,"5min":6.3970000000000002,"15min":5.1210000000000004},"max":{"1min":101.61799999999999,"5min":224.57900000000001,"15min":224.57900000000001},"last":9.9499999999999993},{"interface":"front","average":{"1min":26.762,"5min":23.725000000000001,"15min":27.760999999999999},"min":{"1min":11.435,"5min":7.476,"15min":5.5549999999999997},"max":{"1min":95.575999999999993,"5min":185.56299999999999,"15min":327.26100000000002},"last":21.213999999999999}]},{"osd":3,"last update":"Sun Nov 5 08:28:41 2023","interfaces":[{"interface":"back","average":{"1min":24.623000000000001,"5min":23.707000000000001,"15min":23.678999999999998},"min":{"1min":7.8780000000000001,"5min":6.0629999999999997,"15min":6.0629999999999997},"max":{"1min":90.995999999999995,"5min":192.482,"15min":283.94099999999997},"last":12.09},{"interface":"front","average":{"1min":27.146000000000001,"5min":24.620999999999999,"15min":24.513999999999999},"min":{"1min":12.201000000000001,"5min":8.859,"15min":6.2729999999999997},"max":{"1min":86.838999999999999,"5min":167.28899999999999,"15min":284.72699999999998},"last":19.867000000000001}]},{"osd":4,"last update":"Sun Nov 5 08:28:41 2023","interfaces":[{"interface":"back","average":{"1min":22.033000000000001,"5min":21.033999999999999,"15min":22.164999999999999},"min":{"1min":10.708,"5min":9.3059999999999992,"15min":6.7409999999999997},"max":{"1min":98.747,"5min":98.747,"15min":244.86099999999999},"last":12.996},{"interface":"front","average":{"1min":12.505000000000001,"5min":14.978,"15min":20.456},"min":{"1min":5.8739999999999997,"5min":5.8739999999999997,"15min":5.8739999999999997},"max":{"1min":53.558,"5min":112.798,"15min":277.55700000000002},"last":8.3460000000000001}]},{"osd":6,"last update":"Sun Nov 5 08:28:41 2023","interfaces":[{"interface":"back","average":{"1min":15.161,"5min":20.539999999999999,"15min":24.504000000000001},"min":{"1min":7.093,"5min":7.093,"15min":5.7930000000000001},"max":{"1min":59.149000000000001,"5min":242.536,"15min":242.536},"last":30.408000000000001},{"interface":"front","average":{"1min":25.109000000000002,"5min":26.298999999999999,"15min":27.393999999999998},"min":{"1min":9.1289999999999996,"5min":7.6870000000000003,"15min":7.0300000000000002},"max":{"1min":85.906000000000006,"5min":227.50299999999999,"15min":310.69099999999997},"last":11.214}]},{"osd":7,"last update":"Sun Nov 5 08:28:41 2023","interfaces":[{"interface":"back","average":{"1min":26.856000000000002,"5min":23.469000000000001,"15min":27.475999999999999},"min":{"1min":11.613,"5min":8.7769999999999992,"15min":8.2379999999999995},"max":{"1min":100.372,"5min":119.51900000000001,"15min":281.71199999999999},"last":24.282},{"interface":"front","average":{"1min":26.722000000000001,"5min":23.254999999999999,"15min":29.834},"min":{"1min":9.8550000000000004,"5min":8.0860000000000003,"15min":8.0860000000000003},"max":{"1min":90.287999999999997,"5min":94.194999999999993,"15min":319.786},"last":20.565000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542416,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63368,"kb_used_data":5812,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94308472,"statfs":{"total":96636764160,"available":96571875328,"internally_reserved":0,"allocated":5951488,"data_stored":3235217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":44,"apply_latency_ms":44,"commit_latency_ns":44000000,"apply_latency_ns":44000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 5 08:28:35 2023","interfaces":[{"interface":"back","average":{"1min":9.3810000000000002,"5min":13.75,"15min":20.544},"min":{"1min":5.633,"5min":5.0940000000000003,"15min":5.0069999999999997},"max":{"1min":27.414000000000001,"5min":75.152000000000001,"15min":243.626},"last":13.266},{"interface":"front","average":{"1min":15.006,"5min":19.321000000000002,"15min":24.324999999999999},"min":{"1min":9.4640000000000004,"5min":5.7199999999999998,"15min":5.7199999999999998},"max":{"1min":30.917000000000002,"5min":132.78899999999999,"15min":202.49000000000001},"last":16.559999999999999}]},{"osd":1,"last update":"Sun Nov 5 08:28:35 2023","interfaces":[{"interface":"back","average":{"1min":12.646000000000001,"5min":16.113,"15min":21.669},"min":{"1min":5.4790000000000001,"5min":4.5709999999999997,"15min":4.274},"max":{"1min":24.260000000000002,"5min":162.90799999999999,"15min":369.267},"last":19.465},{"interface":"front","average":{"1min":9.8100000000000005,"5min":15.993,"15min":24.495999999999999},"min":{"1min":5.4930000000000003,"5min":5.4930000000000003,"15min":5.4930000000000003},"max":{"1min":25.135000000000002,"5min":157.459,"15min":340.214},"last":40.164000000000001}]},{"osd":2,"last update":"Sun Nov 5 08:28:35 2023","interfaces":[{"interface":"back","average":{"1min":15.661,"5min":21.771000000000001,"15min":27.968},"min":{"1min":7.2199999999999998,"5min":6.7750000000000004,"15min":6.7750000000000004},"max":{"1min":31.937000000000001,"5min":192.44999999999999,"15min":241.934},"last":17.786000000000001},{"interface":"front","average":{"1min":14.156000000000001,"5min":20.931000000000001,"15min":26.690999999999999},"min":{"1min":6.5110000000000001,"5min":6.5110000000000001,"15min":6.3109999999999999},"max":{"1min":26.538,"5min":183.47900000000001,"15min":368.279},"last":6.6669999999999998}]},{"osd":3,"last update":"Sun Nov 5 08:28:35 2023","interfaces":[{"interface":"back","average":{"1min":13.609999999999999,"5min":19.948,"15min":24.542000000000002},"min":{"1min":7.9960000000000004,"5min":6.6680000000000001,"15min":6.1200000000000001},"max":{"1min":57.084000000000003,"5min":164.06399999999999,"15min":369.53399999999999},"last":10.368},{"interface":"front","average":{"1min":18.161000000000001,"5min":24.800000000000001,"15min":32.271000000000001},"min":{"1min":6.8920000000000003,"5min":6.8920000000000003,"15min":6.8920000000000003},"max":{"1min":55.741,"5min":196.655,"15min":371.52499999999998},"last":18.779}]},{"osd":5,"last update":"Sun Nov 5 08:28:35 2023","interfaces":[{"interface":"back","average":{"1min":18.956,"5min":26.338000000000001,"15min":32.387999999999998},"min":{"1min":12.984,"5min":8.4469999999999992,"15min":7.0010000000000003},"max":{"1min":35.478999999999999,"5min":202.82900000000001,"15min":283.08100000000002},"last":20.763999999999999},{"interface":"front","average":{"1min":15.491,"5min":25.239999999999998,"15min":27.282},"min":{"1min":9.4550000000000001,"5min":6.6219999999999999,"15min":6.3010000000000002},"max":{"1min":28.989999999999998,"5min":264.10300000000001,"15min":283.94400000000002},"last":8.4329999999999998}]},{"osd":6,"last update":"Sun Nov 5 08:28:35 2023","interfaces":[{"interface":"back","average":{"1min":18.690999999999999,"5min":19.449999999999999,"15min":26.378},"min":{"1min":7.7930000000000001,"5min":7.1740000000000004,"15min":6.4359999999999999},"max":{"1min":122.85899999999999,"5min":165.113,"15min":324.98200000000003},"last":14.554},{"interface":"front","average":{"1min":24.279,"5min":26.126000000000001,"15min":31.824000000000002},"min":{"1min":9.5470000000000006,"5min":9.5470000000000006,"15min":8.5890000000000004},"max":{"1min":125.249,"5min":205.83199999999999,"15min":288.26799999999997},"last":21.827000000000002}]},{"osd":7,"last update":"Sun Nov 5 08:28:35 2023","interfaces":[{"interface":"back","average":{"1min":17.625,"5min":26.843,"15min":29.835999999999999},"min":{"1min":8.8219999999999992,"5min":7.7009999999999996,"15min":7.1559999999999997},"max":{"1min":43.206000000000003,"5min":211.39400000000001,"15min":356.44600000000003},"last":11.589},{"interface":"front","average":{"1min":20.716999999999999,"5min":27.966000000000001,"15min":30.741},"min":{"1min":13.167999999999999,"5min":9.7159999999999993,"15min":9.7159999999999993},"max":{"1min":41.866999999999997,"5min":208.833,"15min":327.53800000000001},"last":15.785}]}]},{"osd":6,"up_from":13,"seq":55834575117,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59208,"kb_used_data":5816,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94312632,"statfs":{"total":96636764160,"available":96576135168,"internally_reserved":0,"allocated":5955584,"data_stored":3244032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":49,"apply_latency_ms":49,"commit_latency_ns":49000000,"apply_latency_ns":49000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 5 08:28:46 2023","interfaces":[{"interface":"back","average":{"1min":16.972999999999999,"5min":17.661999999999999,"15min":18.792000000000002},"min":{"1min":4.7169999999999996,"5min":4.1600000000000001,"15min":4.1600000000000001},"max":{"1min":98.253,"5min":165.51900000000001,"15min":187.75899999999999},"last":10.476000000000001},{"interface":"front","average":{"1min":20.254999999999999,"5min":18.486999999999998,"15min":18.247},"min":{"1min":6.7910000000000004,"5min":5.3049999999999997,"15min":4.6790000000000003},"max":{"1min":119.42100000000001,"5min":168.239,"15min":185.38200000000001},"last":12.847}]},{"osd":1,"last update":"Sun Nov 5 08:28:46 2023","interfaces":[{"interface":"back","average":{"1min":17.149000000000001,"5min":23.170000000000002,"15min":24.638999999999999},"min":{"1min":8.7639999999999993,"5min":5.4720000000000004,"15min":5.4720000000000004},"max":{"1min":57.432000000000002,"5min":226.23500000000001,"15min":286.072},"last":20.571999999999999},{"interface":"front","average":{"1min":17.667999999999999,"5min":20.977,"15min":23.52},"min":{"1min":8.1519999999999992,"5min":5.6980000000000004,"15min":5.6980000000000004},"max":{"1min":72.725999999999999,"5min":168.25899999999999,"15min":309.512},"last":9.7400000000000002}]},{"osd":2,"last update":"Sun Nov 5 08:28:46 2023","interfaces":[{"interface":"back","average":{"1min":18.177,"5min":23.372,"15min":24.986999999999998},"min":{"1min":7.9550000000000001,"5min":7.0030000000000001,"15min":6.6390000000000002},"max":{"1min":63.627000000000002,"5min":177.25,"15min":244.21100000000001},"last":15.42},{"interface":"front","average":{"1min":22.576000000000001,"5min":31.414000000000001,"15min":29.402999999999999},"min":{"1min":10.571999999999999,"5min":9.4179999999999993,"15min":8.8000000000000007},"max":{"1min":86.832999999999998,"5min":335.95100000000002,"15min":335.95100000000002},"last":17.521999999999998}]},{"osd":3,"last update":"Sun Nov 5 08:28:46 2023","interfaces":[{"interface":"back","average":{"1min":13.595000000000001,"5min":21.442,"15min":26.722000000000001},"min":{"1min":6.5359999999999996,"5min":6.4909999999999997,"15min":6.4909999999999997},"max":{"1min":55.103999999999999,"5min":175.47300000000001,"15min":372.54199999999997},"last":7.3789999999999996},{"interface":"front","average":{"1min":26.343,"5min":22.968,"15min":21.238},"min":{"1min":11.815,"5min":6.2000000000000002,"15min":6.0069999999999997},"max":{"1min":113.185,"5min":152.446,"15min":273.34300000000002},"last":16.245000000000001}]},{"osd":4,"last update":"Sun Nov 5 08:28:46 2023","interfaces":[{"interface":"back","average":{"1min":20.216000000000001,"5min":19.321000000000002,"15min":19.097000000000001},"min":{"1min":8.0090000000000003,"5min":6.468,"15min":6.468},"max":{"1min":91.988,"5min":138.107,"15min":211},"last":16.884},{"interface":"front","average":{"1min":22.460000000000001,"5min":22.382999999999999,"15min":22.785},"min":{"1min":7.6790000000000003,"5min":7.6790000000000003,"15min":7.5670000000000002},"max":{"1min":90.873000000000005,"5min":178.578,"15min":255.61600000000001},"last":21.669}]},{"osd":5,"last update":"Sun Nov 5 08:28:46 2023","interfaces":[{"interface":"back","average":{"1min":27.132999999999999,"5min":21.550999999999998,"15min":27.628},"min":{"1min":6.4169999999999998,"5min":6.4169999999999998,"15min":6.4169999999999998},"max":{"1min":114.03400000000001,"5min":121.566,"15min":915.64300000000003},"last":8.4870000000000001},{"interface":"front","average":{"1min":35.225999999999999,"5min":28.045000000000002,"15min":34.017000000000003},"min":{"1min":11.31,"5min":11.31,"15min":8.8079999999999998},"max":{"1min":171.06899999999999,"5min":171.06899999999999,"15min":928.67899999999997},"last":19.628}]},{"osd":7,"last update":"Sun Nov 5 08:28:46 2023","interfaces":[{"interface":"back","average":{"1min":26.385000000000002,"5min":22.568000000000001,"15min":23.834},"min":{"1min":10.788,"5min":7.3730000000000002,"15min":7.3730000000000002},"max":{"1min":128.999,"5min":167.63800000000001,"15min":212.917},"last":22.367000000000001},{"interface":"front","average":{"1min":23.076000000000001,"5min":22.853000000000002,"15min":25.146000000000001},"min":{"1min":8.8940000000000001,"5min":8.609,"15min":7.3259999999999996},"max":{"1min":118.515,"5min":182.375,"15min":222.44499999999999},"last":11.186}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-05T08:29:23.792 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-05T08:29:23.899 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.899+0000 7f9108b05640 10 monclient: get_monmap_and_config 2023-11-05T08:29:23.900 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.899+0000 7f9108b05640 10 monclient: build_initial_monmap 2023-11-05T08:29:23.900 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.899+0000 7f9108b05640 10 monclient: monmap: 2023-11-05T08:29:23.900 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:29:23.900 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:23.901 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:29:23.900215+0000 2023-11-05T08:29:23.901 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:29:23.900215+0000 2023-11-05T08:29:23.901 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:29:23.901 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:23.902 INFO:teuthology.orchestra.run.smithi052.stderr:0: v1:172.21.15.52:6789/0 mon.noname-a-legacy 2023-11-05T08:29:23.902 INFO:teuthology.orchestra.run.smithi052.stderr:1: v1:172.21.15.156:6789/0 mon.noname-c-legacy 2023-11-05T08:29:23.902 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-b 2023-11-05T08:29:23.902 INFO:teuthology.orchestra.run.smithi052.stderr:3: v2:172.21.15.52:3300/0 mon.noname-a 2023-11-05T08:29:23.902 INFO:teuthology.orchestra.run.smithi052.stderr:4: v2:172.21.15.156:3300/0 mon.noname-c 2023-11-05T08:29:23.903 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:23.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.900+0000 7f9108b05640 1 Processor -- start 2023-11-05T08:29:23.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.900+0000 7f9108b05640 1 -- start start 2023-11-05T08:29:23.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.900+0000 7f9108b05640 10 monclient: init 2023-11-05T08:29:23.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.900+0000 7f9108b05640 10 monclient: _reopen_session rank -1 2023-11-05T08:29:23.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.900+0000 7f9108b05640 10 monclient: _add_conns ranks=[4,1,3,2,0] 2023-11-05T08:29:23.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.900+0000 7f9108b05640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f91040ae4d0 0x7f91040712c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:23.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.900+0000 7f9108b05640 10 monclient(hunting): picked mon.noname-c con 0x7f91040ae4d0 addr v2:172.21.15.156:3300/0 2023-11-05T08:29:23.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.900+0000 7f9108b05640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f91040abe60 addr v1:172.21.15.156:6789/0 2023-11-05T08:29:23.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.900+0000 7f9108b05640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f91040ac860 0x7f910413b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:23.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.900+0000 7f9108b05640 10 monclient(hunting): picked mon.noname-a con 0x7f91040ac860 addr v2:172.21.15.52:3300/0 2023-11-05T08:29:23.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.900+0000 7f9108b05640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f910413e500 con 0x7f91040abe60 2023-11-05T08:29:23.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.900+0000 7f9108b05640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:23.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.900+0000 7f9108b05640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91040ae8b0 con 0x7f91040ac860 2023-11-05T08:29:23.908 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.900+0000 7f9108b05640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:23.908 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.900+0000 7f9108b05640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91040ac340 con 0x7f91040ae4d0 2023-11-05T08:29:23.908 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.900+0000 7f9108b05640 10 monclient(hunting): _renew_subs 2023-11-05T08:29:23.908 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.900+0000 7f9108b05640 10 monclient(hunting): authenticate will time out at 2710.105851s 2023-11-05T08:29:23.908 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.901+0000 7f9102d9d640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f91040ac860 0x7f910413b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:23.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.901+0000 7f910259c640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f91040ae4d0 0x7f91040712c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:23.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.901+0000 7f9102d9d640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f91040ac860 0x7f910413b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42758/0 (socket says 172.21.15.52:42758) 2023-11-05T08:29:23.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.901+0000 7f9102d9d640 1 -- 172.21.15.52:0/3539888908 learned_addr learned my addr 172.21.15.52:0/3539888908 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-11-05T08:29:23.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.901+0000 7f9102d9d640 10 monclient(hunting): get_auth_request con 0x7f91040ac860 auth_method 0 2023-11-05T08:29:23.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.901+0000 7f9102d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:29:23.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.901+0000 7f9102d9d640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:29:23.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.901+0000 7f9102d9d640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:29:23.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.902+0000 7f910259c640 10 monclient(hunting): get_auth_request con 0x7f91040ae4d0 auth_method 0 2023-11-05T08:29:23.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.902+0000 7f910259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:29:23.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.902+0000 7f910259c640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:29:23.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.902+0000 7f910259c640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:29:23.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.902+0000 7f9102d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:29:23.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.902+0000 7f9102d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:29:23.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.902+0000 7f9102d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:29:23.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.902+0000 7f910259c640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:29:23.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.902+0000 7f910259c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:29:23.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.902+0000 7f910259c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:29:23.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.904+0000 7f9102d9d640 10 monclient(hunting): handle_auth_done global_id 15681 payload 274 2023-11-05T08:29:23.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.904+0000 7f9102d9d640 1 -- 172.21.15.52:0/3539888908 >> v2:172.21.15.156:3300/0 conn(0x7f91040ae4d0 msgr2=0x7f91040712c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-05T08:29:23.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.904+0000 7f9102d9d640 1 --2- 172.21.15.52:0/3539888908 >> v2:172.21.15.156:3300/0 conn(0x7f91040ae4d0 0x7f91040712c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:23.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.904+0000 7f9102d9d640 1 -- 172.21.15.52:0/3539888908 >> v1:172.21.15.156:6789/0 conn(0x7f91040abe60 legacy=0x7f910413ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:23.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.904+0000 7f9102d9d640 10 monclient: _finish_hunting 0 2023-11-05T08:29:23.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.904+0000 7f9102d9d640 1 monclient: found mon.noname-a 2023-11-05T08:29:23.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.904+0000 7f9102d9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:29:23.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.904+0000 7f9102d9d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.52:3300/0 2023-11-05T08:29:23.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.904+0000 7f9102d9d640 1 -- 172.21.15.52:0/3539888908 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91040ad040 con 0x7f91040ac860 2023-11-05T08:29:23.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.906+0000 7f9102d9d640 1 --2- 172.21.15.52:0/3539888908 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91040ac860 0x7f910413b130 secure :-1 s=READY pgs=3046 cs=0 l=1 rev1=1 crypto rx=0x7f910406c160 tx=0x7f90fc02be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b63bc1c54174313 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:29:23.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.909+0000 7f9101d9b640 1 -- 172.21.15.52:0/3539888908 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90fc02c9f0 con 0x7f91040ac860 2023-11-05T08:29:23.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.909+0000 7f9101d9b640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:29:23.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.909+0000 7f9101d9b640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-11-05T08:29:23.919 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.909+0000 7f9101d9b640 10 monclient: dump: 2023-11-05T08:29:23.919 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:29:23.919 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:23.919 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:23.920 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:23.920 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:29:23.920 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:23.920 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:29:23.920 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:29:23.921 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:29:23.921 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:23.921 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.909+0000 7f9101d9b640 10 monclient: _finish_auth 0 2023-11-05T08:29:23.921 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.909+0000 7f9101d9b640 10 monclient: _check_auth_tickets 2023-11-05T08:29:23.922 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.909+0000 7f9101d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:29:23.922 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.909+0000 7f9108b05640 5 monclient: authenticate success, global_id 15681 2023-11-05T08:29:23.922 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.909+0000 7f9108b05640 20 monclient: get_monmap_and_config waiting for monmap|config 2023-11-05T08:29:23.922 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.909+0000 7f9101d9b640 1 -- 172.21.15.52:0/3539888908 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90fc02cb50 con 0x7f91040ac860 2023-11-05T08:29:23.922 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.909+0000 7f9101d9b640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:29:23.923 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.909+0000 7f9101d9b640 1 -- 172.21.15.52:0/3539888908 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90fc0343f0 con 0x7f91040ac860 2023-11-05T08:29:23.923 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.909+0000 7f9108b05640 10 monclient: get_monmap_and_config success 2023-11-05T08:29:23.923 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.909+0000 7f9108b05640 4 set_mon_vals no callback set 2023-11-05T08:29:23.923 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.909+0000 7f9101d9b640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:29:23.924 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.909+0000 7f9101d9b640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-11-05T08:29:23.924 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.909+0000 7f9101d9b640 10 monclient: dump: 2023-11-05T08:29:23.924 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:29:23.924 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:23.924 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:23.925 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:23.925 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:29:23.925 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:23.925 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:29:23.925 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:29:23.926 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:29:23.926 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:23.926 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.910+0000 7f9108b05640 10 monclient: shutdown 2023-11-05T08:29:23.926 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.910+0000 7f9108b05640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:29:23.926 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.910+0000 7f9108b05640 1 -- 172.21.15.52:0/3539888908 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91040ac860 msgr2=0x7f910413b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:23.927 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.910+0000 7f9108b05640 1 --2- 172.21.15.52:0/3539888908 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91040ac860 0x7f910413b130 secure :-1 s=READY pgs=3046 cs=0 l=1 rev1=1 crypto rx=0x7f910406c160 tx=0x7f90fc02be50 comp rx=0 tx=0).stop 2023-11-05T08:29:23.927 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.910+0000 7f9108b05640 1 -- 172.21.15.52:0/3539888908 shutdown_connections 2023-11-05T08:29:23.927 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.910+0000 7f9108b05640 1 --2- 172.21.15.52:0/3539888908 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91040ac860 0x7f910413b130 unknown :-1 s=CLOSED pgs=3046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:23.927 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.910+0000 7f9108b05640 1 --2- 172.21.15.52:0/3539888908 >> v2:172.21.15.156:3300/0 conn(0x7f91040ae4d0 0x7f91040712c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:23.927 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.910+0000 7f9108b05640 1 -- 172.21.15.52:0/3539888908 >> 172.21.15.52:0/3539888908 conn(0x7f91040b2ff0 msgr2=0x7f91040b3400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:29:23.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.910+0000 7f9108b05640 1 -- 172.21.15.52:0/3539888908 shutdown_connections 2023-11-05T08:29:23.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.910+0000 7f9108b05640 1 -- 172.21.15.52:0/3539888908 wait complete. 2023-11-05T08:29:23.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.911+0000 7f9108b05640 10 monclient: build_initial_monmap 2023-11-05T08:29:23.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.911+0000 7f9108b05640 10 monclient: monmap: 2023-11-05T08:29:23.928 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:29:23.929 INFO:teuthology.orchestra.run.smithi052.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-05T08:29:23.929 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 0.000000 2023-11-05T08:29:23.929 INFO:teuthology.orchestra.run.smithi052.stderr:created 0.000000 2023-11-05T08:29:23.929 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:29:23.929 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:23.929 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.noname-a 2023-11-05T08:29:23.930 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.noname-b 2023-11-05T08:29:23.930 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-c 2023-11-05T08:29:23.930 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:23.930 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.911+0000 7f9108b05640 1 librados: starting msgr at 2023-11-05T08:29:23.930 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.911+0000 7f9108b05640 1 librados: starting objecter 2023-11-05T08:29:23.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.911+0000 7f9108b05640 1 Processor -- start 2023-11-05T08:29:23.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.911+0000 7f9108b05640 1 -- start start 2023-11-05T08:29:23.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.911+0000 7f9108b05640 1 librados: setting wanted keys 2023-11-05T08:29:23.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.911+0000 7f9108b05640 1 librados: calling monclient init 2023-11-05T08:29:23.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.911+0000 7f9108b05640 10 monclient: init 2023-11-05T08:29:23.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.912+0000 7f9108b05640 10 monclient: _reopen_session rank -1 2023-11-05T08:29:23.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.912+0000 7f9108b05640 10 monclient: _add_conns ranks=[1,2,0] 2023-11-05T08:29:23.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.912+0000 7f9108b05640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f91040abe60 0x7f9104131ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:23.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.912+0000 7f9108b05640 10 monclient(hunting): picked mon.noname-b con 0x7f91040abe60 addr [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] 2023-11-05T08:29:23.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.912+0000 7f9108b05640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f91040ac860 0x7f910413c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:23.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.912+0000 7f9108b05640 10 monclient(hunting): picked mon.noname-c con 0x7f91040ac860 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:29:23.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.912+0000 7f9108b05640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91040ae4d0 0x7f910413ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:23.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.912+0000 7f9108b05640 10 monclient(hunting): picked mon.noname-a con 0x7f91040ae4d0 addr [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] 2023-11-05T08:29:23.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.912+0000 7f9108b05640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:23.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.912+0000 7f9108b05640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f910413bf00 con 0x7f91040ae4d0 2023-11-05T08:29:23.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.912+0000 7f9108b05640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:23.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.912+0000 7f9108b05640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f910413bc60 con 0x7f91040abe60 2023-11-05T08:29:23.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.912+0000 7f9108b05640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:23.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.912+0000 7f9108b05640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f910414a550 con 0x7f91040ac860 2023-11-05T08:29:23.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.912+0000 7f9108b05640 10 monclient(hunting): _renew_subs 2023-11-05T08:29:23.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.912+0000 7f9108b05640 10 monclient(hunting): authenticate will time out at 2710.117386s 2023-11-05T08:29:23.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.912+0000 7f9102d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91040ae4d0 0x7f910413ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:23.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.913+0000 7f90f9d9b640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f91040ac860 0x7f910413c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:23.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.913+0000 7f9102d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91040ae4d0 0x7f910413ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42770/0 (socket says 172.21.15.52:42770) 2023-11-05T08:29:23.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.913+0000 7f9102d9d640 1 -- 172.21.15.52:0/3381700665 learned_addr learned my addr 172.21.15.52:0/3381700665 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-11-05T08:29:23.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.913+0000 7f9102d9d640 10 monclient(hunting): get_auth_request con 0x7f91040ae4d0 auth_method 0 2023-11-05T08:29:23.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.913+0000 7f9102d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:29:23.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.913+0000 7f9102d9d640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:29:23.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.913+0000 7f9102d9d640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:29:23.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.913+0000 7f910259c640 1 --2- 172.21.15.52:0/3381700665 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f91040abe60 0x7f9104131ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:23.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.913+0000 7f90f9d9b640 10 monclient(hunting): get_auth_request con 0x7f91040ac860 auth_method 0 2023-11-05T08:29:23.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.913+0000 7f90f9d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:29:23.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.913+0000 7f90f9d9b640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:29:23.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.913+0000 7f90f9d9b640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:29:23.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.913+0000 7f910259c640 10 monclient(hunting): get_auth_request con 0x7f91040abe60 auth_method 0 2023-11-05T08:29:23.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.913+0000 7f910259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:29:23.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.913+0000 7f910259c640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:29:23.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.913+0000 7f910259c640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:29:23.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.913+0000 7f9102d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:29:23.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.913+0000 7f9102d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:29:23.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.913+0000 7f9102d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:29:23.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.914+0000 7f910259c640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:29:23.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.914+0000 7f910259c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:29:23.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.914+0000 7f910259c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:29:23.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.914+0000 7f90f9d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:29:23.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.914+0000 7f90f9d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:29:23.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.914+0000 7f90f9d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:29:23.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.916+0000 7f910259c640 10 monclient(hunting): handle_auth_done global_id 20686 payload 824 2023-11-05T08:29:23.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.916+0000 7f910259c640 1 -- 172.21.15.52:0/3381700665 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f91040ac860 msgr2=0x7f910413c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:23.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.916+0000 7f910259c640 1 --2- 172.21.15.52:0/3381700665 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f91040ac860 0x7f910413c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:23.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.916+0000 7f910259c640 1 -- 172.21.15.52:0/3381700665 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91040ae4d0 msgr2=0x7f910413ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:23.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.916+0000 7f910259c640 1 --2- 172.21.15.52:0/3381700665 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91040ae4d0 0x7f910413ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:23.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.916+0000 7f910259c640 10 monclient: _finish_hunting 0 2023-11-05T08:29:23.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.916+0000 7f910259c640 1 monclient: found mon.noname-b 2023-11-05T08:29:23.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.916+0000 7f910259c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:29:23.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.916+0000 7f910259c640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.156:3300/0 2023-11-05T08:29:23.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.916+0000 7f910259c640 1 -- 172.21.15.52:0/3381700665 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90fc009b30 con 0x7f91040abe60 2023-11-05T08:29:23.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.916+0000 7f9102d9d640 1 --2- 172.21.15.52:0/3381700665 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91040ae4d0 0x7f910413ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-05T08:29:23.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.919+0000 7f910259c640 1 --2- 172.21.15.52:0/3381700665 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f91040abe60 0x7f9104131ee0 secure :-1 s=READY pgs=4993 cs=0 l=1 rev1=1 crypto rx=0x7f90f400e870 tx=0x7f90f400ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:29:23.944 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.919+0000 7f90fb7fe640 10 client.?.objecter ms_handle_connect 0x7f91040abe60 2023-11-05T08:29:23.944 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.919+0000 7f90fb7fe640 10 client.?.objecter resend_mon_ops 2023-11-05T08:29:23.944 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.922+0000 7f90fb7fe640 1 -- 172.21.15.52:0/3381700665 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90f400ee60 con 0x7f91040abe60 2023-11-05T08:29:23.944 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.922+0000 7f90fb7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:29:23.944 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.922+0000 7f90fb7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-05T08:29:23.945 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.922+0000 7f90fb7fe640 10 monclient: dump: 2023-11-05T08:29:23.945 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:29:23.945 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:23.945 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:23.945 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:23.946 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:29:23.946 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:23.946 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:29:23.946 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:29:23.946 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:29:23.947 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:23.947 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.922+0000 7f90fb7fe640 10 monclient: _finish_auth 0 2023-11-05T08:29:23.947 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.922+0000 7f90fb7fe640 10 monclient: _check_auth_tickets 2023-11-05T08:29:23.947 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.922+0000 7f90fb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:29:23.947 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.922+0000 7f90fb7fe640 1 -- 172.21.15.52:0/3381700665 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90f400c940 con 0x7f91040abe60 2023-11-05T08:29:23.947 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.922+0000 7f90fb7fe640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:29:23.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.922+0000 7f90fb7fe640 1 -- 172.21.15.52:0/3381700665 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90f400ccd0 con 0x7f91040abe60 2023-11-05T08:29:23.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.922+0000 7f90fb7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:29:23.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.922+0000 7f90fb7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-05T08:29:23.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.922+0000 7f90fb7fe640 10 monclient: dump: 2023-11-05T08:29:23.948 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:29:23.949 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:23.949 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:23.949 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:23.949 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:29:23.950 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:23.950 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:29:23.950 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:29:23.950 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:29:23.950 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:23.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.922+0000 7f9108b05640 5 monclient: authenticate success, global_id 20686 2023-11-05T08:29:23.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.922+0000 7f9108b05640 10 monclient: _renew_subs 2023-11-05T08:29:23.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.922+0000 7f910159a640 4 set_mon_vals no callback set 2023-11-05T08:29:23.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.922+0000 7f9108b05640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:29:23.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.922+0000 7f9108b05640 1 -- 172.21.15.52:0/3381700665 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91040a9a30 con 0x7f91040abe60 2023-11-05T08:29:23.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.923+0000 7f9108b05640 10 client.20686.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-05T08:29:23.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.923+0000 7f9108b05640 10 monclient: _renew_subs 2023-11-05T08:29:23.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.923+0000 7f9108b05640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:29:23.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.923+0000 7f9108b05640 1 -- 172.21.15.52:0/3381700665 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f910412ee00 con 0x7f91040abe60 2023-11-05T08:29:23.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.923+0000 7f9108b05640 1 librados: init done 2023-11-05T08:29:23.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.923+0000 7f9108b05640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-05T08:29:23.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.923+0000 7f9108b05640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:29:23.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.923+0000 7f9108b05640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:29:23.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:23.923+0000 7f9108b05640 1 -- 172.21.15.52:0/3381700665 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f910404e9f0 con 0x7f91040abe60 2023-11-05T08:29:24.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.173+0000 7f90fb7fe640 1 -- 172.21.15.52:0/3381700665 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f90f4013470 con 0x7f91040abe60 2023-11-05T08:29:24.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.174+0000 7f90fb7fe640 1 --2- 172.21.15.52:0/3381700665 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f90e406c850 0x7f90e406ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:24.175 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.174+0000 7f90f9d9b640 1 --2- 172.21.15.52:0/3381700665 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f90e406c850 0x7f90e406ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:24.175 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.174+0000 7f90f9d9b640 10 monclient: get_auth_request con 0x7f90e406c850 auth_method 0 2023-11-05T08:29:24.175 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.175+0000 7f90fb7fe640 10 client.20686.objecter ms_handle_connect 0x7f90e406c850 2023-11-05T08:29:24.175 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.175+0000 7f90f9d9b640 1 --2- 172.21.15.52:0/3381700665 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f90e406c850 0x7f90e406ed10 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f91040a9510 tx=0x7f90ec009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:29:24.176 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.176+0000 7f90fb7fe640 1 -- 172.21.15.52:0/3381700665 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(932..932 src has 541..932) v4 ==== 6193+0+0 (secure 0 0 0) 0x7f90f400ce30 con 0x7f91040abe60 2023-11-05T08:29:24.176 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.176+0000 7f90fb7fe640 10 client.20686.objecter ms_dispatch 0x7f9104000b90 osd_map(932..932 src has 541..932) v4 2023-11-05T08:29:24.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.176+0000 7f90fb7fe640 3 client.20686.objecter handle_osd_map got epochs [932,932] > 0 2023-11-05T08:29:24.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.176+0000 7f90fb7fe640 3 client.20686.objecter handle_osd_map decoding full epoch 932 2023-11-05T08:29:24.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.176+0000 7f90fb7fe640 20 client.20686.objecter dump_active .. 0 homeless 2023-11-05T08:29:24.189 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.187+0000 7f90fb7fe640 1 -- 172.21.15.52:0/3381700665 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f90f4054f10 con 0x7f91040abe60 2023-11-05T08:29:24.189 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.187+0000 7f90fb7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:29:24.190 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.187+0000 7f90fb7fe640 10 monclient: _finish_command 1 = system:0 2023-11-05T08:29:24.364 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.364+0000 7f9108b05640 1 -- 172.21.15.52:0/3381700665 --> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9104138a10 con 0x7f90e406c850 2023-11-05T08:29:24.370 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.370+0000 7f90fb7fe640 1 -- 172.21.15.52:0/3381700665 <== mgr.4108 v2:172.21.15.156:6800/3320012339 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+151253 (secure 0 0 0) 0x7f9104138a10 con 0x7f90e406c850 2023-11-05T08:29:24.371 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:29:24.372 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2023-11-05T08:29:24.374 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.372+0000 7f9108b05640 10 librados: watch_flush enter 2023-11-05T08:29:24.374 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.372+0000 7f9108b05640 10 librados: watch_flush exit 2023-11-05T08:29:24.374 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.372+0000 7f9108b05640 20 client.20686.objecter shutdown clearing up homeless session... 2023-11-05T08:29:24.374 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.372+0000 7f9108b05640 10 client.20686.objecter successfully canceled tick 2023-11-05T08:29:24.375 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.372+0000 7f9108b05640 1 -- 172.21.15.52:0/3381700665 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f90e406c850 msgr2=0x7f90e406ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:24.375 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.372+0000 7f9108b05640 1 --2- 172.21.15.52:0/3381700665 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f90e406c850 0x7f90e406ed10 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f91040a9510 tx=0x7f90ec009040 comp rx=0 tx=0).stop 2023-11-05T08:29:24.375 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.372+0000 7f9108b05640 10 monclient: shutdown 2023-11-05T08:29:24.375 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.372+0000 7f9108b05640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:29:24.375 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.372+0000 7f9108b05640 1 -- 172.21.15.52:0/3381700665 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f91040abe60 msgr2=0x7f9104131ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:24.376 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.372+0000 7f9108b05640 1 --2- 172.21.15.52:0/3381700665 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f91040abe60 0x7f9104131ee0 secure :-1 s=READY pgs=4993 cs=0 l=1 rev1=1 crypto rx=0x7f90f400e870 tx=0x7f90f400ed30 comp rx=0 tx=0).stop 2023-11-05T08:29:24.376 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.372+0000 7f9108b05640 1 -- 172.21.15.52:0/3381700665 shutdown_connections 2023-11-05T08:29:24.376 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.372+0000 7f9108b05640 1 --2- 172.21.15.52:0/3381700665 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f90e406c850 0x7f90e406ed10 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:24.376 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.372+0000 7f9108b05640 1 --2- 172.21.15.52:0/3381700665 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91040ae4d0 0x7f910413ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:24.376 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.372+0000 7f9108b05640 1 --2- 172.21.15.52:0/3381700665 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f91040ac860 0x7f910413c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:24.377 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.372+0000 7f9108b05640 1 --2- 172.21.15.52:0/3381700665 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f91040abe60 0x7f9104131ee0 unknown :-1 s=CLOSED pgs=4993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:24.377 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.372+0000 7f9108b05640 1 -- 172.21.15.52:0/3381700665 >> 172.21.15.52:0/3381700665 conn(0x7f91040b2ff0 msgr2=0x7f91040ad9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:29:24.377 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.372+0000 7f9108b05640 1 -- 172.21.15.52:0/3381700665 shutdown_connections 2023-11-05T08:29:24.377 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.372+0000 7f9108b05640 1 -- 172.21.15.52:0/3381700665 wait complete. 2023-11-05T08:29:24.377 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.372+0000 7f9108b05640 1 librados: shutdown 2023-11-05T08:29:24.384 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":1610,"stamp":"2023-11-05T08:29:23.481560+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459285,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":102,"num_read_kb":88,"num_write":120,"num_write_kb":1379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":140,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":518336,"kb_used_data":46772,"kb_used_omap":12,"kb_used_meta":471411,"kb_avail":754456384,"statfs":{"total":773094113280,"available":772563337216,"internally_reserved":0,"allocated":47894528,"data_stored":26130876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":482725432},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":381,"apply_latency_ms":381,"commit_latency_ns":381000000,"apply_latency_ns":381000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4000299,"num_objects":-44,"num_object_clones":-1,"num_object_copies":-132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-44,"num_whiteouts":0,"num_read":-31,"num_read_kb":-11,"num_write":-71,"num_write_kb":-3969,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":-1,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.436968"},"pg_stats":[{"pgid":"12.10","version":"0'0","reported_seq":879,"reported_epoch":928,"state":"active+clean","last_fresh":"2023-11-05T08:29:17.949538+0000","last_change":"2023-11-05T08:08:27.690087+0000","last_active":"2023-11-05T08:29:17.949538+0000","last_peered":"2023-11-05T08:29:17.949538+0000","last_clean":"2023-11-05T08:29:17.949538+0000","last_became_active":"2023-11-05T08:08:27.684720+0000","last_became_peered":"2023-11-05T08:08:27.684720+0000","last_unstale":"2023-11-05T08:29:17.949538+0000","last_undegraded":"2023-11-05T08:29:17.949538+0000","last_fullsized":"2023-11-05T08:29:17.949538+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T19:41:08.111512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":880,"reported_epoch":930,"state":"active+clean","last_fresh":"2023-11-05T08:29:20.524528+0000","last_change":"2023-11-05T08:08:12.980044+0000","last_active":"2023-11-05T08:29:20.524528+0000","last_peered":"2023-11-05T08:29:20.524528+0000","last_clean":"2023-11-05T08:29:20.524528+0000","last_became_active":"2023-11-05T08:08:12.972471+0000","last_became_peered":"2023-11-05T08:08:12.972471+0000","last_unstale":"2023-11-05T08:29:20.524528+0000","last_undegraded":"2023-11-05T08:29:20.524528+0000","last_fullsized":"2023-11-05T08:29:20.524528+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T12:54:54.078770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":879,"reported_epoch":928,"state":"active+clean","last_fresh":"2023-11-05T08:29:18.321196+0000","last_change":"2023-11-05T08:08:20.798605+0000","last_active":"2023-11-05T08:29:18.321196+0000","last_peered":"2023-11-05T08:29:18.321196+0000","last_clean":"2023-11-05T08:29:18.321196+0000","last_became_active":"2023-11-05T08:08:20.791671+0000","last_became_peered":"2023-11-05T08:08:20.791671+0000","last_unstale":"2023-11-05T08:29:18.321196+0000","last_undegraded":"2023-11-05T08:29:18.321196+0000","last_fullsized":"2023-11-05T08:29:18.321196+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T13:29:00.846506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":866,"reported_epoch":929,"state":"active+clean","last_fresh":"2023-11-05T08:29:19.961924+0000","last_change":"2023-11-05T08:08:26.582880+0000","last_active":"2023-11-05T08:29:19.961924+0000","last_peered":"2023-11-05T08:29:19.961924+0000","last_clean":"2023-11-05T08:29:19.961924+0000","last_became_active":"2023-11-05T08:08:26.449074+0000","last_became_peered":"2023-11-05T08:08:26.449074+0000","last_unstale":"2023-11-05T08:29:19.961924+0000","last_undegraded":"2023-11-05T08:29:19.961924+0000","last_fullsized":"2023-11-05T08:29:19.961924+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T18:45:21.023650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":891,"reported_epoch":929,"state":"active+clean","last_fresh":"2023-11-05T08:29:19.458376+0000","last_change":"2023-11-05T08:08:32.323831+0000","last_active":"2023-11-05T08:29:19.458376+0000","last_peered":"2023-11-05T08:29:19.458376+0000","last_clean":"2023-11-05T08:29:19.458376+0000","last_became_active":"2023-11-05T08:08:32.275587+0000","last_became_peered":"2023-11-05T08:08:32.275587+0000","last_unstale":"2023-11-05T08:29:19.458376+0000","last_undegraded":"2023-11-05T08:29:19.458376+0000","last_fullsized":"2023-11-05T08:29:19.458376+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T13:12:36.530380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":878,"reported_epoch":929,"state":"active+clean","last_fresh":"2023-11-05T08:29:20.077274+0000","last_change":"2023-11-05T08:08:15.985625+0000","last_active":"2023-11-05T08:29:20.077274+0000","last_peered":"2023-11-05T08:29:20.077274+0000","last_clean":"2023-11-05T08:29:20.077274+0000","last_became_active":"2023-11-05T08:08:15.950681+0000","last_became_peered":"2023-11-05T08:08:15.950681+0000","last_unstale":"2023-11-05T08:29:20.077274+0000","last_undegraded":"2023-11-05T08:29:20.077274+0000","last_fullsized":"2023-11-05T08:29:20.077274+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T12:50:28.798998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":878,"reported_epoch":930,"state":"active+clean","last_fresh":"2023-11-05T08:29:20.537827+0000","last_change":"2023-11-05T08:08:24.751420+0000","last_active":"2023-11-05T08:29:20.537827+0000","last_peered":"2023-11-05T08:29:20.537827+0000","last_clean":"2023-11-05T08:29:20.537827+0000","last_became_active":"2023-11-05T08:08:24.718463+0000","last_became_peered":"2023-11-05T08:08:24.718463+0000","last_unstale":"2023-11-05T08:29:20.537827+0000","last_undegraded":"2023-11-05T08:29:20.537827+0000","last_fullsized":"2023-11-05T08:29:20.537827+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T18:26:27.301253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":878,"reported_epoch":929,"state":"active+clean","last_fresh":"2023-11-05T08:29:20.130566+0000","last_change":"2023-11-05T08:08:13.351797+0000","last_active":"2023-11-05T08:29:20.130566+0000","last_peered":"2023-11-05T08:29:20.130566+0000","last_clean":"2023-11-05T08:29:20.130566+0000","last_became_active":"2023-11-05T08:08:13.341684+0000","last_became_peered":"2023-11-05T08:08:13.341684+0000","last_unstale":"2023-11-05T08:29:20.130566+0000","last_undegraded":"2023-11-05T08:29:20.130566+0000","last_fullsized":"2023-11-05T08:29:20.130566+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T16:17:59.865184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":891,"reported_epoch":929,"state":"active+clean","last_fresh":"2023-11-05T08:29:19.519193+0000","last_change":"2023-11-05T08:08:15.525549+0000","last_active":"2023-11-05T08:29:19.519193+0000","last_peered":"2023-11-05T08:29:19.519193+0000","last_clean":"2023-11-05T08:29:19.519193+0000","last_became_active":"2023-11-05T08:08:15.520030+0000","last_became_peered":"2023-11-05T08:08:15.520030+0000","last_unstale":"2023-11-05T08:29:19.519193+0000","last_undegraded":"2023-11-05T08:29:19.519193+0000","last_fullsized":"2023-11-05T08:29:19.519193+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T14:24:09.563061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":891,"reported_epoch":929,"state":"active+clean","last_fresh":"2023-11-05T08:29:19.541086+0000","last_change":"2023-11-05T08:08:15.879034+0000","last_active":"2023-11-05T08:29:19.541086+0000","last_peered":"2023-11-05T08:29:19.541086+0000","last_clean":"2023-11-05T08:29:19.541086+0000","last_became_active":"2023-11-05T08:08:15.871149+0000","last_became_peered":"2023-11-05T08:08:15.871149+0000","last_unstale":"2023-11-05T08:29:19.541086+0000","last_undegraded":"2023-11-05T08:29:19.541086+0000","last_fullsized":"2023-11-05T08:29:19.541086+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T12:39:25.891428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":879,"reported_epoch":930,"state":"active+clean","last_fresh":"2023-11-05T08:29:20.519145+0000","last_change":"2023-11-05T08:08:14.156651+0000","last_active":"2023-11-05T08:29:20.519145+0000","last_peered":"2023-11-05T08:29:20.519145+0000","last_clean":"2023-11-05T08:29:20.519145+0000","last_became_active":"2023-11-05T08:08:14.060255+0000","last_became_peered":"2023-11-05T08:08:14.060255+0000","last_unstale":"2023-11-05T08:29:20.519145+0000","last_undegraded":"2023-11-05T08:29:20.519145+0000","last_fullsized":"2023-11-05T08:29:20.519145+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T09:03:54.287575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":891,"reported_epoch":929,"state":"active+clean","last_fresh":"2023-11-05T08:29:19.509110+0000","last_change":"2023-11-05T08:08:15.769320+0000","last_active":"2023-11-05T08:29:19.509110+0000","last_peered":"2023-11-05T08:29:19.509110+0000","last_clean":"2023-11-05T08:29:19.509110+0000","last_became_active":"2023-11-05T08:08:15.726426+0000","last_became_peered":"2023-11-05T08:08:15.726426+0000","last_unstale":"2023-11-05T08:29:19.509110+0000","last_undegraded":"2023-11-05T08:29:19.509110+0000","last_fullsized":"2023-11-05T08:29:19.509110+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T16:42:57.259557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":881,"reported_epoch":929,"state":"active+clean","last_fresh":"2023-11-05T08:29:19.258449+0000","last_change":"2023-11-05T08:07:07.897554+0000","last_active":"2023-11-05T08:29:19.258449+0000","last_peered":"2023-11-05T08:29:19.258449+0000","last_clean":"2023-11-05T08:29:19.258449+0000","last_became_active":"2023-11-05T08:07:07.890422+0000","last_became_peered":"2023-11-05T08:07:07.890422+0000","last_unstale":"2023-11-05T08:29:19.258449+0000","last_undegraded":"2023-11-05T08:29:19.258449+0000","last_fullsized":"2023-11-05T08:29:19.258449+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:07:05.115520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:07:05.115520+0000","last_clean_scrub_stamp":"2023-11-05T08:07:05.115520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T18:33:54.492130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":879,"reported_epoch":928,"state":"active+clean","last_fresh":"2023-11-05T08:29:17.966606+0000","last_change":"2023-11-05T08:08:38.368346+0000","last_active":"2023-11-05T08:29:17.966606+0000","last_peered":"2023-11-05T08:29:17.966606+0000","last_clean":"2023-11-05T08:29:17.966606+0000","last_became_active":"2023-11-05T08:08:38.362716+0000","last_became_peered":"2023-11-05T08:08:38.362716+0000","last_unstale":"2023-11-05T08:29:17.966606+0000","last_undegraded":"2023-11-05T08:29:17.966606+0000","last_fullsized":"2023-11-05T08:29:17.966606+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T19:21:04.243650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":884,"reported_epoch":928,"state":"active+clean","last_fresh":"2023-11-05T08:29:18.338442+0000","last_change":"2023-11-05T08:07:07.935570+0000","last_active":"2023-11-05T08:29:18.338442+0000","last_peered":"2023-11-05T08:29:18.338442+0000","last_clean":"2023-11-05T08:29:18.338442+0000","last_became_active":"2023-11-05T08:07:07.908128+0000","last_became_peered":"2023-11-05T08:07:07.908128+0000","last_unstale":"2023-11-05T08:29:18.338442+0000","last_undegraded":"2023-11-05T08:29:18.338442+0000","last_fullsized":"2023-11-05T08:29:18.338442+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:07:05.115520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:07:05.115520+0000","last_clean_scrub_stamp":"2023-11-05T08:07:05.115520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T15:25:37.194219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":892,"reported_epoch":929,"state":"active+clean","last_fresh":"2023-11-05T08:29:19.520761+0000","last_change":"2023-11-05T08:08:12.669619+0000","last_active":"2023-11-05T08:29:19.520761+0000","last_peered":"2023-11-05T08:29:19.520761+0000","last_clean":"2023-11-05T08:29:19.520761+0000","last_became_active":"2023-11-05T08:08:12.653053+0000","last_became_peered":"2023-11-05T08:08:12.653053+0000","last_unstale":"2023-11-05T08:29:19.520761+0000","last_undegraded":"2023-11-05T08:29:19.520761+0000","last_fullsized":"2023-11-05T08:29:19.520761+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T17:33:50.738772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":883,"reported_epoch":930,"state":"active+clean","last_fresh":"2023-11-05T08:29:20.271551+0000","last_change":"2023-11-05T08:07:07.213210+0000","last_active":"2023-11-05T08:29:20.271551+0000","last_peered":"2023-11-05T08:29:20.271551+0000","last_clean":"2023-11-05T08:29:20.271551+0000","last_became_active":"2023-11-05T08:07:07.203649+0000","last_became_peered":"2023-11-05T08:07:07.203649+0000","last_unstale":"2023-11-05T08:29:20.271551+0000","last_undegraded":"2023-11-05T08:29:20.271551+0000","last_fullsized":"2023-11-05T08:29:20.271551+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:07:05.115520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:07:05.115520+0000","last_clean_scrub_stamp":"2023-11-05T08:07:05.115520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T13:05:27.884687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":892,"reported_epoch":929,"state":"active+clean","last_fresh":"2023-11-05T08:29:19.555585+0000","last_change":"2023-11-05T08:08:14.906331+0000","last_active":"2023-11-05T08:29:19.555585+0000","last_peered":"2023-11-05T08:29:19.555585+0000","last_clean":"2023-11-05T08:29:19.555585+0000","last_became_active":"2023-11-05T08:08:14.900486+0000","last_became_peered":"2023-11-05T08:08:14.900486+0000","last_unstale":"2023-11-05T08:29:19.555585+0000","last_undegraded":"2023-11-05T08:29:19.555585+0000","last_fullsized":"2023-11-05T08:29:19.555585+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T14:54:34.273100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":872,"reported_epoch":929,"state":"active+clean","last_fresh":"2023-11-05T08:29:19.978553+0000","last_change":"2023-11-05T08:07:07.403639+0000","last_active":"2023-11-05T08:29:19.978553+0000","last_peered":"2023-11-05T08:29:19.978553+0000","last_clean":"2023-11-05T08:29:19.978553+0000","last_became_active":"2023-11-05T08:07:07.371569+0000","last_became_peered":"2023-11-05T08:07:07.371569+0000","last_unstale":"2023-11-05T08:29:19.978553+0000","last_undegraded":"2023-11-05T08:29:19.978553+0000","last_fullsized":"2023-11-05T08:29:19.978553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:07:05.115520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:07:05.115520+0000","last_clean_scrub_stamp":"2023-11-05T08:07:05.115520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T14:58:41.385179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":879,"reported_epoch":928,"state":"active+clean","last_fresh":"2023-11-05T08:29:18.316725+0000","last_change":"2023-11-05T08:08:29.214565+0000","last_active":"2023-11-05T08:29:18.316725+0000","last_peered":"2023-11-05T08:29:18.316725+0000","last_clean":"2023-11-05T08:29:18.316725+0000","last_became_active":"2023-11-05T08:08:29.207330+0000","last_became_peered":"2023-11-05T08:08:29.207330+0000","last_unstale":"2023-11-05T08:29:18.316725+0000","last_undegraded":"2023-11-05T08:29:18.316725+0000","last_fullsized":"2023-11-05T08:29:18.316725+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T11:12:17.103935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":883,"reported_epoch":930,"state":"active+clean","last_fresh":"2023-11-05T08:29:20.231140+0000","last_change":"2023-11-05T08:07:07.350626+0000","last_active":"2023-11-05T08:29:20.231140+0000","last_peered":"2023-11-05T08:29:20.231140+0000","last_clean":"2023-11-05T08:29:20.231140+0000","last_became_active":"2023-11-05T08:07:07.344890+0000","last_became_peered":"2023-11-05T08:07:07.344890+0000","last_unstale":"2023-11-05T08:29:20.231140+0000","last_undegraded":"2023-11-05T08:29:20.231140+0000","last_fullsized":"2023-11-05T08:29:20.231140+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:07:05.115520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:07:05.115520+0000","last_clean_scrub_stamp":"2023-11-05T08:07:05.115520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T10:17:35.666271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":892,"reported_epoch":929,"state":"active+clean","last_fresh":"2023-11-05T08:29:19.616495+0000","last_change":"2023-11-05T08:08:16.955033+0000","last_active":"2023-11-05T08:29:19.616495+0000","last_peered":"2023-11-05T08:29:19.616495+0000","last_clean":"2023-11-05T08:29:19.616495+0000","last_became_active":"2023-11-05T08:08:16.927690+0000","last_became_peered":"2023-11-05T08:08:16.927690+0000","last_unstale":"2023-11-05T08:29:19.616495+0000","last_undegraded":"2023-11-05T08:29:19.616495+0000","last_fullsized":"2023-11-05T08:29:19.616495+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T16:04:26.654084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":897,"reported_epoch":929,"state":"active+clean","last_fresh":"2023-11-05T08:29:19.530569+0000","last_change":"2023-11-05T08:07:07.085537+0000","last_active":"2023-11-05T08:29:19.530569+0000","last_peered":"2023-11-05T08:29:19.530569+0000","last_clean":"2023-11-05T08:29:19.530569+0000","last_became_active":"2023-11-05T08:07:07.051923+0000","last_became_peered":"2023-11-05T08:07:07.051923+0000","last_unstale":"2023-11-05T08:29:19.530569+0000","last_undegraded":"2023-11-05T08:29:19.530569+0000","last_fullsized":"2023-11-05T08:29:19.530569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:07:05.115520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:07:05.115520+0000","last_clean_scrub_stamp":"2023-11-05T08:07:05.115520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T09:32:20.473313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":876,"reported_epoch":929,"state":"active+clean","last_fresh":"2023-11-05T08:29:19.260837+0000","last_change":"2023-11-05T08:08:32.728546+0000","last_active":"2023-11-05T08:29:19.260837+0000","last_peered":"2023-11-05T08:29:19.260837+0000","last_clean":"2023-11-05T08:29:19.260837+0000","last_became_active":"2023-11-05T08:08:32.722827+0000","last_became_peered":"2023-11-05T08:08:32.722827+0000","last_unstale":"2023-11-05T08:29:19.260837+0000","last_undegraded":"2023-11-05T08:29:19.260837+0000","last_fullsized":"2023-11-05T08:29:19.260837+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T18:14:43.626997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":884,"reported_epoch":930,"state":"active+clean","last_fresh":"2023-11-05T08:29:20.220963+0000","last_change":"2023-11-05T08:07:07.161269+0000","last_active":"2023-11-05T08:29:20.220963+0000","last_peered":"2023-11-05T08:29:20.220963+0000","last_clean":"2023-11-05T08:29:20.220963+0000","last_became_active":"2023-11-05T08:07:07.131650+0000","last_became_peered":"2023-11-05T08:07:07.131650+0000","last_unstale":"2023-11-05T08:29:20.220963+0000","last_undegraded":"2023-11-05T08:29:20.220963+0000","last_fullsized":"2023-11-05T08:29:20.220963+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:07:05.115520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:07:05.115520+0000","last_clean_scrub_stamp":"2023-11-05T08:07:05.115520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T11:45:49.611005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":892,"reported_epoch":929,"state":"active+clean","last_fresh":"2023-11-05T08:29:19.568262+0000","last_change":"2023-11-05T08:08:13.856039+0000","last_active":"2023-11-05T08:29:19.568262+0000","last_peered":"2023-11-05T08:29:19.568262+0000","last_clean":"2023-11-05T08:29:19.568262+0000","last_became_active":"2023-11-05T08:08:13.848417+0000","last_became_peered":"2023-11-05T08:08:13.848417+0000","last_unstale":"2023-11-05T08:29:19.568262+0000","last_undegraded":"2023-11-05T08:29:19.568262+0000","last_fullsized":"2023-11-05T08:29:19.568262+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T14:27:44.987944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":883,"reported_epoch":930,"state":"active+clean","last_fresh":"2023-11-05T08:29:20.262132+0000","last_change":"2023-11-05T08:07:07.482345+0000","last_active":"2023-11-05T08:29:20.262132+0000","last_peered":"2023-11-05T08:29:20.262132+0000","last_clean":"2023-11-05T08:29:20.262132+0000","last_became_active":"2023-11-05T08:07:07.467692+0000","last_became_peered":"2023-11-05T08:07:07.467692+0000","last_unstale":"2023-11-05T08:29:20.262132+0000","last_undegraded":"2023-11-05T08:29:20.262132+0000","last_fullsized":"2023-11-05T08:29:20.262132+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:07:05.115520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:07:05.115520+0000","last_clean_scrub_stamp":"2023-11-05T08:07:05.115520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T09:41:35.204221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"23'76","reported_seq":992,"reported_epoch":929,"state":"active+clean","last_fresh":"2023-11-05T08:29:20.025376+0000","last_change":"2023-11-05T08:07:00.997710+0000","last_active":"2023-11-05T08:29:20.025376+0000","last_peered":"2023-11-05T08:29:20.025376+0000","last_clean":"2023-11-05T08:29:20.025376+0000","last_became_active":"2023-11-05T08:07:00.966209+0000","last_became_peered":"2023-11-05T08:07:00.966209+0000","last_unstale":"2023-11-05T08:29:20.025376+0000","last_undegraded":"2023-11-05T08:29:20.025376+0000","last_fullsized":"2023-11-05T08:29:20.025376+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:06:58.242946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:06:58.242946+0000","last_clean_scrub_stamp":"2023-11-05T08:06:58.242946+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T10:17:50.722686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":113,"num_write_kb":1372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":878,"reported_epoch":930,"state":"active+clean","last_fresh":"2023-11-05T08:29:20.267059+0000","last_change":"2023-11-05T08:08:16.483616+0000","last_active":"2023-11-05T08:29:20.267059+0000","last_peered":"2023-11-05T08:29:20.267059+0000","last_clean":"2023-11-05T08:29:20.267059+0000","last_became_active":"2023-11-05T08:08:16.476624+0000","last_became_peered":"2023-11-05T08:08:16.476624+0000","last_unstale":"2023-11-05T08:29:20.267059+0000","last_undegraded":"2023-11-05T08:29:20.267059+0000","last_fullsized":"2023-11-05T08:29:20.267059+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T09:35:42.050473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":892,"reported_epoch":929,"state":"active+clean","last_fresh":"2023-11-05T08:29:19.591653+0000","last_change":"2023-11-05T08:08:15.541517+0000","last_active":"2023-11-05T08:29:19.591653+0000","last_peered":"2023-11-05T08:29:19.591653+0000","last_clean":"2023-11-05T08:29:19.591653+0000","last_became_active":"2023-11-05T08:08:15.536104+0000","last_became_peered":"2023-11-05T08:08:15.536104+0000","last_unstale":"2023-11-05T08:29:19.591653+0000","last_undegraded":"2023-11-05T08:29:19.591653+0000","last_fullsized":"2023-11-05T08:29:19.591653+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T16:13:04.020842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":877,"reported_epoch":928,"state":"active+clean","last_fresh":"2023-11-05T08:29:17.990463+0000","last_change":"2023-11-05T08:08:24.468665+0000","last_active":"2023-11-05T08:29:17.990463+0000","last_peered":"2023-11-05T08:29:17.990463+0000","last_clean":"2023-11-05T08:29:17.990463+0000","last_became_active":"2023-11-05T08:08:24.441081+0000","last_became_peered":"2023-11-05T08:08:24.441081+0000","last_unstale":"2023-11-05T08:29:17.990463+0000","last_undegraded":"2023-11-05T08:29:17.990463+0000","last_fullsized":"2023-11-05T08:29:17.990463+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T18:53:30.099795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":893,"reported_epoch":929,"state":"active+clean","last_fresh":"2023-11-05T08:29:19.482775+0000","last_change":"2023-11-05T08:08:16.655549+0000","last_active":"2023-11-05T08:29:19.482775+0000","last_peered":"2023-11-05T08:29:19.482775+0000","last_clean":"2023-11-05T08:29:19.482775+0000","last_became_active":"2023-11-05T08:08:16.632044+0000","last_became_peered":"2023-11-05T08:08:16.632044+0000","last_unstale":"2023-11-05T08:29:19.482775+0000","last_undegraded":"2023-11-05T08:29:19.482775+0000","last_fullsized":"2023-11-05T08:29:19.482775+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T14:27:26.991803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":881,"reported_epoch":930,"state":"active+clean","last_fresh":"2023-11-05T08:29:20.532510+0000","last_change":"2023-11-05T08:08:14.445311+0000","last_active":"2023-11-05T08:29:20.532510+0000","last_peered":"2023-11-05T08:29:20.532510+0000","last_clean":"2023-11-05T08:29:20.532510+0000","last_became_active":"2023-11-05T08:08:14.425433+0000","last_became_peered":"2023-11-05T08:08:14.425433+0000","last_unstale":"2023-11-05T08:29:20.532510+0000","last_undegraded":"2023-11-05T08:29:20.532510+0000","last_fullsized":"2023-11-05T08:29:20.532510+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T08:24:56.987960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":880,"reported_epoch":928,"state":"active+clean","last_fresh":"2023-11-05T08:29:18.326602+0000","last_change":"2023-11-05T08:08:17.165313+0000","last_active":"2023-11-05T08:29:18.326602+0000","last_peered":"2023-11-05T08:29:18.326602+0000","last_clean":"2023-11-05T08:29:18.326602+0000","last_became_active":"2023-11-05T08:08:17.140308+0000","last_became_peered":"2023-11-05T08:08:17.140308+0000","last_unstale":"2023-11-05T08:29:18.326602+0000","last_undegraded":"2023-11-05T08:29:18.326602+0000","last_fullsized":"2023-11-05T08:29:18.326602+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T19:28:30.888743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":881,"reported_epoch":930,"state":"active+clean","last_fresh":"2023-11-05T08:29:20.517460+0000","last_change":"2023-11-05T08:08:14.150663+0000","last_active":"2023-11-05T08:29:20.517460+0000","last_peered":"2023-11-05T08:29:20.517460+0000","last_clean":"2023-11-05T08:29:20.517460+0000","last_became_active":"2023-11-05T08:08:14.137585+0000","last_became_peered":"2023-11-05T08:08:14.137585+0000","last_unstale":"2023-11-05T08:29:20.517460+0000","last_undegraded":"2023-11-05T08:29:20.517460+0000","last_fullsized":"2023-11-05T08:29:20.517460+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T15:52:07.602007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1","version":"60'7","reported_seq":893,"reported_epoch":929,"state":"active+clean","last_fresh":"2023-11-05T08:29:20.028265+0000","last_change":"2023-11-05T08:08:15.816866+0000","last_active":"2023-11-05T08:29:20.028265+0000","last_peered":"2023-11-05T08:29:20.028265+0000","last_clean":"2023-11-05T08:29:20.028265+0000","last_became_active":"2023-11-05T08:08:15.787944+0000","last_became_peered":"2023-11-05T08:08:15.787944+0000","last_unstale":"2023-11-05T08:29:20.028265+0000","last_undegraded":"2023-11-05T08:29:20.028265+0000","last_fullsized":"2023-11-05T08:29:20.028265+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T15:34:28.380916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":893,"reported_epoch":929,"state":"active+clean","last_fresh":"2023-11-05T08:29:19.437098+0000","last_change":"2023-11-05T08:08:29.552725+0000","last_active":"2023-11-05T08:29:19.437098+0000","last_peered":"2023-11-05T08:29:19.437098+0000","last_clean":"2023-11-05T08:29:19.437098+0000","last_became_active":"2023-11-05T08:08:29.547162+0000","last_became_peered":"2023-11-05T08:08:29.547162+0000","last_unstale":"2023-11-05T08:29:19.437098+0000","last_undegraded":"2023-11-05T08:29:19.437098+0000","last_fullsized":"2023-11-05T08:29:19.437098+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T19:39:29.767004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":877,"reported_epoch":929,"state":"active+clean","last_fresh":"2023-11-05T08:29:19.262775+0000","last_change":"2023-11-05T08:08:20.758068+0000","last_active":"2023-11-05T08:29:19.262775+0000","last_peered":"2023-11-05T08:29:19.262775+0000","last_clean":"2023-11-05T08:29:19.262775+0000","last_became_active":"2023-11-05T08:08:20.752405+0000","last_became_peered":"2023-11-05T08:08:20.752405+0000","last_unstale":"2023-11-05T08:29:19.262775+0000","last_undegraded":"2023-11-05T08:29:19.262775+0000","last_fullsized":"2023-11-05T08:29:19.262775+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T14:40:09.413196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":880,"reported_epoch":930,"state":"active+clean","last_fresh":"2023-11-05T08:29:20.536162+0000","last_change":"2023-11-05T08:08:14.471293+0000","last_active":"2023-11-05T08:29:20.536162+0000","last_peered":"2023-11-05T08:29:20.536162+0000","last_clean":"2023-11-05T08:29:20.536162+0000","last_became_active":"2023-11-05T08:08:14.458020+0000","last_became_peered":"2023-11-05T08:08:14.458020+0000","last_unstale":"2023-11-05T08:29:20.536162+0000","last_undegraded":"2023-11-05T08:29:20.536162+0000","last_fullsized":"2023-11-05T08:29:20.536162+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T16:29:40.591417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":878,"reported_epoch":928,"state":"active+clean","last_fresh":"2023-11-05T08:29:17.986204+0000","last_change":"2023-11-05T08:08:17.325907+0000","last_active":"2023-11-05T08:29:17.986204+0000","last_peered":"2023-11-05T08:29:17.986204+0000","last_clean":"2023-11-05T08:29:17.986204+0000","last_became_active":"2023-11-05T08:08:17.320483+0000","last_became_peered":"2023-11-05T08:08:17.320483+0000","last_unstale":"2023-11-05T08:29:17.986204+0000","last_undegraded":"2023-11-05T08:29:17.986204+0000","last_fullsized":"2023-11-05T08:29:17.986204+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T08:33:36.614472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":866,"reported_epoch":929,"state":"active+clean","last_fresh":"2023-11-05T08:29:19.976904+0000","last_change":"2023-11-05T08:08:20.224993+0000","last_active":"2023-11-05T08:29:19.976904+0000","last_peered":"2023-11-05T08:29:19.976904+0000","last_clean":"2023-11-05T08:29:19.976904+0000","last_became_active":"2023-11-05T08:08:20.218112+0000","last_became_peered":"2023-11-05T08:08:20.218112+0000","last_unstale":"2023-11-05T08:29:19.976904+0000","last_undegraded":"2023-11-05T08:29:19.976904+0000","last_fullsized":"2023-11-05T08:29:19.976904+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T10:27:58.560760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":113,"num_write_kb":1372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":802816,"data_stored":795680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":0,"up_from":16,"seq":68719477007,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59132,"kb_used_data":5740,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94312708,"statfs":{"total":96636764160,"available":96576212992,"internally_reserved":0,"allocated":5877760,"data_stored":3161489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Nov 5 08:28:43 2023","interfaces":[{"interface":"back","average":{"1min":12.737,"5min":16.405000000000001,"15min":17.103999999999999},"min":{"1min":4.6589999999999998,"5min":4.6589999999999998,"15min":4.5},"max":{"1min":57.667000000000002,"5min":109.83,"15min":214.25299999999999},"last":9.3369999999999997},{"interface":"front","average":{"1min":15.419,"5min":18.902000000000001,"15min":19.364999999999998},"min":{"1min":5.0279999999999996,"5min":5.0279999999999996,"15min":4.6989999999999998},"max":{"1min":92.010000000000005,"5min":171.31999999999999,"15min":252.74000000000001},"last":7.0910000000000002}]},{"osd":2,"last update":"Sun Nov 5 08:28:57 2023","interfaces":[{"interface":"back","average":{"1min":14.499000000000001,"5min":24.434000000000001,"15min":24.056999999999999},"min":{"1min":8.8100000000000005,"5min":6.8419999999999996,"15min":6.3369999999999997},"max":{"1min":31.861999999999998,"5min":147.30199999999999,"15min":227.87100000000001},"last":11.821},{"interface":"front","average":{"1min":16.076000000000001,"5min":28.667000000000002,"15min":28.436},"min":{"1min":9.4179999999999993,"5min":9.0510000000000002,"15min":9.0510000000000002},"max":{"1min":34.857999999999997,"5min":231.124,"15min":343.62599999999998},"last":12.460000000000001}]},{"osd":3,"last update":"Sun Nov 5 08:28:43 2023","interfaces":[{"interface":"back","average":{"1min":21.385999999999999,"5min":27.227,"15min":25.497},"min":{"1min":10.151,"5min":7.6390000000000002,"15min":7.6390000000000002},"max":{"1min":95.622,"5min":165.13900000000001,"15min":242.93899999999999},"last":30.991},{"interface":"front","average":{"1min":14.419,"5min":18.553999999999998,"15min":18.728000000000002},"min":{"1min":8.0359999999999996,"5min":6.7190000000000003,"15min":6.3310000000000004},"max":{"1min":40.043999999999997,"5min":127.40600000000001,"15min":220.85499999999999},"last":22.536999999999999}]},{"osd":4,"last update":"Sun Nov 5 08:28:43 2023","interfaces":[{"interface":"back","average":{"1min":13.835000000000001,"5min":19.640000000000001,"15min":18.901},"min":{"1min":9.0429999999999993,"5min":7.6020000000000003,"15min":6.2830000000000004},"max":{"1min":28.248000000000001,"5min":125.905,"15min":176.929},"last":10.366},{"interface":"front","average":{"1min":17.474,"5min":25.137,"15min":24.228999999999999},"min":{"1min":10.781000000000001,"5min":10.333,"15min":7.7300000000000004},"max":{"1min":39.262,"5min":156.762,"15min":230.40600000000001},"last":26.853000000000002}]},{"osd":5,"last update":"Sun Nov 5 08:28:43 2023","interfaces":[{"interface":"back","average":{"1min":16.065000000000001,"5min":22.399000000000001,"15min":22.742000000000001},"min":{"1min":9.9320000000000004,"5min":7.093,"15min":6.8940000000000001},"max":{"1min":52.027999999999999,"5min":116.42,"15min":266.36099999999999},"last":9.6959999999999997},{"interface":"front","average":{"1min":17.501999999999999,"5min":23.870000000000001,"15min":26.367999999999999},"min":{"1min":11.161,"5min":9.4139999999999997,"15min":9.4139999999999997},"max":{"1min":32.369,"5min":115.401,"15min":260.779},"last":21.030999999999999}]},{"osd":6,"last update":"Sun Nov 5 08:28:43 2023","interfaces":[{"interface":"back","average":{"1min":19.154,"5min":30.417000000000002,"15min":29.405000000000001},"min":{"1min":11.42,"5min":10.246,"15min":10.246},"max":{"1min":37.744999999999997,"5min":147.67599999999999,"15min":280.47199999999998},"last":28.875},{"interface":"front","average":{"1min":15.041,"5min":22.821999999999999,"15min":22.027999999999999},"min":{"1min":7.7000000000000002,"5min":6.5739999999999998,"15min":6.5739999999999998},"max":{"1min":40.978000000000002,"5min":216.12,"15min":216.12},"last":21.898}]},{"osd":7,"last update":"Sun Nov 5 08:28:43 2023","interfaces":[{"interface":"back","average":{"1min":21.381,"5min":34.792999999999999,"15min":29.745999999999999},"min":{"1min":12.074999999999999,"5min":11.266999999999999,"15min":10.122},"max":{"1min":44.856000000000002,"5min":281.70800000000003,"15min":281.70800000000003},"last":26.149000000000001},{"interface":"front","average":{"1min":23.933,"5min":40.325000000000003,"15min":34.375},"min":{"1min":16.882000000000001,"5min":13.933,"15min":13.242000000000001},"max":{"1min":45.856999999999999,"5min":284.21199999999999,"15min":284.21199999999999},"last":29.745999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509711,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59108,"kb_used_data":5712,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94312732,"statfs":{"total":96636764160,"available":96576237568,"internally_reserved":0,"allocated":5849088,"data_stored":3123825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":54655432},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":46,"apply_latency_ms":46,"commit_latency_ns":46000000,"apply_latency_ns":46000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 5 08:28:39 2023","interfaces":[{"interface":"back","average":{"1min":10.744999999999999,"5min":14.304,"15min":22.193000000000001},"min":{"1min":6.8170000000000002,"5min":5.7539999999999996,"15min":4.5739999999999998},"max":{"1min":20.763000000000002,"5min":112.003,"15min":261.80799999999999},"last":5.9930000000000003},{"interface":"front","average":{"1min":9.8160000000000007,"5min":12.709,"15min":21.585999999999999},"min":{"1min":7.25,"5min":4.4930000000000003,"15min":4.4199999999999999},"max":{"1min":15.653,"5min":113.303,"15min":391.05500000000001},"last":24.248999999999999}]},{"osd":1,"last update":"Sun Nov 5 08:28:39 2023","interfaces":[{"interface":"back","average":{"1min":14.669,"5min":18.469999999999999,"15min":25.491},"min":{"1min":8.0709999999999997,"5min":5.4669999999999996,"15min":5.4669999999999996},"max":{"1min":33.857999999999997,"5min":210.03999999999999,"15min":390.67000000000002},"last":28.399999999999999},{"interface":"front","average":{"1min":12.352,"5min":16.792999999999999,"15min":25.196999999999999},"min":{"1min":6.4669999999999996,"5min":6.4669999999999996,"15min":6.4279999999999999},"max":{"1min":29.837,"5min":130.197,"15min":406.154},"last":7.266}]},{"osd":2,"last update":"Sun Nov 5 08:28:55 2023","interfaces":[{"interface":"back","average":{"1min":17.161999999999999,"5min":20.928000000000001,"15min":25.690999999999999},"min":{"1min":8.8300000000000001,"5min":7.508,"15min":7.1920000000000002},"max":{"1min":83.262,"5min":143.93100000000001,"15min":356.27800000000002},"last":25.584},{"interface":"front","average":{"1min":18.815000000000001,"5min":22.913,"15min":28.707000000000001},"min":{"1min":10.121,"5min":9.8279999999999994,"15min":7.9210000000000003},"max":{"1min":60.844999999999999,"5min":147.49600000000001,"15min":394.14999999999998},"last":27.329000000000001}]},{"osd":4,"last update":"Sun Nov 5 08:28:39 2023","interfaces":[{"interface":"back","average":{"1min":14.978999999999999,"5min":23.170000000000002,"15min":27.158000000000001},"min":{"1min":9.3439999999999994,"5min":7.1180000000000003,"15min":6.3609999999999998},"max":{"1min":44.747999999999998,"5min":239.07300000000001,"15min":342.72199999999998},"last":30.724},{"interface":"front","average":{"1min":22.855,"5min":29.050999999999998,"15min":32.917000000000002},"min":{"1min":11.836,"5min":9.673,"15min":9.0600000000000005},"max":{"1min":120.264,"5min":240.12799999999999,"15min":343.30799999999999},"last":32.487000000000002}]},{"osd":5,"last update":"Sun Nov 5 08:28:39 2023","interfaces":[{"interface":"back","average":{"1min":18.943000000000001,"5min":21.934000000000001,"15min":30.952999999999999},"min":{"1min":6.3040000000000003,"5min":6.3040000000000003,"15min":6.3040000000000003},"max":{"1min":74.201999999999998,"5min":132.55199999999999,"15min":412.41300000000001},"last":20.573},{"interface":"front","average":{"1min":16.152999999999999,"5min":17.201000000000001,"15min":27.908999999999999},"min":{"1min":6.6420000000000003,"5min":6.0030000000000001,"15min":6.0030000000000001},"max":{"1min":62.115000000000002,"5min":129.458,"15min":393.334},"last":24.922000000000001}]},{"osd":6,"last update":"Sun Nov 5 08:28:39 2023","interfaces":[{"interface":"back","average":{"1min":17.960000000000001,"5min":25.992999999999999,"15min":33.616},"min":{"1min":11.5,"5min":10.747,"15min":8.5289999999999999},"max":{"1min":29.053000000000001,"5min":197.44399999999999,"15min":395.892},"last":29.710000000000001},{"interface":"front","average":{"1min":17.393999999999998,"5min":25.535,"15min":31.867999999999999},"min":{"1min":10.085000000000001,"5min":10.085000000000001,"15min":7.6959999999999997},"max":{"1min":35.482999999999997,"5min":208.23099999999999,"15min":358.10599999999999},"last":33.755000000000003}]},{"osd":7,"last update":"Sun Nov 5 08:28:39 2023","interfaces":[{"interface":"back","average":{"1min":17.265999999999998,"5min":22.513000000000002,"15min":32.591999999999999},"min":{"1min":11.039,"5min":11.039,"15min":10.02},"max":{"1min":25.888999999999999,"5min":140.971,"15min":346.93299999999999},"last":34.789999999999999},{"interface":"front","average":{"1min":14.869999999999999,"5min":18.747,"15min":29.056999999999999},"min":{"1min":8.8059999999999992,"5min":7.7640000000000002,"15min":7.415},"max":{"1min":22.791,"5min":153.31800000000001,"15min":407.678},"last":22.82}]}]},{"osd":2,"up_from":15,"seq":64424509710,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59108,"kb_used_data":5712,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94312732,"statfs":{"total":96636764160,"available":96576237568,"internally_reserved":0,"allocated":5849088,"data_stored":3123825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":67,"apply_latency_ms":67,"commit_latency_ns":67000000,"apply_latency_ns":67000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 5 08:28:49 2023","interfaces":[{"interface":"back","average":{"1min":11.885,"5min":17.285,"15min":22.297999999999998},"min":{"1min":6.4820000000000002,"5min":6.2279999999999998,"15min":5.0839999999999996},"max":{"1min":24.228000000000002,"5min":115.285,"15min":285.363},"last":9.9559999999999995},{"interface":"front","average":{"1min":16.359000000000002,"5min":22.396999999999998,"15min":28.001999999999999},"min":{"1min":7.1840000000000002,"5min":7.1840000000000002,"15min":7.1840000000000002},"max":{"1min":29.151,"5min":117.806,"15min":342.44999999999999},"last":23.140000000000001}]},{"osd":1,"last update":"Sun Nov 5 08:28:36 2023","interfaces":[{"interface":"back","average":{"1min":15.425000000000001,"5min":21.286999999999999,"15min":23.324000000000002},"min":{"1min":9.875,"5min":9.3350000000000009,"15min":5.8529999999999998},"max":{"1min":29.829999999999998,"5min":204.059,"15min":258.88600000000002},"last":23.949000000000002},{"interface":"front","average":{"1min":11.346,"5min":16.706,"15min":22.780000000000001},"min":{"1min":5.681,"5min":5.681,"15min":5.5030000000000001},"max":{"1min":26.155999999999999,"5min":231.86600000000001,"15min":312.77999999999997},"last":6.4729999999999999}]},{"osd":3,"last update":"Sun Nov 5 08:28:49 2023","interfaces":[{"interface":"back","average":{"1min":25.614000000000001,"5min":21.391999999999999,"15min":23.795999999999999},"min":{"1min":7.7069999999999999,"5min":6.976,"15min":6.2439999999999998},"max":{"1min":204.50800000000001,"5min":204.50800000000001,"15min":292.435},"last":9.3010000000000002},{"interface":"front","average":{"1min":26.190000000000001,"5min":26.041,"15min":29.667000000000002},"min":{"1min":11.888,"5min":10.894,"15min":7.9800000000000004},"max":{"1min":160.86500000000001,"5min":161.327,"15min":288.178},"last":26.855}]},{"osd":4,"last update":"Sun Nov 5 08:28:49 2023","interfaces":[{"interface":"back","average":{"1min":11.77,"5min":14.837,"15min":18.927},"min":{"1min":6.399,"5min":5.8220000000000001,"15min":5.8220000000000001},"max":{"1min":27.553000000000001,"5min":129.64699999999999,"15min":261.12},"last":7.5170000000000003},{"interface":"front","average":{"1min":18.356000000000002,"5min":20.210999999999999,"15min":24.844999999999999},"min":{"1min":11.032,"5min":8.0190000000000001,"15min":7.8559999999999999},"max":{"1min":28.463000000000001,"5min":136.566,"15min":268.09899999999999},"last":13.601000000000001}]},{"osd":5,"last update":"Sun Nov 5 08:28:49 2023","interfaces":[{"interface":"back","average":{"1min":13.5,"5min":16.428999999999998,"15min":21.143000000000001},"min":{"1min":6.8479999999999999,"5min":6.3949999999999996,"15min":6.3159999999999998},"max":{"1min":30.815999999999999,"5min":110.682,"15min":229.387},"last":27.481000000000002},{"interface":"front","average":{"1min":20.343,"5min":24.088000000000001,"15min":27.779},"min":{"1min":11.023,"5min":11.023,"15min":9.8520000000000003},"max":{"1min":38.786999999999999,"5min":118.762,"15min":301.16899999999998},"last":10.542}]},{"osd":6,"last update":"Sun Nov 5 08:28:49 2023","interfaces":[{"interface":"back","average":{"1min":15.603,"5min":24.457999999999998,"15min":27.021999999999998},"min":{"1min":8.4469999999999992,"5min":8.4469999999999992,"15min":8.4469999999999992},"max":{"1min":26.398,"5min":119.38800000000001,"15min":219.01300000000001},"last":11.177},{"interface":"front","average":{"1min":18.614999999999998,"5min":19.393999999999998,"15min":22.059000000000001},"min":{"1min":9.875,"5min":8.7929999999999993,"15min":6.5309999999999997},"max":{"1min":34.994,"5min":111.405,"15min":217.93600000000001},"last":12.709}]},{"osd":7,"last update":"Sun Nov 5 08:28:36 2023","interfaces":[{"interface":"back","average":{"1min":23.518000000000001,"5min":23.989000000000001,"15min":27.620999999999999},"min":{"1min":14.113,"5min":9.9079999999999995,"15min":8.4870000000000001},"max":{"1min":65.971000000000004,"5min":135.114,"15min":263.37099999999998},"last":24.574000000000002},{"interface":"front","average":{"1min":32.572000000000003,"5min":31.068999999999999,"15min":31.628},"min":{"1min":16.792000000000002,"5min":13.923,"15min":9.5540000000000003},"max":{"1min":141.214,"5min":141.214,"15min":258.42000000000002},"last":28.135999999999999}]}]},{"osd":1,"up_from":15,"seq":64424509709,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59544,"kb_used_data":6152,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94312296,"statfs":{"total":96636764160,"available":96575791104,"internally_reserved":0,"allocated":6299648,"data_stored":3575718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 5 08:28:48 2023","interfaces":[{"interface":"back","average":{"1min":28.224,"5min":20.513999999999999,"15min":21.202999999999999},"min":{"1min":6.6360000000000001,"5min":4.2789999999999999,"15min":4.2789999999999999},"max":{"1min":269.49200000000002,"5min":269.49200000000002,"15min":309.815},"last":7.5430000000000001},{"interface":"front","average":{"1min":18.898,"5min":18.010999999999999,"15min":19.018999999999998},"min":{"1min":5.7709999999999999,"5min":4.9089999999999998,"15min":4.4119999999999999},"max":{"1min":140.09,"5min":160.89500000000001,"15min":299.55399999999997},"last":8.7530000000000001}]},{"osd":2,"last update":"Sun Nov 5 08:28:48 2023","interfaces":[{"interface":"back","average":{"1min":36.625,"5min":23.963999999999999,"15min":24.616},"min":{"1min":6.9550000000000001,"5min":6.202,"15min":5.7999999999999998},"max":{"1min":365.68099999999998,"5min":365.68099999999998,"15min":365.68099999999998},"last":10.612},{"interface":"front","average":{"1min":27.253,"5min":24.193000000000001,"15min":24.239000000000001},"min":{"1min":9.2539999999999996,"5min":7.0990000000000002,"15min":6.8899999999999997},"max":{"1min":143.03700000000001,"5min":188.554,"15min":302.49799999999999},"last":11.268000000000001}]},{"osd":3,"last update":"Sun Nov 5 08:28:48 2023","interfaces":[{"interface":"back","average":{"1min":34.058,"5min":26.893999999999998,"15min":27.126000000000001},"min":{"1min":8.4090000000000007,"5min":7.1260000000000003,"15min":6.8019999999999996},"max":{"1min":330.101,"5min":330.101,"15min":334.85599999999999},"last":29.888999999999999},{"interface":"front","average":{"1min":32.119,"5min":27.798999999999999,"15min":28.527999999999999},"min":{"1min":7.673,"5min":7.673,"15min":6.9660000000000002},"max":{"1min":268.80900000000003,"5min":268.80900000000003,"15min":382.089},"last":18.803000000000001}]},{"osd":4,"last update":"Sun Nov 5 08:28:48 2023","interfaces":[{"interface":"back","average":{"1min":35.593000000000004,"5min":24.390999999999998,"15min":23.358000000000001},"min":{"1min":8.1560000000000006,"5min":8.0239999999999991,"15min":6.7220000000000004},"max":{"1min":309.38200000000001,"5min":309.38200000000001,"15min":309.38200000000001},"last":37.332999999999998},{"interface":"front","average":{"1min":20.195,"5min":19.210000000000001,"15min":20.236999999999998},"min":{"1min":7.415,"5min":7.1289999999999996,"15min":6.0750000000000002},"max":{"1min":112.929,"5min":161.56700000000001,"15min":161.56700000000001},"last":25.777000000000001}]},{"osd":5,"last update":"Sun Nov 5 08:28:43 2023","interfaces":[{"interface":"back","average":{"1min":36.268000000000001,"5min":25.178999999999998,"15min":24.058},"min":{"1min":11.022,"5min":8.6549999999999994,"15min":6.1600000000000001},"max":{"1min":312.33699999999999,"5min":312.33699999999999,"15min":312.33699999999999},"last":50.942},{"interface":"front","average":{"1min":23.387,"5min":23.638000000000002,"15min":27.129000000000001},"min":{"1min":11.173999999999999,"5min":10.871,"15min":8.2129999999999992},"max":{"1min":138.23699999999999,"5min":146.816,"15min":297.25299999999999},"last":19.544}]},{"osd":6,"last update":"Sun Nov 5 08:28:43 2023","interfaces":[{"interface":"back","average":{"1min":28.651,"5min":23.355,"15min":26.981999999999999},"min":{"1min":11.853999999999999,"5min":8.3930000000000007,"15min":8.0579999999999998},"max":{"1min":166.16300000000001,"5min":166.16300000000001,"15min":284.84300000000002},"last":21.771000000000001},{"interface":"front","average":{"1min":36.008000000000003,"5min":29.831,"15min":32.936},"min":{"1min":13.599,"5min":12.923999999999999,"15min":12.047000000000001},"max":{"1min":225.93899999999999,"5min":225.93899999999999,"15min":290.81099999999998},"last":24.404}]},{"osd":7,"last update":"Sun Nov 5 08:28:43 2023","interfaces":[{"interface":"back","average":{"1min":20.428000000000001,"5min":23.300000000000001,"15min":31.018999999999998},"min":{"1min":8.9469999999999992,"5min":8.3680000000000003,"15min":8.3680000000000003},"max":{"1min":136.005,"5min":248.667,"15min":248.667},"last":23.172999999999998},{"interface":"front","average":{"1min":38.408999999999999,"5min":28.378,"15min":27.754000000000001},"min":{"1min":12.801,"5min":10.247999999999999,"15min":7.7199999999999998},"max":{"1min":331.02800000000002,"5min":331.02800000000002,"15min":331.02800000000002},"last":42.988999999999997}]}]},{"osd":7,"up_from":14,"seq":60129542414,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":81324,"kb_used_data":5724,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94290516,"statfs":{"total":96636764160,"available":96553488384,"internally_reserved":0,"allocated":5861376,"data_stored":3145105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":77396427},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 5 08:28:46 2023","interfaces":[{"interface":"back","average":{"1min":14.635999999999999,"5min":19.125,"15min":17.983000000000001},"min":{"1min":5.3369999999999997,"5min":4.5030000000000001,"15min":4.3739999999999997},"max":{"1min":92.448999999999998,"5min":198.46799999999999,"15min":198.46799999999999},"last":4.6189999999999998},{"interface":"front","average":{"1min":13.433999999999999,"5min":16.824999999999999,"15min":17.916},"min":{"1min":5.8949999999999996,"5min":5.5869999999999997,"15min":4.4260000000000002},"max":{"1min":65.064999999999998,"5min":129.173,"15min":162.06200000000001},"last":7.319}]},{"osd":1,"last update":"Sun Nov 5 08:28:42 2023","interfaces":[{"interface":"back","average":{"1min":13.074999999999999,"5min":19.145,"15min":23.327999999999999},"min":{"1min":6.7039999999999997,"5min":6.4109999999999996,"15min":5.9939999999999998},"max":{"1min":25.713999999999999,"5min":109.303,"15min":415.255},"last":8.6859999999999999},{"interface":"front","average":{"1min":13.377000000000001,"5min":21.669,"15min":24.067},"min":{"1min":8.0030000000000001,"5min":7.2640000000000002,"15min":6.0999999999999996},"max":{"1min":24.722000000000001,"5min":146.83799999999999,"15min":305.72800000000001},"last":11.137}]},{"osd":2,"last update":"Sun Nov 5 08:28:46 2023","interfaces":[{"interface":"back","average":{"1min":12.632,"5min":19.882999999999999,"15min":24.516999999999999},"min":{"1min":6.8860000000000001,"5min":6.5,"15min":6.5},"max":{"1min":41.588999999999999,"5min":125.071,"15min":196.78100000000001},"last":13.4},{"interface":"front","average":{"1min":14.002000000000001,"5min":21.390000000000001,"15min":23.530999999999999},"min":{"1min":8.2460000000000004,"5min":6.7009999999999996,"15min":6.5410000000000004},"max":{"1min":23.905999999999999,"5min":154.429,"15min":193.77500000000001},"last":11.914999999999999}]},{"osd":3,"last update":"Sun Nov 5 08:28:46 2023","interfaces":[{"interface":"back","average":{"1min":16.510000000000002,"5min":25.837,"15min":28.875},"min":{"1min":9.6649999999999991,"5min":9.1050000000000004,"15min":6.6660000000000004},"max":{"1min":30.847000000000001,"5min":171.90600000000001,"15min":380.88099999999997},"last":16.693000000000001},{"interface":"front","average":{"1min":18.937000000000001,"5min":25.657,"15min":26.742999999999999},"min":{"1min":7.0309999999999997,"5min":7.0309999999999997,"15min":6.3769999999999998},"max":{"1min":46.447000000000003,"5min":143.35499999999999,"15min":233.03},"last":12.787000000000001}]},{"osd":4,"last update":"Sun Nov 5 08:28:42 2023","interfaces":[{"interface":"back","average":{"1min":12.259,"5min":23.219000000000001,"15min":24.393999999999998},"min":{"1min":5.9329999999999998,"5min":5.9329999999999998,"15min":5.9329999999999998},"max":{"1min":35.728999999999999,"5min":158.124,"15min":215.60499999999999},"last":10.308999999999999},{"interface":"front","average":{"1min":14.186,"5min":26.652000000000001,"15min":27.027999999999999},"min":{"1min":7.6790000000000003,"5min":7.6790000000000003,"15min":7.6790000000000003},"max":{"1min":25.98,"5min":158.79300000000001,"15min":347.35199999999998},"last":15.49}]},{"osd":5,"last update":"Sun Nov 5 08:28:42 2023","interfaces":[{"interface":"back","average":{"1min":15.875999999999999,"5min":26.494,"15min":28.981999999999999},"min":{"1min":7.8410000000000002,"5min":7.8410000000000002,"15min":7.7199999999999998},"max":{"1min":43.951999999999998,"5min":156.44,"15min":283.54300000000001},"last":47.112000000000002},{"interface":"front","average":{"1min":15.382999999999999,"5min":23.811,"15min":27.538},"min":{"1min":7.4290000000000003,"5min":6.5890000000000004,"15min":6.5890000000000004},"max":{"1min":34.548000000000002,"5min":168.31800000000001,"15min":582.69899999999996},"last":38.107999999999997}]},{"osd":6,"last update":"Sun Nov 5 08:28:42 2023","interfaces":[{"interface":"back","average":{"1min":18.151,"5min":25.055,"15min":26.518000000000001},"min":{"1min":12.026,"5min":9.218,"15min":8.7300000000000004},"max":{"1min":28.806000000000001,"5min":140.654,"15min":228.97200000000001},"last":18.614000000000001},{"interface":"front","average":{"1min":17.321000000000002,"5min":24.378,"15min":24.873000000000001},"min":{"1min":8.4280000000000008,"5min":7.806,"15min":7.1740000000000004},"max":{"1min":45.408999999999999,"5min":132.90199999999999,"15min":203.364},"last":16.001000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542415,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77544,"kb_used_data":6104,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94294296,"statfs":{"total":96636764160,"available":96557359104,"internally_reserved":0,"allocated":6250496,"data_stored":3521665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":62,"apply_latency_ms":62,"commit_latency_ns":62000000,"apply_latency_ns":62000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 5 08:28:41 2023","interfaces":[{"interface":"back","average":{"1min":13.449,"5min":11.827999999999999,"15min":17.780000000000001},"min":{"1min":5.0229999999999997,"5min":4.8460000000000001,"15min":4.3799999999999999},"max":{"1min":73.667000000000002,"5min":73.667000000000002,"15min":258.09699999999998},"last":7.0339999999999998},{"interface":"front","average":{"1min":17.407,"5min":17.596,"15min":21.952999999999999},"min":{"1min":8.6270000000000007,"5min":4.1600000000000001,"15min":4.1600000000000001},"max":{"1min":76.629000000000005,"5min":231.863,"15min":278.45499999999998},"last":26.381}]},{"osd":1,"last update":"Sun Nov 5 08:28:41 2023","interfaces":[{"interface":"back","average":{"1min":22.600999999999999,"5min":20.210999999999999,"15min":20.777999999999999},"min":{"1min":6.5510000000000002,"5min":6.1609999999999996,"15min":4.351},"max":{"1min":77.555000000000007,"5min":304.47800000000001,"15min":304.47800000000001},"last":9.2430000000000003},{"interface":"front","average":{"1min":23.942,"5min":22.003,"15min":24.678000000000001},"min":{"1min":9.0899999999999999,"5min":6.4649999999999999,"15min":6.2430000000000003},"max":{"1min":89.457999999999998,"5min":167.91900000000001,"15min":286.233},"last":23.526}]},{"osd":2,"last update":"Sun Nov 5 08:28:41 2023","interfaces":[{"interface":"back","average":{"1min":22.696999999999999,"5min":20.16,"15min":22.661999999999999},"min":{"1min":8.1959999999999997,"5min":6.3970000000000002,"15min":5.1210000000000004},"max":{"1min":101.61799999999999,"5min":224.57900000000001,"15min":224.57900000000001},"last":9.9499999999999993},{"interface":"front","average":{"1min":26.762,"5min":23.725000000000001,"15min":27.760999999999999},"min":{"1min":11.435,"5min":7.476,"15min":5.5549999999999997},"max":{"1min":95.575999999999993,"5min":185.56299999999999,"15min":327.26100000000002},"last":21.213999999999999}]},{"osd":3,"last update":"Sun Nov 5 08:28:41 2023","interfaces":[{"interface":"back","average":{"1min":24.623000000000001,"5min":23.707000000000001,"15min":23.678999999999998},"min":{"1min":7.8780000000000001,"5min":6.0629999999999997,"15min":6.0629999999999997},"max":{"1min":90.995999999999995,"5min":192.482,"15min":283.94099999999997},"last":12.09},{"interface":"front","average":{"1min":27.146000000000001,"5min":24.620999999999999,"15min":24.513999999999999},"min":{"1min":12.201000000000001,"5min":8.859,"15min":6.2729999999999997},"max":{"1min":86.838999999999999,"5min":167.28899999999999,"15min":284.72699999999998},"last":19.867000000000001}]},{"osd":4,"last update":"Sun Nov 5 08:28:41 2023","interfaces":[{"interface":"back","average":{"1min":22.033000000000001,"5min":21.033999999999999,"15min":22.164999999999999},"min":{"1min":10.708,"5min":9.3059999999999992,"15min":6.7409999999999997},"max":{"1min":98.747,"5min":98.747,"15min":244.86099999999999},"last":12.996},{"interface":"front","average":{"1min":12.505000000000001,"5min":14.978,"15min":20.456},"min":{"1min":5.8739999999999997,"5min":5.8739999999999997,"15min":5.8739999999999997},"max":{"1min":53.558,"5min":112.798,"15min":277.55700000000002},"last":8.3460000000000001}]},{"osd":6,"last update":"Sun Nov 5 08:28:41 2023","interfaces":[{"interface":"back","average":{"1min":15.161,"5min":20.539999999999999,"15min":24.504000000000001},"min":{"1min":7.093,"5min":7.093,"15min":5.7930000000000001},"max":{"1min":59.149000000000001,"5min":242.536,"15min":242.536},"last":30.408000000000001},{"interface":"front","average":{"1min":25.109000000000002,"5min":26.298999999999999,"15min":27.393999999999998},"min":{"1min":9.1289999999999996,"5min":7.6870000000000003,"15min":7.0300000000000002},"max":{"1min":85.906000000000006,"5min":227.50299999999999,"15min":310.69099999999997},"last":11.214}]},{"osd":7,"last update":"Sun Nov 5 08:28:41 2023","interfaces":[{"interface":"back","average":{"1min":26.856000000000002,"5min":23.469000000000001,"15min":27.475999999999999},"min":{"1min":11.613,"5min":8.7769999999999992,"15min":8.2379999999999995},"max":{"1min":100.372,"5min":119.51900000000001,"15min":281.71199999999999},"last":24.282},{"interface":"front","average":{"1min":26.722000000000001,"5min":23.254999999999999,"15min":29.834},"min":{"1min":9.8550000000000004,"5min":8.0860000000000003,"15min":8.0860000000000003},"max":{"1min":90.287999999999997,"5min":94.194999999999993,"15min":319.786},"last":20.565000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542416,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63368,"kb_used_data":5812,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94308472,"statfs":{"total":96636764160,"available":96571875328,"internally_reserved":0,"allocated":5951488,"data_stored":3235217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":44,"apply_latency_ms":44,"commit_latency_ns":44000000,"apply_latency_ns":44000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 5 08:28:35 2023","interfaces":[{"interface":"back","average":{"1min":9.3810000000000002,"5min":13.75,"15min":20.544},"min":{"1min":5.633,"5min":5.0940000000000003,"15min":5.0069999999999997},"max":{"1min":27.414000000000001,"5min":75.152000000000001,"15min":243.626},"last":13.266},{"interface":"front","average":{"1min":15.006,"5min":19.321000000000002,"15min":24.324999999999999},"min":{"1min":9.4640000000000004,"5min":5.7199999999999998,"15min":5.7199999999999998},"max":{"1min":30.917000000000002,"5min":132.78899999999999,"15min":202.49000000000001},"last":16.559999999999999}]},{"osd":1,"last update":"Sun Nov 5 08:28:35 2023","interfaces":[{"interface":"back","average":{"1min":12.646000000000001,"5min":16.113,"15min":21.669},"min":{"1min":5.4790000000000001,"5min":4.5709999999999997,"15min":4.274},"max":{"1min":24.260000000000002,"5min":162.90799999999999,"15min":369.267},"last":19.465},{"interface":"front","average":{"1min":9.8100000000000005,"5min":15.993,"15min":24.495999999999999},"min":{"1min":5.4930000000000003,"5min":5.4930000000000003,"15min":5.4930000000000003},"max":{"1min":25.135000000000002,"5min":157.459,"15min":340.214},"last":40.164000000000001}]},{"osd":2,"last update":"Sun Nov 5 08:28:35 2023","interfaces":[{"interface":"back","average":{"1min":15.661,"5min":21.771000000000001,"15min":27.968},"min":{"1min":7.2199999999999998,"5min":6.7750000000000004,"15min":6.7750000000000004},"max":{"1min":31.937000000000001,"5min":192.44999999999999,"15min":241.934},"last":17.786000000000001},{"interface":"front","average":{"1min":14.156000000000001,"5min":20.931000000000001,"15min":26.690999999999999},"min":{"1min":6.5110000000000001,"5min":6.5110000000000001,"15min":6.3109999999999999},"max":{"1min":26.538,"5min":183.47900000000001,"15min":368.279},"last":6.6669999999999998}]},{"osd":3,"last update":"Sun Nov 5 08:28:35 2023","interfaces":[{"interface":"back","average":{"1min":13.609999999999999,"5min":19.948,"15min":24.542000000000002},"min":{"1min":7.9960000000000004,"5min":6.6680000000000001,"15min":6.1200000000000001},"max":{"1min":57.084000000000003,"5min":164.06399999999999,"15min":369.53399999999999},"last":10.368},{"interface":"front","average":{"1min":18.161000000000001,"5min":24.800000000000001,"15min":32.271000000000001},"min":{"1min":6.8920000000000003,"5min":6.8920000000000003,"15min":6.8920000000000003},"max":{"1min":55.741,"5min":196.655,"15min":371.52499999999998},"last":18.779}]},{"osd":5,"last update":"Sun Nov 5 08:28:35 2023","interfaces":[{"interface":"back","average":{"1min":18.956,"5min":26.338000000000001,"15min":32.387999999999998},"min":{"1min":12.984,"5min":8.4469999999999992,"15min":7.0010000000000003},"max":{"1min":35.478999999999999,"5min":202.82900000000001,"15min":283.08100000000002},"last":20.763999999999999},{"interface":"front","average":{"1min":15.491,"5min":25.239999999999998,"15min":27.282},"min":{"1min":9.4550000000000001,"5min":6.6219999999999999,"15min":6.3010000000000002},"max":{"1min":28.989999999999998,"5min":264.10300000000001,"15min":283.94400000000002},"last":8.4329999999999998}]},{"osd":6,"last update":"Sun Nov 5 08:28:35 2023","interfaces":[{"interface":"back","average":{"1min":18.690999999999999,"5min":19.449999999999999,"15min":26.378},"min":{"1min":7.7930000000000001,"5min":7.1740000000000004,"15min":6.4359999999999999},"max":{"1min":122.85899999999999,"5min":165.113,"15min":324.98200000000003},"last":14.554},{"interface":"front","average":{"1min":24.279,"5min":26.126000000000001,"15min":31.824000000000002},"min":{"1min":9.5470000000000006,"5min":9.5470000000000006,"15min":8.5890000000000004},"max":{"1min":125.249,"5min":205.83199999999999,"15min":288.26799999999997},"last":21.827000000000002}]},{"osd":7,"last update":"Sun Nov 5 08:28:35 2023","interfaces":[{"interface":"back","average":{"1min":17.625,"5min":26.843,"15min":29.835999999999999},"min":{"1min":8.8219999999999992,"5min":7.7009999999999996,"15min":7.1559999999999997},"max":{"1min":43.206000000000003,"5min":211.39400000000001,"15min":356.44600000000003},"last":11.589},{"interface":"front","average":{"1min":20.716999999999999,"5min":27.966000000000001,"15min":30.741},"min":{"1min":13.167999999999999,"5min":9.7159999999999993,"15min":9.7159999999999993},"max":{"1min":41.866999999999997,"5min":208.833,"15min":327.53800000000001},"last":15.785}]}]},{"osd":6,"up_from":13,"seq":55834575117,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59208,"kb_used_data":5816,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94312632,"statfs":{"total":96636764160,"available":96576135168,"internally_reserved":0,"allocated":5955584,"data_stored":3244032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":49,"apply_latency_ms":49,"commit_latency_ns":49000000,"apply_latency_ns":49000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 5 08:28:46 2023","interfaces":[{"interface":"back","average":{"1min":16.972999999999999,"5min":17.661999999999999,"15min":18.792000000000002},"min":{"1min":4.7169999999999996,"5min":4.1600000000000001,"15min":4.1600000000000001},"max":{"1min":98.253,"5min":165.51900000000001,"15min":187.75899999999999},"last":10.476000000000001},{"interface":"front","average":{"1min":20.254999999999999,"5min":18.486999999999998,"15min":18.247},"min":{"1min":6.7910000000000004,"5min":5.3049999999999997,"15min":4.6790000000000003},"max":{"1min":119.42100000000001,"5min":168.239,"15min":185.38200000000001},"last":12.847}]},{"osd":1,"last update":"Sun Nov 5 08:28:46 2023","interfaces":[{"interface":"back","average":{"1min":17.149000000000001,"5min":23.170000000000002,"15min":24.638999999999999},"min":{"1min":8.7639999999999993,"5min":5.4720000000000004,"15min":5.4720000000000004},"max":{"1min":57.432000000000002,"5min":226.23500000000001,"15min":286.072},"last":20.571999999999999},{"interface":"front","average":{"1min":17.667999999999999,"5min":20.977,"15min":23.52},"min":{"1min":8.1519999999999992,"5min":5.6980000000000004,"15min":5.6980000000000004},"max":{"1min":72.725999999999999,"5min":168.25899999999999,"15min":309.512},"last":9.7400000000000002}]},{"osd":2,"last update":"Sun Nov 5 08:28:46 2023","interfaces":[{"interface":"back","average":{"1min":18.177,"5min":23.372,"15min":24.986999999999998},"min":{"1min":7.9550000000000001,"5min":7.0030000000000001,"15min":6.6390000000000002},"max":{"1min":63.627000000000002,"5min":177.25,"15min":244.21100000000001},"last":15.42},{"interface":"front","average":{"1min":22.576000000000001,"5min":31.414000000000001,"15min":29.402999999999999},"min":{"1min":10.571999999999999,"5min":9.4179999999999993,"15min":8.8000000000000007},"max":{"1min":86.832999999999998,"5min":335.95100000000002,"15min":335.95100000000002},"last":17.521999999999998}]},{"osd":3,"last update":"Sun Nov 5 08:28:46 2023","interfaces":[{"interface":"back","average":{"1min":13.595000000000001,"5min":21.442,"15min":26.722000000000001},"min":{"1min":6.5359999999999996,"5min":6.4909999999999997,"15min":6.4909999999999997},"max":{"1min":55.103999999999999,"5min":175.47300000000001,"15min":372.54199999999997},"last":7.3789999999999996},{"interface":"front","average":{"1min":26.343,"5min":22.968,"15min":21.238},"min":{"1min":11.815,"5min":6.2000000000000002,"15min":6.0069999999999997},"max":{"1min":113.185,"5min":152.446,"15min":273.34300000000002},"last":16.245000000000001}]},{"osd":4,"last update":"Sun Nov 5 08:28:46 2023","interfaces":[{"interface":"back","average":{"1min":20.216000000000001,"5min":19.321000000000002,"15min":19.097000000000001},"min":{"1min":8.0090000000000003,"5min":6.468,"15min":6.468},"max":{"1min":91.988,"5min":138.107,"15min":211},"last":16.884},{"interface":"front","average":{"1min":22.460000000000001,"5min":22.382999999999999,"15min":22.785},"min":{"1min":7.6790000000000003,"5min":7.6790000000000003,"15min":7.5670000000000002},"max":{"1min":90.873000000000005,"5min":178.578,"15min":255.61600000000001},"last":21.669}]},{"osd":5,"last update":"Sun Nov 5 08:28:46 2023","interfaces":[{"interface":"back","average":{"1min":27.132999999999999,"5min":21.550999999999998,"15min":27.628},"min":{"1min":6.4169999999999998,"5min":6.4169999999999998,"15min":6.4169999999999998},"max":{"1min":114.03400000000001,"5min":121.566,"15min":915.64300000000003},"last":8.4870000000000001},{"interface":"front","average":{"1min":35.225999999999999,"5min":28.045000000000002,"15min":34.017000000000003},"min":{"1min":11.31,"5min":11.31,"15min":8.8079999999999998},"max":{"1min":171.06899999999999,"5min":171.06899999999999,"15min":928.67899999999997},"last":19.628}]},{"osd":7,"last update":"Sun Nov 5 08:28:46 2023","interfaces":[{"interface":"back","average":{"1min":26.385000000000002,"5min":22.568000000000001,"15min":23.834},"min":{"1min":10.788,"5min":7.3730000000000002,"15min":7.3730000000000002},"max":{"1min":128.999,"5min":167.63800000000001,"15min":212.917},"last":22.367000000000001},{"interface":"front","average":{"1min":23.076000000000001,"5min":22.853000000000002,"15min":25.146000000000001},"min":{"1min":8.8940000000000001,"5min":8.609,"15min":7.3259999999999996},"max":{"1min":118.515,"5min":182.375,"15min":222.44499999999999},"last":11.186}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-05T08:29:24.388 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-05T08:29:24.388 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-05T08:29:24.494 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.494+0000 7f26e84c2640 10 monclient: get_monmap_and_config 2023-11-05T08:29:24.494 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.494+0000 7f26e84c2640 10 monclient: build_initial_monmap 2023-11-05T08:29:24.494 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.494+0000 7f26e84c2640 10 monclient: monmap: 2023-11-05T08:29:24.495 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:29:24.495 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:24.495 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:29:24.494612+0000 2023-11-05T08:29:24.495 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:29:24.494612+0000 2023-11-05T08:29:24.495 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:29:24.496 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:24.496 INFO:teuthology.orchestra.run.smithi052.stderr:0: v1:172.21.15.52:6789/0 mon.noname-a-legacy 2023-11-05T08:29:24.496 INFO:teuthology.orchestra.run.smithi052.stderr:1: v1:172.21.15.156:6789/0 mon.noname-c-legacy 2023-11-05T08:29:24.496 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-b 2023-11-05T08:29:24.496 INFO:teuthology.orchestra.run.smithi052.stderr:3: v2:172.21.15.52:3300/0 mon.noname-a 2023-11-05T08:29:24.497 INFO:teuthology.orchestra.run.smithi052.stderr:4: v2:172.21.15.156:3300/0 mon.noname-c 2023-11-05T08:29:24.497 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:24.500 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.494+0000 7f26e84c2640 1 Processor -- start 2023-11-05T08:29:24.500 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.494+0000 7f26e84c2640 1 -- start start 2023-11-05T08:29:24.500 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.494+0000 7f26e84c2640 10 monclient: init 2023-11-05T08:29:24.500 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.495+0000 7f26e84c2640 10 monclient: _reopen_session rank -1 2023-11-05T08:29:24.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.495+0000 7f26e84c2640 10 monclient: _add_conns ranks=[4,3,2,1,0] 2023-11-05T08:29:24.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.495+0000 7f26e84c2640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f26e00a8ae0 0x7f26e013ec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:24.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.495+0000 7f26e84c2640 10 monclient(hunting): picked mon.noname-c con 0x7f26e00a8ae0 addr v2:172.21.15.156:3300/0 2023-11-05T08:29:24.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.495+0000 7f26e84c2640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f26e00a8ec0 0x7f26e013f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:24.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.495+0000 7f26e84c2640 10 monclient(hunting): picked mon.noname-a con 0x7f26e00a8ec0 addr v2:172.21.15.52:3300/0 2023-11-05T08:29:24.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.495+0000 7f26e84c2640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f26e00b0de0 0x7f26e0145000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:24.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.495+0000 7f26e84c2640 10 monclient(hunting): picked mon.noname-b con 0x7f26e00b0de0 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:29:24.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.495+0000 7f26e84c2640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:24.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.495+0000 7f26e84c2640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26e00a9360 con 0x7f26e00a8ec0 2023-11-05T08:29:24.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.495+0000 7f26e84c2640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:24.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.495+0000 7f26e84c2640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26e00a9600 con 0x7f26e00a8ae0 2023-11-05T08:29:24.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.495+0000 7f26e84c2640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:24.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.495+0000 7f26e84c2640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26e00b80b0 con 0x7f26e00b0de0 2023-11-05T08:29:24.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.495+0000 7f26e84c2640 10 monclient(hunting): _renew_subs 2023-11-05T08:29:24.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.495+0000 7f26e84c2640 10 monclient(hunting): authenticate will time out at 2710.700407s 2023-11-05T08:29:24.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.496+0000 7f26e5a5d640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f26e00a8ec0 0x7f26e013f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:24.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.496+0000 7f26e625e640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f26e00a8ae0 0x7f26e013ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:24.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.496+0000 7f26e6a5f640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f26e00b0de0 0x7f26e0145000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:24.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.496+0000 7f26e5a5d640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f26e00a8ec0 0x7f26e013f170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42780/0 (socket says 172.21.15.52:42780) 2023-11-05T08:29:24.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.496+0000 7f26e5a5d640 1 -- 172.21.15.52:0/3624261614 learned_addr learned my addr 172.21.15.52:0/3624261614 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-11-05T08:29:24.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.496+0000 7f26e5a5d640 10 monclient(hunting): get_auth_request con 0x7f26e00a8ec0 auth_method 0 2023-11-05T08:29:24.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.496+0000 7f26e5a5d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:29:24.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.496+0000 7f26e5a5d640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:29:24.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.496+0000 7f26e5a5d640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:29:24.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.496+0000 7f26e6a5f640 10 monclient(hunting): get_auth_request con 0x7f26e00b0de0 auth_method 0 2023-11-05T08:29:24.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.496+0000 7f26e6a5f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:29:24.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.496+0000 7f26e6a5f640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:29:24.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.496+0000 7f26e6a5f640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:29:24.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.496+0000 7f26e625e640 10 monclient(hunting): get_auth_request con 0x7f26e00a8ae0 auth_method 0 2023-11-05T08:29:24.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.496+0000 7f26e625e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:29:24.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.496+0000 7f26e625e640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:29:24.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.496+0000 7f26e625e640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:29:24.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.496+0000 7f26e5a5d640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:29:24.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.496+0000 7f26e5a5d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:29:24.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.496+0000 7f26e5a5d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:29:24.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.497+0000 7f26e625e640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:29:24.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.497+0000 7f26e625e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:29:24.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.497+0000 7f26e625e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:29:24.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.497+0000 7f26e6a5f640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:29:24.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.497+0000 7f26e6a5f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:29:24.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.497+0000 7f26e6a5f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:29:24.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.498+0000 7f26e5a5d640 10 monclient(hunting): handle_auth_done global_id 15687 payload 274 2023-11-05T08:29:24.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.498+0000 7f26e5a5d640 1 -- 172.21.15.52:0/3624261614 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f26e00b0de0 msgr2=0x7f26e0145000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-05T08:29:24.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.498+0000 7f26e5a5d640 1 --2- 172.21.15.52:0/3624261614 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f26e00b0de0 0x7f26e0145000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:24.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.498+0000 7f26e5a5d640 1 -- 172.21.15.52:0/3624261614 >> v2:172.21.15.156:3300/0 conn(0x7f26e00a8ae0 msgr2=0x7f26e013ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-05T08:29:24.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.498+0000 7f26e5a5d640 1 --2- 172.21.15.52:0/3624261614 >> v2:172.21.15.156:3300/0 conn(0x7f26e00a8ae0 0x7f26e013ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:24.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.498+0000 7f26e5a5d640 10 monclient: _finish_hunting 0 2023-11-05T08:29:24.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.498+0000 7f26e5a5d640 1 monclient: found mon.noname-a 2023-11-05T08:29:24.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.498+0000 7f26e5a5d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:29:24.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.498+0000 7f26e5a5d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.52:3300/0 2023-11-05T08:29:24.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.498+0000 7f26e5a5d640 1 -- 172.21.15.52:0/3624261614 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26e0145540 con 0x7f26e00a8ec0 2023-11-05T08:29:24.514 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.500+0000 7f26e5a5d640 1 --2- 172.21.15.52:0/3624261614 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26e00a8ec0 0x7f26e013f170 secure :-1 s=READY pgs=3047 cs=0 l=1 rev1=1 crypto rx=0x7f26e006d070 tx=0x7f26d002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cb6f05129dbeda3 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:29:24.514 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.504+0000 7f26e525c640 1 -- 172.21.15.52:0/3624261614 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d0030860 con 0x7f26e00a8ec0 2023-11-05T08:29:24.514 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.504+0000 7f26e525c640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:29:24.514 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.504+0000 7f26e525c640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-11-05T08:29:24.515 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.504+0000 7f26e525c640 10 monclient: dump: 2023-11-05T08:29:24.515 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:29:24.515 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:24.515 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:24.515 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:24.516 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:29:24.516 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:24.516 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:29:24.516 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:29:24.516 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:29:24.517 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:24.517 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.504+0000 7f26e525c640 10 monclient: _finish_auth 0 2023-11-05T08:29:24.517 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.504+0000 7f26e525c640 10 monclient: _check_auth_tickets 2023-11-05T08:29:24.517 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.504+0000 7f26e525c640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:29:24.517 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.504+0000 7f26e525c640 1 -- 172.21.15.52:0/3624261614 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26d00309c0 con 0x7f26e00a8ec0 2023-11-05T08:29:24.517 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.504+0000 7f26e525c640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:29:24.518 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.504+0000 7f26e525c640 1 -- 172.21.15.52:0/3624261614 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d0030d50 con 0x7f26e00a8ec0 2023-11-05T08:29:24.518 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.504+0000 7f26e525c640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:29:24.518 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.504+0000 7f26e525c640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-11-05T08:29:24.518 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.504+0000 7f26e525c640 10 monclient: dump: 2023-11-05T08:29:24.518 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:29:24.519 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:24.519 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:24.519 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:24.519 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:29:24.519 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:24.520 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:29:24.520 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:29:24.520 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:29:24.520 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:24.520 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.504+0000 7f26e84c2640 5 monclient: authenticate success, global_id 15687 2023-11-05T08:29:24.520 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.504+0000 7f26e84c2640 10 monclient: get_monmap_and_config success 2023-11-05T08:29:24.521 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.504+0000 7f26e84c2640 4 set_mon_vals no callback set 2023-11-05T08:29:24.521 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.504+0000 7f26e84c2640 10 monclient: shutdown 2023-11-05T08:29:24.521 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.504+0000 7f26e84c2640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:29:24.521 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.504+0000 7f26e84c2640 1 -- 172.21.15.52:0/3624261614 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26e00a8ec0 msgr2=0x7f26e013f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:24.521 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.504+0000 7f26e84c2640 1 --2- 172.21.15.52:0/3624261614 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26e00a8ec0 0x7f26e013f170 secure :-1 s=READY pgs=3047 cs=0 l=1 rev1=1 crypto rx=0x7f26e006d070 tx=0x7f26d002b9a0 comp rx=0 tx=0).stop 2023-11-05T08:29:24.522 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.505+0000 7f26e84c2640 1 -- 172.21.15.52:0/3624261614 shutdown_connections 2023-11-05T08:29:24.522 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.505+0000 7f26e84c2640 1 --2- 172.21.15.52:0/3624261614 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f26e00b0de0 0x7f26e0145000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:24.522 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.505+0000 7f26e84c2640 1 --2- 172.21.15.52:0/3624261614 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26e00a8ec0 0x7f26e013f170 unknown :-1 s=CLOSED pgs=3047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:24.522 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.505+0000 7f26e84c2640 1 --2- 172.21.15.52:0/3624261614 >> v2:172.21.15.156:3300/0 conn(0x7f26e00a8ae0 0x7f26e013ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:24.522 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.505+0000 7f26e84c2640 1 -- 172.21.15.52:0/3624261614 >> 172.21.15.52:0/3624261614 conn(0x7f26e00b7230 msgr2=0x7f26e00b7610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:29:24.523 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.505+0000 7f26e84c2640 1 -- 172.21.15.52:0/3624261614 shutdown_connections 2023-11-05T08:29:24.523 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.505+0000 7f26e84c2640 1 -- 172.21.15.52:0/3624261614 wait complete. 2023-11-05T08:29:24.523 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.505+0000 7f26e84c2640 10 monclient: build_initial_monmap 2023-11-05T08:29:24.523 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.505+0000 7f26e84c2640 10 monclient: monmap: 2023-11-05T08:29:24.523 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:29:24.523 INFO:teuthology.orchestra.run.smithi052.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-05T08:29:24.524 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 0.000000 2023-11-05T08:29:24.524 INFO:teuthology.orchestra.run.smithi052.stderr:created 0.000000 2023-11-05T08:29:24.524 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:29:24.524 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:24.524 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.noname-a 2023-11-05T08:29:24.525 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.noname-b 2023-11-05T08:29:24.525 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-c 2023-11-05T08:29:24.525 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:24.525 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.506+0000 7f26e84c2640 1 librados: starting msgr at 2023-11-05T08:29:24.525 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.506+0000 7f26e84c2640 1 librados: starting objecter 2023-11-05T08:29:24.525 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.506+0000 7f26e84c2640 1 Processor -- start 2023-11-05T08:29:24.526 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.506+0000 7f26e84c2640 1 -- start start 2023-11-05T08:29:24.526 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.506+0000 7f26e84c2640 1 librados: setting wanted keys 2023-11-05T08:29:24.526 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.506+0000 7f26e84c2640 1 librados: calling monclient init 2023-11-05T08:29:24.526 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.506+0000 7f26e84c2640 10 monclient: init 2023-11-05T08:29:24.526 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.506+0000 7f26e84c2640 10 monclient: _reopen_session rank -1 2023-11-05T08:29:24.527 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.506+0000 7f26e84c2640 10 monclient: _add_conns ranks=[0,2,1] 2023-11-05T08:29:24.527 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.506+0000 7f26e84c2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26e00a8ae0 0x7f26e0144930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:24.527 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.506+0000 7f26e84c2640 10 monclient(hunting): picked mon.noname-a con 0x7f26e00a8ae0 addr [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] 2023-11-05T08:29:24.527 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.506+0000 7f26e84c2640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f26e00a8ec0 0x7f26e013d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:24.527 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.506+0000 7f26e84c2640 10 monclient(hunting): picked mon.noname-c con 0x7f26e00a8ec0 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:29:24.528 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.507+0000 7f26e84c2640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f26e00b0de0 0x7f26e01d67c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:24.528 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.507+0000 7f26e84c2640 10 monclient(hunting): picked mon.noname-b con 0x7f26e00b0de0 addr [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] 2023-11-05T08:29:24.528 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.507+0000 7f26e84c2640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:24.528 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.507+0000 7f26e84c2640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26e01444a0 con 0x7f26e00a8ae0 2023-11-05T08:29:24.528 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.507+0000 7f26e84c2640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:24.529 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.507+0000 7f26e84c2640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26e00b6620 con 0x7f26e00b0de0 2023-11-05T08:29:24.529 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.507+0000 7f26e84c2640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:24.529 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.507+0000 7f26e84c2640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26e013e020 con 0x7f26e00a8ec0 2023-11-05T08:29:24.529 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.507+0000 7f26e84c2640 10 monclient(hunting): _renew_subs 2023-11-05T08:29:24.529 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.507+0000 7f26e84c2640 10 monclient(hunting): authenticate will time out at 2710.711944s 2023-11-05T08:29:24.529 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.507+0000 7f26e5a5d640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f26e00a8ec0 0x7f26e013d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:24.530 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.507+0000 7f26e625e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26e00a8ae0 0x7f26e0144930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:24.530 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.507+0000 7f26e6a5f640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f26e00b0de0 0x7f26e01d67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:24.530 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.507+0000 7f26e625e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26e00a8ae0 0x7f26e0144930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42790/0 (socket says 172.21.15.52:42790) 2023-11-05T08:29:24.530 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.507+0000 7f26e625e640 1 -- 172.21.15.52:0/545251693 learned_addr learned my addr 172.21.15.52:0/545251693 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-11-05T08:29:24.530 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.507+0000 7f26e625e640 10 monclient(hunting): get_auth_request con 0x7f26e00a8ae0 auth_method 0 2023-11-05T08:29:24.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.507+0000 7f26e625e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:29:24.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.507+0000 7f26e625e640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:29:24.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.507+0000 7f26e625e640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:29:24.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.508+0000 7f26e5a5d640 10 monclient(hunting): get_auth_request con 0x7f26e00a8ec0 auth_method 0 2023-11-05T08:29:24.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.508+0000 7f26e5a5d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:29:24.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.508+0000 7f26e5a5d640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:29:24.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.508+0000 7f26e5a5d640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:29:24.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.508+0000 7f26e6a5f640 10 monclient(hunting): get_auth_request con 0x7f26e00b0de0 auth_method 0 2023-11-05T08:29:24.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.508+0000 7f26e6a5f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:29:24.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.508+0000 7f26e6a5f640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:29:24.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.508+0000 7f26e6a5f640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:29:24.533 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.508+0000 7f26e6a5f640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:29:24.533 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.508+0000 7f26e6a5f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:29:24.533 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.508+0000 7f26e6a5f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:29:24.533 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.508+0000 7f26e625e640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:29:24.533 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.508+0000 7f26e625e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:29:24.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.508+0000 7f26e625e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:29:24.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.508+0000 7f26e5a5d640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:29:24.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.508+0000 7f26e5a5d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:29:24.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.508+0000 7f26e5a5d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:29:24.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.511+0000 7f26e6a5f640 10 monclient(hunting): handle_auth_done global_id 20692 payload 824 2023-11-05T08:29:24.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.511+0000 7f26e6a5f640 1 -- 172.21.15.52:0/545251693 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f26e00a8ec0 msgr2=0x7f26e013d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:24.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.511+0000 7f26e6a5f640 1 --2- 172.21.15.52:0/545251693 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f26e00a8ec0 0x7f26e013d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:24.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.511+0000 7f26e6a5f640 1 -- 172.21.15.52:0/545251693 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26e00a8ae0 msgr2=0x7f26e0144930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:24.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.511+0000 7f26e6a5f640 1 --2- 172.21.15.52:0/545251693 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26e00a8ae0 0x7f26e0144930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:24.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.511+0000 7f26e6a5f640 10 monclient: _finish_hunting 0 2023-11-05T08:29:24.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.511+0000 7f26e6a5f640 1 monclient: found mon.noname-b 2023-11-05T08:29:24.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.511+0000 7f26e6a5f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:29:24.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.511+0000 7f26e6a5f640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.156:3300/0 2023-11-05T08:29:24.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.511+0000 7f26e6a5f640 1 -- 172.21.15.52:0/545251693 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26d00094d0 con 0x7f26e00b0de0 2023-11-05T08:29:24.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.513+0000 7f26e6a5f640 1 --2- 172.21.15.52:0/545251693 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f26e00b0de0 0x7f26e01d67c0 secure :-1 s=READY pgs=4994 cs=0 l=1 rev1=1 crypto rx=0x7f26d800eba0 tx=0x7f26d800c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:29:24.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.513+0000 7f26d6ffd640 10 client.?.objecter ms_handle_connect 0x7f26e00b0de0 2023-11-05T08:29:24.537 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.513+0000 7f26d6ffd640 10 client.?.objecter resend_mon_ops 2023-11-05T08:29:24.538 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.517+0000 7f26d6ffd640 1 -- 172.21.15.52:0/545251693 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d800cd20 con 0x7f26e00b0de0 2023-11-05T08:29:24.538 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.517+0000 7f26d6ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:29:24.539 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.517+0000 7f26d6ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-05T08:29:24.539 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.517+0000 7f26d6ffd640 10 monclient: dump: 2023-11-05T08:29:24.539 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:29:24.539 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:24.539 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:24.540 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:24.540 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:29:24.540 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:24.540 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:29:24.540 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:29:24.541 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:29:24.541 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:24.541 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.517+0000 7f26d6ffd640 10 monclient: _finish_auth 0 2023-11-05T08:29:24.541 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.517+0000 7f26d6ffd640 10 monclient: _check_auth_tickets 2023-11-05T08:29:24.541 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.517+0000 7f26d6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:29:24.542 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.517+0000 7f26d6ffd640 1 -- 172.21.15.52:0/545251693 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26d800f040 con 0x7f26e00b0de0 2023-11-05T08:29:24.542 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.517+0000 7f26d6ffd640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:29:24.542 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.517+0000 7f26d6ffd640 1 -- 172.21.15.52:0/545251693 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d80146c0 con 0x7f26e00b0de0 2023-11-05T08:29:24.542 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.517+0000 7f26d6ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:29:24.542 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.517+0000 7f26d6ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-05T08:29:24.543 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.517+0000 7f26d6ffd640 10 monclient: dump: 2023-11-05T08:29:24.543 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:29:24.543 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:24.543 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:24.543 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:24.544 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:29:24.544 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:24.544 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:29:24.544 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:29:24.544 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:29:24.544 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:24.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.517+0000 7f26e84c2640 5 monclient: authenticate success, global_id 20692 2023-11-05T08:29:24.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.517+0000 7f26e84c2640 10 monclient: _renew_subs 2023-11-05T08:29:24.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.517+0000 7f26e4a5b640 4 set_mon_vals no callback set 2023-11-05T08:29:24.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.517+0000 7f26e84c2640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:29:24.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.517+0000 7f26e84c2640 1 -- 172.21.15.52:0/545251693 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26e0144030 con 0x7f26e00b0de0 2023-11-05T08:29:24.546 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.517+0000 7f26e84c2640 10 client.20692.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-05T08:29:24.546 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.517+0000 7f26e84c2640 10 monclient: _renew_subs 2023-11-05T08:29:24.546 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.517+0000 7f26e84c2640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:29:24.546 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.517+0000 7f26e84c2640 1 -- 172.21.15.52:0/545251693 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26e01d6ee0 con 0x7f26e00b0de0 2023-11-05T08:29:24.546 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.517+0000 7f26e84c2640 1 librados: init done 2023-11-05T08:29:24.547 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.518+0000 7f26e84c2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-05T08:29:24.547 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.518+0000 7f26e84c2640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:29:24.547 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.518+0000 7f26e84c2640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:29:24.547 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.518+0000 7f26e84c2640 1 -- 172.21.15.52:0/545251693 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26e0144610 con 0x7f26e00b0de0 2023-11-05T08:29:24.547 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.537+0000 7f26d6ffd640 1 -- 172.21.15.52:0/545251693 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f26d8014820 con 0x7f26e00b0de0 2023-11-05T08:29:24.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.537+0000 7f26d6ffd640 1 --2- 172.21.15.52:0/545251693 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f26c406c850 0x7f26c406ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:24.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.537+0000 7f26e625e640 1 --2- 172.21.15.52:0/545251693 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f26c406c850 0x7f26c406ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:24.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.537+0000 7f26e625e640 10 monclient: get_auth_request con 0x7f26c406c850 auth_method 0 2023-11-05T08:29:24.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.538+0000 7f26d6ffd640 10 client.20692.objecter ms_handle_connect 0x7f26c406c850 2023-11-05T08:29:24.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.538+0000 7f26e625e640 1 --2- 172.21.15.52:0/545251693 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f26c406c850 0x7f26c406ed10 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f26dc009b70 tx=0x7f26dc009110 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:29:24.549 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.540+0000 7f26d6ffd640 1 -- 172.21.15.52:0/545251693 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(932..932 src has 541..932) v4 ==== 6193+0+0 (secure 0 0 0) 0x7f26d80595d0 con 0x7f26e00b0de0 2023-11-05T08:29:24.549 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.540+0000 7f26d6ffd640 10 client.20692.objecter ms_dispatch 0x7f26e0000b90 osd_map(932..932 src has 541..932) v4 2023-11-05T08:29:24.549 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.540+0000 7f26d6ffd640 3 client.20692.objecter handle_osd_map got epochs [932,932] > 0 2023-11-05T08:29:24.549 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.540+0000 7f26d6ffd640 3 client.20692.objecter handle_osd_map decoding full epoch 932 2023-11-05T08:29:24.550 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.540+0000 7f26d6ffd640 20 client.20692.objecter dump_active .. 0 homeless 2023-11-05T08:29:24.778 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.778+0000 7f26d6ffd640 1 -- 172.21.15.52:0/545251693 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f26d8055910 con 0x7f26e00b0de0 2023-11-05T08:29:24.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.778+0000 7f26d6ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:29:24.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.778+0000 7f26d6ffd640 10 monclient: _finish_command 1 = system:0 2023-11-05T08:29:24.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.956+0000 7f26e84c2640 1 -- 172.21.15.52:0/545251693 --> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f26e004e9f0 con 0x7f26c406c850 2023-11-05T08:29:24.961 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.961+0000 7f26d6ffd640 1 -- 172.21.15.52:0/545251693 <== mgr.4108 v2:172.21.15.156:6800/3320012339 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+151253 (secure 0 0 0) 0x7f26e004e9f0 con 0x7f26c406c850 2023-11-05T08:29:24.963 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:29:24.964 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2023-11-05T08:29:24.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.964+0000 7f26e84c2640 10 librados: watch_flush enter 2023-11-05T08:29:24.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.964+0000 7f26e84c2640 10 librados: watch_flush exit 2023-11-05T08:29:24.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.964+0000 7f26e84c2640 20 client.20692.objecter shutdown clearing up homeless session... 2023-11-05T08:29:24.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.964+0000 7f26e84c2640 10 client.20692.objecter successfully canceled tick 2023-11-05T08:29:24.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.964+0000 7f26e84c2640 1 -- 172.21.15.52:0/545251693 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f26c406c850 msgr2=0x7f26c406ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:24.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.964+0000 7f26e84c2640 1 --2- 172.21.15.52:0/545251693 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f26c406c850 0x7f26c406ed10 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f26dc009b70 tx=0x7f26dc009110 comp rx=0 tx=0).stop 2023-11-05T08:29:24.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.964+0000 7f26e84c2640 10 monclient: shutdown 2023-11-05T08:29:24.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.964+0000 7f26e84c2640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:29:24.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.964+0000 7f26e84c2640 1 -- 172.21.15.52:0/545251693 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f26e00b0de0 msgr2=0x7f26e01d67c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:24.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.964+0000 7f26e84c2640 1 --2- 172.21.15.52:0/545251693 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f26e00b0de0 0x7f26e01d67c0 secure :-1 s=READY pgs=4994 cs=0 l=1 rev1=1 crypto rx=0x7f26d800eba0 tx=0x7f26d800c490 comp rx=0 tx=0).stop 2023-11-05T08:29:24.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.964+0000 7f26e84c2640 1 -- 172.21.15.52:0/545251693 shutdown_connections 2023-11-05T08:29:24.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.964+0000 7f26e84c2640 1 --2- 172.21.15.52:0/545251693 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f26c406c850 0x7f26c406ed10 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:24.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.964+0000 7f26e84c2640 1 --2- 172.21.15.52:0/545251693 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f26e00b0de0 0x7f26e01d67c0 unknown :-1 s=CLOSED pgs=4994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:24.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.964+0000 7f26e84c2640 1 --2- 172.21.15.52:0/545251693 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f26e00a8ec0 0x7f26e013d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:24.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.964+0000 7f26e84c2640 1 --2- 172.21.15.52:0/545251693 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26e00a8ae0 0x7f26e0144930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:24.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.964+0000 7f26e84c2640 1 -- 172.21.15.52:0/545251693 >> 172.21.15.52:0/545251693 conn(0x7f26e00b7230 msgr2=0x7f26e00b2c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:29:24.972 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.964+0000 7f26e84c2640 1 -- 172.21.15.52:0/545251693 shutdown_connections 2023-11-05T08:29:24.972 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.964+0000 7f26e84c2640 1 -- 172.21.15.52:0/545251693 wait complete. 2023-11-05T08:29:24.972 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:24.964+0000 7f26e84c2640 1 librados: shutdown 2023-11-05T08:29:24.975 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":1610,"stamp":"2023-11-05T08:29:23.481560+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459285,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":102,"num_read_kb":88,"num_write":120,"num_write_kb":1379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":140,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":518336,"kb_used_data":46772,"kb_used_omap":12,"kb_used_meta":471411,"kb_avail":754456384,"statfs":{"total":773094113280,"available":772563337216,"internally_reserved":0,"allocated":47894528,"data_stored":26130876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":482725432},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":381,"apply_latency_ms":381,"commit_latency_ns":381000000,"apply_latency_ns":381000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4000299,"num_objects":-44,"num_object_clones":-1,"num_object_copies":-132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-44,"num_whiteouts":0,"num_read":-31,"num_read_kb":-11,"num_write":-71,"num_write_kb":-3969,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":-1,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.436968"},"pg_stats":[{"pgid":"12.10","version":"0'0","reported_seq":879,"reported_epoch":928,"state":"active+clean","last_fresh":"2023-11-05T08:29:17.949538+0000","last_change":"2023-11-05T08:08:27.690087+0000","last_active":"2023-11-05T08:29:17.949538+0000","last_peered":"2023-11-05T08:29:17.949538+0000","last_clean":"2023-11-05T08:29:17.949538+0000","last_became_active":"2023-11-05T08:08:27.684720+0000","last_became_peered":"2023-11-05T08:08:27.684720+0000","last_unstale":"2023-11-05T08:29:17.949538+0000","last_undegraded":"2023-11-05T08:29:17.949538+0000","last_fullsized":"2023-11-05T08:29:17.949538+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T19:41:08.111512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":880,"reported_epoch":930,"state":"active+clean","last_fresh":"2023-11-05T08:29:20.524528+0000","last_change":"2023-11-05T08:08:12.980044+0000","last_active":"2023-11-05T08:29:20.524528+0000","last_peered":"2023-11-05T08:29:20.524528+0000","last_clean":"2023-11-05T08:29:20.524528+0000","last_became_active":"2023-11-05T08:08:12.972471+0000","last_became_peered":"2023-11-05T08:08:12.972471+0000","last_unstale":"2023-11-05T08:29:20.524528+0000","last_undegraded":"2023-11-05T08:29:20.524528+0000","last_fullsized":"2023-11-05T08:29:20.524528+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T12:54:54.078770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":879,"reported_epoch":928,"state":"active+clean","last_fresh":"2023-11-05T08:29:18.321196+0000","last_change":"2023-11-05T08:08:20.798605+0000","last_active":"2023-11-05T08:29:18.321196+0000","last_peered":"2023-11-05T08:29:18.321196+0000","last_clean":"2023-11-05T08:29:18.321196+0000","last_became_active":"2023-11-05T08:08:20.791671+0000","last_became_peered":"2023-11-05T08:08:20.791671+0000","last_unstale":"2023-11-05T08:29:18.321196+0000","last_undegraded":"2023-11-05T08:29:18.321196+0000","last_fullsized":"2023-11-05T08:29:18.321196+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T13:29:00.846506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":866,"reported_epoch":929,"state":"active+clean","last_fresh":"2023-11-05T08:29:19.961924+0000","last_change":"2023-11-05T08:08:26.582880+0000","last_active":"2023-11-05T08:29:19.961924+0000","last_peered":"2023-11-05T08:29:19.961924+0000","last_clean":"2023-11-05T08:29:19.961924+0000","last_became_active":"2023-11-05T08:08:26.449074+0000","last_became_peered":"2023-11-05T08:08:26.449074+0000","last_unstale":"2023-11-05T08:29:19.961924+0000","last_undegraded":"2023-11-05T08:29:19.961924+0000","last_fullsized":"2023-11-05T08:29:19.961924+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T18:45:21.023650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":891,"reported_epoch":929,"state":"active+clean","last_fresh":"2023-11-05T08:29:19.458376+0000","last_change":"2023-11-05T08:08:32.323831+0000","last_active":"2023-11-05T08:29:19.458376+0000","last_peered":"2023-11-05T08:29:19.458376+0000","last_clean":"2023-11-05T08:29:19.458376+0000","last_became_active":"2023-11-05T08:08:32.275587+0000","last_became_peered":"2023-11-05T08:08:32.275587+0000","last_unstale":"2023-11-05T08:29:19.458376+0000","last_undegraded":"2023-11-05T08:29:19.458376+0000","last_fullsized":"2023-11-05T08:29:19.458376+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T13:12:36.530380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":878,"reported_epoch":929,"state":"active+clean","last_fresh":"2023-11-05T08:29:20.077274+0000","last_change":"2023-11-05T08:08:15.985625+0000","last_active":"2023-11-05T08:29:20.077274+0000","last_peered":"2023-11-05T08:29:20.077274+0000","last_clean":"2023-11-05T08:29:20.077274+0000","last_became_active":"2023-11-05T08:08:15.950681+0000","last_became_peered":"2023-11-05T08:08:15.950681+0000","last_unstale":"2023-11-05T08:29:20.077274+0000","last_undegraded":"2023-11-05T08:29:20.077274+0000","last_fullsized":"2023-11-05T08:29:20.077274+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T12:50:28.798998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":878,"reported_epoch":930,"state":"active+clean","last_fresh":"2023-11-05T08:29:20.537827+0000","last_change":"2023-11-05T08:08:24.751420+0000","last_active":"2023-11-05T08:29:20.537827+0000","last_peered":"2023-11-05T08:29:20.537827+0000","last_clean":"2023-11-05T08:29:20.537827+0000","last_became_active":"2023-11-05T08:08:24.718463+0000","last_became_peered":"2023-11-05T08:08:24.718463+0000","last_unstale":"2023-11-05T08:29:20.537827+0000","last_undegraded":"2023-11-05T08:29:20.537827+0000","last_fullsized":"2023-11-05T08:29:20.537827+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T18:26:27.301253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":878,"reported_epoch":929,"state":"active+clean","last_fresh":"2023-11-05T08:29:20.130566+0000","last_change":"2023-11-05T08:08:13.351797+0000","last_active":"2023-11-05T08:29:20.130566+0000","last_peered":"2023-11-05T08:29:20.130566+0000","last_clean":"2023-11-05T08:29:20.130566+0000","last_became_active":"2023-11-05T08:08:13.341684+0000","last_became_peered":"2023-11-05T08:08:13.341684+0000","last_unstale":"2023-11-05T08:29:20.130566+0000","last_undegraded":"2023-11-05T08:29:20.130566+0000","last_fullsized":"2023-11-05T08:29:20.130566+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T16:17:59.865184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":891,"reported_epoch":929,"state":"active+clean","last_fresh":"2023-11-05T08:29:19.519193+0000","last_change":"2023-11-05T08:08:15.525549+0000","last_active":"2023-11-05T08:29:19.519193+0000","last_peered":"2023-11-05T08:29:19.519193+0000","last_clean":"2023-11-05T08:29:19.519193+0000","last_became_active":"2023-11-05T08:08:15.520030+0000","last_became_peered":"2023-11-05T08:08:15.520030+0000","last_unstale":"2023-11-05T08:29:19.519193+0000","last_undegraded":"2023-11-05T08:29:19.519193+0000","last_fullsized":"2023-11-05T08:29:19.519193+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T14:24:09.563061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":891,"reported_epoch":929,"state":"active+clean","last_fresh":"2023-11-05T08:29:19.541086+0000","last_change":"2023-11-05T08:08:15.879034+0000","last_active":"2023-11-05T08:29:19.541086+0000","last_peered":"2023-11-05T08:29:19.541086+0000","last_clean":"2023-11-05T08:29:19.541086+0000","last_became_active":"2023-11-05T08:08:15.871149+0000","last_became_peered":"2023-11-05T08:08:15.871149+0000","last_unstale":"2023-11-05T08:29:19.541086+0000","last_undegraded":"2023-11-05T08:29:19.541086+0000","last_fullsized":"2023-11-05T08:29:19.541086+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T12:39:25.891428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":879,"reported_epoch":930,"state":"active+clean","last_fresh":"2023-11-05T08:29:20.519145+0000","last_change":"2023-11-05T08:08:14.156651+0000","last_active":"2023-11-05T08:29:20.519145+0000","last_peered":"2023-11-05T08:29:20.519145+0000","last_clean":"2023-11-05T08:29:20.519145+0000","last_became_active":"2023-11-05T08:08:14.060255+0000","last_became_peered":"2023-11-05T08:08:14.060255+0000","last_unstale":"2023-11-05T08:29:20.519145+0000","last_undegraded":"2023-11-05T08:29:20.519145+0000","last_fullsized":"2023-11-05T08:29:20.519145+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T09:03:54.287575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":891,"reported_epoch":929,"state":"active+clean","last_fresh":"2023-11-05T08:29:19.509110+0000","last_change":"2023-11-05T08:08:15.769320+0000","last_active":"2023-11-05T08:29:19.509110+0000","last_peered":"2023-11-05T08:29:19.509110+0000","last_clean":"2023-11-05T08:29:19.509110+0000","last_became_active":"2023-11-05T08:08:15.726426+0000","last_became_peered":"2023-11-05T08:08:15.726426+0000","last_unstale":"2023-11-05T08:29:19.509110+0000","last_undegraded":"2023-11-05T08:29:19.509110+0000","last_fullsized":"2023-11-05T08:29:19.509110+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T16:42:57.259557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":881,"reported_epoch":929,"state":"active+clean","last_fresh":"2023-11-05T08:29:19.258449+0000","last_change":"2023-11-05T08:07:07.897554+0000","last_active":"2023-11-05T08:29:19.258449+0000","last_peered":"2023-11-05T08:29:19.258449+0000","last_clean":"2023-11-05T08:29:19.258449+0000","last_became_active":"2023-11-05T08:07:07.890422+0000","last_became_peered":"2023-11-05T08:07:07.890422+0000","last_unstale":"2023-11-05T08:29:19.258449+0000","last_undegraded":"2023-11-05T08:29:19.258449+0000","last_fullsized":"2023-11-05T08:29:19.258449+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:07:05.115520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:07:05.115520+0000","last_clean_scrub_stamp":"2023-11-05T08:07:05.115520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T18:33:54.492130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":879,"reported_epoch":928,"state":"active+clean","last_fresh":"2023-11-05T08:29:17.966606+0000","last_change":"2023-11-05T08:08:38.368346+0000","last_active":"2023-11-05T08:29:17.966606+0000","last_peered":"2023-11-05T08:29:17.966606+0000","last_clean":"2023-11-05T08:29:17.966606+0000","last_became_active":"2023-11-05T08:08:38.362716+0000","last_became_peered":"2023-11-05T08:08:38.362716+0000","last_unstale":"2023-11-05T08:29:17.966606+0000","last_undegraded":"2023-11-05T08:29:17.966606+0000","last_fullsized":"2023-11-05T08:29:17.966606+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T19:21:04.243650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":884,"reported_epoch":928,"state":"active+clean","last_fresh":"2023-11-05T08:29:18.338442+0000","last_change":"2023-11-05T08:07:07.935570+0000","last_active":"2023-11-05T08:29:18.338442+0000","last_peered":"2023-11-05T08:29:18.338442+0000","last_clean":"2023-11-05T08:29:18.338442+0000","last_became_active":"2023-11-05T08:07:07.908128+0000","last_became_peered":"2023-11-05T08:07:07.908128+0000","last_unstale":"2023-11-05T08:29:18.338442+0000","last_undegraded":"2023-11-05T08:29:18.338442+0000","last_fullsized":"2023-11-05T08:29:18.338442+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:07:05.115520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:07:05.115520+0000","last_clean_scrub_stamp":"2023-11-05T08:07:05.115520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T15:25:37.194219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":892,"reported_epoch":929,"state":"active+clean","last_fresh":"2023-11-05T08:29:19.520761+0000","last_change":"2023-11-05T08:08:12.669619+0000","last_active":"2023-11-05T08:29:19.520761+0000","last_peered":"2023-11-05T08:29:19.520761+0000","last_clean":"2023-11-05T08:29:19.520761+0000","last_became_active":"2023-11-05T08:08:12.653053+0000","last_became_peered":"2023-11-05T08:08:12.653053+0000","last_unstale":"2023-11-05T08:29:19.520761+0000","last_undegraded":"2023-11-05T08:29:19.520761+0000","last_fullsized":"2023-11-05T08:29:19.520761+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T17:33:50.738772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":883,"reported_epoch":930,"state":"active+clean","last_fresh":"2023-11-05T08:29:20.271551+0000","last_change":"2023-11-05T08:07:07.213210+0000","last_active":"2023-11-05T08:29:20.271551+0000","last_peered":"2023-11-05T08:29:20.271551+0000","last_clean":"2023-11-05T08:29:20.271551+0000","last_became_active":"2023-11-05T08:07:07.203649+0000","last_became_peered":"2023-11-05T08:07:07.203649+0000","last_unstale":"2023-11-05T08:29:20.271551+0000","last_undegraded":"2023-11-05T08:29:20.271551+0000","last_fullsized":"2023-11-05T08:29:20.271551+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:07:05.115520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:07:05.115520+0000","last_clean_scrub_stamp":"2023-11-05T08:07:05.115520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T13:05:27.884687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":892,"reported_epoch":929,"state":"active+clean","last_fresh":"2023-11-05T08:29:19.555585+0000","last_change":"2023-11-05T08:08:14.906331+0000","last_active":"2023-11-05T08:29:19.555585+0000","last_peered":"2023-11-05T08:29:19.555585+0000","last_clean":"2023-11-05T08:29:19.555585+0000","last_became_active":"2023-11-05T08:08:14.900486+0000","last_became_peered":"2023-11-05T08:08:14.900486+0000","last_unstale":"2023-11-05T08:29:19.555585+0000","last_undegraded":"2023-11-05T08:29:19.555585+0000","last_fullsized":"2023-11-05T08:29:19.555585+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T14:54:34.273100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":872,"reported_epoch":929,"state":"active+clean","last_fresh":"2023-11-05T08:29:19.978553+0000","last_change":"2023-11-05T08:07:07.403639+0000","last_active":"2023-11-05T08:29:19.978553+0000","last_peered":"2023-11-05T08:29:19.978553+0000","last_clean":"2023-11-05T08:29:19.978553+0000","last_became_active":"2023-11-05T08:07:07.371569+0000","last_became_peered":"2023-11-05T08:07:07.371569+0000","last_unstale":"2023-11-05T08:29:19.978553+0000","last_undegraded":"2023-11-05T08:29:19.978553+0000","last_fullsized":"2023-11-05T08:29:19.978553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:07:05.115520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:07:05.115520+0000","last_clean_scrub_stamp":"2023-11-05T08:07:05.115520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T14:58:41.385179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":879,"reported_epoch":928,"state":"active+clean","last_fresh":"2023-11-05T08:29:18.316725+0000","last_change":"2023-11-05T08:08:29.214565+0000","last_active":"2023-11-05T08:29:18.316725+0000","last_peered":"2023-11-05T08:29:18.316725+0000","last_clean":"2023-11-05T08:29:18.316725+0000","last_became_active":"2023-11-05T08:08:29.207330+0000","last_became_peered":"2023-11-05T08:08:29.207330+0000","last_unstale":"2023-11-05T08:29:18.316725+0000","last_undegraded":"2023-11-05T08:29:18.316725+0000","last_fullsized":"2023-11-05T08:29:18.316725+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T11:12:17.103935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":883,"reported_epoch":930,"state":"active+clean","last_fresh":"2023-11-05T08:29:20.231140+0000","last_change":"2023-11-05T08:07:07.350626+0000","last_active":"2023-11-05T08:29:20.231140+0000","last_peered":"2023-11-05T08:29:20.231140+0000","last_clean":"2023-11-05T08:29:20.231140+0000","last_became_active":"2023-11-05T08:07:07.344890+0000","last_became_peered":"2023-11-05T08:07:07.344890+0000","last_unstale":"2023-11-05T08:29:20.231140+0000","last_undegraded":"2023-11-05T08:29:20.231140+0000","last_fullsized":"2023-11-05T08:29:20.231140+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:07:05.115520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:07:05.115520+0000","last_clean_scrub_stamp":"2023-11-05T08:07:05.115520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T10:17:35.666271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":892,"reported_epoch":929,"state":"active+clean","last_fresh":"2023-11-05T08:29:19.616495+0000","last_change":"2023-11-05T08:08:16.955033+0000","last_active":"2023-11-05T08:29:19.616495+0000","last_peered":"2023-11-05T08:29:19.616495+0000","last_clean":"2023-11-05T08:29:19.616495+0000","last_became_active":"2023-11-05T08:08:16.927690+0000","last_became_peered":"2023-11-05T08:08:16.927690+0000","last_unstale":"2023-11-05T08:29:19.616495+0000","last_undegraded":"2023-11-05T08:29:19.616495+0000","last_fullsized":"2023-11-05T08:29:19.616495+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T16:04:26.654084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":897,"reported_epoch":929,"state":"active+clean","last_fresh":"2023-11-05T08:29:19.530569+0000","last_change":"2023-11-05T08:07:07.085537+0000","last_active":"2023-11-05T08:29:19.530569+0000","last_peered":"2023-11-05T08:29:19.530569+0000","last_clean":"2023-11-05T08:29:19.530569+0000","last_became_active":"2023-11-05T08:07:07.051923+0000","last_became_peered":"2023-11-05T08:07:07.051923+0000","last_unstale":"2023-11-05T08:29:19.530569+0000","last_undegraded":"2023-11-05T08:29:19.530569+0000","last_fullsized":"2023-11-05T08:29:19.530569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:07:05.115520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:07:05.115520+0000","last_clean_scrub_stamp":"2023-11-05T08:07:05.115520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T09:32:20.473313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":876,"reported_epoch":929,"state":"active+clean","last_fresh":"2023-11-05T08:29:19.260837+0000","last_change":"2023-11-05T08:08:32.728546+0000","last_active":"2023-11-05T08:29:19.260837+0000","last_peered":"2023-11-05T08:29:19.260837+0000","last_clean":"2023-11-05T08:29:19.260837+0000","last_became_active":"2023-11-05T08:08:32.722827+0000","last_became_peered":"2023-11-05T08:08:32.722827+0000","last_unstale":"2023-11-05T08:29:19.260837+0000","last_undegraded":"2023-11-05T08:29:19.260837+0000","last_fullsized":"2023-11-05T08:29:19.260837+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T18:14:43.626997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":884,"reported_epoch":930,"state":"active+clean","last_fresh":"2023-11-05T08:29:20.220963+0000","last_change":"2023-11-05T08:07:07.161269+0000","last_active":"2023-11-05T08:29:20.220963+0000","last_peered":"2023-11-05T08:29:20.220963+0000","last_clean":"2023-11-05T08:29:20.220963+0000","last_became_active":"2023-11-05T08:07:07.131650+0000","last_became_peered":"2023-11-05T08:07:07.131650+0000","last_unstale":"2023-11-05T08:29:20.220963+0000","last_undegraded":"2023-11-05T08:29:20.220963+0000","last_fullsized":"2023-11-05T08:29:20.220963+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:07:05.115520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:07:05.115520+0000","last_clean_scrub_stamp":"2023-11-05T08:07:05.115520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T11:45:49.611005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":892,"reported_epoch":929,"state":"active+clean","last_fresh":"2023-11-05T08:29:19.568262+0000","last_change":"2023-11-05T08:08:13.856039+0000","last_active":"2023-11-05T08:29:19.568262+0000","last_peered":"2023-11-05T08:29:19.568262+0000","last_clean":"2023-11-05T08:29:19.568262+0000","last_became_active":"2023-11-05T08:08:13.848417+0000","last_became_peered":"2023-11-05T08:08:13.848417+0000","last_unstale":"2023-11-05T08:29:19.568262+0000","last_undegraded":"2023-11-05T08:29:19.568262+0000","last_fullsized":"2023-11-05T08:29:19.568262+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T14:27:44.987944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":883,"reported_epoch":930,"state":"active+clean","last_fresh":"2023-11-05T08:29:20.262132+0000","last_change":"2023-11-05T08:07:07.482345+0000","last_active":"2023-11-05T08:29:20.262132+0000","last_peered":"2023-11-05T08:29:20.262132+0000","last_clean":"2023-11-05T08:29:20.262132+0000","last_became_active":"2023-11-05T08:07:07.467692+0000","last_became_peered":"2023-11-05T08:07:07.467692+0000","last_unstale":"2023-11-05T08:29:20.262132+0000","last_undegraded":"2023-11-05T08:29:20.262132+0000","last_fullsized":"2023-11-05T08:29:20.262132+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:07:05.115520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:07:05.115520+0000","last_clean_scrub_stamp":"2023-11-05T08:07:05.115520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T09:41:35.204221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"23'76","reported_seq":992,"reported_epoch":929,"state":"active+clean","last_fresh":"2023-11-05T08:29:20.025376+0000","last_change":"2023-11-05T08:07:00.997710+0000","last_active":"2023-11-05T08:29:20.025376+0000","last_peered":"2023-11-05T08:29:20.025376+0000","last_clean":"2023-11-05T08:29:20.025376+0000","last_became_active":"2023-11-05T08:07:00.966209+0000","last_became_peered":"2023-11-05T08:07:00.966209+0000","last_unstale":"2023-11-05T08:29:20.025376+0000","last_undegraded":"2023-11-05T08:29:20.025376+0000","last_fullsized":"2023-11-05T08:29:20.025376+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:06:58.242946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:06:58.242946+0000","last_clean_scrub_stamp":"2023-11-05T08:06:58.242946+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T10:17:50.722686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":113,"num_write_kb":1372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":878,"reported_epoch":930,"state":"active+clean","last_fresh":"2023-11-05T08:29:20.267059+0000","last_change":"2023-11-05T08:08:16.483616+0000","last_active":"2023-11-05T08:29:20.267059+0000","last_peered":"2023-11-05T08:29:20.267059+0000","last_clean":"2023-11-05T08:29:20.267059+0000","last_became_active":"2023-11-05T08:08:16.476624+0000","last_became_peered":"2023-11-05T08:08:16.476624+0000","last_unstale":"2023-11-05T08:29:20.267059+0000","last_undegraded":"2023-11-05T08:29:20.267059+0000","last_fullsized":"2023-11-05T08:29:20.267059+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T09:35:42.050473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":892,"reported_epoch":929,"state":"active+clean","last_fresh":"2023-11-05T08:29:19.591653+0000","last_change":"2023-11-05T08:08:15.541517+0000","last_active":"2023-11-05T08:29:19.591653+0000","last_peered":"2023-11-05T08:29:19.591653+0000","last_clean":"2023-11-05T08:29:19.591653+0000","last_became_active":"2023-11-05T08:08:15.536104+0000","last_became_peered":"2023-11-05T08:08:15.536104+0000","last_unstale":"2023-11-05T08:29:19.591653+0000","last_undegraded":"2023-11-05T08:29:19.591653+0000","last_fullsized":"2023-11-05T08:29:19.591653+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T16:13:04.020842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":877,"reported_epoch":928,"state":"active+clean","last_fresh":"2023-11-05T08:29:17.990463+0000","last_change":"2023-11-05T08:08:24.468665+0000","last_active":"2023-11-05T08:29:17.990463+0000","last_peered":"2023-11-05T08:29:17.990463+0000","last_clean":"2023-11-05T08:29:17.990463+0000","last_became_active":"2023-11-05T08:08:24.441081+0000","last_became_peered":"2023-11-05T08:08:24.441081+0000","last_unstale":"2023-11-05T08:29:17.990463+0000","last_undegraded":"2023-11-05T08:29:17.990463+0000","last_fullsized":"2023-11-05T08:29:17.990463+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T18:53:30.099795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":893,"reported_epoch":929,"state":"active+clean","last_fresh":"2023-11-05T08:29:19.482775+0000","last_change":"2023-11-05T08:08:16.655549+0000","last_active":"2023-11-05T08:29:19.482775+0000","last_peered":"2023-11-05T08:29:19.482775+0000","last_clean":"2023-11-05T08:29:19.482775+0000","last_became_active":"2023-11-05T08:08:16.632044+0000","last_became_peered":"2023-11-05T08:08:16.632044+0000","last_unstale":"2023-11-05T08:29:19.482775+0000","last_undegraded":"2023-11-05T08:29:19.482775+0000","last_fullsized":"2023-11-05T08:29:19.482775+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T14:27:26.991803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":881,"reported_epoch":930,"state":"active+clean","last_fresh":"2023-11-05T08:29:20.532510+0000","last_change":"2023-11-05T08:08:14.445311+0000","last_active":"2023-11-05T08:29:20.532510+0000","last_peered":"2023-11-05T08:29:20.532510+0000","last_clean":"2023-11-05T08:29:20.532510+0000","last_became_active":"2023-11-05T08:08:14.425433+0000","last_became_peered":"2023-11-05T08:08:14.425433+0000","last_unstale":"2023-11-05T08:29:20.532510+0000","last_undegraded":"2023-11-05T08:29:20.532510+0000","last_fullsized":"2023-11-05T08:29:20.532510+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T08:24:56.987960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":880,"reported_epoch":928,"state":"active+clean","last_fresh":"2023-11-05T08:29:18.326602+0000","last_change":"2023-11-05T08:08:17.165313+0000","last_active":"2023-11-05T08:29:18.326602+0000","last_peered":"2023-11-05T08:29:18.326602+0000","last_clean":"2023-11-05T08:29:18.326602+0000","last_became_active":"2023-11-05T08:08:17.140308+0000","last_became_peered":"2023-11-05T08:08:17.140308+0000","last_unstale":"2023-11-05T08:29:18.326602+0000","last_undegraded":"2023-11-05T08:29:18.326602+0000","last_fullsized":"2023-11-05T08:29:18.326602+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T19:28:30.888743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":881,"reported_epoch":930,"state":"active+clean","last_fresh":"2023-11-05T08:29:20.517460+0000","last_change":"2023-11-05T08:08:14.150663+0000","last_active":"2023-11-05T08:29:20.517460+0000","last_peered":"2023-11-05T08:29:20.517460+0000","last_clean":"2023-11-05T08:29:20.517460+0000","last_became_active":"2023-11-05T08:08:14.137585+0000","last_became_peered":"2023-11-05T08:08:14.137585+0000","last_unstale":"2023-11-05T08:29:20.517460+0000","last_undegraded":"2023-11-05T08:29:20.517460+0000","last_fullsized":"2023-11-05T08:29:20.517460+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T15:52:07.602007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1","version":"60'7","reported_seq":893,"reported_epoch":929,"state":"active+clean","last_fresh":"2023-11-05T08:29:20.028265+0000","last_change":"2023-11-05T08:08:15.816866+0000","last_active":"2023-11-05T08:29:20.028265+0000","last_peered":"2023-11-05T08:29:20.028265+0000","last_clean":"2023-11-05T08:29:20.028265+0000","last_became_active":"2023-11-05T08:08:15.787944+0000","last_became_peered":"2023-11-05T08:08:15.787944+0000","last_unstale":"2023-11-05T08:29:20.028265+0000","last_undegraded":"2023-11-05T08:29:20.028265+0000","last_fullsized":"2023-11-05T08:29:20.028265+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T15:34:28.380916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":893,"reported_epoch":929,"state":"active+clean","last_fresh":"2023-11-05T08:29:19.437098+0000","last_change":"2023-11-05T08:08:29.552725+0000","last_active":"2023-11-05T08:29:19.437098+0000","last_peered":"2023-11-05T08:29:19.437098+0000","last_clean":"2023-11-05T08:29:19.437098+0000","last_became_active":"2023-11-05T08:08:29.547162+0000","last_became_peered":"2023-11-05T08:08:29.547162+0000","last_unstale":"2023-11-05T08:29:19.437098+0000","last_undegraded":"2023-11-05T08:29:19.437098+0000","last_fullsized":"2023-11-05T08:29:19.437098+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T19:39:29.767004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":877,"reported_epoch":929,"state":"active+clean","last_fresh":"2023-11-05T08:29:19.262775+0000","last_change":"2023-11-05T08:08:20.758068+0000","last_active":"2023-11-05T08:29:19.262775+0000","last_peered":"2023-11-05T08:29:19.262775+0000","last_clean":"2023-11-05T08:29:19.262775+0000","last_became_active":"2023-11-05T08:08:20.752405+0000","last_became_peered":"2023-11-05T08:08:20.752405+0000","last_unstale":"2023-11-05T08:29:19.262775+0000","last_undegraded":"2023-11-05T08:29:19.262775+0000","last_fullsized":"2023-11-05T08:29:19.262775+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T14:40:09.413196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":880,"reported_epoch":930,"state":"active+clean","last_fresh":"2023-11-05T08:29:20.536162+0000","last_change":"2023-11-05T08:08:14.471293+0000","last_active":"2023-11-05T08:29:20.536162+0000","last_peered":"2023-11-05T08:29:20.536162+0000","last_clean":"2023-11-05T08:29:20.536162+0000","last_became_active":"2023-11-05T08:08:14.458020+0000","last_became_peered":"2023-11-05T08:08:14.458020+0000","last_unstale":"2023-11-05T08:29:20.536162+0000","last_undegraded":"2023-11-05T08:29:20.536162+0000","last_fullsized":"2023-11-05T08:29:20.536162+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T16:29:40.591417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":878,"reported_epoch":928,"state":"active+clean","last_fresh":"2023-11-05T08:29:17.986204+0000","last_change":"2023-11-05T08:08:17.325907+0000","last_active":"2023-11-05T08:29:17.986204+0000","last_peered":"2023-11-05T08:29:17.986204+0000","last_clean":"2023-11-05T08:29:17.986204+0000","last_became_active":"2023-11-05T08:08:17.320483+0000","last_became_peered":"2023-11-05T08:08:17.320483+0000","last_unstale":"2023-11-05T08:29:17.986204+0000","last_undegraded":"2023-11-05T08:29:17.986204+0000","last_fullsized":"2023-11-05T08:29:17.986204+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T08:33:36.614472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":866,"reported_epoch":929,"state":"active+clean","last_fresh":"2023-11-05T08:29:19.976904+0000","last_change":"2023-11-05T08:08:20.224993+0000","last_active":"2023-11-05T08:29:19.976904+0000","last_peered":"2023-11-05T08:29:19.976904+0000","last_clean":"2023-11-05T08:29:19.976904+0000","last_became_active":"2023-11-05T08:08:20.218112+0000","last_became_peered":"2023-11-05T08:08:20.218112+0000","last_unstale":"2023-11-05T08:29:19.976904+0000","last_undegraded":"2023-11-05T08:29:19.976904+0000","last_fullsized":"2023-11-05T08:29:19.976904+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T10:27:58.560760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":113,"num_write_kb":1372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":802816,"data_stored":795680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":0,"up_from":16,"seq":68719477007,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59132,"kb_used_data":5740,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94312708,"statfs":{"total":96636764160,"available":96576212992,"internally_reserved":0,"allocated":5877760,"data_stored":3161489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Nov 5 08:28:43 2023","interfaces":[{"interface":"back","average":{"1min":12.737,"5min":16.405000000000001,"15min":17.103999999999999},"min":{"1min":4.6589999999999998,"5min":4.6589999999999998,"15min":4.5},"max":{"1min":57.667000000000002,"5min":109.83,"15min":214.25299999999999},"last":9.3369999999999997},{"interface":"front","average":{"1min":15.419,"5min":18.902000000000001,"15min":19.364999999999998},"min":{"1min":5.0279999999999996,"5min":5.0279999999999996,"15min":4.6989999999999998},"max":{"1min":92.010000000000005,"5min":171.31999999999999,"15min":252.74000000000001},"last":7.0910000000000002}]},{"osd":2,"last update":"Sun Nov 5 08:28:57 2023","interfaces":[{"interface":"back","average":{"1min":14.499000000000001,"5min":24.434000000000001,"15min":24.056999999999999},"min":{"1min":8.8100000000000005,"5min":6.8419999999999996,"15min":6.3369999999999997},"max":{"1min":31.861999999999998,"5min":147.30199999999999,"15min":227.87100000000001},"last":11.821},{"interface":"front","average":{"1min":16.076000000000001,"5min":28.667000000000002,"15min":28.436},"min":{"1min":9.4179999999999993,"5min":9.0510000000000002,"15min":9.0510000000000002},"max":{"1min":34.857999999999997,"5min":231.124,"15min":343.62599999999998},"last":12.460000000000001}]},{"osd":3,"last update":"Sun Nov 5 08:28:43 2023","interfaces":[{"interface":"back","average":{"1min":21.385999999999999,"5min":27.227,"15min":25.497},"min":{"1min":10.151,"5min":7.6390000000000002,"15min":7.6390000000000002},"max":{"1min":95.622,"5min":165.13900000000001,"15min":242.93899999999999},"last":30.991},{"interface":"front","average":{"1min":14.419,"5min":18.553999999999998,"15min":18.728000000000002},"min":{"1min":8.0359999999999996,"5min":6.7190000000000003,"15min":6.3310000000000004},"max":{"1min":40.043999999999997,"5min":127.40600000000001,"15min":220.85499999999999},"last":22.536999999999999}]},{"osd":4,"last update":"Sun Nov 5 08:28:43 2023","interfaces":[{"interface":"back","average":{"1min":13.835000000000001,"5min":19.640000000000001,"15min":18.901},"min":{"1min":9.0429999999999993,"5min":7.6020000000000003,"15min":6.2830000000000004},"max":{"1min":28.248000000000001,"5min":125.905,"15min":176.929},"last":10.366},{"interface":"front","average":{"1min":17.474,"5min":25.137,"15min":24.228999999999999},"min":{"1min":10.781000000000001,"5min":10.333,"15min":7.7300000000000004},"max":{"1min":39.262,"5min":156.762,"15min":230.40600000000001},"last":26.853000000000002}]},{"osd":5,"last update":"Sun Nov 5 08:28:43 2023","interfaces":[{"interface":"back","average":{"1min":16.065000000000001,"5min":22.399000000000001,"15min":22.742000000000001},"min":{"1min":9.9320000000000004,"5min":7.093,"15min":6.8940000000000001},"max":{"1min":52.027999999999999,"5min":116.42,"15min":266.36099999999999},"last":9.6959999999999997},{"interface":"front","average":{"1min":17.501999999999999,"5min":23.870000000000001,"15min":26.367999999999999},"min":{"1min":11.161,"5min":9.4139999999999997,"15min":9.4139999999999997},"max":{"1min":32.369,"5min":115.401,"15min":260.779},"last":21.030999999999999}]},{"osd":6,"last update":"Sun Nov 5 08:28:43 2023","interfaces":[{"interface":"back","average":{"1min":19.154,"5min":30.417000000000002,"15min":29.405000000000001},"min":{"1min":11.42,"5min":10.246,"15min":10.246},"max":{"1min":37.744999999999997,"5min":147.67599999999999,"15min":280.47199999999998},"last":28.875},{"interface":"front","average":{"1min":15.041,"5min":22.821999999999999,"15min":22.027999999999999},"min":{"1min":7.7000000000000002,"5min":6.5739999999999998,"15min":6.5739999999999998},"max":{"1min":40.978000000000002,"5min":216.12,"15min":216.12},"last":21.898}]},{"osd":7,"last update":"Sun Nov 5 08:28:43 2023","interfaces":[{"interface":"back","average":{"1min":21.381,"5min":34.792999999999999,"15min":29.745999999999999},"min":{"1min":12.074999999999999,"5min":11.266999999999999,"15min":10.122},"max":{"1min":44.856000000000002,"5min":281.70800000000003,"15min":281.70800000000003},"last":26.149000000000001},{"interface":"front","average":{"1min":23.933,"5min":40.325000000000003,"15min":34.375},"min":{"1min":16.882000000000001,"5min":13.933,"15min":13.242000000000001},"max":{"1min":45.856999999999999,"5min":284.21199999999999,"15min":284.21199999999999},"last":29.745999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509711,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59108,"kb_used_data":5712,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94312732,"statfs":{"total":96636764160,"available":96576237568,"internally_reserved":0,"allocated":5849088,"data_stored":3123825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":54655432},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":46,"apply_latency_ms":46,"commit_latency_ns":46000000,"apply_latency_ns":46000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 5 08:28:39 2023","interfaces":[{"interface":"back","average":{"1min":10.744999999999999,"5min":14.304,"15min":22.193000000000001},"min":{"1min":6.8170000000000002,"5min":5.7539999999999996,"15min":4.5739999999999998},"max":{"1min":20.763000000000002,"5min":112.003,"15min":261.80799999999999},"last":5.9930000000000003},{"interface":"front","average":{"1min":9.8160000000000007,"5min":12.709,"15min":21.585999999999999},"min":{"1min":7.25,"5min":4.4930000000000003,"15min":4.4199999999999999},"max":{"1min":15.653,"5min":113.303,"15min":391.05500000000001},"last":24.248999999999999}]},{"osd":1,"last update":"Sun Nov 5 08:28:39 2023","interfaces":[{"interface":"back","average":{"1min":14.669,"5min":18.469999999999999,"15min":25.491},"min":{"1min":8.0709999999999997,"5min":5.4669999999999996,"15min":5.4669999999999996},"max":{"1min":33.857999999999997,"5min":210.03999999999999,"15min":390.67000000000002},"last":28.399999999999999},{"interface":"front","average":{"1min":12.352,"5min":16.792999999999999,"15min":25.196999999999999},"min":{"1min":6.4669999999999996,"5min":6.4669999999999996,"15min":6.4279999999999999},"max":{"1min":29.837,"5min":130.197,"15min":406.154},"last":7.266}]},{"osd":2,"last update":"Sun Nov 5 08:28:55 2023","interfaces":[{"interface":"back","average":{"1min":17.161999999999999,"5min":20.928000000000001,"15min":25.690999999999999},"min":{"1min":8.8300000000000001,"5min":7.508,"15min":7.1920000000000002},"max":{"1min":83.262,"5min":143.93100000000001,"15min":356.27800000000002},"last":25.584},{"interface":"front","average":{"1min":18.815000000000001,"5min":22.913,"15min":28.707000000000001},"min":{"1min":10.121,"5min":9.8279999999999994,"15min":7.9210000000000003},"max":{"1min":60.844999999999999,"5min":147.49600000000001,"15min":394.14999999999998},"last":27.329000000000001}]},{"osd":4,"last update":"Sun Nov 5 08:28:39 2023","interfaces":[{"interface":"back","average":{"1min":14.978999999999999,"5min":23.170000000000002,"15min":27.158000000000001},"min":{"1min":9.3439999999999994,"5min":7.1180000000000003,"15min":6.3609999999999998},"max":{"1min":44.747999999999998,"5min":239.07300000000001,"15min":342.72199999999998},"last":30.724},{"interface":"front","average":{"1min":22.855,"5min":29.050999999999998,"15min":32.917000000000002},"min":{"1min":11.836,"5min":9.673,"15min":9.0600000000000005},"max":{"1min":120.264,"5min":240.12799999999999,"15min":343.30799999999999},"last":32.487000000000002}]},{"osd":5,"last update":"Sun Nov 5 08:28:39 2023","interfaces":[{"interface":"back","average":{"1min":18.943000000000001,"5min":21.934000000000001,"15min":30.952999999999999},"min":{"1min":6.3040000000000003,"5min":6.3040000000000003,"15min":6.3040000000000003},"max":{"1min":74.201999999999998,"5min":132.55199999999999,"15min":412.41300000000001},"last":20.573},{"interface":"front","average":{"1min":16.152999999999999,"5min":17.201000000000001,"15min":27.908999999999999},"min":{"1min":6.6420000000000003,"5min":6.0030000000000001,"15min":6.0030000000000001},"max":{"1min":62.115000000000002,"5min":129.458,"15min":393.334},"last":24.922000000000001}]},{"osd":6,"last update":"Sun Nov 5 08:28:39 2023","interfaces":[{"interface":"back","average":{"1min":17.960000000000001,"5min":25.992999999999999,"15min":33.616},"min":{"1min":11.5,"5min":10.747,"15min":8.5289999999999999},"max":{"1min":29.053000000000001,"5min":197.44399999999999,"15min":395.892},"last":29.710000000000001},{"interface":"front","average":{"1min":17.393999999999998,"5min":25.535,"15min":31.867999999999999},"min":{"1min":10.085000000000001,"5min":10.085000000000001,"15min":7.6959999999999997},"max":{"1min":35.482999999999997,"5min":208.23099999999999,"15min":358.10599999999999},"last":33.755000000000003}]},{"osd":7,"last update":"Sun Nov 5 08:28:39 2023","interfaces":[{"interface":"back","average":{"1min":17.265999999999998,"5min":22.513000000000002,"15min":32.591999999999999},"min":{"1min":11.039,"5min":11.039,"15min":10.02},"max":{"1min":25.888999999999999,"5min":140.971,"15min":346.93299999999999},"last":34.789999999999999},{"interface":"front","average":{"1min":14.869999999999999,"5min":18.747,"15min":29.056999999999999},"min":{"1min":8.8059999999999992,"5min":7.7640000000000002,"15min":7.415},"max":{"1min":22.791,"5min":153.31800000000001,"15min":407.678},"last":22.82}]}]},{"osd":2,"up_from":15,"seq":64424509710,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59108,"kb_used_data":5712,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94312732,"statfs":{"total":96636764160,"available":96576237568,"internally_reserved":0,"allocated":5849088,"data_stored":3123825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":67,"apply_latency_ms":67,"commit_latency_ns":67000000,"apply_latency_ns":67000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 5 08:28:49 2023","interfaces":[{"interface":"back","average":{"1min":11.885,"5min":17.285,"15min":22.297999999999998},"min":{"1min":6.4820000000000002,"5min":6.2279999999999998,"15min":5.0839999999999996},"max":{"1min":24.228000000000002,"5min":115.285,"15min":285.363},"last":9.9559999999999995},{"interface":"front","average":{"1min":16.359000000000002,"5min":22.396999999999998,"15min":28.001999999999999},"min":{"1min":7.1840000000000002,"5min":7.1840000000000002,"15min":7.1840000000000002},"max":{"1min":29.151,"5min":117.806,"15min":342.44999999999999},"last":23.140000000000001}]},{"osd":1,"last update":"Sun Nov 5 08:28:36 2023","interfaces":[{"interface":"back","average":{"1min":15.425000000000001,"5min":21.286999999999999,"15min":23.324000000000002},"min":{"1min":9.875,"5min":9.3350000000000009,"15min":5.8529999999999998},"max":{"1min":29.829999999999998,"5min":204.059,"15min":258.88600000000002},"last":23.949000000000002},{"interface":"front","average":{"1min":11.346,"5min":16.706,"15min":22.780000000000001},"min":{"1min":5.681,"5min":5.681,"15min":5.5030000000000001},"max":{"1min":26.155999999999999,"5min":231.86600000000001,"15min":312.77999999999997},"last":6.4729999999999999}]},{"osd":3,"last update":"Sun Nov 5 08:28:49 2023","interfaces":[{"interface":"back","average":{"1min":25.614000000000001,"5min":21.391999999999999,"15min":23.795999999999999},"min":{"1min":7.7069999999999999,"5min":6.976,"15min":6.2439999999999998},"max":{"1min":204.50800000000001,"5min":204.50800000000001,"15min":292.435},"last":9.3010000000000002},{"interface":"front","average":{"1min":26.190000000000001,"5min":26.041,"15min":29.667000000000002},"min":{"1min":11.888,"5min":10.894,"15min":7.9800000000000004},"max":{"1min":160.86500000000001,"5min":161.327,"15min":288.178},"last":26.855}]},{"osd":4,"last update":"Sun Nov 5 08:28:49 2023","interfaces":[{"interface":"back","average":{"1min":11.77,"5min":14.837,"15min":18.927},"min":{"1min":6.399,"5min":5.8220000000000001,"15min":5.8220000000000001},"max":{"1min":27.553000000000001,"5min":129.64699999999999,"15min":261.12},"last":7.5170000000000003},{"interface":"front","average":{"1min":18.356000000000002,"5min":20.210999999999999,"15min":24.844999999999999},"min":{"1min":11.032,"5min":8.0190000000000001,"15min":7.8559999999999999},"max":{"1min":28.463000000000001,"5min":136.566,"15min":268.09899999999999},"last":13.601000000000001}]},{"osd":5,"last update":"Sun Nov 5 08:28:49 2023","interfaces":[{"interface":"back","average":{"1min":13.5,"5min":16.428999999999998,"15min":21.143000000000001},"min":{"1min":6.8479999999999999,"5min":6.3949999999999996,"15min":6.3159999999999998},"max":{"1min":30.815999999999999,"5min":110.682,"15min":229.387},"last":27.481000000000002},{"interface":"front","average":{"1min":20.343,"5min":24.088000000000001,"15min":27.779},"min":{"1min":11.023,"5min":11.023,"15min":9.8520000000000003},"max":{"1min":38.786999999999999,"5min":118.762,"15min":301.16899999999998},"last":10.542}]},{"osd":6,"last update":"Sun Nov 5 08:28:49 2023","interfaces":[{"interface":"back","average":{"1min":15.603,"5min":24.457999999999998,"15min":27.021999999999998},"min":{"1min":8.4469999999999992,"5min":8.4469999999999992,"15min":8.4469999999999992},"max":{"1min":26.398,"5min":119.38800000000001,"15min":219.01300000000001},"last":11.177},{"interface":"front","average":{"1min":18.614999999999998,"5min":19.393999999999998,"15min":22.059000000000001},"min":{"1min":9.875,"5min":8.7929999999999993,"15min":6.5309999999999997},"max":{"1min":34.994,"5min":111.405,"15min":217.93600000000001},"last":12.709}]},{"osd":7,"last update":"Sun Nov 5 08:28:36 2023","interfaces":[{"interface":"back","average":{"1min":23.518000000000001,"5min":23.989000000000001,"15min":27.620999999999999},"min":{"1min":14.113,"5min":9.9079999999999995,"15min":8.4870000000000001},"max":{"1min":65.971000000000004,"5min":135.114,"15min":263.37099999999998},"last":24.574000000000002},{"interface":"front","average":{"1min":32.572000000000003,"5min":31.068999999999999,"15min":31.628},"min":{"1min":16.792000000000002,"5min":13.923,"15min":9.5540000000000003},"max":{"1min":141.214,"5min":141.214,"15min":258.42000000000002},"last":28.135999999999999}]}]},{"osd":1,"up_from":15,"seq":64424509709,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59544,"kb_used_data":6152,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94312296,"statfs":{"total":96636764160,"available":96575791104,"internally_reserved":0,"allocated":6299648,"data_stored":3575718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 5 08:28:48 2023","interfaces":[{"interface":"back","average":{"1min":28.224,"5min":20.513999999999999,"15min":21.202999999999999},"min":{"1min":6.6360000000000001,"5min":4.2789999999999999,"15min":4.2789999999999999},"max":{"1min":269.49200000000002,"5min":269.49200000000002,"15min":309.815},"last":7.5430000000000001},{"interface":"front","average":{"1min":18.898,"5min":18.010999999999999,"15min":19.018999999999998},"min":{"1min":5.7709999999999999,"5min":4.9089999999999998,"15min":4.4119999999999999},"max":{"1min":140.09,"5min":160.89500000000001,"15min":299.55399999999997},"last":8.7530000000000001}]},{"osd":2,"last update":"Sun Nov 5 08:28:48 2023","interfaces":[{"interface":"back","average":{"1min":36.625,"5min":23.963999999999999,"15min":24.616},"min":{"1min":6.9550000000000001,"5min":6.202,"15min":5.7999999999999998},"max":{"1min":365.68099999999998,"5min":365.68099999999998,"15min":365.68099999999998},"last":10.612},{"interface":"front","average":{"1min":27.253,"5min":24.193000000000001,"15min":24.239000000000001},"min":{"1min":9.2539999999999996,"5min":7.0990000000000002,"15min":6.8899999999999997},"max":{"1min":143.03700000000001,"5min":188.554,"15min":302.49799999999999},"last":11.268000000000001}]},{"osd":3,"last update":"Sun Nov 5 08:28:48 2023","interfaces":[{"interface":"back","average":{"1min":34.058,"5min":26.893999999999998,"15min":27.126000000000001},"min":{"1min":8.4090000000000007,"5min":7.1260000000000003,"15min":6.8019999999999996},"max":{"1min":330.101,"5min":330.101,"15min":334.85599999999999},"last":29.888999999999999},{"interface":"front","average":{"1min":32.119,"5min":27.798999999999999,"15min":28.527999999999999},"min":{"1min":7.673,"5min":7.673,"15min":6.9660000000000002},"max":{"1min":268.80900000000003,"5min":268.80900000000003,"15min":382.089},"last":18.803000000000001}]},{"osd":4,"last update":"Sun Nov 5 08:28:48 2023","interfaces":[{"interface":"back","average":{"1min":35.593000000000004,"5min":24.390999999999998,"15min":23.358000000000001},"min":{"1min":8.1560000000000006,"5min":8.0239999999999991,"15min":6.7220000000000004},"max":{"1min":309.38200000000001,"5min":309.38200000000001,"15min":309.38200000000001},"last":37.332999999999998},{"interface":"front","average":{"1min":20.195,"5min":19.210000000000001,"15min":20.236999999999998},"min":{"1min":7.415,"5min":7.1289999999999996,"15min":6.0750000000000002},"max":{"1min":112.929,"5min":161.56700000000001,"15min":161.56700000000001},"last":25.777000000000001}]},{"osd":5,"last update":"Sun Nov 5 08:28:43 2023","interfaces":[{"interface":"back","average":{"1min":36.268000000000001,"5min":25.178999999999998,"15min":24.058},"min":{"1min":11.022,"5min":8.6549999999999994,"15min":6.1600000000000001},"max":{"1min":312.33699999999999,"5min":312.33699999999999,"15min":312.33699999999999},"last":50.942},{"interface":"front","average":{"1min":23.387,"5min":23.638000000000002,"15min":27.129000000000001},"min":{"1min":11.173999999999999,"5min":10.871,"15min":8.2129999999999992},"max":{"1min":138.23699999999999,"5min":146.816,"15min":297.25299999999999},"last":19.544}]},{"osd":6,"last update":"Sun Nov 5 08:28:43 2023","interfaces":[{"interface":"back","average":{"1min":28.651,"5min":23.355,"15min":26.981999999999999},"min":{"1min":11.853999999999999,"5min":8.3930000000000007,"15min":8.0579999999999998},"max":{"1min":166.16300000000001,"5min":166.16300000000001,"15min":284.84300000000002},"last":21.771000000000001},{"interface":"front","average":{"1min":36.008000000000003,"5min":29.831,"15min":32.936},"min":{"1min":13.599,"5min":12.923999999999999,"15min":12.047000000000001},"max":{"1min":225.93899999999999,"5min":225.93899999999999,"15min":290.81099999999998},"last":24.404}]},{"osd":7,"last update":"Sun Nov 5 08:28:43 2023","interfaces":[{"interface":"back","average":{"1min":20.428000000000001,"5min":23.300000000000001,"15min":31.018999999999998},"min":{"1min":8.9469999999999992,"5min":8.3680000000000003,"15min":8.3680000000000003},"max":{"1min":136.005,"5min":248.667,"15min":248.667},"last":23.172999999999998},{"interface":"front","average":{"1min":38.408999999999999,"5min":28.378,"15min":27.754000000000001},"min":{"1min":12.801,"5min":10.247999999999999,"15min":7.7199999999999998},"max":{"1min":331.02800000000002,"5min":331.02800000000002,"15min":331.02800000000002},"last":42.988999999999997}]}]},{"osd":7,"up_from":14,"seq":60129542414,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":81324,"kb_used_data":5724,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94290516,"statfs":{"total":96636764160,"available":96553488384,"internally_reserved":0,"allocated":5861376,"data_stored":3145105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":77396427},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 5 08:28:46 2023","interfaces":[{"interface":"back","average":{"1min":14.635999999999999,"5min":19.125,"15min":17.983000000000001},"min":{"1min":5.3369999999999997,"5min":4.5030000000000001,"15min":4.3739999999999997},"max":{"1min":92.448999999999998,"5min":198.46799999999999,"15min":198.46799999999999},"last":4.6189999999999998},{"interface":"front","average":{"1min":13.433999999999999,"5min":16.824999999999999,"15min":17.916},"min":{"1min":5.8949999999999996,"5min":5.5869999999999997,"15min":4.4260000000000002},"max":{"1min":65.064999999999998,"5min":129.173,"15min":162.06200000000001},"last":7.319}]},{"osd":1,"last update":"Sun Nov 5 08:28:42 2023","interfaces":[{"interface":"back","average":{"1min":13.074999999999999,"5min":19.145,"15min":23.327999999999999},"min":{"1min":6.7039999999999997,"5min":6.4109999999999996,"15min":5.9939999999999998},"max":{"1min":25.713999999999999,"5min":109.303,"15min":415.255},"last":8.6859999999999999},{"interface":"front","average":{"1min":13.377000000000001,"5min":21.669,"15min":24.067},"min":{"1min":8.0030000000000001,"5min":7.2640000000000002,"15min":6.0999999999999996},"max":{"1min":24.722000000000001,"5min":146.83799999999999,"15min":305.72800000000001},"last":11.137}]},{"osd":2,"last update":"Sun Nov 5 08:28:46 2023","interfaces":[{"interface":"back","average":{"1min":12.632,"5min":19.882999999999999,"15min":24.516999999999999},"min":{"1min":6.8860000000000001,"5min":6.5,"15min":6.5},"max":{"1min":41.588999999999999,"5min":125.071,"15min":196.78100000000001},"last":13.4},{"interface":"front","average":{"1min":14.002000000000001,"5min":21.390000000000001,"15min":23.530999999999999},"min":{"1min":8.2460000000000004,"5min":6.7009999999999996,"15min":6.5410000000000004},"max":{"1min":23.905999999999999,"5min":154.429,"15min":193.77500000000001},"last":11.914999999999999}]},{"osd":3,"last update":"Sun Nov 5 08:28:46 2023","interfaces":[{"interface":"back","average":{"1min":16.510000000000002,"5min":25.837,"15min":28.875},"min":{"1min":9.6649999999999991,"5min":9.1050000000000004,"15min":6.6660000000000004},"max":{"1min":30.847000000000001,"5min":171.90600000000001,"15min":380.88099999999997},"last":16.693000000000001},{"interface":"front","average":{"1min":18.937000000000001,"5min":25.657,"15min":26.742999999999999},"min":{"1min":7.0309999999999997,"5min":7.0309999999999997,"15min":6.3769999999999998},"max":{"1min":46.447000000000003,"5min":143.35499999999999,"15min":233.03},"last":12.787000000000001}]},{"osd":4,"last update":"Sun Nov 5 08:28:42 2023","interfaces":[{"interface":"back","average":{"1min":12.259,"5min":23.219000000000001,"15min":24.393999999999998},"min":{"1min":5.9329999999999998,"5min":5.9329999999999998,"15min":5.9329999999999998},"max":{"1min":35.728999999999999,"5min":158.124,"15min":215.60499999999999},"last":10.308999999999999},{"interface":"front","average":{"1min":14.186,"5min":26.652000000000001,"15min":27.027999999999999},"min":{"1min":7.6790000000000003,"5min":7.6790000000000003,"15min":7.6790000000000003},"max":{"1min":25.98,"5min":158.79300000000001,"15min":347.35199999999998},"last":15.49}]},{"osd":5,"last update":"Sun Nov 5 08:28:42 2023","interfaces":[{"interface":"back","average":{"1min":15.875999999999999,"5min":26.494,"15min":28.981999999999999},"min":{"1min":7.8410000000000002,"5min":7.8410000000000002,"15min":7.7199999999999998},"max":{"1min":43.951999999999998,"5min":156.44,"15min":283.54300000000001},"last":47.112000000000002},{"interface":"front","average":{"1min":15.382999999999999,"5min":23.811,"15min":27.538},"min":{"1min":7.4290000000000003,"5min":6.5890000000000004,"15min":6.5890000000000004},"max":{"1min":34.548000000000002,"5min":168.31800000000001,"15min":582.69899999999996},"last":38.107999999999997}]},{"osd":6,"last update":"Sun Nov 5 08:28:42 2023","interfaces":[{"interface":"back","average":{"1min":18.151,"5min":25.055,"15min":26.518000000000001},"min":{"1min":12.026,"5min":9.218,"15min":8.7300000000000004},"max":{"1min":28.806000000000001,"5min":140.654,"15min":228.97200000000001},"last":18.614000000000001},{"interface":"front","average":{"1min":17.321000000000002,"5min":24.378,"15min":24.873000000000001},"min":{"1min":8.4280000000000008,"5min":7.806,"15min":7.1740000000000004},"max":{"1min":45.408999999999999,"5min":132.90199999999999,"15min":203.364},"last":16.001000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542415,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77544,"kb_used_data":6104,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94294296,"statfs":{"total":96636764160,"available":96557359104,"internally_reserved":0,"allocated":6250496,"data_stored":3521665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":62,"apply_latency_ms":62,"commit_latency_ns":62000000,"apply_latency_ns":62000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 5 08:28:41 2023","interfaces":[{"interface":"back","average":{"1min":13.449,"5min":11.827999999999999,"15min":17.780000000000001},"min":{"1min":5.0229999999999997,"5min":4.8460000000000001,"15min":4.3799999999999999},"max":{"1min":73.667000000000002,"5min":73.667000000000002,"15min":258.09699999999998},"last":7.0339999999999998},{"interface":"front","average":{"1min":17.407,"5min":17.596,"15min":21.952999999999999},"min":{"1min":8.6270000000000007,"5min":4.1600000000000001,"15min":4.1600000000000001},"max":{"1min":76.629000000000005,"5min":231.863,"15min":278.45499999999998},"last":26.381}]},{"osd":1,"last update":"Sun Nov 5 08:28:41 2023","interfaces":[{"interface":"back","average":{"1min":22.600999999999999,"5min":20.210999999999999,"15min":20.777999999999999},"min":{"1min":6.5510000000000002,"5min":6.1609999999999996,"15min":4.351},"max":{"1min":77.555000000000007,"5min":304.47800000000001,"15min":304.47800000000001},"last":9.2430000000000003},{"interface":"front","average":{"1min":23.942,"5min":22.003,"15min":24.678000000000001},"min":{"1min":9.0899999999999999,"5min":6.4649999999999999,"15min":6.2430000000000003},"max":{"1min":89.457999999999998,"5min":167.91900000000001,"15min":286.233},"last":23.526}]},{"osd":2,"last update":"Sun Nov 5 08:28:41 2023","interfaces":[{"interface":"back","average":{"1min":22.696999999999999,"5min":20.16,"15min":22.661999999999999},"min":{"1min":8.1959999999999997,"5min":6.3970000000000002,"15min":5.1210000000000004},"max":{"1min":101.61799999999999,"5min":224.57900000000001,"15min":224.57900000000001},"last":9.9499999999999993},{"interface":"front","average":{"1min":26.762,"5min":23.725000000000001,"15min":27.760999999999999},"min":{"1min":11.435,"5min":7.476,"15min":5.5549999999999997},"max":{"1min":95.575999999999993,"5min":185.56299999999999,"15min":327.26100000000002},"last":21.213999999999999}]},{"osd":3,"last update":"Sun Nov 5 08:28:41 2023","interfaces":[{"interface":"back","average":{"1min":24.623000000000001,"5min":23.707000000000001,"15min":23.678999999999998},"min":{"1min":7.8780000000000001,"5min":6.0629999999999997,"15min":6.0629999999999997},"max":{"1min":90.995999999999995,"5min":192.482,"15min":283.94099999999997},"last":12.09},{"interface":"front","average":{"1min":27.146000000000001,"5min":24.620999999999999,"15min":24.513999999999999},"min":{"1min":12.201000000000001,"5min":8.859,"15min":6.2729999999999997},"max":{"1min":86.838999999999999,"5min":167.28899999999999,"15min":284.72699999999998},"last":19.867000000000001}]},{"osd":4,"last update":"Sun Nov 5 08:28:41 2023","interfaces":[{"interface":"back","average":{"1min":22.033000000000001,"5min":21.033999999999999,"15min":22.164999999999999},"min":{"1min":10.708,"5min":9.3059999999999992,"15min":6.7409999999999997},"max":{"1min":98.747,"5min":98.747,"15min":244.86099999999999},"last":12.996},{"interface":"front","average":{"1min":12.505000000000001,"5min":14.978,"15min":20.456},"min":{"1min":5.8739999999999997,"5min":5.8739999999999997,"15min":5.8739999999999997},"max":{"1min":53.558,"5min":112.798,"15min":277.55700000000002},"last":8.3460000000000001}]},{"osd":6,"last update":"Sun Nov 5 08:28:41 2023","interfaces":[{"interface":"back","average":{"1min":15.161,"5min":20.539999999999999,"15min":24.504000000000001},"min":{"1min":7.093,"5min":7.093,"15min":5.7930000000000001},"max":{"1min":59.149000000000001,"5min":242.536,"15min":242.536},"last":30.408000000000001},{"interface":"front","average":{"1min":25.109000000000002,"5min":26.298999999999999,"15min":27.393999999999998},"min":{"1min":9.1289999999999996,"5min":7.6870000000000003,"15min":7.0300000000000002},"max":{"1min":85.906000000000006,"5min":227.50299999999999,"15min":310.69099999999997},"last":11.214}]},{"osd":7,"last update":"Sun Nov 5 08:28:41 2023","interfaces":[{"interface":"back","average":{"1min":26.856000000000002,"5min":23.469000000000001,"15min":27.475999999999999},"min":{"1min":11.613,"5min":8.7769999999999992,"15min":8.2379999999999995},"max":{"1min":100.372,"5min":119.51900000000001,"15min":281.71199999999999},"last":24.282},{"interface":"front","average":{"1min":26.722000000000001,"5min":23.254999999999999,"15min":29.834},"min":{"1min":9.8550000000000004,"5min":8.0860000000000003,"15min":8.0860000000000003},"max":{"1min":90.287999999999997,"5min":94.194999999999993,"15min":319.786},"last":20.565000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542416,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63368,"kb_used_data":5812,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94308472,"statfs":{"total":96636764160,"available":96571875328,"internally_reserved":0,"allocated":5951488,"data_stored":3235217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":44,"apply_latency_ms":44,"commit_latency_ns":44000000,"apply_latency_ns":44000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 5 08:28:35 2023","interfaces":[{"interface":"back","average":{"1min":9.3810000000000002,"5min":13.75,"15min":20.544},"min":{"1min":5.633,"5min":5.0940000000000003,"15min":5.0069999999999997},"max":{"1min":27.414000000000001,"5min":75.152000000000001,"15min":243.626},"last":13.266},{"interface":"front","average":{"1min":15.006,"5min":19.321000000000002,"15min":24.324999999999999},"min":{"1min":9.4640000000000004,"5min":5.7199999999999998,"15min":5.7199999999999998},"max":{"1min":30.917000000000002,"5min":132.78899999999999,"15min":202.49000000000001},"last":16.559999999999999}]},{"osd":1,"last update":"Sun Nov 5 08:28:35 2023","interfaces":[{"interface":"back","average":{"1min":12.646000000000001,"5min":16.113,"15min":21.669},"min":{"1min":5.4790000000000001,"5min":4.5709999999999997,"15min":4.274},"max":{"1min":24.260000000000002,"5min":162.90799999999999,"15min":369.267},"last":19.465},{"interface":"front","average":{"1min":9.8100000000000005,"5min":15.993,"15min":24.495999999999999},"min":{"1min":5.4930000000000003,"5min":5.4930000000000003,"15min":5.4930000000000003},"max":{"1min":25.135000000000002,"5min":157.459,"15min":340.214},"last":40.164000000000001}]},{"osd":2,"last update":"Sun Nov 5 08:28:35 2023","interfaces":[{"interface":"back","average":{"1min":15.661,"5min":21.771000000000001,"15min":27.968},"min":{"1min":7.2199999999999998,"5min":6.7750000000000004,"15min":6.7750000000000004},"max":{"1min":31.937000000000001,"5min":192.44999999999999,"15min":241.934},"last":17.786000000000001},{"interface":"front","average":{"1min":14.156000000000001,"5min":20.931000000000001,"15min":26.690999999999999},"min":{"1min":6.5110000000000001,"5min":6.5110000000000001,"15min":6.3109999999999999},"max":{"1min":26.538,"5min":183.47900000000001,"15min":368.279},"last":6.6669999999999998}]},{"osd":3,"last update":"Sun Nov 5 08:28:35 2023","interfaces":[{"interface":"back","average":{"1min":13.609999999999999,"5min":19.948,"15min":24.542000000000002},"min":{"1min":7.9960000000000004,"5min":6.6680000000000001,"15min":6.1200000000000001},"max":{"1min":57.084000000000003,"5min":164.06399999999999,"15min":369.53399999999999},"last":10.368},{"interface":"front","average":{"1min":18.161000000000001,"5min":24.800000000000001,"15min":32.271000000000001},"min":{"1min":6.8920000000000003,"5min":6.8920000000000003,"15min":6.8920000000000003},"max":{"1min":55.741,"5min":196.655,"15min":371.52499999999998},"last":18.779}]},{"osd":5,"last update":"Sun Nov 5 08:28:35 2023","interfaces":[{"interface":"back","average":{"1min":18.956,"5min":26.338000000000001,"15min":32.387999999999998},"min":{"1min":12.984,"5min":8.4469999999999992,"15min":7.0010000000000003},"max":{"1min":35.478999999999999,"5min":202.82900000000001,"15min":283.08100000000002},"last":20.763999999999999},{"interface":"front","average":{"1min":15.491,"5min":25.239999999999998,"15min":27.282},"min":{"1min":9.4550000000000001,"5min":6.6219999999999999,"15min":6.3010000000000002},"max":{"1min":28.989999999999998,"5min":264.10300000000001,"15min":283.94400000000002},"last":8.4329999999999998}]},{"osd":6,"last update":"Sun Nov 5 08:28:35 2023","interfaces":[{"interface":"back","average":{"1min":18.690999999999999,"5min":19.449999999999999,"15min":26.378},"min":{"1min":7.7930000000000001,"5min":7.1740000000000004,"15min":6.4359999999999999},"max":{"1min":122.85899999999999,"5min":165.113,"15min":324.98200000000003},"last":14.554},{"interface":"front","average":{"1min":24.279,"5min":26.126000000000001,"15min":31.824000000000002},"min":{"1min":9.5470000000000006,"5min":9.5470000000000006,"15min":8.5890000000000004},"max":{"1min":125.249,"5min":205.83199999999999,"15min":288.26799999999997},"last":21.827000000000002}]},{"osd":7,"last update":"Sun Nov 5 08:28:35 2023","interfaces":[{"interface":"back","average":{"1min":17.625,"5min":26.843,"15min":29.835999999999999},"min":{"1min":8.8219999999999992,"5min":7.7009999999999996,"15min":7.1559999999999997},"max":{"1min":43.206000000000003,"5min":211.39400000000001,"15min":356.44600000000003},"last":11.589},{"interface":"front","average":{"1min":20.716999999999999,"5min":27.966000000000001,"15min":30.741},"min":{"1min":13.167999999999999,"5min":9.7159999999999993,"15min":9.7159999999999993},"max":{"1min":41.866999999999997,"5min":208.833,"15min":327.53800000000001},"last":15.785}]}]},{"osd":6,"up_from":13,"seq":55834575117,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59208,"kb_used_data":5816,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94312632,"statfs":{"total":96636764160,"available":96576135168,"internally_reserved":0,"allocated":5955584,"data_stored":3244032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":49,"apply_latency_ms":49,"commit_latency_ns":49000000,"apply_latency_ns":49000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 5 08:28:46 2023","interfaces":[{"interface":"back","average":{"1min":16.972999999999999,"5min":17.661999999999999,"15min":18.792000000000002},"min":{"1min":4.7169999999999996,"5min":4.1600000000000001,"15min":4.1600000000000001},"max":{"1min":98.253,"5min":165.51900000000001,"15min":187.75899999999999},"last":10.476000000000001},{"interface":"front","average":{"1min":20.254999999999999,"5min":18.486999999999998,"15min":18.247},"min":{"1min":6.7910000000000004,"5min":5.3049999999999997,"15min":4.6790000000000003},"max":{"1min":119.42100000000001,"5min":168.239,"15min":185.38200000000001},"last":12.847}]},{"osd":1,"last update":"Sun Nov 5 08:28:46 2023","interfaces":[{"interface":"back","average":{"1min":17.149000000000001,"5min":23.170000000000002,"15min":24.638999999999999},"min":{"1min":8.7639999999999993,"5min":5.4720000000000004,"15min":5.4720000000000004},"max":{"1min":57.432000000000002,"5min":226.23500000000001,"15min":286.072},"last":20.571999999999999},{"interface":"front","average":{"1min":17.667999999999999,"5min":20.977,"15min":23.52},"min":{"1min":8.1519999999999992,"5min":5.6980000000000004,"15min":5.6980000000000004},"max":{"1min":72.725999999999999,"5min":168.25899999999999,"15min":309.512},"last":9.7400000000000002}]},{"osd":2,"last update":"Sun Nov 5 08:28:46 2023","interfaces":[{"interface":"back","average":{"1min":18.177,"5min":23.372,"15min":24.986999999999998},"min":{"1min":7.9550000000000001,"5min":7.0030000000000001,"15min":6.6390000000000002},"max":{"1min":63.627000000000002,"5min":177.25,"15min":244.21100000000001},"last":15.42},{"interface":"front","average":{"1min":22.576000000000001,"5min":31.414000000000001,"15min":29.402999999999999},"min":{"1min":10.571999999999999,"5min":9.4179999999999993,"15min":8.8000000000000007},"max":{"1min":86.832999999999998,"5min":335.95100000000002,"15min":335.95100000000002},"last":17.521999999999998}]},{"osd":3,"last update":"Sun Nov 5 08:28:46 2023","interfaces":[{"interface":"back","average":{"1min":13.595000000000001,"5min":21.442,"15min":26.722000000000001},"min":{"1min":6.5359999999999996,"5min":6.4909999999999997,"15min":6.4909999999999997},"max":{"1min":55.103999999999999,"5min":175.47300000000001,"15min":372.54199999999997},"last":7.3789999999999996},{"interface":"front","average":{"1min":26.343,"5min":22.968,"15min":21.238},"min":{"1min":11.815,"5min":6.2000000000000002,"15min":6.0069999999999997},"max":{"1min":113.185,"5min":152.446,"15min":273.34300000000002},"last":16.245000000000001}]},{"osd":4,"last update":"Sun Nov 5 08:28:46 2023","interfaces":[{"interface":"back","average":{"1min":20.216000000000001,"5min":19.321000000000002,"15min":19.097000000000001},"min":{"1min":8.0090000000000003,"5min":6.468,"15min":6.468},"max":{"1min":91.988,"5min":138.107,"15min":211},"last":16.884},{"interface":"front","average":{"1min":22.460000000000001,"5min":22.382999999999999,"15min":22.785},"min":{"1min":7.6790000000000003,"5min":7.6790000000000003,"15min":7.5670000000000002},"max":{"1min":90.873000000000005,"5min":178.578,"15min":255.61600000000001},"last":21.669}]},{"osd":5,"last update":"Sun Nov 5 08:28:46 2023","interfaces":[{"interface":"back","average":{"1min":27.132999999999999,"5min":21.550999999999998,"15min":27.628},"min":{"1min":6.4169999999999998,"5min":6.4169999999999998,"15min":6.4169999999999998},"max":{"1min":114.03400000000001,"5min":121.566,"15min":915.64300000000003},"last":8.4870000000000001},{"interface":"front","average":{"1min":35.225999999999999,"5min":28.045000000000002,"15min":34.017000000000003},"min":{"1min":11.31,"5min":11.31,"15min":8.8079999999999998},"max":{"1min":171.06899999999999,"5min":171.06899999999999,"15min":928.67899999999997},"last":19.628}]},{"osd":7,"last update":"Sun Nov 5 08:28:46 2023","interfaces":[{"interface":"back","average":{"1min":26.385000000000002,"5min":22.568000000000001,"15min":23.834},"min":{"1min":10.788,"5min":7.3730000000000002,"15min":7.3730000000000002},"max":{"1min":128.999,"5min":167.63800000000001,"15min":212.917},"last":22.367000000000001},{"interface":"front","average":{"1min":23.076000000000001,"5min":22.853000000000002,"15min":25.146000000000001},"min":{"1min":8.8940000000000001,"5min":8.609,"15min":7.3259999999999996},"max":{"1min":118.515,"5min":182.375,"15min":222.44499999999999},"last":11.186}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-05T08:29:24.979 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-05T08:29:25.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.084+0000 7f06c774e640 10 monclient: get_monmap_and_config 2023-11-05T08:29:25.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.084+0000 7f06c774e640 10 monclient: build_initial_monmap 2023-11-05T08:29:25.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.084+0000 7f06c774e640 10 monclient: monmap: 2023-11-05T08:29:25.085 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:29:25.085 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:25.085 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:29:25.084591+0000 2023-11-05T08:29:25.085 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:29:25.084591+0000 2023-11-05T08:29:25.085 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:29:25.086 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:25.086 INFO:teuthology.orchestra.run.smithi052.stderr:0: v1:172.21.15.52:6789/0 mon.noname-a-legacy 2023-11-05T08:29:25.086 INFO:teuthology.orchestra.run.smithi052.stderr:1: v1:172.21.15.156:6789/0 mon.noname-c-legacy 2023-11-05T08:29:25.086 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-b 2023-11-05T08:29:25.086 INFO:teuthology.orchestra.run.smithi052.stderr:3: v2:172.21.15.52:3300/0 mon.noname-a 2023-11-05T08:29:25.087 INFO:teuthology.orchestra.run.smithi052.stderr:4: v2:172.21.15.156:3300/0 mon.noname-c 2023-11-05T08:29:25.087 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:25.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.084+0000 7f06c774e640 1 Processor -- start 2023-11-05T08:29:25.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.084+0000 7f06c774e640 1 -- start start 2023-11-05T08:29:25.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.084+0000 7f06c774e640 10 monclient: init 2023-11-05T08:29:25.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.085+0000 7f06c774e640 10 monclient: _reopen_session rank -1 2023-11-05T08:29:25.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.085+0000 7f06c774e640 10 monclient: _add_conns ranks=[4,1,2,0,3] 2023-11-05T08:29:25.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.085+0000 7f06c774e640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f06c00a8ae0 0x7f06c013ec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:25.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.085+0000 7f06c774e640 10 monclient(hunting): picked mon.noname-c con 0x7f06c00a8ae0 addr v2:172.21.15.156:3300/0 2023-11-05T08:29:25.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.085+0000 7f06c774e640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f06c00a8ec0 addr v1:172.21.15.156:6789/0 2023-11-05T08:29:25.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.085+0000 7f06c774e640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f06c00b0de0 0x7f06c013f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:25.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.085+0000 7f06c774e640 10 monclient(hunting): picked mon.noname-b con 0x7f06c00b0de0 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:29:25.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.085+0000 7f06c774e640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06c00a9600 con 0x7f06c00a8ec0 2023-11-05T08:29:25.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.085+0000 7f06c774e640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:25.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.085+0000 7f06c774e640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06c00a9360 con 0x7f06c00a8ae0 2023-11-05T08:29:25.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.085+0000 7f06c774e640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:25.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.085+0000 7f06c774e640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06c00b80b0 con 0x7f06c00b0de0 2023-11-05T08:29:25.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.085+0000 7f06c774e640 10 monclient(hunting): _renew_subs 2023-11-05T08:29:25.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.085+0000 7f06c774e640 10 monclient(hunting): authenticate will time out at 2711.290361s 2023-11-05T08:29:25.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.086+0000 7f06c5ceb640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f06c00b0de0 0x7f06c013f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:25.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.086+0000 7f06c54ea640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f06c00a8ae0 0x7f06c013ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:25.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.086+0000 7f06c5ceb640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f06c00b0de0 0x7f06c013f170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.52:34650/0 (socket says 172.21.15.52:34650) 2023-11-05T08:29:25.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.086+0000 7f06c5ceb640 1 -- 172.21.15.52:0/418049837 learned_addr learned my addr 172.21.15.52:0/418049837 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-11-05T08:29:25.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.086+0000 7f06c5ceb640 10 monclient(hunting): get_auth_request con 0x7f06c00b0de0 auth_method 0 2023-11-05T08:29:25.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.086+0000 7f06c5ceb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:29:25.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.086+0000 7f06c5ceb640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:29:25.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.086+0000 7f06c5ceb640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:29:25.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.086+0000 7f06c54ea640 10 monclient(hunting): get_auth_request con 0x7f06c00a8ae0 auth_method 0 2023-11-05T08:29:25.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.086+0000 7f06c54ea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:29:25.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.086+0000 7f06c54ea640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:29:25.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.086+0000 7f06c54ea640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:29:25.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.086+0000 7f06c5ceb640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:29:25.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.086+0000 7f06c5ceb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:29:25.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.086+0000 7f06c5ceb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:29:25.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.087+0000 7f06c54ea640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:29:25.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.087+0000 7f06c54ea640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:29:25.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.087+0000 7f06c54ea640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:29:25.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.088+0000 7f06c5ceb640 10 monclient(hunting): handle_auth_done global_id 16952 payload 274 2023-11-05T08:29:25.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.088+0000 7f06c5ceb640 1 -- 172.21.15.52:0/418049837 >> v2:172.21.15.156:3300/0 conn(0x7f06c00a8ae0 msgr2=0x7f06c013ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-05T08:29:25.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.088+0000 7f06c5ceb640 1 --2- 172.21.15.52:0/418049837 >> v2:172.21.15.156:3300/0 conn(0x7f06c00a8ae0 0x7f06c013ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:25.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.088+0000 7f06c5ceb640 1 -- 172.21.15.52:0/418049837 >> v1:172.21.15.156:6789/0 conn(0x7f06c00a8ec0 legacy=0x7f06c0145000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:25.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.088+0000 7f06c5ceb640 10 monclient: _finish_hunting 0 2023-11-05T08:29:25.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.088+0000 7f06c5ceb640 1 monclient: found mon.noname-b 2023-11-05T08:29:25.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.088+0000 7f06c5ceb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:29:25.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.088+0000 7f06c5ceb640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.52:3301/0 2023-11-05T08:29:25.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.088+0000 7f06c5ceb640 1 -- 172.21.15.52:0/418049837 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06c0145710 con 0x7f06c00b0de0 2023-11-05T08:29:25.101 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.090+0000 7f06c5ceb640 1 --2- 172.21.15.52:0/418049837 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f06c00b0de0 0x7f06c013f170 secure :-1 s=READY pgs=3076 cs=0 l=1 rev1=1 crypto rx=0x7f06b8009e50 tx=0x7f06b802bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8141248832887770 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:29:25.101 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.094+0000 7f06b7fff640 1 -- 172.21.15.52:0/418049837 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06b802cb00 con 0x7f06c00b0de0 2023-11-05T08:29:25.101 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.094+0000 7f06b7fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:29:25.101 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.094+0000 7f06b7fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-05T08:29:25.101 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.094+0000 7f06b7fff640 10 monclient: dump: 2023-11-05T08:29:25.102 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:29:25.102 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:25.102 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:25.102 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:25.102 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:29:25.103 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:25.103 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:29:25.103 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:29:25.103 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:29:25.103 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:25.104 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.094+0000 7f06b7fff640 10 monclient: _finish_auth 0 2023-11-05T08:29:25.104 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.094+0000 7f06b7fff640 10 monclient: _check_auth_tickets 2023-11-05T08:29:25.104 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.094+0000 7f06b7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:29:25.104 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.094+0000 7f06b7fff640 1 -- 172.21.15.52:0/418049837 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06b802cc60 con 0x7f06c00b0de0 2023-11-05T08:29:25.104 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.094+0000 7f06b7fff640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:29:25.104 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.094+0000 7f06b7fff640 1 -- 172.21.15.52:0/418049837 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06b80343f0 con 0x7f06c00b0de0 2023-11-05T08:29:25.105 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.094+0000 7f06c774e640 5 monclient: authenticate success, global_id 16952 2023-11-05T08:29:25.105 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.094+0000 7f06c774e640 10 monclient: get_monmap_and_config success 2023-11-05T08:29:25.105 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.094+0000 7f06c774e640 4 set_mon_vals no callback set 2023-11-05T08:29:25.105 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.094+0000 7f06b7fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:29:25.105 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.094+0000 7f06b7fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-11-05T08:29:25.106 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.094+0000 7f06b7fff640 10 monclient: dump: 2023-11-05T08:29:25.106 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:29:25.106 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:25.106 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:25.106 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:25.107 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:29:25.107 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:25.107 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:29:25.107 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:29:25.107 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:29:25.107 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:25.108 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.095+0000 7f06c774e640 10 monclient: shutdown 2023-11-05T08:29:25.108 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.095+0000 7f06c774e640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:29:25.108 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.095+0000 7f06c774e640 1 -- 172.21.15.52:0/418049837 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f06c00b0de0 msgr2=0x7f06c013f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:25.108 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.095+0000 7f06c774e640 1 --2- 172.21.15.52:0/418049837 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f06c00b0de0 0x7f06c013f170 secure :-1 s=READY pgs=3076 cs=0 l=1 rev1=1 crypto rx=0x7f06b8009e50 tx=0x7f06b802bf60 comp rx=0 tx=0).stop 2023-11-05T08:29:25.108 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.095+0000 7f06c774e640 1 -- 172.21.15.52:0/418049837 shutdown_connections 2023-11-05T08:29:25.109 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.095+0000 7f06c774e640 1 --2- 172.21.15.52:0/418049837 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f06c00b0de0 0x7f06c013f170 unknown :-1 s=CLOSED pgs=3076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:25.109 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.095+0000 7f06c774e640 1 --2- 172.21.15.52:0/418049837 >> v2:172.21.15.156:3300/0 conn(0x7f06c00a8ae0 0x7f06c013ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:25.109 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.095+0000 7f06c774e640 1 -- 172.21.15.52:0/418049837 >> 172.21.15.52:0/418049837 conn(0x7f06c00b7230 msgr2=0x7f06c00b7610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:29:25.109 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.095+0000 7f06c774e640 1 -- 172.21.15.52:0/418049837 shutdown_connections 2023-11-05T08:29:25.109 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.095+0000 7f06c774e640 1 -- 172.21.15.52:0/418049837 wait complete. 2023-11-05T08:29:25.110 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.095+0000 7f06c774e640 10 monclient: build_initial_monmap 2023-11-05T08:29:25.110 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.095+0000 7f06c774e640 10 monclient: monmap: 2023-11-05T08:29:25.110 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:29:25.110 INFO:teuthology.orchestra.run.smithi052.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-05T08:29:25.110 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 0.000000 2023-11-05T08:29:25.110 INFO:teuthology.orchestra.run.smithi052.stderr:created 0.000000 2023-11-05T08:29:25.111 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:29:25.111 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:25.111 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.noname-a 2023-11-05T08:29:25.111 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.noname-b 2023-11-05T08:29:25.111 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-c 2023-11-05T08:29:25.112 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:25.112 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.096+0000 7f06c774e640 1 librados: starting msgr at 2023-11-05T08:29:25.112 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.096+0000 7f06c774e640 1 librados: starting objecter 2023-11-05T08:29:25.112 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.096+0000 7f06c774e640 1 Processor -- start 2023-11-05T08:29:25.112 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.096+0000 7f06c774e640 1 -- start start 2023-11-05T08:29:25.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.096+0000 7f06c774e640 1 librados: setting wanted keys 2023-11-05T08:29:25.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.096+0000 7f06c774e640 1 librados: calling monclient init 2023-11-05T08:29:25.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.096+0000 7f06c774e640 10 monclient: init 2023-11-05T08:29:25.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.096+0000 7f06c774e640 10 monclient: _reopen_session rank -1 2023-11-05T08:29:25.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.096+0000 7f06c774e640 10 monclient: _add_conns ranks=[0,2,1] 2023-11-05T08:29:25.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.096+0000 7f06c774e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06c00a8ae0 0x7f06c012f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:25.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.096+0000 7f06c774e640 10 monclient(hunting): picked mon.noname-a con 0x7f06c00a8ae0 addr [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] 2023-11-05T08:29:25.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.096+0000 7f06c774e640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f06c00a8ec0 0x7f06c00b57d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:25.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.096+0000 7f06c774e640 10 monclient(hunting): picked mon.noname-c con 0x7f06c00a8ec0 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:29:25.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.096+0000 7f06c774e640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f06c00b0de0 0x7f06c00b5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:25.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.096+0000 7f06c774e640 10 monclient(hunting): picked mon.noname-b con 0x7f06c00b0de0 addr [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] 2023-11-05T08:29:25.115 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.096+0000 7f06c774e640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:25.115 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.096+0000 7f06c774e640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06c0143d80 con 0x7f06c00a8ae0 2023-11-05T08:29:25.115 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.096+0000 7f06c774e640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:25.115 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.096+0000 7f06c774e640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06c00b5140 con 0x7f06c00b0de0 2023-11-05T08:29:25.115 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.096+0000 7f06c774e640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:25.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.096+0000 7f06c774e640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06c00b53b0 con 0x7f06c00a8ec0 2023-11-05T08:29:25.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.096+0000 7f06c774e640 10 monclient(hunting): _renew_subs 2023-11-05T08:29:25.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.096+0000 7f06c774e640 10 monclient(hunting): authenticate will time out at 2711.301773s 2023-11-05T08:29:25.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.097+0000 7f06c4ce9640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f06c00a8ec0 0x7f06c00b57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:25.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.097+0000 7f06c54ea640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06c00a8ae0 0x7f06c012f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:25.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.097+0000 7f06c5ceb640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f06c00b0de0 0x7f06c00b5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:25.117 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.097+0000 7f06c4ce9640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f06c00a8ec0 0x7f06c00b57d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.52:34662/0 (socket says 172.21.15.52:34662) 2023-11-05T08:29:25.117 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.097+0000 7f06c4ce9640 1 -- 172.21.15.52:0/2103499369 learned_addr learned my addr 172.21.15.52:0/2103499369 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-11-05T08:29:25.117 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.097+0000 7f06c4ce9640 10 monclient(hunting): get_auth_request con 0x7f06c00a8ec0 auth_method 0 2023-11-05T08:29:25.117 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.097+0000 7f06c4ce9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:29:25.117 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.097+0000 7f06c4ce9640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:29:25.118 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.097+0000 7f06c4ce9640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:29:25.118 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.097+0000 7f06c5ceb640 10 monclient(hunting): get_auth_request con 0x7f06c00b0de0 auth_method 0 2023-11-05T08:29:25.118 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.097+0000 7f06c5ceb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:29:25.118 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.097+0000 7f06c5ceb640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:29:25.118 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.097+0000 7f06c5ceb640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:29:25.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.097+0000 7f06c54ea640 10 monclient(hunting): get_auth_request con 0x7f06c00a8ae0 auth_method 0 2023-11-05T08:29:25.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.097+0000 7f06c54ea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:29:25.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.097+0000 7f06c54ea640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:29:25.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.097+0000 7f06c54ea640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:29:25.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.098+0000 7f06c4ce9640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:29:25.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.098+0000 7f06c4ce9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:29:25.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.098+0000 7f06c4ce9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:29:25.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.098+0000 7f06c5ceb640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:29:25.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.098+0000 7f06c5ceb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:29:25.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.098+0000 7f06c5ceb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:29:25.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.098+0000 7f06c54ea640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:29:25.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.098+0000 7f06c54ea640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:29:25.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.098+0000 7f06c54ea640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:29:25.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.100+0000 7f06c5ceb640 10 monclient(hunting): handle_auth_done global_id 20698 payload 824 2023-11-05T08:29:25.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.100+0000 7f06c5ceb640 1 -- 172.21.15.52:0/2103499369 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f06c00a8ec0 msgr2=0x7f06c00b57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:25.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.100+0000 7f06c5ceb640 1 --2- 172.21.15.52:0/2103499369 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f06c00a8ec0 0x7f06c00b57d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:25.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.100+0000 7f06c5ceb640 1 -- 172.21.15.52:0/2103499369 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06c00a8ae0 msgr2=0x7f06c012f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:25.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.100+0000 7f06c5ceb640 1 --2- 172.21.15.52:0/2103499369 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06c00a8ae0 0x7f06c012f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:25.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.100+0000 7f06c5ceb640 10 monclient: _finish_hunting 0 2023-11-05T08:29:25.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.100+0000 7f06c5ceb640 1 monclient: found mon.noname-b 2023-11-05T08:29:25.123 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.100+0000 7f06c5ceb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:29:25.123 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.100+0000 7f06c5ceb640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.156:3300/0 2023-11-05T08:29:25.123 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.100+0000 7f06c5ceb640 1 -- 172.21.15.52:0/2103499369 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06b8009b30 con 0x7f06c00b0de0 2023-11-05T08:29:25.124 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.103+0000 7f06c5ceb640 1 --2- 172.21.15.52:0/2103499369 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f06c00b0de0 0x7f06c00b5d10 secure :-1 s=READY pgs=4996 cs=0 l=1 rev1=1 crypto rx=0x7f06b8032000 tx=0x7f06b8004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:29:25.125 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.103+0000 7f06b5ffb640 10 client.?.objecter ms_handle_connect 0x7f06c00b0de0 2023-11-05T08:29:25.125 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.103+0000 7f06b5ffb640 10 client.?.objecter resend_mon_ops 2023-11-05T08:29:25.125 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.107+0000 7f06b5ffb640 1 -- 172.21.15.52:0/2103499369 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06b8040670 con 0x7f06c00b0de0 2023-11-05T08:29:25.125 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.107+0000 7f06b5ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:29:25.125 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.107+0000 7f06b5ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-05T08:29:25.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.107+0000 7f06b5ffb640 10 monclient: dump: 2023-11-05T08:29:25.126 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:29:25.126 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:25.126 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:25.126 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:25.127 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:29:25.127 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:25.127 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:29:25.127 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:29:25.127 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:29:25.128 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:25.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.107+0000 7f06b5ffb640 10 monclient: _finish_auth 0 2023-11-05T08:29:25.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.107+0000 7f06b5ffb640 10 monclient: _check_auth_tickets 2023-11-05T08:29:25.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.107+0000 7f06b5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:29:25.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.107+0000 7f06b5ffb640 1 -- 172.21.15.52:0/2103499369 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06b8040810 con 0x7f06c00b0de0 2023-11-05T08:29:25.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.107+0000 7f06b5ffb640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:29:25.129 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.107+0000 7f06b5ffb640 1 -- 172.21.15.52:0/2103499369 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06b8040bc0 con 0x7f06c00b0de0 2023-11-05T08:29:25.129 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.107+0000 7f06c774e640 5 monclient: authenticate success, global_id 20698 2023-11-05T08:29:25.129 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.107+0000 7f06c774e640 10 monclient: _renew_subs 2023-11-05T08:29:25.129 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.107+0000 7f06c774e640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:29:25.129 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.107+0000 7f06c774e640 1 -- 172.21.15.52:0/2103499369 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06c0142c50 con 0x7f06c00b0de0 2023-11-05T08:29:25.130 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.107+0000 7f06b6ffd640 4 set_mon_vals no callback set 2023-11-05T08:29:25.130 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.107+0000 7f06b5ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:29:25.130 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.107+0000 7f06b5ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-05T08:29:25.130 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.107+0000 7f06b5ffb640 10 monclient: dump: 2023-11-05T08:29:25.130 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:29:25.131 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:25.131 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:25.131 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:25.131 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:29:25.131 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:25.131 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:29:25.132 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:29:25.132 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:29:25.132 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:25.132 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.107+0000 7f06c774e640 10 client.20698.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-05T08:29:25.132 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.107+0000 7f06c774e640 10 monclient: _renew_subs 2023-11-05T08:29:25.132 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.107+0000 7f06c774e640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:29:25.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.107+0000 7f06c774e640 1 -- 172.21.15.52:0/2103499369 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06c0144b60 con 0x7f06c00b0de0 2023-11-05T08:29:25.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.107+0000 7f06c774e640 1 librados: init done 2023-11-05T08:29:25.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.108+0000 7f06c774e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-05T08:29:25.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.108+0000 7f06c774e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:29:25.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.108+0000 7f06c774e640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:29:25.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.108+0000 7f06c774e640 1 -- 172.21.15.52:0/2103499369 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06c0143f30 con 0x7f06c00b0de0 2023-11-05T08:29:25.134 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.127+0000 7f06b5ffb640 1 -- 172.21.15.52:0/2103499369 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f06b8040d20 con 0x7f06c00b0de0 2023-11-05T08:29:25.134 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.127+0000 7f06b5ffb640 1 --2- 172.21.15.52:0/2103499369 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f06a406c850 0x7f06a406ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:25.135 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.127+0000 7f06c54ea640 1 --2- 172.21.15.52:0/2103499369 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f06a406c850 0x7f06a406ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:25.135 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.127+0000 7f06c54ea640 10 monclient: get_auth_request con 0x7f06a406c850 auth_method 0 2023-11-05T08:29:25.135 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.128+0000 7f06b5ffb640 10 client.20698.objecter ms_handle_connect 0x7f06a406c850 2023-11-05T08:29:25.135 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.128+0000 7f06c54ea640 1 --2- 172.21.15.52:0/2103499369 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f06a406c850 0x7f06a406ed10 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f06bc009a90 tx=0x7f06bc009110 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:29:25.363 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.363+0000 7f06b5ffb640 1 -- 172.21.15.52:0/2103499369 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(932..932 src has 541..932) v4 ==== 6193+0+0 (secure 0 0 0) 0x7f06b807b610 con 0x7f06c00b0de0 2023-11-05T08:29:25.364 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.363+0000 7f06b5ffb640 10 client.20698.objecter ms_dispatch 0x7f06c0000b90 osd_map(932..932 src has 541..932) v4 2023-11-05T08:29:25.364 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.363+0000 7f06b5ffb640 3 client.20698.objecter handle_osd_map got epochs [932,932] > 0 2023-11-05T08:29:25.364 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.363+0000 7f06b5ffb640 3 client.20698.objecter handle_osd_map decoding full epoch 932 2023-11-05T08:29:25.365 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.363+0000 7f06b5ffb640 20 client.20698.objecter dump_active .. 0 homeless 2023-11-05T08:29:25.372 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.372+0000 7f06b5ffb640 1 -- 172.21.15.52:0/2103499369 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f06b8077950 con 0x7f06c00b0de0 2023-11-05T08:29:25.373 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.372+0000 7f06b5ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:29:25.373 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.372+0000 7f06b5ffb640 10 monclient: _finish_command 1 = system:0 2023-11-05T08:29:25.552 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.550+0000 7f06c774e640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2023-11-05T08:29:25.552 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.550+0000 7f06c774e640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2023-11-05T08:29:25.552 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.550+0000 7f06c774e640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:29:25.552 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.550+0000 7f06c774e640 1 -- 172.21.15.52:0/2103499369 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f06c0143f30 con 0x7f06c00b0de0 2023-11-05T08:29:25.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.586+0000 7f06b5ffb640 1 -- 172.21.15.52:0/2103499369 <== mon.1 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v932) v1 ==== 74+0+17350 (secure 0 0 0) 0x7f06c0143f30 con 0x7f06c00b0de0 2023-11-05T08:29:25.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.586+0000 7f06b5ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2023-11-05T08:29:25.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.586+0000 7f06b5ffb640 10 monclient: _finish_command 2 = system:0 2023-11-05T08:29:25.587 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:29:25.587 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":932,"fsid":"b7fdc914-b520-409f-b9d7-902b05a64252","created":"2023-11-05T08:06:09.361414+0000","modified":"2023-11-05T08:29:22.444478+0000","last_up_change":"2023-11-05T08:06:58.242946+0000","last_in_change":"2023-11-05T08:06:15.124773+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":103,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":259,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-05T08:06:57.428817+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-05T08:07:04.236294+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"ceph_test_rados_api_asio","create_time":"2023-11-05T08:08:08.356508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c95e48e9-832b-4950-b467-9f61d33decc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":926,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":61703536},{"type":"v1","addr":"172.21.15.52:6817","nonce":61703536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6818","nonce":61703536},{"type":"v1","addr":"172.21.15.52:6819","nonce":61703536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":61703536},{"type":"v1","addr":"172.21.15.52:6823","nonce":61703536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":61703536},{"type":"v1","addr":"172.21.15.52:6821","nonce":61703536}]},"public_addr":"172.21.15.52:6817/61703536","cluster_addr":"172.21.15.52:6819/61703536","heartbeat_back_addr":"172.21.15.52:6823/61703536","heartbeat_front_addr":"172.21.15.52:6821/61703536","state":["exists","up"]},{"osd":1,"uuid":"82d5dd13-f1f5-4282-8ec8-4d6c273a42c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":926,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":544646809},{"type":"v1","addr":"172.21.15.52:6825","nonce":544646809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":544646809},{"type":"v1","addr":"172.21.15.52:6827","nonce":544646809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":544646809},{"type":"v1","addr":"172.21.15.52:6831","nonce":544646809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":544646809},{"type":"v1","addr":"172.21.15.52:6829","nonce":544646809}]},"public_addr":"172.21.15.52:6825/544646809","cluster_addr":"172.21.15.52:6827/544646809","heartbeat_back_addr":"172.21.15.52:6831/544646809","heartbeat_front_addr":"172.21.15.52:6829/544646809","state":["exists","up"]},{"osd":2,"uuid":"2c5ea82d-5534-4437-a76f-e3769d798b17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":926,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":495294409},{"type":"v1","addr":"172.21.15.52:6801","nonce":495294409}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":495294409},{"type":"v1","addr":"172.21.15.52:6803","nonce":495294409}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":495294409},{"type":"v1","addr":"172.21.15.52:6807","nonce":495294409}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":495294409},{"type":"v1","addr":"172.21.15.52:6805","nonce":495294409}]},"public_addr":"172.21.15.52:6801/495294409","cluster_addr":"172.21.15.52:6803/495294409","heartbeat_back_addr":"172.21.15.52:6807/495294409","heartbeat_front_addr":"172.21.15.52:6805/495294409","state":["exists","up"]},{"osd":3,"uuid":"9ffcbf5b-1afd-4777-825f-c5fb551b9d88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":926,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":3439629566},{"type":"v1","addr":"172.21.15.52:6809","nonce":3439629566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":3439629566},{"type":"v1","addr":"172.21.15.52:6811","nonce":3439629566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":3439629566},{"type":"v1","addr":"172.21.15.52:6815","nonce":3439629566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3439629566},{"type":"v1","addr":"172.21.15.52:6813","nonce":3439629566}]},"public_addr":"172.21.15.52:6809/3439629566","cluster_addr":"172.21.15.52:6811/3439629566","heartbeat_back_addr":"172.21.15.52:6815/3439629566","heartbeat_front_addr":"172.21.15.52:6813/3439629566","state":["exists","up"]},{"osd":4,"uuid":"3f5f9aa4-2015-4835-9b39-faf459a35a49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":921,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":3458684008},{"type":"v1","addr":"172.21.15.156:6816","nonce":3458684008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":3458684008},{"type":"v1","addr":"172.21.15.156:6820","nonce":3458684008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":3458684008},{"type":"v1","addr":"172.21.15.156:6825","nonce":3458684008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":3458684008},{"type":"v1","addr":"172.21.15.156:6823","nonce":3458684008}]},"public_addr":"172.21.15.156:6816/3458684008","cluster_addr":"172.21.15.156:6820/3458684008","heartbeat_back_addr":"172.21.15.156:6825/3458684008","heartbeat_front_addr":"172.21.15.156:6823/3458684008","state":["exists","up"]},{"osd":5,"uuid":"cf781fb3-83fb-40e0-86a3-f895d7824edb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":926,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":2755763872},{"type":"v1","addr":"172.21.15.156:6811","nonce":2755763872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":2755763872},{"type":"v1","addr":"172.21.15.156:6813","nonce":2755763872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6819","nonce":2755763872},{"type":"v1","addr":"172.21.15.156:6821","nonce":2755763872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6815","nonce":2755763872},{"type":"v1","addr":"172.21.15.156:6817","nonce":2755763872}]},"public_addr":"172.21.15.156:6811/2755763872","cluster_addr":"172.21.15.156:6813/2755763872","heartbeat_back_addr":"172.21.15.156:6821/2755763872","heartbeat_front_addr":"172.21.15.156:6817/2755763872","state":["exists","up"]},{"osd":6,"uuid":"d2787c11-d907-4924-b9cf-69db95ad35c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":926,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":2586579514},{"type":"v1","addr":"172.21.15.156:6827","nonce":2586579514}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":2586579514},{"type":"v1","addr":"172.21.15.156:6829","nonce":2586579514}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":2586579514},{"type":"v1","addr":"172.21.15.156:6833","nonce":2586579514}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":2586579514},{"type":"v1","addr":"172.21.15.156:6831","nonce":2586579514}]},"public_addr":"172.21.15.156:6827/2586579514","cluster_addr":"172.21.15.156:6829/2586579514","heartbeat_back_addr":"172.21.15.156:6833/2586579514","heartbeat_front_addr":"172.21.15.156:6831/2586579514","state":["exists","up"]},{"osd":7,"uuid":"e9e51eb8-2a9d-4cd0-9158-a00eea2a5614","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":926,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":617205919},{"type":"v1","addr":"172.21.15.156:6803","nonce":617205919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":617205919},{"type":"v1","addr":"172.21.15.156:6805","nonce":617205919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":617205919},{"type":"v1","addr":"172.21.15.156:6809","nonce":617205919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":617205919},{"type":"v1","addr":"172.21.15.156:6807","nonce":617205919}]},"public_addr":"172.21.15.156:6803/617205919","cluster_addr":"172.21.15.156:6805/617205919","heartbeat_back_addr":"172.21.15.156:6809/617205919","heartbeat_front_addr":"172.21.15.156:6807/617205919","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-05T08:06:55.502291+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-05T08:06:55.933520+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-05T08:06:54.412766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-05T08:06:55.414534+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-05T08:06:53.487778+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-05T08:06:53.398349+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-05T08:06:53.054197+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-05T08:06:53.155612+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":9,"snaps":[{"begin":9,"length":2}]},{"pool":24,"snaps":[{"begin":1,"length":1},{"begin":3,"length":1},{"begin":5,"length":1},{"begin":7,"length":1}]},{"pool":54,"snaps":[{"begin":11,"length":2}]},{"pool":85,"snaps":[{"begin":3,"length":1},{"begin":5,"length":1},{"begin":7,"length":1}]},{"pool":91,"snaps":[{"begin":2,"length":1}]},{"pool":96,"snaps":[{"begin":6,"length":2}]},{"pool":106,"snaps":[{"begin":3,"length":1},{"begin":5,"length":1},{"begin":7,"length":1}]},{"pool":117,"snaps":[{"begin":7,"length":2},{"begin":11,"length":2}]},{"pool":174,"snaps":[{"begin":12,"length":1}]},{"pool":183,"snaps":[{"begin":14,"length":1}]},{"pool":188,"snaps":[{"begin":17,"length":1}]},{"pool":191,"snaps":[{"begin":19,"length":1}]},{"pool":197,"snaps":[{"begin":24,"length":1}]},{"pool":240,"snaps":[{"begin":2,"length":1}]},{"pool":241,"snaps":[{"begin":4,"length":1}]},{"pool":244,"snaps":[{"begin":6,"length":1}]},{"pool":248,"snaps":[{"begin":9,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-05T08:29:25.589 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.587+0000 7f06c774e640 10 librados: watch_flush enter 2023-11-05T08:29:25.589 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.588+0000 7f06c774e640 10 librados: watch_flush exit 2023-11-05T08:29:25.589 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.588+0000 7f06c774e640 20 client.20698.objecter shutdown clearing up homeless session... 2023-11-05T08:29:25.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.588+0000 7f06c774e640 10 client.20698.objecter successfully canceled tick 2023-11-05T08:29:25.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.588+0000 7f06c774e640 1 -- 172.21.15.52:0/2103499369 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f06a406c850 msgr2=0x7f06a406ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:25.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.588+0000 7f06c774e640 1 --2- 172.21.15.52:0/2103499369 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f06a406c850 0x7f06a406ed10 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f06bc009a90 tx=0x7f06bc009110 comp rx=0 tx=0).stop 2023-11-05T08:29:25.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.588+0000 7f06c774e640 10 monclient: shutdown 2023-11-05T08:29:25.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.588+0000 7f06c774e640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:29:25.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.588+0000 7f06c774e640 1 -- 172.21.15.52:0/2103499369 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f06c00b0de0 msgr2=0x7f06c00b5d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:25.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.588+0000 7f06c774e640 1 --2- 172.21.15.52:0/2103499369 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f06c00b0de0 0x7f06c00b5d10 secure :-1 s=READY pgs=4996 cs=0 l=1 rev1=1 crypto rx=0x7f06b8032000 tx=0x7f06b8004a40 comp rx=0 tx=0).stop 2023-11-05T08:29:25.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.588+0000 7f06c774e640 1 -- 172.21.15.52:0/2103499369 shutdown_connections 2023-11-05T08:29:25.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.588+0000 7f06c774e640 1 --2- 172.21.15.52:0/2103499369 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f06a406c850 0x7f06a406ed10 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:25.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.588+0000 7f06c774e640 1 --2- 172.21.15.52:0/2103499369 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f06c00b0de0 0x7f06c00b5d10 unknown :-1 s=CLOSED pgs=4996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:25.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.588+0000 7f06c774e640 1 --2- 172.21.15.52:0/2103499369 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f06c00a8ec0 0x7f06c00b57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:25.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.588+0000 7f06c774e640 1 --2- 172.21.15.52:0/2103499369 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06c00a8ae0 0x7f06c012f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:25.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.588+0000 7f06c774e640 1 -- 172.21.15.52:0/2103499369 >> 172.21.15.52:0/2103499369 conn(0x7f06c00b7230 msgr2=0x7f06c00b7610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:29:25.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.588+0000 7f06c774e640 1 -- 172.21.15.52:0/2103499369 shutdown_connections 2023-11-05T08:29:25.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.588+0000 7f06c774e640 1 -- 172.21.15.52:0/2103499369 wait complete. 2023-11-05T08:29:25.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:25.588+0000 7f06c774e640 1 librados: shutdown 2023-11-05T08:29:26.409 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:23:29.524 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:29:26.413 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:23:29.529 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:29:26.441 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:23:29.556 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:29:26.456 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:23:29.530 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:29:26.459 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:23:29.534 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:29:26.464 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:23:29.580 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:29:26.469 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:23:29.585 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:29:26.487 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:23:29.562 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:29:26.501 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:23:29.617 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:29:26.601 INFO:tasks.ceph:Scrubbing osd.0 2023-11-05T08:29:26.601 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-11-05T08:29:26.713 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.712+0000 7fd73a3e2640 10 monclient: get_monmap_and_config 2023-11-05T08:29:26.713 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.712+0000 7fd73a3e2640 10 monclient: build_initial_monmap 2023-11-05T08:29:26.713 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.712+0000 7fd73a3e2640 10 monclient: monmap: 2023-11-05T08:29:26.713 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:29:26.714 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:26.714 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:29:26.713267+0000 2023-11-05T08:29:26.714 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:29:26.713267+0000 2023-11-05T08:29:26.714 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:29:26.714 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:26.715 INFO:teuthology.orchestra.run.smithi052.stderr:0: v1:172.21.15.52:6789/0 mon.noname-a-legacy 2023-11-05T08:29:26.715 INFO:teuthology.orchestra.run.smithi052.stderr:1: v1:172.21.15.156:6789/0 mon.noname-c-legacy 2023-11-05T08:29:26.715 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-b 2023-11-05T08:29:26.715 INFO:teuthology.orchestra.run.smithi052.stderr:3: v2:172.21.15.52:3300/0 mon.noname-a 2023-11-05T08:29:26.715 INFO:teuthology.orchestra.run.smithi052.stderr:4: v2:172.21.15.156:3300/0 mon.noname-c 2023-11-05T08:29:26.716 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:26.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.713+0000 7fd73a3e2640 1 Processor -- start 2023-11-05T08:29:26.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.713+0000 7fd73a3e2640 1 -- start start 2023-11-05T08:29:26.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.713+0000 7fd73a3e2640 10 monclient: init 2023-11-05T08:29:26.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.714+0000 7fd73a3e2640 10 monclient: _reopen_session rank -1 2023-11-05T08:29:26.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.714+0000 7fd73a3e2640 10 monclient: _add_conns ranks=[4,3,0,2,1] 2023-11-05T08:29:26.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.714+0000 7fd73a3e2640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd7340b42c0 0x7fd7340a9210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:26.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.714+0000 7fd73a3e2640 10 monclient(hunting): picked mon.noname-c con 0x7fd7340b42c0 addr v2:172.21.15.156:3300/0 2023-11-05T08:29:26.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.714+0000 7fd73a3e2640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd7340a8770 0x7fd73413ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:26.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.714+0000 7fd73a3e2640 10 monclient(hunting): picked mon.noname-a con 0x7fd7340a8770 addr v2:172.21.15.52:3300/0 2023-11-05T08:29:26.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.714+0000 7fd73a3e2640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fd73413f130 addr v1:172.21.15.52:6789/0 2023-11-05T08:29:26.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.714+0000 7fd73a3e2640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7340a8d00 con 0x7fd73413f130 2023-11-05T08:29:26.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.714+0000 7fd73a3e2640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:26.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.714+0000 7fd73a3e2640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7340b46a0 con 0x7fd7340a8770 2023-11-05T08:29:26.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.714+0000 7fd73a3e2640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:26.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.714+0000 7fd73a3e2640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7340ade80 con 0x7fd7340b42c0 2023-11-05T08:29:26.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.714+0000 7fd73a3e2640 10 monclient(hunting): _renew_subs 2023-11-05T08:29:26.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.714+0000 7fd73a3e2640 10 monclient(hunting): authenticate will time out at 2712.919110s 2023-11-05T08:29:26.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.720+0000 7fd733fff640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd7340b42c0 0x7fd7340a9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:26.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.727+0000 7fd733fff640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd7340b42c0 0x7fd7340a9210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.52:34456/0 (socket says 172.21.15.52:34456) 2023-11-05T08:29:26.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.727+0000 7fd733fff640 1 -- 172.21.15.52:0/3605271058 learned_addr learned my addr 172.21.15.52:0/3605271058 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-11-05T08:29:26.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.727+0000 7fd733fff640 10 monclient(hunting): get_auth_request con 0x7fd7340b42c0 auth_method 0 2023-11-05T08:29:26.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.727+0000 7fd733fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:29:26.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.727+0000 7fd733fff640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:29:26.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.727+0000 7fd733fff640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:29:26.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.733+0000 7fd733fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:29:26.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.733+0000 7fd733fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:29:26.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.733+0000 7fd733fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:29:26.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.741+0000 7fd733fff640 10 monclient(hunting): handle_auth_done global_id 20701 payload 274 2023-11-05T08:29:26.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.741+0000 7fd733fff640 1 -- 172.21.15.52:0/3605271058 >> v2:172.21.15.52:3300/0 conn(0x7fd7340a8770 msgr2=0x7fd73413ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-05T08:29:26.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.741+0000 7fd733fff640 1 --2- 172.21.15.52:0/3605271058 >> v2:172.21.15.52:3300/0 conn(0x7fd7340a8770 0x7fd73413ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:26.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.741+0000 7fd733fff640 1 -- 172.21.15.52:0/3605271058 >> v1:172.21.15.52:6789/0 conn(0x7fd73413f130 legacy=0x7fd734144f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-05T08:29:26.742 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.741+0000 7fd733fff640 10 monclient: _finish_hunting 0 2023-11-05T08:29:26.742 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.741+0000 7fd733fff640 1 monclient: found mon.noname-c 2023-11-05T08:29:26.742 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.741+0000 7fd733fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:29:26.742 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.741+0000 7fd733fff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.156:3300/0 2023-11-05T08:29:26.742 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.741+0000 7fd733fff640 1 -- 172.21.15.52:0/3605271058 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd73413f560 con 0x7fd7340b42c0 2023-11-05T08:29:26.750 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.750+0000 7fd733fff640 1 --2- 172.21.15.52:0/3605271058 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd7340b42c0 0x7fd7340a9210 secure :-1 s=READY pgs=4999 cs=0 l=1 rev1=1 crypto rx=0x7fd73406b830 tx=0x7fd72402b7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d07f14074c01d93 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:29:26.808 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.808+0000 7fd732ffd640 1 -- 172.21.15.52:0/3605271058 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd724031750 con 0x7fd7340b42c0 2023-11-05T08:29:26.809 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.808+0000 7fd732ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:29:26.809 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.808+0000 7fd732ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-11-05T08:29:26.809 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.808+0000 7fd732ffd640 10 monclient: dump: 2023-11-05T08:29:26.809 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:29:26.810 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:26.810 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:26.810 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:26.810 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:29:26.810 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:26.811 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:29:26.811 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:29:26.811 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:29:26.811 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:26.811 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.808+0000 7fd732ffd640 10 monclient: _finish_auth 0 2023-11-05T08:29:26.811 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.808+0000 7fd732ffd640 10 monclient: _check_auth_tickets 2023-11-05T08:29:26.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.808+0000 7fd732ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:29:26.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.808+0000 7fd732ffd640 1 -- 172.21.15.52:0/3605271058 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7240318b0 con 0x7fd7340b42c0 2023-11-05T08:29:26.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.808+0000 7fd732ffd640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:29:26.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.808+0000 7fd732ffd640 1 -- 172.21.15.52:0/3605271058 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd724031c40 con 0x7fd7340b42c0 2023-11-05T08:29:26.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.808+0000 7fd73a3e2640 5 monclient: authenticate success, global_id 20701 2023-11-05T08:29:26.813 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.808+0000 7fd73a3e2640 10 monclient: get_monmap_and_config success 2023-11-05T08:29:26.813 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.808+0000 7fd73a3e2640 4 set_mon_vals no callback set 2023-11-05T08:29:26.813 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.808+0000 7fd732ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:29:26.813 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.808+0000 7fd732ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-05T08:29:26.813 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.808+0000 7fd732ffd640 10 monclient: dump: 2023-11-05T08:29:26.814 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:29:26.814 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:26.814 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:26.814 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:26.814 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:29:26.815 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:26.815 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:29:26.815 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:29:26.815 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:29:26.815 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:26.818 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.809+0000 7fd73a3e2640 10 monclient: shutdown 2023-11-05T08:29:26.819 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.809+0000 7fd73a3e2640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:29:26.819 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.809+0000 7fd73a3e2640 1 -- 172.21.15.52:0/3605271058 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd7340b42c0 msgr2=0x7fd7340a9210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:26.819 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.809+0000 7fd73a3e2640 1 --2- 172.21.15.52:0/3605271058 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd7340b42c0 0x7fd7340a9210 secure :-1 s=READY pgs=4999 cs=0 l=1 rev1=1 crypto rx=0x7fd73406b830 tx=0x7fd72402b7f0 comp rx=0 tx=0).stop 2023-11-05T08:29:26.819 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.809+0000 7fd73a3e2640 1 -- 172.21.15.52:0/3605271058 shutdown_connections 2023-11-05T08:29:26.819 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.809+0000 7fd73a3e2640 1 --2- 172.21.15.52:0/3605271058 >> v2:172.21.15.52:3300/0 conn(0x7fd7340a8770 0x7fd73413ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:26.820 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.809+0000 7fd73a3e2640 1 --2- 172.21.15.52:0/3605271058 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd7340b42c0 0x7fd7340a9210 unknown :-1 s=CLOSED pgs=4999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:26.820 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.809+0000 7fd73a3e2640 1 -- 172.21.15.52:0/3605271058 >> 172.21.15.52:0/3605271058 conn(0x7fd734065ee0 msgr2=0x7fd7340662f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:29:26.820 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.809+0000 7fd73a3e2640 1 -- 172.21.15.52:0/3605271058 shutdown_connections 2023-11-05T08:29:26.820 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.809+0000 7fd73a3e2640 1 -- 172.21.15.52:0/3605271058 wait complete. 2023-11-05T08:29:26.820 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.809+0000 7fd73a3e2640 10 monclient: build_initial_monmap 2023-11-05T08:29:26.820 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.809+0000 7fd73a3e2640 10 monclient: monmap: 2023-11-05T08:29:26.821 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:29:26.821 INFO:teuthology.orchestra.run.smithi052.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-05T08:29:26.821 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 0.000000 2023-11-05T08:29:26.821 INFO:teuthology.orchestra.run.smithi052.stderr:created 0.000000 2023-11-05T08:29:26.821 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:29:26.822 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:26.822 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.noname-a 2023-11-05T08:29:26.822 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.noname-b 2023-11-05T08:29:26.822 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-c 2023-11-05T08:29:26.822 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:26.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.810+0000 7fd73a3e2640 1 librados: starting msgr at 2023-11-05T08:29:26.823 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.810+0000 7fd73a3e2640 1 librados: starting objecter 2023-11-05T08:29:26.823 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.810+0000 7fd73a3e2640 1 Processor -- start 2023-11-05T08:29:26.823 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.810+0000 7fd73a3e2640 1 -- start start 2023-11-05T08:29:26.823 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.810+0000 7fd73a3e2640 1 librados: setting wanted keys 2023-11-05T08:29:26.823 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.810+0000 7fd73a3e2640 1 librados: calling monclient init 2023-11-05T08:29:26.824 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.810+0000 7fd73a3e2640 10 monclient: init 2023-11-05T08:29:26.824 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.810+0000 7fd73a3e2640 10 monclient: _reopen_session rank -1 2023-11-05T08:29:26.824 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.810+0000 7fd73a3e2640 10 monclient: _add_conns ranks=[1,0,2] 2023-11-05T08:29:26.824 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.810+0000 7fd73a3e2640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd7340a8770 0x7fd7340ac0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:26.824 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.810+0000 7fd73a3e2640 10 monclient(hunting): picked mon.noname-b con 0x7fd7340a8770 addr [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] 2023-11-05T08:29:26.825 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.810+0000 7fd73a3e2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7340b42c0 0x7fd7341d7020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:26.825 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.810+0000 7fd73a3e2640 10 monclient(hunting): picked mon.noname-a con 0x7fd7340b42c0 addr [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] 2023-11-05T08:29:26.825 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.810+0000 7fd73a3e2640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd73413f130 0x7fd7341d7560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:26.825 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.810+0000 7fd73a3e2640 10 monclient(hunting): picked mon.noname-c con 0x7fd73413f130 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:29:26.825 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.810+0000 7fd73a3e2640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:26.825 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.810+0000 7fd73a3e2640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7341d6bd0 con 0x7fd7340b42c0 2023-11-05T08:29:26.826 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.810+0000 7fd73a3e2640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:26.826 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.810+0000 7fd73a3e2640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7340b7e00 con 0x7fd7340a8770 2023-11-05T08:29:26.826 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.810+0000 7fd73a3e2640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:26.826 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.810+0000 7fd73a3e2640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7340b5f80 con 0x7fd73413f130 2023-11-05T08:29:26.826 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.810+0000 7fd73a3e2640 10 monclient(hunting): _renew_subs 2023-11-05T08:29:26.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.810+0000 7fd73a3e2640 10 monclient(hunting): authenticate will time out at 2713.015877s 2023-11-05T08:29:26.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.812+0000 7fd733fff640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd7340a8770 0x7fd7340ac0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:26.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.812+0000 7fd7337fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7340b42c0 0x7fd7341d7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:26.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.813+0000 7fd7337fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7340b42c0 0x7fd7341d7020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59954/0 (socket says 172.21.15.52:59954) 2023-11-05T08:29:26.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.813+0000 7fd7337fe640 1 -- 172.21.15.52:0/2343508266 learned_addr learned my addr 172.21.15.52:0/2343508266 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-11-05T08:29:26.828 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.813+0000 7fd7337fe640 10 monclient(hunting): get_auth_request con 0x7fd7340b42c0 auth_method 0 2023-11-05T08:29:26.828 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.813+0000 7fd7337fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:29:26.828 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.813+0000 7fd7337fe640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:29:26.828 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.813+0000 7fd7337fe640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:29:26.828 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.813+0000 7fd733fff640 10 monclient(hunting): get_auth_request con 0x7fd7340a8770 auth_method 0 2023-11-05T08:29:26.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.813+0000 7fd733fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:29:26.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.813+0000 7fd733fff640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:29:26.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.813+0000 7fd733fff640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:29:26.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.814+0000 7fd733fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:29:26.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.814+0000 7fd733fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:29:26.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.814+0000 7fd733fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:29:26.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.814+0000 7fd7337fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:29:26.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.814+0000 7fd7337fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:29:26.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.814+0000 7fd7337fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:29:26.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.817+0000 7fd733fff640 10 monclient(hunting): handle_auth_done global_id 20704 payload 824 2023-11-05T08:29:26.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.817+0000 7fd733fff640 1 -- 172.21.15.52:0/2343508266 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd73413f130 msgr2=0x7fd7341d7560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:26.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.817+0000 7fd733fff640 1 --2- 172.21.15.52:0/2343508266 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd73413f130 0x7fd7341d7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:26.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.817+0000 7fd733fff640 1 -- 172.21.15.52:0/2343508266 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7340b42c0 msgr2=0x7fd7341d7020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:26.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.817+0000 7fd733fff640 1 --2- 172.21.15.52:0/2343508266 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7340b42c0 0x7fd7341d7020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:26.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.817+0000 7fd733fff640 10 monclient: _finish_hunting 0 2023-11-05T08:29:26.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.817+0000 7fd733fff640 1 monclient: found mon.noname-b 2023-11-05T08:29:26.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.817+0000 7fd733fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:29:26.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.817+0000 7fd733fff640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.156:3300/0 2023-11-05T08:29:26.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.817+0000 7fd733fff640 1 -- 172.21.15.52:0/2343508266 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7240094d0 con 0x7fd7340a8770 2023-11-05T08:29:26.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.820+0000 7fd733fff640 1 --2- 172.21.15.52:0/2343508266 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd7340a8770 0x7fd7340ac0f0 secure :-1 s=READY pgs=5000 cs=0 l=1 rev1=1 crypto rx=0x7fd724033000 tx=0x7fd7240046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:29:26.833 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.820+0000 7fd730ff9640 10 client.?.objecter ms_handle_connect 0x7fd7340a8770 2023-11-05T08:29:26.833 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.820+0000 7fd730ff9640 10 client.?.objecter resend_mon_ops 2023-11-05T08:29:26.835 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.834+0000 7fd730ff9640 1 -- 172.21.15.52:0/2343508266 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd724033c60 con 0x7fd7340a8770 2023-11-05T08:29:26.835 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.834+0000 7fd730ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:29:26.836 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.834+0000 7fd730ff9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-05T08:29:26.836 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.834+0000 7fd730ff9640 10 monclient: dump: 2023-11-05T08:29:26.836 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:29:26.836 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:26.836 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:26.837 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:26.837 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:29:26.837 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:26.837 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:29:26.837 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:29:26.838 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:29:26.838 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:26.838 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.834+0000 7fd730ff9640 10 monclient: _finish_auth 0 2023-11-05T08:29:26.838 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.834+0000 7fd730ff9640 10 monclient: _check_auth_tickets 2023-11-05T08:29:26.838 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.834+0000 7fd730ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:29:26.838 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.834+0000 7fd730ff9640 1 -- 172.21.15.52:0/2343508266 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd724033dc0 con 0x7fd7340a8770 2023-11-05T08:29:26.839 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.834+0000 7fd73a3e2640 5 monclient: authenticate success, global_id 20704 2023-11-05T08:29:26.839 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.834+0000 7fd73a3e2640 10 monclient: _renew_subs 2023-11-05T08:29:26.839 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.834+0000 7fd73a3e2640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:29:26.839 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.834+0000 7fd73a3e2640 1 -- 172.21.15.52:0/2343508266 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7340ac630 con 0x7fd7340a8770 2023-11-05T08:29:26.839 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.834+0000 7fd730ff9640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:29:26.840 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.834+0000 7fd730ff9640 1 -- 172.21.15.52:0/2343508266 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd72403d6b0 con 0x7fd7340a8770 2023-11-05T08:29:26.840 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.834+0000 7fd730ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:29:26.840 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.834+0000 7fd730ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-05T08:29:26.840 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.834+0000 7fd730ff9640 10 monclient: dump: 2023-11-05T08:29:26.840 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:29:26.841 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:26.841 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:26.841 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:26.841 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:29:26.841 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:26.842 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:29:26.842 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:29:26.842 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:29:26.842 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:26.842 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.834+0000 7fd73a3e2640 10 client.20704.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-05T08:29:26.842 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.834+0000 7fd73a3e2640 10 monclient: _renew_subs 2023-11-05T08:29:26.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.834+0000 7fd73a3e2640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:29:26.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.834+0000 7fd7327fc640 4 set_mon_vals no callback set 2023-11-05T08:29:26.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.834+0000 7fd73a3e2640 1 -- 172.21.15.52:0/2343508266 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7340ab450 con 0x7fd7340a8770 2023-11-05T08:29:26.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.834+0000 7fd73a3e2640 1 librados: init done 2023-11-05T08:29:26.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.835+0000 7fd73a3e2640 10 client.20704.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:29:26.844 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.835+0000 7fd73a3e2640 15 client.20704.objecter _session_command_op_assign -1 1 2023-11-05T08:29:26.844 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.835+0000 7fd73a3e2640 20 client.20704.objecter _get_session osd=-1 returning homeless 2023-11-05T08:29:26.844 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.835+0000 7fd73a3e2640 10 client.20704.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-05T08:29:26.844 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.835+0000 7fd73a3e2640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:29:26.844 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.835+0000 7fd73a3e2640 1 -- 172.21.15.52:0/2343508266 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd7340b6140 con 0x7fd7340a8770 2023-11-05T08:29:26.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.864+0000 7fd730ff9640 1 -- 172.21.15.52:0/2343508266 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd72403a040 con 0x7fd7340a8770 2023-11-05T08:29:26.865 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.864+0000 7fd730ff9640 1 --2- 172.21.15.52:0/2343508266 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7fd72006c850 0x7fd72006ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:26.865 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.865+0000 7fd7337fe640 1 --2- 172.21.15.52:0/2343508266 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7fd72006c850 0x7fd72006ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:26.865 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.865+0000 7fd7337fe640 10 monclient: get_auth_request con 0x7fd72006c850 auth_method 0 2023-11-05T08:29:26.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.865+0000 7fd7337fe640 1 --2- 172.21.15.52:0/2343508266 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7fd72006c850 0x7fd72006ed10 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fd7340ad420 tx=0x7fd728009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:29:26.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.865+0000 7fd730ff9640 10 client.20704.objecter ms_handle_connect 0x7fd72006c850 2023-11-05T08:29:26.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.867+0000 7fd730ff9640 1 -- 172.21.15.52:0/2343508266 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(932..932 src has 619..932) v4 ==== 6193+0+0 (secure 0 0 0) 0x7fd72407b030 con 0x7fd7340a8770 2023-11-05T08:29:26.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.867+0000 7fd730ff9640 10 client.20704.objecter ms_dispatch 0x7fd734000b90 osd_map(932..932 src has 619..932) v4 2023-11-05T08:29:26.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.867+0000 7fd730ff9640 3 client.20704.objecter handle_osd_map got epochs [932,932] > 0 2023-11-05T08:29:26.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.867+0000 7fd730ff9640 3 client.20704.objecter handle_osd_map decoding full epoch 932 2023-11-05T08:29:26.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.867+0000 7fd730ff9640 10 client.20704.objecter checking command 1 2023-11-05T08:29:26.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.867+0000 7fd730ff9640 1 --2- 172.21.15.52:0/2343508266 >> [v2:172.21.15.52:6816/61703536,v1:172.21.15.52:6817/61703536] conn(0x7fd7200740a0 0x7fd720076540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:26.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.867+0000 7fd730ff9640 20 client.20704.objecter _get_session s=0x7fd7200739d0 osd=0 3 2023-11-05T08:29:26.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.867+0000 7fd730ff9640 20 client.20704.objecter put_session s=0x7fd7200739d0 osd=0 3 2023-11-05T08:29:26.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.867+0000 7fd730ff9640 15 client.20704.objecter _session_command_op_remove -1 1 2023-11-05T08:29:26.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.867+0000 7fd730ff9640 20 client.20704.objecter _get_session s=0x7fd7200739d0 osd=0 3 2023-11-05T08:29:26.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.867+0000 7fd730ff9640 20 client.20704.objecter get_session s=0x7fd7200739d0 osd=0 3 2023-11-05T08:29:26.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.867+0000 7fd730ff9640 15 client.20704.objecter _session_command_op_assign 0 1 2023-11-05T08:29:26.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.867+0000 7fd730ff9640 20 client.20704.objecter put_session s=0x7fd7200739d0 osd=0 4 2023-11-05T08:29:26.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.867+0000 7fd730ff9640 10 client.20704.objecter _send_command 1 2023-11-05T08:29:26.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.867+0000 7fd730ff9640 1 -- 172.21.15.52:0/2343508266 --> [v2:172.21.15.52:6816/61703536,v1:172.21.15.52:6817/61703536] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd720076c10 con 0x7fd7200740a0 2023-11-05T08:29:26.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.867+0000 7fd730ff9640 20 client.20704.objecter dump_active .. 0 homeless 2023-11-05T08:29:26.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.867+0000 7fd730ff9640 1 -- 172.21.15.52:0/2343508266 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_get_version_reply(handle=1 version=932) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd724076c70 con 0x7fd7340a8770 2023-11-05T08:29:26.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.867+0000 7fd730ff9640 10 monclient: handle_get_version_reply finishing 1 version 932 2023-11-05T08:29:26.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.868+0000 7fd73897f640 1 --2- 172.21.15.52:0/2343508266 >> [v2:172.21.15.52:6816/61703536,v1:172.21.15.52:6817/61703536] conn(0x7fd7200740a0 0x7fd720076540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:26.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.870+0000 7fd73897f640 10 monclient: get_auth_request con 0x7fd7200740a0 auth_method 0 2023-11-05T08:29:26.874 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.873+0000 7fd730ff9640 10 client.20704.objecter ms_handle_connect 0x7fd7200740a0 2023-11-05T08:29:26.874 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.873+0000 7fd73897f640 1 --2- 172.21.15.52:0/2343508266 >> [v2:172.21.15.52:6816/61703536,v1:172.21.15.52:6817/61703536] conn(0x7fd7200740a0 0x7fd720076540 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:29:26.900 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.900+0000 7fd730ff9640 1 -- 172.21.15.52:0/2343508266 <== osd.0 v2:172.21.15.52:6816/61703536 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fd720076c10 con 0x7fd7200740a0 2023-11-05T08:29:26.900 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.900+0000 7fd730ff9640 10 client.20704.objecter ms_dispatch 0x7fd734000b90 command_reply(tid 1: 0 ) v1 2023-11-05T08:29:26.900 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.900+0000 7fd730ff9640 10 client.20704.objecter _finish_command 1 = system:0 2023-11-05T08:29:26.901 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.900+0000 7fd730ff9640 20 client.20704.objecter put_session s=0x7fd7200739d0 osd=0 4 2023-11-05T08:29:26.901 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.900+0000 7fd730ff9640 15 client.20704.objecter _session_command_op_remove 0 1 2023-11-05T08:29:26.922 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.922+0000 7fd73a3e2640 10 client.20704.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2023-11-05T08:29:26.923 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.922+0000 7fd73a3e2640 15 client.20704.objecter _session_command_op_assign -1 2 2023-11-05T08:29:26.923 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.922+0000 7fd73a3e2640 20 client.20704.objecter _get_session s=0x7fd7200739d0 osd=0 3 2023-11-05T08:29:26.923 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.922+0000 7fd73a3e2640 20 client.20704.objecter put_session s=0x7fd7200739d0 osd=0 3 2023-11-05T08:29:26.923 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.922+0000 7fd73a3e2640 20 client.20704.objecter _get_session s=0x7fd7200739d0 osd=0 3 2023-11-05T08:29:26.924 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.922+0000 7fd73a3e2640 15 client.20704.objecter _session_command_op_remove -1 2 2023-11-05T08:29:26.924 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.922+0000 7fd73a3e2640 20 client.20704.objecter get_session s=0x7fd7200739d0 osd=0 3 2023-11-05T08:29:26.924 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.922+0000 7fd73a3e2640 15 client.20704.objecter _session_command_op_assign 0 2 2023-11-05T08:29:26.924 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.922+0000 7fd73a3e2640 20 client.20704.objecter put_session s=0x7fd7200739d0 osd=0 4 2023-11-05T08:29:26.924 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.922+0000 7fd73a3e2640 10 client.20704.objecter _send_command 2 2023-11-05T08:29:26.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.922+0000 7fd73a3e2640 1 -- 172.21.15.52:0/2343508266 --> [v2:172.21.15.52:6816/61703536,v1:172.21.15.52:6817/61703536] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd734075530 con 0x7fd7200740a0 2023-11-05T08:29:26.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.937+0000 7fd730ff9640 1 -- 172.21.15.52:0/2343508266 <== osd.0 v2:172.21.15.52:6816/61703536 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fd734075530 con 0x7fd7200740a0 2023-11-05T08:29:26.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.937+0000 7fd730ff9640 10 client.20704.objecter ms_dispatch 0x7fd734000b90 command_reply(tid 2: 0 ) v1 2023-11-05T08:29:26.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.937+0000 7fd730ff9640 10 client.20704.objecter _finish_command 2 = system:0 2023-11-05T08:29:26.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.937+0000 7fd730ff9640 20 client.20704.objecter put_session s=0x7fd7200739d0 osd=0 4 2023-11-05T08:29:26.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.937+0000 7fd730ff9640 15 client.20704.objecter _session_command_op_remove 0 2 2023-11-05T08:29:26.939 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2023-11-05T08:29:26.939 INFO:teuthology.orchestra.run.smithi052.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-05T08:29:26.940 INFO:teuthology.orchestra.run.smithi052.stdout:} 2023-11-05T08:29:26.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.938+0000 7fd73a3e2640 10 librados: watch_flush enter 2023-11-05T08:29:26.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.938+0000 7fd73a3e2640 10 librados: watch_flush exit 2023-11-05T08:29:26.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.938+0000 7fd73a3e2640 10 client.20704.objecter close_session for osd.0 2023-11-05T08:29:26.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.938+0000 7fd73a3e2640 1 -- 172.21.15.52:0/2343508266 >> [v2:172.21.15.52:6816/61703536,v1:172.21.15.52:6817/61703536] conn(0x7fd7200740a0 msgr2=0x7fd720076540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:26.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.938+0000 7fd73a3e2640 1 --2- 172.21.15.52:0/2343508266 >> [v2:172.21.15.52:6816/61703536,v1:172.21.15.52:6817/61703536] conn(0x7fd7200740a0 0x7fd720076540 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:26.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.938+0000 7fd73a3e2640 20 client.20704.objecter put_session s=0x7fd7200739d0 osd=0 1 2023-11-05T08:29:26.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.938+0000 7fd73a3e2640 20 client.20704.objecter shutdown clearing up homeless session... 2023-11-05T08:29:26.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.938+0000 7fd73a3e2640 10 client.20704.objecter successfully canceled tick 2023-11-05T08:29:26.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.938+0000 7fd73a3e2640 1 -- 172.21.15.52:0/2343508266 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7fd72006c850 msgr2=0x7fd72006ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:26.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.938+0000 7fd73a3e2640 1 --2- 172.21.15.52:0/2343508266 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7fd72006c850 0x7fd72006ed10 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fd7340ad420 tx=0x7fd728009190 comp rx=0 tx=0).stop 2023-11-05T08:29:26.944 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.938+0000 7fd73a3e2640 10 monclient: shutdown 2023-11-05T08:29:26.944 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.938+0000 7fd73a3e2640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:29:26.944 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.938+0000 7fd73a3e2640 1 -- 172.21.15.52:0/2343508266 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd7340a8770 msgr2=0x7fd7340ac0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:26.944 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.938+0000 7fd73a3e2640 1 --2- 172.21.15.52:0/2343508266 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd7340a8770 0x7fd7340ac0f0 secure :-1 s=READY pgs=5000 cs=0 l=1 rev1=1 crypto rx=0x7fd724033000 tx=0x7fd7240046c0 comp rx=0 tx=0).stop 2023-11-05T08:29:26.944 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.938+0000 7fd73897f640 1 -- 172.21.15.52:0/2343508266 reap_dead start 2023-11-05T08:29:26.945 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.938+0000 7fd73a3e2640 1 -- 172.21.15.52:0/2343508266 shutdown_connections 2023-11-05T08:29:26.945 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.938+0000 7fd73a3e2640 1 -- 172.21.15.52:0/2343508266 >> 172.21.15.52:0/2343508266 conn(0x7fd734065ee0 msgr2=0x7fd73413e130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:29:26.945 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.938+0000 7fd73a3e2640 1 -- 172.21.15.52:0/2343508266 shutdown_connections 2023-11-05T08:29:26.945 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.938+0000 7fd73a3e2640 1 -- 172.21.15.52:0/2343508266 wait complete. 2023-11-05T08:29:26.946 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:26.938+0000 7fd73a3e2640 1 librados: shutdown 2023-11-05T08:29:26.951 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-11-05T08:29:27.062 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.062+0000 7f9a3a968640 10 monclient: get_monmap_and_config 2023-11-05T08:29:27.063 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.062+0000 7f9a3a968640 10 monclient: build_initial_monmap 2023-11-05T08:29:27.063 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.062+0000 7f9a3a968640 10 monclient: monmap: 2023-11-05T08:29:27.063 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:29:27.063 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:27.063 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:29:27.063126+0000 2023-11-05T08:29:27.064 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:29:27.063126+0000 2023-11-05T08:29:27.064 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:29:27.064 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:27.064 INFO:teuthology.orchestra.run.smithi052.stderr:0: v1:172.21.15.52:6789/0 mon.noname-a-legacy 2023-11-05T08:29:27.064 INFO:teuthology.orchestra.run.smithi052.stderr:1: v1:172.21.15.156:6789/0 mon.noname-c-legacy 2023-11-05T08:29:27.065 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-b 2023-11-05T08:29:27.065 INFO:teuthology.orchestra.run.smithi052.stderr:3: v2:172.21.15.52:3300/0 mon.noname-a 2023-11-05T08:29:27.065 INFO:teuthology.orchestra.run.smithi052.stderr:4: v2:172.21.15.156:3300/0 mon.noname-c 2023-11-05T08:29:27.065 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:27.066 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.063+0000 7f9a3a968640 1 Processor -- start 2023-11-05T08:29:27.067 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.063+0000 7f9a3a968640 1 -- start start 2023-11-05T08:29:27.067 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.063+0000 7f9a3a968640 10 monclient: init 2023-11-05T08:29:27.067 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.063+0000 7f9a3a968640 10 monclient: _reopen_session rank -1 2023-11-05T08:29:27.067 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.063+0000 7f9a3a968640 10 monclient: _add_conns ranks=[3,4,0,2,1] 2023-11-05T08:29:27.067 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.063+0000 7f9a3a968640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9a340a8ae0 0x7f9a3413ec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:27.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.064+0000 7f9a3a968640 10 monclient(hunting): picked mon.noname-a con 0x7f9a340a8ae0 addr v2:172.21.15.52:3300/0 2023-11-05T08:29:27.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.064+0000 7f9a3a968640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f9a340a8ec0 0x7f9a3413f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:27.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.064+0000 7f9a3a968640 10 monclient(hunting): picked mon.noname-c con 0x7f9a340a8ec0 addr v2:172.21.15.156:3300/0 2023-11-05T08:29:27.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.064+0000 7f9a3a968640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f9a340b0de0 addr v1:172.21.15.52:6789/0 2023-11-05T08:29:27.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.064+0000 7f9a3a968640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a340a9600 con 0x7f9a340b0de0 2023-11-05T08:29:27.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.064+0000 7f9a3a968640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:27.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.064+0000 7f9a3a968640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a340a9360 con 0x7f9a340a8ae0 2023-11-05T08:29:27.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.064+0000 7f9a3a968640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:27.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.064+0000 7f9a3a968640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a340b80b0 con 0x7f9a340a8ec0 2023-11-05T08:29:27.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.064+0000 7f9a3a968640 10 monclient(hunting): _renew_subs 2023-11-05T08:29:27.070 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.064+0000 7f9a3a968640 10 monclient(hunting): authenticate will time out at 2713.268992s 2023-11-05T08:29:27.070 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.070+0000 7f9a337fe640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f9a340a8ec0 0x7f9a3413f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:27.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.072+0000 7f9a337fe640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f9a340a8ec0 0x7f9a3413f170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.52:34468/0 (socket says 172.21.15.52:34468) 2023-11-05T08:29:27.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.072+0000 7f9a337fe640 1 -- 172.21.15.52:0/2887045435 learned_addr learned my addr 172.21.15.52:0/2887045435 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-11-05T08:29:27.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.072+0000 7f9a337fe640 10 monclient(hunting): get_auth_request con 0x7f9a340a8ec0 auth_method 0 2023-11-05T08:29:27.074 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.072+0000 7f9a337fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:29:27.074 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.072+0000 7f9a337fe640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:29:27.074 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.072+0000 7f9a337fe640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:29:27.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.075+0000 7f9a337fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:29:27.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.075+0000 7f9a337fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:29:27.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.075+0000 7f9a337fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:29:27.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.078+0000 7f9a337fe640 10 monclient(hunting): handle_auth_done global_id 20707 payload 274 2023-11-05T08:29:27.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.078+0000 7f9a337fe640 1 -- 172.21.15.52:0/2887045435 >> v2:172.21.15.52:3300/0 conn(0x7f9a340a8ae0 msgr2=0x7f9a3413ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-05T08:29:27.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.078+0000 7f9a337fe640 1 --2- 172.21.15.52:0/2887045435 >> v2:172.21.15.52:3300/0 conn(0x7f9a340a8ae0 0x7f9a3413ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:27.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.078+0000 7f9a337fe640 1 -- 172.21.15.52:0/2887045435 >> v1:172.21.15.52:6789/0 conn(0x7f9a340b0de0 legacy=0x7f9a34145000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-05T08:29:27.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.078+0000 7f9a337fe640 10 monclient: _finish_hunting 0 2023-11-05T08:29:27.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.078+0000 7f9a337fe640 1 monclient: found mon.noname-c 2023-11-05T08:29:27.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.078+0000 7f9a337fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:29:27.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.078+0000 7f9a337fe640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.156:3300/0 2023-11-05T08:29:27.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.078+0000 7f9a337fe640 1 -- 172.21.15.52:0/2887045435 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a34145710 con 0x7f9a340a8ec0 2023-11-05T08:29:27.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.086+0000 7f9a337fe640 1 --2- 172.21.15.52:0/2887045435 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9a340a8ec0 0x7f9a3413f170 secure :-1 s=READY pgs=5001 cs=0 l=1 rev1=1 crypto rx=0x7f9a341418b0 tx=0x7f9a2802b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ff5290e98e0979ad server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:29:27.106 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.106+0000 7f9a32ffd640 1 -- 172.21.15.52:0/2887045435 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a28031870 con 0x7f9a340a8ec0 2023-11-05T08:29:27.107 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.106+0000 7f9a32ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:29:27.107 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.106+0000 7f9a32ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-11-05T08:29:27.107 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.106+0000 7f9a32ffd640 10 monclient: dump: 2023-11-05T08:29:27.107 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:29:27.108 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:27.108 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:27.108 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:27.108 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:29:27.108 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:27.109 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:29:27.109 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:29:27.109 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:29:27.109 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:27.109 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.106+0000 7f9a32ffd640 10 monclient: _finish_auth 0 2023-11-05T08:29:27.110 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.106+0000 7f9a32ffd640 10 monclient: _check_auth_tickets 2023-11-05T08:29:27.110 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.106+0000 7f9a32ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:29:27.110 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.106+0000 7f9a32ffd640 1 -- 172.21.15.52:0/2887045435 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a280319d0 con 0x7f9a340a8ec0 2023-11-05T08:29:27.110 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.106+0000 7f9a32ffd640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:29:27.110 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.106+0000 7f9a32ffd640 1 -- 172.21.15.52:0/2887045435 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a28031d60 con 0x7f9a340a8ec0 2023-11-05T08:29:27.111 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.106+0000 7f9a3a968640 5 monclient: authenticate success, global_id 20707 2023-11-05T08:29:27.111 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.106+0000 7f9a3a968640 10 monclient: get_monmap_and_config success 2023-11-05T08:29:27.111 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.106+0000 7f9a32ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:29:27.111 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.106+0000 7f9a3a968640 4 set_mon_vals no callback set 2023-11-05T08:29:27.111 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.106+0000 7f9a32ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-05T08:29:27.111 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.106+0000 7f9a32ffd640 10 monclient: dump: 2023-11-05T08:29:27.112 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:29:27.112 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:27.112 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:27.112 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:27.112 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:29:27.113 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:27.113 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:29:27.113 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:29:27.113 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:29:27.113 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:27.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.107+0000 7f9a3a968640 10 monclient: shutdown 2023-11-05T08:29:27.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.107+0000 7f9a3a968640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:29:27.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.107+0000 7f9a3a968640 1 -- 172.21.15.52:0/2887045435 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9a340a8ec0 msgr2=0x7f9a3413f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:27.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.107+0000 7f9a3a968640 1 --2- 172.21.15.52:0/2887045435 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9a340a8ec0 0x7f9a3413f170 secure :-1 s=READY pgs=5001 cs=0 l=1 rev1=1 crypto rx=0x7f9a341418b0 tx=0x7f9a2802b910 comp rx=0 tx=0).stop 2023-11-05T08:29:27.117 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.107+0000 7f9a3a968640 1 -- 172.21.15.52:0/2887045435 shutdown_connections 2023-11-05T08:29:27.117 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.107+0000 7f9a3a968640 1 --2- 172.21.15.52:0/2887045435 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9a340a8ec0 0x7f9a3413f170 unknown :-1 s=CLOSED pgs=5001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:27.117 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.107+0000 7f9a3a968640 1 --2- 172.21.15.52:0/2887045435 >> v2:172.21.15.52:3300/0 conn(0x7f9a340a8ae0 0x7f9a3413ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:27.117 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.107+0000 7f9a3a968640 1 -- 172.21.15.52:0/2887045435 >> 172.21.15.52:0/2887045435 conn(0x7f9a340b7230 msgr2=0x7f9a340b7610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:29:27.117 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.107+0000 7f9a3a968640 1 -- 172.21.15.52:0/2887045435 shutdown_connections 2023-11-05T08:29:27.118 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.107+0000 7f9a3a968640 1 -- 172.21.15.52:0/2887045435 wait complete. 2023-11-05T08:29:27.118 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.108+0000 7f9a3a968640 10 monclient: build_initial_monmap 2023-11-05T08:29:27.118 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.108+0000 7f9a3a968640 10 monclient: monmap: 2023-11-05T08:29:27.118 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:29:27.118 INFO:teuthology.orchestra.run.smithi052.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-05T08:29:27.119 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 0.000000 2023-11-05T08:29:27.119 INFO:teuthology.orchestra.run.smithi052.stderr:created 0.000000 2023-11-05T08:29:27.119 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:29:27.119 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:27.119 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.noname-a 2023-11-05T08:29:27.120 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.noname-b 2023-11-05T08:29:27.120 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-c 2023-11-05T08:29:27.120 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:27.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.108+0000 7f9a3a968640 1 librados: starting msgr at 2023-11-05T08:29:27.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.108+0000 7f9a3a968640 1 librados: starting objecter 2023-11-05T08:29:27.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.108+0000 7f9a3a968640 1 Processor -- start 2023-11-05T08:29:27.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.108+0000 7f9a3a968640 1 -- start start 2023-11-05T08:29:27.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.108+0000 7f9a3a968640 1 librados: setting wanted keys 2023-11-05T08:29:27.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.108+0000 7f9a3a968640 1 librados: calling monclient init 2023-11-05T08:29:27.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.108+0000 7f9a3a968640 10 monclient: init 2023-11-05T08:29:27.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.109+0000 7f9a3a968640 10 monclient: _reopen_session rank -1 2023-11-05T08:29:27.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.109+0000 7f9a3a968640 10 monclient: _add_conns ranks=[1,2,0] 2023-11-05T08:29:27.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.109+0000 7f9a3a968640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9a340a8ae0 0x7f9a341445c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:27.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.109+0000 7f9a3a968640 10 monclient(hunting): picked mon.noname-b con 0x7f9a340a8ae0 addr [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] 2023-11-05T08:29:27.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.109+0000 7f9a3a968640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9a340a8ec0 0x7f9a34137750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:27.123 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.109+0000 7f9a3a968640 10 monclient(hunting): picked mon.noname-c con 0x7f9a340a8ec0 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:29:27.123 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.109+0000 7f9a3a968640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a340b0de0 0x7f9a341d6650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:27.123 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.109+0000 7f9a3a968640 10 monclient(hunting): picked mon.noname-a con 0x7f9a340b0de0 addr [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] 2023-11-05T08:29:27.123 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.109+0000 7f9a3a968640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:27.123 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.109+0000 7f9a3a968640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a341380a0 con 0x7f9a340b0de0 2023-11-05T08:29:27.124 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.109+0000 7f9a3a968640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:27.124 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.109+0000 7f9a3a968640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a341420d0 con 0x7f9a340a8ae0 2023-11-05T08:29:27.124 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.109+0000 7f9a3a968640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:27.124 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.109+0000 7f9a3a968640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a3413b6c0 con 0x7f9a340a8ec0 2023-11-05T08:29:27.124 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.109+0000 7f9a3a968640 10 monclient(hunting): _renew_subs 2023-11-05T08:29:27.125 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.109+0000 7f9a3a968640 10 monclient(hunting): authenticate will time out at 2713.314474s 2023-11-05T08:29:27.125 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.113+0000 7f9a337fe640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9a340a8ec0 0x7f9a34137750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:27.125 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.113+0000 7f9a38f05640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a340b0de0 0x7f9a341d6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:27.125 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.114+0000 7f9a38f05640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a340b0de0 0x7f9a341d6650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59976/0 (socket says 172.21.15.52:59976) 2023-11-05T08:29:27.125 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.114+0000 7f9a38f05640 1 -- 172.21.15.52:0/32619652 learned_addr learned my addr 172.21.15.52:0/32619652 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-11-05T08:29:27.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.114+0000 7f9a38f05640 10 monclient(hunting): get_auth_request con 0x7f9a340b0de0 auth_method 0 2023-11-05T08:29:27.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.114+0000 7f9a38f05640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:29:27.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.114+0000 7f9a38f05640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:29:27.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.114+0000 7f9a38f05640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:29:27.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.117+0000 7f9a38f05640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:29:27.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.117+0000 7f9a38f05640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:29:27.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.117+0000 7f9a38f05640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:29:27.129 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.117+0000 7f9a337fe640 10 monclient(hunting): get_auth_request con 0x7f9a340a8ec0 auth_method 0 2023-11-05T08:29:27.129 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.117+0000 7f9a337fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:29:27.129 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.117+0000 7f9a337fe640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:29:27.129 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.117+0000 7f9a337fe640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:29:27.129 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.118+0000 7f9a337fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:29:27.130 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.118+0000 7f9a337fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:29:27.130 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.118+0000 7f9a337fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:29:27.130 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.119+0000 7f9a33fff640 1 --2- 172.21.15.52:0/32619652 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9a340a8ae0 0x7f9a341445c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:27.130 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.120+0000 7f9a33fff640 10 monclient(hunting): get_auth_request con 0x7f9a340a8ae0 auth_method 0 2023-11-05T08:29:27.130 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.121+0000 7f9a33fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:29:27.131 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.121+0000 7f9a33fff640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:29:27.131 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.121+0000 7f9a33fff640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:29:27.131 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.122+0000 7f9a33fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:29:27.131 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.122+0000 7f9a33fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:29:27.131 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.122+0000 7f9a33fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:29:27.132 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.122+0000 7f9a38f05640 10 monclient(hunting): handle_auth_done global_id 15699 payload 824 2023-11-05T08:29:27.132 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.122+0000 7f9a38f05640 1 -- 172.21.15.52:0/32619652 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9a340a8ec0 msgr2=0x7f9a34137750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:27.132 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.122+0000 7f9a38f05640 1 --2- 172.21.15.52:0/32619652 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9a340a8ec0 0x7f9a34137750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:27.132 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.122+0000 7f9a38f05640 1 -- 172.21.15.52:0/32619652 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9a340a8ae0 msgr2=0x7f9a341445c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:27.132 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.122+0000 7f9a38f05640 1 --2- 172.21.15.52:0/32619652 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9a340a8ae0 0x7f9a341445c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:27.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.122+0000 7f9a38f05640 10 monclient: _finish_hunting 0 2023-11-05T08:29:27.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.122+0000 7f9a38f05640 1 monclient: found mon.noname-a 2023-11-05T08:29:27.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.122+0000 7f9a38f05640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:29:27.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.122+0000 7f9a38f05640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.52:3300/0 2023-11-05T08:29:27.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.122+0000 7f9a38f05640 1 -- 172.21.15.52:0/32619652 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a280094d0 con 0x7f9a340b0de0 2023-11-05T08:29:27.134 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.129+0000 7f9a38f05640 1 --2- 172.21.15.52:0/32619652 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a340b0de0 0x7f9a341d6650 secure :-1 s=READY pgs=3048 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c00b990 tx=0x7f9a2c00be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:29:27.134 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.129+0000 7f9a30ff9640 10 client.?.objecter ms_handle_connect 0x7f9a340b0de0 2023-11-05T08:29:27.134 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.129+0000 7f9a30ff9640 10 client.?.objecter resend_mon_ops 2023-11-05T08:29:27.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.138+0000 7f9a30ff9640 1 -- 172.21.15.52:0/32619652 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2c00cba0 con 0x7f9a340b0de0 2023-11-05T08:29:27.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.138+0000 7f9a30ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:29:27.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.138+0000 7f9a30ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-11-05T08:29:27.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.138+0000 7f9a30ff9640 10 monclient: dump: 2023-11-05T08:29:27.139 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:29:27.140 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:27.140 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:27.140 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:27.140 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:29:27.140 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:27.140 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:29:27.141 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:29:27.141 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:29:27.141 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:27.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.138+0000 7f9a30ff9640 10 monclient: _finish_auth 0 2023-11-05T08:29:27.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.138+0000 7f9a30ff9640 10 monclient: _check_auth_tickets 2023-11-05T08:29:27.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.138+0000 7f9a30ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:29:27.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.138+0000 7f9a30ff9640 1 -- 172.21.15.52:0/32619652 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a2c00cd00 con 0x7f9a340b0de0 2023-11-05T08:29:27.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.138+0000 7f9a3a968640 5 monclient: authenticate success, global_id 15699 2023-11-05T08:29:27.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.138+0000 7f9a3a968640 10 monclient: _renew_subs 2023-11-05T08:29:27.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.138+0000 7f9a3a968640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.52:3300/0 2023-11-05T08:29:27.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.138+0000 7f9a3a968640 1 -- 172.21.15.52:0/32619652 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a34140b60 con 0x7f9a340b0de0 2023-11-05T08:29:27.144 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.138+0000 7f9a30ff9640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:29:27.144 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.138+0000 7f9a30ff9640 1 -- 172.21.15.52:0/32619652 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2c014680 con 0x7f9a340b0de0 2023-11-05T08:29:27.144 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.138+0000 7f9a30ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:29:27.144 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.138+0000 7f9a30ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-11-05T08:29:27.144 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.138+0000 7f9a30ff9640 10 monclient: dump: 2023-11-05T08:29:27.145 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:29:27.145 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:27.145 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:27.145 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:27.145 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:29:27.146 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:27.146 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:29:27.146 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:29:27.146 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:29:27.147 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:27.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.138+0000 7f9a327fc640 4 set_mon_vals no callback set 2023-11-05T08:29:27.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.138+0000 7f9a3a968640 10 client.15699.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-05T08:29:27.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.138+0000 7f9a3a968640 10 monclient: _renew_subs 2023-11-05T08:29:27.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.138+0000 7f9a3a968640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.52:3300/0 2023-11-05T08:29:27.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.138+0000 7f9a3a968640 1 -- 172.21.15.52:0/32619652 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a341d6b90 con 0x7f9a340b0de0 2023-11-05T08:29:27.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.138+0000 7f9a3a968640 1 librados: init done 2023-11-05T08:29:27.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.139+0000 7f9a3a968640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-05T08:29:27.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.139+0000 7f9a3a968640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:29:27.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.139+0000 7f9a3a968640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.52:3300/0 2023-11-05T08:29:27.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.139+0000 7f9a3a968640 1 -- 172.21.15.52:0/32619652 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a34142280 con 0x7f9a340b0de0 2023-11-05T08:29:27.238 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:23:30.313 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:29:27.239 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:23:30.314 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:29:27.247 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:23:30.322 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:29:27.281 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:23:30.397 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:29:27.282 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:23:30.398 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:29:27.290 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:23:30.406 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:29:27.421 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.420+0000 7f9a30ff9640 1 -- 172.21.15.52:0/32619652 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f9a2c01d3b0 con 0x7f9a340b0de0 2023-11-05T08:29:27.421 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.421+0000 7f9a30ff9640 1 --2- 172.21.15.52:0/32619652 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f9a2006c850 0x7f9a2006ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:27.422 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.421+0000 7f9a33fff640 1 --2- 172.21.15.52:0/32619652 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f9a2006c850 0x7f9a2006ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:27.422 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.421+0000 7f9a33fff640 10 monclient: get_auth_request con 0x7f9a2006c850 auth_method 0 2023-11-05T08:29:27.422 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.422+0000 7f9a33fff640 1 --2- 172.21.15.52:0/32619652 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f9a2006c850 0x7f9a2006ed10 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f9a24009970 tx=0x7f9a24009110 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:29:27.423 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.422+0000 7f9a30ff9640 10 client.15699.objecter ms_handle_connect 0x7f9a2006c850 2023-11-05T08:29:27.437 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.437+0000 7f9a30ff9640 1 -- 172.21.15.52:0/32619652 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(932..932 src has 619..932) v4 ==== 6193+0+0 (secure 0 0 0) 0x7f9a2c058930 con 0x7f9a340b0de0 2023-11-05T08:29:27.437 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.437+0000 7f9a30ff9640 10 client.15699.objecter ms_dispatch 0x7f9a34000b90 osd_map(932..932 src has 619..932) v4 2023-11-05T08:29:27.437 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.437+0000 7f9a30ff9640 3 client.15699.objecter handle_osd_map got epochs [932,932] > 0 2023-11-05T08:29:27.438 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.437+0000 7f9a30ff9640 3 client.15699.objecter handle_osd_map decoding full epoch 932 2023-11-05T08:29:27.438 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.437+0000 7f9a30ff9640 20 client.15699.objecter dump_active .. 0 homeless 2023-11-05T08:29:27.438 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.437+0000 7f9a30ff9640 1 -- 172.21.15.52:0/32619652 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9a2c054c70 con 0x7f9a340b0de0 2023-11-05T08:29:27.438 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.437+0000 7f9a30ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:29:27.438 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.437+0000 7f9a30ff9640 10 monclient: _finish_command 1 = system:0 2023-11-05T08:29:27.594 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:23:30.710 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:29:27.595 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:23:30.711 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:29:27.604 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:23:30.719 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:29:27.622 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.622+0000 7f9a3a968640 1 -- 172.21.15.52:0/32619652 --> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f9a3414c1c0 con 0x7f9a2006c850 2023-11-05T08:29:27.622 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.622+0000 7f9a30ff9640 1 -- 172.21.15.52:0/32619652 <== mgr.4108 v2:172.21.15.156:6800/3320012339 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f9a240095c0 con 0x7f9a2006c850 2023-11-05T08:29:27.623 INFO:teuthology.orchestra.run.smithi052.stderr:instructed osd(s) 0 to deep-scrub 2023-11-05T08:29:27.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.624+0000 7f9a3a968640 10 librados: watch_flush enter 2023-11-05T08:29:27.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.624+0000 7f9a3a968640 10 librados: watch_flush exit 2023-11-05T08:29:27.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.624+0000 7f9a3a968640 20 client.15699.objecter shutdown clearing up homeless session... 2023-11-05T08:29:27.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.624+0000 7f9a3a968640 10 client.15699.objecter successfully canceled tick 2023-11-05T08:29:27.626 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.624+0000 7f9a3a968640 1 -- 172.21.15.52:0/32619652 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f9a2006c850 msgr2=0x7f9a2006ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:27.626 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.624+0000 7f9a3a968640 1 --2- 172.21.15.52:0/32619652 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f9a2006c850 0x7f9a2006ed10 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f9a24009970 tx=0x7f9a24009110 comp rx=0 tx=0).stop 2023-11-05T08:29:27.626 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.624+0000 7f9a3a968640 10 monclient: shutdown 2023-11-05T08:29:27.626 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.624+0000 7f9a3a968640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:29:27.626 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.624+0000 7f9a3a968640 1 -- 172.21.15.52:0/32619652 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a340b0de0 msgr2=0x7f9a341d6650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:27.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.624+0000 7f9a3a968640 1 --2- 172.21.15.52:0/32619652 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a340b0de0 0x7f9a341d6650 secure :-1 s=READY pgs=3048 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c00b990 tx=0x7f9a2c00be50 comp rx=0 tx=0).stop 2023-11-05T08:29:27.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.624+0000 7f9a3a968640 1 -- 172.21.15.52:0/32619652 shutdown_connections 2023-11-05T08:29:27.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.624+0000 7f9a3a968640 1 --2- 172.21.15.52:0/32619652 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f9a2006c850 0x7f9a2006ed10 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:27.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.624+0000 7f9a3a968640 1 --2- 172.21.15.52:0/32619652 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a340b0de0 0x7f9a341d6650 unknown :-1 s=CLOSED pgs=3048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:27.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.624+0000 7f9a3a968640 1 --2- 172.21.15.52:0/32619652 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9a340a8ec0 0x7f9a34137750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:27.628 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.624+0000 7f9a3a968640 1 --2- 172.21.15.52:0/32619652 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9a340a8ae0 0x7f9a341445c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:27.628 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.624+0000 7f9a3a968640 1 -- 172.21.15.52:0/32619652 >> 172.21.15.52:0/32619652 conn(0x7f9a340b7230 msgr2=0x7f9a340b7610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:29:27.628 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.624+0000 7f9a3a968640 1 -- 172.21.15.52:0/32619652 shutdown_connections 2023-11-05T08:29:27.628 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.624+0000 7f9a3a968640 1 -- 172.21.15.52:0/32619652 wait complete. 2023-11-05T08:29:27.628 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.624+0000 7f9a3a968640 1 librados: shutdown 2023-11-05T08:29:27.636 INFO:tasks.ceph:Scrubbing osd.1 2023-11-05T08:29:27.637 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-11-05T08:29:27.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.747+0000 7ff464d33640 10 monclient: get_monmap_and_config 2023-11-05T08:29:27.748 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.747+0000 7ff464d33640 10 monclient: build_initial_monmap 2023-11-05T08:29:27.748 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.747+0000 7ff464d33640 10 monclient: monmap: 2023-11-05T08:29:27.748 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:29:27.748 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:27.749 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:29:27.748221+0000 2023-11-05T08:29:27.749 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:29:27.748221+0000 2023-11-05T08:29:27.749 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:29:27.749 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:27.749 INFO:teuthology.orchestra.run.smithi052.stderr:0: v1:172.21.15.52:6789/0 mon.noname-a-legacy 2023-11-05T08:29:27.750 INFO:teuthology.orchestra.run.smithi052.stderr:1: v1:172.21.15.156:6789/0 mon.noname-c-legacy 2023-11-05T08:29:27.750 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-b 2023-11-05T08:29:27.750 INFO:teuthology.orchestra.run.smithi052.stderr:3: v2:172.21.15.52:3300/0 mon.noname-a 2023-11-05T08:29:27.750 INFO:teuthology.orchestra.run.smithi052.stderr:4: v2:172.21.15.156:3300/0 mon.noname-c 2023-11-05T08:29:27.750 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:27.752 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.748+0000 7ff464d33640 1 Processor -- start 2023-11-05T08:29:27.752 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.748+0000 7ff464d33640 1 -- start start 2023-11-05T08:29:27.752 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.748+0000 7ff464d33640 10 monclient: init 2023-11-05T08:29:27.752 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.749+0000 7ff464d33640 10 monclient: _reopen_session rank -1 2023-11-05T08:29:27.753 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.749+0000 7ff464d33640 10 monclient: _add_conns ranks=[0,2,3,1,4] 2023-11-05T08:29:27.753 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.749+0000 7ff464d33640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7ff4600b42c0 addr v1:172.21.15.52:6789/0 2023-11-05T08:29:27.753 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.749+0000 7ff464d33640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff4600a8770 0x7ff46013f300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:27.753 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.749+0000 7ff464d33640 10 monclient(hunting): picked mon.noname-b con 0x7ff4600a8770 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:29:27.753 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.749+0000 7ff464d33640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff4600a9210 0x7ff460144f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:27.754 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.749+0000 7ff464d33640 10 monclient(hunting): picked mon.noname-a con 0x7ff4600a9210 addr v2:172.21.15.52:3300/0 2023-11-05T08:29:27.754 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.749+0000 7ff464d33640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4600a8d00 con 0x7ff4600b42c0 2023-11-05T08:29:27.754 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.749+0000 7ff464d33640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:27.754 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.749+0000 7ff464d33640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4600b46a0 con 0x7ff4600a9210 2023-11-05T08:29:27.754 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.749+0000 7ff464d33640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:27.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.749+0000 7ff464d33640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4600ade80 con 0x7ff4600a8770 2023-11-05T08:29:27.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.749+0000 7ff464d33640 10 monclient(hunting): _renew_subs 2023-11-05T08:29:27.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.749+0000 7ff464d33640 10 monclient(hunting): authenticate will time out at 2713.954551s 2023-11-05T08:29:27.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.752+0000 7ff457fff640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff4600a8770 0x7ff46013f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:27.756 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.752+0000 7ff457fff640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff4600a8770 0x7ff46013f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.52:59692/0 (socket says 172.21.15.52:59692) 2023-11-05T08:29:27.756 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.752+0000 7ff457fff640 1 -- 172.21.15.52:0/2073116325 learned_addr learned my addr 172.21.15.52:0/2073116325 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-11-05T08:29:27.757 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.752+0000 7ff457fff640 10 monclient(hunting): get_auth_request con 0x7ff4600a8770 auth_method 0 2023-11-05T08:29:27.757 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.752+0000 7ff457fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:29:27.757 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.752+0000 7ff457fff640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:29:27.757 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.752+0000 7ff457fff640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:29:27.758 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.754+0000 7ff457fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:29:27.758 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.754+0000 7ff457fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:29:27.758 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.754+0000 7ff457fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:29:27.758 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.756+0000 7ff457fff640 10 monclient(hunting): handle_auth_done global_id 16961 payload 274 2023-11-05T08:29:27.758 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.756+0000 7ff457fff640 1 -- 172.21.15.52:0/2073116325 >> v2:172.21.15.52:3300/0 conn(0x7ff4600a9210 msgr2=0x7ff460144f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-05T08:29:27.758 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.756+0000 7ff457fff640 1 --2- 172.21.15.52:0/2073116325 >> v2:172.21.15.52:3300/0 conn(0x7ff4600a9210 0x7ff460144f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:27.759 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.756+0000 7ff457fff640 1 -- 172.21.15.52:0/2073116325 >> v1:172.21.15.52:6789/0 conn(0x7ff4600b42c0 legacy=0x7ff46013ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-05T08:29:27.759 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.756+0000 7ff457fff640 10 monclient: _finish_hunting 0 2023-11-05T08:29:27.759 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.756+0000 7ff457fff640 1 monclient: found mon.noname-b 2023-11-05T08:29:27.759 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.756+0000 7ff457fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:29:27.759 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.756+0000 7ff457fff640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.52:3301/0 2023-11-05T08:29:27.760 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.756+0000 7ff457fff640 1 -- 172.21.15.52:0/2073116325 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4601454a0 con 0x7ff4600a8770 2023-11-05T08:29:27.760 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.760+0000 7ff457fff640 1 --2- 172.21.15.52:0/2073116325 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff4600a8770 0x7ff46013f300 secure :-1 s=READY pgs=3079 cs=0 l=1 rev1=1 crypto rx=0x7ff448009870 tx=0x7ff44802b7e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b3f3613b8f44892 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:29:27.769 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.768+0000 7ff45dd9b640 1 -- 172.21.15.52:0/2073116325 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff448031740 con 0x7ff4600a8770 2023-11-05T08:29:27.769 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.768+0000 7ff45dd9b640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:29:27.769 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.768+0000 7ff45dd9b640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-05T08:29:27.769 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.768+0000 7ff45dd9b640 10 monclient: dump: 2023-11-05T08:29:27.770 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:29:27.770 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:27.770 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:27.770 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:27.770 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:29:27.771 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:27.771 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:29:27.771 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:29:27.771 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:29:27.771 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:27.772 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.768+0000 7ff45dd9b640 10 monclient: _finish_auth 0 2023-11-05T08:29:27.772 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.768+0000 7ff45dd9b640 10 monclient: _check_auth_tickets 2023-11-05T08:29:27.772 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.768+0000 7ff45dd9b640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:29:27.772 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.768+0000 7ff45dd9b640 1 -- 172.21.15.52:0/2073116325 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4480318a0 con 0x7ff4600a8770 2023-11-05T08:29:27.772 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.768+0000 7ff464d33640 5 monclient: authenticate success, global_id 16961 2023-11-05T08:29:27.773 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.768+0000 7ff464d33640 20 monclient: get_monmap_and_config waiting for monmap|config 2023-11-05T08:29:27.773 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.768+0000 7ff45dd9b640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:29:27.773 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.768+0000 7ff464d33640 10 monclient: get_monmap_and_config success 2023-11-05T08:29:27.773 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.768+0000 7ff45dd9b640 1 -- 172.21.15.52:0/2073116325 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff448031c30 con 0x7ff4600a8770 2023-11-05T08:29:27.773 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.768+0000 7ff45dd9b640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:29:27.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.768+0000 7ff464d33640 4 set_mon_vals no callback set 2023-11-05T08:29:27.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.768+0000 7ff45dd9b640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-11-05T08:29:27.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.768+0000 7ff45dd9b640 10 monclient: dump: 2023-11-05T08:29:27.774 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:29:27.774 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:27.774 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:27.775 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:27.775 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:29:27.775 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:27.775 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:29:27.775 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:29:27.776 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:29:27.776 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:27.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.769+0000 7ff464d33640 10 monclient: shutdown 2023-11-05T08:29:27.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.769+0000 7ff464d33640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:29:27.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.769+0000 7ff464d33640 1 -- 172.21.15.52:0/2073116325 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff4600a8770 msgr2=0x7ff46013f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:27.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.769+0000 7ff464d33640 1 --2- 172.21.15.52:0/2073116325 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff4600a8770 0x7ff46013f300 secure :-1 s=READY pgs=3079 cs=0 l=1 rev1=1 crypto rx=0x7ff448009870 tx=0x7ff44802b7e0 comp rx=0 tx=0).stop 2023-11-05T08:29:27.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.769+0000 7ff464d33640 1 -- 172.21.15.52:0/2073116325 shutdown_connections 2023-11-05T08:29:27.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.769+0000 7ff464d33640 1 --2- 172.21.15.52:0/2073116325 >> v2:172.21.15.52:3300/0 conn(0x7ff4600a9210 0x7ff460144f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:27.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.769+0000 7ff464d33640 1 --2- 172.21.15.52:0/2073116325 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff4600a8770 0x7ff46013f300 unknown :-1 s=CLOSED pgs=3079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:27.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.769+0000 7ff464d33640 1 -- 172.21.15.52:0/2073116325 >> 172.21.15.52:0/2073116325 conn(0x7ff460065ee0 msgr2=0x7ff4600662f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:29:27.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.769+0000 7ff464d33640 1 -- 172.21.15.52:0/2073116325 shutdown_connections 2023-11-05T08:29:27.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.769+0000 7ff464d33640 1 -- 172.21.15.52:0/2073116325 wait complete. 2023-11-05T08:29:27.781 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.770+0000 7ff464d33640 10 monclient: build_initial_monmap 2023-11-05T08:29:27.781 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.770+0000 7ff464d33640 10 monclient: monmap: 2023-11-05T08:29:27.781 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:29:27.781 INFO:teuthology.orchestra.run.smithi052.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-05T08:29:27.781 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 0.000000 2023-11-05T08:29:27.782 INFO:teuthology.orchestra.run.smithi052.stderr:created 0.000000 2023-11-05T08:29:27.782 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:29:27.782 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:27.782 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.noname-a 2023-11-05T08:29:27.782 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.noname-b 2023-11-05T08:29:27.783 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-c 2023-11-05T08:29:27.783 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:27.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.770+0000 7ff464d33640 1 librados: starting msgr at 2023-11-05T08:29:27.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.770+0000 7ff464d33640 1 librados: starting objecter 2023-11-05T08:29:27.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.771+0000 7ff464d33640 1 Processor -- start 2023-11-05T08:29:27.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.771+0000 7ff464d33640 1 -- start start 2023-11-05T08:29:27.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.771+0000 7ff464d33640 1 librados: setting wanted keys 2023-11-05T08:29:27.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.771+0000 7ff464d33640 1 librados: calling monclient init 2023-11-05T08:29:27.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.771+0000 7ff464d33640 10 monclient: init 2023-11-05T08:29:27.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.771+0000 7ff464d33640 10 monclient: _reopen_session rank -1 2023-11-05T08:29:27.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.771+0000 7ff464d33640 10 monclient: _add_conns ranks=[2,1,0] 2023-11-05T08:29:27.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.771+0000 7ff464d33640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff4600a8770 0x7ff4600ab520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:27.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.771+0000 7ff464d33640 10 monclient(hunting): picked mon.noname-c con 0x7ff4600a8770 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:29:27.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.771+0000 7ff464d33640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff4600a9210 0x7ff4600b0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:27.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.771+0000 7ff464d33640 10 monclient(hunting): picked mon.noname-b con 0x7ff4600a9210 addr [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] 2023-11-05T08:29:27.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.771+0000 7ff464d33640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4600b42c0 0x7ff4600b0950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:27.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.771+0000 7ff464d33640 10 monclient(hunting): picked mon.noname-a con 0x7ff4600b42c0 addr [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] 2023-11-05T08:29:27.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.771+0000 7ff464d33640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:27.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.771+0000 7ff464d33640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4600b75d0 con 0x7ff4600b42c0 2023-11-05T08:29:27.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.771+0000 7ff464d33640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:27.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.771+0000 7ff464d33640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4600b0e90 con 0x7ff4600a9210 2023-11-05T08:29:27.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.771+0000 7ff464d33640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:27.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.771+0000 7ff464d33640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4600b7c90 con 0x7ff4600a8770 2023-11-05T08:29:27.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.771+0000 7ff464d33640 10 monclient(hunting): _renew_subs 2023-11-05T08:29:27.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.771+0000 7ff464d33640 10 monclient(hunting): authenticate will time out at 2713.976726s 2023-11-05T08:29:27.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.772+0000 7ff457fff640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff4600a9210 0x7ff4600b0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:27.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.772+0000 7ff457fff640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff4600a9210 0x7ff4600b0410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.52:34484/0 (socket says 172.21.15.52:34484) 2023-11-05T08:29:27.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.772+0000 7ff457fff640 1 -- 172.21.15.52:0/3324945874 learned_addr learned my addr 172.21.15.52:0/3324945874 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-11-05T08:29:27.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.772+0000 7ff457fff640 10 monclient(hunting): get_auth_request con 0x7ff4600a9210 auth_method 0 2023-11-05T08:29:27.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.772+0000 7ff457fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:29:27.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.772+0000 7ff457fff640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:29:27.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.772+0000 7ff457fff640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:29:27.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.773+0000 7ff457fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:29:27.789 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.773+0000 7ff457fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:29:27.789 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.773+0000 7ff457fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:29:27.789 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.776+0000 7ff45e59c640 1 --2- 172.21.15.52:0/3324945874 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff4600a8770 0x7ff4600ab520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:27.789 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.776+0000 7ff457fff640 10 monclient(hunting): handle_auth_done global_id 20713 payload 824 2023-11-05T08:29:27.790 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.776+0000 7ff457fff640 1 -- 172.21.15.52:0/3324945874 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff4600a8770 msgr2=0x7ff4600ab520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:27.790 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.776+0000 7ff457fff640 1 --2- 172.21.15.52:0/3324945874 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff4600a8770 0x7ff4600ab520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:27.790 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.776+0000 7ff457fff640 1 -- 172.21.15.52:0/3324945874 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4600b42c0 msgr2=0x7ff4600b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:27.790 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.776+0000 7ff457fff640 1 --2- 172.21.15.52:0/3324945874 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4600b42c0 0x7ff4600b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:27.790 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.776+0000 7ff457fff640 10 monclient: _finish_hunting 0 2023-11-05T08:29:27.791 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.776+0000 7ff457fff640 1 monclient: found mon.noname-b 2023-11-05T08:29:27.791 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.776+0000 7ff457fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:29:27.791 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.776+0000 7ff457fff640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.156:3300/0 2023-11-05T08:29:27.791 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.776+0000 7ff457fff640 1 -- 172.21.15.52:0/3324945874 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4480094d0 con 0x7ff4600a9210 2023-11-05T08:29:27.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.779+0000 7ff457fff640 1 --2- 172.21.15.52:0/3324945874 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff4600a9210 0x7ff4600b0410 secure :-1 s=READY pgs=5002 cs=0 l=1 rev1=1 crypto rx=0x7ff448000c00 tx=0x7ff4480046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:29:27.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.779+0000 7ff456ffd640 10 client.?.objecter ms_handle_connect 0x7ff4600a9210 2023-11-05T08:29:27.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.779+0000 7ff456ffd640 10 client.?.objecter resend_mon_ops 2023-11-05T08:29:27.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.786+0000 7ff456ffd640 1 -- 172.21.15.52:0/3324945874 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff448033c70 con 0x7ff4600a9210 2023-11-05T08:29:27.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.786+0000 7ff456ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:29:27.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.786+0000 7ff456ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-05T08:29:27.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.786+0000 7ff456ffd640 10 monclient: dump: 2023-11-05T08:29:27.794 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:29:27.794 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:27.794 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:27.795 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:27.795 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:29:27.795 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:27.795 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:29:27.795 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:29:27.796 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:29:27.796 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:27.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.786+0000 7ff456ffd640 10 monclient: _finish_auth 0 2023-11-05T08:29:27.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.786+0000 7ff456ffd640 10 monclient: _check_auth_tickets 2023-11-05T08:29:27.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.786+0000 7ff456ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:29:27.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.786+0000 7ff456ffd640 1 -- 172.21.15.52:0/3324945874 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff448033df0 con 0x7ff4600a9210 2023-11-05T08:29:27.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.786+0000 7ff464d33640 5 monclient: authenticate success, global_id 20713 2023-11-05T08:29:27.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.786+0000 7ff464d33640 10 monclient: _renew_subs 2023-11-05T08:29:27.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.786+0000 7ff464d33640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:29:27.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.786+0000 7ff464d33640 1 -- 172.21.15.52:0/3324945874 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4600abe10 con 0x7ff4600a9210 2023-11-05T08:29:27.798 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.786+0000 7ff456ffd640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:29:27.798 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.786+0000 7ff456ffd640 1 -- 172.21.15.52:0/3324945874 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff44803d6b0 con 0x7ff4600a9210 2023-11-05T08:29:27.798 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.786+0000 7ff456ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:29:27.798 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.786+0000 7ff456ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-05T08:29:27.798 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.786+0000 7ff456ffd640 10 monclient: dump: 2023-11-05T08:29:27.799 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:29:27.799 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:27.799 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:27.799 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:27.799 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:29:27.800 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:27.800 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:29:27.800 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:29:27.800 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:29:27.800 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:27.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.786+0000 7ff45d59a640 4 set_mon_vals no callback set 2023-11-05T08:29:27.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.787+0000 7ff464d33640 10 client.20713.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-05T08:29:27.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.787+0000 7ff464d33640 10 monclient: _renew_subs 2023-11-05T08:29:27.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.787+0000 7ff464d33640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:29:27.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.787+0000 7ff464d33640 1 -- 172.21.15.52:0/3324945874 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4600b1100 con 0x7ff4600a9210 2023-11-05T08:29:27.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.787+0000 7ff464d33640 1 librados: init done 2023-11-05T08:29:27.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.787+0000 7ff464d33640 10 client.20713.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:29:27.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.787+0000 7ff464d33640 15 client.20713.objecter _session_command_op_assign -1 1 2023-11-05T08:29:27.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.787+0000 7ff464d33640 20 client.20713.objecter _get_session osd=-1 returning homeless 2023-11-05T08:29:27.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.787+0000 7ff464d33640 10 client.20713.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-05T08:29:27.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.787+0000 7ff464d33640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:29:27.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.787+0000 7ff464d33640 1 -- 172.21.15.52:0/3324945874 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff4600abff0 con 0x7ff4600a9210 2023-11-05T08:29:27.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.806+0000 7ff456ffd640 1 -- 172.21.15.52:0/3324945874 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff44803a040 con 0x7ff4600a9210 2023-11-05T08:29:27.807 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.807+0000 7ff456ffd640 1 --2- 172.21.15.52:0/3324945874 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7ff44006c850 0x7ff44006ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:27.807 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.807+0000 7ff45e59c640 1 --2- 172.21.15.52:0/3324945874 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7ff44006c850 0x7ff44006ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:27.807 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.807+0000 7ff45e59c640 10 monclient: get_auth_request con 0x7ff44006c850 auth_method 0 2023-11-05T08:29:27.808 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.807+0000 7ff45e59c640 1 --2- 172.21.15.52:0/3324945874 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7ff44006c850 0x7ff44006ed10 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ff4600ad5d0 tx=0x7ff450008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:29:27.808 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.808+0000 7ff456ffd640 10 client.20713.objecter ms_handle_connect 0x7ff44006c850 2023-11-05T08:29:27.809 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.809+0000 7ff456ffd640 1 -- 172.21.15.52:0/3324945874 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(932..932 src has 619..932) v4 ==== 6193+0+0 (secure 0 0 0) 0x7ff44807b0a0 con 0x7ff4600a9210 2023-11-05T08:29:27.810 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.809+0000 7ff456ffd640 10 client.20713.objecter ms_dispatch 0x7ff460000b90 osd_map(932..932 src has 619..932) v4 2023-11-05T08:29:27.810 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.809+0000 7ff456ffd640 3 client.20713.objecter handle_osd_map got epochs [932,932] > 0 2023-11-05T08:29:27.810 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.809+0000 7ff456ffd640 3 client.20713.objecter handle_osd_map decoding full epoch 932 2023-11-05T08:29:27.810 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.809+0000 7ff456ffd640 10 client.20713.objecter checking command 1 2023-11-05T08:29:27.810 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.809+0000 7ff456ffd640 1 --2- 172.21.15.52:0/3324945874 >> [v2:172.21.15.52:6824/544646809,v1:172.21.15.52:6825/544646809] conn(0x7ff4400740a0 0x7ff440076540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:27.811 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.809+0000 7ff456ffd640 20 client.20713.objecter _get_session s=0x7ff4400739d0 osd=1 3 2023-11-05T08:29:27.811 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.809+0000 7ff456ffd640 20 client.20713.objecter put_session s=0x7ff4400739d0 osd=1 3 2023-11-05T08:29:27.811 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.809+0000 7ff456ffd640 15 client.20713.objecter _session_command_op_remove -1 1 2023-11-05T08:29:27.811 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.809+0000 7ff456ffd640 20 client.20713.objecter _get_session s=0x7ff4400739d0 osd=1 3 2023-11-05T08:29:27.811 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.809+0000 7ff456ffd640 20 client.20713.objecter get_session s=0x7ff4400739d0 osd=1 3 2023-11-05T08:29:27.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.809+0000 7ff456ffd640 15 client.20713.objecter _session_command_op_assign 1 1 2023-11-05T08:29:27.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.809+0000 7ff456ffd640 20 client.20713.objecter put_session s=0x7ff4400739d0 osd=1 4 2023-11-05T08:29:27.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.809+0000 7ff456ffd640 10 client.20713.objecter _send_command 1 2023-11-05T08:29:27.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.809+0000 7ff456ffd640 1 -- 172.21.15.52:0/3324945874 --> [v2:172.21.15.52:6824/544646809,v1:172.21.15.52:6825/544646809] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff440076c10 con 0x7ff4400740a0 2023-11-05T08:29:27.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.809+0000 7ff456ffd640 20 client.20713.objecter dump_active .. 0 homeless 2023-11-05T08:29:27.813 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.810+0000 7ff45ed9d640 1 --2- 172.21.15.52:0/3324945874 >> [v2:172.21.15.52:6824/544646809,v1:172.21.15.52:6825/544646809] conn(0x7ff4400740a0 0x7ff440076540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:27.813 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.810+0000 7ff45ed9d640 10 monclient: get_auth_request con 0x7ff4400740a0 auth_method 0 2023-11-05T08:29:27.813 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.811+0000 7ff456ffd640 1 -- 172.21.15.52:0/3324945874 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_get_version_reply(handle=1 version=932) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff448076ce0 con 0x7ff4600a9210 2023-11-05T08:29:27.814 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.811+0000 7ff456ffd640 10 monclient: handle_get_version_reply finishing 1 version 932 2023-11-05T08:29:27.814 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.813+0000 7ff456ffd640 10 client.20713.objecter ms_handle_connect 0x7ff4400740a0 2023-11-05T08:29:27.814 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.813+0000 7ff45ed9d640 1 --2- 172.21.15.52:0/3324945874 >> [v2:172.21.15.52:6824/544646809,v1:172.21.15.52:6825/544646809] conn(0x7ff4400740a0 0x7ff440076540 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:29:27.854 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.854+0000 7ff456ffd640 1 -- 172.21.15.52:0/3324945874 <== osd.1 v2:172.21.15.52:6824/544646809 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7ff440076c10 con 0x7ff4400740a0 2023-11-05T08:29:27.854 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.854+0000 7ff456ffd640 10 client.20713.objecter ms_dispatch 0x7ff460000b90 command_reply(tid 1: 0 ) v1 2023-11-05T08:29:27.855 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.854+0000 7ff456ffd640 10 client.20713.objecter _finish_command 1 = system:0 2023-11-05T08:29:27.855 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.854+0000 7ff456ffd640 20 client.20713.objecter put_session s=0x7ff4400739d0 osd=1 4 2023-11-05T08:29:27.855 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.854+0000 7ff456ffd640 15 client.20713.objecter _session_command_op_remove 1 1 2023-11-05T08:29:27.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.867+0000 7ff464d33640 10 client.20713.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2023-11-05T08:29:27.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.867+0000 7ff464d33640 15 client.20713.objecter _session_command_op_assign -1 2 2023-11-05T08:29:27.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.867+0000 7ff464d33640 20 client.20713.objecter _get_session s=0x7ff4400739d0 osd=1 3 2023-11-05T08:29:27.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.867+0000 7ff464d33640 20 client.20713.objecter put_session s=0x7ff4400739d0 osd=1 3 2023-11-05T08:29:27.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.867+0000 7ff464d33640 20 client.20713.objecter _get_session s=0x7ff4400739d0 osd=1 3 2023-11-05T08:29:27.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.867+0000 7ff464d33640 15 client.20713.objecter _session_command_op_remove -1 2 2023-11-05T08:29:27.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.867+0000 7ff464d33640 20 client.20713.objecter get_session s=0x7ff4400739d0 osd=1 3 2023-11-05T08:29:27.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.867+0000 7ff464d33640 15 client.20713.objecter _session_command_op_assign 1 2 2023-11-05T08:29:27.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.867+0000 7ff464d33640 20 client.20713.objecter put_session s=0x7ff4400739d0 osd=1 4 2023-11-05T08:29:27.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.867+0000 7ff464d33640 10 client.20713.objecter _send_command 2 2023-11-05T08:29:27.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.867+0000 7ff464d33640 1 -- 172.21.15.52:0/3324945874 --> [v2:172.21.15.52:6824/544646809,v1:172.21.15.52:6825/544646809] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ff460075530 con 0x7ff4400740a0 2023-11-05T08:29:27.888 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.888+0000 7ff456ffd640 1 -- 172.21.15.52:0/3324945874 <== osd.1 v2:172.21.15.52:6824/544646809 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7ff460075530 con 0x7ff4400740a0 2023-11-05T08:29:27.888 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.888+0000 7ff456ffd640 10 client.20713.objecter ms_dispatch 0x7ff460000b90 command_reply(tid 2: 0 ) v1 2023-11-05T08:29:27.889 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.888+0000 7ff456ffd640 10 client.20713.objecter _finish_command 2 = system:0 2023-11-05T08:29:27.889 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.888+0000 7ff456ffd640 20 client.20713.objecter put_session s=0x7ff4400739d0 osd=1 4 2023-11-05T08:29:27.889 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.888+0000 7ff456ffd640 15 client.20713.objecter _session_command_op_remove 1 2 2023-11-05T08:29:27.889 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2023-11-05T08:29:27.890 INFO:teuthology.orchestra.run.smithi052.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-05T08:29:27.890 INFO:teuthology.orchestra.run.smithi052.stdout:} 2023-11-05T08:29:27.891 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.888+0000 7ff464d33640 10 librados: watch_flush enter 2023-11-05T08:29:27.891 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.888+0000 7ff464d33640 10 librados: watch_flush exit 2023-11-05T08:29:27.892 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.888+0000 7ff464d33640 10 client.20713.objecter close_session for osd.1 2023-11-05T08:29:27.892 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.888+0000 7ff464d33640 1 -- 172.21.15.52:0/3324945874 >> [v2:172.21.15.52:6824/544646809,v1:172.21.15.52:6825/544646809] conn(0x7ff4400740a0 msgr2=0x7ff440076540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:27.892 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.888+0000 7ff464d33640 1 --2- 172.21.15.52:0/3324945874 >> [v2:172.21.15.52:6824/544646809,v1:172.21.15.52:6825/544646809] conn(0x7ff4400740a0 0x7ff440076540 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:27.892 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.888+0000 7ff464d33640 20 client.20713.objecter put_session s=0x7ff4400739d0 osd=1 1 2023-11-05T08:29:27.892 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.888+0000 7ff464d33640 20 client.20713.objecter shutdown clearing up homeless session... 2023-11-05T08:29:27.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.888+0000 7ff464d33640 10 client.20713.objecter successfully canceled tick 2023-11-05T08:29:27.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.889+0000 7ff464d33640 1 -- 172.21.15.52:0/3324945874 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7ff44006c850 msgr2=0x7ff44006ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:27.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.889+0000 7ff464d33640 1 --2- 172.21.15.52:0/3324945874 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7ff44006c850 0x7ff44006ed10 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ff4600ad5d0 tx=0x7ff450008040 comp rx=0 tx=0).stop 2023-11-05T08:29:27.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.889+0000 7ff464d33640 10 monclient: shutdown 2023-11-05T08:29:27.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.889+0000 7ff464d33640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:29:27.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.889+0000 7ff464d33640 1 -- 172.21.15.52:0/3324945874 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff4600a9210 msgr2=0x7ff4600b0410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:27.894 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.889+0000 7ff464d33640 1 --2- 172.21.15.52:0/3324945874 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff4600a9210 0x7ff4600b0410 secure :-1 s=READY pgs=5002 cs=0 l=1 rev1=1 crypto rx=0x7ff448000c00 tx=0x7ff4480046c0 comp rx=0 tx=0).stop 2023-11-05T08:29:27.894 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.889+0000 7ff45ed9d640 1 -- 172.21.15.52:0/3324945874 reap_dead start 2023-11-05T08:29:27.894 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.889+0000 7ff464d33640 1 -- 172.21.15.52:0/3324945874 shutdown_connections 2023-11-05T08:29:27.894 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.889+0000 7ff464d33640 1 -- 172.21.15.52:0/3324945874 >> 172.21.15.52:0/3324945874 conn(0x7ff460065ee0 msgr2=0x7ff46013e9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:29:27.894 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.889+0000 7ff464d33640 1 -- 172.21.15.52:0/3324945874 shutdown_connections 2023-11-05T08:29:27.895 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.889+0000 7ff464d33640 1 -- 172.21.15.52:0/3324945874 wait complete. 2023-11-05T08:29:27.895 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:27.889+0000 7ff464d33640 1 librados: shutdown 2023-11-05T08:29:27.900 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-11-05T08:29:28.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.007+0000 7f2a1464f640 10 monclient: get_monmap_and_config 2023-11-05T08:29:28.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.007+0000 7f2a1464f640 10 monclient: build_initial_monmap 2023-11-05T08:29:28.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.007+0000 7f2a1464f640 10 monclient: monmap: 2023-11-05T08:29:28.009 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:29:28.009 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:28.009 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:29:28.008486+0000 2023-11-05T08:29:28.009 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:29:28.008486+0000 2023-11-05T08:29:28.010 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:29:28.010 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:28.010 INFO:teuthology.orchestra.run.smithi052.stderr:0: v1:172.21.15.52:6789/0 mon.noname-a-legacy 2023-11-05T08:29:28.010 INFO:teuthology.orchestra.run.smithi052.stderr:1: v1:172.21.15.156:6789/0 mon.noname-c-legacy 2023-11-05T08:29:28.010 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-b 2023-11-05T08:29:28.011 INFO:teuthology.orchestra.run.smithi052.stderr:3: v2:172.21.15.52:3300/0 mon.noname-a 2023-11-05T08:29:28.011 INFO:teuthology.orchestra.run.smithi052.stderr:4: v2:172.21.15.156:3300/0 mon.noname-c 2023-11-05T08:29:28.011 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:28.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.008+0000 7f2a1464f640 1 Processor -- start 2023-11-05T08:29:28.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.008+0000 7f2a1464f640 1 -- start start 2023-11-05T08:29:28.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.008+0000 7f2a1464f640 10 monclient: init 2023-11-05T08:29:28.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.009+0000 7f2a1464f640 10 monclient: _reopen_session rank -1 2023-11-05T08:29:28.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.009+0000 7f2a1464f640 10 monclient: _add_conns ranks=[0,1,4,2,3] 2023-11-05T08:29:28.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.009+0000 7f2a1464f640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f2a0c0a8ae0 addr v1:172.21.15.52:6789/0 2023-11-05T08:29:28.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.009+0000 7f2a1464f640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f2a0c13f340 addr v1:172.21.15.156:6789/0 2023-11-05T08:29:28.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.009+0000 7f2a1464f640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f2a0c0a8ec0 0x7f2a0c145710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:28.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.009+0000 7f2a1464f640 10 monclient(hunting): picked mon.noname-c con 0x7f2a0c0a8ec0 addr v2:172.21.15.156:3300/0 2023-11-05T08:29:28.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.009+0000 7f2a1464f640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a0c0a9600 con 0x7f2a0c0a8ae0 2023-11-05T08:29:28.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.009+0000 7f2a1464f640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a0c145c50 con 0x7f2a0c13f340 2023-11-05T08:29:28.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.009+0000 7f2a1464f640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:28.015 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.009+0000 7f2a1464f640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a0c0a9360 con 0x7f2a0c0a8ec0 2023-11-05T08:29:28.015 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.009+0000 7f2a1464f640 10 monclient(hunting): _renew_subs 2023-11-05T08:29:28.015 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.009+0000 7f2a1464f640 10 monclient(hunting): authenticate will time out at 2714.214443s 2023-11-05T08:29:28.017 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.017+0000 7f2a12bec640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f2a0c0a8ec0 0x7f2a0c145710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:28.017 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.017+0000 7f2a11bea640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f2a0c13f340 0x7f2a0c145000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.52:49672/0 (socket says 172.21.15.52:49672) 2023-11-05T08:29:28.018 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.017+0000 7f2a11bea640 1 -- 172.21.15.52:0/1617363156 learned_addr learned my addr 172.21.15.52:0/1617363156 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-11-05T08:29:28.018 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.017+0000 7f2a12bec640 10 monclient(hunting): get_auth_request con 0x7f2a0c0a8ec0 auth_method 0 2023-11-05T08:29:28.018 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.017+0000 7f2a12bec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:29:28.019 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.017+0000 7f2a12bec640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:29:28.019 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.017+0000 7f2a12bec640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:29:28.019 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.018+0000 7f2a12bec640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:29:28.019 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.018+0000 7f2a12bec640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:29:28.019 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.018+0000 7f2a12bec640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:29:28.021 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.021+0000 7f2a12bec640 10 monclient(hunting): handle_auth_done global_id 20716 payload 274 2023-11-05T08:29:28.022 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.021+0000 7f2a12bec640 1 -- 172.21.15.52:0/1617363156 >> v1:172.21.15.156:6789/0 conn(0x7f2a0c13f340 legacy=0x7f2a0c145000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:28.022 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.021+0000 7f2a12bec640 1 -- 172.21.15.52:0/1617363156 >> v1:172.21.15.52:6789/0 conn(0x7f2a0c0a8ae0 legacy=0x7f2a0c13ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-05T08:29:28.022 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.021+0000 7f2a12bec640 10 monclient: _finish_hunting 0 2023-11-05T08:29:28.022 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.021+0000 7f2a12bec640 1 monclient: found mon.noname-c 2023-11-05T08:29:28.023 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.021+0000 7f2a12bec640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:29:28.023 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.021+0000 7f2a12bec640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.156:3300/0 2023-11-05T08:29:28.023 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.021+0000 7f2a12bec640 1 -- 172.21.15.52:0/1617363156 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a0c0b80b0 con 0x7f2a0c0a8ec0 2023-11-05T08:29:28.024 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.024+0000 7f2a12bec640 1 --2- 172.21.15.52:0/1617363156 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2a0c0a8ec0 0x7f2a0c145710 secure :-1 s=READY pgs=5004 cs=0 l=1 rev1=1 crypto rx=0x7f2a04009d90 tx=0x7f2a0402be20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b9c1f2a1f1588d3 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:29:28.028 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.027+0000 7f2a113e9640 1 -- 172.21.15.52:0/1617363156 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a0402cbd0 con 0x7f2a0c0a8ec0 2023-11-05T08:29:28.028 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.027+0000 7f2a113e9640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:29:28.028 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.027+0000 7f2a113e9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-11-05T08:29:28.028 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.027+0000 7f2a113e9640 10 monclient: dump: 2023-11-05T08:29:28.028 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:29:28.029 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:28.029 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:28.029 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:28.029 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:29:28.029 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:28.029 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:29:28.030 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:29:28.030 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:29:28.030 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:28.030 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.027+0000 7f2a113e9640 10 monclient: _finish_auth 0 2023-11-05T08:29:28.030 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.027+0000 7f2a113e9640 10 monclient: _check_auth_tickets 2023-11-05T08:29:28.031 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.027+0000 7f2a113e9640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:29:28.031 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.027+0000 7f2a1464f640 5 monclient: authenticate success, global_id 20716 2023-11-05T08:29:28.031 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.027+0000 7f2a1464f640 20 monclient: get_monmap_and_config waiting for monmap|config 2023-11-05T08:29:28.032 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.031+0000 7f2a113e9640 1 -- 172.21.15.52:0/1617363156 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a0402cd30 con 0x7f2a0c0a8ec0 2023-11-05T08:29:28.032 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.031+0000 7f2a113e9640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:29:28.033 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.031+0000 7f2a113e9640 1 -- 172.21.15.52:0/1617363156 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a0402cea0 con 0x7f2a0c0a8ec0 2023-11-05T08:29:28.033 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.031+0000 7f2a113e9640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:29:28.033 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.031+0000 7f2a113e9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-05T08:29:28.033 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.031+0000 7f2a113e9640 10 monclient: dump: 2023-11-05T08:29:28.033 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:29:28.033 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:28.034 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:28.034 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:28.034 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:29:28.034 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:28.034 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:29:28.035 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:29:28.035 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:29:28.035 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:28.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.031+0000 7f2a1464f640 10 monclient: get_monmap_and_config success 2023-11-05T08:29:28.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.031+0000 7f2a1464f640 4 set_mon_vals no callback set 2023-11-05T08:29:28.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.031+0000 7f2a1464f640 10 monclient: shutdown 2023-11-05T08:29:28.036 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.031+0000 7f2a1464f640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:29:28.036 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.031+0000 7f2a1464f640 1 -- 172.21.15.52:0/1617363156 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2a0c0a8ec0 msgr2=0x7f2a0c145710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:28.036 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.031+0000 7f2a1464f640 1 --2- 172.21.15.52:0/1617363156 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2a0c0a8ec0 0x7f2a0c145710 secure :-1 s=READY pgs=5004 cs=0 l=1 rev1=1 crypto rx=0x7f2a04009d90 tx=0x7f2a0402be20 comp rx=0 tx=0).stop 2023-11-05T08:29:28.036 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.031+0000 7f2a1464f640 1 -- 172.21.15.52:0/1617363156 shutdown_connections 2023-11-05T08:29:28.036 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.031+0000 7f2a1464f640 1 --2- 172.21.15.52:0/1617363156 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2a0c0a8ec0 0x7f2a0c145710 unknown :-1 s=CLOSED pgs=5004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:28.037 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.032+0000 7f2a1464f640 1 -- 172.21.15.52:0/1617363156 >> 172.21.15.52:0/1617363156 conn(0x7f2a0c0b7230 msgr2=0x7f2a0c0b7610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:29:28.037 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.032+0000 7f2a1464f640 1 -- 172.21.15.52:0/1617363156 shutdown_connections 2023-11-05T08:29:28.037 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.032+0000 7f2a1464f640 1 -- 172.21.15.52:0/1617363156 wait complete. 2023-11-05T08:29:28.040 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.032+0000 7f2a1464f640 10 monclient: build_initial_monmap 2023-11-05T08:29:28.040 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.032+0000 7f2a1464f640 10 monclient: monmap: 2023-11-05T08:29:28.041 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:29:28.041 INFO:teuthology.orchestra.run.smithi052.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-05T08:29:28.041 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 0.000000 2023-11-05T08:29:28.041 INFO:teuthology.orchestra.run.smithi052.stderr:created 0.000000 2023-11-05T08:29:28.041 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:29:28.042 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:28.042 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.noname-a 2023-11-05T08:29:28.042 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.noname-b 2023-11-05T08:29:28.042 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-c 2023-11-05T08:29:28.042 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:28.043 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.033+0000 7f2a1464f640 1 librados: starting msgr at 2023-11-05T08:29:28.043 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.033+0000 7f2a1464f640 1 librados: starting objecter 2023-11-05T08:29:28.043 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.033+0000 7f2a1464f640 1 Processor -- start 2023-11-05T08:29:28.043 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.033+0000 7f2a1464f640 1 -- start start 2023-11-05T08:29:28.043 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.033+0000 7f2a1464f640 1 librados: setting wanted keys 2023-11-05T08:29:28.044 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.033+0000 7f2a1464f640 1 librados: calling monclient init 2023-11-05T08:29:28.044 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.033+0000 7f2a1464f640 10 monclient: init 2023-11-05T08:29:28.044 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.033+0000 7f2a1464f640 10 monclient: _reopen_session rank -1 2023-11-05T08:29:28.044 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.033+0000 7f2a1464f640 10 monclient: _add_conns ranks=[1,2,0] 2023-11-05T08:29:28.044 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.033+0000 7f2a1464f640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2a0c0a8ae0 0x7f2a0c12a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:28.044 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.033+0000 7f2a1464f640 10 monclient(hunting): picked mon.noname-b con 0x7f2a0c0a8ae0 addr [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] 2023-11-05T08:29:28.045 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.033+0000 7f2a1464f640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2a0c0a8ec0 0x7f2a0c0b62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:28.045 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.033+0000 7f2a1464f640 10 monclient(hunting): picked mon.noname-c con 0x7f2a0c0a8ec0 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:29:28.045 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.033+0000 7f2a1464f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2a0c13f340 0x7f2a0c0b67f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:28.045 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.033+0000 7f2a1464f640 10 monclient(hunting): picked mon.noname-a con 0x7f2a0c13f340 addr [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] 2023-11-05T08:29:28.045 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.033+0000 7f2a1464f640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:28.046 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.033+0000 7f2a1464f640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a0c144b60 con 0x7f2a0c13f340 2023-11-05T08:29:28.046 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.033+0000 7f2a1464f640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:28.046 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.033+0000 7f2a1464f640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a0c0b5e70 con 0x7f2a0c0a8ae0 2023-11-05T08:29:28.046 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.033+0000 7f2a1464f640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:28.046 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.033+0000 7f2a1464f640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a0c143f20 con 0x7f2a0c0a8ec0 2023-11-05T08:29:28.047 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.033+0000 7f2a1464f640 10 monclient(hunting): _renew_subs 2023-11-05T08:29:28.047 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.033+0000 7f2a1464f640 10 monclient(hunting): authenticate will time out at 2714.238907s 2023-11-05T08:29:28.047 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.034+0000 7f2a11bea640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2a0c0a8ec0 0x7f2a0c0b62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:28.047 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.034+0000 7f2a11bea640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2a0c0a8ec0 0x7f2a0c0b62b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.52:59708/0 (socket says 172.21.15.52:59708) 2023-11-05T08:29:28.047 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.034+0000 7f2a11bea640 1 -- 172.21.15.52:0/4114676543 learned_addr learned my addr 172.21.15.52:0/4114676543 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-11-05T08:29:28.048 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.034+0000 7f2a11bea640 10 monclient(hunting): get_auth_request con 0x7f2a0c0a8ec0 auth_method 0 2023-11-05T08:29:28.048 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.034+0000 7f2a11bea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:29:28.048 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.034+0000 7f2a11bea640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:29:28.048 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.034+0000 7f2a11bea640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:29:28.048 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.035+0000 7f2a11bea640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:29:28.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.035+0000 7f2a11bea640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:29:28.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.035+0000 7f2a11bea640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:29:28.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.035+0000 7f2a123eb640 1 --2- 172.21.15.52:0/4114676543 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2a0c0a8ae0 0x7f2a0c12a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:28.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.036+0000 7f2a123eb640 10 monclient(hunting): get_auth_request con 0x7f2a0c0a8ae0 auth_method 0 2023-11-05T08:29:28.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.036+0000 7f2a123eb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:29:28.050 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.036+0000 7f2a123eb640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:29:28.050 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.036+0000 7f2a123eb640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:29:28.050 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.036+0000 7f2a123eb640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:29:28.050 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.036+0000 7f2a123eb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:29:28.050 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.036+0000 7f2a123eb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:29:28.051 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.038+0000 7f2a11bea640 10 monclient(hunting): handle_auth_done global_id 16964 payload 824 2023-11-05T08:29:28.051 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.038+0000 7f2a11bea640 1 -- 172.21.15.52:0/4114676543 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2a0c0a8ae0 msgr2=0x7f2a0c12a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:28.051 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.038+0000 7f2a11bea640 1 --2- 172.21.15.52:0/4114676543 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2a0c0a8ae0 0x7f2a0c12a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:28.051 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.038+0000 7f2a11bea640 1 -- 172.21.15.52:0/4114676543 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2a0c13f340 msgr2=0x7f2a0c0b67f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:28.051 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.038+0000 7f2a11bea640 1 --2- 172.21.15.52:0/4114676543 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2a0c13f340 0x7f2a0c0b67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:28.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.038+0000 7f2a11bea640 10 monclient: _finish_hunting 0 2023-11-05T08:29:28.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.038+0000 7f2a11bea640 1 monclient: found mon.noname-c 2023-11-05T08:29:28.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.038+0000 7f2a11bea640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:29:28.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.038+0000 7f2a11bea640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.52:3301/0 2023-11-05T08:29:28.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.038+0000 7f2a11bea640 1 -- 172.21.15.52:0/4114676543 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a04009a70 con 0x7f2a0c0a8ec0 2023-11-05T08:29:28.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.040+0000 7f2a11bea640 1 --2- 172.21.15.52:0/4114676543 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2a0c0a8ec0 0x7f2a0c0b62b0 secure :-1 s=READY pgs=3080 cs=0 l=1 rev1=1 crypto rx=0x7f29fc00c3c0 tx=0x7f29fc00c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:29:28.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.040+0000 7f2a02ffd640 10 client.?.objecter ms_handle_connect 0x7f2a0c0a8ec0 2023-11-05T08:29:28.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.040+0000 7f2a02ffd640 10 client.?.objecter resend_mon_ops 2023-11-05T08:29:28.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.042+0000 7f2a02ffd640 1 -- 172.21.15.52:0/4114676543 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29fc005ce0 con 0x7f2a0c0a8ec0 2023-11-05T08:29:28.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.042+0000 7f2a02ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:29:28.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.043+0000 7f2a02ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-11-05T08:29:28.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.043+0000 7f2a02ffd640 10 monclient: dump: 2023-11-05T08:29:28.055 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:29:28.055 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:28.056 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:28.056 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:28.056 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:29:28.056 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:28.056 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:29:28.056 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:29:28.057 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:29:28.057 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:28.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.043+0000 7f2a02ffd640 10 monclient: _finish_auth 0 2023-11-05T08:29:28.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.043+0000 7f2a02ffd640 10 monclient: _check_auth_tickets 2023-11-05T08:29:28.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.043+0000 7f2a02ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:29:28.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.043+0000 7f2a1464f640 5 monclient: authenticate success, global_id 16964 2023-11-05T08:29:28.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.043+0000 7f2a1464f640 10 monclient: _renew_subs 2023-11-05T08:29:28.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.043+0000 7f2a1464f640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.52:3301/0 2023-11-05T08:29:28.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.043+0000 7f2a1464f640 1 -- 172.21.15.52:0/4114676543 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a0c0b5250 con 0x7f2a0c0a8ec0 2023-11-05T08:29:28.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.043+0000 7f2a1464f640 10 client.16964.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-05T08:29:28.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.043+0000 7f2a1464f640 10 monclient: _renew_subs 2023-11-05T08:29:28.059 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.043+0000 7f2a1464f640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.52:3301/0 2023-11-05T08:29:28.059 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.043+0000 7f2a1464f640 1 -- 172.21.15.52:0/4114676543 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a0c142e30 con 0x7f2a0c0a8ec0 2023-11-05T08:29:28.059 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.043+0000 7f2a1464f640 1 librados: init done 2023-11-05T08:29:28.059 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.044+0000 7f2a1464f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-05T08:29:28.059 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.044+0000 7f2a1464f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:29:28.060 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.044+0000 7f2a1464f640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.52:3301/0 2023-11-05T08:29:28.060 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.044+0000 7f2a1464f640 1 -- 172.21.15.52:0/4114676543 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a0c144ca0 con 0x7f2a0c0a8ec0 2023-11-05T08:29:28.060 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.045+0000 7f2a02ffd640 1 -- 172.21.15.52:0/4114676543 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29fc001100 con 0x7f2a0c0a8ec0 2023-11-05T08:29:28.060 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.045+0000 7f2a02ffd640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:29:28.060 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.045+0000 7f2a02ffd640 1 -- 172.21.15.52:0/4114676543 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29fc0072d0 con 0x7f2a0c0a8ec0 2023-11-05T08:29:28.060 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.045+0000 7f2a02ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:29:28.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.045+0000 7f2a02ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-11-05T08:29:28.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.045+0000 7f2a02ffd640 10 monclient: dump: 2023-11-05T08:29:28.061 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:29:28.061 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:28.061 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:28.061 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:28.062 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:29:28.062 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:28.062 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:29:28.062 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:29:28.062 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:29:28.063 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:28.063 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.045+0000 7f2a10be8640 4 set_mon_vals no callback set 2023-11-05T08:29:28.400 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.399+0000 7f2a02ffd640 1 -- 172.21.15.52:0/4114676543 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f29fc0074f0 con 0x7f2a0c0a8ec0 2023-11-05T08:29:28.400 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.400+0000 7f2a02ffd640 1 --2- 172.21.15.52:0/4114676543 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f29f006c800 0x7f29f006ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:28.401 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.400+0000 7f2a123eb640 1 --2- 172.21.15.52:0/4114676543 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f29f006c800 0x7f29f006ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:28.401 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.400+0000 7f2a123eb640 10 monclient: get_auth_request con 0x7f29f006c800 auth_method 0 2023-11-05T08:29:28.401 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.401+0000 7f2a02ffd640 10 client.16964.objecter ms_handle_connect 0x7f29f006c800 2023-11-05T08:29:28.402 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.401+0000 7f2a123eb640 1 --2- 172.21.15.52:0/4114676543 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f29f006c800 0x7f29f006ecc0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f2a080017e0 tx=0x7f2a08009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:29:28.416 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.415+0000 7f2a02ffd640 1 -- 172.21.15.52:0/4114676543 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(932..932 src has 619..932) v4 ==== 6193+0+0 (secure 0 0 0) 0x7f29fc005e40 con 0x7f2a0c0a8ec0 2023-11-05T08:29:28.416 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.415+0000 7f2a02ffd640 10 client.16964.objecter ms_dispatch 0x7f2a0c000b90 osd_map(932..932 src has 619..932) v4 2023-11-05T08:29:28.416 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.415+0000 7f2a02ffd640 3 client.16964.objecter handle_osd_map got epochs [932,932] > 0 2023-11-05T08:29:28.416 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.415+0000 7f2a02ffd640 3 client.16964.objecter handle_osd_map decoding full epoch 932 2023-11-05T08:29:28.417 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.416+0000 7f2a02ffd640 20 client.16964.objecter dump_active .. 0 homeless 2023-11-05T08:29:28.417 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.416+0000 7f2a02ffd640 1 -- 172.21.15.52:0/4114676543 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f29fc054180 con 0x7f2a0c0a8ec0 2023-11-05T08:29:28.417 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.416+0000 7f2a02ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:29:28.417 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.416+0000 7f2a02ffd640 10 monclient: _finish_command 1 = system:0 2023-11-05T08:29:28.600 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.600+0000 7f2a1464f640 1 -- 172.21.15.52:0/4114676543 --> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f2a0c142e30 con 0x7f29f006c800 2023-11-05T08:29:28.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.600+0000 7f2a02ffd640 1 -- 172.21.15.52:0/4114676543 <== mgr.4108 v2:172.21.15.156:6800/3320012339 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f2a0c142e30 con 0x7f29f006c800 2023-11-05T08:29:28.601 INFO:teuthology.orchestra.run.smithi052.stderr:instructed osd(s) 1 to deep-scrub 2023-11-05T08:29:28.603 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.602+0000 7f2a1464f640 10 librados: watch_flush enter 2023-11-05T08:29:28.603 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.602+0000 7f2a1464f640 10 librados: watch_flush exit 2023-11-05T08:29:28.603 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.602+0000 7f2a1464f640 20 client.16964.objecter shutdown clearing up homeless session... 2023-11-05T08:29:28.604 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.602+0000 7f2a1464f640 10 client.16964.objecter successfully canceled tick 2023-11-05T08:29:28.604 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.602+0000 7f2a1464f640 1 -- 172.21.15.52:0/4114676543 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f29f006c800 msgr2=0x7f29f006ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:28.604 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.602+0000 7f2a1464f640 1 --2- 172.21.15.52:0/4114676543 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f29f006c800 0x7f29f006ecc0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f2a080017e0 tx=0x7f2a08009040 comp rx=0 tx=0).stop 2023-11-05T08:29:28.604 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.602+0000 7f2a1464f640 10 monclient: shutdown 2023-11-05T08:29:28.604 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.602+0000 7f2a1464f640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:29:28.605 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.602+0000 7f2a1464f640 1 -- 172.21.15.52:0/4114676543 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2a0c0a8ec0 msgr2=0x7f2a0c0b62b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:28.605 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.602+0000 7f2a1464f640 1 --2- 172.21.15.52:0/4114676543 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2a0c0a8ec0 0x7f2a0c0b62b0 secure :-1 s=READY pgs=3080 cs=0 l=1 rev1=1 crypto rx=0x7f29fc00c3c0 tx=0x7f29fc00c880 comp rx=0 tx=0).stop 2023-11-05T08:29:28.605 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.602+0000 7f2a1464f640 1 -- 172.21.15.52:0/4114676543 shutdown_connections 2023-11-05T08:29:28.605 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.602+0000 7f2a1464f640 1 --2- 172.21.15.52:0/4114676543 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f29f006c800 0x7f29f006ecc0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:28.605 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.602+0000 7f2a1464f640 1 --2- 172.21.15.52:0/4114676543 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2a0c13f340 0x7f2a0c0b67f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:28.606 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.602+0000 7f2a1464f640 1 --2- 172.21.15.52:0/4114676543 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f2a0c0a8ec0 0x7f2a0c0b62b0 unknown :-1 s=CLOSED pgs=3080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:28.606 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.602+0000 7f2a1464f640 1 --2- 172.21.15.52:0/4114676543 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2a0c0a8ae0 0x7f2a0c12a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:28.606 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.602+0000 7f2a1464f640 1 -- 172.21.15.52:0/4114676543 >> 172.21.15.52:0/4114676543 conn(0x7f2a0c0b7230 msgr2=0x7f2a0c135e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:29:28.606 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.603+0000 7f2a1464f640 1 -- 172.21.15.52:0/4114676543 shutdown_connections 2023-11-05T08:29:28.607 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.603+0000 7f2a1464f640 1 -- 172.21.15.52:0/4114676543 wait complete. 2023-11-05T08:29:28.607 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.603+0000 7f2a1464f640 1 librados: shutdown 2023-11-05T08:29:28.615 INFO:tasks.ceph:Scrubbing osd.2 2023-11-05T08:29:28.616 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-11-05T08:29:28.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.724+0000 7f4869ad7640 10 monclient: get_monmap_and_config 2023-11-05T08:29:28.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.724+0000 7f4869ad7640 10 monclient: build_initial_monmap 2023-11-05T08:29:28.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.724+0000 7f4869ad7640 10 monclient: monmap: 2023-11-05T08:29:28.725 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:29:28.726 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:28.726 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:29:28.725324+0000 2023-11-05T08:29:28.726 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:29:28.725324+0000 2023-11-05T08:29:28.726 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:29:28.727 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:28.727 INFO:teuthology.orchestra.run.smithi052.stderr:0: v1:172.21.15.52:6789/0 mon.noname-a-legacy 2023-11-05T08:29:28.727 INFO:teuthology.orchestra.run.smithi052.stderr:1: v1:172.21.15.156:6789/0 mon.noname-c-legacy 2023-11-05T08:29:28.727 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-b 2023-11-05T08:29:28.727 INFO:teuthology.orchestra.run.smithi052.stderr:3: v2:172.21.15.52:3300/0 mon.noname-a 2023-11-05T08:29:28.728 INFO:teuthology.orchestra.run.smithi052.stderr:4: v2:172.21.15.156:3300/0 mon.noname-c 2023-11-05T08:29:28.728 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:28.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.725+0000 7f4869ad7640 1 Processor -- start 2023-11-05T08:29:28.731 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.725+0000 7f4869ad7640 1 -- start start 2023-11-05T08:29:28.731 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.725+0000 7f4869ad7640 10 monclient: init 2023-11-05T08:29:28.731 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.726+0000 7f4869ad7640 10 monclient: _reopen_session rank -1 2023-11-05T08:29:28.731 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.726+0000 7f4869ad7640 10 monclient: _add_conns ranks=[3,4,0,1,2] 2023-11-05T08:29:28.732 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.726+0000 7f4869ad7640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f486406a040 0x7f48640afd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:28.732 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.726+0000 7f4869ad7640 10 monclient(hunting): picked mon.noname-a con 0x7f486406a040 addr v2:172.21.15.52:3300/0 2023-11-05T08:29:28.732 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.726+0000 7f4869ad7640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f48640aa9f0 0x7f48640ae7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:28.732 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.726+0000 7f4869ad7640 10 monclient(hunting): picked mon.noname-c con 0x7f48640aa9f0 addr v2:172.21.15.156:3300/0 2023-11-05T08:29:28.732 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.726+0000 7f4869ad7640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f48640b0270 addr v1:172.21.15.52:6789/0 2023-11-05T08:29:28.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.726+0000 7f4869ad7640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48640a8e60 con 0x7f48640b0270 2023-11-05T08:29:28.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.726+0000 7f4869ad7640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:28.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.726+0000 7f4869ad7640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f486406a420 con 0x7f486406a040 2023-11-05T08:29:28.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.726+0000 7f4869ad7640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:28.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.726+0000 7f4869ad7640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48640aa550 con 0x7f48640aa9f0 2023-11-05T08:29:28.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.726+0000 7f4869ad7640 10 monclient(hunting): _renew_subs 2023-11-05T08:29:28.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.726+0000 7f4869ad7640 10 monclient(hunting): authenticate will time out at 2714.931210s 2023-11-05T08:29:28.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.726+0000 7f48637fe640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f486406a040 0x7f48640afd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:28.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.727+0000 7f4862ffd640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f48640aa9f0 0x7f48640ae7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:28.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.727+0000 7f4863fff640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f48640b0270 0x7f48640aed30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:46046/0 (socket says 172.21.15.52:46046) 2023-11-05T08:29:28.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.727+0000 7f4863fff640 1 -- 172.21.15.52:0/1952418843 learned_addr learned my addr 172.21.15.52:0/1952418843 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-11-05T08:29:28.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.727+0000 7f48637fe640 10 monclient(hunting): get_auth_request con 0x7f486406a040 auth_method 0 2023-11-05T08:29:28.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.727+0000 7f48637fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:29:28.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.727+0000 7f48637fe640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:29:28.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.727+0000 7f48637fe640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:29:28.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.727+0000 7f4862ffd640 10 monclient(hunting): get_auth_request con 0x7f48640aa9f0 auth_method 0 2023-11-05T08:29:28.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.727+0000 7f4862ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:29:28.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.727+0000 7f4862ffd640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:29:28.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.727+0000 7f4862ffd640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:29:28.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.728+0000 7f4862ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:29:28.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.728+0000 7f4862ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:29:28.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.728+0000 7f4862ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:29:28.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.728+0000 7f48637fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:29:28.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.728+0000 7f48637fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:29:28.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.728+0000 7f48637fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:29:28.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.729+0000 7f4862ffd640 10 monclient(hunting): handle_auth_done global_id 20722 payload 274 2023-11-05T08:29:28.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.729+0000 7f4862ffd640 1 -- 172.21.15.52:0/1952418843 >> v2:172.21.15.52:3300/0 conn(0x7f486406a040 msgr2=0x7f48640afd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-05T08:29:28.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.729+0000 7f4862ffd640 1 --2- 172.21.15.52:0/1952418843 >> v2:172.21.15.52:3300/0 conn(0x7f486406a040 0x7f48640afd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:28.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.729+0000 7f4862ffd640 1 -- 172.21.15.52:0/1952418843 >> v1:172.21.15.52:6789/0 conn(0x7f48640b0270 legacy=0x7f48640aed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:28.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.729+0000 7f4862ffd640 10 monclient: _finish_hunting 0 2023-11-05T08:29:28.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.729+0000 7f4862ffd640 1 monclient: found mon.noname-c 2023-11-05T08:29:28.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.729+0000 7f4862ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:29:28.739 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.729+0000 7f4862ffd640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.156:3300/0 2023-11-05T08:29:28.739 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.729+0000 7f4862ffd640 1 -- 172.21.15.52:0/1952418843 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48640a90b0 con 0x7f48640aa9f0 2023-11-05T08:29:28.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.731+0000 7f4862ffd640 1 --2- 172.21.15.52:0/1952418843 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f48640aa9f0 0x7f48640ae7f0 secure :-1 s=READY pgs=5005 cs=0 l=1 rev1=1 crypto rx=0x7f48540097a0 tx=0x7f485402b7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a701d049341e4899 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:29:28.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.735+0000 7f48627fc640 1 -- 172.21.15.52:0/1952418843 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f485402f050 con 0x7f48640aa9f0 2023-11-05T08:29:28.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.735+0000 7f48627fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:29:28.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.735+0000 7f48627fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-11-05T08:29:28.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.735+0000 7f48627fc640 10 monclient: dump: 2023-11-05T08:29:28.744 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:29:28.744 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:28.744 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:28.744 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:28.745 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:29:28.745 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:28.745 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:29:28.745 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:29:28.745 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:29:28.746 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:28.746 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.735+0000 7f48627fc640 10 monclient: _finish_auth 0 2023-11-05T08:29:28.746 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.735+0000 7f48627fc640 10 monclient: _check_auth_tickets 2023-11-05T08:29:28.746 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.735+0000 7f48627fc640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:29:28.746 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.735+0000 7f48627fc640 1 -- 172.21.15.52:0/1952418843 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4854031700 con 0x7f48640aa9f0 2023-11-05T08:29:28.746 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.735+0000 7f4869ad7640 5 monclient: authenticate success, global_id 20722 2023-11-05T08:29:28.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.735+0000 7f4869ad7640 20 monclient: get_monmap_and_config waiting for monmap|config 2023-11-05T08:29:28.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.735+0000 7f48627fc640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:29:28.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.735+0000 7f4869ad7640 10 monclient: get_monmap_and_config success 2023-11-05T08:29:28.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.735+0000 7f4869ad7640 4 set_mon_vals no callback set 2023-11-05T08:29:28.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.735+0000 7f48627fc640 1 -- 172.21.15.52:0/1952418843 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4854031a90 con 0x7f48640aa9f0 2023-11-05T08:29:28.748 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.735+0000 7f48627fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:29:28.748 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.735+0000 7f48627fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-05T08:29:28.748 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.735+0000 7f48627fc640 10 monclient: dump: 2023-11-05T08:29:28.748 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:29:28.748 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:28.749 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:28.749 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:28.749 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:29:28.749 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:28.749 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:29:28.749 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:29:28.750 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:29:28.750 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:28.750 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.735+0000 7f4869ad7640 10 monclient: shutdown 2023-11-05T08:29:28.750 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.735+0000 7f4869ad7640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:29:28.750 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.735+0000 7f4869ad7640 1 -- 172.21.15.52:0/1952418843 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f48640aa9f0 msgr2=0x7f48640ae7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:28.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.735+0000 7f4869ad7640 1 --2- 172.21.15.52:0/1952418843 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f48640aa9f0 0x7f48640ae7f0 secure :-1 s=READY pgs=5005 cs=0 l=1 rev1=1 crypto rx=0x7f48540097a0 tx=0x7f485402b7a0 comp rx=0 tx=0).stop 2023-11-05T08:29:28.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.735+0000 7f4869ad7640 1 -- 172.21.15.52:0/1952418843 shutdown_connections 2023-11-05T08:29:28.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.735+0000 7f4869ad7640 1 --2- 172.21.15.52:0/1952418843 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f48640aa9f0 0x7f48640ae7f0 unknown :-1 s=CLOSED pgs=5005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:28.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.736+0000 7f4869ad7640 1 --2- 172.21.15.52:0/1952418843 >> v2:172.21.15.52:3300/0 conn(0x7f486406a040 0x7f48640afd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:28.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.736+0000 7f4869ad7640 1 -- 172.21.15.52:0/1952418843 >> 172.21.15.52:0/1952418843 conn(0x7f48640b3e70 msgr2=0x7f48640b4280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:29:28.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.736+0000 7f4869ad7640 1 -- 172.21.15.52:0/1952418843 shutdown_connections 2023-11-05T08:29:28.752 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.736+0000 7f4869ad7640 1 -- 172.21.15.52:0/1952418843 wait complete. 2023-11-05T08:29:28.752 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.736+0000 7f4869ad7640 10 monclient: build_initial_monmap 2023-11-05T08:29:28.752 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.736+0000 7f4869ad7640 10 monclient: monmap: 2023-11-05T08:29:28.752 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:29:28.752 INFO:teuthology.orchestra.run.smithi052.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-05T08:29:28.753 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 0.000000 2023-11-05T08:29:28.753 INFO:teuthology.orchestra.run.smithi052.stderr:created 0.000000 2023-11-05T08:29:28.753 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:29:28.753 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:28.753 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.noname-a 2023-11-05T08:29:28.753 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.noname-b 2023-11-05T08:29:28.754 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-c 2023-11-05T08:29:28.754 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:28.754 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.736+0000 7f4869ad7640 1 librados: starting msgr at 2023-11-05T08:29:28.754 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.736+0000 7f4869ad7640 1 librados: starting objecter 2023-11-05T08:29:28.754 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.737+0000 7f4869ad7640 1 Processor -- start 2023-11-05T08:29:28.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.737+0000 7f4869ad7640 1 -- start start 2023-11-05T08:29:28.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.737+0000 7f4869ad7640 1 librados: setting wanted keys 2023-11-05T08:29:28.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.737+0000 7f4869ad7640 1 librados: calling monclient init 2023-11-05T08:29:28.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.737+0000 7f4869ad7640 10 monclient: init 2023-11-05T08:29:28.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.737+0000 7f4869ad7640 10 monclient: _reopen_session rank -1 2023-11-05T08:29:28.756 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.737+0000 7f4869ad7640 10 monclient: _add_conns ranks=[2,0,1] 2023-11-05T08:29:28.756 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.737+0000 7f4869ad7640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f486406a040 0x7f48641d67d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:28.756 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.737+0000 7f4869ad7640 10 monclient(hunting): picked mon.noname-c con 0x7f486406a040 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:29:28.756 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.737+0000 7f4869ad7640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f48640aa9f0 0x7f48641d6d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:28.756 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.737+0000 7f4869ad7640 10 monclient(hunting): picked mon.noname-a con 0x7f48640aa9f0 addr [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] 2023-11-05T08:29:28.757 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.737+0000 7f4869ad7640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f48640b0270 0x7f48641a5f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:28.757 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.737+0000 7f4869ad7640 10 monclient(hunting): picked mon.noname-b con 0x7f48640b0270 addr [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] 2023-11-05T08:29:28.757 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.737+0000 7f4869ad7640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:28.757 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.737+0000 7f4869ad7640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48641d7250 con 0x7f48640aa9f0 2023-11-05T08:29:28.757 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.737+0000 7f4869ad7640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:28.757 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.737+0000 7f4869ad7640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48641a55a0 con 0x7f48640b0270 2023-11-05T08:29:28.758 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.737+0000 7f4869ad7640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:28.758 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.737+0000 7f4869ad7640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48641a5a30 con 0x7f486406a040 2023-11-05T08:29:28.758 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.737+0000 7f4869ad7640 10 monclient(hunting): _renew_subs 2023-11-05T08:29:28.758 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.737+0000 7f4869ad7640 10 monclient(hunting): authenticate will time out at 2714.942755s 2023-11-05T08:29:28.758 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.738+0000 7f4862ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f48640aa9f0 0x7f48641d6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:28.759 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.738+0000 7f48637fe640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f486406a040 0x7f48641d67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:28.759 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.738+0000 7f4863fff640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f48640b0270 0x7f48641a5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:28.759 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.738+0000 7f4862ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f48640aa9f0 0x7f48641d6d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60012/0 (socket says 172.21.15.52:60012) 2023-11-05T08:29:28.759 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.738+0000 7f4862ffd640 1 -- 172.21.15.52:0/1364579277 learned_addr learned my addr 172.21.15.52:0/1364579277 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-11-05T08:29:28.759 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.738+0000 7f4862ffd640 10 monclient(hunting): get_auth_request con 0x7f48640aa9f0 auth_method 0 2023-11-05T08:29:28.760 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.738+0000 7f4862ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:29:28.760 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.738+0000 7f4862ffd640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:29:28.760 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.738+0000 7f4862ffd640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:29:28.760 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.738+0000 7f4863fff640 10 monclient(hunting): get_auth_request con 0x7f48640b0270 auth_method 0 2023-11-05T08:29:28.760 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.738+0000 7f4863fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:29:28.761 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.738+0000 7f4863fff640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:29:28.761 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.738+0000 7f4863fff640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:29:28.761 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.739+0000 7f48637fe640 10 monclient(hunting): get_auth_request con 0x7f486406a040 auth_method 0 2023-11-05T08:29:28.761 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.739+0000 7f48637fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:29:28.761 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.739+0000 7f48637fe640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:29:28.762 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.739+0000 7f48637fe640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:29:28.762 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.739+0000 7f4863fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:29:28.762 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.739+0000 7f4863fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:29:28.762 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.739+0000 7f4863fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:29:28.762 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.739+0000 7f4862ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:29:28.762 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.739+0000 7f4862ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:29:28.763 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.739+0000 7f4862ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:29:28.763 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.739+0000 7f48637fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:29:28.763 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.739+0000 7f48637fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:29:28.763 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.739+0000 7f48637fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:29:28.763 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.741+0000 7f4863fff640 10 monclient(hunting): handle_auth_done global_id 20725 payload 824 2023-11-05T08:29:28.764 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.741+0000 7f4863fff640 1 -- 172.21.15.52:0/1364579277 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f486406a040 msgr2=0x7f48641d67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:28.764 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.741+0000 7f4863fff640 1 --2- 172.21.15.52:0/1364579277 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f486406a040 0x7f48641d67d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:28.764 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.741+0000 7f4863fff640 1 -- 172.21.15.52:0/1364579277 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f48640aa9f0 msgr2=0x7f48641d6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:28.764 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.741+0000 7f4863fff640 1 --2- 172.21.15.52:0/1364579277 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f48640aa9f0 0x7f48641d6d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:28.764 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.741+0000 7f4863fff640 10 monclient: _finish_hunting 0 2023-11-05T08:29:28.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.741+0000 7f4863fff640 1 monclient: found mon.noname-b 2023-11-05T08:29:28.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.741+0000 7f4863fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:29:28.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.741+0000 7f4863fff640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.156:3300/0 2023-11-05T08:29:28.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.741+0000 7f4863fff640 1 -- 172.21.15.52:0/1364579277 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4854009400 con 0x7f48640b0270 2023-11-05T08:29:28.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.744+0000 7f4863fff640 1 --2- 172.21.15.52:0/1364579277 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f48640b0270 0x7f48641a5f60 secure :-1 s=READY pgs=5006 cs=0 l=1 rev1=1 crypto rx=0x7f485c00ca70 tx=0x7f485c00cf30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:29:28.767 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.744+0000 7f485bfff640 10 client.?.objecter ms_handle_connect 0x7f48640b0270 2023-11-05T08:29:28.767 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.744+0000 7f485bfff640 10 client.?.objecter resend_mon_ops 2023-11-05T08:29:28.767 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.747+0000 7f485bfff640 1 -- 172.21.15.52:0/1364579277 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f485c00ab10 con 0x7f48640b0270 2023-11-05T08:29:28.767 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.747+0000 7f485bfff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:29:28.768 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.747+0000 7f485bfff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-05T08:29:28.768 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.747+0000 7f485bfff640 10 monclient: dump: 2023-11-05T08:29:28.768 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:29:28.768 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:28.768 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:28.769 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:28.769 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:29:28.769 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:28.769 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:29:28.769 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:29:28.770 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:29:28.770 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:28.770 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.747+0000 7f485bfff640 10 monclient: _finish_auth 0 2023-11-05T08:29:28.770 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.747+0000 7f485bfff640 10 monclient: _check_auth_tickets 2023-11-05T08:29:28.770 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.747+0000 7f485bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:29:28.771 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.747+0000 7f485bfff640 1 -- 172.21.15.52:0/1364579277 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f485c00ac70 con 0x7f48640b0270 2023-11-05T08:29:28.771 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.747+0000 7f485bfff640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:29:28.771 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.747+0000 7f485bfff640 1 -- 172.21.15.52:0/1364579277 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f485c012600 con 0x7f48640b0270 2023-11-05T08:29:28.771 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.747+0000 7f4869ad7640 5 monclient: authenticate success, global_id 20725 2023-11-05T08:29:28.771 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.747+0000 7f4869ad7640 10 monclient: _renew_subs 2023-11-05T08:29:28.771 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.747+0000 7f4869ad7640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:29:28.772 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.747+0000 7f4869ad7640 1 -- 172.21.15.52:0/1364579277 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48641c7890 con 0x7f48640b0270 2023-11-05T08:29:28.772 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.747+0000 7f485bfff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:29:28.772 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.747+0000 7f4861ffb640 4 set_mon_vals no callback set 2023-11-05T08:29:28.772 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.747+0000 7f485bfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-05T08:29:28.772 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.747+0000 7f485bfff640 10 monclient: dump: 2023-11-05T08:29:28.773 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:29:28.773 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:28.773 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:28.773 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:28.773 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:29:28.774 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:28.774 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:29:28.774 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:29:28.774 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:29:28.774 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:28.775 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.747+0000 7f4869ad7640 10 client.20725.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-05T08:29:28.775 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.747+0000 7f4869ad7640 10 monclient: _renew_subs 2023-11-05T08:29:28.775 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.747+0000 7f4869ad7640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:29:28.775 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.747+0000 7f4869ad7640 1 -- 172.21.15.52:0/1364579277 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48641c7c10 con 0x7f48640b0270 2023-11-05T08:29:28.775 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.747+0000 7f4869ad7640 1 librados: init done 2023-11-05T08:29:28.776 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.748+0000 7f4869ad7640 10 client.20725.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:29:28.776 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.748+0000 7f4869ad7640 15 client.20725.objecter _session_command_op_assign -1 1 2023-11-05T08:29:28.776 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.748+0000 7f4869ad7640 20 client.20725.objecter _get_session osd=-1 returning homeless 2023-11-05T08:29:28.776 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.748+0000 7f4869ad7640 10 client.20725.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-05T08:29:28.776 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.748+0000 7f4869ad7640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:29:28.777 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.748+0000 7f4869ad7640 1 -- 172.21.15.52:0/1364579277 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f48640a9b70 con 0x7f48640b0270 2023-11-05T08:29:28.778 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.767+0000 7f485bfff640 1 -- 172.21.15.52:0/1364579277 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f485c007070 con 0x7f48640b0270 2023-11-05T08:29:28.778 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.767+0000 7f485bfff640 1 --2- 172.21.15.52:0/1364579277 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f484406c800 0x7f484406ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:28.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.768+0000 7f48637fe640 1 --2- 172.21.15.52:0/1364579277 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f484406c800 0x7f484406ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:28.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.768+0000 7f48637fe640 10 monclient: get_auth_request con 0x7f484406c800 auth_method 0 2023-11-05T08:29:28.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.768+0000 7f48637fe640 1 --2- 172.21.15.52:0/1364579277 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f484406c800 0x7f484406ecc0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f484c009b40 tx=0x7f484c009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:29:28.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.768+0000 7f485bfff640 10 client.20725.objecter ms_handle_connect 0x7f484406c800 2023-11-05T08:29:28.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.770+0000 7f485bfff640 1 -- 172.21.15.52:0/1364579277 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(932..932 src has 619..932) v4 ==== 6193+0+0 (secure 0 0 0) 0x7f485c00ae20 con 0x7f48640b0270 2023-11-05T08:29:28.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.770+0000 7f485bfff640 10 client.20725.objecter ms_dispatch 0x7f4864000b90 osd_map(932..932 src has 619..932) v4 2023-11-05T08:29:28.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.770+0000 7f485bfff640 3 client.20725.objecter handle_osd_map got epochs [932,932] > 0 2023-11-05T08:29:28.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.770+0000 7f485bfff640 3 client.20725.objecter handle_osd_map decoding full epoch 932 2023-11-05T08:29:28.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.770+0000 7f485bfff640 10 client.20725.objecter checking command 1 2023-11-05T08:29:28.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.770+0000 7f485bfff640 1 --2- 172.21.15.52:0/1364579277 >> [v2:172.21.15.52:6800/495294409,v1:172.21.15.52:6801/495294409] conn(0x7f4844074050 0x7f48440764f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:28.781 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.770+0000 7f485bfff640 20 client.20725.objecter _get_session s=0x7f4844073980 osd=2 3 2023-11-05T08:29:28.781 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.770+0000 7f485bfff640 20 client.20725.objecter put_session s=0x7f4844073980 osd=2 3 2023-11-05T08:29:28.781 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.770+0000 7f485bfff640 15 client.20725.objecter _session_command_op_remove -1 1 2023-11-05T08:29:28.781 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.770+0000 7f485bfff640 20 client.20725.objecter _get_session s=0x7f4844073980 osd=2 3 2023-11-05T08:29:28.781 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.770+0000 7f485bfff640 20 client.20725.objecter get_session s=0x7f4844073980 osd=2 3 2023-11-05T08:29:28.782 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.770+0000 7f485bfff640 15 client.20725.objecter _session_command_op_assign 2 1 2023-11-05T08:29:28.782 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.770+0000 7f485bfff640 20 client.20725.objecter put_session s=0x7f4844073980 osd=2 4 2023-11-05T08:29:28.782 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.770+0000 7f485bfff640 10 client.20725.objecter _send_command 1 2023-11-05T08:29:28.782 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.770+0000 7f485bfff640 1 -- 172.21.15.52:0/1364579277 --> [v2:172.21.15.52:6800/495294409,v1:172.21.15.52:6801/495294409] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4844076bc0 con 0x7f4844074050 2023-11-05T08:29:28.782 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.770+0000 7f485bfff640 20 client.20725.objecter dump_active .. 0 homeless 2023-11-05T08:29:28.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.770+0000 7f485bfff640 1 -- 172.21.15.52:0/1364579277 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_get_version_reply(handle=1 version=932) v2 ==== 24+0+0 (secure 0 0 0) 0x7f485c001ac0 con 0x7f48640b0270 2023-11-05T08:29:28.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.770+0000 7f485bfff640 10 monclient: handle_get_version_reply finishing 1 version 932 2023-11-05T08:29:28.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.770+0000 7f4862ffd640 1 --2- 172.21.15.52:0/1364579277 >> [v2:172.21.15.52:6800/495294409,v1:172.21.15.52:6801/495294409] conn(0x7f4844074050 0x7f48440764f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:28.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.771+0000 7f4862ffd640 10 monclient: get_auth_request con 0x7f4844074050 auth_method 0 2023-11-05T08:29:28.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.773+0000 7f4862ffd640 1 --2- 172.21.15.52:0/1364579277 >> [v2:172.21.15.52:6800/495294409,v1:172.21.15.52:6801/495294409] conn(0x7f4844074050 0x7f48440764f0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:29:28.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.773+0000 7f485bfff640 10 client.20725.objecter ms_handle_connect 0x7f4844074050 2023-11-05T08:29:28.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.797+0000 7f485bfff640 1 -- 172.21.15.52:0/1364579277 <== osd.2 v2:172.21.15.52:6800/495294409 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f4844076bc0 con 0x7f4844074050 2023-11-05T08:29:28.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.797+0000 7f485bfff640 10 client.20725.objecter ms_dispatch 0x7f4864000b90 command_reply(tid 1: 0 ) v1 2023-11-05T08:29:28.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.797+0000 7f485bfff640 10 client.20725.objecter _finish_command 1 = system:0 2023-11-05T08:29:28.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.797+0000 7f485bfff640 20 client.20725.objecter put_session s=0x7f4844073980 osd=2 4 2023-11-05T08:29:28.798 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.797+0000 7f485bfff640 15 client.20725.objecter _session_command_op_remove 2 1 2023-11-05T08:29:28.810 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.810+0000 7f4869ad7640 10 client.20725.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2023-11-05T08:29:28.810 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.810+0000 7f4869ad7640 15 client.20725.objecter _session_command_op_assign -1 2 2023-11-05T08:29:28.810 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.810+0000 7f4869ad7640 20 client.20725.objecter _get_session s=0x7f4844073980 osd=2 3 2023-11-05T08:29:28.810 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.810+0000 7f4869ad7640 20 client.20725.objecter put_session s=0x7f4844073980 osd=2 3 2023-11-05T08:29:28.810 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.810+0000 7f4869ad7640 20 client.20725.objecter _get_session s=0x7f4844073980 osd=2 3 2023-11-05T08:29:28.811 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.810+0000 7f4869ad7640 15 client.20725.objecter _session_command_op_remove -1 2 2023-11-05T08:29:28.811 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.810+0000 7f4869ad7640 20 client.20725.objecter get_session s=0x7f4844073980 osd=2 3 2023-11-05T08:29:28.811 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.810+0000 7f4869ad7640 15 client.20725.objecter _session_command_op_assign 2 2 2023-11-05T08:29:28.811 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.810+0000 7f4869ad7640 20 client.20725.objecter put_session s=0x7f4844073980 osd=2 4 2023-11-05T08:29:28.811 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.810+0000 7f4869ad7640 10 client.20725.objecter _send_command 2 2023-11-05T08:29:28.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.810+0000 7f4869ad7640 1 -- 172.21.15.52:0/1364579277 --> [v2:172.21.15.52:6800/495294409,v1:172.21.15.52:6801/495294409] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f48640a9890 con 0x7f4844074050 2023-11-05T08:29:28.824 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.824+0000 7f485bfff640 1 -- 172.21.15.52:0/1364579277 <== osd.2 v2:172.21.15.52:6800/495294409 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f4854031ab0 con 0x7f4844074050 2023-11-05T08:29:28.824 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.824+0000 7f485bfff640 10 client.20725.objecter ms_dispatch 0x7f4864000b90 command_reply(tid 2: 0 ) v1 2023-11-05T08:29:28.825 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.824+0000 7f485bfff640 10 client.20725.objecter _finish_command 2 = system:0 2023-11-05T08:29:28.825 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.824+0000 7f485bfff640 20 client.20725.objecter put_session s=0x7f4844073980 osd=2 4 2023-11-05T08:29:28.825 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.824+0000 7f485bfff640 15 client.20725.objecter _session_command_op_remove 2 2 2023-11-05T08:29:28.825 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2023-11-05T08:29:28.826 INFO:teuthology.orchestra.run.smithi052.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-05T08:29:28.826 INFO:teuthology.orchestra.run.smithi052.stdout:} 2023-11-05T08:29:28.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.824+0000 7f4869ad7640 10 librados: watch_flush enter 2023-11-05T08:29:28.828 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.824+0000 7f4869ad7640 10 librados: watch_flush exit 2023-11-05T08:29:28.828 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.824+0000 7f4869ad7640 10 client.20725.objecter close_session for osd.2 2023-11-05T08:29:28.828 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.824+0000 7f4869ad7640 1 -- 172.21.15.52:0/1364579277 >> [v2:172.21.15.52:6800/495294409,v1:172.21.15.52:6801/495294409] conn(0x7f4844074050 msgr2=0x7f48440764f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:28.828 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.824+0000 7f4869ad7640 1 --2- 172.21.15.52:0/1364579277 >> [v2:172.21.15.52:6800/495294409,v1:172.21.15.52:6801/495294409] conn(0x7f4844074050 0x7f48440764f0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:28.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.824+0000 7f4869ad7640 20 client.20725.objecter put_session s=0x7f4844073980 osd=2 1 2023-11-05T08:29:28.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.824+0000 7f4869ad7640 20 client.20725.objecter shutdown clearing up homeless session... 2023-11-05T08:29:28.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.824+0000 7f4869ad7640 10 client.20725.objecter successfully canceled tick 2023-11-05T08:29:28.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.825+0000 7f4869ad7640 1 -- 172.21.15.52:0/1364579277 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f484406c800 msgr2=0x7f484406ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:28.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.825+0000 7f4869ad7640 1 --2- 172.21.15.52:0/1364579277 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f484406c800 0x7f484406ecc0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f484c009b40 tx=0x7f484c009190 comp rx=0 tx=0).stop 2023-11-05T08:29:28.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.825+0000 7f4869ad7640 10 monclient: shutdown 2023-11-05T08:29:28.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.825+0000 7f4869ad7640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:29:28.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.825+0000 7f4869ad7640 1 -- 172.21.15.52:0/1364579277 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f48640b0270 msgr2=0x7f48641a5f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:28.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.825+0000 7f4869ad7640 1 --2- 172.21.15.52:0/1364579277 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f48640b0270 0x7f48641a5f60 secure :-1 s=READY pgs=5006 cs=0 l=1 rev1=1 crypto rx=0x7f485c00ca70 tx=0x7f485c00cf30 comp rx=0 tx=0).stop 2023-11-05T08:29:28.830 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.825+0000 7f4863fff640 1 -- 172.21.15.52:0/1364579277 reap_dead start 2023-11-05T08:29:28.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.825+0000 7f4869ad7640 1 -- 172.21.15.52:0/1364579277 shutdown_connections 2023-11-05T08:29:28.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.825+0000 7f4869ad7640 1 -- 172.21.15.52:0/1364579277 >> 172.21.15.52:0/1364579277 conn(0x7f48640b3e70 msgr2=0x7f48640aef40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:29:28.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.825+0000 7f4869ad7640 1 -- 172.21.15.52:0/1364579277 shutdown_connections 2023-11-05T08:29:28.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.825+0000 7f4869ad7640 1 -- 172.21.15.52:0/1364579277 wait complete. 2023-11-05T08:29:28.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.825+0000 7f4869ad7640 1 librados: shutdown 2023-11-05T08:29:28.835 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-11-05T08:29:28.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.942+0000 7f1a1b826640 10 monclient: get_monmap_and_config 2023-11-05T08:29:28.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.942+0000 7f1a1b826640 10 monclient: build_initial_monmap 2023-11-05T08:29:28.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.942+0000 7f1a1b826640 10 monclient: monmap: 2023-11-05T08:29:28.943 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:29:28.943 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:28.943 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:29:28.943013+0000 2023-11-05T08:29:28.944 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:29:28.943013+0000 2023-11-05T08:29:28.944 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:29:28.944 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:28.944 INFO:teuthology.orchestra.run.smithi052.stderr:0: v1:172.21.15.52:6789/0 mon.noname-a-legacy 2023-11-05T08:29:28.945 INFO:teuthology.orchestra.run.smithi052.stderr:1: v1:172.21.15.156:6789/0 mon.noname-c-legacy 2023-11-05T08:29:28.945 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-b 2023-11-05T08:29:28.945 INFO:teuthology.orchestra.run.smithi052.stderr:3: v2:172.21.15.52:3300/0 mon.noname-a 2023-11-05T08:29:28.945 INFO:teuthology.orchestra.run.smithi052.stderr:4: v2:172.21.15.156:3300/0 mon.noname-c 2023-11-05T08:29:28.945 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:28.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.943+0000 7f1a1b826640 1 Processor -- start 2023-11-05T08:29:28.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.943+0000 7f1a1b826640 1 -- start start 2023-11-05T08:29:28.949 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.943+0000 7f1a1b826640 10 monclient: init 2023-11-05T08:29:28.949 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.943+0000 7f1a1b826640 10 monclient: _reopen_session rank -1 2023-11-05T08:29:28.949 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.943+0000 7f1a1b826640 10 monclient: _add_conns ranks=[3,0,2,4,1] 2023-11-05T08:29:28.949 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.943+0000 7f1a1b826640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1a140ac830 0x7f1a140acc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:28.949 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.943+0000 7f1a1b826640 10 monclient(hunting): picked mon.noname-a con 0x7f1a140ac830 addr v2:172.21.15.52:3300/0 2023-11-05T08:29:28.950 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.943+0000 7f1a1b826640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f1a14071bd0 addr v1:172.21.15.52:6789/0 2023-11-05T08:29:28.950 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.943+0000 7f1a1b826640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1a1413e640 0x7f1a1413ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:28.950 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.943+0000 7f1a1b826640 10 monclient(hunting): picked mon.noname-b con 0x7f1a1413e640 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:29:28.950 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.943+0000 7f1a1b826640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a140ac310 con 0x7f1a14071bd0 2023-11-05T08:29:28.950 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.943+0000 7f1a1b826640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:28.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.943+0000 7f1a1b826640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a140aad80 con 0x7f1a140ac830 2023-11-05T08:29:28.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.943+0000 7f1a1b826640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:28.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.943+0000 7f1a1b826640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a140ad150 con 0x7f1a1413e640 2023-11-05T08:29:28.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.943+0000 7f1a1b826640 10 monclient(hunting): _renew_subs 2023-11-05T08:29:28.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.943+0000 7f1a1b826640 10 monclient(hunting): authenticate will time out at 2715.148874s 2023-11-05T08:29:28.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.944+0000 7f1a195c2640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1a140ac830 0x7f1a140acc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:28.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.944+0000 7f1a19dc3640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1a1413e640 0x7f1a1413ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:28.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.945+0000 7f1a18dc1640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f1a14071bd0 0x7f1a1413bc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:46048/0 (socket says 172.21.15.52:46048) 2023-11-05T08:29:28.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.945+0000 7f1a18dc1640 1 -- 172.21.15.52:0/3678690539 learned_addr learned my addr 172.21.15.52:0/3678690539 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-11-05T08:29:28.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.945+0000 7f1a19dc3640 10 monclient(hunting): get_auth_request con 0x7f1a1413e640 auth_method 0 2023-11-05T08:29:28.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.945+0000 7f1a19dc3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:29:28.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.945+0000 7f1a19dc3640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:29:28.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.945+0000 7f1a19dc3640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:29:28.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.945+0000 7f1a195c2640 10 monclient(hunting): get_auth_request con 0x7f1a140ac830 auth_method 0 2023-11-05T08:29:28.954 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.945+0000 7f1a195c2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:29:28.954 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.945+0000 7f1a195c2640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:29:28.954 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.945+0000 7f1a195c2640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:29:28.954 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.945+0000 7f1a19dc3640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:29:28.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.945+0000 7f1a19dc3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:29:28.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.945+0000 7f1a19dc3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:29:28.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.946+0000 7f1a195c2640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:29:28.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.946+0000 7f1a195c2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:29:28.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.946+0000 7f1a195c2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:29:28.956 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.947+0000 7f1a19dc3640 10 monclient(hunting): handle_auth_done global_id 16970 payload 274 2023-11-05T08:29:28.956 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.947+0000 7f1a19dc3640 1 -- 172.21.15.52:0/3678690539 >> v2:172.21.15.52:3300/0 conn(0x7f1a140ac830 msgr2=0x7f1a140acc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-05T08:29:28.956 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.947+0000 7f1a19dc3640 1 --2- 172.21.15.52:0/3678690539 >> v2:172.21.15.52:3300/0 conn(0x7f1a140ac830 0x7f1a140acc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:28.956 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.947+0000 7f1a19dc3640 1 -- 172.21.15.52:0/3678690539 >> v1:172.21.15.52:6789/0 conn(0x7f1a14071bd0 legacy=0x7f1a1413bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:28.956 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.947+0000 7f1a19dc3640 10 monclient: _finish_hunting 0 2023-11-05T08:29:28.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.947+0000 7f1a19dc3640 1 monclient: found mon.noname-b 2023-11-05T08:29:28.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.947+0000 7f1a19dc3640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:29:28.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.947+0000 7f1a19dc3640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.52:3301/0 2023-11-05T08:29:28.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.947+0000 7f1a19dc3640 1 -- 172.21.15.52:0/3678690539 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a140ab2a0 con 0x7f1a1413e640 2023-11-05T08:29:28.961 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.949+0000 7f1a19dc3640 1 --2- 172.21.15.52:0/3678690539 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1a1413e640 0x7f1a1413ead0 secure :-1 s=READY pgs=3081 cs=0 l=1 rev1=1 crypto rx=0x7f1a140ab4f0 tx=0x7f1a0c02bd70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5fa6d04082cade81 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:29:28.961 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.953+0000 7f1a0bfff640 1 -- 172.21.15.52:0/3678690539 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a0c02cb20 con 0x7f1a1413e640 2023-11-05T08:29:28.961 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.953+0000 7f1a0bfff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:29:28.961 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.953+0000 7f1a0bfff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-05T08:29:28.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.953+0000 7f1a0bfff640 10 monclient: dump: 2023-11-05T08:29:28.962 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:29:28.962 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:28.962 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:28.962 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:28.963 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:29:28.963 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:28.963 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:29:28.963 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:29:28.963 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:29:28.964 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:28.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.953+0000 7f1a0bfff640 10 monclient: _finish_auth 0 2023-11-05T08:29:28.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.953+0000 7f1a0bfff640 10 monclient: _check_auth_tickets 2023-11-05T08:29:28.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.953+0000 7f1a0bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:29:28.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.953+0000 7f1a0bfff640 1 -- 172.21.15.52:0/3678690539 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a0c02cc80 con 0x7f1a1413e640 2023-11-05T08:29:28.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.953+0000 7f1a1b826640 5 monclient: authenticate success, global_id 16970 2023-11-05T08:29:28.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.953+0000 7f1a1b826640 20 monclient: get_monmap_and_config waiting for monmap|config 2023-11-05T08:29:28.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.953+0000 7f1a0bfff640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:29:28.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.953+0000 7f1a1b826640 10 monclient: get_monmap_and_config success 2023-11-05T08:29:28.965 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.953+0000 7f1a0bfff640 1 -- 172.21.15.52:0/3678690539 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a0c034440 con 0x7f1a1413e640 2023-11-05T08:29:28.966 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.953+0000 7f1a1b826640 4 set_mon_vals no callback set 2023-11-05T08:29:28.966 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.953+0000 7f1a0bfff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:29:28.966 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.953+0000 7f1a0bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-11-05T08:29:28.966 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.953+0000 7f1a0bfff640 10 monclient: dump: 2023-11-05T08:29:28.966 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:29:28.967 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:28.967 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:28.967 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:28.967 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:29:28.967 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:28.968 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:29:28.968 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:29:28.968 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:29:28.968 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:28.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.953+0000 7f1a1b826640 10 monclient: shutdown 2023-11-05T08:29:28.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.953+0000 7f1a1b826640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:29:28.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.953+0000 7f1a1b826640 1 -- 172.21.15.52:0/3678690539 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1a1413e640 msgr2=0x7f1a1413ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:28.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.953+0000 7f1a1b826640 1 --2- 172.21.15.52:0/3678690539 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1a1413e640 0x7f1a1413ead0 secure :-1 s=READY pgs=3081 cs=0 l=1 rev1=1 crypto rx=0x7f1a140ab4f0 tx=0x7f1a0c02bd70 comp rx=0 tx=0).stop 2023-11-05T08:29:28.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.953+0000 7f1a1b826640 1 -- 172.21.15.52:0/3678690539 shutdown_connections 2023-11-05T08:29:28.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.953+0000 7f1a1b826640 1 --2- 172.21.15.52:0/3678690539 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1a1413e640 0x7f1a1413ead0 unknown :-1 s=CLOSED pgs=3081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:28.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.953+0000 7f1a1b826640 1 --2- 172.21.15.52:0/3678690539 >> v2:172.21.15.52:3300/0 conn(0x7f1a140ac830 0x7f1a140acc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:28.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.953+0000 7f1a1b826640 1 -- 172.21.15.52:0/3678690539 >> 172.21.15.52:0/3678690539 conn(0x7f1a140b2ff0 msgr2=0x7f1a140b3400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:29:28.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.953+0000 7f1a1b826640 1 -- 172.21.15.52:0/3678690539 shutdown_connections 2023-11-05T08:29:28.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.953+0000 7f1a1b826640 1 -- 172.21.15.52:0/3678690539 wait complete. 2023-11-05T08:29:28.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.954+0000 7f1a1b826640 10 monclient: build_initial_monmap 2023-11-05T08:29:28.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.954+0000 7f1a1b826640 10 monclient: monmap: 2023-11-05T08:29:28.971 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:29:28.971 INFO:teuthology.orchestra.run.smithi052.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-05T08:29:28.971 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 0.000000 2023-11-05T08:29:28.972 INFO:teuthology.orchestra.run.smithi052.stderr:created 0.000000 2023-11-05T08:29:28.972 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:29:28.972 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:28.972 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.noname-a 2023-11-05T08:29:28.972 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.noname-b 2023-11-05T08:29:28.973 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-c 2023-11-05T08:29:28.973 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:28.973 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.954+0000 7f1a1b826640 1 librados: starting msgr at 2023-11-05T08:29:28.973 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.954+0000 7f1a1b826640 1 librados: starting objecter 2023-11-05T08:29:28.973 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.954+0000 7f1a1b826640 1 Processor -- start 2023-11-05T08:29:28.974 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.955+0000 7f1a1b826640 1 -- start start 2023-11-05T08:29:28.974 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.955+0000 7f1a1b826640 1 librados: setting wanted keys 2023-11-05T08:29:28.974 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.955+0000 7f1a1b826640 1 librados: calling monclient init 2023-11-05T08:29:28.974 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.955+0000 7f1a1b826640 10 monclient: init 2023-11-05T08:29:28.974 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.955+0000 7f1a1b826640 10 monclient: _reopen_session rank -1 2023-11-05T08:29:28.975 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.955+0000 7f1a1b826640 10 monclient: _add_conns ranks=[0,2,1] 2023-11-05T08:29:28.975 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.955+0000 7f1a1b826640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a14071bd0 0x7f1a140b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:28.975 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.955+0000 7f1a1b826640 10 monclient(hunting): picked mon.noname-a con 0x7f1a14071bd0 addr [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] 2023-11-05T08:29:28.975 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.955+0000 7f1a1b826640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1a140ac830 0x7f1a141d6720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:28.975 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.955+0000 7f1a1b826640 10 monclient(hunting): picked mon.noname-c con 0x7f1a140ac830 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:29:28.976 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.955+0000 7f1a1b826640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1a1413e640 0x7f1a14133200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:28.976 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.955+0000 7f1a1b826640 10 monclient(hunting): picked mon.noname-b con 0x7f1a1413e640 addr [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] 2023-11-05T08:29:28.976 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.955+0000 7f1a1b826640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:28.976 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.955+0000 7f1a1b826640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a14140540 con 0x7f1a14071bd0 2023-11-05T08:29:28.976 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.955+0000 7f1a1b826640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:28.977 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.955+0000 7f1a1b826640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a141d6290 con 0x7f1a1413e640 2023-11-05T08:29:28.977 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.955+0000 7f1a1b826640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:28.977 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.955+0000 7f1a1b826640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a14140790 con 0x7f1a140ac830 2023-11-05T08:29:28.977 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.955+0000 7f1a1b826640 10 monclient(hunting): _renew_subs 2023-11-05T08:29:28.977 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.955+0000 7f1a1b826640 10 monclient(hunting): authenticate will time out at 2715.160453s 2023-11-05T08:29:28.978 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.956+0000 7f1a195c2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a14071bd0 0x7f1a140b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:28.978 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.956+0000 7f1a18dc1640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1a140ac830 0x7f1a141d6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:28.978 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.956+0000 7f1a195c2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a14071bd0 0x7f1a140b2170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60020/0 (socket says 172.21.15.52:60020) 2023-11-05T08:29:28.978 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.956+0000 7f1a195c2640 1 -- 172.21.15.52:0/1344850493 learned_addr learned my addr 172.21.15.52:0/1344850493 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-11-05T08:29:28.978 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.956+0000 7f1a195c2640 10 monclient(hunting): get_auth_request con 0x7f1a14071bd0 auth_method 0 2023-11-05T08:29:28.979 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.956+0000 7f1a195c2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:29:28.979 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.956+0000 7f1a195c2640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:29:28.979 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.956+0000 7f1a195c2640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:29:28.979 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.956+0000 7f1a18dc1640 10 monclient(hunting): get_auth_request con 0x7f1a140ac830 auth_method 0 2023-11-05T08:29:28.979 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.956+0000 7f1a18dc1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:29:28.980 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.956+0000 7f1a18dc1640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:29:28.980 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.956+0000 7f1a18dc1640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:29:28.980 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.956+0000 7f1a195c2640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:29:28.980 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.956+0000 7f1a195c2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:29:28.980 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.956+0000 7f1a195c2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:29:28.980 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.957+0000 7f1a18dc1640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:29:28.981 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.957+0000 7f1a18dc1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:29:28.981 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.957+0000 7f1a18dc1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:29:28.981 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.959+0000 7f1a195c2640 10 monclient(hunting): handle_auth_done global_id 15714 payload 824 2023-11-05T08:29:28.981 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.959+0000 7f1a195c2640 1 -- 172.21.15.52:0/1344850493 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1a140ac830 msgr2=0x7f1a141d6720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:28.981 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.959+0000 7f1a195c2640 1 --2- 172.21.15.52:0/1344850493 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1a140ac830 0x7f1a141d6720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:28.982 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.959+0000 7f1a195c2640 1 -- 172.21.15.52:0/1344850493 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1a1413e640 msgr2=0x7f1a14133200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:28.982 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.959+0000 7f1a195c2640 1 --2- 172.21.15.52:0/1344850493 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1a1413e640 0x7f1a14133200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:28.982 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.959+0000 7f1a195c2640 10 monclient: _finish_hunting 0 2023-11-05T08:29:28.982 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.959+0000 7f1a195c2640 1 monclient: found mon.noname-a 2023-11-05T08:29:28.982 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.959+0000 7f1a195c2640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:29:28.983 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.959+0000 7f1a195c2640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.52:3300/0 2023-11-05T08:29:28.983 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.959+0000 7f1a195c2640 1 -- 172.21.15.52:0/1344850493 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a0c009a70 con 0x7f1a14071bd0 2023-11-05T08:29:28.983 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.959+0000 7f1a18dc1640 1 --2- 172.21.15.52:0/1344850493 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1a140ac830 0x7f1a141d6720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-05T08:29:28.984 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.962+0000 7f1a195c2640 1 --2- 172.21.15.52:0/1344850493 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a14071bd0 0x7f1a140b2170 secure :-1 s=READY pgs=3051 cs=0 l=1 rev1=1 crypto rx=0x7f1a1000e9e0 tx=0x7f1a1000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:29:28.985 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.962+0000 7f1a09ffb640 10 client.?.objecter ms_handle_connect 0x7f1a14071bd0 2023-11-05T08:29:28.985 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.962+0000 7f1a09ffb640 10 client.?.objecter resend_mon_ops 2023-11-05T08:29:28.985 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.964+0000 7f1a09ffb640 1 -- 172.21.15.52:0/1344850493 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a10009670 con 0x7f1a14071bd0 2023-11-05T08:29:28.985 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.964+0000 7f1a09ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:29:28.985 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.964+0000 7f1a09ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-11-05T08:29:28.985 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.964+0000 7f1a09ffb640 10 monclient: dump: 2023-11-05T08:29:28.986 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:29:28.986 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:28.986 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:28.986 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:28.987 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:29:28.987 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:28.987 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:29:28.987 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:29:28.987 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:29:28.988 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:28.988 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.964+0000 7f1a09ffb640 10 monclient: _finish_auth 0 2023-11-05T08:29:28.988 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.964+0000 7f1a09ffb640 10 monclient: _check_auth_tickets 2023-11-05T08:29:28.988 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.964+0000 7f1a09ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:29:28.988 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.964+0000 7f1a1b826640 5 monclient: authenticate success, global_id 15714 2023-11-05T08:29:28.989 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.964+0000 7f1a1b826640 10 monclient: _renew_subs 2023-11-05T08:29:28.989 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.964+0000 7f1a1b826640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.52:3300/0 2023-11-05T08:29:28.989 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.964+0000 7f1a1b826640 1 -- 172.21.15.52:0/1344850493 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a14133740 con 0x7f1a14071bd0 2023-11-05T08:29:28.989 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.964+0000 7f1a1b826640 10 client.15714.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-05T08:29:28.989 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.964+0000 7f1a1b826640 10 monclient: _renew_subs 2023-11-05T08:29:28.990 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.964+0000 7f1a1b826640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.52:3300/0 2023-11-05T08:29:28.990 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.964+0000 7f1a1b826640 1 -- 172.21.15.52:0/1344850493 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a14132ed0 con 0x7f1a14071bd0 2023-11-05T08:29:28.990 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.964+0000 7f1a1b826640 1 librados: init done 2023-11-05T08:29:28.990 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.966+0000 7f1a1b826640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-05T08:29:28.990 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.966+0000 7f1a1b826640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:29:28.991 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.966+0000 7f1a1b826640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.52:3300/0 2023-11-05T08:29:28.991 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.966+0000 7f1a1b826640 1 -- 172.21.15.52:0/1344850493 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a1404e9f0 con 0x7f1a14071bd0 2023-11-05T08:29:28.991 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.967+0000 7f1a09ffb640 1 -- 172.21.15.52:0/1344850493 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a10005990 con 0x7f1a14071bd0 2023-11-05T08:29:28.991 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.967+0000 7f1a09ffb640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:29:28.991 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:28.967+0000 7f1a0b7fe640 4 set_mon_vals no callback set 2023-11-05T08:29:29.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.231+0000 7f1a09ffb640 1 -- 172.21.15.52:0/1344850493 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a10005d00 con 0x7f1a14071bd0 2023-11-05T08:29:29.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.231+0000 7f1a09ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:29:29.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.231+0000 7f1a09ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-11-05T08:29:29.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.231+0000 7f1a09ffb640 10 monclient: dump: 2023-11-05T08:29:29.233 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:29:29.233 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:29.233 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:29.233 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:29.233 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:29:29.234 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:29.234 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:29:29.234 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:29:29.234 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:29:29.234 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:29.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.232+0000 7f1a09ffb640 1 -- 172.21.15.52:0/1344850493 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1a1000c9d0 con 0x7f1a14071bd0 2023-11-05T08:29:29.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.233+0000 7f1a09ffb640 1 --2- 172.21.15.52:0/1344850493 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f19f806c800 0x7f19f806ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:29.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.233+0000 7f1a18dc1640 1 --2- 172.21.15.52:0/1344850493 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f19f806c800 0x7f19f806ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:29.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.233+0000 7f1a18dc1640 10 monclient: get_auth_request con 0x7f19f806c800 auth_method 0 2023-11-05T08:29:29.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.233+0000 7f1a18dc1640 1 --2- 172.21.15.52:0/1344850493 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f19f806c800 0x7f19f806ecc0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f1a1413e610 tx=0x7f1a04009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:29:29.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.233+0000 7f1a09ffb640 10 client.15714.objecter ms_handle_connect 0x7f19f806c800 2023-11-05T08:29:29.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.261+0000 7f1a09ffb640 1 -- 172.21.15.52:0/1344850493 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(932..932 src has 619..932) v4 ==== 6193+0+0 (secure 0 0 0) 0x7f1a10058dc0 con 0x7f1a14071bd0 2023-11-05T08:29:29.262 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.261+0000 7f1a09ffb640 10 client.15714.objecter ms_dispatch 0x7f1a14000b90 osd_map(932..932 src has 619..932) v4 2023-11-05T08:29:29.262 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.261+0000 7f1a09ffb640 3 client.15714.objecter handle_osd_map got epochs [932,932] > 0 2023-11-05T08:29:29.262 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.261+0000 7f1a09ffb640 3 client.15714.objecter handle_osd_map decoding full epoch 932 2023-11-05T08:29:29.262 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.261+0000 7f1a09ffb640 20 client.15714.objecter dump_active .. 0 homeless 2023-11-05T08:29:29.262 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.261+0000 7f1a09ffb640 1 -- 172.21.15.52:0/1344850493 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1a10058b90 con 0x7f1a14071bd0 2023-11-05T08:29:29.263 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.261+0000 7f1a09ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:29:29.263 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.261+0000 7f1a09ffb640 10 monclient: _finish_command 1 = system:0 2023-11-05T08:29:29.461 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.460+0000 7f1a1b826640 1 -- 172.21.15.52:0/1344850493 --> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f1a140ae260 con 0x7f19f806c800 2023-11-05T08:29:29.461 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.461+0000 7f1a09ffb640 1 -- 172.21.15.52:0/1344850493 <== mgr.4108 v2:172.21.15.156:6800/3320012339 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f1a040018f0 con 0x7f19f806c800 2023-11-05T08:29:29.461 INFO:teuthology.orchestra.run.smithi052.stderr:instructed osd(s) 2 to deep-scrub 2023-11-05T08:29:29.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.463+0000 7f1a1b826640 10 librados: watch_flush enter 2023-11-05T08:29:29.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.463+0000 7f1a1b826640 10 librados: watch_flush exit 2023-11-05T08:29:29.464 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.463+0000 7f1a1b826640 20 client.15714.objecter shutdown clearing up homeless session... 2023-11-05T08:29:29.465 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.463+0000 7f1a1b826640 10 client.15714.objecter successfully canceled tick 2023-11-05T08:29:29.465 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.463+0000 7f1a1b826640 1 -- 172.21.15.52:0/1344850493 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f19f806c800 msgr2=0x7f19f806ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:29.465 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.463+0000 7f1a1b826640 1 --2- 172.21.15.52:0/1344850493 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f19f806c800 0x7f19f806ecc0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f1a1413e610 tx=0x7f1a04009040 comp rx=0 tx=0).stop 2023-11-05T08:29:29.465 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.463+0000 7f1a1b826640 10 monclient: shutdown 2023-11-05T08:29:29.465 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.463+0000 7f1a1b826640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:29:29.465 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.463+0000 7f1a1b826640 1 -- 172.21.15.52:0/1344850493 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a14071bd0 msgr2=0x7f1a140b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:29.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.463+0000 7f1a1b826640 1 --2- 172.21.15.52:0/1344850493 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a14071bd0 0x7f1a140b2170 secure :-1 s=READY pgs=3051 cs=0 l=1 rev1=1 crypto rx=0x7f1a1000e9e0 tx=0x7f1a1000eea0 comp rx=0 tx=0).stop 2023-11-05T08:29:29.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.463+0000 7f1a1b826640 1 -- 172.21.15.52:0/1344850493 shutdown_connections 2023-11-05T08:29:29.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.463+0000 7f1a1b826640 1 --2- 172.21.15.52:0/1344850493 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f19f806c800 0x7f19f806ecc0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:29.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.463+0000 7f1a1b826640 1 --2- 172.21.15.52:0/1344850493 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1a1413e640 0x7f1a14133200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:29.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.463+0000 7f1a1b826640 1 --2- 172.21.15.52:0/1344850493 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1a140ac830 0x7f1a141d6720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:29.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.463+0000 7f1a1b826640 1 --2- 172.21.15.52:0/1344850493 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a14071bd0 0x7f1a140b2170 unknown :-1 s=CLOSED pgs=3051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:29.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.463+0000 7f1a1b826640 1 -- 172.21.15.52:0/1344850493 >> 172.21.15.52:0/1344850493 conn(0x7f1a140b2ff0 msgr2=0x7f1a141393b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:29:29.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.463+0000 7f1a1b826640 1 -- 172.21.15.52:0/1344850493 shutdown_connections 2023-11-05T08:29:29.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.463+0000 7f1a1b826640 1 -- 172.21.15.52:0/1344850493 wait complete. 2023-11-05T08:29:29.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.463+0000 7f1a1b826640 1 librados: shutdown 2023-11-05T08:29:29.475 INFO:tasks.ceph:Scrubbing osd.3 2023-11-05T08:29:29.475 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-11-05T08:29:29.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.586+0000 7fe818183640 10 monclient: get_monmap_and_config 2023-11-05T08:29:29.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.586+0000 7fe818183640 10 monclient: build_initial_monmap 2023-11-05T08:29:29.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.587+0000 7fe818183640 10 monclient: monmap: 2023-11-05T08:29:29.588 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:29:29.588 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:29.588 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:29:29.587503+0000 2023-11-05T08:29:29.588 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:29:29.587503+0000 2023-11-05T08:29:29.588 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:29:29.589 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:29.589 INFO:teuthology.orchestra.run.smithi052.stderr:0: v1:172.21.15.52:6789/0 mon.noname-a-legacy 2023-11-05T08:29:29.589 INFO:teuthology.orchestra.run.smithi052.stderr:1: v1:172.21.15.156:6789/0 mon.noname-c-legacy 2023-11-05T08:29:29.589 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-b 2023-11-05T08:29:29.589 INFO:teuthology.orchestra.run.smithi052.stderr:3: v2:172.21.15.52:3300/0 mon.noname-a 2023-11-05T08:29:29.590 INFO:teuthology.orchestra.run.smithi052.stderr:4: v2:172.21.15.156:3300/0 mon.noname-c 2023-11-05T08:29:29.590 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:29.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.587+0000 7fe818183640 1 Processor -- start 2023-11-05T08:29:29.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.587+0000 7fe818183640 1 -- start start 2023-11-05T08:29:29.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.587+0000 7fe818183640 10 monclient: init 2023-11-05T08:29:29.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.588+0000 7fe818183640 10 monclient: _reopen_session rank -1 2023-11-05T08:29:29.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.588+0000 7fe818183640 10 monclient: _add_conns ranks=[1,3,2,0,4] 2023-11-05T08:29:29.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.588+0000 7fe818183640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fe8100ac8c0 addr v1:172.21.15.156:6789/0 2023-11-05T08:29:29.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.588+0000 7fe818183640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe8100acca0 0x7fe8101417d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:29.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.588+0000 7fe818183640 10 monclient(hunting): picked mon.noname-a con 0x7fe8100acca0 addr v2:172.21.15.52:3300/0 2023-11-05T08:29:29.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.588+0000 7fe818183640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe81006d3e0 0x7fe810071cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:29.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.588+0000 7fe818183640 10 monclient(hunting): picked mon.noname-b con 0x7fe81006d3e0 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:29:29.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.588+0000 7fe818183640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe81006d820 con 0x7fe8100ac8c0 2023-11-05T08:29:29.595 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.588+0000 7fe818183640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:29.595 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.588+0000 7fe818183640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe810071670 con 0x7fe8100acca0 2023-11-05T08:29:29.595 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.588+0000 7fe818183640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:29.595 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.588+0000 7fe818183640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe81006dab0 con 0x7fe81006d3e0 2023-11-05T08:29:29.595 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.588+0000 7fe818183640 10 monclient(hunting): _renew_subs 2023-11-05T08:29:29.596 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.588+0000 7fe818183640 10 monclient(hunting): authenticate will time out at 2715.793337s 2023-11-05T08:29:29.596 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.588+0000 7fe81571e640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe8100acca0 0x7fe8101417d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:29.596 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.589+0000 7fe815f1f640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fe8100ac8c0 0x7fe810070f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.52:49678/0 (socket says 172.21.15.52:49678) 2023-11-05T08:29:29.596 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.589+0000 7fe815f1f640 1 -- 172.21.15.52:0/4229802181 learned_addr learned my addr 172.21.15.52:0/4229802181 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-11-05T08:29:29.596 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.589+0000 7fe816720640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe81006d3e0 0x7fe810071cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:29.597 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.589+0000 7fe81571e640 10 monclient(hunting): get_auth_request con 0x7fe8100acca0 auth_method 0 2023-11-05T08:29:29.597 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.589+0000 7fe81571e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:29:29.597 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.589+0000 7fe81571e640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:29:29.597 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.589+0000 7fe81571e640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:29:29.597 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.589+0000 7fe816720640 10 monclient(hunting): get_auth_request con 0x7fe81006d3e0 auth_method 0 2023-11-05T08:29:29.598 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.589+0000 7fe816720640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:29:29.598 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.589+0000 7fe816720640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:29:29.598 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.589+0000 7fe816720640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:29:29.598 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.590+0000 7fe81571e640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:29:29.598 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.590+0000 7fe81571e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:29:29.599 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.590+0000 7fe81571e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:29:29.599 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.590+0000 7fe816720640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:29:29.599 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.590+0000 7fe816720640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:29:29.599 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.590+0000 7fe816720640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:29:29.599 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.591+0000 7fe814f1d640 1 -- 172.21.15.52:0/4229802181 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1150823399 0 0) 0x7fe81006d820 con 0x7fe8100ac8c0 2023-11-05T08:29:29.600 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.591+0000 7fe814f1d640 10 monclient(hunting): _negotiate 2023-11-05T08:29:29.600 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.591+0000 7fe814f1d640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:29:29.600 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.591+0000 7fe814f1d640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:29:29.600 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.591+0000 7fe814f1d640 10 monclient(hunting): my global_id is 20728 2023-11-05T08:29:29.600 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.591+0000 7fe814f1d640 1 -- 172.21.15.52:0/4229802181 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7fc003520 con 0x7fe8100ac8c0 2023-11-05T08:29:29.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.592+0000 7fe81571e640 10 monclient(hunting): handle_auth_done global_id 15717 payload 274 2023-11-05T08:29:29.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.592+0000 7fe81571e640 1 -- 172.21.15.52:0/4229802181 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe81006d3e0 msgr2=0x7fe810071cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-05T08:29:29.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.592+0000 7fe81571e640 1 --2- 172.21.15.52:0/4229802181 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe81006d3e0 0x7fe810071cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:29.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.592+0000 7fe81571e640 1 -- 172.21.15.52:0/4229802181 >> v1:172.21.15.156:6789/0 conn(0x7fe8100ac8c0 legacy=0x7fe810070f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:29.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.592+0000 7fe81571e640 10 monclient: _finish_hunting 0 2023-11-05T08:29:29.602 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.592+0000 7fe81571e640 1 monclient: found mon.noname-a 2023-11-05T08:29:29.602 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.592+0000 7fe81571e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:29:29.602 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.592+0000 7fe81571e640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.52:3300/0 2023-11-05T08:29:29.602 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.592+0000 7fe81571e640 1 -- 172.21.15.52:0/4229802181 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8100ad4d0 con 0x7fe8100acca0 2023-11-05T08:29:29.602 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.592+0000 7fe816720640 1 --2- 172.21.15.52:0/4229802181 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe81006d3e0 0x7fe810071cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-05T08:29:29.606 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.594+0000 7fe81571e640 1 --2- 172.21.15.52:0/4229802181 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8100acca0 0x7fe8101417d0 secure :-1 s=READY pgs=3052 cs=0 l=1 rev1=1 crypto rx=0x7fe80c0097a0 tx=0x7fe80c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b805a42a14abe3b server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:29:29.607 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.598+0000 7fe814f1d640 1 -- 172.21.15.52:0/4229802181 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe80c02e070 con 0x7fe8100acca0 2023-11-05T08:29:29.607 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.598+0000 7fe814f1d640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:29:29.607 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.598+0000 7fe814f1d640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-11-05T08:29:29.607 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.598+0000 7fe814f1d640 10 monclient: dump: 2023-11-05T08:29:29.607 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:29:29.608 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:29.608 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:29.608 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:29.608 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:29:29.608 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:29.609 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:29:29.609 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:29:29.609 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:29:29.609 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:29.609 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.598+0000 7fe814f1d640 10 monclient: _finish_auth 0 2023-11-05T08:29:29.609 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.598+0000 7fe814f1d640 10 monclient: _check_auth_tickets 2023-11-05T08:29:29.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.598+0000 7fe814f1d640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:29:29.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.598+0000 7fe814f1d640 1 -- 172.21.15.52:0/4229802181 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe80c0315a0 con 0x7fe8100acca0 2023-11-05T08:29:29.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.598+0000 7fe814f1d640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:29:29.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.598+0000 7fe814f1d640 1 -- 172.21.15.52:0/4229802181 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe80c031930 con 0x7fe8100acca0 2023-11-05T08:29:29.611 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.598+0000 7fe818183640 5 monclient: authenticate success, global_id 15717 2023-11-05T08:29:29.611 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.598+0000 7fe818183640 10 monclient: get_monmap_and_config success 2023-11-05T08:29:29.611 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.598+0000 7fe818183640 4 set_mon_vals no callback set 2023-11-05T08:29:29.611 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.598+0000 7fe814f1d640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:29:29.611 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.598+0000 7fe814f1d640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-11-05T08:29:29.611 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.598+0000 7fe814f1d640 10 monclient: dump: 2023-11-05T08:29:29.612 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:29:29.612 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:29.612 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:29.612 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:29.612 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:29:29.613 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:29.613 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:29:29.613 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:29:29.613 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:29:29.613 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:29.614 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.599+0000 7fe818183640 10 monclient: shutdown 2023-11-05T08:29:29.614 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.599+0000 7fe818183640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:29:29.614 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.599+0000 7fe818183640 1 -- 172.21.15.52:0/4229802181 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8100acca0 msgr2=0x7fe8101417d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:29.614 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.599+0000 7fe818183640 1 --2- 172.21.15.52:0/4229802181 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8100acca0 0x7fe8101417d0 secure :-1 s=READY pgs=3052 cs=0 l=1 rev1=1 crypto rx=0x7fe80c0097a0 tx=0x7fe80c02b840 comp rx=0 tx=0).stop 2023-11-05T08:29:29.614 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.599+0000 7fe818183640 1 -- 172.21.15.52:0/4229802181 shutdown_connections 2023-11-05T08:29:29.615 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.599+0000 7fe818183640 1 --2- 172.21.15.52:0/4229802181 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe81006d3e0 0x7fe810071cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:29.615 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.599+0000 7fe818183640 1 --2- 172.21.15.52:0/4229802181 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8100acca0 0x7fe8101417d0 unknown :-1 s=CLOSED pgs=3052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:29.615 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.599+0000 7fe818183640 1 -- 172.21.15.52:0/4229802181 >> 172.21.15.52:0/4229802181 conn(0x7fe8100afb40 msgr2=0x7fe8100aff50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:29:29.615 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.599+0000 7fe818183640 1 -- 172.21.15.52:0/4229802181 shutdown_connections 2023-11-05T08:29:29.615 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.599+0000 7fe818183640 1 -- 172.21.15.52:0/4229802181 wait complete. 2023-11-05T08:29:29.615 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.600+0000 7fe818183640 10 monclient: build_initial_monmap 2023-11-05T08:29:29.616 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.600+0000 7fe818183640 10 monclient: monmap: 2023-11-05T08:29:29.616 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:29:29.616 INFO:teuthology.orchestra.run.smithi052.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-05T08:29:29.616 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 0.000000 2023-11-05T08:29:29.616 INFO:teuthology.orchestra.run.smithi052.stderr:created 0.000000 2023-11-05T08:29:29.617 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:29:29.617 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:29.617 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.noname-a 2023-11-05T08:29:29.617 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.noname-b 2023-11-05T08:29:29.618 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-c 2023-11-05T08:29:29.618 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:29.618 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.600+0000 7fe818183640 1 librados: starting msgr at 2023-11-05T08:29:29.618 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.600+0000 7fe818183640 1 librados: starting objecter 2023-11-05T08:29:29.618 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.600+0000 7fe818183640 1 Processor -- start 2023-11-05T08:29:29.619 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.600+0000 7fe818183640 1 -- start start 2023-11-05T08:29:29.619 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.600+0000 7fe818183640 1 librados: setting wanted keys 2023-11-05T08:29:29.619 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.600+0000 7fe818183640 1 librados: calling monclient init 2023-11-05T08:29:29.619 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.600+0000 7fe818183640 10 monclient: init 2023-11-05T08:29:29.619 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.601+0000 7fe818183640 10 monclient: _reopen_session rank -1 2023-11-05T08:29:29.620 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.601+0000 7fe818183640 10 monclient: _add_conns ranks=[1,0,2] 2023-11-05T08:29:29.620 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.601+0000 7fe818183640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe81006d3e0 0x7fe8101d65e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:29.620 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.601+0000 7fe818183640 10 monclient(hunting): picked mon.noname-b con 0x7fe81006d3e0 addr [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] 2023-11-05T08:29:29.620 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.601+0000 7fe818183640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8100ac8c0 0x7fe8101d6b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:29.620 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.601+0000 7fe818183640 10 monclient(hunting): picked mon.noname-a con 0x7fe8100ac8c0 addr [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] 2023-11-05T08:29:29.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.601+0000 7fe818183640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe8101d7060 0x7fe81011d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:29.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.601+0000 7fe818183640 10 monclient(hunting): picked mon.noname-c con 0x7fe8101d7060 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:29:29.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.601+0000 7fe818183640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:29.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.601+0000 7fe818183640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe810145b30 con 0x7fe8100ac8c0 2023-11-05T08:29:29.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.601+0000 7fe818183640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:29.622 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.601+0000 7fe818183640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe81011d010 con 0x7fe81006d3e0 2023-11-05T08:29:29.622 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.601+0000 7fe818183640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:29.622 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.601+0000 7fe818183640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe81011cd30 con 0x7fe8101d7060 2023-11-05T08:29:29.622 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.601+0000 7fe818183640 10 monclient(hunting): _renew_subs 2023-11-05T08:29:29.623 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.601+0000 7fe818183640 10 monclient(hunting): authenticate will time out at 2715.806426s 2023-11-05T08:29:29.623 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.601+0000 7fe81571e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8100ac8c0 0x7fe8101d6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:29.623 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.602+0000 7fe816720640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe8101d7060 0x7fe81011d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:29.623 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.602+0000 7fe815f1f640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe81006d3e0 0x7fe8101d65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:29.623 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.602+0000 7fe81571e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8100ac8c0 0x7fe8101d6b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60032/0 (socket says 172.21.15.52:60032) 2023-11-05T08:29:29.624 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.602+0000 7fe81571e640 1 -- 172.21.15.52:0/1039598366 learned_addr learned my addr 172.21.15.52:0/1039598366 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-11-05T08:29:29.624 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.602+0000 7fe81571e640 10 monclient(hunting): get_auth_request con 0x7fe8100ac8c0 auth_method 0 2023-11-05T08:29:29.624 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.602+0000 7fe81571e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:29:29.624 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.602+0000 7fe81571e640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:29:29.624 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.602+0000 7fe81571e640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:29:29.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.602+0000 7fe816720640 10 monclient(hunting): get_auth_request con 0x7fe8101d7060 auth_method 0 2023-11-05T08:29:29.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.602+0000 7fe816720640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:29:29.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.602+0000 7fe816720640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:29:29.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.602+0000 7fe816720640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:29:29.626 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.602+0000 7fe815f1f640 10 monclient(hunting): get_auth_request con 0x7fe81006d3e0 auth_method 0 2023-11-05T08:29:29.626 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.602+0000 7fe815f1f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:29:29.626 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.602+0000 7fe815f1f640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:29:29.626 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.602+0000 7fe815f1f640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:29:29.626 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.602+0000 7fe815f1f640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:29:29.626 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.602+0000 7fe815f1f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:29:29.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.603+0000 7fe815f1f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:29:29.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.603+0000 7fe81571e640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:29:29.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.603+0000 7fe81571e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:29:29.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.603+0000 7fe81571e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:29:29.628 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.603+0000 7fe816720640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:29:29.628 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.603+0000 7fe816720640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:29:29.628 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.603+0000 7fe816720640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:29:29.628 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.605+0000 7fe815f1f640 10 monclient(hunting): handle_auth_done global_id 20731 payload 824 2023-11-05T08:29:29.628 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.605+0000 7fe815f1f640 1 -- 172.21.15.52:0/1039598366 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe8101d7060 msgr2=0x7fe81011d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:29.628 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.605+0000 7fe815f1f640 1 --2- 172.21.15.52:0/1039598366 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe8101d7060 0x7fe81011d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:29.629 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.605+0000 7fe815f1f640 1 -- 172.21.15.52:0/1039598366 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8100ac8c0 msgr2=0x7fe8101d6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:29.629 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.605+0000 7fe815f1f640 1 --2- 172.21.15.52:0/1039598366 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8100ac8c0 0x7fe8101d6b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:29.629 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.605+0000 7fe815f1f640 10 monclient: _finish_hunting 0 2023-11-05T08:29:29.629 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.605+0000 7fe815f1f640 1 monclient: found mon.noname-b 2023-11-05T08:29:29.630 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.605+0000 7fe815f1f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:29:29.630 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.605+0000 7fe815f1f640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.156:3300/0 2023-11-05T08:29:29.630 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.605+0000 7fe815f1f640 1 -- 172.21.15.52:0/1039598366 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe808009a70 con 0x7fe81006d3e0 2023-11-05T08:29:29.631 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.607+0000 7fe815f1f640 1 --2- 172.21.15.52:0/1039598366 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe81006d3e0 0x7fe8101d65e0 secure :-1 s=READY pgs=5008 cs=0 l=1 rev1=1 crypto rx=0x7fe80000c460 tx=0x7fe80000c860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:29:29.632 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.607+0000 7fe8067fc640 10 client.?.objecter ms_handle_connect 0x7fe81006d3e0 2023-11-05T08:29:29.632 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.607+0000 7fe8067fc640 10 client.?.objecter resend_mon_ops 2023-11-05T08:29:29.632 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.611+0000 7fe8067fc640 1 -- 172.21.15.52:0/1039598366 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe800005ce0 con 0x7fe81006d3e0 2023-11-05T08:29:29.632 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.611+0000 7fe8067fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:29:29.633 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.611+0000 7fe8067fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-05T08:29:29.633 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.611+0000 7fe8067fc640 10 monclient: dump: 2023-11-05T08:29:29.633 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:29:29.633 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:29.633 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:29.634 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:29.634 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:29:29.634 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:29.634 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:29:29.634 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:29:29.635 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:29:29.635 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:29.635 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.611+0000 7fe8067fc640 10 monclient: _finish_auth 0 2023-11-05T08:29:29.635 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.611+0000 7fe8067fc640 10 monclient: _check_auth_tickets 2023-11-05T08:29:29.635 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.611+0000 7fe8067fc640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:29:29.636 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.611+0000 7fe8067fc640 1 -- 172.21.15.52:0/1039598366 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe800005e40 con 0x7fe81006d3e0 2023-11-05T08:29:29.636 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.611+0000 7fe8067fc640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:29:29.636 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.611+0000 7fe8067fc640 1 -- 172.21.15.52:0/1039598366 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8000072f0 con 0x7fe81006d3e0 2023-11-05T08:29:29.636 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.611+0000 7fe8067fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:29:29.636 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.611+0000 7fe8067fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-05T08:29:29.637 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.611+0000 7fe8067fc640 10 monclient: dump: 2023-11-05T08:29:29.637 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:29:29.637 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:29.637 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:29.637 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:29.637 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:29:29.638 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:29.638 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:29:29.638 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:29:29.638 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:29:29.638 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:29.639 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.611+0000 7fe807fff640 4 set_mon_vals no callback set 2023-11-05T08:29:29.639 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.611+0000 7fe818183640 5 monclient: authenticate success, global_id 20731 2023-11-05T08:29:29.639 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.611+0000 7fe818183640 10 monclient: _renew_subs 2023-11-05T08:29:29.639 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.611+0000 7fe818183640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:29:29.639 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.611+0000 7fe818183640 1 -- 172.21.15.52:0/1039598366 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe80c009400 con 0x7fe81006d3e0 2023-11-05T08:29:29.640 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.611+0000 7fe818183640 10 client.20731.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-05T08:29:29.640 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.611+0000 7fe818183640 10 monclient: _renew_subs 2023-11-05T08:29:29.640 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.611+0000 7fe818183640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:29:29.640 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.611+0000 7fe818183640 1 -- 172.21.15.52:0/1039598366 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe81011de00 con 0x7fe81006d3e0 2023-11-05T08:29:29.640 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.611+0000 7fe818183640 1 librados: init done 2023-11-05T08:29:29.641 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.611+0000 7fe818183640 10 client.20731.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:29:29.641 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.611+0000 7fe818183640 15 client.20731.objecter _session_command_op_assign -1 1 2023-11-05T08:29:29.641 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.611+0000 7fe818183640 20 client.20731.objecter _get_session osd=-1 returning homeless 2023-11-05T08:29:29.641 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.611+0000 7fe818183640 10 client.20731.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-05T08:29:29.641 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.611+0000 7fe818183640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:29:29.642 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.611+0000 7fe818183640 1 -- 172.21.15.52:0/1039598366 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe8100721f0 con 0x7fe81006d3e0 2023-11-05T08:29:29.642 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.630+0000 7fe8067fc640 1 -- 172.21.15.52:0/1039598366 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe800007450 con 0x7fe81006d3e0 2023-11-05T08:29:29.642 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.630+0000 7fe8067fc640 1 --2- 172.21.15.52:0/1039598366 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7fe7f406c850 0x7fe7f406ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:29.642 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.630+0000 7fe81571e640 1 --2- 172.21.15.52:0/1039598366 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7fe7f406c850 0x7fe7f406ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:29.642 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.631+0000 7fe81571e640 10 monclient: get_auth_request con 0x7fe7f406c850 auth_method 0 2023-11-05T08:29:29.644 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.631+0000 7fe8067fc640 10 client.20731.objecter ms_handle_connect 0x7fe7f406c850 2023-11-05T08:29:29.644 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.631+0000 7fe81571e640 1 --2- 172.21.15.52:0/1039598366 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7fe7f406c850 0x7fe7f406ed10 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fe80c000c00 tx=0x7fe80c03d040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:29:29.644 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.632+0000 7fe8067fc640 1 -- 172.21.15.52:0/1039598366 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(932..932 src has 619..932) v4 ==== 6193+0+0 (secure 0 0 0) 0x7fe800007e20 con 0x7fe81006d3e0 2023-11-05T08:29:29.645 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.632+0000 7fe8067fc640 10 client.20731.objecter ms_dispatch 0x7fe810000b90 osd_map(932..932 src has 619..932) v4 2023-11-05T08:29:29.645 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.632+0000 7fe8067fc640 3 client.20731.objecter handle_osd_map got epochs [932,932] > 0 2023-11-05T08:29:29.645 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.632+0000 7fe8067fc640 3 client.20731.objecter handle_osd_map decoding full epoch 932 2023-11-05T08:29:29.645 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.633+0000 7fe8067fc640 10 client.20731.objecter checking command 1 2023-11-05T08:29:29.645 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.633+0000 7fe8067fc640 1 --2- 172.21.15.52:0/1039598366 >> [v2:172.21.15.52:6808/3439629566,v1:172.21.15.52:6809/3439629566] conn(0x7fe7f4074010 0x7fe7f40764b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:29.646 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.633+0000 7fe8067fc640 20 client.20731.objecter _get_session s=0x7fe7f4073940 osd=3 3 2023-11-05T08:29:29.646 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.633+0000 7fe8067fc640 20 client.20731.objecter put_session s=0x7fe7f4073940 osd=3 3 2023-11-05T08:29:29.646 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.633+0000 7fe8067fc640 15 client.20731.objecter _session_command_op_remove -1 1 2023-11-05T08:29:29.646 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.633+0000 7fe8067fc640 20 client.20731.objecter _get_session s=0x7fe7f4073940 osd=3 3 2023-11-05T08:29:29.646 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.633+0000 7fe8067fc640 20 client.20731.objecter get_session s=0x7fe7f4073940 osd=3 3 2023-11-05T08:29:29.647 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.633+0000 7fe8067fc640 15 client.20731.objecter _session_command_op_assign 3 1 2023-11-05T08:29:29.647 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.633+0000 7fe8067fc640 20 client.20731.objecter put_session s=0x7fe7f4073940 osd=3 4 2023-11-05T08:29:29.647 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.633+0000 7fe8067fc640 10 client.20731.objecter _send_command 1 2023-11-05T08:29:29.647 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.633+0000 7fe8067fc640 1 -- 172.21.15.52:0/1039598366 --> [v2:172.21.15.52:6808/3439629566,v1:172.21.15.52:6809/3439629566] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe7f4076b80 con 0x7fe7f4074010 2023-11-05T08:29:29.647 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.633+0000 7fe8067fc640 20 client.20731.objecter dump_active .. 0 homeless 2023-11-05T08:29:29.647 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.633+0000 7fe8067fc640 1 -- 172.21.15.52:0/1039598366 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_get_version_reply(handle=1 version=932) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe8000542b0 con 0x7fe81006d3e0 2023-11-05T08:29:29.648 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.633+0000 7fe8067fc640 10 monclient: handle_get_version_reply finishing 1 version 932 2023-11-05T08:29:29.648 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.633+0000 7fe816720640 1 --2- 172.21.15.52:0/1039598366 >> [v2:172.21.15.52:6808/3439629566,v1:172.21.15.52:6809/3439629566] conn(0x7fe7f4074010 0x7fe7f40764b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:29.648 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.634+0000 7fe816720640 10 monclient: get_auth_request con 0x7fe7f4074010 auth_method 0 2023-11-05T08:29:29.648 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.636+0000 7fe8067fc640 10 client.20731.objecter ms_handle_connect 0x7fe7f4074010 2023-11-05T08:29:29.648 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.636+0000 7fe816720640 1 --2- 172.21.15.52:0/1039598366 >> [v2:172.21.15.52:6808/3439629566,v1:172.21.15.52:6809/3439629566] conn(0x7fe7f4074010 0x7fe7f40764b0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:29:29.661 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.660+0000 7fe8067fc640 1 -- 172.21.15.52:0/1039598366 <== osd.3 v2:172.21.15.52:6808/3439629566 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fe7f4076b80 con 0x7fe7f4074010 2023-11-05T08:29:29.661 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.660+0000 7fe8067fc640 10 client.20731.objecter ms_dispatch 0x7fe810000b90 command_reply(tid 1: 0 ) v1 2023-11-05T08:29:29.662 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.660+0000 7fe8067fc640 10 client.20731.objecter _finish_command 1 = system:0 2023-11-05T08:29:29.662 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.660+0000 7fe8067fc640 20 client.20731.objecter put_session s=0x7fe7f4073940 osd=3 4 2023-11-05T08:29:29.662 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.660+0000 7fe8067fc640 15 client.20731.objecter _session_command_op_remove 3 1 2023-11-05T08:29:29.674 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.673+0000 7fe818183640 10 client.20731.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2023-11-05T08:29:29.674 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.673+0000 7fe818183640 15 client.20731.objecter _session_command_op_assign -1 2 2023-11-05T08:29:29.675 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.673+0000 7fe818183640 20 client.20731.objecter _get_session s=0x7fe7f4073940 osd=3 3 2023-11-05T08:29:29.675 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.673+0000 7fe818183640 20 client.20731.objecter put_session s=0x7fe7f4073940 osd=3 3 2023-11-05T08:29:29.675 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.673+0000 7fe818183640 20 client.20731.objecter _get_session s=0x7fe7f4073940 osd=3 3 2023-11-05T08:29:29.675 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.673+0000 7fe818183640 15 client.20731.objecter _session_command_op_remove -1 2 2023-11-05T08:29:29.676 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.673+0000 7fe818183640 20 client.20731.objecter get_session s=0x7fe7f4073940 osd=3 3 2023-11-05T08:29:29.676 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.673+0000 7fe818183640 15 client.20731.objecter _session_command_op_assign 3 2 2023-11-05T08:29:29.676 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.673+0000 7fe818183640 20 client.20731.objecter put_session s=0x7fe7f4073940 osd=3 4 2023-11-05T08:29:29.676 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.673+0000 7fe818183640 10 client.20731.objecter _send_command 2 2023-11-05T08:29:29.677 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.673+0000 7fe818183640 1 -- 172.21.15.52:0/1039598366 --> [v2:172.21.15.52:6808/3439629566,v1:172.21.15.52:6809/3439629566] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fe810075530 con 0x7fe7f4074010 2023-11-05T08:29:29.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.687+0000 7fe8067fc640 1 -- 172.21.15.52:0/1039598366 <== osd.3 v2:172.21.15.52:6808/3439629566 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fe810075530 con 0x7fe7f4074010 2023-11-05T08:29:29.689 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.687+0000 7fe8067fc640 10 client.20731.objecter ms_dispatch 0x7fe810000b90 command_reply(tid 2: 0 ) v1 2023-11-05T08:29:29.689 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.687+0000 7fe8067fc640 10 client.20731.objecter _finish_command 2 = system:0 2023-11-05T08:29:29.689 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.687+0000 7fe8067fc640 20 client.20731.objecter put_session s=0x7fe7f4073940 osd=3 4 2023-11-05T08:29:29.689 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.687+0000 7fe8067fc640 15 client.20731.objecter _session_command_op_remove 3 2 2023-11-05T08:29:29.690 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2023-11-05T08:29:29.690 INFO:teuthology.orchestra.run.smithi052.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-05T08:29:29.690 INFO:teuthology.orchestra.run.smithi052.stdout:} 2023-11-05T08:29:29.692 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.687+0000 7fe818183640 10 librados: watch_flush enter 2023-11-05T08:29:29.692 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.687+0000 7fe818183640 10 librados: watch_flush exit 2023-11-05T08:29:29.692 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.687+0000 7fe818183640 10 client.20731.objecter close_session for osd.3 2023-11-05T08:29:29.692 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.687+0000 7fe818183640 1 -- 172.21.15.52:0/1039598366 >> [v2:172.21.15.52:6808/3439629566,v1:172.21.15.52:6809/3439629566] conn(0x7fe7f4074010 msgr2=0x7fe7f40764b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:29.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.687+0000 7fe818183640 1 --2- 172.21.15.52:0/1039598366 >> [v2:172.21.15.52:6808/3439629566,v1:172.21.15.52:6809/3439629566] conn(0x7fe7f4074010 0x7fe7f40764b0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:29.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.688+0000 7fe818183640 20 client.20731.objecter put_session s=0x7fe7f4073940 osd=3 1 2023-11-05T08:29:29.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.688+0000 7fe818183640 20 client.20731.objecter shutdown clearing up homeless session... 2023-11-05T08:29:29.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.688+0000 7fe818183640 10 client.20731.objecter successfully canceled tick 2023-11-05T08:29:29.694 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.688+0000 7fe818183640 1 -- 172.21.15.52:0/1039598366 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7fe7f406c850 msgr2=0x7fe7f406ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:29.694 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.688+0000 7fe818183640 1 --2- 172.21.15.52:0/1039598366 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7fe7f406c850 0x7fe7f406ed10 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fe80c000c00 tx=0x7fe80c03d040 comp rx=0 tx=0).stop 2023-11-05T08:29:29.694 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.688+0000 7fe818183640 10 monclient: shutdown 2023-11-05T08:29:29.694 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.688+0000 7fe818183640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:29:29.694 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.688+0000 7fe818183640 1 -- 172.21.15.52:0/1039598366 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe81006d3e0 msgr2=0x7fe8101d65e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:29.695 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.688+0000 7fe818183640 1 --2- 172.21.15.52:0/1039598366 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe81006d3e0 0x7fe8101d65e0 secure :-1 s=READY pgs=5008 cs=0 l=1 rev1=1 crypto rx=0x7fe80000c460 tx=0x7fe80000c860 comp rx=0 tx=0).stop 2023-11-05T08:29:29.695 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.688+0000 7fe816720640 1 -- 172.21.15.52:0/1039598366 reap_dead start 2023-11-05T08:29:29.695 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.688+0000 7fe818183640 1 -- 172.21.15.52:0/1039598366 shutdown_connections 2023-11-05T08:29:29.695 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.688+0000 7fe818183640 1 -- 172.21.15.52:0/1039598366 >> 172.21.15.52:0/1039598366 conn(0x7fe8100afb40 msgr2=0x7fe8100b1e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:29:29.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.688+0000 7fe818183640 1 -- 172.21.15.52:0/1039598366 shutdown_connections 2023-11-05T08:29:29.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.688+0000 7fe818183640 1 -- 172.21.15.52:0/1039598366 wait complete. 2023-11-05T08:29:29.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.688+0000 7fe818183640 1 librados: shutdown 2023-11-05T08:29:29.699 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-11-05T08:29:29.805 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.804+0000 7fb716db6640 10 monclient: get_monmap_and_config 2023-11-05T08:29:29.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.804+0000 7fb716db6640 10 monclient: build_initial_monmap 2023-11-05T08:29:29.806 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.804+0000 7fb716db6640 10 monclient: monmap: 2023-11-05T08:29:29.806 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:29:29.806 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:29.807 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:29:29.806270+0000 2023-11-05T08:29:29.807 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:29:29.806270+0000 2023-11-05T08:29:29.807 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:29:29.807 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:29.807 INFO:teuthology.orchestra.run.smithi052.stderr:0: v1:172.21.15.52:6789/0 mon.noname-a-legacy 2023-11-05T08:29:29.808 INFO:teuthology.orchestra.run.smithi052.stderr:1: v1:172.21.15.156:6789/0 mon.noname-c-legacy 2023-11-05T08:29:29.808 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-b 2023-11-05T08:29:29.808 INFO:teuthology.orchestra.run.smithi052.stderr:3: v2:172.21.15.52:3300/0 mon.noname-a 2023-11-05T08:29:29.808 INFO:teuthology.orchestra.run.smithi052.stderr:4: v2:172.21.15.156:3300/0 mon.noname-c 2023-11-05T08:29:29.808 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:29.810 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.805+0000 7fb716db6640 1 Processor -- start 2023-11-05T08:29:29.811 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.805+0000 7fb716db6640 1 -- start start 2023-11-05T08:29:29.811 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.805+0000 7fb716db6640 10 monclient: init 2023-11-05T08:29:29.811 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.806+0000 7fb716db6640 10 monclient: _reopen_session rank -1 2023-11-05T08:29:29.811 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.806+0000 7fb716db6640 10 monclient: _add_conns ranks=[2,3,1,4,0] 2023-11-05T08:29:29.811 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.806+0000 7fb716db6640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb71006bbe0 0x7fb71006bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:29.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.806+0000 7fb716db6640 10 monclient(hunting): picked mon.noname-b con 0x7fb71006bbe0 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:29:29.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.806+0000 7fb716db6640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb71006b1d0 0x7fb7100713b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:29.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.806+0000 7fb716db6640 10 monclient(hunting): picked mon.noname-a con 0x7fb71006b1d0 addr v2:172.21.15.52:3300/0 2023-11-05T08:29:29.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.806+0000 7fb716db6640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fb7100718f0 addr v1:172.21.15.156:6789/0 2023-11-05T08:29:29.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.806+0000 7fb716db6640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb71006fc00 con 0x7fb7100718f0 2023-11-05T08:29:29.813 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.806+0000 7fb716db6640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:29.813 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.806+0000 7fb716db6640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb710071da0 con 0x7fb71006b1d0 2023-11-05T08:29:29.813 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.806+0000 7fb716db6640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:29.813 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.806+0000 7fb716db6640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb71006c500 con 0x7fb71006bbe0 2023-11-05T08:29:29.813 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.806+0000 7fb716db6640 10 monclient(hunting): _renew_subs 2023-11-05T08:29:29.814 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.806+0000 7fb716db6640 10 monclient(hunting): authenticate will time out at 2716.012136s 2023-11-05T08:29:29.814 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.806+0000 7fb70ffff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb71006b1d0 0x7fb7100713b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:29.814 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.806+0000 7fb715353640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fb7100718f0 0x7fb710141cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.52:49692/0 (socket says 172.21.15.52:49692) 2023-11-05T08:29:29.814 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.806+0000 7fb715353640 1 -- 172.21.15.52:0/3558296383 learned_addr learned my addr 172.21.15.52:0/3558296383 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-11-05T08:29:29.814 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.806+0000 7fb714b52640 1 --2- 172.21.15.52:0/3558296383 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb71006bbe0 0x7fb71006bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:29.815 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.807+0000 7fb70ffff640 10 monclient(hunting): get_auth_request con 0x7fb71006b1d0 auth_method 0 2023-11-05T08:29:29.815 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.807+0000 7fb70ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:29:29.815 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.807+0000 7fb70ffff640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:29:29.815 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.807+0000 7fb70ffff640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:29:29.815 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.807+0000 7fb714b52640 10 monclient(hunting): get_auth_request con 0x7fb71006bbe0 auth_method 0 2023-11-05T08:29:29.815 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.807+0000 7fb714b52640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:29:29.816 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.807+0000 7fb714b52640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:29:29.816 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.807+0000 7fb714b52640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:29:29.816 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.807+0000 7fb70ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:29:29.816 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.807+0000 7fb70ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:29:29.816 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.807+0000 7fb70ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:29:29.817 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.807+0000 7fb714b52640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:29:29.817 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.807+0000 7fb714b52640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:29:29.817 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.807+0000 7fb714b52640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:29:29.817 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.809+0000 7fb70ffff640 10 monclient(hunting): handle_auth_done global_id 15723 payload 274 2023-11-05T08:29:29.817 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.809+0000 7fb70ffff640 1 -- 172.21.15.52:0/3558296383 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb71006bbe0 msgr2=0x7fb71006bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-05T08:29:29.818 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.809+0000 7fb70ffff640 1 --2- 172.21.15.52:0/3558296383 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb71006bbe0 0x7fb71006bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:29.818 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.809+0000 7fb70ffff640 1 -- 172.21.15.52:0/3558296383 >> v1:172.21.15.156:6789/0 conn(0x7fb7100718f0 legacy=0x7fb710141cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:29.818 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.809+0000 7fb70ffff640 10 monclient: _finish_hunting 0 2023-11-05T08:29:29.818 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.809+0000 7fb70ffff640 1 monclient: found mon.noname-a 2023-11-05T08:29:29.818 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.809+0000 7fb70ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:29:29.819 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.809+0000 7fb70ffff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.52:3300/0 2023-11-05T08:29:29.819 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.809+0000 7fb70f7fe640 1 -- 172.21.15.52:0/3558296383 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1342482200 0 0) 0x7fb71006fc00 con 0x7fb7100718f0 2023-11-05T08:29:29.819 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.809+0000 7fb70ffff640 1 -- 172.21.15.52:0/3558296383 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb71006c770 con 0x7fb71006b1d0 2023-11-05T08:29:29.819 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.809+0000 7fb70f7fe640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) v1 2023-11-05T08:29:29.824 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.811+0000 7fb70ffff640 1 --2- 172.21.15.52:0/3558296383 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb71006b1d0 0x7fb7100713b0 secure :-1 s=READY pgs=3053 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc0097a0 tx=0x7fb6fc02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ef245c4ebbd61ef server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:29:29.824 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.815+0000 7fb70f7fe640 1 -- 172.21.15.52:0/3558296383 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6fc02e070 con 0x7fb71006b1d0 2023-11-05T08:29:29.824 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.815+0000 7fb70f7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:29:29.824 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.815+0000 7fb70f7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-11-05T08:29:29.825 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.815+0000 7fb70f7fe640 10 monclient: dump: 2023-11-05T08:29:29.825 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:29:29.825 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:29.825 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:29.826 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:29.826 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:29:29.826 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:29.826 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:29:29.826 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:29:29.827 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:29:29.827 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:29.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.815+0000 7fb70f7fe640 10 monclient: _finish_auth 0 2023-11-05T08:29:29.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.815+0000 7fb70f7fe640 10 monclient: _check_auth_tickets 2023-11-05T08:29:29.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.815+0000 7fb70f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:29:29.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.815+0000 7fb70f7fe640 1 -- 172.21.15.52:0/3558296383 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6fc0315a0 con 0x7fb71006b1d0 2023-11-05T08:29:29.828 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.815+0000 7fb716db6640 5 monclient: authenticate success, global_id 15723 2023-11-05T08:29:29.828 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.815+0000 7fb716db6640 20 monclient: get_monmap_and_config waiting for monmap|config 2023-11-05T08:29:29.828 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.815+0000 7fb70f7fe640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:29:29.828 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.815+0000 7fb70f7fe640 1 -- 172.21.15.52:0/3558296383 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6fc031930 con 0x7fb71006b1d0 2023-11-05T08:29:29.828 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.815+0000 7fb70f7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:29:29.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.815+0000 7fb70f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-11-05T08:29:29.829 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.815+0000 7fb70f7fe640 10 monclient: dump: 2023-11-05T08:29:29.829 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:29:29.829 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:29.829 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:29.830 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:29.830 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:29:29.830 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:29.830 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:29:29.830 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:29:29.831 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:29:29.831 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:29.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.815+0000 7fb716db6640 10 monclient: get_monmap_and_config success 2023-11-05T08:29:29.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.815+0000 7fb716db6640 4 set_mon_vals no callback set 2023-11-05T08:29:29.831 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.815+0000 7fb716db6640 10 monclient: shutdown 2023-11-05T08:29:29.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.815+0000 7fb716db6640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:29:29.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.815+0000 7fb716db6640 1 -- 172.21.15.52:0/3558296383 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb71006b1d0 msgr2=0x7fb7100713b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:29.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.815+0000 7fb716db6640 1 --2- 172.21.15.52:0/3558296383 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb71006b1d0 0x7fb7100713b0 secure :-1 s=READY pgs=3053 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc0097a0 tx=0x7fb6fc02b840 comp rx=0 tx=0).stop 2023-11-05T08:29:29.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.816+0000 7fb716db6640 1 -- 172.21.15.52:0/3558296383 shutdown_connections 2023-11-05T08:29:29.832 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.816+0000 7fb716db6640 1 --2- 172.21.15.52:0/3558296383 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb71006b1d0 0x7fb7100713b0 unknown :-1 s=CLOSED pgs=3053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:29.833 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.816+0000 7fb716db6640 1 --2- 172.21.15.52:0/3558296383 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb71006bbe0 0x7fb71006bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:29.833 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.816+0000 7fb716db6640 1 -- 172.21.15.52:0/3558296383 >> 172.21.15.52:0/3558296383 conn(0x7fb7100665e0 msgr2=0x7fb7100b50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:29:29.833 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.816+0000 7fb716db6640 1 -- 172.21.15.52:0/3558296383 shutdown_connections 2023-11-05T08:29:29.833 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.816+0000 7fb716db6640 1 -- 172.21.15.52:0/3558296383 wait complete. 2023-11-05T08:29:29.833 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.816+0000 7fb716db6640 10 monclient: build_initial_monmap 2023-11-05T08:29:29.833 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.816+0000 7fb716db6640 10 monclient: monmap: 2023-11-05T08:29:29.834 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:29:29.834 INFO:teuthology.orchestra.run.smithi052.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-05T08:29:29.834 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 0.000000 2023-11-05T08:29:29.834 INFO:teuthology.orchestra.run.smithi052.stderr:created 0.000000 2023-11-05T08:29:29.834 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:29:29.835 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:29.835 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.noname-a 2023-11-05T08:29:29.835 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.noname-b 2023-11-05T08:29:29.835 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-c 2023-11-05T08:29:29.835 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:29.836 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.817+0000 7fb716db6640 1 librados: starting msgr at 2023-11-05T08:29:29.836 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.817+0000 7fb716db6640 1 librados: starting objecter 2023-11-05T08:29:29.836 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.817+0000 7fb716db6640 1 Processor -- start 2023-11-05T08:29:29.836 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.817+0000 7fb716db6640 1 -- start start 2023-11-05T08:29:29.836 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.817+0000 7fb716db6640 1 librados: setting wanted keys 2023-11-05T08:29:29.837 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.817+0000 7fb716db6640 1 librados: calling monclient init 2023-11-05T08:29:29.837 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.817+0000 7fb716db6640 10 monclient: init 2023-11-05T08:29:29.837 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.817+0000 7fb716db6640 10 monclient: _reopen_session rank -1 2023-11-05T08:29:29.837 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.817+0000 7fb716db6640 10 monclient: _add_conns ranks=[0,2,1] 2023-11-05T08:29:29.837 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.817+0000 7fb716db6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb71006b1d0 0x7fb7101458b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:29.838 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.817+0000 7fb716db6640 10 monclient(hunting): picked mon.noname-a con 0x7fb71006b1d0 addr [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] 2023-11-05T08:29:29.838 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.817+0000 7fb716db6640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb71006bbe0 0x7fb7101d66a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:29.838 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.817+0000 7fb716db6640 10 monclient(hunting): picked mon.noname-c con 0x7fb71006bbe0 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:29:29.838 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.817+0000 7fb716db6640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb7100718f0 0x7fb7101d6be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:29.838 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.817+0000 7fb716db6640 10 monclient(hunting): picked mon.noname-b con 0x7fb7100718f0 addr [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] 2023-11-05T08:29:29.839 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.817+0000 7fb716db6640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:29.839 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.817+0000 7fb716db6640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb710142db0 con 0x7fb71006b1d0 2023-11-05T08:29:29.839 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.817+0000 7fb716db6640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:29.839 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.817+0000 7fb716db6640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb710145df0 con 0x7fb7100718f0 2023-11-05T08:29:29.839 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.817+0000 7fb716db6640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:29.839 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.817+0000 7fb716db6640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7101d7120 con 0x7fb71006bbe0 2023-11-05T08:29:29.840 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.817+0000 7fb716db6640 10 monclient(hunting): _renew_subs 2023-11-05T08:29:29.840 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.817+0000 7fb716db6640 10 monclient(hunting): authenticate will time out at 2716.023908s 2023-11-05T08:29:29.840 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.818+0000 7fb714b52640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb71006b1d0 0x7fb7101458b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:29.840 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.818+0000 7fb70ffff640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb71006bbe0 0x7fb7101d66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:29.840 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.818+0000 7fb715353640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb7100718f0 0x7fb7101d6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:29.841 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.818+0000 7fb714b52640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb71006b1d0 0x7fb7101458b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60048/0 (socket says 172.21.15.52:60048) 2023-11-05T08:29:29.841 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.818+0000 7fb714b52640 1 -- 172.21.15.52:0/2928441513 learned_addr learned my addr 172.21.15.52:0/2928441513 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-11-05T08:29:29.841 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.818+0000 7fb714b52640 10 monclient(hunting): get_auth_request con 0x7fb71006b1d0 auth_method 0 2023-11-05T08:29:29.841 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.818+0000 7fb714b52640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:29:29.841 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.818+0000 7fb714b52640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:29:29.842 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.818+0000 7fb714b52640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:29:29.842 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.818+0000 7fb715353640 10 monclient(hunting): get_auth_request con 0x7fb7100718f0 auth_method 0 2023-11-05T08:29:29.842 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.818+0000 7fb715353640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:29:29.842 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.818+0000 7fb715353640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:29:29.842 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.818+0000 7fb715353640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:29:29.842 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.819+0000 7fb70ffff640 10 monclient(hunting): get_auth_request con 0x7fb71006bbe0 auth_method 0 2023-11-05T08:29:29.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.819+0000 7fb70ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:29:29.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.819+0000 7fb70ffff640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:29:29.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.819+0000 7fb70ffff640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:29:29.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.819+0000 7fb714b52640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:29:29.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.819+0000 7fb714b52640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:29:29.844 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.819+0000 7fb714b52640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:29:29.844 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.819+0000 7fb715353640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:29:29.844 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.819+0000 7fb715353640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:29:29.844 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.819+0000 7fb715353640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:29:29.844 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.819+0000 7fb70ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:29:29.845 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.819+0000 7fb70ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:29:29.845 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.819+0000 7fb70ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:29:29.845 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.822+0000 7fb715353640 10 monclient(hunting): handle_auth_done global_id 20737 payload 824 2023-11-05T08:29:29.845 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.822+0000 7fb715353640 1 -- 172.21.15.52:0/2928441513 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb71006bbe0 msgr2=0x7fb7101d66a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:29.845 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.822+0000 7fb715353640 1 --2- 172.21.15.52:0/2928441513 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb71006bbe0 0x7fb7101d66a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:29.846 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.822+0000 7fb715353640 1 -- 172.21.15.52:0/2928441513 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb71006b1d0 msgr2=0x7fb7101458b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:29.846 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.822+0000 7fb715353640 1 --2- 172.21.15.52:0/2928441513 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb71006b1d0 0x7fb7101458b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:29.846 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.822+0000 7fb715353640 10 monclient: _finish_hunting 0 2023-11-05T08:29:29.846 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.822+0000 7fb715353640 1 monclient: found mon.noname-b 2023-11-05T08:29:29.846 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.822+0000 7fb715353640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:29:29.847 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.822+0000 7fb715353640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.156:3300/0 2023-11-05T08:29:29.847 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.822+0000 7fb715353640 1 -- 172.21.15.52:0/2928441513 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6fc009400 con 0x7fb7100718f0 2023-11-05T08:29:29.849 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.824+0000 7fb715353640 1 --2- 172.21.15.52:0/2928441513 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb7100718f0 0x7fb7101d6be0 secure :-1 s=READY pgs=5010 cs=0 l=1 rev1=1 crypto rx=0x7fb708001560 tx=0x7fb70800cbe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:29:29.849 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.824+0000 7fb70d7fa640 10 client.?.objecter ms_handle_connect 0x7fb7100718f0 2023-11-05T08:29:29.849 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.824+0000 7fb70d7fa640 10 client.?.objecter resend_mon_ops 2023-11-05T08:29:29.849 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.828+0000 7fb70d7fa640 1 -- 172.21.15.52:0/2928441513 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb70800ce30 con 0x7fb7100718f0 2023-11-05T08:29:29.849 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.828+0000 7fb70d7fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:29:29.850 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.828+0000 7fb70d7fa640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-05T08:29:29.850 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.828+0000 7fb70d7fa640 10 monclient: dump: 2023-11-05T08:29:29.850 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:29:29.850 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:29.851 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:29.851 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:29.851 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:29:29.851 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:29.851 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:29:29.852 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:29:29.852 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:29:29.852 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:29.852 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.828+0000 7fb70d7fa640 10 monclient: _finish_auth 0 2023-11-05T08:29:29.852 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.828+0000 7fb70d7fa640 10 monclient: _check_auth_tickets 2023-11-05T08:29:29.853 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.828+0000 7fb70d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:29:29.853 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.828+0000 7fb70d7fa640 1 -- 172.21.15.52:0/2928441513 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb70800a640 con 0x7fb7100718f0 2023-11-05T08:29:29.853 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.828+0000 7fb716db6640 5 monclient: authenticate success, global_id 20737 2023-11-05T08:29:29.853 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.828+0000 7fb716db6640 10 monclient: _renew_subs 2023-11-05T08:29:29.853 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.828+0000 7fb716db6640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:29:29.854 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.828+0000 7fb716db6640 1 -- 172.21.15.52:0/2928441513 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7100ab220 con 0x7fb7100718f0 2023-11-05T08:29:29.854 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.828+0000 7fb70d7fa640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:29:29.854 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.828+0000 7fb70d7fa640 1 -- 172.21.15.52:0/2928441513 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb70800aa10 con 0x7fb7100718f0 2023-11-05T08:29:29.854 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.828+0000 7fb70d7fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:29:29.854 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.828+0000 7fb70d7fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-05T08:29:29.855 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.828+0000 7fb70d7fa640 10 monclient: dump: 2023-11-05T08:29:29.855 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:29:29.855 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:29.855 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:29.855 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:29.856 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:29:29.856 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:29.856 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:29:29.856 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:29:29.856 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:29:29.856 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:29.857 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.828+0000 7fb70e7fc640 4 set_mon_vals no callback set 2023-11-05T08:29:29.857 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.828+0000 7fb716db6640 10 client.20737.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-05T08:29:29.857 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.828+0000 7fb716db6640 10 monclient: _renew_subs 2023-11-05T08:29:29.857 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.828+0000 7fb716db6640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:29:29.857 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.828+0000 7fb716db6640 1 -- 172.21.15.52:0/2928441513 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7100aef10 con 0x7fb7100718f0 2023-11-05T08:29:29.858 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.828+0000 7fb716db6640 1 librados: init done 2023-11-05T08:29:29.858 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.829+0000 7fb716db6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-05T08:29:29.858 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.829+0000 7fb716db6640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:29:29.858 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.829+0000 7fb716db6640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:29:29.858 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:29.829+0000 7fb716db6640 1 -- 172.21.15.52:0/2928441513 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7101d63c0 con 0x7fb7100718f0 2023-11-05T08:29:30.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.069+0000 7fb70d7fa640 1 -- 172.21.15.52:0/2928441513 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb70800ab70 con 0x7fb7100718f0 2023-11-05T08:29:30.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.070+0000 7fb70d7fa640 1 --2- 172.21.15.52:0/2928441513 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7fb6f406c800 0x7fb6f406ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:30.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.070+0000 7fb714b52640 1 --2- 172.21.15.52:0/2928441513 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7fb6f406c800 0x7fb6f406ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:30.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.070+0000 7fb714b52640 10 monclient: get_auth_request con 0x7fb6f406c800 auth_method 0 2023-11-05T08:29:30.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.071+0000 7fb714b52640 1 --2- 172.21.15.52:0/2928441513 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7fb6f406c800 0x7fb6f406ecc0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fb704009c00 tx=0x7fb704009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:29:30.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.071+0000 7fb70d7fa640 10 client.20737.objecter ms_handle_connect 0x7fb6f406c800 2023-11-05T08:29:30.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.072+0000 7fb70d7fa640 1 -- 172.21.15.52:0/2928441513 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(932..932 src has 619..932) v4 ==== 6193+0+0 (secure 0 0 0) 0x7fb70800ae20 con 0x7fb7100718f0 2023-11-05T08:29:30.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.072+0000 7fb70d7fa640 10 client.20737.objecter ms_dispatch 0x7fb710000b90 osd_map(932..932 src has 619..932) v4 2023-11-05T08:29:30.074 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.072+0000 7fb70d7fa640 3 client.20737.objecter handle_osd_map got epochs [932,932] > 0 2023-11-05T08:29:30.074 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.072+0000 7fb70d7fa640 3 client.20737.objecter handle_osd_map decoding full epoch 932 2023-11-05T08:29:30.074 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.072+0000 7fb70d7fa640 20 client.20737.objecter dump_active .. 0 homeless 2023-11-05T08:29:30.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.082+0000 7fb70d7fa640 1 -- 172.21.15.52:0/2928441513 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb708053e70 con 0x7fb7100718f0 2023-11-05T08:29:30.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.082+0000 7fb70d7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:29:30.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.082+0000 7fb70d7fa640 10 monclient: _finish_command 1 = system:0 2023-11-05T08:29:30.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.260+0000 7fb716db6640 1 -- 172.21.15.52:0/2928441513 --> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7fb710072160 con 0x7fb6f406c800 2023-11-05T08:29:30.262 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.260+0000 7fb70d7fa640 1 -- 172.21.15.52:0/2928441513 <== mgr.4108 v2:172.21.15.156:6800/3320012339 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb704011b20 con 0x7fb6f406c800 2023-11-05T08:29:30.262 INFO:teuthology.orchestra.run.smithi052.stderr:instructed osd(s) 3 to deep-scrub 2023-11-05T08:29:30.264 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.262+0000 7fb716db6640 10 librados: watch_flush enter 2023-11-05T08:29:30.264 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.262+0000 7fb716db6640 10 librados: watch_flush exit 2023-11-05T08:29:30.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.262+0000 7fb716db6640 20 client.20737.objecter shutdown clearing up homeless session... 2023-11-05T08:29:30.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.262+0000 7fb716db6640 10 client.20737.objecter successfully canceled tick 2023-11-05T08:29:30.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.262+0000 7fb716db6640 1 -- 172.21.15.52:0/2928441513 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7fb6f406c800 msgr2=0x7fb6f406ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:30.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.262+0000 7fb716db6640 1 --2- 172.21.15.52:0/2928441513 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7fb6f406c800 0x7fb6f406ecc0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fb704009c00 tx=0x7fb704009190 comp rx=0 tx=0).stop 2023-11-05T08:29:30.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.262+0000 7fb716db6640 10 monclient: shutdown 2023-11-05T08:29:30.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.262+0000 7fb716db6640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:29:30.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.262+0000 7fb716db6640 1 -- 172.21.15.52:0/2928441513 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb7100718f0 msgr2=0x7fb7101d6be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:30.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.262+0000 7fb716db6640 1 --2- 172.21.15.52:0/2928441513 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb7100718f0 0x7fb7101d6be0 secure :-1 s=READY pgs=5010 cs=0 l=1 rev1=1 crypto rx=0x7fb708001560 tx=0x7fb70800cbe0 comp rx=0 tx=0).stop 2023-11-05T08:29:30.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.263+0000 7fb716db6640 1 -- 172.21.15.52:0/2928441513 shutdown_connections 2023-11-05T08:29:30.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.263+0000 7fb716db6640 1 --2- 172.21.15.52:0/2928441513 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7fb6f406c800 0x7fb6f406ecc0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:30.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.263+0000 7fb716db6640 1 --2- 172.21.15.52:0/2928441513 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb7100718f0 0x7fb7101d6be0 unknown :-1 s=CLOSED pgs=5010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:30.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.263+0000 7fb716db6640 1 --2- 172.21.15.52:0/2928441513 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fb71006bbe0 0x7fb7101d66a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:30.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.263+0000 7fb716db6640 1 --2- 172.21.15.52:0/2928441513 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb71006b1d0 0x7fb7101458b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:30.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.263+0000 7fb716db6640 1 -- 172.21.15.52:0/2928441513 >> 172.21.15.52:0/2928441513 conn(0x7fb7100665e0 msgr2=0x7fb7100b0430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:29:30.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.263+0000 7fb716db6640 1 -- 172.21.15.52:0/2928441513 shutdown_connections 2023-11-05T08:29:30.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.263+0000 7fb716db6640 1 -- 172.21.15.52:0/2928441513 wait complete. 2023-11-05T08:29:30.268 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.263+0000 7fb716db6640 1 librados: shutdown 2023-11-05T08:29:30.275 INFO:tasks.ceph:Scrubbing osd.4 2023-11-05T08:29:30.276 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-11-05T08:29:30.397 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.396+0000 7f4d4ebb0640 10 monclient: get_monmap_and_config 2023-11-05T08:29:30.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.396+0000 7f4d4ebb0640 10 monclient: build_initial_monmap 2023-11-05T08:29:30.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.396+0000 7f4d4ebb0640 10 monclient: monmap: 2023-11-05T08:29:30.398 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:29:30.399 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:30.399 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:29:30.398345+0000 2023-11-05T08:29:30.399 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:29:30.398345+0000 2023-11-05T08:29:30.399 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:29:30.399 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:30.400 INFO:teuthology.orchestra.run.smithi052.stderr:0: v1:172.21.15.52:6789/0 mon.noname-a-legacy 2023-11-05T08:29:30.400 INFO:teuthology.orchestra.run.smithi052.stderr:1: v1:172.21.15.156:6789/0 mon.noname-c-legacy 2023-11-05T08:29:30.400 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-b 2023-11-05T08:29:30.400 INFO:teuthology.orchestra.run.smithi052.stderr:3: v2:172.21.15.52:3300/0 mon.noname-a 2023-11-05T08:29:30.400 INFO:teuthology.orchestra.run.smithi052.stderr:4: v2:172.21.15.156:3300/0 mon.noname-c 2023-11-05T08:29:30.401 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:30.403 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.397+0000 7f4d4ebb0640 1 Processor -- start 2023-11-05T08:29:30.403 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.397+0000 7f4d4ebb0640 1 -- start start 2023-11-05T08:29:30.403 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.397+0000 7f4d4ebb0640 10 monclient: init 2023-11-05T08:29:30.403 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.398+0000 7f4d4ebb0640 10 monclient: _reopen_session rank -1 2023-11-05T08:29:30.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.398+0000 7f4d4ebb0640 10 monclient: _add_conns ranks=[2,1,4,0,3] 2023-11-05T08:29:30.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.398+0000 7f4d4ebb0640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4d480b42c0 0x7f4d480a9210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:30.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.398+0000 7f4d4ebb0640 10 monclient(hunting): picked mon.noname-b con 0x7f4d480b42c0 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:29:30.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.398+0000 7f4d4ebb0640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f4d480a8770 addr v1:172.21.15.156:6789/0 2023-11-05T08:29:30.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.398+0000 7f4d4ebb0640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f4d4813f300 0x7f4d48144f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:30.405 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.398+0000 7f4d4ebb0640 10 monclient(hunting): picked mon.noname-c con 0x7f4d4813f300 addr v2:172.21.15.156:3300/0 2023-11-05T08:29:30.405 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.398+0000 7f4d4ebb0640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d480a8d00 con 0x7f4d480a8770 2023-11-05T08:29:30.405 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.398+0000 7f4d4ebb0640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:30.405 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.398+0000 7f4d4ebb0640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d480b46a0 con 0x7f4d4813f300 2023-11-05T08:29:30.405 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.398+0000 7f4d4ebb0640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:30.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.398+0000 7f4d4ebb0640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d480ade80 con 0x7f4d480b42c0 2023-11-05T08:29:30.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.398+0000 7f4d4ebb0640 10 monclient(hunting): _renew_subs 2023-11-05T08:29:30.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.398+0000 7f4d4ebb0640 10 monclient(hunting): authenticate will time out at 2716.604171s 2023-11-05T08:29:30.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.398+0000 7f4d4d14d640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f4d4813f300 0x7f4d48144f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:30.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.398+0000 7f4d4c94c640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4d480b42c0 0x7f4d480a9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:30.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.399+0000 7f4d4c94c640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4d480b42c0 0x7f4d480a9210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.52:59782/0 (socket says 172.21.15.52:59782) 2023-11-05T08:29:30.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.399+0000 7f4d4c94c640 1 -- 172.21.15.52:0/3462127262 learned_addr learned my addr 172.21.15.52:0/3462127262 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-11-05T08:29:30.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.399+0000 7f4d4c94c640 10 monclient(hunting): get_auth_request con 0x7f4d480b42c0 auth_method 0 2023-11-05T08:29:30.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.399+0000 7f4d4c94c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:29:30.408 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.399+0000 7f4d4c94c640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:29:30.408 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.399+0000 7f4d4c94c640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:29:30.408 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.399+0000 7f4d4d14d640 10 monclient(hunting): get_auth_request con 0x7f4d4813f300 auth_method 0 2023-11-05T08:29:30.408 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.399+0000 7f4d4d14d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:29:30.408 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.399+0000 7f4d4d14d640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:29:30.409 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.399+0000 7f4d4d14d640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:29:30.409 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.400+0000 7f4d4c94c640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:29:30.409 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.400+0000 7f4d4c94c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:29:30.409 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.400+0000 7f4d4c94c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:29:30.409 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.400+0000 7f4d4d14d640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:29:30.409 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.400+0000 7f4d4d14d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:29:30.410 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.400+0000 7f4d4d14d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:29:30.410 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.401+0000 7f4d4c94c640 10 monclient(hunting): handle_auth_done global_id 16988 payload 274 2023-11-05T08:29:30.410 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.401+0000 7f4d4c94c640 1 -- 172.21.15.52:0/3462127262 >> v2:172.21.15.156:3300/0 conn(0x7f4d4813f300 msgr2=0x7f4d48144f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-05T08:29:30.410 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.401+0000 7f4d4c94c640 1 --2- 172.21.15.52:0/3462127262 >> v2:172.21.15.156:3300/0 conn(0x7f4d4813f300 0x7f4d48144f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:30.410 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.401+0000 7f4d4c94c640 1 -- 172.21.15.52:0/3462127262 >> v1:172.21.15.156:6789/0 conn(0x7f4d480a8770 legacy=0x7f4d4813ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:30.411 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.401+0000 7f4d4c94c640 10 monclient: _finish_hunting 0 2023-11-05T08:29:30.411 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.401+0000 7f4d4c94c640 1 monclient: found mon.noname-b 2023-11-05T08:29:30.411 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.401+0000 7f4d4c94c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:29:30.411 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.401+0000 7f4d4c94c640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.52:3301/0 2023-11-05T08:29:30.411 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.401+0000 7f4d4c94c640 1 -- 172.21.15.52:0/3462127262 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d481454a0 con 0x7f4d480b42c0 2023-11-05T08:29:30.414 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.405+0000 7f4d4c94c640 1 --2- 172.21.15.52:0/3462127262 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4d480b42c0 0x7f4d480a9210 secure :-1 s=READY pgs=3082 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c009870 tx=0x7f4d3c02b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e5917ea7cfe9c20 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:29:30.414 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.410+0000 7f4d477fe640 1 -- 172.21.15.52:0/3462127262 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d3c0317c0 con 0x7f4d480b42c0 2023-11-05T08:29:30.414 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.410+0000 7f4d477fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:29:30.414 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.410+0000 7f4d477fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-05T08:29:30.415 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.410+0000 7f4d477fe640 10 monclient: dump: 2023-11-05T08:29:30.415 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:29:30.415 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:30.415 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:30.415 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:30.416 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:29:30.416 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:30.416 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:29:30.416 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:29:30.416 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:29:30.417 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:30.417 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.411+0000 7f4d477fe640 10 monclient: _finish_auth 0 2023-11-05T08:29:30.417 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.411+0000 7f4d477fe640 10 monclient: _check_auth_tickets 2023-11-05T08:29:30.417 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.411+0000 7f4d477fe640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:29:30.417 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.411+0000 7f4d477fe640 1 -- 172.21.15.52:0/3462127262 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d3c031920 con 0x7f4d480b42c0 2023-11-05T08:29:30.418 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.411+0000 7f4d4ebb0640 5 monclient: authenticate success, global_id 16988 2023-11-05T08:29:30.418 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.411+0000 7f4d4ebb0640 20 monclient: get_monmap_and_config waiting for monmap|config 2023-11-05T08:29:30.418 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.411+0000 7f4d477fe640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:29:30.418 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.411+0000 7f4d477fe640 1 -- 172.21.15.52:0/3462127262 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d3c031cb0 con 0x7f4d480b42c0 2023-11-05T08:29:30.418 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.411+0000 7f4d4ebb0640 10 monclient: get_monmap_and_config success 2023-11-05T08:29:30.419 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.411+0000 7f4d4ebb0640 4 set_mon_vals no callback set 2023-11-05T08:29:30.419 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.411+0000 7f4d477fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:29:30.419 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.411+0000 7f4d477fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-11-05T08:29:30.419 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.411+0000 7f4d477fe640 10 monclient: dump: 2023-11-05T08:29:30.419 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:29:30.420 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:30.420 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:30.420 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:30.420 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:29:30.420 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:30.421 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:29:30.421 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:29:30.421 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:29:30.421 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:30.421 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.411+0000 7f4d4ebb0640 10 monclient: shutdown 2023-11-05T08:29:30.421 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.411+0000 7f4d4ebb0640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:29:30.422 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.411+0000 7f4d4ebb0640 1 -- 172.21.15.52:0/3462127262 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4d480b42c0 msgr2=0x7f4d480a9210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:30.422 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.411+0000 7f4d4ebb0640 1 --2- 172.21.15.52:0/3462127262 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4d480b42c0 0x7f4d480a9210 secure :-1 s=READY pgs=3082 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c009870 tx=0x7f4d3c02b860 comp rx=0 tx=0).stop 2023-11-05T08:29:30.422 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.411+0000 7f4d4ebb0640 1 -- 172.21.15.52:0/3462127262 shutdown_connections 2023-11-05T08:29:30.422 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.411+0000 7f4d4ebb0640 1 --2- 172.21.15.52:0/3462127262 >> v2:172.21.15.156:3300/0 conn(0x7f4d4813f300 0x7f4d48144f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:30.422 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.411+0000 7f4d4ebb0640 1 --2- 172.21.15.52:0/3462127262 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4d480b42c0 0x7f4d480a9210 unknown :-1 s=CLOSED pgs=3082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:30.423 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.411+0000 7f4d4ebb0640 1 -- 172.21.15.52:0/3462127262 >> 172.21.15.52:0/3462127262 conn(0x7f4d48065ee0 msgr2=0x7f4d480662f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:29:30.423 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.411+0000 7f4d4ebb0640 1 -- 172.21.15.52:0/3462127262 shutdown_connections 2023-11-05T08:29:30.423 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.411+0000 7f4d4ebb0640 1 -- 172.21.15.52:0/3462127262 wait complete. 2023-11-05T08:29:30.423 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.412+0000 7f4d4ebb0640 10 monclient: build_initial_monmap 2023-11-05T08:29:30.424 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.412+0000 7f4d4ebb0640 10 monclient: monmap: 2023-11-05T08:29:30.424 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:29:30.424 INFO:teuthology.orchestra.run.smithi052.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-05T08:29:30.424 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 0.000000 2023-11-05T08:29:30.424 INFO:teuthology.orchestra.run.smithi052.stderr:created 0.000000 2023-11-05T08:29:30.425 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:29:30.425 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:30.425 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.noname-a 2023-11-05T08:29:30.425 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.noname-b 2023-11-05T08:29:30.425 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-c 2023-11-05T08:29:30.426 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:30.426 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.412+0000 7f4d4ebb0640 1 librados: starting msgr at 2023-11-05T08:29:30.426 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.412+0000 7f4d4ebb0640 1 librados: starting objecter 2023-11-05T08:29:30.426 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.412+0000 7f4d4ebb0640 1 Processor -- start 2023-11-05T08:29:30.426 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.412+0000 7f4d4ebb0640 1 -- start start 2023-11-05T08:29:30.427 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.412+0000 7f4d4ebb0640 1 librados: setting wanted keys 2023-11-05T08:29:30.427 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.412+0000 7f4d4ebb0640 1 librados: calling monclient init 2023-11-05T08:29:30.427 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.412+0000 7f4d4ebb0640 10 monclient: init 2023-11-05T08:29:30.431 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.413+0000 7f4d4ebb0640 10 monclient: _reopen_session rank -1 2023-11-05T08:29:30.431 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.413+0000 7f4d4ebb0640 10 monclient: _add_conns ranks=[1,0,2] 2023-11-05T08:29:30.431 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.413+0000 7f4d4ebb0640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4d480a8770 0x7f4d480ab0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:30.431 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.413+0000 7f4d4ebb0640 10 monclient(hunting): picked mon.noname-b con 0x7f4d480a8770 addr [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] 2023-11-05T08:29:30.431 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.413+0000 7f4d4ebb0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d480b42c0 0x7f4d480abed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:30.432 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.413+0000 7f4d4ebb0640 10 monclient(hunting): picked mon.noname-a con 0x7f4d480b42c0 addr [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] 2023-11-05T08:29:30.432 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.413+0000 7f4d4ebb0640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4d4813f300 0x7f4d48140ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:30.432 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.413+0000 7f4d4ebb0640 10 monclient(hunting): picked mon.noname-c con 0x7f4d4813f300 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:29:30.432 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.413+0000 7f4d4ebb0640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:30.432 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.413+0000 7f4d4ebb0640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d48140a40 con 0x7f4d480b42c0 2023-11-05T08:29:30.433 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.413+0000 7f4d4ebb0640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:30.433 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.413+0000 7f4d4ebb0640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d480aabd0 con 0x7f4d480a8770 2023-11-05T08:29:30.433 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.413+0000 7f4d4ebb0640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:30.433 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.413+0000 7f4d4ebb0640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d480aad40 con 0x7f4d4813f300 2023-11-05T08:29:30.434 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.413+0000 7f4d4ebb0640 10 monclient(hunting): _renew_subs 2023-11-05T08:29:30.434 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.413+0000 7f4d4ebb0640 10 monclient(hunting): authenticate will time out at 2716.619770s 2023-11-05T08:29:30.434 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.414+0000 7f4d4c94c640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4d480a8770 0x7f4d480ab0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:30.434 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.414+0000 7f4d4d14d640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4d4813f300 0x7f4d48140ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:30.434 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.414+0000 7f4d4c94c640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4d480a8770 0x7f4d480ab0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.52:34552/0 (socket says 172.21.15.52:34552) 2023-11-05T08:29:30.435 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.414+0000 7f4d4c94c640 1 -- 172.21.15.52:0/4283115260 learned_addr learned my addr 172.21.15.52:0/4283115260 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-11-05T08:29:30.435 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.414+0000 7f4d4c94c640 10 monclient(hunting): get_auth_request con 0x7f4d480a8770 auth_method 0 2023-11-05T08:29:30.435 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.414+0000 7f4d4c94c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:29:30.435 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.414+0000 7f4d4c94c640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:29:30.436 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.414+0000 7f4d4c94c640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:29:30.436 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.414+0000 7f4d4d14d640 10 monclient(hunting): get_auth_request con 0x7f4d4813f300 auth_method 0 2023-11-05T08:29:30.436 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.414+0000 7f4d4d14d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:29:30.436 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.414+0000 7f4d4d14d640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:29:30.436 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.414+0000 7f4d4d14d640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:29:30.437 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.415+0000 7f4d4c94c640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:29:30.437 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.415+0000 7f4d4c94c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:29:30.437 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.415+0000 7f4d4c94c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:29:30.437 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.415+0000 7f4d4d14d640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:29:30.437 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.415+0000 7f4d4d14d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:29:30.438 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.415+0000 7f4d4d14d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:29:30.438 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.417+0000 7f4d4c94c640 10 monclient(hunting): handle_auth_done global_id 20743 payload 824 2023-11-05T08:29:30.438 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.417+0000 7f4d4c94c640 1 -- 172.21.15.52:0/4283115260 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4d4813f300 msgr2=0x7f4d48140ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:30.438 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.417+0000 7f4d4c94c640 1 --2- 172.21.15.52:0/4283115260 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4d4813f300 0x7f4d48140ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:30.438 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.417+0000 7f4d4c94c640 1 -- 172.21.15.52:0/4283115260 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d480b42c0 msgr2=0x7f4d480abed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:30.438 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.417+0000 7f4d4c94c640 1 --2- 172.21.15.52:0/4283115260 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d480b42c0 0x7f4d480abed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:30.439 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.417+0000 7f4d4c94c640 10 monclient: _finish_hunting 0 2023-11-05T08:29:30.439 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.417+0000 7f4d4c94c640 1 monclient: found mon.noname-b 2023-11-05T08:29:30.439 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.417+0000 7f4d4c94c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:29:30.439 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.417+0000 7f4d4c94c640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.156:3300/0 2023-11-05T08:29:30.439 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.417+0000 7f4d4c94c640 1 -- 172.21.15.52:0/4283115260 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d3c0094d0 con 0x7f4d480a8770 2023-11-05T08:29:30.440 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.420+0000 7f4d4c94c640 1 --2- 172.21.15.52:0/4283115260 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4d480a8770 0x7f4d480ab0c0 secure :-1 s=READY pgs=5012 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c000c00 tx=0x7f4d3c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:29:30.440 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.420+0000 7f4d457fa640 10 client.?.objecter ms_handle_connect 0x7f4d480a8770 2023-11-05T08:29:30.440 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.420+0000 7f4d457fa640 10 client.?.objecter resend_mon_ops 2023-11-05T08:29:30.440 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.424+0000 7f4d457fa640 1 -- 172.21.15.52:0/4283115260 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d3c032860 con 0x7f4d480a8770 2023-11-05T08:29:30.440 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.424+0000 7f4d457fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:29:30.440 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.424+0000 7f4d457fa640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-05T08:29:30.441 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.424+0000 7f4d457fa640 10 monclient: dump: 2023-11-05T08:29:30.441 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:29:30.441 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:30.441 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:30.441 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:30.441 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:29:30.442 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:30.442 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:29:30.442 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:29:30.442 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:29:30.442 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:30.443 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.424+0000 7f4d457fa640 10 monclient: _finish_auth 0 2023-11-05T08:29:30.443 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.424+0000 7f4d457fa640 10 monclient: _check_auth_tickets 2023-11-05T08:29:30.443 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.424+0000 7f4d457fa640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:29:30.443 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.424+0000 7f4d457fa640 1 -- 172.21.15.52:0/4283115260 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d3c0329c0 con 0x7f4d480a8770 2023-11-05T08:29:30.443 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.424+0000 7f4d457fa640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:29:30.444 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.424+0000 7f4d457fa640 1 -- 172.21.15.52:0/4283115260 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d3c032d70 con 0x7f4d480a8770 2023-11-05T08:29:30.444 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.424+0000 7f4d457fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:29:30.444 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.424+0000 7f4d457fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-05T08:29:30.444 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.424+0000 7f4d457fa640 10 monclient: dump: 2023-11-05T08:29:30.444 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:29:30.445 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:30.445 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:30.445 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:30.445 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:29:30.445 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:30.446 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:29:30.446 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:29:30.446 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:29:30.446 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:30.446 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.424+0000 7f4d4ebb0640 5 monclient: authenticate success, global_id 20743 2023-11-05T08:29:30.446 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.424+0000 7f4d46ffd640 4 set_mon_vals no callback set 2023-11-05T08:29:30.447 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.424+0000 7f4d4ebb0640 10 monclient: _renew_subs 2023-11-05T08:29:30.447 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.424+0000 7f4d4ebb0640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:29:30.447 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.424+0000 7f4d4ebb0640 1 -- 172.21.15.52:0/4283115260 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d480ac550 con 0x7f4d480a8770 2023-11-05T08:29:30.447 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.424+0000 7f4d4ebb0640 10 client.20743.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-05T08:29:30.447 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.424+0000 7f4d4ebb0640 10 monclient: _renew_subs 2023-11-05T08:29:30.448 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.424+0000 7f4d4ebb0640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:29:30.448 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.424+0000 7f4d4ebb0640 1 -- 172.21.15.52:0/4283115260 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d481415f0 con 0x7f4d480a8770 2023-11-05T08:29:30.448 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.424+0000 7f4d4ebb0640 1 librados: init done 2023-11-05T08:29:30.448 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.425+0000 7f4d4ebb0640 10 client.20743.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:29:30.448 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.425+0000 7f4d4ebb0640 15 client.20743.objecter _session_command_op_assign -1 1 2023-11-05T08:29:30.449 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.425+0000 7f4d4ebb0640 20 client.20743.objecter _get_session osd=-1 returning homeless 2023-11-05T08:29:30.449 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.425+0000 7f4d4ebb0640 10 client.20743.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-05T08:29:30.449 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.425+0000 7f4d4ebb0640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:29:30.449 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.425+0000 7f4d4ebb0640 1 -- 172.21.15.52:0/4283115260 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4d480ac770 con 0x7f4d480a8770 2023-11-05T08:29:30.451 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.445+0000 7f4d457fa640 1 -- 172.21.15.52:0/4283115260 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4d3c04e450 con 0x7f4d480a8770 2023-11-05T08:29:30.451 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.445+0000 7f4d457fa640 1 --2- 172.21.15.52:0/4283115260 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f4d2c06c800 0x7f4d2c06ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:30.451 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.446+0000 7f4d47fff640 1 --2- 172.21.15.52:0/4283115260 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f4d2c06c800 0x7f4d2c06ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:30.452 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.446+0000 7f4d47fff640 10 monclient: get_auth_request con 0x7f4d2c06c800 auth_method 0 2023-11-05T08:29:30.452 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.446+0000 7f4d47fff640 1 --2- 172.21.15.52:0/4283115260 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f4d2c06c800 0x7f4d2c06ecc0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f4d34000f60 tx=0x7f4d340079b0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:29:30.452 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.446+0000 7f4d457fa640 10 client.20743.objecter ms_handle_connect 0x7f4d2c06c800 2023-11-05T08:29:30.452 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.448+0000 7f4d457fa640 1 -- 172.21.15.52:0/4283115260 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(932..932 src has 619..932) v4 ==== 6193+0+0 (secure 0 0 0) 0x7f4d3c07afb0 con 0x7f4d480a8770 2023-11-05T08:29:30.453 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.448+0000 7f4d457fa640 10 client.20743.objecter ms_dispatch 0x7f4d48000b90 osd_map(932..932 src has 619..932) v4 2023-11-05T08:29:30.453 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.448+0000 7f4d457fa640 3 client.20743.objecter handle_osd_map got epochs [932,932] > 0 2023-11-05T08:29:30.453 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.448+0000 7f4d457fa640 3 client.20743.objecter handle_osd_map decoding full epoch 932 2023-11-05T08:29:30.453 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.448+0000 7f4d457fa640 10 client.20743.objecter checking command 1 2023-11-05T08:29:30.453 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.448+0000 7f4d457fa640 1 --2- 172.21.15.52:0/4283115260 >> [v2:172.21.15.156:6814/3458684008,v1:172.21.15.156:6816/3458684008] conn(0x7f4d2c074050 0x7f4d2c0764f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:30.454 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.448+0000 7f4d457fa640 20 client.20743.objecter _get_session s=0x7f4d2c073980 osd=4 3 2023-11-05T08:29:30.454 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.448+0000 7f4d457fa640 20 client.20743.objecter put_session s=0x7f4d2c073980 osd=4 3 2023-11-05T08:29:30.454 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.448+0000 7f4d457fa640 15 client.20743.objecter _session_command_op_remove -1 1 2023-11-05T08:29:30.454 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.448+0000 7f4d457fa640 20 client.20743.objecter _get_session s=0x7f4d2c073980 osd=4 3 2023-11-05T08:29:30.454 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.448+0000 7f4d457fa640 20 client.20743.objecter get_session s=0x7f4d2c073980 osd=4 3 2023-11-05T08:29:30.454 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.448+0000 7f4d457fa640 15 client.20743.objecter _session_command_op_assign 4 1 2023-11-05T08:29:30.455 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.448+0000 7f4d457fa640 20 client.20743.objecter put_session s=0x7f4d2c073980 osd=4 4 2023-11-05T08:29:30.455 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.448+0000 7f4d457fa640 10 client.20743.objecter _send_command 1 2023-11-05T08:29:30.455 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.448+0000 7f4d457fa640 1 -- 172.21.15.52:0/4283115260 --> [v2:172.21.15.156:6814/3458684008,v1:172.21.15.156:6816/3458684008] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4d2c076bc0 con 0x7f4d2c074050 2023-11-05T08:29:30.455 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.448+0000 7f4d457fa640 20 client.20743.objecter dump_active .. 0 homeless 2023-11-05T08:29:30.455 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.449+0000 7f4d4d14d640 1 --2- 172.21.15.52:0/4283115260 >> [v2:172.21.15.156:6814/3458684008,v1:172.21.15.156:6816/3458684008] conn(0x7f4d2c074050 0x7f4d2c0764f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:30.456 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.449+0000 7f4d4d14d640 10 monclient: get_auth_request con 0x7f4d2c074050 auth_method 0 2023-11-05T08:29:30.456 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.452+0000 7f4d457fa640 10 client.20743.objecter ms_handle_connect 0x7f4d2c074050 2023-11-05T08:29:30.456 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.452+0000 7f4d4d14d640 1 --2- 172.21.15.52:0/4283115260 >> [v2:172.21.15.156:6814/3458684008,v1:172.21.15.156:6816/3458684008] conn(0x7f4d2c074050 0x7f4d2c0764f0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:29:30.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.476+0000 7f4d457fa640 1 -- 172.21.15.52:0/4283115260 <== osd.4 v2:172.21.15.156:6814/3458684008 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f4d2c076bc0 con 0x7f4d2c074050 2023-11-05T08:29:30.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.476+0000 7f4d457fa640 10 client.20743.objecter ms_dispatch 0x7f4d48000b90 command_reply(tid 1: 0 ) v1 2023-11-05T08:29:30.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.476+0000 7f4d457fa640 10 client.20743.objecter _finish_command 1 = system:0 2023-11-05T08:29:30.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.476+0000 7f4d457fa640 20 client.20743.objecter put_session s=0x7f4d2c073980 osd=4 4 2023-11-05T08:29:30.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.476+0000 7f4d457fa640 15 client.20743.objecter _session_command_op_remove 4 1 2023-11-05T08:29:30.490 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.489+0000 7f4d4ebb0640 10 client.20743.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2023-11-05T08:29:30.491 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.489+0000 7f4d4ebb0640 15 client.20743.objecter _session_command_op_assign -1 2 2023-11-05T08:29:30.491 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.489+0000 7f4d4ebb0640 20 client.20743.objecter _get_session s=0x7f4d2c073980 osd=4 3 2023-11-05T08:29:30.491 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.489+0000 7f4d4ebb0640 20 client.20743.objecter put_session s=0x7f4d2c073980 osd=4 3 2023-11-05T08:29:30.491 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.489+0000 7f4d4ebb0640 20 client.20743.objecter _get_session s=0x7f4d2c073980 osd=4 3 2023-11-05T08:29:30.491 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.489+0000 7f4d4ebb0640 15 client.20743.objecter _session_command_op_remove -1 2 2023-11-05T08:29:30.491 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.489+0000 7f4d4ebb0640 20 client.20743.objecter get_session s=0x7f4d2c073980 osd=4 3 2023-11-05T08:29:30.492 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.489+0000 7f4d4ebb0640 15 client.20743.objecter _session_command_op_assign 4 2 2023-11-05T08:29:30.492 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.489+0000 7f4d4ebb0640 20 client.20743.objecter put_session s=0x7f4d2c073980 osd=4 4 2023-11-05T08:29:30.492 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.489+0000 7f4d4ebb0640 10 client.20743.objecter _send_command 2 2023-11-05T08:29:30.492 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.489+0000 7f4d4ebb0640 1 -- 172.21.15.52:0/4283115260 --> [v2:172.21.15.156:6814/3458684008,v1:172.21.15.156:6816/3458684008] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f4d48075530 con 0x7f4d2c074050 2023-11-05T08:29:30.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.501+0000 7f4d457fa640 1 -- 172.21.15.52:0/4283115260 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_get_version_reply(handle=1 version=932) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4d3c076bf0 con 0x7f4d480a8770 2023-11-05T08:29:30.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.501+0000 7f4d457fa640 10 monclient: handle_get_version_reply finishing 1 version 932 2023-11-05T08:29:30.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.504+0000 7f4d457fa640 1 -- 172.21.15.52:0/4283115260 <== osd.4 v2:172.21.15.156:6814/3458684008 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f4d48075530 con 0x7f4d2c074050 2023-11-05T08:29:30.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.504+0000 7f4d457fa640 10 client.20743.objecter ms_dispatch 0x7f4d48000b90 command_reply(tid 2: 0 ) v1 2023-11-05T08:29:30.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.504+0000 7f4d457fa640 10 client.20743.objecter _finish_command 2 = system:0 2023-11-05T08:29:30.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.504+0000 7f4d457fa640 20 client.20743.objecter put_session s=0x7f4d2c073980 osd=4 4 2023-11-05T08:29:30.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.504+0000 7f4d457fa640 15 client.20743.objecter _session_command_op_remove 4 2 2023-11-05T08:29:30.506 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2023-11-05T08:29:30.506 INFO:teuthology.orchestra.run.smithi052.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-05T08:29:30.507 INFO:teuthology.orchestra.run.smithi052.stdout:} 2023-11-05T08:29:30.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.504+0000 7f4d4ebb0640 10 librados: watch_flush enter 2023-11-05T08:29:30.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.504+0000 7f4d4ebb0640 10 librados: watch_flush exit 2023-11-05T08:29:30.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.504+0000 7f4d4ebb0640 10 client.20743.objecter close_session for osd.4 2023-11-05T08:29:30.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.504+0000 7f4d4ebb0640 1 -- 172.21.15.52:0/4283115260 >> [v2:172.21.15.156:6814/3458684008,v1:172.21.15.156:6816/3458684008] conn(0x7f4d2c074050 msgr2=0x7f4d2c0764f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:30.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.504+0000 7f4d4ebb0640 1 --2- 172.21.15.52:0/4283115260 >> [v2:172.21.15.156:6814/3458684008,v1:172.21.15.156:6816/3458684008] conn(0x7f4d2c074050 0x7f4d2c0764f0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:30.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.504+0000 7f4d4ebb0640 20 client.20743.objecter put_session s=0x7f4d2c073980 osd=4 1 2023-11-05T08:29:30.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.504+0000 7f4d4ebb0640 20 client.20743.objecter shutdown clearing up homeless session... 2023-11-05T08:29:30.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.504+0000 7f4d4ebb0640 10 client.20743.objecter successfully canceled tick 2023-11-05T08:29:30.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.504+0000 7f4d4ebb0640 1 -- 172.21.15.52:0/4283115260 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f4d2c06c800 msgr2=0x7f4d2c06ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:30.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.504+0000 7f4d4ebb0640 1 --2- 172.21.15.52:0/4283115260 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f4d2c06c800 0x7f4d2c06ecc0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f4d34000f60 tx=0x7f4d340079b0 comp rx=0 tx=0).stop 2023-11-05T08:29:30.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.504+0000 7f4d4ebb0640 10 monclient: shutdown 2023-11-05T08:29:30.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.504+0000 7f4d4ebb0640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:29:30.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.504+0000 7f4d4ebb0640 1 -- 172.21.15.52:0/4283115260 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4d480a8770 msgr2=0x7f4d480ab0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:30.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.504+0000 7f4d4ebb0640 1 --2- 172.21.15.52:0/4283115260 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4d480a8770 0x7f4d480ab0c0 secure :-1 s=READY pgs=5012 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c000c00 tx=0x7f4d3c0046c0 comp rx=0 tx=0).stop 2023-11-05T08:29:30.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.504+0000 7f4d4d14d640 1 -- 172.21.15.52:0/4283115260 reap_dead start 2023-11-05T08:29:30.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.504+0000 7f4d4ebb0640 1 -- 172.21.15.52:0/4283115260 shutdown_connections 2023-11-05T08:29:30.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.504+0000 7f4d4ebb0640 1 -- 172.21.15.52:0/4283115260 >> 172.21.15.52:0/4283115260 conn(0x7f4d48065ee0 msgr2=0x7f4d480b31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:29:30.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.504+0000 7f4d4ebb0640 1 -- 172.21.15.52:0/4283115260 shutdown_connections 2023-11-05T08:29:30.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.504+0000 7f4d4ebb0640 1 -- 172.21.15.52:0/4283115260 wait complete. 2023-11-05T08:29:30.512 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.504+0000 7f4d4ebb0640 1 librados: shutdown 2023-11-05T08:29:30.516 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-11-05T08:29:30.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.624+0000 7fa87cef2640 10 monclient: get_monmap_and_config 2023-11-05T08:29:30.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.624+0000 7fa87cef2640 10 monclient: build_initial_monmap 2023-11-05T08:29:30.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.624+0000 7fa87cef2640 10 monclient: monmap: 2023-11-05T08:29:30.626 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:29:30.626 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:30.626 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:29:30.625793+0000 2023-11-05T08:29:30.626 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:29:30.625793+0000 2023-11-05T08:29:30.627 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:29:30.627 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:30.627 INFO:teuthology.orchestra.run.smithi052.stderr:0: v1:172.21.15.52:6789/0 mon.noname-a-legacy 2023-11-05T08:29:30.627 INFO:teuthology.orchestra.run.smithi052.stderr:1: v1:172.21.15.156:6789/0 mon.noname-c-legacy 2023-11-05T08:29:30.627 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-b 2023-11-05T08:29:30.628 INFO:teuthology.orchestra.run.smithi052.stderr:3: v2:172.21.15.52:3300/0 mon.noname-a 2023-11-05T08:29:30.628 INFO:teuthology.orchestra.run.smithi052.stderr:4: v2:172.21.15.156:3300/0 mon.noname-c 2023-11-05T08:29:30.628 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:30.630 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.624+0000 7fa87cef2640 1 Processor -- start 2023-11-05T08:29:30.630 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.624+0000 7fa87cef2640 1 -- start start 2023-11-05T08:29:30.631 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.624+0000 7fa87cef2640 10 monclient: init 2023-11-05T08:29:30.631 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.625+0000 7fa87cef2640 10 monclient: _reopen_session rank -1 2023-11-05T08:29:30.631 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.625+0000 7fa87cef2640 10 monclient: _add_conns ranks=[2,4,1,3,0] 2023-11-05T08:29:30.631 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.625+0000 7fa87cef2640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa87806a040 0x7fa8780af1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:30.631 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.625+0000 7fa87cef2640 10 monclient(hunting): picked mon.noname-b con 0x7fa87806a040 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:29:30.632 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.625+0000 7fa87cef2640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa87813e820 0x7fa87813ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:30.632 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.625+0000 7fa87cef2640 10 monclient(hunting): picked mon.noname-c con 0x7fa87813e820 addr v2:172.21.15.156:3300/0 2023-11-05T08:29:30.632 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.625+0000 7fa87cef2640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fa878141c00 addr v1:172.21.15.156:6789/0 2023-11-05T08:29:30.632 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.625+0000 7fa87cef2640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa87806e2c0 con 0x7fa878141c00 2023-11-05T08:29:30.633 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.625+0000 7fa87cef2640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:30.633 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.625+0000 7fa87cef2640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa87806a420 con 0x7fa87813e820 2023-11-05T08:29:30.633 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.625+0000 7fa87cef2640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:30.633 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.625+0000 7fa87cef2640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8780af950 con 0x7fa87806a040 2023-11-05T08:29:30.633 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.625+0000 7fa87cef2640 10 monclient(hunting): _renew_subs 2023-11-05T08:29:30.634 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.625+0000 7fa87cef2640 10 monclient(hunting): authenticate will time out at 2716.831596s 2023-11-05T08:29:30.634 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.626+0000 7fa87659c640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa87806a040 0x7fa8780af1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:30.634 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.626+0000 7fa875d9b640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa87813e820 0x7fa87813ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:30.634 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.626+0000 7fa87659c640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa87806a040 0x7fa8780af1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.52:59812/0 (socket says 172.21.15.52:59812) 2023-11-05T08:29:30.635 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.626+0000 7fa87659c640 1 -- 172.21.15.52:0/3049109207 learned_addr learned my addr 172.21.15.52:0/3049109207 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-11-05T08:29:30.635 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.626+0000 7fa87659c640 10 monclient(hunting): get_auth_request con 0x7fa87806a040 auth_method 0 2023-11-05T08:29:30.635 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.626+0000 7fa87659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:29:30.635 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.626+0000 7fa87659c640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:29:30.635 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.626+0000 7fa87659c640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:29:30.635 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.626+0000 7fa875d9b640 10 monclient(hunting): get_auth_request con 0x7fa87813e820 auth_method 0 2023-11-05T08:29:30.636 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.626+0000 7fa875d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:29:30.636 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.627+0000 7fa875d9b640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:29:30.636 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.627+0000 7fa875d9b640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:29:30.636 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.627+0000 7fa87659c640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:29:30.637 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.627+0000 7fa87659c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:29:30.637 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.627+0000 7fa87659c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:29:30.637 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.627+0000 7fa875d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:29:30.637 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.627+0000 7fa875d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:29:30.637 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.627+0000 7fa875d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:29:30.638 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.628+0000 7fa87659c640 10 monclient(hunting): handle_auth_done global_id 16994 payload 274 2023-11-05T08:29:30.638 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.628+0000 7fa87659c640 1 -- 172.21.15.52:0/3049109207 >> v2:172.21.15.156:3300/0 conn(0x7fa87813e820 msgr2=0x7fa87813ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-05T08:29:30.638 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.628+0000 7fa87659c640 1 --2- 172.21.15.52:0/3049109207 >> v2:172.21.15.156:3300/0 conn(0x7fa87813e820 0x7fa87813ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:30.638 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.628+0000 7fa87659c640 1 -- 172.21.15.52:0/3049109207 >> v1:172.21.15.156:6789/0 conn(0x7fa878141c00 legacy=0x7fa878142090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:30.638 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.628+0000 7fa87659c640 10 monclient: _finish_hunting 0 2023-11-05T08:29:30.639 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.628+0000 7fa87659c640 1 monclient: found mon.noname-b 2023-11-05T08:29:30.639 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.628+0000 7fa87659c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:29:30.639 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.628+0000 7fa87659c640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.52:3301/0 2023-11-05T08:29:30.639 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.628+0000 7fa87659c640 1 -- 172.21.15.52:0/3049109207 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8781427a0 con 0x7fa87806a040 2023-11-05T08:29:30.643 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.630+0000 7fa87659c640 1 --2- 172.21.15.52:0/3049109207 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa87806a040 0x7fa8780af1a0 secure :-1 s=READY pgs=3083 cs=0 l=1 rev1=1 crypto rx=0x7fa870009870 tx=0x7fa87002b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f59136784ade3d0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:29:30.643 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.634+0000 7fa87559a640 1 -- 172.21.15.52:0/3049109207 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa870031640 con 0x7fa87806a040 2023-11-05T08:29:30.643 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.634+0000 7fa87559a640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:29:30.643 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.634+0000 7fa87559a640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-05T08:29:30.644 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.634+0000 7fa87559a640 10 monclient: dump: 2023-11-05T08:29:30.644 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:29:30.644 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:30.644 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:30.644 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:30.645 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:29:30.645 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:30.645 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:29:30.645 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:29:30.645 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:29:30.645 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:30.646 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.634+0000 7fa87559a640 10 monclient: _finish_auth 0 2023-11-05T08:29:30.646 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.634+0000 7fa87559a640 10 monclient: _check_auth_tickets 2023-11-05T08:29:30.646 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.634+0000 7fa87559a640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:29:30.646 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.634+0000 7fa87559a640 1 -- 172.21.15.52:0/3049109207 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8700317a0 con 0x7fa87806a040 2023-11-05T08:29:30.647 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.634+0000 7fa87559a640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:29:30.647 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.634+0000 7fa87559a640 1 -- 172.21.15.52:0/3049109207 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa870031b30 con 0x7fa87806a040 2023-11-05T08:29:30.647 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.634+0000 7fa87559a640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:29:30.647 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.634+0000 7fa87559a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-11-05T08:29:30.647 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.634+0000 7fa87559a640 10 monclient: dump: 2023-11-05T08:29:30.648 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:29:30.648 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:30.648 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:30.648 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:30.648 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:29:30.649 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:30.649 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:29:30.649 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:29:30.649 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:29:30.649 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:30.650 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.634+0000 7fa87cef2640 5 monclient: authenticate success, global_id 16994 2023-11-05T08:29:30.650 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.634+0000 7fa87cef2640 10 monclient: get_monmap_and_config success 2023-11-05T08:29:30.650 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.634+0000 7fa87cef2640 4 set_mon_vals no callback set 2023-11-05T08:29:30.650 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.635+0000 7fa87cef2640 10 monclient: shutdown 2023-11-05T08:29:30.650 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.635+0000 7fa87cef2640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:29:30.650 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.635+0000 7fa87cef2640 1 -- 172.21.15.52:0/3049109207 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa87806a040 msgr2=0x7fa8780af1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:30.651 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.635+0000 7fa87cef2640 1 --2- 172.21.15.52:0/3049109207 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa87806a040 0x7fa8780af1a0 secure :-1 s=READY pgs=3083 cs=0 l=1 rev1=1 crypto rx=0x7fa870009870 tx=0x7fa87002b8f0 comp rx=0 tx=0).stop 2023-11-05T08:29:30.651 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.635+0000 7fa87cef2640 1 -- 172.21.15.52:0/3049109207 shutdown_connections 2023-11-05T08:29:30.651 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.635+0000 7fa87cef2640 1 --2- 172.21.15.52:0/3049109207 >> v2:172.21.15.156:3300/0 conn(0x7fa87813e820 0x7fa87813ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:30.651 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.635+0000 7fa87cef2640 1 --2- 172.21.15.52:0/3049109207 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa87806a040 0x7fa8780af1a0 unknown :-1 s=CLOSED pgs=3083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:30.651 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.635+0000 7fa87cef2640 1 -- 172.21.15.52:0/3049109207 >> 172.21.15.52:0/3049109207 conn(0x7fa8780b09a0 msgr2=0x7fa8780b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:29:30.652 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.635+0000 7fa87cef2640 1 -- 172.21.15.52:0/3049109207 shutdown_connections 2023-11-05T08:29:30.652 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.635+0000 7fa87cef2640 1 -- 172.21.15.52:0/3049109207 wait complete. 2023-11-05T08:29:30.652 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.636+0000 7fa87cef2640 10 monclient: build_initial_monmap 2023-11-05T08:29:30.652 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.636+0000 7fa87cef2640 10 monclient: monmap: 2023-11-05T08:29:30.652 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:29:30.652 INFO:teuthology.orchestra.run.smithi052.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-05T08:29:30.653 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 0.000000 2023-11-05T08:29:30.653 INFO:teuthology.orchestra.run.smithi052.stderr:created 0.000000 2023-11-05T08:29:30.653 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:29:30.653 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:30.653 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.noname-a 2023-11-05T08:29:30.654 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.noname-b 2023-11-05T08:29:30.654 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-c 2023-11-05T08:29:30.654 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:30.654 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.636+0000 7fa87cef2640 1 librados: starting msgr at 2023-11-05T08:29:30.654 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.636+0000 7fa87cef2640 1 librados: starting objecter 2023-11-05T08:29:30.654 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.636+0000 7fa87cef2640 1 Processor -- start 2023-11-05T08:29:30.655 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.636+0000 7fa87cef2640 1 -- start start 2023-11-05T08:29:30.655 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.636+0000 7fa87cef2640 1 librados: setting wanted keys 2023-11-05T08:29:30.655 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.636+0000 7fa87cef2640 1 librados: calling monclient init 2023-11-05T08:29:30.655 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.636+0000 7fa87cef2640 10 monclient: init 2023-11-05T08:29:30.655 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.637+0000 7fa87cef2640 10 monclient: _reopen_session rank -1 2023-11-05T08:29:30.656 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.637+0000 7fa87cef2640 10 monclient: _add_conns ranks=[1,0,2] 2023-11-05T08:29:30.656 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.637+0000 7fa87cef2640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa87806a040 0x7fa87813a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:30.656 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.637+0000 7fa87cef2640 10 monclient(hunting): picked mon.noname-b con 0x7fa87806a040 addr [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] 2023-11-05T08:29:30.656 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.637+0000 7fa87cef2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa87813e820 0x7fa878142c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:30.656 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.637+0000 7fa87cef2640 10 monclient(hunting): picked mon.noname-a con 0x7fa87813e820 addr [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] 2023-11-05T08:29:30.657 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.637+0000 7fa87cef2640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa878141c00 0x7fa878134230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:30.657 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.637+0000 7fa87cef2640 10 monclient(hunting): picked mon.noname-c con 0x7fa878141c00 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:29:30.657 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.637+0000 7fa87cef2640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:30.657 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.637+0000 7fa87cef2640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8781438e0 con 0x7fa87813e820 2023-11-05T08:29:30.658 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.637+0000 7fa87cef2640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:30.658 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.637+0000 7fa87cef2640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8781431a0 con 0x7fa87806a040 2023-11-05T08:29:30.658 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.637+0000 7fa87cef2640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:30.658 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.637+0000 7fa87cef2640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8781433c0 con 0x7fa878141c00 2023-11-05T08:29:30.658 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.637+0000 7fa87cef2640 10 monclient(hunting): _renew_subs 2023-11-05T08:29:30.659 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.637+0000 7fa87cef2640 10 monclient(hunting): authenticate will time out at 2716.843149s 2023-11-05T08:29:30.659 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.637+0000 7fa876d9d640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa878141c00 0x7fa878134230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:30.659 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.637+0000 7fa875d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa87813e820 0x7fa878142c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:30.659 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.637+0000 7fa87659c640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa87806a040 0x7fa87813a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:30.659 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.638+0000 7fa876d9d640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa878141c00 0x7fa878134230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.52:59814/0 (socket says 172.21.15.52:59814) 2023-11-05T08:29:30.660 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.638+0000 7fa875d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa87813e820 0x7fa878142c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60078/0 (socket says 172.21.15.52:60078) 2023-11-05T08:29:30.660 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.638+0000 7fa876d9d640 1 -- 172.21.15.52:0/3641731552 learned_addr learned my addr 172.21.15.52:0/3641731552 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-11-05T08:29:30.660 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.638+0000 7fa876d9d640 10 monclient(hunting): get_auth_request con 0x7fa878141c00 auth_method 0 2023-11-05T08:29:30.660 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.638+0000 7fa876d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:29:30.660 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.638+0000 7fa876d9d640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:29:30.661 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.638+0000 7fa876d9d640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:29:30.661 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.638+0000 7fa875d9b640 10 monclient(hunting): get_auth_request con 0x7fa87813e820 auth_method 0 2023-11-05T08:29:30.661 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.638+0000 7fa875d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:29:30.661 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.638+0000 7fa875d9b640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:29:30.661 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.638+0000 7fa875d9b640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:29:30.662 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.638+0000 7fa87659c640 10 monclient(hunting): get_auth_request con 0x7fa87806a040 auth_method 0 2023-11-05T08:29:30.662 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.638+0000 7fa87659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:29:30.662 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.638+0000 7fa87659c640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:29:30.662 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.638+0000 7fa87659c640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:29:30.662 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.638+0000 7fa875d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:29:30.663 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.638+0000 7fa875d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:29:30.663 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.638+0000 7fa875d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:29:30.663 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.638+0000 7fa87659c640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:29:30.663 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.638+0000 7fa87659c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:29:30.663 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.638+0000 7fa87659c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:29:30.664 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.638+0000 7fa876d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:29:30.664 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.638+0000 7fa876d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:29:30.664 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.638+0000 7fa876d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:29:30.664 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.641+0000 7fa87659c640 10 monclient(hunting): handle_auth_done global_id 20749 payload 824 2023-11-05T08:29:30.664 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.641+0000 7fa87659c640 1 -- 172.21.15.52:0/3641731552 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa878141c00 msgr2=0x7fa878134230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:30.665 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.641+0000 7fa87659c640 1 --2- 172.21.15.52:0/3641731552 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa878141c00 0x7fa878134230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:30.665 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.641+0000 7fa87659c640 1 -- 172.21.15.52:0/3641731552 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa87813e820 msgr2=0x7fa878142c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:30.665 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.641+0000 7fa87659c640 1 --2- 172.21.15.52:0/3641731552 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa87813e820 0x7fa878142c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:30.665 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.641+0000 7fa87659c640 10 monclient: _finish_hunting 0 2023-11-05T08:29:30.665 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.641+0000 7fa87659c640 1 monclient: found mon.noname-b 2023-11-05T08:29:30.666 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.641+0000 7fa87659c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:29:30.666 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.641+0000 7fa87659c640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.156:3300/0 2023-11-05T08:29:30.666 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.641+0000 7fa87659c640 1 -- 172.21.15.52:0/3641731552 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8700094d0 con 0x7fa87806a040 2023-11-05T08:29:30.668 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.643+0000 7fa87659c640 1 --2- 172.21.15.52:0/3641731552 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa87806a040 0x7fa87813a0f0 secure :-1 s=READY pgs=5016 cs=0 l=1 rev1=1 crypto rx=0x7fa8780afa90 tx=0x7fa8700046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:29:30.668 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.643+0000 7fa86effd640 10 client.?.objecter ms_handle_connect 0x7fa87806a040 2023-11-05T08:29:30.668 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.643+0000 7fa86effd640 10 client.?.objecter resend_mon_ops 2023-11-05T08:29:30.668 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.647+0000 7fa86effd640 1 -- 172.21.15.52:0/3641731552 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa87003ac60 con 0x7fa87806a040 2023-11-05T08:29:30.669 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.647+0000 7fa86effd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:29:30.669 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.647+0000 7fa86effd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-05T08:29:30.669 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.647+0000 7fa86effd640 10 monclient: dump: 2023-11-05T08:29:30.669 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:29:30.669 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:30.670 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:30.670 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:30.670 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:29:30.670 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:30.670 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:29:30.671 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:29:30.671 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:29:30.671 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:30.671 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.647+0000 7fa86effd640 10 monclient: _finish_auth 0 2023-11-05T08:29:30.671 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.647+0000 7fa86effd640 10 monclient: _check_auth_tickets 2023-11-05T08:29:30.672 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.647+0000 7fa86effd640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:29:30.672 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.647+0000 7fa86effd640 1 -- 172.21.15.52:0/3641731552 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa87003ade0 con 0x7fa87806a040 2023-11-05T08:29:30.672 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.647+0000 7fa86effd640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:29:30.672 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.647+0000 7fa86effd640 1 -- 172.21.15.52:0/3641731552 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa870042630 con 0x7fa87806a040 2023-11-05T08:29:30.673 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.647+0000 7fa86effd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:29:30.673 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.647+0000 7fa86effd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-05T08:29:30.673 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.647+0000 7fa86effd640 10 monclient: dump: 2023-11-05T08:29:30.673 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:29:30.673 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:30.674 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:30.674 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:30.674 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:29:30.674 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:30.674 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:29:30.675 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:29:30.675 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:29:30.675 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:30.675 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.647+0000 7fa87cef2640 5 monclient: authenticate success, global_id 20749 2023-11-05T08:29:30.675 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.647+0000 7fa87cef2640 10 monclient: _renew_subs 2023-11-05T08:29:30.676 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.647+0000 7fa87cef2640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:29:30.676 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.647+0000 7fa87cef2640 1 -- 172.21.15.52:0/3641731552 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa87813f340 con 0x7fa87806a040 2023-11-05T08:29:30.676 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.647+0000 7fa874d99640 4 set_mon_vals no callback set 2023-11-05T08:29:30.676 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.647+0000 7fa87cef2640 10 client.20749.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-05T08:29:30.676 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.647+0000 7fa87cef2640 10 monclient: _renew_subs 2023-11-05T08:29:30.677 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.647+0000 7fa87cef2640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:29:30.677 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.647+0000 7fa87cef2640 1 -- 172.21.15.52:0/3641731552 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8780b35d0 con 0x7fa87806a040 2023-11-05T08:29:30.677 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.647+0000 7fa87cef2640 1 librados: init done 2023-11-05T08:29:30.677 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.648+0000 7fa87cef2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-05T08:29:30.677 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.648+0000 7fa87cef2640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:29:30.677 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.648+0000 7fa87cef2640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:29:30.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.648+0000 7fa87cef2640 1 -- 172.21.15.52:0/3641731552 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa87804e9f0 con 0x7fa87806a040 2023-11-05T08:29:30.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.665+0000 7fa86effd640 1 -- 172.21.15.52:0/3641731552 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa87002f050 con 0x7fa87806a040 2023-11-05T08:29:30.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.666+0000 7fa86effd640 1 --2- 172.21.15.52:0/3641731552 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7fa85806c880 0x7fa85806ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:30.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.666+0000 7fa875d9b640 1 --2- 172.21.15.52:0/3641731552 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7fa85806c880 0x7fa85806ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:30.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.666+0000 7fa875d9b640 10 monclient: get_auth_request con 0x7fa85806c880 auth_method 0 2023-11-05T08:29:30.679 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.666+0000 7fa875d9b640 1 --2- 172.21.15.52:0/3641731552 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7fa85806c880 0x7fa85806ed40 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fa878141840 tx=0x7fa860009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:29:30.679 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.666+0000 7fa86effd640 10 client.20749.objecter ms_handle_connect 0x7fa85806c880 2023-11-05T08:29:30.679 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.668+0000 7fa86effd640 1 -- 172.21.15.52:0/3641731552 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(932..932 src has 619..932) v4 ==== 6193+0+0 (secure 0 0 0) 0x7fa87007a620 con 0x7fa87806a040 2023-11-05T08:29:30.679 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.668+0000 7fa86effd640 10 client.20749.objecter ms_dispatch 0x7fa878000b90 osd_map(932..932 src has 619..932) v4 2023-11-05T08:29:30.680 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.668+0000 7fa86effd640 3 client.20749.objecter handle_osd_map got epochs [932,932] > 0 2023-11-05T08:29:30.680 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.668+0000 7fa86effd640 3 client.20749.objecter handle_osd_map decoding full epoch 932 2023-11-05T08:29:30.680 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.668+0000 7fa86effd640 20 client.20749.objecter dump_active .. 0 homeless 2023-11-05T08:29:30.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.904+0000 7fa86effd640 1 -- 172.21.15.52:0/3641731552 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa870076960 con 0x7fa87806a040 2023-11-05T08:29:30.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.904+0000 7fa86effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:29:30.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:30.904+0000 7fa86effd640 10 monclient: _finish_command 1 = system:0 2023-11-05T08:29:31.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.083+0000 7fa87cef2640 1 -- 172.21.15.52:0/3641731552 --> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fa87813f1c0 con 0x7fa85806c880 2023-11-05T08:29:31.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.084+0000 7fa86effd640 1 -- 172.21.15.52:0/3641731552 <== mgr.4108 v2:172.21.15.156:6800/3320012339 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fa860011a30 con 0x7fa85806c880 2023-11-05T08:29:31.086 INFO:teuthology.orchestra.run.smithi052.stderr:instructed osd(s) 4 to deep-scrub 2023-11-05T08:29:31.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.085+0000 7fa87cef2640 10 librados: watch_flush enter 2023-11-05T08:29:31.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.085+0000 7fa87cef2640 10 librados: watch_flush exit 2023-11-05T08:29:31.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.085+0000 7fa87cef2640 20 client.20749.objecter shutdown clearing up homeless session... 2023-11-05T08:29:31.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.085+0000 7fa87cef2640 10 client.20749.objecter successfully canceled tick 2023-11-05T08:29:31.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.085+0000 7fa87cef2640 1 -- 172.21.15.52:0/3641731552 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7fa85806c880 msgr2=0x7fa85806ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:31.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.085+0000 7fa87cef2640 1 --2- 172.21.15.52:0/3641731552 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7fa85806c880 0x7fa85806ed40 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fa878141840 tx=0x7fa860009190 comp rx=0 tx=0).stop 2023-11-05T08:29:31.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.085+0000 7fa87cef2640 10 monclient: shutdown 2023-11-05T08:29:31.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.085+0000 7fa87cef2640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:29:31.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.085+0000 7fa87cef2640 1 -- 172.21.15.52:0/3641731552 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa87806a040 msgr2=0x7fa87813a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:31.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.085+0000 7fa87cef2640 1 --2- 172.21.15.52:0/3641731552 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa87806a040 0x7fa87813a0f0 secure :-1 s=READY pgs=5016 cs=0 l=1 rev1=1 crypto rx=0x7fa8780afa90 tx=0x7fa8700046c0 comp rx=0 tx=0).stop 2023-11-05T08:29:31.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.085+0000 7fa87cef2640 1 -- 172.21.15.52:0/3641731552 shutdown_connections 2023-11-05T08:29:31.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.085+0000 7fa87cef2640 1 --2- 172.21.15.52:0/3641731552 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7fa85806c880 0x7fa85806ed40 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:31.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.085+0000 7fa87cef2640 1 --2- 172.21.15.52:0/3641731552 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa878141c00 0x7fa878134230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:31.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.085+0000 7fa87cef2640 1 --2- 172.21.15.52:0/3641731552 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa87813e820 0x7fa878142c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:31.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.085+0000 7fa87cef2640 1 --2- 172.21.15.52:0/3641731552 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa87806a040 0x7fa87813a0f0 unknown :-1 s=CLOSED pgs=5016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:31.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.085+0000 7fa87cef2640 1 -- 172.21.15.52:0/3641731552 >> 172.21.15.52:0/3641731552 conn(0x7fa8780b09a0 msgr2=0x7fa8780ad080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:29:31.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.085+0000 7fa87cef2640 1 -- 172.21.15.52:0/3641731552 shutdown_connections 2023-11-05T08:29:31.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.085+0000 7fa87cef2640 1 -- 172.21.15.52:0/3641731552 wait complete. 2023-11-05T08:29:31.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.086+0000 7fa87cef2640 1 librados: shutdown 2023-11-05T08:29:31.098 INFO:tasks.ceph:Scrubbing osd.5 2023-11-05T08:29:31.099 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-11-05T08:29:31.208 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.207+0000 7f78f5790640 10 monclient: get_monmap_and_config 2023-11-05T08:29:31.208 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.207+0000 7f78f5790640 10 monclient: build_initial_monmap 2023-11-05T08:29:31.209 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.207+0000 7f78f5790640 10 monclient: monmap: 2023-11-05T08:29:31.209 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:29:31.209 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:31.209 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:29:31.208790+0000 2023-11-05T08:29:31.209 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:29:31.208790+0000 2023-11-05T08:29:31.210 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:29:31.210 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:31.210 INFO:teuthology.orchestra.run.smithi052.stderr:0: v1:172.21.15.52:6789/0 mon.noname-a-legacy 2023-11-05T08:29:31.210 INFO:teuthology.orchestra.run.smithi052.stderr:1: v1:172.21.15.156:6789/0 mon.noname-c-legacy 2023-11-05T08:29:31.210 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-b 2023-11-05T08:29:31.211 INFO:teuthology.orchestra.run.smithi052.stderr:3: v2:172.21.15.52:3300/0 mon.noname-a 2023-11-05T08:29:31.211 INFO:teuthology.orchestra.run.smithi052.stderr:4: v2:172.21.15.156:3300/0 mon.noname-c 2023-11-05T08:29:31.211 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:31.213 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.207+0000 7f78f5790640 1 Processor -- start 2023-11-05T08:29:31.213 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.207+0000 7f78f5790640 1 -- start start 2023-11-05T08:29:31.213 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.207+0000 7f78f5790640 10 monclient: init 2023-11-05T08:29:31.213 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.208+0000 7f78f5790640 10 monclient: _reopen_session rank -1 2023-11-05T08:29:31.214 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.208+0000 7f78f5790640 10 monclient: _add_conns ranks=[4,3,0,1,2] 2023-11-05T08:29:31.214 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.208+0000 7f78f5790640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f78f00b42c0 0x7f78f00a9210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:31.214 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.208+0000 7f78f5790640 10 monclient(hunting): picked mon.noname-c con 0x7f78f00b42c0 addr v2:172.21.15.156:3300/0 2023-11-05T08:29:31.214 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.208+0000 7f78f5790640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f78f00a8770 0x7f78f013ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:31.214 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.208+0000 7f78f5790640 10 monclient(hunting): picked mon.noname-a con 0x7f78f00a8770 addr v2:172.21.15.52:3300/0 2023-11-05T08:29:31.214 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.208+0000 7f78f5790640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f78f013f130 addr v1:172.21.15.52:6789/0 2023-11-05T08:29:31.215 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.208+0000 7f78f5790640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78f00a8d00 con 0x7f78f013f130 2023-11-05T08:29:31.215 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.208+0000 7f78f5790640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:31.215 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.208+0000 7f78f5790640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78f00b46a0 con 0x7f78f00a8770 2023-11-05T08:29:31.215 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.208+0000 7f78f5790640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:31.215 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.208+0000 7f78f5790640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78f00ade80 con 0x7f78f00b42c0 2023-11-05T08:29:31.216 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.208+0000 7f78f5790640 10 monclient(hunting): _renew_subs 2023-11-05T08:29:31.216 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.208+0000 7f78f5790640 10 monclient(hunting): authenticate will time out at 2717.414538s 2023-11-05T08:29:31.216 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.209+0000 7f78eeffd640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f78f00b42c0 0x7f78f00a9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:31.216 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.209+0000 7f78ee7fc640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f78f00a8770 0x7f78f013ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:31.216 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.209+0000 7f78ef7fe640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f78f013f130 0x7f78f0144f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:46062/0 (socket says 172.21.15.52:46062) 2023-11-05T08:29:31.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.209+0000 7f78ef7fe640 1 -- 172.21.15.52:0/2176046888 learned_addr learned my addr 172.21.15.52:0/2176046888 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-11-05T08:29:31.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.209+0000 7f78eeffd640 10 monclient(hunting): get_auth_request con 0x7f78f00b42c0 auth_method 0 2023-11-05T08:29:31.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.209+0000 7f78eeffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:29:31.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.209+0000 7f78eeffd640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:29:31.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.209+0000 7f78eeffd640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:29:31.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.209+0000 7f78ee7fc640 10 monclient(hunting): get_auth_request con 0x7f78f00a8770 auth_method 0 2023-11-05T08:29:31.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.209+0000 7f78ee7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:29:31.218 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.209+0000 7f78ee7fc640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:29:31.218 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.209+0000 7f78ee7fc640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:29:31.218 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.210+0000 7f78eeffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:29:31.218 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.210+0000 7f78eeffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:29:31.218 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.210+0000 7f78eeffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:29:31.219 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.210+0000 7f78ee7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:29:31.219 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.210+0000 7f78ee7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:29:31.219 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.210+0000 7f78ee7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:29:31.219 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.211+0000 7f78eeffd640 10 monclient(hunting): handle_auth_done global_id 20752 payload 274 2023-11-05T08:29:31.219 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.211+0000 7f78eeffd640 1 -- 172.21.15.52:0/2176046888 >> v2:172.21.15.52:3300/0 conn(0x7f78f00a8770 msgr2=0x7f78f013ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-05T08:29:31.219 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.211+0000 7f78eeffd640 1 --2- 172.21.15.52:0/2176046888 >> v2:172.21.15.52:3300/0 conn(0x7f78f00a8770 0x7f78f013ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:31.220 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.211+0000 7f78eeffd640 1 -- 172.21.15.52:0/2176046888 >> v1:172.21.15.52:6789/0 conn(0x7f78f013f130 legacy=0x7f78f0144f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:31.220 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.211+0000 7f78eeffd640 10 monclient: _finish_hunting 0 2023-11-05T08:29:31.220 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.211+0000 7f78eeffd640 1 monclient: found mon.noname-c 2023-11-05T08:29:31.220 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.211+0000 7f78eeffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:29:31.220 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.211+0000 7f78eeffd640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.156:3300/0 2023-11-05T08:29:31.220 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.211+0000 7f78eeffd640 1 -- 172.21.15.52:0/2176046888 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78f013f560 con 0x7f78f00b42c0 2023-11-05T08:29:31.223 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.213+0000 7f78eeffd640 1 --2- 172.21.15.52:0/2176046888 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f78f00b42c0 0x7f78f00a9210 secure :-1 s=READY pgs=5017 cs=0 l=1 rev1=1 crypto rx=0x7f78f006b830 tx=0x7f78e002b7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e9663bd8c84d904 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:29:31.224 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.217+0000 7f78edffb640 1 -- 172.21.15.52:0/2176046888 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78e0031710 con 0x7f78f00b42c0 2023-11-05T08:29:31.224 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.217+0000 7f78edffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:29:31.224 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.217+0000 7f78edffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-11-05T08:29:31.224 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.217+0000 7f78edffb640 10 monclient: dump: 2023-11-05T08:29:31.224 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:29:31.225 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:31.225 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:31.225 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:31.225 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:29:31.225 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:31.226 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:29:31.226 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:29:31.226 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:29:31.226 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:31.226 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.217+0000 7f78edffb640 10 monclient: _finish_auth 0 2023-11-05T08:29:31.227 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.217+0000 7f78edffb640 10 monclient: _check_auth_tickets 2023-11-05T08:29:31.227 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.217+0000 7f78edffb640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:29:31.227 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.217+0000 7f78edffb640 1 -- 172.21.15.52:0/2176046888 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78e002f050 con 0x7f78f00b42c0 2023-11-05T08:29:31.227 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.217+0000 7f78f5790640 5 monclient: authenticate success, global_id 20752 2023-11-05T08:29:31.227 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.217+0000 7f78f5790640 20 monclient: get_monmap_and_config waiting for monmap|config 2023-11-05T08:29:31.227 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.217+0000 7f78edffb640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:29:31.228 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.217+0000 7f78f5790640 10 monclient: get_monmap_and_config success 2023-11-05T08:29:31.228 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.217+0000 7f78edffb640 1 -- 172.21.15.52:0/2176046888 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78e0031a90 con 0x7f78f00b42c0 2023-11-05T08:29:31.228 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.217+0000 7f78f5790640 4 set_mon_vals no callback set 2023-11-05T08:29:31.228 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.217+0000 7f78edffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:29:31.228 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.217+0000 7f78edffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-05T08:29:31.229 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.217+0000 7f78edffb640 10 monclient: dump: 2023-11-05T08:29:31.229 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:29:31.229 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:31.229 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:31.229 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:31.229 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:29:31.230 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:31.230 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:29:31.230 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:29:31.230 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:29:31.230 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:31.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.217+0000 7f78f5790640 10 monclient: shutdown 2023-11-05T08:29:31.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.217+0000 7f78f5790640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:29:31.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.217+0000 7f78f5790640 1 -- 172.21.15.52:0/2176046888 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f78f00b42c0 msgr2=0x7f78f00a9210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:31.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.217+0000 7f78f5790640 1 --2- 172.21.15.52:0/2176046888 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f78f00b42c0 0x7f78f00a9210 secure :-1 s=READY pgs=5017 cs=0 l=1 rev1=1 crypto rx=0x7f78f006b830 tx=0x7f78e002b7b0 comp rx=0 tx=0).stop 2023-11-05T08:29:31.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.218+0000 7f78f5790640 1 -- 172.21.15.52:0/2176046888 shutdown_connections 2023-11-05T08:29:31.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.218+0000 7f78f5790640 1 --2- 172.21.15.52:0/2176046888 >> v2:172.21.15.52:3300/0 conn(0x7f78f00a8770 0x7f78f013ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:31.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.218+0000 7f78f5790640 1 --2- 172.21.15.52:0/2176046888 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f78f00b42c0 0x7f78f00a9210 unknown :-1 s=CLOSED pgs=5017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:31.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.218+0000 7f78f5790640 1 -- 172.21.15.52:0/2176046888 >> 172.21.15.52:0/2176046888 conn(0x7f78f0065ee0 msgr2=0x7f78f00662f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:29:31.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.218+0000 7f78f5790640 1 -- 172.21.15.52:0/2176046888 shutdown_connections 2023-11-05T08:29:31.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.218+0000 7f78f5790640 1 -- 172.21.15.52:0/2176046888 wait complete. 2023-11-05T08:29:31.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.218+0000 7f78f5790640 10 monclient: build_initial_monmap 2023-11-05T08:29:31.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.218+0000 7f78f5790640 10 monclient: monmap: 2023-11-05T08:29:31.233 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:29:31.233 INFO:teuthology.orchestra.run.smithi052.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-05T08:29:31.233 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 0.000000 2023-11-05T08:29:31.233 INFO:teuthology.orchestra.run.smithi052.stderr:created 0.000000 2023-11-05T08:29:31.234 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:29:31.234 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:31.234 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.noname-a 2023-11-05T08:29:31.234 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.noname-b 2023-11-05T08:29:31.234 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-c 2023-11-05T08:29:31.234 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:31.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.219+0000 7f78f5790640 1 librados: starting msgr at 2023-11-05T08:29:31.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.219+0000 7f78f5790640 1 librados: starting objecter 2023-11-05T08:29:31.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.219+0000 7f78f5790640 1 Processor -- start 2023-11-05T08:29:31.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.219+0000 7f78f5790640 1 -- start start 2023-11-05T08:29:31.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.219+0000 7f78f5790640 1 librados: setting wanted keys 2023-11-05T08:29:31.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.219+0000 7f78f5790640 1 librados: calling monclient init 2023-11-05T08:29:31.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.219+0000 7f78f5790640 10 monclient: init 2023-11-05T08:29:31.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.219+0000 7f78f5790640 10 monclient: _reopen_session rank -1 2023-11-05T08:29:31.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.219+0000 7f78f5790640 10 monclient: _add_conns ranks=[2,1,0] 2023-11-05T08:29:31.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.219+0000 7f78f5790640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f78f00a8770 0x7f78f00ad0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:31.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.219+0000 7f78f5790640 10 monclient(hunting): picked mon.noname-c con 0x7f78f00a8770 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:29:31.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.219+0000 7f78f5790640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f78f00b42c0 0x7f78f00b04e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:31.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.219+0000 7f78f5790640 10 monclient(hunting): picked mon.noname-b con 0x7f78f00b42c0 addr [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] 2023-11-05T08:29:31.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.219+0000 7f78f5790640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f78f013f130 0x7f78f01d9950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:31.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.219+0000 7f78f5790640 10 monclient(hunting): picked mon.noname-a con 0x7f78f013f130 addr [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] 2023-11-05T08:29:31.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.219+0000 7f78f5790640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:31.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.219+0000 7f78f5790640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78f00b1010 con 0x7f78f013f130 2023-11-05T08:29:31.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.219+0000 7f78f5790640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:31.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.219+0000 7f78f5790640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78f01442e0 con 0x7f78f00b42c0 2023-11-05T08:29:31.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.219+0000 7f78f5790640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:31.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.219+0000 7f78f5790640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78f00b0a20 con 0x7f78f00a8770 2023-11-05T08:29:31.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.219+0000 7f78f5790640 10 monclient(hunting): _renew_subs 2023-11-05T08:29:31.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.219+0000 7f78f5790640 10 monclient(hunting): authenticate will time out at 2717.425879s 2023-11-05T08:29:31.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.220+0000 7f78ef7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f78f013f130 0x7f78f01d9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:31.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.220+0000 7f78eeffd640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f78f00a8770 0x7f78f00ad0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:31.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.220+0000 7f78ee7fc640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f78f00b42c0 0x7f78f00b04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:31.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.220+0000 7f78ef7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f78f013f130 0x7f78f01d9950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60094/0 (socket says 172.21.15.52:60094) 2023-11-05T08:29:31.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.220+0000 7f78ef7fe640 1 -- 172.21.15.52:0/1303696183 learned_addr learned my addr 172.21.15.52:0/1303696183 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-11-05T08:29:31.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.220+0000 7f78ef7fe640 10 monclient(hunting): get_auth_request con 0x7f78f013f130 auth_method 0 2023-11-05T08:29:31.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.220+0000 7f78ef7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:29:31.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.220+0000 7f78ef7fe640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:29:31.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.220+0000 7f78ef7fe640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:29:31.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.220+0000 7f78ee7fc640 10 monclient(hunting): get_auth_request con 0x7f78f00b42c0 auth_method 0 2023-11-05T08:29:31.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.220+0000 7f78ee7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:29:31.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.220+0000 7f78ee7fc640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:29:31.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.220+0000 7f78ee7fc640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:29:31.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.221+0000 7f78eeffd640 10 monclient(hunting): get_auth_request con 0x7f78f00a8770 auth_method 0 2023-11-05T08:29:31.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.221+0000 7f78eeffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:29:31.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.221+0000 7f78eeffd640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:29:31.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.221+0000 7f78eeffd640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:29:31.242 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.221+0000 7f78ef7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:29:31.242 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.221+0000 7f78ef7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:29:31.242 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.221+0000 7f78ef7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:29:31.242 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.221+0000 7f78ee7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:29:31.242 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.221+0000 7f78ee7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:29:31.242 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.221+0000 7f78ee7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:29:31.243 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.221+0000 7f78eeffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:29:31.243 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.221+0000 7f78eeffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:29:31.243 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.221+0000 7f78eeffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:29:31.244 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.223+0000 7f78ee7fc640 10 monclient(hunting): handle_auth_done global_id 20755 payload 824 2023-11-05T08:29:31.245 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.224+0000 7f78ee7fc640 1 -- 172.21.15.52:0/1303696183 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f78f00a8770 msgr2=0x7f78f00ad0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:31.245 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.224+0000 7f78ee7fc640 1 --2- 172.21.15.52:0/1303696183 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f78f00a8770 0x7f78f00ad0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:31.245 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.224+0000 7f78ee7fc640 1 -- 172.21.15.52:0/1303696183 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f78f013f130 msgr2=0x7f78f01d9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:31.245 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.224+0000 7f78ee7fc640 1 --2- 172.21.15.52:0/1303696183 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f78f013f130 0x7f78f01d9950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:31.245 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.224+0000 7f78ee7fc640 10 monclient: _finish_hunting 0 2023-11-05T08:29:31.246 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.224+0000 7f78ee7fc640 1 monclient: found mon.noname-b 2023-11-05T08:29:31.246 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.224+0000 7f78ee7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:29:31.246 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.224+0000 7f78ee7fc640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.156:3300/0 2023-11-05T08:29:31.246 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.224+0000 7f78ee7fc640 1 -- 172.21.15.52:0/1303696183 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78e0009400 con 0x7f78f00b42c0 2023-11-05T08:29:31.246 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.226+0000 7f78ee7fc640 1 --2- 172.21.15.52:0/1303696183 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f78f00b42c0 0x7f78f00b04e0 secure :-1 s=READY pgs=5018 cs=0 l=1 rev1=1 crypto rx=0x7f78e400e820 tx=0x7f78e400ece0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:29:31.246 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.226+0000 7f78d77fe640 10 client.?.objecter ms_handle_connect 0x7f78f00b42c0 2023-11-05T08:29:31.247 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.226+0000 7f78d77fe640 10 client.?.objecter resend_mon_ops 2023-11-05T08:29:31.247 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.229+0000 7f78d77fe640 1 -- 172.21.15.52:0/1303696183 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78e40095b0 con 0x7f78f00b42c0 2023-11-05T08:29:31.247 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.229+0000 7f78d77fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:29:31.247 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.229+0000 7f78d77fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-05T08:29:31.247 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.229+0000 7f78d77fe640 10 monclient: dump: 2023-11-05T08:29:31.248 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:29:31.248 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:31.248 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:31.248 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:31.248 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:29:31.249 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:31.249 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:29:31.249 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:29:31.249 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:29:31.249 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:31.249 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.229+0000 7f78d77fe640 10 monclient: _finish_auth 0 2023-11-05T08:29:31.250 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.229+0000 7f78d77fe640 10 monclient: _check_auth_tickets 2023-11-05T08:29:31.250 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.229+0000 7f78d77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:29:31.250 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.229+0000 7f78f5790640 5 monclient: authenticate success, global_id 20755 2023-11-05T08:29:31.250 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.229+0000 7f78d77fe640 1 -- 172.21.15.52:0/1303696183 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78e400c940 con 0x7f78f00b42c0 2023-11-05T08:29:31.250 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.229+0000 7f78d77fe640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:29:31.251 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.229+0000 7f78f5790640 10 monclient: _renew_subs 2023-11-05T08:29:31.251 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.229+0000 7f78d77fe640 1 -- 172.21.15.52:0/1303696183 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78e400ccf0 con 0x7f78f00b42c0 2023-11-05T08:29:31.251 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.229+0000 7f78f5790640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:29:31.251 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.229+0000 7f78f5790640 1 -- 172.21.15.52:0/1303696183 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78f00b0cb0 con 0x7f78f00b42c0 2023-11-05T08:29:31.251 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.229+0000 7f78d77fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:29:31.251 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.229+0000 7f78d77fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-05T08:29:31.252 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.229+0000 7f78ed7fa640 4 set_mon_vals no callback set 2023-11-05T08:29:31.252 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.229+0000 7f78d77fe640 10 monclient: dump: 2023-11-05T08:29:31.252 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:29:31.252 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:31.252 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:31.253 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:31.253 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:29:31.253 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:31.253 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:29:31.253 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:29:31.253 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:29:31.254 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:31.254 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.229+0000 7f78f5790640 10 client.20755.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-05T08:29:31.254 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.229+0000 7f78f5790640 10 monclient: _renew_subs 2023-11-05T08:29:31.254 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.229+0000 7f78f5790640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:29:31.254 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.229+0000 7f78f5790640 1 -- 172.21.15.52:0/1303696183 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78f01da0c0 con 0x7f78f00b42c0 2023-11-05T08:29:31.255 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.229+0000 7f78f5790640 1 librados: init done 2023-11-05T08:29:31.255 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.230+0000 7f78f5790640 10 client.20755.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:29:31.255 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.230+0000 7f78f5790640 15 client.20755.objecter _session_command_op_assign -1 1 2023-11-05T08:29:31.255 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.230+0000 7f78f5790640 20 client.20755.objecter _get_session osd=-1 returning homeless 2023-11-05T08:29:31.255 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.230+0000 7f78f5790640 10 client.20755.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-05T08:29:31.256 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.230+0000 7f78f5790640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:29:31.256 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.230+0000 7f78f5790640 1 -- 172.21.15.52:0/1303696183 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f78f00b11c0 con 0x7f78f00b42c0 2023-11-05T08:29:31.257 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.249+0000 7f78d77fe640 1 -- 172.21.15.52:0/1303696183 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f78e4013470 con 0x7f78f00b42c0 2023-11-05T08:29:31.258 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.249+0000 7f78d77fe640 1 --2- 172.21.15.52:0/1303696183 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f78dc06c850 0x7f78dc06ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:31.258 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.249+0000 7f78eeffd640 1 --2- 172.21.15.52:0/1303696183 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f78dc06c850 0x7f78dc06ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:31.258 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.249+0000 7f78eeffd640 10 monclient: get_auth_request con 0x7f78dc06c850 auth_method 0 2023-11-05T08:29:31.258 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.250+0000 7f78eeffd640 1 --2- 172.21.15.52:0/1303696183 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f78dc06c850 0x7f78dc06ed10 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f78e0035000 tx=0x7f78e0008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:29:31.259 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.250+0000 7f78d77fe640 10 client.20755.objecter ms_handle_connect 0x7f78dc06c850 2023-11-05T08:29:31.259 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.252+0000 7f78d77fe640 1 -- 172.21.15.52:0/1303696183 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(932..932 src has 619..932) v4 ==== 6193+0+0 (secure 0 0 0) 0x7f78e40587e0 con 0x7f78f00b42c0 2023-11-05T08:29:31.259 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.252+0000 7f78d77fe640 10 client.20755.objecter ms_dispatch 0x7f78f0000b90 osd_map(932..932 src has 619..932) v4 2023-11-05T08:29:31.259 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.252+0000 7f78d77fe640 3 client.20755.objecter handle_osd_map got epochs [932,932] > 0 2023-11-05T08:29:31.259 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.252+0000 7f78d77fe640 3 client.20755.objecter handle_osd_map decoding full epoch 932 2023-11-05T08:29:31.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.252+0000 7f78d77fe640 10 client.20755.objecter checking command 1 2023-11-05T08:29:31.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.252+0000 7f78d77fe640 1 --2- 172.21.15.52:0/1303696183 >> [v2:172.21.15.156:6810/2755763872,v1:172.21.15.156:6811/2755763872] conn(0x7f78dc0740a0 0x7f78dc076540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:31.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.252+0000 7f78d77fe640 20 client.20755.objecter _get_session s=0x7f78dc0739d0 osd=5 3 2023-11-05T08:29:31.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.252+0000 7f78d77fe640 20 client.20755.objecter put_session s=0x7f78dc0739d0 osd=5 3 2023-11-05T08:29:31.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.252+0000 7f78d77fe640 15 client.20755.objecter _session_command_op_remove -1 1 2023-11-05T08:29:31.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.252+0000 7f78d77fe640 20 client.20755.objecter _get_session s=0x7f78dc0739d0 osd=5 3 2023-11-05T08:29:31.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.252+0000 7f78d77fe640 20 client.20755.objecter get_session s=0x7f78dc0739d0 osd=5 3 2023-11-05T08:29:31.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.252+0000 7f78d77fe640 15 client.20755.objecter _session_command_op_assign 5 1 2023-11-05T08:29:31.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.252+0000 7f78d77fe640 20 client.20755.objecter put_session s=0x7f78dc0739d0 osd=5 4 2023-11-05T08:29:31.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.252+0000 7f78d77fe640 10 client.20755.objecter _send_command 1 2023-11-05T08:29:31.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.252+0000 7f78d77fe640 1 -- 172.21.15.52:0/1303696183 --> [v2:172.21.15.156:6810/2755763872,v1:172.21.15.156:6811/2755763872] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f78dc076c10 con 0x7f78dc0740a0 2023-11-05T08:29:31.262 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.252+0000 7f78d77fe640 20 client.20755.objecter dump_active .. 0 homeless 2023-11-05T08:29:31.262 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.253+0000 7f78ef7fe640 1 --2- 172.21.15.52:0/1303696183 >> [v2:172.21.15.156:6810/2755763872,v1:172.21.15.156:6811/2755763872] conn(0x7f78dc0740a0 0x7f78dc076540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:31.262 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.253+0000 7f78ef7fe640 10 monclient: get_auth_request con 0x7f78dc0740a0 auth_method 0 2023-11-05T08:29:31.262 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.254+0000 7f78d77fe640 1 -- 172.21.15.52:0/1303696183 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_get_version_reply(handle=1 version=932) v2 ==== 24+0+0 (secure 0 0 0) 0x7f78e4054b20 con 0x7f78f00b42c0 2023-11-05T08:29:31.262 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.254+0000 7f78d77fe640 10 monclient: handle_get_version_reply finishing 1 version 932 2023-11-05T08:29:31.263 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.256+0000 7f78ef7fe640 1 --2- 172.21.15.52:0/1303696183 >> [v2:172.21.15.156:6810/2755763872,v1:172.21.15.156:6811/2755763872] conn(0x7f78dc0740a0 0x7f78dc076540 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:29:31.263 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.256+0000 7f78d77fe640 10 client.20755.objecter ms_handle_connect 0x7f78dc0740a0 2023-11-05T08:29:31.280 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.279+0000 7f78d77fe640 1 -- 172.21.15.52:0/1303696183 <== osd.5 v2:172.21.15.156:6810/2755763872 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f78dc076c10 con 0x7f78dc0740a0 2023-11-05T08:29:31.280 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.279+0000 7f78d77fe640 10 client.20755.objecter ms_dispatch 0x7f78f0000b90 command_reply(tid 1: 0 ) v1 2023-11-05T08:29:31.281 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.279+0000 7f78d77fe640 10 client.20755.objecter _finish_command 1 = system:0 2023-11-05T08:29:31.281 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.279+0000 7f78d77fe640 20 client.20755.objecter put_session s=0x7f78dc0739d0 osd=5 4 2023-11-05T08:29:31.281 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.279+0000 7f78d77fe640 15 client.20755.objecter _session_command_op_remove 5 1 2023-11-05T08:29:31.293 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.292+0000 7f78f5790640 10 client.20755.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2023-11-05T08:29:31.293 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.292+0000 7f78f5790640 15 client.20755.objecter _session_command_op_assign -1 2 2023-11-05T08:29:31.293 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.292+0000 7f78f5790640 20 client.20755.objecter _get_session s=0x7f78dc0739d0 osd=5 3 2023-11-05T08:29:31.293 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.292+0000 7f78f5790640 20 client.20755.objecter put_session s=0x7f78dc0739d0 osd=5 3 2023-11-05T08:29:31.294 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.292+0000 7f78f5790640 20 client.20755.objecter _get_session s=0x7f78dc0739d0 osd=5 3 2023-11-05T08:29:31.294 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.292+0000 7f78f5790640 15 client.20755.objecter _session_command_op_remove -1 2 2023-11-05T08:29:31.294 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.292+0000 7f78f5790640 20 client.20755.objecter get_session s=0x7f78dc0739d0 osd=5 3 2023-11-05T08:29:31.294 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.292+0000 7f78f5790640 15 client.20755.objecter _session_command_op_assign 5 2 2023-11-05T08:29:31.294 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.292+0000 7f78f5790640 20 client.20755.objecter put_session s=0x7f78dc0739d0 osd=5 4 2023-11-05T08:29:31.295 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.292+0000 7f78f5790640 10 client.20755.objecter _send_command 2 2023-11-05T08:29:31.295 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.292+0000 7f78f5790640 1 -- 172.21.15.52:0/1303696183 --> [v2:172.21.15.156:6810/2755763872,v1:172.21.15.156:6811/2755763872] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f78f0075530 con 0x7f78dc0740a0 2023-11-05T08:29:31.307 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.306+0000 7f78d77fe640 1 -- 172.21.15.52:0/1303696183 <== osd.5 v2:172.21.15.156:6810/2755763872 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f78f0075530 con 0x7f78dc0740a0 2023-11-05T08:29:31.307 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.306+0000 7f78d77fe640 10 client.20755.objecter ms_dispatch 0x7f78f0000b90 command_reply(tid 2: 0 ) v1 2023-11-05T08:29:31.308 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.306+0000 7f78d77fe640 10 client.20755.objecter _finish_command 2 = system:0 2023-11-05T08:29:31.308 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.306+0000 7f78d77fe640 20 client.20755.objecter put_session s=0x7f78dc0739d0 osd=5 4 2023-11-05T08:29:31.308 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.306+0000 7f78d77fe640 15 client.20755.objecter _session_command_op_remove 5 2 2023-11-05T08:29:31.308 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2023-11-05T08:29:31.309 INFO:teuthology.orchestra.run.smithi052.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-05T08:29:31.309 INFO:teuthology.orchestra.run.smithi052.stdout:} 2023-11-05T08:29:31.310 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.306+0000 7f78f5790640 10 librados: watch_flush enter 2023-11-05T08:29:31.310 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.306+0000 7f78f5790640 10 librados: watch_flush exit 2023-11-05T08:29:31.311 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.306+0000 7f78f5790640 10 client.20755.objecter close_session for osd.5 2023-11-05T08:29:31.311 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.306+0000 7f78f5790640 1 -- 172.21.15.52:0/1303696183 >> [v2:172.21.15.156:6810/2755763872,v1:172.21.15.156:6811/2755763872] conn(0x7f78dc0740a0 msgr2=0x7f78dc076540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:31.311 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.306+0000 7f78f5790640 1 --2- 172.21.15.52:0/1303696183 >> [v2:172.21.15.156:6810/2755763872,v1:172.21.15.156:6811/2755763872] conn(0x7f78dc0740a0 0x7f78dc076540 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:31.311 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.306+0000 7f78f5790640 20 client.20755.objecter put_session s=0x7f78dc0739d0 osd=5 1 2023-11-05T08:29:31.311 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.306+0000 7f78f5790640 20 client.20755.objecter shutdown clearing up homeless session... 2023-11-05T08:29:31.312 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.306+0000 7f78f5790640 10 client.20755.objecter successfully canceled tick 2023-11-05T08:29:31.312 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.306+0000 7f78f5790640 1 -- 172.21.15.52:0/1303696183 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f78dc06c850 msgr2=0x7f78dc06ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:31.312 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.306+0000 7f78f5790640 1 --2- 172.21.15.52:0/1303696183 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f78dc06c850 0x7f78dc06ed10 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f78e0035000 tx=0x7f78e0008030 comp rx=0 tx=0).stop 2023-11-05T08:29:31.312 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.306+0000 7f78f5790640 10 monclient: shutdown 2023-11-05T08:29:31.312 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.306+0000 7f78f5790640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:29:31.313 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.306+0000 7f78f5790640 1 -- 172.21.15.52:0/1303696183 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f78f00b42c0 msgr2=0x7f78f00b04e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:31.313 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.306+0000 7f78f5790640 1 --2- 172.21.15.52:0/1303696183 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f78f00b42c0 0x7f78f00b04e0 secure :-1 s=READY pgs=5018 cs=0 l=1 rev1=1 crypto rx=0x7f78e400e820 tx=0x7f78e400ece0 comp rx=0 tx=0).stop 2023-11-05T08:29:31.313 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.306+0000 7f78ef7fe640 1 -- 172.21.15.52:0/1303696183 reap_dead start 2023-11-05T08:29:31.313 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.306+0000 7f78f5790640 1 -- 172.21.15.52:0/1303696183 shutdown_connections 2023-11-05T08:29:31.313 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.306+0000 7f78f5790640 1 -- 172.21.15.52:0/1303696183 >> 172.21.15.52:0/1303696183 conn(0x7f78f0065ee0 msgr2=0x7f78f00b2600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:29:31.314 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.306+0000 7f78f5790640 1 -- 172.21.15.52:0/1303696183 shutdown_connections 2023-11-05T08:29:31.314 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.306+0000 7f78f5790640 1 -- 172.21.15.52:0/1303696183 wait complete. 2023-11-05T08:29:31.314 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.307+0000 7f78f5790640 1 librados: shutdown 2023-11-05T08:29:31.319 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-11-05T08:29:31.415 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:23:34.531 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:29:31.421 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:23:34.537 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:29:31.437 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.436+0000 7fdea41f5640 10 monclient: get_monmap_and_config 2023-11-05T08:29:31.437 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.436+0000 7fdea41f5640 10 monclient: build_initial_monmap 2023-11-05T08:29:31.438 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.436+0000 7fdea41f5640 10 monclient: monmap: 2023-11-05T08:29:31.438 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:29:31.438 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:31.438 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:29:31.438073+0000 2023-11-05T08:29:31.438 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:29:31.438073+0000 2023-11-05T08:29:31.439 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:29:31.439 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:31.439 INFO:teuthology.orchestra.run.smithi052.stderr:0: v1:172.21.15.52:6789/0 mon.noname-a-legacy 2023-11-05T08:29:31.439 INFO:teuthology.orchestra.run.smithi052.stderr:1: v1:172.21.15.156:6789/0 mon.noname-c-legacy 2023-11-05T08:29:31.439 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-b 2023-11-05T08:29:31.439 INFO:teuthology.orchestra.run.smithi052.stderr:3: v2:172.21.15.52:3300/0 mon.noname-a 2023-11-05T08:29:31.440 INFO:teuthology.orchestra.run.smithi052.stderr:4: v2:172.21.15.156:3300/0 mon.noname-c 2023-11-05T08:29:31.440 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:31.441 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.437+0000 7fdea41f5640 1 Processor -- start 2023-11-05T08:29:31.441 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.437+0000 7fdea41f5640 1 -- start start 2023-11-05T08:29:31.442 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.437+0000 7fdea41f5640 10 monclient: init 2023-11-05T08:29:31.442 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.437+0000 7fdea41f5640 10 monclient: _reopen_session rank -1 2023-11-05T08:29:31.442 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.438+0000 7fdea41f5640 10 monclient: _add_conns ranks=[0,2,3,4,1] 2023-11-05T08:29:31.442 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.438+0000 7fdea41f5640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fde9c0b4240 addr v1:172.21.15.52:6789/0 2023-11-05T08:29:31.442 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.438+0000 7fdea41f5640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fde9c0b38d0 0x7fde9c0ae640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:31.443 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.438+0000 7fdea41f5640 10 monclient(hunting): picked mon.noname-b con 0x7fde9c0b38d0 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:29:31.443 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.438+0000 7fdea41f5640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fde9c0ade00 0x7fde9c13b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:31.443 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.438+0000 7fdea41f5640 10 monclient(hunting): picked mon.noname-a con 0x7fde9c0ade00 addr v2:172.21.15.52:3300/0 2023-11-05T08:29:31.443 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.438+0000 7fdea41f5640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde9c0b0cc0 con 0x7fde9c0b4240 2023-11-05T08:29:31.443 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.438+0000 7fdea41f5640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:31.444 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.438+0000 7fdea41f5640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde9c0b4620 con 0x7fde9c0ade00 2023-11-05T08:29:31.444 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.438+0000 7fdea41f5640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:31.444 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.438+0000 7fdea41f5640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde9c0aeb80 con 0x7fde9c0b38d0 2023-11-05T08:29:31.444 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.438+0000 7fdea41f5640 10 monclient(hunting): _renew_subs 2023-11-05T08:29:31.444 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.438+0000 7fdea41f5640 10 monclient(hunting): authenticate will time out at 2717.644033s 2023-11-05T08:29:31.445 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:23:34.557 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:29:31.445 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.440+0000 7fdea2792640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fde9c0ade00 0x7fde9c13b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:31.446 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.441+0000 7fdea1f91640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fde9c0b4240 0x7fde9c0b1150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:46074/0 (socket says 172.21.15.52:46074) 2023-11-05T08:29:31.446 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.441+0000 7fdea1f91640 1 -- 172.21.15.52:0/754999368 learned_addr learned my addr 172.21.15.52:0/754999368 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-11-05T08:29:31.446 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.441+0000 7fdea2792640 10 monclient(hunting): get_auth_request con 0x7fde9c0ade00 auth_method 0 2023-11-05T08:29:31.446 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.441+0000 7fdea2792640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:29:31.446 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.441+0000 7fdea2792640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:29:31.447 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.441+0000 7fdea2792640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:29:31.447 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.446+0000 7fdea2792640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:29:31.447 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.446+0000 7fdea2792640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:29:31.447 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.446+0000 7fdea2792640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:29:31.455 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.454+0000 7fdea2792640 10 monclient(hunting): handle_auth_done global_id 15741 payload 274 2023-11-05T08:29:31.455 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.454+0000 7fdea2792640 1 -- 172.21.15.52:0/754999368 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fde9c0b38d0 msgr2=0x7fde9c0ae640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-05T08:29:31.456 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.454+0000 7fdea2792640 1 --2- 172.21.15.52:0/754999368 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fde9c0b38d0 0x7fde9c0ae640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:31.456 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.454+0000 7fdea2792640 1 -- 172.21.15.52:0/754999368 >> v1:172.21.15.52:6789/0 conn(0x7fde9c0b4240 legacy=0x7fde9c0b1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:31.456 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.454+0000 7fdea2792640 10 monclient: _finish_hunting 0 2023-11-05T08:29:31.456 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.454+0000 7fdea2792640 1 monclient: found mon.noname-a 2023-11-05T08:29:31.456 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.454+0000 7fdea2792640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:29:31.457 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.454+0000 7fdea2792640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.52:3300/0 2023-11-05T08:29:31.457 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.454+0000 7fdea2792640 1 -- 172.21.15.52:0/754999368 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde9c13f5f0 con 0x7fde9c0ade00 2023-11-05T08:29:31.461 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.460+0000 7fdea2792640 1 --2- 172.21.15.52:0/754999368 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde9c0ade00 0x7fde9c13b420 secure :-1 s=READY pgs=3056 cs=0 l=1 rev1=1 crypto rx=0x7fde94009d90 tx=0x7fde9402be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2324ad4fed4a6ed3 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:29:31.467 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:23:34.542 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:29:31.469 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:23:34.544 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:29:31.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.470+0000 7fdea0f8f640 1 -- 172.21.15.52:0/754999368 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde9402cbc0 con 0x7fde9c0ade00 2023-11-05T08:29:31.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.470+0000 7fdea0f8f640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:29:31.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.470+0000 7fdea0f8f640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-11-05T08:29:31.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.470+0000 7fdea0f8f640 10 monclient: dump: 2023-11-05T08:29:31.472 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:29:31.472 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:31.472 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:31.472 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:31.472 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:29:31.473 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:31.473 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:29:31.473 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:29:31.473 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:29:31.473 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:31.473 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.470+0000 7fdea0f8f640 10 monclient: _finish_auth 0 2023-11-05T08:29:31.474 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.470+0000 7fdea0f8f640 10 monclient: _check_auth_tickets 2023-11-05T08:29:31.474 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.470+0000 7fdea0f8f640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:29:31.474 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.470+0000 7fdea0f8f640 1 -- 172.21.15.52:0/754999368 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde9402cd20 con 0x7fde9c0ade00 2023-11-05T08:29:31.474 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.470+0000 7fdea41f5640 5 monclient: authenticate success, global_id 15741 2023-11-05T08:29:31.474 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.470+0000 7fdea41f5640 20 monclient: get_monmap_and_config waiting for monmap|config 2023-11-05T08:29:31.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.470+0000 7fdea0f8f640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:29:31.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.470+0000 7fdea41f5640 10 monclient: get_monmap_and_config success 2023-11-05T08:29:31.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.470+0000 7fdea41f5640 4 set_mon_vals no callback set 2023-11-05T08:29:31.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.470+0000 7fdea0f8f640 1 -- 172.21.15.52:0/754999368 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde94034660 con 0x7fde9c0ade00 2023-11-05T08:29:31.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.470+0000 7fdea0f8f640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:29:31.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.470+0000 7fdea0f8f640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-11-05T08:29:31.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.470+0000 7fdea0f8f640 10 monclient: dump: 2023-11-05T08:29:31.476 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:29:31.476 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:31.477 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:31.477 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:31.477 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:29:31.477 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:31.477 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:29:31.477 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:29:31.478 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:29:31.478 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:31.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.470+0000 7fdea41f5640 10 monclient: shutdown 2023-11-05T08:29:31.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.470+0000 7fdea41f5640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:29:31.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.470+0000 7fdea41f5640 1 -- 172.21.15.52:0/754999368 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde9c0ade00 msgr2=0x7fde9c13b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:31.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.470+0000 7fdea41f5640 1 --2- 172.21.15.52:0/754999368 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde9c0ade00 0x7fde9c13b420 secure :-1 s=READY pgs=3056 cs=0 l=1 rev1=1 crypto rx=0x7fde94009d90 tx=0x7fde9402be10 comp rx=0 tx=0).stop 2023-11-05T08:29:31.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.470+0000 7fdea41f5640 1 -- 172.21.15.52:0/754999368 shutdown_connections 2023-11-05T08:29:31.480 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.470+0000 7fdea41f5640 1 --2- 172.21.15.52:0/754999368 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde9c0ade00 0x7fde9c13b420 unknown :-1 s=CLOSED pgs=3056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:31.480 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.470+0000 7fdea41f5640 1 --2- 172.21.15.52:0/754999368 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fde9c0b38d0 0x7fde9c0ae640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:31.480 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.470+0000 7fdea41f5640 1 -- 172.21.15.52:0/754999368 >> 172.21.15.52:0/754999368 conn(0x7fde9c065cd0 msgr2=0x7fde9c0660e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:29:31.480 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.470+0000 7fdea41f5640 1 -- 172.21.15.52:0/754999368 shutdown_connections 2023-11-05T08:29:31.480 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.470+0000 7fdea41f5640 1 -- 172.21.15.52:0/754999368 wait complete. 2023-11-05T08:29:31.481 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:23:34.587 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:29:31.483 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.471+0000 7fdea41f5640 10 monclient: build_initial_monmap 2023-11-05T08:29:31.483 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.471+0000 7fdea41f5640 10 monclient: monmap: 2023-11-05T08:29:31.483 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:29:31.483 INFO:teuthology.orchestra.run.smithi052.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-05T08:29:31.483 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 0.000000 2023-11-05T08:29:31.484 INFO:teuthology.orchestra.run.smithi052.stderr:created 0.000000 2023-11-05T08:29:31.484 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:29:31.484 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:31.484 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.noname-a 2023-11-05T08:29:31.484 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.noname-b 2023-11-05T08:29:31.484 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-c 2023-11-05T08:29:31.485 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:31.485 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.471+0000 7fdea41f5640 1 librados: starting msgr at 2023-11-05T08:29:31.485 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.471+0000 7fdea41f5640 1 librados: starting objecter 2023-11-05T08:29:31.485 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.472+0000 7fdea41f5640 1 Processor -- start 2023-11-05T08:29:31.485 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.472+0000 7fdea41f5640 1 -- start start 2023-11-05T08:29:31.486 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.472+0000 7fdea41f5640 1 librados: setting wanted keys 2023-11-05T08:29:31.486 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.472+0000 7fdea41f5640 1 librados: calling monclient init 2023-11-05T08:29:31.486 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.472+0000 7fdea41f5640 10 monclient: init 2023-11-05T08:29:31.486 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.472+0000 7fdea41f5640 10 monclient: _reopen_session rank -1 2023-11-05T08:29:31.486 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.472+0000 7fdea41f5640 10 monclient: _add_conns ranks=[0,1,2] 2023-11-05T08:29:31.486 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.472+0000 7fdea41f5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde9c0ade00 0x7fde9c143470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:31.487 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.472+0000 7fdea41f5640 10 monclient(hunting): picked mon.noname-a con 0x7fde9c0ade00 addr [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] 2023-11-05T08:29:31.487 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.472+0000 7fdea41f5640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fde9c0b4240 0x7fde9c1d6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:31.487 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.472+0000 7fdea41f5640 10 monclient(hunting): picked mon.noname-b con 0x7fde9c0b4240 addr [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] 2023-11-05T08:29:31.487 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.472+0000 7fdea41f5640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fde9c1d71e0 0x7fde9c0a8720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:31.487 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.472+0000 7fdea41f5640 10 monclient(hunting): picked mon.noname-c con 0x7fde9c1d71e0 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:29:31.488 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.472+0000 7fdea41f5640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:31.488 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.472+0000 7fdea41f5640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde9c145530 con 0x7fde9c0ade00 2023-11-05T08:29:31.488 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.472+0000 7fdea41f5640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:31.488 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.472+0000 7fdea41f5640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde9c1d6810 con 0x7fde9c0b4240 2023-11-05T08:29:31.488 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.472+0000 7fdea41f5640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:31.488 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.472+0000 7fdea41f5640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde9c1d64a0 con 0x7fde9c1d71e0 2023-11-05T08:29:31.489 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.472+0000 7fdea41f5640 10 monclient(hunting): _renew_subs 2023-11-05T08:29:31.489 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.472+0000 7fdea41f5640 10 monclient(hunting): authenticate will time out at 2717.678543s 2023-11-05T08:29:31.489 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.475+0000 7fdea1790640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fde9c0b4240 0x7fde9c1d6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:31.489 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.476+0000 7fdea2792640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fde9c1d71e0 0x7fde9c0a8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:31.489 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.478+0000 7fdea1790640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fde9c0b4240 0x7fde9c1d6ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.52:34610/0 (socket says 172.21.15.52:34610) 2023-11-05T08:29:31.490 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.478+0000 7fdea1790640 1 -- 172.21.15.52:0/1915163020 learned_addr learned my addr 172.21.15.52:0/1915163020 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-11-05T08:29:31.490 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.478+0000 7fdea1790640 10 monclient(hunting): get_auth_request con 0x7fde9c0b4240 auth_method 0 2023-11-05T08:29:31.490 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.478+0000 7fdea1790640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:29:31.490 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.478+0000 7fdea1790640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:29:31.490 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.478+0000 7fdea1790640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:29:31.491 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.478+0000 7fdea2792640 10 monclient(hunting): get_auth_request con 0x7fde9c1d71e0 auth_method 0 2023-11-05T08:29:31.491 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.478+0000 7fdea2792640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:29:31.491 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.478+0000 7fdea2792640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:29:31.491 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.478+0000 7fdea2792640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:29:31.491 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.479+0000 7fdea2792640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:29:31.491 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.479+0000 7fdea2792640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:29:31.492 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.479+0000 7fdea2792640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:29:31.492 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:23:34.596 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:29:31.493 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.480+0000 7fdea1790640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:29:31.493 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.480+0000 7fdea1790640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:29:31.493 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.480+0000 7fdea1790640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:29:31.493 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.483+0000 7fdea1790640 10 monclient(hunting): handle_auth_done global_id 20758 payload 824 2023-11-05T08:29:31.494 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.483+0000 7fdea1790640 1 -- 172.21.15.52:0/1915163020 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fde9c1d71e0 msgr2=0x7fde9c0a8720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:31.494 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.483+0000 7fdea1790640 1 --2- 172.21.15.52:0/1915163020 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fde9c1d71e0 0x7fde9c0a8720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:31.494 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.483+0000 7fdea1790640 1 -- 172.21.15.52:0/1915163020 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde9c0ade00 msgr2=0x7fde9c143470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:31.494 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.483+0000 7fdea1790640 1 --2- 172.21.15.52:0/1915163020 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde9c0ade00 0x7fde9c143470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:31.494 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.483+0000 7fdea1790640 10 monclient: _finish_hunting 0 2023-11-05T08:29:31.494 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.483+0000 7fdea1790640 1 monclient: found mon.noname-b 2023-11-05T08:29:31.495 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.483+0000 7fdea1790640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:29:31.495 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.483+0000 7fdea1790640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.156:3300/0 2023-11-05T08:29:31.495 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.483+0000 7fdea1790640 1 -- 172.21.15.52:0/1915163020 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde94009a70 con 0x7fde9c0b4240 2023-11-05T08:29:31.495 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.488+0000 7fdea1790640 1 --2- 172.21.15.52:0/1915163020 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fde9c0b4240 0x7fde9c1d6ca0 secure :-1 s=READY pgs=5019 cs=0 l=1 rev1=1 crypto rx=0x7fde8c00b4a0 tx=0x7fde8c00b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:29:31.495 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.488+0000 7fde927fc640 10 client.?.objecter ms_handle_connect 0x7fde9c0b4240 2023-11-05T08:29:31.495 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.488+0000 7fde927fc640 10 client.?.objecter resend_mon_ops 2023-11-05T08:29:31.496 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:23:34.569 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:29:31.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.494+0000 7fde927fc640 1 -- 172.21.15.52:0/1915163020 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde8c010610 con 0x7fde9c0b4240 2023-11-05T08:29:31.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.494+0000 7fde927fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:29:31.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.494+0000 7fde927fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-05T08:29:31.498 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.494+0000 7fde927fc640 10 monclient: dump: 2023-11-05T08:29:31.498 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:29:31.498 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:31.498 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:31.498 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:31.499 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:29:31.499 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:31.499 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:29:31.499 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:29:31.499 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:29:31.499 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:31.500 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.494+0000 7fde927fc640 10 monclient: _finish_auth 0 2023-11-05T08:29:31.500 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.494+0000 7fde927fc640 10 monclient: _check_auth_tickets 2023-11-05T08:29:31.500 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.494+0000 7fde927fc640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:29:31.500 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.494+0000 7fde927fc640 1 -- 172.21.15.52:0/1915163020 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde8c010770 con 0x7fde9c0b4240 2023-11-05T08:29:31.500 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.494+0000 7fdea41f5640 5 monclient: authenticate success, global_id 20758 2023-11-05T08:29:31.500 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.494+0000 7fdea41f5640 10 monclient: _renew_subs 2023-11-05T08:29:31.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.494+0000 7fdea41f5640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:29:31.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.494+0000 7fdea41f5640 1 -- 172.21.15.52:0/1915163020 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde9c0a9640 con 0x7fde9c0b4240 2023-11-05T08:29:31.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.494+0000 7fde927fc640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:29:31.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.494+0000 7fde927fc640 1 -- 172.21.15.52:0/1915163020 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde8c010b20 con 0x7fde9c0b4240 2023-11-05T08:29:31.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.494+0000 7fde927fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:29:31.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.494+0000 7fde927fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-05T08:29:31.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.494+0000 7fde93fff640 4 set_mon_vals no callback set 2023-11-05T08:29:31.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.494+0000 7fde927fc640 10 monclient: dump: 2023-11-05T08:29:31.502 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:29:31.502 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:31.502 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:31.503 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:31.503 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:29:31.503 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:31.503 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:29:31.503 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:29:31.503 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:29:31.504 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:31.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.494+0000 7fdea41f5640 10 client.20758.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-05T08:29:31.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.494+0000 7fdea41f5640 10 monclient: _renew_subs 2023-11-05T08:29:31.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.494+0000 7fdea41f5640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:29:31.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.494+0000 7fdea41f5640 1 -- 172.21.15.52:0/1915163020 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde9c0a8e40 con 0x7fde9c0b4240 2023-11-05T08:29:31.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.494+0000 7fdea41f5640 1 librados: init done 2023-11-05T08:29:31.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.495+0000 7fdea41f5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-05T08:29:31.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.495+0000 7fdea41f5640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:29:31.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.495+0000 7fdea41f5640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:29:31.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.495+0000 7fdea41f5640 1 -- 172.21.15.52:0/1915163020 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde9c04e9f0 con 0x7fde9c0b4240 2023-11-05T08:29:31.506 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:23:34.619 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:29:31.752 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.750+0000 7fde927fc640 1 -- 172.21.15.52:0/1915163020 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fde8c010c80 con 0x7fde9c0b4240 2023-11-05T08:29:31.752 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.750+0000 7fde927fc640 1 --2- 172.21.15.52:0/1915163020 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7fde8006c850 0x7fde8006ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:31.752 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.751+0000 7fdea1f91640 1 --2- 172.21.15.52:0/1915163020 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7fde8006c850 0x7fde8006ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:31.753 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.751+0000 7fdea1f91640 10 monclient: get_auth_request con 0x7fde8006c850 auth_method 0 2023-11-05T08:29:31.753 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.751+0000 7fde927fc640 10 client.20758.objecter ms_handle_connect 0x7fde8006c850 2023-11-05T08:29:31.753 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.751+0000 7fdea1f91640 1 --2- 172.21.15.52:0/1915163020 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7fde8006c850 0x7fde8006ed10 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fde98001550 tx=0x7fde98007a40 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:29:31.754 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.752+0000 7fde927fc640 1 -- 172.21.15.52:0/1915163020 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(932..932 src has 619..932) v4 ==== 6193+0+0 (secure 0 0 0) 0x7fde8c058460 con 0x7fde9c0b4240 2023-11-05T08:29:31.754 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.752+0000 7fde927fc640 10 client.20758.objecter ms_dispatch 0x7fde9c000b90 osd_map(932..932 src has 619..932) v4 2023-11-05T08:29:31.754 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.752+0000 7fde927fc640 3 client.20758.objecter handle_osd_map got epochs [932,932] > 0 2023-11-05T08:29:31.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.752+0000 7fde927fc640 3 client.20758.objecter handle_osd_map decoding full epoch 932 2023-11-05T08:29:31.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.753+0000 7fde927fc640 20 client.20758.objecter dump_active .. 0 homeless 2023-11-05T08:29:31.763 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.762+0000 7fde927fc640 1 -- 172.21.15.52:0/1915163020 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fde8c0547a0 con 0x7fde9c0b4240 2023-11-05T08:29:31.763 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.762+0000 7fde927fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:29:31.764 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.762+0000 7fde927fc640 10 monclient: _finish_command 1 = system:0 2023-11-05T08:29:31.947 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.945+0000 7fdea41f5640 1 -- 172.21.15.52:0/1915163020 --> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fde9c1d6950 con 0x7fde8006c850 2023-11-05T08:29:31.947 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.946+0000 7fde927fc640 1 -- 172.21.15.52:0/1915163020 <== mgr.4108 v2:172.21.15.156:6800/3320012339 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fde9c1d6950 con 0x7fde8006c850 2023-11-05T08:29:31.947 INFO:teuthology.orchestra.run.smithi052.stderr:instructed osd(s) 5 to deep-scrub 2023-11-05T08:29:31.950 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.947+0000 7fdea41f5640 10 librados: watch_flush enter 2023-11-05T08:29:31.950 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.948+0000 7fdea41f5640 10 librados: watch_flush exit 2023-11-05T08:29:31.950 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.948+0000 7fdea41f5640 20 client.20758.objecter shutdown clearing up homeless session... 2023-11-05T08:29:31.950 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.948+0000 7fdea41f5640 10 client.20758.objecter successfully canceled tick 2023-11-05T08:29:31.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.948+0000 7fdea41f5640 1 -- 172.21.15.52:0/1915163020 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7fde8006c850 msgr2=0x7fde8006ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:31.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.948+0000 7fdea41f5640 1 --2- 172.21.15.52:0/1915163020 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7fde8006c850 0x7fde8006ed10 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fde98001550 tx=0x7fde98007a40 comp rx=0 tx=0).stop 2023-11-05T08:29:31.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.948+0000 7fdea41f5640 10 monclient: shutdown 2023-11-05T08:29:31.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.948+0000 7fdea41f5640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:29:31.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.948+0000 7fdea41f5640 1 -- 172.21.15.52:0/1915163020 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fde9c0b4240 msgr2=0x7fde9c1d6ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:31.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.948+0000 7fdea41f5640 1 --2- 172.21.15.52:0/1915163020 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fde9c0b4240 0x7fde9c1d6ca0 secure :-1 s=READY pgs=5019 cs=0 l=1 rev1=1 crypto rx=0x7fde8c00b4a0 tx=0x7fde8c00b960 comp rx=0 tx=0).stop 2023-11-05T08:29:31.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.948+0000 7fdea41f5640 1 -- 172.21.15.52:0/1915163020 shutdown_connections 2023-11-05T08:29:31.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.948+0000 7fdea41f5640 1 --2- 172.21.15.52:0/1915163020 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7fde8006c850 0x7fde8006ed10 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:31.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.948+0000 7fdea41f5640 1 --2- 172.21.15.52:0/1915163020 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fde9c1d71e0 0x7fde9c0a8720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:31.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.948+0000 7fdea41f5640 1 --2- 172.21.15.52:0/1915163020 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fde9c0b4240 0x7fde9c1d6ca0 unknown :-1 s=CLOSED pgs=5019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:31.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.948+0000 7fdea41f5640 1 --2- 172.21.15.52:0/1915163020 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde9c0ade00 0x7fde9c143470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:31.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.948+0000 7fdea41f5640 1 -- 172.21.15.52:0/1915163020 >> 172.21.15.52:0/1915163020 conn(0x7fde9c065cd0 msgr2=0x7fde9c13a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:29:31.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.948+0000 7fdea41f5640 1 -- 172.21.15.52:0/1915163020 shutdown_connections 2023-11-05T08:29:31.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.948+0000 7fdea41f5640 1 -- 172.21.15.52:0/1915163020 wait complete. 2023-11-05T08:29:31.954 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:31.948+0000 7fdea41f5640 1 librados: shutdown 2023-11-05T08:29:31.961 INFO:tasks.ceph:Scrubbing osd.6 2023-11-05T08:29:31.962 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-11-05T08:29:32.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.075+0000 7f19e59b6640 10 monclient: get_monmap_and_config 2023-11-05T08:29:32.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.075+0000 7f19e59b6640 10 monclient: build_initial_monmap 2023-11-05T08:29:32.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.075+0000 7f19e59b6640 10 monclient: monmap: 2023-11-05T08:29:32.077 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:29:32.077 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:32.077 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:29:32.076933+0000 2023-11-05T08:29:32.078 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:29:32.076933+0000 2023-11-05T08:29:32.078 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:29:32.078 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:32.078 INFO:teuthology.orchestra.run.smithi052.stderr:0: v1:172.21.15.52:6789/0 mon.noname-a-legacy 2023-11-05T08:29:32.078 INFO:teuthology.orchestra.run.smithi052.stderr:1: v1:172.21.15.156:6789/0 mon.noname-c-legacy 2023-11-05T08:29:32.079 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-b 2023-11-05T08:29:32.079 INFO:teuthology.orchestra.run.smithi052.stderr:3: v2:172.21.15.52:3300/0 mon.noname-a 2023-11-05T08:29:32.079 INFO:teuthology.orchestra.run.smithi052.stderr:4: v2:172.21.15.156:3300/0 mon.noname-c 2023-11-05T08:29:32.079 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:32.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.076+0000 7f19e59b6640 1 Processor -- start 2023-11-05T08:29:32.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.076+0000 7f19e59b6640 1 -- start start 2023-11-05T08:29:32.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.076+0000 7f19e59b6640 10 monclient: init 2023-11-05T08:29:32.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.076+0000 7f19e59b6640 10 monclient: _reopen_session rank -1 2023-11-05T08:29:32.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.076+0000 7f19e59b6640 10 monclient: _add_conns ranks=[2,1,0,3,4] 2023-11-05T08:29:32.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.076+0000 7f19e59b6640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f19e00b42c0 0x7f19e00a9210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:32.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.076+0000 7f19e59b6640 10 monclient(hunting): picked mon.noname-b con 0x7f19e00b42c0 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:29:32.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.076+0000 7f19e59b6640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f19e00a8770 addr v1:172.21.15.156:6789/0 2023-11-05T08:29:32.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.076+0000 7f19e59b6640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f19e013f300 addr v1:172.21.15.52:6789/0 2023-11-05T08:29:32.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.076+0000 7f19e59b6640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19e00a8d00 con 0x7f19e013f300 2023-11-05T08:29:32.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.076+0000 7f19e59b6640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19e00ade80 con 0x7f19e00a8770 2023-11-05T08:29:32.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.076+0000 7f19e59b6640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:32.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.076+0000 7f19e59b6640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19e00ae010 con 0x7f19e00b42c0 2023-11-05T08:29:32.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.076+0000 7f19e59b6640 10 monclient(hunting): _renew_subs 2023-11-05T08:29:32.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.076+0000 7f19e59b6640 10 monclient(hunting): authenticate will time out at 2718.282630s 2023-11-05T08:29:32.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.079+0000 7f19df7fe640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f19e013f300 0x7f19e0144f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:46082/0 (socket says 172.21.15.52:46082) 2023-11-05T08:29:32.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.079+0000 7f19df7fe640 1 -- 172.21.15.52:0/2234789203 learned_addr learned my addr 172.21.15.52:0/2234789203 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-11-05T08:29:32.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.079+0000 7f19deffd640 1 --2- 172.21.15.52:0/2234789203 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f19e00b42c0 0x7f19e00a9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:32.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.081+0000 7f19deffd640 10 monclient(hunting): get_auth_request con 0x7f19e00b42c0 auth_method 0 2023-11-05T08:29:32.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.081+0000 7f19deffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:29:32.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.081+0000 7f19deffd640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:29:32.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.081+0000 7f19deffd640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:29:32.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.082+0000 7f19deffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:29:32.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.082+0000 7f19deffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:29:32.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.082+0000 7f19deffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:29:32.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.085+0000 7f19deffd640 10 monclient(hunting): handle_auth_done global_id 17006 payload 274 2023-11-05T08:29:32.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.085+0000 7f19deffd640 1 -- 172.21.15.52:0/2234789203 >> v1:172.21.15.156:6789/0 conn(0x7f19e00a8770 legacy=0x7f19e013ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-05T08:29:32.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.085+0000 7f19deffd640 1 -- 172.21.15.52:0/2234789203 >> v1:172.21.15.52:6789/0 conn(0x7f19e013f300 legacy=0x7f19e0144f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:32.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.085+0000 7f19deffd640 10 monclient: _finish_hunting 0 2023-11-05T08:29:32.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.085+0000 7f19deffd640 1 monclient: found mon.noname-b 2023-11-05T08:29:32.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.085+0000 7f19deffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:29:32.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.085+0000 7f19deffd640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.52:3301/0 2023-11-05T08:29:32.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.085+0000 7f19deffd640 1 -- 172.21.15.52:0/2234789203 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19e0145670 con 0x7f19e00b42c0 2023-11-05T08:29:32.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.093+0000 7f19deffd640 1 --2- 172.21.15.52:0/2234789203 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f19e00b42c0 0x7f19e00a9210 secure :-1 s=READY pgs=3084 cs=0 l=1 rev1=1 crypto rx=0x7f19d00097d0 tx=0x7f19d002b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=43754a8e050f82d7 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:29:32.103 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.102+0000 7f19ddffb640 1 -- 172.21.15.52:0/2234789203 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d00316f0 con 0x7f19e00b42c0 2023-11-05T08:29:32.104 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.102+0000 7f19ddffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:29:32.104 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.102+0000 7f19ddffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-05T08:29:32.104 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.102+0000 7f19ddffb640 10 monclient: dump: 2023-11-05T08:29:32.104 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:29:32.105 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:32.105 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:32.105 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:32.105 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:29:32.105 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:32.106 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:29:32.106 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:29:32.106 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:29:32.106 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:32.107 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.102+0000 7f19ddffb640 10 monclient: _finish_auth 0 2023-11-05T08:29:32.107 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.102+0000 7f19ddffb640 10 monclient: _check_auth_tickets 2023-11-05T08:29:32.107 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.102+0000 7f19ddffb640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:29:32.107 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.102+0000 7f19ddffb640 1 -- 172.21.15.52:0/2234789203 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19d0031850 con 0x7f19e00b42c0 2023-11-05T08:29:32.107 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.102+0000 7f19e59b6640 5 monclient: authenticate success, global_id 17006 2023-11-05T08:29:32.108 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.102+0000 7f19e59b6640 20 monclient: get_monmap_and_config waiting for monmap|config 2023-11-05T08:29:32.108 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.102+0000 7f19ddffb640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:29:32.108 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.102+0000 7f19e59b6640 10 monclient: get_monmap_and_config success 2023-11-05T08:29:32.108 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.102+0000 7f19ddffb640 1 -- 172.21.15.52:0/2234789203 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d0031be0 con 0x7f19e00b42c0 2023-11-05T08:29:32.108 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.102+0000 7f19ddffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:29:32.109 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.102+0000 7f19e59b6640 4 set_mon_vals no callback set 2023-11-05T08:29:32.109 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.102+0000 7f19ddffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-11-05T08:29:32.109 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.102+0000 7f19ddffb640 10 monclient: dump: 2023-11-05T08:29:32.109 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:29:32.109 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:32.110 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:32.110 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:32.110 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:29:32.110 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:32.110 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:29:32.111 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:29:32.111 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:29:32.111 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:32.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.103+0000 7f19e59b6640 10 monclient: shutdown 2023-11-05T08:29:32.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.103+0000 7f19e59b6640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:29:32.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.103+0000 7f19e59b6640 1 -- 172.21.15.52:0/2234789203 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f19e00b42c0 msgr2=0x7f19e00a9210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:32.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.103+0000 7f19e59b6640 1 --2- 172.21.15.52:0/2234789203 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f19e00b42c0 0x7f19e00a9210 secure :-1 s=READY pgs=3084 cs=0 l=1 rev1=1 crypto rx=0x7f19d00097d0 tx=0x7f19d002b790 comp rx=0 tx=0).stop 2023-11-05T08:29:32.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.103+0000 7f19e59b6640 1 -- 172.21.15.52:0/2234789203 shutdown_connections 2023-11-05T08:29:32.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.103+0000 7f19e59b6640 1 --2- 172.21.15.52:0/2234789203 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f19e00b42c0 0x7f19e00a9210 unknown :-1 s=CLOSED pgs=3084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:32.115 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.103+0000 7f19e59b6640 1 -- 172.21.15.52:0/2234789203 >> 172.21.15.52:0/2234789203 conn(0x7f19e0065ee0 msgr2=0x7f19e00662f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:29:32.115 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.103+0000 7f19e59b6640 1 -- 172.21.15.52:0/2234789203 shutdown_connections 2023-11-05T08:29:32.115 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.103+0000 7f19e59b6640 1 -- 172.21.15.52:0/2234789203 wait complete. 2023-11-05T08:29:32.115 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.104+0000 7f19e59b6640 10 monclient: build_initial_monmap 2023-11-05T08:29:32.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.104+0000 7f19e59b6640 10 monclient: monmap: 2023-11-05T08:29:32.116 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:29:32.116 INFO:teuthology.orchestra.run.smithi052.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-05T08:29:32.116 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 0.000000 2023-11-05T08:29:32.116 INFO:teuthology.orchestra.run.smithi052.stderr:created 0.000000 2023-11-05T08:29:32.117 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:29:32.117 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:32.117 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.noname-a 2023-11-05T08:29:32.117 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.noname-b 2023-11-05T08:29:32.117 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-c 2023-11-05T08:29:32.118 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:32.118 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.104+0000 7f19e59b6640 1 librados: starting msgr at 2023-11-05T08:29:32.118 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.104+0000 7f19e59b6640 1 librados: starting objecter 2023-11-05T08:29:32.118 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.104+0000 7f19e59b6640 1 Processor -- start 2023-11-05T08:29:32.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.104+0000 7f19e59b6640 1 -- start start 2023-11-05T08:29:32.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.104+0000 7f19e59b6640 1 librados: setting wanted keys 2023-11-05T08:29:32.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.104+0000 7f19e59b6640 1 librados: calling monclient init 2023-11-05T08:29:32.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.104+0000 7f19e59b6640 10 monclient: init 2023-11-05T08:29:32.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.105+0000 7f19e59b6640 10 monclient: _reopen_session rank -1 2023-11-05T08:29:32.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.105+0000 7f19e59b6640 10 monclient: _add_conns ranks=[2,0,1] 2023-11-05T08:29:32.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.105+0000 7f19e59b6640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f19e00a8770 0x7f19e00b0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:32.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.105+0000 7f19e59b6640 10 monclient(hunting): picked mon.noname-c con 0x7f19e00a8770 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:29:32.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.105+0000 7f19e59b6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19e00b42c0 0x7f19e013f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:32.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.105+0000 7f19e59b6640 10 monclient(hunting): picked mon.noname-a con 0x7f19e00b42c0 addr [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] 2023-11-05T08:29:32.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.105+0000 7f19e59b6640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f19e013f300 0x7f19e00b0de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:32.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.105+0000 7f19e59b6640 10 monclient(hunting): picked mon.noname-b con 0x7f19e013f300 addr [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] 2023-11-05T08:29:32.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.105+0000 7f19e59b6640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:32.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.105+0000 7f19e59b6640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19e0140f80 con 0x7f19e00b42c0 2023-11-05T08:29:32.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.105+0000 7f19e59b6640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:32.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.105+0000 7f19e59b6640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19e013fda0 con 0x7f19e013f300 2023-11-05T08:29:32.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.105+0000 7f19e59b6640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:32.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.105+0000 7f19e59b6640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19e00afa30 con 0x7f19e00a8770 2023-11-05T08:29:32.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.105+0000 7f19e59b6640 10 monclient(hunting): _renew_subs 2023-11-05T08:29:32.123 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.105+0000 7f19e59b6640 10 monclient(hunting): authenticate will time out at 2718.311576s 2023-11-05T08:29:32.123 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.109+0000 7f19de7fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19e00b42c0 0x7f19e013f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:32.124 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.113+0000 7f19de7fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19e00b42c0 0x7f19e013f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60118/0 (socket says 172.21.15.52:60118) 2023-11-05T08:29:32.125 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.113+0000 7f19de7fc640 1 -- 172.21.15.52:0/325306791 learned_addr learned my addr 172.21.15.52:0/325306791 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-11-05T08:29:32.125 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.113+0000 7f19de7fc640 10 monclient(hunting): get_auth_request con 0x7f19e00b42c0 auth_method 0 2023-11-05T08:29:32.125 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.113+0000 7f19de7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:29:32.125 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.113+0000 7f19de7fc640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:29:32.125 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.113+0000 7f19de7fc640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:29:32.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.113+0000 7f19deffd640 1 --2- 172.21.15.52:0/325306791 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f19e00a8770 0x7f19e00b0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:32.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.114+0000 7f19deffd640 10 monclient(hunting): get_auth_request con 0x7f19e00a8770 auth_method 0 2023-11-05T08:29:32.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.114+0000 7f19deffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:29:32.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.114+0000 7f19deffd640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:29:32.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.114+0000 7f19deffd640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:29:32.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.114+0000 7f19de7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:29:32.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.114+0000 7f19de7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:29:32.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.114+0000 7f19de7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:29:32.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.117+0000 7f19deffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:29:32.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.117+0000 7f19deffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:29:32.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.117+0000 7f19deffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:29:32.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.120+0000 7f19de7fc640 10 monclient(hunting): handle_auth_done global_id 15747 payload 824 2023-11-05T08:29:32.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.120+0000 7f19de7fc640 1 -- 172.21.15.52:0/325306791 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f19e00a8770 msgr2=0x7f19e00b0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:32.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.120+0000 7f19de7fc640 1 --2- 172.21.15.52:0/325306791 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f19e00a8770 0x7f19e00b0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:32.129 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.120+0000 7f19de7fc640 1 -- 172.21.15.52:0/325306791 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f19e013f300 msgr2=0x7f19e00b0de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:32.129 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.120+0000 7f19de7fc640 1 --2- 172.21.15.52:0/325306791 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f19e013f300 0x7f19e00b0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:32.129 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.120+0000 7f19de7fc640 10 monclient: _finish_hunting 0 2023-11-05T08:29:32.129 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.120+0000 7f19de7fc640 1 monclient: found mon.noname-a 2023-11-05T08:29:32.129 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.120+0000 7f19de7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:29:32.130 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.120+0000 7f19de7fc640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.52:3300/0 2023-11-05T08:29:32.130 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.120+0000 7f19de7fc640 1 -- 172.21.15.52:0/325306791 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19d0009400 con 0x7f19e00b42c0 2023-11-05T08:29:32.130 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.127+0000 7f19de7fc640 1 --2- 172.21.15.52:0/325306791 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19e00b42c0 0x7f19e013f860 secure :-1 s=READY pgs=3058 cs=0 l=1 rev1=1 crypto rx=0x7f19d400c410 tx=0x7f19d400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:29:32.131 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.127+0000 7f19c7fff640 10 client.?.objecter ms_handle_connect 0x7f19e00b42c0 2023-11-05T08:29:32.131 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.127+0000 7f19c7fff640 10 client.?.objecter resend_mon_ops 2023-11-05T08:29:32.137 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.136+0000 7f19c7fff640 1 -- 172.21.15.52:0/325306791 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d40035f0 con 0x7f19e00b42c0 2023-11-05T08:29:32.137 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.136+0000 7f19c7fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:29:32.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.136+0000 7f19c7fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-11-05T08:29:32.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.136+0000 7f19c7fff640 10 monclient: dump: 2023-11-05T08:29:32.138 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:29:32.138 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:32.139 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:32.139 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:32.139 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:29:32.139 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:32.139 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:29:32.140 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:29:32.140 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:29:32.140 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:32.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.136+0000 7f19c7fff640 10 monclient: _finish_auth 0 2023-11-05T08:29:32.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.136+0000 7f19c7fff640 10 monclient: _check_auth_tickets 2023-11-05T08:29:32.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.136+0000 7f19c7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:29:32.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.136+0000 7f19c7fff640 1 -- 172.21.15.52:0/325306791 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19d4003750 con 0x7f19e00b42c0 2023-11-05T08:29:32.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.136+0000 7f19c7fff640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:29:32.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.136+0000 7f19c7fff640 1 -- 172.21.15.52:0/325306791 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d4003b40 con 0x7f19e00b42c0 2023-11-05T08:29:32.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.136+0000 7f19c7fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:29:32.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.136+0000 7f19c7fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-11-05T08:29:32.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.136+0000 7f19c7fff640 10 monclient: dump: 2023-11-05T08:29:32.142 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:29:32.142 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:32.143 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:32.143 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:32.143 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:29:32.143 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:32.143 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:29:32.144 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:29:32.144 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:29:32.144 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:32.144 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.136+0000 7f19e59b6640 5 monclient: authenticate success, global_id 15747 2023-11-05T08:29:32.144 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.136+0000 7f19e59b6640 10 monclient: _renew_subs 2023-11-05T08:29:32.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.136+0000 7f19e59b6640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.52:3300/0 2023-11-05T08:29:32.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.136+0000 7f19e59b6640 1 -- 172.21.15.52:0/325306791 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19e01413a0 con 0x7f19e00b42c0 2023-11-05T08:29:32.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.136+0000 7f19dd7fa640 4 set_mon_vals no callback set 2023-11-05T08:29:32.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.136+0000 7f19e59b6640 10 client.15747.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-05T08:29:32.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.136+0000 7f19e59b6640 10 monclient: _renew_subs 2023-11-05T08:29:32.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.136+0000 7f19e59b6640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.52:3300/0 2023-11-05T08:29:32.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.136+0000 7f19e59b6640 1 -- 172.21.15.52:0/325306791 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19e00af5b0 con 0x7f19e00b42c0 2023-11-05T08:29:32.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.136+0000 7f19e59b6640 1 librados: init done 2023-11-05T08:29:32.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.137+0000 7f19e59b6640 10 client.15747.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:29:32.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.137+0000 7f19e59b6640 15 client.15747.objecter _session_command_op_assign -1 1 2023-11-05T08:29:32.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.137+0000 7f19e59b6640 20 client.15747.objecter _get_session osd=-1 returning homeless 2023-11-05T08:29:32.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.137+0000 7f19e59b6640 10 client.15747.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-05T08:29:32.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.137+0000 7f19e59b6640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.52:3300/0 2023-11-05T08:29:32.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.137+0000 7f19e59b6640 1 -- 172.21.15.52:0/325306791 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f19e01410f0 con 0x7f19e00b42c0 2023-11-05T08:29:32.172 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.171+0000 7f19c7fff640 1 -- 172.21.15.52:0/325306791 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f19d4003ca0 con 0x7f19e00b42c0 2023-11-05T08:29:32.172 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.171+0000 7f19c7fff640 1 --2- 172.21.15.52:0/325306791 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f19cc06c800 0x7f19cc06ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:32.173 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.172+0000 7f19deffd640 1 --2- 172.21.15.52:0/325306791 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f19cc06c800 0x7f19cc06ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:32.173 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.172+0000 7f19deffd640 10 monclient: get_auth_request con 0x7f19cc06c800 auth_method 0 2023-11-05T08:29:32.173 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.172+0000 7f19deffd640 1 --2- 172.21.15.52:0/325306791 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f19cc06c800 0x7f19cc06ecc0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f19d0036000 tx=0x7f19d0008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:29:32.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.172+0000 7f19c7fff640 10 client.15747.objecter ms_handle_connect 0x7f19cc06c800 2023-11-05T08:29:32.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.176+0000 7f19c7fff640 1 -- 172.21.15.52:0/325306791 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(932..932 src has 619..932) v4 ==== 6193+0+0 (secure 0 0 0) 0x7f19d40010c0 con 0x7f19e00b42c0 2023-11-05T08:29:32.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.176+0000 7f19c7fff640 10 client.15747.objecter ms_dispatch 0x7f19e0000b90 osd_map(932..932 src has 619..932) v4 2023-11-05T08:29:32.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.176+0000 7f19c7fff640 3 client.15747.objecter handle_osd_map got epochs [932,932] > 0 2023-11-05T08:29:32.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.176+0000 7f19c7fff640 3 client.15747.objecter handle_osd_map decoding full epoch 932 2023-11-05T08:29:32.179 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.176+0000 7f19c7fff640 10 client.15747.objecter checking command 1 2023-11-05T08:29:32.179 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.176+0000 7f19c7fff640 1 --2- 172.21.15.52:0/325306791 >> [v2:172.21.15.156:6826/2586579514,v1:172.21.15.156:6827/2586579514] conn(0x7f19cc074050 0x7f19cc0764f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:32.179 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.176+0000 7f19c7fff640 20 client.15747.objecter _get_session s=0x7f19cc073980 osd=6 3 2023-11-05T08:29:32.179 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.176+0000 7f19c7fff640 20 client.15747.objecter put_session s=0x7f19cc073980 osd=6 3 2023-11-05T08:29:32.179 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.176+0000 7f19c7fff640 15 client.15747.objecter _session_command_op_remove -1 1 2023-11-05T08:29:32.180 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.176+0000 7f19c7fff640 20 client.15747.objecter _get_session s=0x7f19cc073980 osd=6 3 2023-11-05T08:29:32.180 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.176+0000 7f19c7fff640 20 client.15747.objecter get_session s=0x7f19cc073980 osd=6 3 2023-11-05T08:29:32.180 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.176+0000 7f19c7fff640 15 client.15747.objecter _session_command_op_assign 6 1 2023-11-05T08:29:32.180 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.176+0000 7f19c7fff640 20 client.15747.objecter put_session s=0x7f19cc073980 osd=6 4 2023-11-05T08:29:32.181 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.176+0000 7f19c7fff640 10 client.15747.objecter _send_command 1 2023-11-05T08:29:32.181 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.176+0000 7f19c7fff640 1 -- 172.21.15.52:0/325306791 --> [v2:172.21.15.156:6826/2586579514,v1:172.21.15.156:6827/2586579514] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f19cc076bc0 con 0x7f19cc074050 2023-11-05T08:29:32.181 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.176+0000 7f19c7fff640 20 client.15747.objecter dump_active .. 0 homeless 2023-11-05T08:29:32.181 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.176+0000 7f19c7fff640 1 -- 172.21.15.52:0/325306791 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=932) v2 ==== 24+0+0 (secure 0 0 0) 0x7f19d4053c70 con 0x7f19e00b42c0 2023-11-05T08:29:32.181 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.176+0000 7f19c7fff640 10 monclient: handle_get_version_reply finishing 1 version 932 2023-11-05T08:29:32.182 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.177+0000 7f19df7fe640 1 --2- 172.21.15.52:0/325306791 >> [v2:172.21.15.156:6826/2586579514,v1:172.21.15.156:6827/2586579514] conn(0x7f19cc074050 0x7f19cc0764f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:32.182 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.177+0000 7f19df7fe640 10 monclient: get_auth_request con 0x7f19cc074050 auth_method 0 2023-11-05T08:29:32.183 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.180+0000 7f19df7fe640 1 --2- 172.21.15.52:0/325306791 >> [v2:172.21.15.156:6826/2586579514,v1:172.21.15.156:6827/2586579514] conn(0x7f19cc074050 0x7f19cc0764f0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:29:32.183 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.180+0000 7f19c7fff640 10 client.15747.objecter ms_handle_connect 0x7f19cc074050 2023-11-05T08:29:32.228 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.227+0000 7f19c7fff640 1 -- 172.21.15.52:0/325306791 <== osd.6 v2:172.21.15.156:6826/2586579514 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f19cc076bc0 con 0x7f19cc074050 2023-11-05T08:29:32.228 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.227+0000 7f19c7fff640 10 client.15747.objecter ms_dispatch 0x7f19e0000b90 command_reply(tid 1: 0 ) v1 2023-11-05T08:29:32.228 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.227+0000 7f19c7fff640 10 client.15747.objecter _finish_command 1 = system:0 2023-11-05T08:29:32.229 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.227+0000 7f19c7fff640 20 client.15747.objecter put_session s=0x7f19cc073980 osd=6 4 2023-11-05T08:29:32.229 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.227+0000 7f19c7fff640 15 client.15747.objecter _session_command_op_remove 6 1 2023-11-05T08:29:32.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.240+0000 7f19e59b6640 10 client.15747.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2023-11-05T08:29:32.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.240+0000 7f19e59b6640 15 client.15747.objecter _session_command_op_assign -1 2 2023-11-05T08:29:32.242 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.240+0000 7f19e59b6640 20 client.15747.objecter _get_session s=0x7f19cc073980 osd=6 3 2023-11-05T08:29:32.242 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.240+0000 7f19e59b6640 20 client.15747.objecter put_session s=0x7f19cc073980 osd=6 3 2023-11-05T08:29:32.242 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.240+0000 7f19e59b6640 20 client.15747.objecter _get_session s=0x7f19cc073980 osd=6 3 2023-11-05T08:29:32.242 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.240+0000 7f19e59b6640 15 client.15747.objecter _session_command_op_remove -1 2 2023-11-05T08:29:32.243 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.240+0000 7f19e59b6640 20 client.15747.objecter get_session s=0x7f19cc073980 osd=6 3 2023-11-05T08:29:32.243 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.240+0000 7f19e59b6640 15 client.15747.objecter _session_command_op_assign 6 2 2023-11-05T08:29:32.243 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.240+0000 7f19e59b6640 20 client.15747.objecter put_session s=0x7f19cc073980 osd=6 4 2023-11-05T08:29:32.243 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.240+0000 7f19e59b6640 10 client.15747.objecter _send_command 2 2023-11-05T08:29:32.243 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.240+0000 7f19e59b6640 1 -- 172.21.15.52:0/325306791 --> [v2:172.21.15.156:6826/2586579514,v1:172.21.15.156:6827/2586579514] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f19e00b1500 con 0x7f19cc074050 2023-11-05T08:29:32.256 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.255+0000 7f19c7fff640 1 -- 172.21.15.52:0/325306791 <== osd.6 v2:172.21.15.156:6826/2586579514 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f19d8001b70 con 0x7f19cc074050 2023-11-05T08:29:32.257 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.255+0000 7f19c7fff640 10 client.15747.objecter ms_dispatch 0x7f19e0000b90 command_reply(tid 2: 0 ) v1 2023-11-05T08:29:32.257 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.255+0000 7f19c7fff640 10 client.15747.objecter _finish_command 2 = system:0 2023-11-05T08:29:32.257 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.255+0000 7f19c7fff640 20 client.15747.objecter put_session s=0x7f19cc073980 osd=6 4 2023-11-05T08:29:32.257 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.255+0000 7f19c7fff640 15 client.15747.objecter _session_command_op_remove 6 2 2023-11-05T08:29:32.258 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2023-11-05T08:29:32.258 INFO:teuthology.orchestra.run.smithi052.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-05T08:29:32.258 INFO:teuthology.orchestra.run.smithi052.stdout:} 2023-11-05T08:29:32.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.256+0000 7f19e59b6640 10 librados: watch_flush enter 2023-11-05T08:29:32.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.256+0000 7f19e59b6640 10 librados: watch_flush exit 2023-11-05T08:29:32.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.256+0000 7f19e59b6640 10 client.15747.objecter close_session for osd.6 2023-11-05T08:29:32.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.256+0000 7f19e59b6640 1 -- 172.21.15.52:0/325306791 >> [v2:172.21.15.156:6826/2586579514,v1:172.21.15.156:6827/2586579514] conn(0x7f19cc074050 msgr2=0x7f19cc0764f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:32.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.256+0000 7f19e59b6640 1 --2- 172.21.15.52:0/325306791 >> [v2:172.21.15.156:6826/2586579514,v1:172.21.15.156:6827/2586579514] conn(0x7f19cc074050 0x7f19cc0764f0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:32.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.256+0000 7f19e59b6640 20 client.15747.objecter put_session s=0x7f19cc073980 osd=6 1 2023-11-05T08:29:32.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.256+0000 7f19e59b6640 20 client.15747.objecter shutdown clearing up homeless session... 2023-11-05T08:29:32.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.256+0000 7f19e59b6640 10 client.15747.objecter successfully canceled tick 2023-11-05T08:29:32.262 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.256+0000 7f19e59b6640 1 -- 172.21.15.52:0/325306791 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f19cc06c800 msgr2=0x7f19cc06ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:32.262 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.256+0000 7f19e59b6640 1 --2- 172.21.15.52:0/325306791 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f19cc06c800 0x7f19cc06ecc0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f19d0036000 tx=0x7f19d0008030 comp rx=0 tx=0).stop 2023-11-05T08:29:32.262 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.256+0000 7f19e59b6640 10 monclient: shutdown 2023-11-05T08:29:32.262 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.256+0000 7f19e59b6640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:29:32.263 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.256+0000 7f19e59b6640 1 -- 172.21.15.52:0/325306791 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19e00b42c0 msgr2=0x7f19e013f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:32.263 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.256+0000 7f19e59b6640 1 --2- 172.21.15.52:0/325306791 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19e00b42c0 0x7f19e013f860 secure :-1 s=READY pgs=3058 cs=0 l=1 rev1=1 crypto rx=0x7f19d400c410 tx=0x7f19d400c8d0 comp rx=0 tx=0).stop 2023-11-05T08:29:32.263 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.256+0000 7f19df7fe640 1 -- 172.21.15.52:0/325306791 reap_dead start 2023-11-05T08:29:32.263 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.256+0000 7f19e59b6640 1 -- 172.21.15.52:0/325306791 shutdown_connections 2023-11-05T08:29:32.263 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.256+0000 7f19e59b6640 1 -- 172.21.15.52:0/325306791 >> 172.21.15.52:0/325306791 conn(0x7f19e0065ee0 msgr2=0x7f19e013e110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:29:32.264 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.256+0000 7f19e59b6640 1 -- 172.21.15.52:0/325306791 shutdown_connections 2023-11-05T08:29:32.264 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.256+0000 7f19e59b6640 1 -- 172.21.15.52:0/325306791 wait complete. 2023-11-05T08:29:32.264 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.256+0000 7f19e59b6640 1 librados: shutdown 2023-11-05T08:29:32.269 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-11-05T08:29:32.381 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.380+0000 7f0f646e5640 10 monclient: get_monmap_and_config 2023-11-05T08:29:32.382 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.380+0000 7f0f646e5640 10 monclient: build_initial_monmap 2023-11-05T08:29:32.382 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.380+0000 7f0f646e5640 10 monclient: monmap: 2023-11-05T08:29:32.382 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:29:32.382 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:32.383 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:29:32.381938+0000 2023-11-05T08:29:32.383 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:29:32.381938+0000 2023-11-05T08:29:32.383 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:29:32.383 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:32.383 INFO:teuthology.orchestra.run.smithi052.stderr:0: v1:172.21.15.52:6789/0 mon.noname-a-legacy 2023-11-05T08:29:32.384 INFO:teuthology.orchestra.run.smithi052.stderr:1: v1:172.21.15.156:6789/0 mon.noname-c-legacy 2023-11-05T08:29:32.384 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-b 2023-11-05T08:29:32.384 INFO:teuthology.orchestra.run.smithi052.stderr:3: v2:172.21.15.52:3300/0 mon.noname-a 2023-11-05T08:29:32.384 INFO:teuthology.orchestra.run.smithi052.stderr:4: v2:172.21.15.156:3300/0 mon.noname-c 2023-11-05T08:29:32.384 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:32.384 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.380+0000 7f0f646e5640 1 Processor -- start 2023-11-05T08:29:32.385 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.381+0000 7f0f646e5640 1 -- start start 2023-11-05T08:29:32.385 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.381+0000 7f0f646e5640 10 monclient: init 2023-11-05T08:29:32.387 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.381+0000 7f0f646e5640 10 monclient: _reopen_session rank -1 2023-11-05T08:29:32.387 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.381+0000 7f0f646e5640 10 monclient: _add_conns ranks=[2,1,0,3,4] 2023-11-05T08:29:32.387 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.381+0000 7f0f646e5640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0f5c06bf20 0x7f0f5c141d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:32.387 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.381+0000 7f0f646e5640 10 monclient(hunting): picked mon.noname-b con 0x7f0f5c06bf20 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:29:32.388 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.381+0000 7f0f646e5640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f0f5c06b120 addr v1:172.21.15.156:6789/0 2023-11-05T08:29:32.388 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.381+0000 7f0f646e5640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f0f5c13e810 addr v1:172.21.15.52:6789/0 2023-11-05T08:29:32.388 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.381+0000 7f0f646e5640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f5c06c770 con 0x7f0f5c13e810 2023-11-05T08:29:32.388 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.381+0000 7f0f646e5640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f5c06f7e0 con 0x7f0f5c06b120 2023-11-05T08:29:32.388 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.381+0000 7f0f646e5640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:32.389 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.381+0000 7f0f646e5640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5c142970 con 0x7f0f5c06bf20 2023-11-05T08:29:32.389 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.381+0000 7f0f646e5640 10 monclient(hunting): _renew_subs 2023-11-05T08:29:32.389 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.381+0000 7f0f646e5640 10 monclient(hunting): authenticate will time out at 2718.587742s 2023-11-05T08:29:32.390 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.382+0000 7f0f62c82640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f0f5c13e810 0x7f0f5c13eca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:46090/0 (socket says 172.21.15.52:46090) 2023-11-05T08:29:32.390 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.382+0000 7f0f62c82640 1 -- 172.21.15.52:0/683838869 learned_addr learned my addr 172.21.15.52:0/683838869 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-11-05T08:29:32.391 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.382+0000 7f0f62481640 1 --2- 172.21.15.52:0/683838869 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0f5c06bf20 0x7f0f5c141d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:32.391 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.382+0000 7f0f62481640 10 monclient(hunting): get_auth_request con 0x7f0f5c06bf20 auth_method 0 2023-11-05T08:29:32.391 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.382+0000 7f0f62481640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:29:32.391 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.382+0000 7f0f62481640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:29:32.391 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.382+0000 7f0f62481640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:29:32.392 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.383+0000 7f0f62481640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:29:32.394 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.383+0000 7f0f62481640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:29:32.394 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.383+0000 7f0f62481640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:29:32.395 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.385+0000 7f0f6147f640 1 -- 172.21.15.52:0/683838869 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4282228853 0 0) 0x7f0f5c06c770 con 0x7f0f5c13e810 2023-11-05T08:29:32.395 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.385+0000 7f0f6147f640 10 monclient(hunting): _negotiate 2023-11-05T08:29:32.395 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.385+0000 7f0f6147f640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:29:32.396 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.385+0000 7f0f6147f640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:29:32.396 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.385+0000 7f0f6147f640 10 monclient(hunting): my global_id is 15750 2023-11-05T08:29:32.396 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.385+0000 7f0f6147f640 1 -- 172.21.15.52:0/683838869 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f48003520 con 0x7f0f5c13e810 2023-11-05T08:29:32.396 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.385+0000 7f0f62481640 10 monclient(hunting): handle_auth_done global_id 17012 payload 274 2023-11-05T08:29:32.397 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.385+0000 7f0f62481640 1 -- 172.21.15.52:0/683838869 >> v1:172.21.15.156:6789/0 conn(0x7f0f5c06b120 legacy=0x7f0f5c142260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-05T08:29:32.397 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.385+0000 7f0f62481640 1 -- 172.21.15.52:0/683838869 >> v1:172.21.15.52:6789/0 conn(0x7f0f5c13e810 legacy=0x7f0f5c13eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:32.397 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.385+0000 7f0f62481640 10 monclient: _finish_hunting 0 2023-11-05T08:29:32.397 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.385+0000 7f0f62481640 1 monclient: found mon.noname-b 2023-11-05T08:29:32.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.385+0000 7f0f62481640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:29:32.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.385+0000 7f0f62481640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.52:3301/0 2023-11-05T08:29:32.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.385+0000 7f0f62481640 1 -- 172.21.15.52:0/683838869 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f5c06fac0 con 0x7f0f5c06bf20 2023-11-05T08:29:32.402 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.387+0000 7f0f62481640 1 --2- 172.21.15.52:0/683838869 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0f5c06bf20 0x7f0f5c141d20 secure :-1 s=READY pgs=3085 cs=0 l=1 rev1=1 crypto rx=0x7f0f580097d0 tx=0x7f0f5802b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e23bc3dd7a84b0b9 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:29:32.402 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.391+0000 7f0f6147f640 1 -- 172.21.15.52:0/683838869 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f58031800 con 0x7f0f5c06bf20 2023-11-05T08:29:32.402 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.391+0000 7f0f6147f640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:29:32.403 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.391+0000 7f0f6147f640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-05T08:29:32.403 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.391+0000 7f0f6147f640 10 monclient: dump: 2023-11-05T08:29:32.403 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:29:32.403 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:32.403 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:32.404 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:32.404 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:29:32.404 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:32.404 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:29:32.404 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:29:32.405 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:29:32.405 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:32.405 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.391+0000 7f0f6147f640 10 monclient: _finish_auth 0 2023-11-05T08:29:32.405 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.391+0000 7f0f6147f640 10 monclient: _check_auth_tickets 2023-11-05T08:29:32.405 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.391+0000 7f0f6147f640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:29:32.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.391+0000 7f0f6147f640 1 -- 172.21.15.52:0/683838869 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f58031960 con 0x7f0f5c06bf20 2023-11-05T08:29:32.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.391+0000 7f0f6147f640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:29:32.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.391+0000 7f0f6147f640 1 -- 172.21.15.52:0/683838869 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f58031cf0 con 0x7f0f5c06bf20 2023-11-05T08:29:32.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.391+0000 7f0f646e5640 5 monclient: authenticate success, global_id 17012 2023-11-05T08:29:32.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.391+0000 7f0f646e5640 10 monclient: get_monmap_and_config success 2023-11-05T08:29:32.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.391+0000 7f0f646e5640 4 set_mon_vals no callback set 2023-11-05T08:29:32.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.391+0000 7f0f6147f640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:29:32.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.391+0000 7f0f6147f640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-11-05T08:29:32.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.391+0000 7f0f6147f640 10 monclient: dump: 2023-11-05T08:29:32.407 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:29:32.407 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:32.408 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:32.408 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:32.408 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:29:32.408 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:32.408 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:29:32.409 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:29:32.409 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:29:32.409 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:32.409 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.392+0000 7f0f646e5640 10 monclient: shutdown 2023-11-05T08:29:32.409 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.392+0000 7f0f646e5640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:29:32.410 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.392+0000 7f0f646e5640 1 -- 172.21.15.52:0/683838869 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0f5c06bf20 msgr2=0x7f0f5c141d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:32.410 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.392+0000 7f0f646e5640 1 --2- 172.21.15.52:0/683838869 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0f5c06bf20 0x7f0f5c141d20 secure :-1 s=READY pgs=3085 cs=0 l=1 rev1=1 crypto rx=0x7f0f580097d0 tx=0x7f0f5802b8a0 comp rx=0 tx=0).stop 2023-11-05T08:29:32.410 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.392+0000 7f0f646e5640 1 -- 172.21.15.52:0/683838869 shutdown_connections 2023-11-05T08:29:32.410 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.392+0000 7f0f646e5640 1 --2- 172.21.15.52:0/683838869 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0f5c06bf20 0x7f0f5c141d20 unknown :-1 s=CLOSED pgs=3085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:32.410 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.392+0000 7f0f646e5640 1 -- 172.21.15.52:0/683838869 >> 172.21.15.52:0/683838869 conn(0x7f0f5c0665e0 msgr2=0x7f0f5c0b50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:29:32.410 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.392+0000 7f0f646e5640 1 -- 172.21.15.52:0/683838869 shutdown_connections 2023-11-05T08:29:32.411 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.392+0000 7f0f646e5640 1 -- 172.21.15.52:0/683838869 wait complete. 2023-11-05T08:29:32.411 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.392+0000 7f0f646e5640 10 monclient: build_initial_monmap 2023-11-05T08:29:32.411 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.392+0000 7f0f646e5640 10 monclient: monmap: 2023-11-05T08:29:32.411 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:29:32.411 INFO:teuthology.orchestra.run.smithi052.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-05T08:29:32.412 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 0.000000 2023-11-05T08:29:32.412 INFO:teuthology.orchestra.run.smithi052.stderr:created 0.000000 2023-11-05T08:29:32.412 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:29:32.412 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:32.412 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.noname-a 2023-11-05T08:29:32.412 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.noname-b 2023-11-05T08:29:32.413 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-c 2023-11-05T08:29:32.413 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:32.413 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.393+0000 7f0f646e5640 1 librados: starting msgr at 2023-11-05T08:29:32.413 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.393+0000 7f0f646e5640 1 librados: starting objecter 2023-11-05T08:29:32.413 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.393+0000 7f0f646e5640 1 Processor -- start 2023-11-05T08:29:32.414 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.393+0000 7f0f646e5640 1 -- start start 2023-11-05T08:29:32.414 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.393+0000 7f0f646e5640 1 librados: setting wanted keys 2023-11-05T08:29:32.414 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.393+0000 7f0f646e5640 1 librados: calling monclient init 2023-11-05T08:29:32.414 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.393+0000 7f0f646e5640 10 monclient: init 2023-11-05T08:29:32.414 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.394+0000 7f0f646e5640 10 monclient: _reopen_session rank -1 2023-11-05T08:29:32.415 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.394+0000 7f0f646e5640 10 monclient: _add_conns ranks=[2,1,0] 2023-11-05T08:29:32.415 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.394+0000 7f0f646e5640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0f5c06b120 0x7f0f5c0b4160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:32.415 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.394+0000 7f0f646e5640 10 monclient(hunting): picked mon.noname-c con 0x7f0f5c06b120 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:29:32.415 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.394+0000 7f0f646e5640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0f5c06bf20 0x7f0f5c1d65f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:32.415 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.394+0000 7f0f646e5640 10 monclient(hunting): picked mon.noname-b con 0x7f0f5c06bf20 addr [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] 2023-11-05T08:29:32.415 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.394+0000 7f0f646e5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f5c13e810 0x7f0f5c1d6b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:32.416 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.394+0000 7f0f646e5640 10 monclient(hunting): picked mon.noname-a con 0x7f0f5c13e810 addr [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] 2023-11-05T08:29:32.416 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.394+0000 7f0f646e5640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:32.416 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.394+0000 7f0f646e5640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5c1d7070 con 0x7f0f5c13e810 2023-11-05T08:29:32.416 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.394+0000 7f0f646e5640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:32.416 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.394+0000 7f0f646e5640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5c0a9330 con 0x7f0f5c06bf20 2023-11-05T08:29:32.417 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.394+0000 7f0f646e5640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:32.417 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.394+0000 7f0f646e5640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5c0ae2d0 con 0x7f0f5c06b120 2023-11-05T08:29:32.417 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.394+0000 7f0f646e5640 10 monclient(hunting): _renew_subs 2023-11-05T08:29:32.417 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.394+0000 7f0f646e5640 10 monclient(hunting): authenticate will time out at 2718.600304s 2023-11-05T08:29:32.417 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.395+0000 7f0f62481640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0f5c06b120 0x7f0f5c0b4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:32.417 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.396+0000 7f0f62481640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0f5c06b120 0x7f0f5c0b4160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.52:59854/0 (socket says 172.21.15.52:59854) 2023-11-05T08:29:32.418 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.396+0000 7f0f62481640 1 -- 172.21.15.52:0/2924352199 learned_addr learned my addr 172.21.15.52:0/2924352199 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-11-05T08:29:32.418 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.396+0000 7f0f62481640 10 monclient(hunting): get_auth_request con 0x7f0f5c06b120 auth_method 0 2023-11-05T08:29:32.418 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.396+0000 7f0f62481640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:29:32.418 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.396+0000 7f0f62481640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:29:32.418 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.396+0000 7f0f62481640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:29:32.419 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.396+0000 7f0f62481640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:29:32.419 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.396+0000 7f0f62481640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:29:32.419 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.396+0000 7f0f62481640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:29:32.419 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.396+0000 7f0f62c82640 1 --2- 172.21.15.52:0/2924352199 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f5c13e810 0x7f0f5c1d6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:32.419 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.397+0000 7f0f62c82640 10 monclient(hunting): get_auth_request con 0x7f0f5c13e810 auth_method 0 2023-11-05T08:29:32.420 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.397+0000 7f0f62c82640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:29:32.420 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.397+0000 7f0f62c82640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:29:32.420 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.397+0000 7f0f62c82640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:29:32.420 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.397+0000 7f0f62c82640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:29:32.420 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.397+0000 7f0f62c82640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:29:32.421 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.397+0000 7f0f62c82640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:29:32.421 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.399+0000 7f0f61c80640 1 --2- 172.21.15.52:0/2924352199 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0f5c06bf20 0x7f0f5c1d65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:32.421 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.400+0000 7f0f62c82640 10 monclient(hunting): handle_auth_done global_id 15753 payload 824 2023-11-05T08:29:32.421 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.400+0000 7f0f62c82640 1 -- 172.21.15.52:0/2924352199 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0f5c06b120 msgr2=0x7f0f5c0b4160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:32.421 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.400+0000 7f0f62c82640 1 --2- 172.21.15.52:0/2924352199 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0f5c06b120 0x7f0f5c0b4160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:32.422 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.400+0000 7f0f62c82640 1 -- 172.21.15.52:0/2924352199 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0f5c06bf20 msgr2=0x7f0f5c1d65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:32.422 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.400+0000 7f0f62c82640 1 --2- 172.21.15.52:0/2924352199 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0f5c06bf20 0x7f0f5c1d65f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:32.422 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.400+0000 7f0f62c82640 10 monclient: _finish_hunting 0 2023-11-05T08:29:32.422 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.400+0000 7f0f62c82640 1 monclient: found mon.noname-a 2023-11-05T08:29:32.422 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.400+0000 7f0f62c82640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:29:32.422 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.400+0000 7f0f62c82640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.52:3300/0 2023-11-05T08:29:32.423 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.400+0000 7f0f62c82640 1 -- 172.21.15.52:0/2924352199 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f58009400 con 0x7f0f5c13e810 2023-11-05T08:29:32.424 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.403+0000 7f0f62c82640 1 --2- 172.21.15.52:0/2924352199 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f5c13e810 0x7f0f5c1d6b30 secure :-1 s=READY pgs=3060 cs=0 l=1 rev1=1 crypto rx=0x7f0f5400caa0 tx=0x7f0f5400cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:29:32.425 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.403+0000 7f0f52ffd640 10 client.?.objecter ms_handle_connect 0x7f0f5c13e810 2023-11-05T08:29:32.425 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.403+0000 7f0f52ffd640 10 client.?.objecter resend_mon_ops 2023-11-05T08:29:32.425 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.407+0000 7f0f52ffd640 1 -- 172.21.15.52:0/2924352199 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5400ab40 con 0x7f0f5c13e810 2023-11-05T08:29:32.425 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.407+0000 7f0f52ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:29:32.425 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.407+0000 7f0f52ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-11-05T08:29:32.426 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.407+0000 7f0f52ffd640 10 monclient: dump: 2023-11-05T08:29:32.426 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:29:32.426 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:32.426 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:32.426 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:32.426 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:29:32.427 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:32.427 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:29:32.427 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:29:32.427 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:29:32.427 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:32.428 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.407+0000 7f0f52ffd640 10 monclient: _finish_auth 0 2023-11-05T08:29:32.428 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.407+0000 7f0f52ffd640 10 monclient: _check_auth_tickets 2023-11-05T08:29:32.428 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.407+0000 7f0f52ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:29:32.428 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.407+0000 7f0f52ffd640 1 -- 172.21.15.52:0/2924352199 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f5400aca0 con 0x7f0f5c13e810 2023-11-05T08:29:32.428 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.407+0000 7f0f646e5640 5 monclient: authenticate success, global_id 15753 2023-11-05T08:29:32.429 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.407+0000 7f0f646e5640 10 monclient: _renew_subs 2023-11-05T08:29:32.429 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.407+0000 7f0f646e5640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.52:3300/0 2023-11-05T08:29:32.429 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.407+0000 7f0f646e5640 1 -- 172.21.15.52:0/2924352199 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f5c0ae7f0 con 0x7f0f5c13e810 2023-11-05T08:29:32.429 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.407+0000 7f0f52ffd640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:29:32.429 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.407+0000 7f0f52ffd640 1 -- 172.21.15.52:0/2924352199 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f54012600 con 0x7f0f5c13e810 2023-11-05T08:29:32.429 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.407+0000 7f0f52ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:29:32.430 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.407+0000 7f0f52ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-11-05T08:29:32.430 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.407+0000 7f0f52ffd640 10 monclient: dump: 2023-11-05T08:29:32.430 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:29:32.430 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:32.430 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:32.431 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:32.431 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:29:32.431 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:32.431 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:29:32.431 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:29:32.431 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:29:32.432 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:32.432 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.407+0000 7f0f60c7e640 4 set_mon_vals no callback set 2023-11-05T08:29:32.432 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.407+0000 7f0f646e5640 10 client.15753.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-05T08:29:32.432 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.407+0000 7f0f646e5640 10 monclient: _renew_subs 2023-11-05T08:29:32.432 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.407+0000 7f0f646e5640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.52:3300/0 2023-11-05T08:29:32.433 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.407+0000 7f0f646e5640 1 -- 172.21.15.52:0/2924352199 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f5c0adf90 con 0x7f0f5c13e810 2023-11-05T08:29:32.433 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.407+0000 7f0f646e5640 1 librados: init done 2023-11-05T08:29:32.433 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.408+0000 7f0f646e5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-05T08:29:32.433 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.408+0000 7f0f646e5640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:29:32.433 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.408+0000 7f0f646e5640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.52:3300/0 2023-11-05T08:29:32.434 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.408+0000 7f0f646e5640 1 -- 172.21.15.52:0/2924352199 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f5c04e9f0 con 0x7f0f5c13e810 2023-11-05T08:29:32.672 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.671+0000 7f0f52ffd640 1 -- 172.21.15.52:0/2924352199 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0f54007070 con 0x7f0f5c13e810 2023-11-05T08:29:32.672 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.671+0000 7f0f52ffd640 1 --2- 172.21.15.52:0/2924352199 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f0f4006c830 0x7f0f4006ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:32.673 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.671+0000 7f0f62481640 1 --2- 172.21.15.52:0/2924352199 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f0f4006c830 0x7f0f4006ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:32.673 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.671+0000 7f0f62481640 10 monclient: get_auth_request con 0x7f0f4006c830 auth_method 0 2023-11-05T08:29:32.673 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.672+0000 7f0f62481640 1 --2- 172.21.15.52:0/2924352199 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f0f4006c830 0x7f0f4006ecf0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f0f5802b8e0 tx=0x7f0f5803c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:29:32.673 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.672+0000 7f0f52ffd640 10 client.15753.objecter ms_handle_connect 0x7f0f4006c830 2023-11-05T08:29:32.692 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.691+0000 7f0f52ffd640 1 -- 172.21.15.52:0/2924352199 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(932..932 src has 619..932) v4 ==== 6193+0+0 (secure 0 0 0) 0x7f0f540586a0 con 0x7f0f5c13e810 2023-11-05T08:29:32.692 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.691+0000 7f0f52ffd640 10 client.15753.objecter ms_dispatch 0x7f0f5c000b90 osd_map(932..932 src has 619..932) v4 2023-11-05T08:29:32.692 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.691+0000 7f0f52ffd640 3 client.15753.objecter handle_osd_map got epochs [932,932] > 0 2023-11-05T08:29:32.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.691+0000 7f0f52ffd640 3 client.15753.objecter handle_osd_map decoding full epoch 932 2023-11-05T08:29:32.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.691+0000 7f0f52ffd640 20 client.15753.objecter dump_active .. 0 homeless 2023-11-05T08:29:32.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.691+0000 7f0f52ffd640 1 -- 172.21.15.52:0/2924352199 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0f540549e0 con 0x7f0f5c13e810 2023-11-05T08:29:32.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.691+0000 7f0f52ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:29:32.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.691+0000 7f0f52ffd640 10 monclient: _finish_command 1 = system:0 2023-11-05T08:29:32.875 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.873+0000 7f0f646e5640 1 -- 172.21.15.52:0/2924352199 --> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f0f5c13f3b0 con 0x7f0f4006c830 2023-11-05T08:29:32.875 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.874+0000 7f0f52ffd640 1 -- 172.21.15.52:0/2924352199 <== mgr.4108 v2:172.21.15.156:6800/3320012339 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f0f5803a420 con 0x7f0f4006c830 2023-11-05T08:29:32.875 INFO:teuthology.orchestra.run.smithi052.stderr:instructed osd(s) 6 to deep-scrub 2023-11-05T08:29:32.878 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.876+0000 7f0f646e5640 10 librados: watch_flush enter 2023-11-05T08:29:32.878 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.876+0000 7f0f646e5640 10 librados: watch_flush exit 2023-11-05T08:29:32.878 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.876+0000 7f0f646e5640 20 client.15753.objecter shutdown clearing up homeless session... 2023-11-05T08:29:32.878 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.876+0000 7f0f646e5640 10 client.15753.objecter successfully canceled tick 2023-11-05T08:29:32.879 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.876+0000 7f0f646e5640 1 -- 172.21.15.52:0/2924352199 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f0f4006c830 msgr2=0x7f0f4006ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:32.879 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.876+0000 7f0f646e5640 1 --2- 172.21.15.52:0/2924352199 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f0f4006c830 0x7f0f4006ecf0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f0f5802b8e0 tx=0x7f0f5803c040 comp rx=0 tx=0).stop 2023-11-05T08:29:32.879 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.876+0000 7f0f646e5640 10 monclient: shutdown 2023-11-05T08:29:32.879 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.876+0000 7f0f646e5640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:29:32.880 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.876+0000 7f0f646e5640 1 -- 172.21.15.52:0/2924352199 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f5c13e810 msgr2=0x7f0f5c1d6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:32.880 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.876+0000 7f0f646e5640 1 --2- 172.21.15.52:0/2924352199 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f5c13e810 0x7f0f5c1d6b30 secure :-1 s=READY pgs=3060 cs=0 l=1 rev1=1 crypto rx=0x7f0f5400caa0 tx=0x7f0f5400cea0 comp rx=0 tx=0).stop 2023-11-05T08:29:32.880 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.876+0000 7f0f646e5640 1 -- 172.21.15.52:0/2924352199 shutdown_connections 2023-11-05T08:29:32.880 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.876+0000 7f0f646e5640 1 --2- 172.21.15.52:0/2924352199 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f0f4006c830 0x7f0f4006ecf0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:32.880 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.876+0000 7f0f646e5640 1 --2- 172.21.15.52:0/2924352199 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f5c13e810 0x7f0f5c1d6b30 unknown :-1 s=CLOSED pgs=3060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:32.880 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.876+0000 7f0f646e5640 1 --2- 172.21.15.52:0/2924352199 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0f5c06bf20 0x7f0f5c1d65f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:32.881 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.876+0000 7f0f646e5640 1 --2- 172.21.15.52:0/2924352199 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0f5c06b120 0x7f0f5c0b4160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:32.881 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.876+0000 7f0f646e5640 1 -- 172.21.15.52:0/2924352199 >> 172.21.15.52:0/2924352199 conn(0x7f0f5c0665e0 msgr2=0x7f0f5c13ff00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:29:32.881 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.876+0000 7f0f646e5640 1 -- 172.21.15.52:0/2924352199 shutdown_connections 2023-11-05T08:29:32.881 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.876+0000 7f0f646e5640 1 -- 172.21.15.52:0/2924352199 wait complete. 2023-11-05T08:29:32.881 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:32.876+0000 7f0f646e5640 1 librados: shutdown 2023-11-05T08:29:32.890 INFO:tasks.ceph:Scrubbing osd.7 2023-11-05T08:29:32.890 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-11-05T08:29:33.002 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.001+0000 7fc70967c640 10 monclient: get_monmap_and_config 2023-11-05T08:29:33.002 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.001+0000 7fc70967c640 10 monclient: build_initial_monmap 2023-11-05T08:29:33.003 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.001+0000 7fc70967c640 10 monclient: monmap: 2023-11-05T08:29:33.003 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:29:33.003 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:33.003 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:29:33.002674+0000 2023-11-05T08:29:33.003 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:29:33.002674+0000 2023-11-05T08:29:33.004 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:29:33.004 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:33.004 INFO:teuthology.orchestra.run.smithi052.stderr:0: v1:172.21.15.52:6789/0 mon.noname-a-legacy 2023-11-05T08:29:33.004 INFO:teuthology.orchestra.run.smithi052.stderr:1: v1:172.21.15.156:6789/0 mon.noname-c-legacy 2023-11-05T08:29:33.004 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-b 2023-11-05T08:29:33.005 INFO:teuthology.orchestra.run.smithi052.stderr:3: v2:172.21.15.52:3300/0 mon.noname-a 2023-11-05T08:29:33.005 INFO:teuthology.orchestra.run.smithi052.stderr:4: v2:172.21.15.156:3300/0 mon.noname-c 2023-11-05T08:29:33.005 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:33.007 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.001+0000 7fc70967c640 1 Processor -- start 2023-11-05T08:29:33.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.001+0000 7fc70967c640 1 -- start start 2023-11-05T08:29:33.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.001+0000 7fc70967c640 10 monclient: init 2023-11-05T08:29:33.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.002+0000 7fc70967c640 10 monclient: _reopen_session rank -1 2023-11-05T08:29:33.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.002+0000 7fc70967c640 10 monclient: _add_conns ranks=[2,4,1,3,0] 2023-11-05T08:29:33.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.002+0000 7fc70967c640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc7040b42c0 0x7fc7040a9210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:33.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.002+0000 7fc70967c640 10 monclient(hunting): picked mon.noname-b con 0x7fc7040b42c0 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:29:33.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.002+0000 7fc70967c640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc7040a8770 0x7fc70413ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:33.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.002+0000 7fc70967c640 10 monclient(hunting): picked mon.noname-c con 0x7fc7040a8770 addr v2:172.21.15.156:3300/0 2023-11-05T08:29:33.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.002+0000 7fc70967c640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fc70413f130 addr v1:172.21.15.156:6789/0 2023-11-05T08:29:33.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.002+0000 7fc70967c640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7040a8d00 con 0x7fc70413f130 2023-11-05T08:29:33.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.002+0000 7fc70967c640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:33.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.002+0000 7fc70967c640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7040b46a0 con 0x7fc7040a8770 2023-11-05T08:29:33.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.002+0000 7fc70967c640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:33.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.002+0000 7fc70967c640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc70413f5c0 con 0x7fc7040b42c0 2023-11-05T08:29:33.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.002+0000 7fc70967c640 10 monclient(hunting): _renew_subs 2023-11-05T08:29:33.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.002+0000 7fc70967c640 10 monclient(hunting): authenticate will time out at 2719.208331s 2023-11-05T08:29:33.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.003+0000 7fc702ffd640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc7040b42c0 0x7fc7040a9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:33.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.003+0000 7fc7027fc640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc7040a8770 0x7fc70413ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:33.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.003+0000 7fc702ffd640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc7040b42c0 0x7fc7040a9210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.52:59872/0 (socket says 172.21.15.52:59872) 2023-11-05T08:29:33.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.003+0000 7fc702ffd640 1 -- 172.21.15.52:0/229704669 learned_addr learned my addr 172.21.15.52:0/229704669 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-11-05T08:29:33.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.003+0000 7fc702ffd640 10 monclient(hunting): get_auth_request con 0x7fc7040b42c0 auth_method 0 2023-11-05T08:29:33.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.003+0000 7fc702ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:29:33.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.003+0000 7fc702ffd640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:29:33.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.003+0000 7fc702ffd640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:29:33.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.003+0000 7fc7027fc640 10 monclient(hunting): get_auth_request con 0x7fc7040a8770 auth_method 0 2023-11-05T08:29:33.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.003+0000 7fc7027fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:29:33.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.003+0000 7fc7027fc640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:29:33.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.003+0000 7fc7027fc640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:29:33.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.003+0000 7fc702ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:29:33.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.003+0000 7fc702ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:29:33.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.003+0000 7fc702ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:29:33.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.004+0000 7fc7027fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:29:33.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.004+0000 7fc7027fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:29:33.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.004+0000 7fc7027fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:29:33.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.005+0000 7fc702ffd640 10 monclient(hunting): handle_auth_done global_id 17018 payload 274 2023-11-05T08:29:33.015 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.005+0000 7fc702ffd640 1 -- 172.21.15.52:0/229704669 >> v2:172.21.15.156:3300/0 conn(0x7fc7040a8770 msgr2=0x7fc70413ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-05T08:29:33.015 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.005+0000 7fc702ffd640 1 --2- 172.21.15.52:0/229704669 >> v2:172.21.15.156:3300/0 conn(0x7fc7040a8770 0x7fc70413ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:33.015 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.005+0000 7fc702ffd640 1 -- 172.21.15.52:0/229704669 >> v1:172.21.15.156:6789/0 conn(0x7fc70413f130 legacy=0x7fc704144f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:33.015 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.005+0000 7fc702ffd640 10 monclient: _finish_hunting 0 2023-11-05T08:29:33.016 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.005+0000 7fc702ffd640 1 monclient: found mon.noname-b 2023-11-05T08:29:33.016 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.005+0000 7fc702ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:29:33.016 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.005+0000 7fc702ffd640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.52:3301/0 2023-11-05T08:29:33.016 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.005+0000 7fc702ffd640 1 -- 172.21.15.52:0/229704669 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7040ade80 con 0x7fc7040b42c0 2023-11-05T08:29:33.020 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.007+0000 7fc702ffd640 1 --2- 172.21.15.52:0/229704669 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc7040b42c0 0x7fc7040a9210 secure :-1 s=READY pgs=3088 cs=0 l=1 rev1=1 crypto rx=0x7fc6fc009e50 tx=0x7fc6fc02be40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bfffa9e253d8d51b server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:29:33.020 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.011+0000 7fc701ffb640 1 -- 172.21.15.52:0/229704669 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6fc02c9e0 con 0x7fc7040b42c0 2023-11-05T08:29:33.020 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.011+0000 7fc701ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:29:33.020 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.011+0000 7fc701ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-05T08:29:33.021 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.011+0000 7fc701ffb640 10 monclient: dump: 2023-11-05T08:29:33.021 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:29:33.021 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:33.021 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:33.021 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:33.022 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:29:33.022 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:33.022 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:29:33.022 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:29:33.022 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:29:33.023 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:33.023 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.011+0000 7fc701ffb640 10 monclient: _finish_auth 0 2023-11-05T08:29:33.023 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.011+0000 7fc701ffb640 10 monclient: _check_auth_tickets 2023-11-05T08:29:33.023 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.011+0000 7fc701ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:29:33.023 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.011+0000 7fc701ffb640 1 -- 172.21.15.52:0/229704669 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6fc02cb40 con 0x7fc7040b42c0 2023-11-05T08:29:33.024 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.011+0000 7fc701ffb640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:29:33.024 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.011+0000 7fc701ffb640 1 -- 172.21.15.52:0/229704669 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6fc0343f0 con 0x7fc7040b42c0 2023-11-05T08:29:33.024 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.011+0000 7fc70967c640 5 monclient: authenticate success, global_id 17018 2023-11-05T08:29:33.024 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.011+0000 7fc70967c640 10 monclient: get_monmap_and_config success 2023-11-05T08:29:33.024 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.011+0000 7fc70967c640 4 set_mon_vals no callback set 2023-11-05T08:29:33.024 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.011+0000 7fc701ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:29:33.025 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.011+0000 7fc701ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-11-05T08:29:33.025 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.011+0000 7fc701ffb640 10 monclient: dump: 2023-11-05T08:29:33.025 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:29:33.025 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:33.025 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:33.025 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:33.026 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:29:33.026 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:33.026 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:29:33.026 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:29:33.026 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:29:33.027 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:33.027 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.012+0000 7fc70967c640 10 monclient: shutdown 2023-11-05T08:29:33.027 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.012+0000 7fc70967c640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:29:33.027 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.012+0000 7fc70967c640 1 -- 172.21.15.52:0/229704669 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc7040b42c0 msgr2=0x7fc7040a9210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:33.027 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.012+0000 7fc70967c640 1 --2- 172.21.15.52:0/229704669 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc7040b42c0 0x7fc7040a9210 secure :-1 s=READY pgs=3088 cs=0 l=1 rev1=1 crypto rx=0x7fc6fc009e50 tx=0x7fc6fc02be40 comp rx=0 tx=0).stop 2023-11-05T08:29:33.028 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.012+0000 7fc70967c640 1 -- 172.21.15.52:0/229704669 shutdown_connections 2023-11-05T08:29:33.028 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.012+0000 7fc70967c640 1 --2- 172.21.15.52:0/229704669 >> v2:172.21.15.156:3300/0 conn(0x7fc7040a8770 0x7fc70413ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:33.028 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.012+0000 7fc70967c640 1 --2- 172.21.15.52:0/229704669 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc7040b42c0 0x7fc7040a9210 unknown :-1 s=CLOSED pgs=3088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:33.028 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.012+0000 7fc70967c640 1 -- 172.21.15.52:0/229704669 >> 172.21.15.52:0/229704669 conn(0x7fc704065ee0 msgr2=0x7fc7040662f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:29:33.028 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.012+0000 7fc70967c640 1 -- 172.21.15.52:0/229704669 shutdown_connections 2023-11-05T08:29:33.029 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.012+0000 7fc70967c640 1 -- 172.21.15.52:0/229704669 wait complete. 2023-11-05T08:29:33.029 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.013+0000 7fc70967c640 10 monclient: build_initial_monmap 2023-11-05T08:29:33.029 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.013+0000 7fc70967c640 10 monclient: monmap: 2023-11-05T08:29:33.029 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:29:33.029 INFO:teuthology.orchestra.run.smithi052.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-05T08:29:33.030 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 0.000000 2023-11-05T08:29:33.030 INFO:teuthology.orchestra.run.smithi052.stderr:created 0.000000 2023-11-05T08:29:33.030 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:29:33.030 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:33.030 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.noname-a 2023-11-05T08:29:33.030 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.noname-b 2023-11-05T08:29:33.031 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-c 2023-11-05T08:29:33.031 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:33.031 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.013+0000 7fc70967c640 1 librados: starting msgr at 2023-11-05T08:29:33.031 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.013+0000 7fc70967c640 1 librados: starting objecter 2023-11-05T08:29:33.031 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.013+0000 7fc70967c640 1 Processor -- start 2023-11-05T08:29:33.032 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.013+0000 7fc70967c640 1 -- start start 2023-11-05T08:29:33.032 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.013+0000 7fc70967c640 1 librados: setting wanted keys 2023-11-05T08:29:33.032 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.013+0000 7fc70967c640 1 librados: calling monclient init 2023-11-05T08:29:33.032 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.013+0000 7fc70967c640 10 monclient: init 2023-11-05T08:29:33.032 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.014+0000 7fc70967c640 10 monclient: _reopen_session rank -1 2023-11-05T08:29:33.033 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.014+0000 7fc70967c640 10 monclient: _add_conns ranks=[1,0,2] 2023-11-05T08:29:33.033 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.014+0000 7fc70967c640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc7040a8770 0x7fc7040b6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:33.033 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.014+0000 7fc70967c640 10 monclient(hunting): picked mon.noname-b con 0x7fc7040a8770 addr [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] 2023-11-05T08:29:33.033 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.014+0000 7fc70967c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc7040b42c0 0x7fc7040b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:33.033 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.014+0000 7fc70967c640 10 monclient(hunting): picked mon.noname-a con 0x7fc7040b42c0 addr [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] 2023-11-05T08:29:33.033 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.014+0000 7fc70967c640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc70413f130 0x7fc7040ac280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:33.034 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.014+0000 7fc70967c640 10 monclient(hunting): picked mon.noname-c con 0x7fc70413f130 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:29:33.034 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.014+0000 7fc70967c640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:33.034 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.014+0000 7fc70967c640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc70413fce0 con 0x7fc7040b42c0 2023-11-05T08:29:33.034 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.014+0000 7fc70967c640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:33.034 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.014+0000 7fc70967c640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7040b5df0 con 0x7fc7040a8770 2023-11-05T08:29:33.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.014+0000 7fc70967c640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:33.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.014+0000 7fc70967c640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7040b51d0 con 0x7fc70413f130 2023-11-05T08:29:33.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.014+0000 7fc70967c640 10 monclient(hunting): _renew_subs 2023-11-05T08:29:33.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.014+0000 7fc70967c640 10 monclient(hunting): authenticate will time out at 2719.220474s 2023-11-05T08:29:33.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.015+0000 7fc7037fe640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc70413f130 0x7fc7040ac280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:33.036 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.015+0000 7fc7027fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc7040b42c0 0x7fc7040b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:33.036 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.015+0000 7fc702ffd640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc7040a8770 0x7fc7040b6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:33.036 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.015+0000 7fc7027fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc7040b42c0 0x7fc7040b70d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60138/0 (socket says 172.21.15.52:60138) 2023-11-05T08:29:33.036 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.015+0000 7fc7037fe640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc70413f130 0x7fc7040ac280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.52:59884/0 (socket says 172.21.15.52:59884) 2023-11-05T08:29:33.037 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.015+0000 7fc7027fc640 1 -- 172.21.15.52:0/3594550776 learned_addr learned my addr 172.21.15.52:0/3594550776 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-11-05T08:29:33.037 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.015+0000 7fc7027fc640 10 monclient(hunting): get_auth_request con 0x7fc7040b42c0 auth_method 0 2023-11-05T08:29:33.037 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.015+0000 7fc7027fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:29:33.037 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.015+0000 7fc7027fc640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:29:33.037 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.015+0000 7fc7027fc640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:29:33.037 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.015+0000 7fc7037fe640 10 monclient(hunting): get_auth_request con 0x7fc70413f130 auth_method 0 2023-11-05T08:29:33.038 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.015+0000 7fc7037fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:29:33.038 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.015+0000 7fc7037fe640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:29:33.038 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.015+0000 7fc7037fe640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:29:33.038 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.015+0000 7fc702ffd640 10 monclient(hunting): get_auth_request con 0x7fc7040a8770 auth_method 0 2023-11-05T08:29:33.039 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.015+0000 7fc702ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:29:33.039 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.015+0000 7fc702ffd640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:29:33.039 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.015+0000 7fc702ffd640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:29:33.039 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.016+0000 7fc702ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:29:33.039 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.016+0000 7fc702ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:29:33.039 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.016+0000 7fc702ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:29:33.040 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.016+0000 7fc7037fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:29:33.040 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.016+0000 7fc7037fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:29:33.040 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.016+0000 7fc7037fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:29:33.040 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.016+0000 7fc7027fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:29:33.040 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.016+0000 7fc7027fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:29:33.041 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.016+0000 7fc7027fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:29:33.041 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.018+0000 7fc702ffd640 10 monclient(hunting): handle_auth_done global_id 20764 payload 824 2023-11-05T08:29:33.041 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.018+0000 7fc702ffd640 1 -- 172.21.15.52:0/3594550776 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc70413f130 msgr2=0x7fc7040ac280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:33.041 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.018+0000 7fc702ffd640 1 --2- 172.21.15.52:0/3594550776 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc70413f130 0x7fc7040ac280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:33.041 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.018+0000 7fc702ffd640 1 -- 172.21.15.52:0/3594550776 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc7040b42c0 msgr2=0x7fc7040b70d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:33.042 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.018+0000 7fc702ffd640 1 --2- 172.21.15.52:0/3594550776 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc7040b42c0 0x7fc7040b70d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:33.042 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.018+0000 7fc702ffd640 10 monclient: _finish_hunting 0 2023-11-05T08:29:33.042 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.018+0000 7fc702ffd640 1 monclient: found mon.noname-b 2023-11-05T08:29:33.042 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.018+0000 7fc702ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:29:33.042 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.018+0000 7fc702ffd640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.156:3300/0 2023-11-05T08:29:33.043 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.018+0000 7fc702ffd640 1 -- 172.21.15.52:0/3594550776 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6fc009b30 con 0x7fc7040a8770 2023-11-05T08:29:33.044 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.020+0000 7fc702ffd640 1 --2- 172.21.15.52:0/3594550776 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc7040a8770 0x7fc7040b6b90 secure :-1 s=READY pgs=5021 cs=0 l=1 rev1=1 crypto rx=0x7fc6fc032000 tx=0x7fc6fc004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:29:33.044 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.020+0000 7fc6fb7fe640 10 client.?.objecter ms_handle_connect 0x7fc7040a8770 2023-11-05T08:29:33.045 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.020+0000 7fc6fb7fe640 10 client.?.objecter resend_mon_ops 2023-11-05T08:29:33.045 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.024+0000 7fc6fb7fe640 1 -- 172.21.15.52:0/3594550776 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6fc03e450 con 0x7fc7040a8770 2023-11-05T08:29:33.045 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.024+0000 7fc6fb7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:29:33.045 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.024+0000 7fc6fb7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-05T08:29:33.045 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.024+0000 7fc6fb7fe640 10 monclient: dump: 2023-11-05T08:29:33.046 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:29:33.046 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:33.046 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:33.046 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:33.046 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:29:33.047 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:33.047 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:29:33.047 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:29:33.047 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:29:33.047 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:33.048 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.024+0000 7fc6fb7fe640 10 monclient: _finish_auth 0 2023-11-05T08:29:33.048 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.024+0000 7fc6fb7fe640 10 monclient: _check_auth_tickets 2023-11-05T08:29:33.048 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.024+0000 7fc6fb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:29:33.048 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.024+0000 7fc6fb7fe640 1 -- 172.21.15.52:0/3594550776 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6fc03e5d0 con 0x7fc7040a8770 2023-11-05T08:29:33.048 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.024+0000 7fc70967c640 5 monclient: authenticate success, global_id 20764 2023-11-05T08:29:33.048 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.024+0000 7fc70967c640 10 monclient: _renew_subs 2023-11-05T08:29:33.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.024+0000 7fc70967c640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:29:33.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.024+0000 7fc70967c640 1 -- 172.21.15.52:0/3594550776 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7040ac7c0 con 0x7fc7040a8770 2023-11-05T08:29:33.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.024+0000 7fc6fb7fe640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:29:33.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.024+0000 7fc6fb7fe640 1 -- 172.21.15.52:0/3594550776 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6fc03e980 con 0x7fc7040a8770 2023-11-05T08:29:33.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.024+0000 7fc6fb7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:29:33.050 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.024+0000 7fc6fb7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-05T08:29:33.050 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.024+0000 7fc6fb7fe640 10 monclient: dump: 2023-11-05T08:29:33.050 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:29:33.050 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:33.050 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:33.051 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:33.051 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:29:33.051 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:33.051 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:29:33.051 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:29:33.052 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:29:33.052 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:33.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.024+0000 7fc7017fa640 4 set_mon_vals no callback set 2023-11-05T08:29:33.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.024+0000 7fc70967c640 10 client.20764.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-05T08:29:33.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.024+0000 7fc70967c640 10 monclient: _renew_subs 2023-11-05T08:29:33.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.024+0000 7fc70967c640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:29:33.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.024+0000 7fc70967c640 1 -- 172.21.15.52:0/3594550776 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7040acca0 con 0x7fc7040a8770 2023-11-05T08:29:33.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.024+0000 7fc70967c640 1 librados: init done 2023-11-05T08:29:33.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.025+0000 7fc70967c640 10 client.20764.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:29:33.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.025+0000 7fc70967c640 15 client.20764.objecter _session_command_op_assign -1 1 2023-11-05T08:29:33.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.025+0000 7fc70967c640 20 client.20764.objecter _get_session osd=-1 returning homeless 2023-11-05T08:29:33.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.025+0000 7fc70967c640 10 client.20764.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-05T08:29:33.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.025+0000 7fc70967c640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:29:33.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.025+0000 7fc70967c640 1 -- 172.21.15.52:0/3594550776 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc70413fe50 con 0x7fc7040a8770 2023-11-05T08:29:33.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.044+0000 7fc6fb7fe640 1 -- 172.21.15.52:0/3594550776 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc6fc03eae0 con 0x7fc7040a8770 2023-11-05T08:29:33.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.045+0000 7fc6fb7fe640 1 --2- 172.21.15.52:0/3594550776 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7fc6e406c850 0x7fc6e406ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:33.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.045+0000 7fc7027fc640 1 --2- 172.21.15.52:0/3594550776 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7fc6e406c850 0x7fc6e406ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:33.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.045+0000 7fc7027fc640 10 monclient: get_auth_request con 0x7fc6e406c850 auth_method 0 2023-11-05T08:29:33.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.045+0000 7fc7027fc640 1 --2- 172.21.15.52:0/3594550776 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7fc6e406c850 0x7fc6e406ed10 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fc7040b5900 tx=0x7fc6ec009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:29:33.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.045+0000 7fc6fb7fe640 10 client.20764.objecter ms_handle_connect 0x7fc6e406c850 2023-11-05T08:29:33.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.047+0000 7fc6fb7fe640 1 -- 172.21.15.52:0/3594550776 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(932..932 src has 619..932) v4 ==== 6193+0+0 (secure 0 0 0) 0x7fc6fc07b5a0 con 0x7fc7040a8770 2023-11-05T08:29:33.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.047+0000 7fc6fb7fe640 10 client.20764.objecter ms_dispatch 0x7fc704000b90 osd_map(932..932 src has 619..932) v4 2023-11-05T08:29:33.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.047+0000 7fc6fb7fe640 3 client.20764.objecter handle_osd_map got epochs [932,932] > 0 2023-11-05T08:29:33.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.047+0000 7fc6fb7fe640 3 client.20764.objecter handle_osd_map decoding full epoch 932 2023-11-05T08:29:33.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.047+0000 7fc6fb7fe640 10 client.20764.objecter checking command 1 2023-11-05T08:29:33.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.047+0000 7fc6fb7fe640 1 --2- 172.21.15.52:0/3594550776 >> [v2:172.21.15.156:6802/617205919,v1:172.21.15.156:6803/617205919] conn(0x7fc6e40740a0 0x7fc6e4076540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:33.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.047+0000 7fc6fb7fe640 20 client.20764.objecter _get_session s=0x7fc6e40739d0 osd=7 3 2023-11-05T08:29:33.059 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.047+0000 7fc6fb7fe640 20 client.20764.objecter put_session s=0x7fc6e40739d0 osd=7 3 2023-11-05T08:29:33.059 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.047+0000 7fc6fb7fe640 15 client.20764.objecter _session_command_op_remove -1 1 2023-11-05T08:29:33.059 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.047+0000 7fc6fb7fe640 20 client.20764.objecter _get_session s=0x7fc6e40739d0 osd=7 3 2023-11-05T08:29:33.059 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.047+0000 7fc6fb7fe640 20 client.20764.objecter get_session s=0x7fc6e40739d0 osd=7 3 2023-11-05T08:29:33.059 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.047+0000 7fc6fb7fe640 15 client.20764.objecter _session_command_op_assign 7 1 2023-11-05T08:29:33.060 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.047+0000 7fc6fb7fe640 20 client.20764.objecter put_session s=0x7fc6e40739d0 osd=7 4 2023-11-05T08:29:33.060 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.047+0000 7fc6fb7fe640 10 client.20764.objecter _send_command 1 2023-11-05T08:29:33.060 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.047+0000 7fc6fb7fe640 1 -- 172.21.15.52:0/3594550776 --> [v2:172.21.15.156:6802/617205919,v1:172.21.15.156:6803/617205919] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc6e4076c10 con 0x7fc6e40740a0 2023-11-05T08:29:33.060 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.047+0000 7fc6fb7fe640 20 client.20764.objecter dump_active .. 0 homeless 2023-11-05T08:29:33.060 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.047+0000 7fc6fb7fe640 1 -- 172.21.15.52:0/3594550776 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_get_version_reply(handle=1 version=932) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc6fc0778e0 con 0x7fc7040a8770 2023-11-05T08:29:33.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.047+0000 7fc6fb7fe640 10 monclient: handle_get_version_reply finishing 1 version 932 2023-11-05T08:29:33.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.048+0000 7fc7037fe640 1 --2- 172.21.15.52:0/3594550776 >> [v2:172.21.15.156:6802/617205919,v1:172.21.15.156:6803/617205919] conn(0x7fc6e40740a0 0x7fc6e4076540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:33.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.048+0000 7fc7037fe640 10 monclient: get_auth_request con 0x7fc6e40740a0 auth_method 0 2023-11-05T08:29:33.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.051+0000 7fc7037fe640 1 --2- 172.21.15.52:0/3594550776 >> [v2:172.21.15.156:6802/617205919,v1:172.21.15.156:6803/617205919] conn(0x7fc6e40740a0 0x7fc6e4076540 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:29:33.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.051+0000 7fc6fb7fe640 10 client.20764.objecter ms_handle_connect 0x7fc6e40740a0 2023-11-05T08:29:33.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.074+0000 7fc6fb7fe640 1 -- 172.21.15.52:0/3594550776 <== osd.7 v2:172.21.15.156:6802/617205919 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fc6e4076c10 con 0x7fc6e40740a0 2023-11-05T08:29:33.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.074+0000 7fc6fb7fe640 10 client.20764.objecter ms_dispatch 0x7fc704000b90 command_reply(tid 1: 0 ) v1 2023-11-05T08:29:33.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.074+0000 7fc6fb7fe640 10 client.20764.objecter _finish_command 1 = system:0 2023-11-05T08:29:33.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.074+0000 7fc6fb7fe640 20 client.20764.objecter put_session s=0x7fc6e40739d0 osd=7 4 2023-11-05T08:29:33.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.074+0000 7fc6fb7fe640 15 client.20764.objecter _session_command_op_remove 7 1 2023-11-05T08:29:33.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.086+0000 7fc70967c640 10 client.20764.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2023-11-05T08:29:33.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.086+0000 7fc70967c640 15 client.20764.objecter _session_command_op_assign -1 2 2023-11-05T08:29:33.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.086+0000 7fc70967c640 20 client.20764.objecter _get_session s=0x7fc6e40739d0 osd=7 3 2023-11-05T08:29:33.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.086+0000 7fc70967c640 20 client.20764.objecter put_session s=0x7fc6e40739d0 osd=7 3 2023-11-05T08:29:33.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.086+0000 7fc70967c640 20 client.20764.objecter _get_session s=0x7fc6e40739d0 osd=7 3 2023-11-05T08:29:33.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.086+0000 7fc70967c640 15 client.20764.objecter _session_command_op_remove -1 2 2023-11-05T08:29:33.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.086+0000 7fc70967c640 20 client.20764.objecter get_session s=0x7fc6e40739d0 osd=7 3 2023-11-05T08:29:33.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.086+0000 7fc70967c640 15 client.20764.objecter _session_command_op_assign 7 2 2023-11-05T08:29:33.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.086+0000 7fc70967c640 20 client.20764.objecter put_session s=0x7fc6e40739d0 osd=7 4 2023-11-05T08:29:33.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.086+0000 7fc70967c640 10 client.20764.objecter _send_command 2 2023-11-05T08:29:33.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.086+0000 7fc70967c640 1 -- 172.21.15.52:0/3594550776 --> [v2:172.21.15.156:6802/617205919,v1:172.21.15.156:6803/617205919] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fc7040b6220 con 0x7fc6e40740a0 2023-11-05T08:29:33.102 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.101+0000 7fc6fb7fe640 1 -- 172.21.15.52:0/3594550776 <== osd.7 v2:172.21.15.156:6802/617205919 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fc7040b6220 con 0x7fc6e40740a0 2023-11-05T08:29:33.102 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.101+0000 7fc6fb7fe640 10 client.20764.objecter ms_dispatch 0x7fc704000b90 command_reply(tid 2: 0 ) v1 2023-11-05T08:29:33.102 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.101+0000 7fc6fb7fe640 10 client.20764.objecter _finish_command 2 = system:0 2023-11-05T08:29:33.102 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.101+0000 7fc6fb7fe640 20 client.20764.objecter put_session s=0x7fc6e40739d0 osd=7 4 2023-11-05T08:29:33.103 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.101+0000 7fc6fb7fe640 15 client.20764.objecter _session_command_op_remove 7 2 2023-11-05T08:29:33.103 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2023-11-05T08:29:33.103 INFO:teuthology.orchestra.run.smithi052.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-05T08:29:33.103 INFO:teuthology.orchestra.run.smithi052.stdout:} 2023-11-05T08:29:33.105 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.101+0000 7fc70967c640 10 librados: watch_flush enter 2023-11-05T08:29:33.105 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.101+0000 7fc70967c640 10 librados: watch_flush exit 2023-11-05T08:29:33.105 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.101+0000 7fc70967c640 10 client.20764.objecter close_session for osd.7 2023-11-05T08:29:33.105 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.101+0000 7fc70967c640 1 -- 172.21.15.52:0/3594550776 >> [v2:172.21.15.156:6802/617205919,v1:172.21.15.156:6803/617205919] conn(0x7fc6e40740a0 msgr2=0x7fc6e4076540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:33.105 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.101+0000 7fc70967c640 1 --2- 172.21.15.52:0/3594550776 >> [v2:172.21.15.156:6802/617205919,v1:172.21.15.156:6803/617205919] conn(0x7fc6e40740a0 0x7fc6e4076540 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:33.106 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.101+0000 7fc70967c640 20 client.20764.objecter put_session s=0x7fc6e40739d0 osd=7 1 2023-11-05T08:29:33.106 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.101+0000 7fc70967c640 20 client.20764.objecter shutdown clearing up homeless session... 2023-11-05T08:29:33.106 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.101+0000 7fc70967c640 10 client.20764.objecter successfully canceled tick 2023-11-05T08:29:33.106 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.101+0000 7fc70967c640 1 -- 172.21.15.52:0/3594550776 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7fc6e406c850 msgr2=0x7fc6e406ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:33.106 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.101+0000 7fc70967c640 1 --2- 172.21.15.52:0/3594550776 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7fc6e406c850 0x7fc6e406ed10 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fc7040b5900 tx=0x7fc6ec009190 comp rx=0 tx=0).stop 2023-11-05T08:29:33.107 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.101+0000 7fc70967c640 10 monclient: shutdown 2023-11-05T08:29:33.107 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.101+0000 7fc70967c640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:29:33.107 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.101+0000 7fc70967c640 1 -- 172.21.15.52:0/3594550776 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc7040a8770 msgr2=0x7fc7040b6b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:33.107 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.101+0000 7fc70967c640 1 --2- 172.21.15.52:0/3594550776 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc7040a8770 0x7fc7040b6b90 secure :-1 s=READY pgs=5021 cs=0 l=1 rev1=1 crypto rx=0x7fc6fc032000 tx=0x7fc6fc004a40 comp rx=0 tx=0).stop 2023-11-05T08:29:33.107 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.101+0000 7fc7037fe640 1 -- 172.21.15.52:0/3594550776 reap_dead start 2023-11-05T08:29:33.108 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.101+0000 7fc70967c640 1 -- 172.21.15.52:0/3594550776 shutdown_connections 2023-11-05T08:29:33.108 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.101+0000 7fc70967c640 1 -- 172.21.15.52:0/3594550776 >> 172.21.15.52:0/3594550776 conn(0x7fc704065ee0 msgr2=0x7fc7040b1970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:29:33.108 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.101+0000 7fc70967c640 1 -- 172.21.15.52:0/3594550776 shutdown_connections 2023-11-05T08:29:33.108 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.101+0000 7fc70967c640 1 -- 172.21.15.52:0/3594550776 wait complete. 2023-11-05T08:29:33.108 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.101+0000 7fc70967c640 1 librados: shutdown 2023-11-05T08:29:33.113 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-11-05T08:29:33.219 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.218+0000 7f8f35c32640 10 monclient: get_monmap_and_config 2023-11-05T08:29:33.219 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.218+0000 7f8f35c32640 10 monclient: build_initial_monmap 2023-11-05T08:29:33.219 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.218+0000 7f8f35c32640 10 monclient: monmap: 2023-11-05T08:29:33.220 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:29:33.220 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:33.220 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:29:33.219615+0000 2023-11-05T08:29:33.220 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:29:33.219615+0000 2023-11-05T08:29:33.220 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:29:33.221 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:33.221 INFO:teuthology.orchestra.run.smithi052.stderr:0: v1:172.21.15.52:6789/0 mon.noname-a-legacy 2023-11-05T08:29:33.221 INFO:teuthology.orchestra.run.smithi052.stderr:1: v1:172.21.15.156:6789/0 mon.noname-c-legacy 2023-11-05T08:29:33.221 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-b 2023-11-05T08:29:33.221 INFO:teuthology.orchestra.run.smithi052.stderr:3: v2:172.21.15.52:3300/0 mon.noname-a 2023-11-05T08:29:33.222 INFO:teuthology.orchestra.run.smithi052.stderr:4: v2:172.21.15.156:3300/0 mon.noname-c 2023-11-05T08:29:33.222 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:33.224 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.218+0000 7f8f35c32640 1 Processor -- start 2023-11-05T08:29:33.224 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.218+0000 7f8f35c32640 1 -- start start 2023-11-05T08:29:33.224 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.218+0000 7f8f35c32640 10 monclient: init 2023-11-05T08:29:33.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.219+0000 7f8f35c32640 10 monclient: _reopen_session rank -1 2023-11-05T08:29:33.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.219+0000 7f8f35c32640 10 monclient: _add_conns ranks=[2,0,4,1,3] 2023-11-05T08:29:33.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.219+0000 7f8f35c32640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8f300b4240 0x7f8f300b1150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:33.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.219+0000 7f8f35c32640 10 monclient(hunting): picked mon.noname-b con 0x7f8f300b4240 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:29:33.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.219+0000 7f8f35c32640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f8f300b38d0 addr v1:172.21.15.52:6789/0 2023-11-05T08:29:33.226 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.219+0000 7f8f35c32640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f8f300ade00 0x7f8f3013b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:33.226 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.219+0000 7f8f35c32640 10 monclient(hunting): picked mon.noname-c con 0x7f8f300ade00 addr v2:172.21.15.156:3300/0 2023-11-05T08:29:33.226 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.219+0000 7f8f35c32640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f300b0cc0 con 0x7f8f300b38d0 2023-11-05T08:29:33.226 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.219+0000 7f8f35c32640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:33.226 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.219+0000 7f8f35c32640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f300b4620 con 0x7f8f300ade00 2023-11-05T08:29:33.227 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.219+0000 7f8f35c32640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:33.227 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.219+0000 7f8f35c32640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f300b1690 con 0x7f8f300b4240 2023-11-05T08:29:33.227 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.219+0000 7f8f35c32640 10 monclient(hunting): _renew_subs 2023-11-05T08:29:33.227 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.219+0000 7f8f35c32640 10 monclient(hunting): authenticate will time out at 2719.425390s 2023-11-05T08:29:33.227 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.220+0000 7f8f2effd640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f8f300b38d0 0x7f8f300ae640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:46106/0 (socket says 172.21.15.52:46106) 2023-11-05T08:29:33.228 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.220+0000 7f8f2effd640 1 -- 172.21.15.52:0/3098598037 learned_addr learned my addr 172.21.15.52:0/3098598037 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-11-05T08:29:33.228 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.220+0000 7f8f2f7fe640 1 --2- 172.21.15.52:0/3098598037 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8f300b4240 0x7f8f300b1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:33.228 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.220+0000 7f8f2ffff640 1 --2- 172.21.15.52:0/3098598037 >> v2:172.21.15.156:3300/0 conn(0x7f8f300ade00 0x7f8f3013b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:33.228 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.220+0000 7f8f2f7fe640 10 monclient(hunting): get_auth_request con 0x7f8f300b4240 auth_method 0 2023-11-05T08:29:33.228 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.220+0000 7f8f2f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:29:33.229 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.220+0000 7f8f2f7fe640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:29:33.229 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.220+0000 7f8f2f7fe640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:29:33.229 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.220+0000 7f8f2ffff640 10 monclient(hunting): get_auth_request con 0x7f8f300ade00 auth_method 0 2023-11-05T08:29:33.229 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.220+0000 7f8f2ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:29:33.229 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.220+0000 7f8f2ffff640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:29:33.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.220+0000 7f8f2ffff640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:29:33.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.221+0000 7f8f2ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:29:33.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.221+0000 7f8f2ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:29:33.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.221+0000 7f8f2ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:29:33.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.221+0000 7f8f2f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:29:33.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.221+0000 7f8f2f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:29:33.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.221+0000 7f8f2f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:29:33.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.222+0000 7f8f2e7fc640 1 -- 172.21.15.52:0/3098598037 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 514728636 0 0) 0x7f8f300b0cc0 con 0x7f8f300b38d0 2023-11-05T08:29:33.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.222+0000 7f8f2e7fc640 10 monclient(hunting): _negotiate 2023-11-05T08:29:33.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.222+0000 7f8f2e7fc640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:29:33.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.222+0000 7f8f2e7fc640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:29:33.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.222+0000 7f8f2e7fc640 10 monclient(hunting): my global_id is 15759 2023-11-05T08:29:33.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.222+0000 7f8f2e7fc640 1 -- 172.21.15.52:0/3098598037 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f18003520 con 0x7f8f300b38d0 2023-11-05T08:29:33.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.222+0000 7f8f2ffff640 10 monclient(hunting): handle_auth_done global_id 20767 payload 274 2023-11-05T08:29:33.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.222+0000 7f8f2ffff640 1 -- 172.21.15.52:0/3098598037 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8f300b4240 msgr2=0x7f8f300b1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-05T08:29:33.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.222+0000 7f8f2ffff640 1 --2- 172.21.15.52:0/3098598037 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8f300b4240 0x7f8f300b1150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:33.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.222+0000 7f8f2ffff640 1 -- 172.21.15.52:0/3098598037 >> v1:172.21.15.52:6789/0 conn(0x7f8f300b38d0 legacy=0x7f8f300ae640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:33.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.222+0000 7f8f2ffff640 10 monclient: _finish_hunting 0 2023-11-05T08:29:33.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.222+0000 7f8f2ffff640 1 monclient: found mon.noname-c 2023-11-05T08:29:33.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.222+0000 7f8f2ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:29:33.234 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.222+0000 7f8f2ffff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.156:3300/0 2023-11-05T08:29:33.234 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.222+0000 7f8f2ffff640 1 -- 172.21.15.52:0/3098598037 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f3013f5f0 con 0x7f8f300ade00 2023-11-05T08:29:33.234 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.222+0000 7f8f2f7fe640 1 --2- 172.21.15.52:0/3098598037 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8f300b4240 0x7f8f300b1150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-05T08:29:33.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.225+0000 7f8f2ffff640 1 --2- 172.21.15.52:0/3098598037 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f300ade00 0x7f8f3013b420 secure :-1 s=READY pgs=5022 cs=0 l=1 rev1=1 crypto rx=0x7f8f28009d90 tx=0x7f8f2802be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb58f85e2ed2f42e server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:29:33.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.228+0000 7f8f2e7fc640 1 -- 172.21.15.52:0/3098598037 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f2802cbc0 con 0x7f8f300ade00 2023-11-05T08:29:33.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.228+0000 7f8f2e7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:29:33.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.228+0000 7f8f2e7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-11-05T08:29:33.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.228+0000 7f8f2e7fc640 10 monclient: dump: 2023-11-05T08:29:33.239 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:29:33.239 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:33.239 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:33.239 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:33.240 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:29:33.240 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:33.240 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:29:33.240 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:29:33.240 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:29:33.241 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:33.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.228+0000 7f8f2e7fc640 10 monclient: _finish_auth 0 2023-11-05T08:29:33.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.228+0000 7f8f2e7fc640 10 monclient: _check_auth_tickets 2023-11-05T08:29:33.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.228+0000 7f8f2e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:29:33.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.228+0000 7f8f2e7fc640 1 -- 172.21.15.52:0/3098598037 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f2802cd20 con 0x7f8f300ade00 2023-11-05T08:29:33.242 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.228+0000 7f8f35c32640 5 monclient: authenticate success, global_id 20767 2023-11-05T08:29:33.242 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.228+0000 7f8f35c32640 20 monclient: get_monmap_and_config waiting for monmap|config 2023-11-05T08:29:33.242 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.228+0000 7f8f2e7fc640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:29:33.242 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.228+0000 7f8f35c32640 10 monclient: get_monmap_and_config success 2023-11-05T08:29:33.242 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.228+0000 7f8f35c32640 4 set_mon_vals no callback set 2023-11-05T08:29:33.243 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.228+0000 7f8f2e7fc640 1 -- 172.21.15.52:0/3098598037 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f28034660 con 0x7f8f300ade00 2023-11-05T08:29:33.243 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.229+0000 7f8f2e7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:29:33.243 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.229+0000 7f8f2e7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-05T08:29:33.243 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.229+0000 7f8f2e7fc640 10 monclient: dump: 2023-11-05T08:29:33.243 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:29:33.244 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:33.244 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:33.244 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:33.244 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:29:33.244 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:33.245 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:29:33.245 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:29:33.245 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:29:33.245 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:33.245 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.229+0000 7f8f35c32640 10 monclient: shutdown 2023-11-05T08:29:33.246 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.229+0000 7f8f35c32640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:29:33.246 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.229+0000 7f8f35c32640 1 -- 172.21.15.52:0/3098598037 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f300ade00 msgr2=0x7f8f3013b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:33.246 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.229+0000 7f8f35c32640 1 --2- 172.21.15.52:0/3098598037 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f300ade00 0x7f8f3013b420 secure :-1 s=READY pgs=5022 cs=0 l=1 rev1=1 crypto rx=0x7f8f28009d90 tx=0x7f8f2802be10 comp rx=0 tx=0).stop 2023-11-05T08:29:33.246 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.229+0000 7f8f35c32640 1 -- 172.21.15.52:0/3098598037 shutdown_connections 2023-11-05T08:29:33.246 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.229+0000 7f8f35c32640 1 --2- 172.21.15.52:0/3098598037 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f300ade00 0x7f8f3013b420 unknown :-1 s=CLOSED pgs=5022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:33.247 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.229+0000 7f8f35c32640 1 --2- 172.21.15.52:0/3098598037 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8f300b4240 0x7f8f300b1150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:33.247 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.229+0000 7f8f35c32640 1 -- 172.21.15.52:0/3098598037 >> 172.21.15.52:0/3098598037 conn(0x7f8f30065cd0 msgr2=0x7f8f300660e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:29:33.247 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.229+0000 7f8f35c32640 1 -- 172.21.15.52:0/3098598037 shutdown_connections 2023-11-05T08:29:33.247 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.229+0000 7f8f35c32640 1 -- 172.21.15.52:0/3098598037 wait complete. 2023-11-05T08:29:33.247 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.230+0000 7f8f35c32640 10 monclient: build_initial_monmap 2023-11-05T08:29:33.248 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.230+0000 7f8f35c32640 10 monclient: monmap: 2023-11-05T08:29:33.248 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:29:33.248 INFO:teuthology.orchestra.run.smithi052.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-05T08:29:33.248 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 0.000000 2023-11-05T08:29:33.248 INFO:teuthology.orchestra.run.smithi052.stderr:created 0.000000 2023-11-05T08:29:33.248 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:29:33.249 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:33.249 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.noname-a 2023-11-05T08:29:33.249 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.noname-b 2023-11-05T08:29:33.249 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-c 2023-11-05T08:29:33.249 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:33.250 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.230+0000 7f8f35c32640 1 librados: starting msgr at 2023-11-05T08:29:33.250 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.230+0000 7f8f35c32640 1 librados: starting objecter 2023-11-05T08:29:33.250 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.230+0000 7f8f35c32640 1 Processor -- start 2023-11-05T08:29:33.250 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.231+0000 7f8f35c32640 1 -- start start 2023-11-05T08:29:33.250 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.231+0000 7f8f35c32640 1 librados: setting wanted keys 2023-11-05T08:29:33.251 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.231+0000 7f8f35c32640 1 librados: calling monclient init 2023-11-05T08:29:33.251 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.231+0000 7f8f35c32640 10 monclient: init 2023-11-05T08:29:33.251 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.231+0000 7f8f35c32640 10 monclient: _reopen_session rank -1 2023-11-05T08:29:33.251 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.231+0000 7f8f35c32640 10 monclient: _add_conns ranks=[0,2,1] 2023-11-05T08:29:33.251 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.231+0000 7f8f35c32640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f300ade00 0x7f8f30145000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:33.251 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.231+0000 7f8f35c32640 10 monclient(hunting): picked mon.noname-a con 0x7f8f300ade00 addr [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] 2023-11-05T08:29:33.252 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.231+0000 7f8f35c32640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8f300b4240 0x7f8f301d69c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:33.252 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.231+0000 7f8f35c32640 10 monclient(hunting): picked mon.noname-c con 0x7f8f300b4240 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:29:33.252 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.231+0000 7f8f35c32640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f301d6f00 0x7f8f301d9c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:33.252 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.231+0000 7f8f35c32640 10 monclient(hunting): picked mon.noname-b con 0x7f8f301d6f00 addr [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] 2023-11-05T08:29:33.252 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.231+0000 7f8f35c32640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:33.253 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.231+0000 7f8f35c32640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f30145ea0 con 0x7f8f300ade00 2023-11-05T08:29:33.253 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.231+0000 7f8f35c32640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:33.253 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.231+0000 7f8f35c32640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f301443e0 con 0x7f8f301d6f00 2023-11-05T08:29:33.253 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.231+0000 7f8f35c32640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:33.253 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.231+0000 7f8f35c32640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f30142b70 con 0x7f8f300b4240 2023-11-05T08:29:33.254 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.231+0000 7f8f35c32640 10 monclient(hunting): _renew_subs 2023-11-05T08:29:33.254 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.231+0000 7f8f35c32640 10 monclient(hunting): authenticate will time out at 2719.437722s 2023-11-05T08:29:33.254 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.232+0000 7f8f2f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f300ade00 0x7f8f30145000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:33.254 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.232+0000 7f8f2ffff640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f301d6f00 0x7f8f301d9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:33.254 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.232+0000 7f8f2effd640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8f300b4240 0x7f8f301d69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:33.255 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.232+0000 7f8f2f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f300ade00 0x7f8f30145000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60142/0 (socket says 172.21.15.52:60142) 2023-11-05T08:29:33.255 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.232+0000 7f8f2f7fe640 1 -- 172.21.15.52:0/1216872807 learned_addr learned my addr 172.21.15.52:0/1216872807 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-11-05T08:29:33.255 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.232+0000 7f8f2f7fe640 10 monclient(hunting): get_auth_request con 0x7f8f300ade00 auth_method 0 2023-11-05T08:29:33.255 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.232+0000 7f8f2f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:29:33.255 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.232+0000 7f8f2f7fe640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:29:33.256 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.232+0000 7f8f2f7fe640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:29:33.256 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.232+0000 7f8f2ffff640 10 monclient(hunting): get_auth_request con 0x7f8f301d6f00 auth_method 0 2023-11-05T08:29:33.256 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.232+0000 7f8f2ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:29:33.256 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.232+0000 7f8f2ffff640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:29:33.256 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.232+0000 7f8f2ffff640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:29:33.257 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.232+0000 7f8f2effd640 10 monclient(hunting): get_auth_request con 0x7f8f300b4240 auth_method 0 2023-11-05T08:29:33.257 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.232+0000 7f8f2effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:29:33.257 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.232+0000 7f8f2effd640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:29:33.257 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.232+0000 7f8f2effd640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:29:33.258 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.233+0000 7f8f2f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:29:33.258 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.233+0000 7f8f2f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:29:33.258 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.233+0000 7f8f2f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:29:33.258 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.233+0000 7f8f2effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:29:33.258 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.233+0000 7f8f2effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:29:33.259 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.233+0000 7f8f2effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:29:33.259 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.233+0000 7f8f2ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:29:33.259 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.233+0000 7f8f2ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:29:33.259 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.233+0000 7f8f2ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:29:33.259 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.236+0000 7f8f2effd640 10 monclient(hunting): handle_auth_done global_id 17027 payload 824 2023-11-05T08:29:33.259 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.236+0000 7f8f2effd640 1 -- 172.21.15.52:0/1216872807 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f301d6f00 msgr2=0x7f8f301d9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:33.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.236+0000 7f8f2effd640 1 --2- 172.21.15.52:0/1216872807 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f301d6f00 0x7f8f301d9c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:33.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.236+0000 7f8f2effd640 1 -- 172.21.15.52:0/1216872807 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f300ade00 msgr2=0x7f8f30145000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:33.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.236+0000 7f8f2effd640 1 --2- 172.21.15.52:0/1216872807 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f300ade00 0x7f8f30145000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:33.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.236+0000 7f8f2effd640 10 monclient: _finish_hunting 0 2023-11-05T08:29:33.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.236+0000 7f8f2effd640 1 monclient: found mon.noname-c 2023-11-05T08:29:33.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.236+0000 7f8f2effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:29:33.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.236+0000 7f8f2effd640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.52:3301/0 2023-11-05T08:29:33.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.236+0000 7f8f2effd640 1 -- 172.21.15.52:0/1216872807 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f20009400 con 0x7f8f300b4240 2023-11-05T08:29:33.263 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.238+0000 7f8f2effd640 1 --2- 172.21.15.52:0/1216872807 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8f300b4240 0x7f8f301d69c0 secure :-1 s=READY pgs=3089 cs=0 l=1 rev1=1 crypto rx=0x7f8f2400c400 tx=0x7f8f2400c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:29:33.263 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.238+0000 7f8f17fff640 10 client.?.objecter ms_handle_connect 0x7f8f300b4240 2023-11-05T08:29:33.263 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.238+0000 7f8f17fff640 10 client.?.objecter resend_mon_ops 2023-11-05T08:29:33.264 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.243+0000 7f8f17fff640 1 -- 172.21.15.52:0/1216872807 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f24005ce0 con 0x7f8f300b4240 2023-11-05T08:29:33.264 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.243+0000 7f8f17fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:29:33.264 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.243+0000 7f8f17fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-11-05T08:29:33.264 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.243+0000 7f8f17fff640 10 monclient: dump: 2023-11-05T08:29:33.264 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:29:33.265 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:33.265 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:33.265 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:33.265 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:29:33.265 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:33.266 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:29:33.266 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:29:33.266 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:29:33.266 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:33.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.243+0000 7f8f17fff640 10 monclient: _finish_auth 0 2023-11-05T08:29:33.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.243+0000 7f8f17fff640 10 monclient: _check_auth_tickets 2023-11-05T08:29:33.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.243+0000 7f8f17fff640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:29:33.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.243+0000 7f8f17fff640 1 -- 172.21.15.52:0/1216872807 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f24005e40 con 0x7f8f300b4240 2023-11-05T08:29:33.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.243+0000 7f8f35c32640 5 monclient: authenticate success, global_id 17027 2023-11-05T08:29:33.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.243+0000 7f8f35c32640 10 monclient: _renew_subs 2023-11-05T08:29:33.268 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.243+0000 7f8f35c32640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.52:3301/0 2023-11-05T08:29:33.268 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.243+0000 7f8f35c32640 1 -- 172.21.15.52:0/1216872807 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f28009a70 con 0x7f8f300b4240 2023-11-05T08:29:33.268 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.243+0000 7f8f17fff640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:29:33.268 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.243+0000 7f8f17fff640 1 -- 172.21.15.52:0/1216872807 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f240072f0 con 0x7f8f300b4240 2023-11-05T08:29:33.268 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.243+0000 7f8f17fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:29:33.269 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.243+0000 7f8f17fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-11-05T08:29:33.269 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.243+0000 7f8f17fff640 10 monclient: dump: 2023-11-05T08:29:33.269 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:29:33.269 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:33.269 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:33.269 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:33.270 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:29:33.270 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:33.270 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:29:33.270 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:29:33.270 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:29:33.271 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:33.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.243+0000 7f8f2dffb640 4 set_mon_vals no callback set 2023-11-05T08:29:33.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.243+0000 7f8f35c32640 10 client.17027.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-05T08:29:33.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.243+0000 7f8f35c32640 10 monclient: _renew_subs 2023-11-05T08:29:33.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.243+0000 7f8f35c32640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.52:3301/0 2023-11-05T08:29:33.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.243+0000 7f8f35c32640 1 -- 172.21.15.52:0/1216872807 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f300a8690 con 0x7f8f300b4240 2023-11-05T08:29:33.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.243+0000 7f8f35c32640 1 librados: init done 2023-11-05T08:29:33.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.244+0000 7f8f35c32640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-05T08:29:33.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.244+0000 7f8f35c32640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:29:33.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.244+0000 7f8f35c32640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.52:3301/0 2023-11-05T08:29:33.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.244+0000 7f8f35c32640 1 -- 172.21.15.52:0/1216872807 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f3004e9f0 con 0x7f8f300b4240 2023-11-05T08:29:33.514 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.513+0000 7f8f17fff640 1 -- 172.21.15.52:0/1216872807 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8f24007450 con 0x7f8f300b4240 2023-11-05T08:29:33.515 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.513+0000 7f8f17fff640 1 --2- 172.21.15.52:0/1216872807 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f8f1c06c800 0x7f8f1c06ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:33.515 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.514+0000 7f8f2f7fe640 1 --2- 172.21.15.52:0/1216872807 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f8f1c06c800 0x7f8f1c06ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:33.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.514+0000 7f8f2f7fe640 10 monclient: get_auth_request con 0x7f8f1c06c800 auth_method 0 2023-11-05T08:29:33.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.514+0000 7f8f2f7fe640 1 --2- 172.21.15.52:0/1216872807 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f8f1c06c800 0x7f8f1c06ecc0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f8f20009d30 tx=0x7f8f20009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:29:33.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.514+0000 7f8f17fff640 10 client.17027.objecter ms_handle_connect 0x7f8f1c06c800 2023-11-05T08:29:33.529 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.527+0000 7f8f17fff640 1 -- 172.21.15.52:0/1216872807 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(932..932 src has 619..932) v4 ==== 6193+0+0 (secure 0 0 0) 0x7f8f240580d0 con 0x7f8f300b4240 2023-11-05T08:29:33.529 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.527+0000 7f8f17fff640 10 client.17027.objecter ms_dispatch 0x7f8f30000b90 osd_map(932..932 src has 619..932) v4 2023-11-05T08:29:33.529 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.527+0000 7f8f17fff640 3 client.17027.objecter handle_osd_map got epochs [932,932] > 0 2023-11-05T08:29:33.529 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.527+0000 7f8f17fff640 3 client.17027.objecter handle_osd_map decoding full epoch 932 2023-11-05T08:29:33.529 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.527+0000 7f8f17fff640 20 client.17027.objecter dump_active .. 0 homeless 2023-11-05T08:29:33.530 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.527+0000 7f8f17fff640 1 -- 172.21.15.52:0/1216872807 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8f24054410 con 0x7f8f300b4240 2023-11-05T08:29:33.530 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.527+0000 7f8f17fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:29:33.530 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.527+0000 7f8f17fff640 10 monclient: _finish_command 1 = system:0 2023-11-05T08:29:33.712 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.711+0000 7f8f35c32640 1 -- 172.21.15.52:0/1216872807 --> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f8f300b6c20 con 0x7f8f1c06c800 2023-11-05T08:29:33.713 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.712+0000 7f8f17fff640 1 -- 172.21.15.52:0/1216872807 <== mgr.4108 v2:172.21.15.156:6800/3320012339 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f8f300b6c20 con 0x7f8f1c06c800 2023-11-05T08:29:33.713 INFO:teuthology.orchestra.run.smithi052.stderr:instructed osd(s) 7 to deep-scrub 2023-11-05T08:29:33.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.714+0000 7f8f35c32640 10 librados: watch_flush enter 2023-11-05T08:29:33.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.714+0000 7f8f35c32640 10 librados: watch_flush exit 2023-11-05T08:29:33.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.714+0000 7f8f35c32640 20 client.17027.objecter shutdown clearing up homeless session... 2023-11-05T08:29:33.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.714+0000 7f8f35c32640 10 client.17027.objecter successfully canceled tick 2023-11-05T08:29:33.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.714+0000 7f8f35c32640 1 -- 172.21.15.52:0/1216872807 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f8f1c06c800 msgr2=0x7f8f1c06ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:33.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.714+0000 7f8f35c32640 1 --2- 172.21.15.52:0/1216872807 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f8f1c06c800 0x7f8f1c06ecc0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f8f20009d30 tx=0x7f8f20009190 comp rx=0 tx=0).stop 2023-11-05T08:29:33.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.714+0000 7f8f35c32640 10 monclient: shutdown 2023-11-05T08:29:33.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.714+0000 7f8f35c32640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:29:33.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.714+0000 7f8f35c32640 1 -- 172.21.15.52:0/1216872807 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8f300b4240 msgr2=0x7f8f301d69c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:33.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.714+0000 7f8f35c32640 1 --2- 172.21.15.52:0/1216872807 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8f300b4240 0x7f8f301d69c0 secure :-1 s=READY pgs=3089 cs=0 l=1 rev1=1 crypto rx=0x7f8f2400c400 tx=0x7f8f2400c8c0 comp rx=0 tx=0).stop 2023-11-05T08:29:33.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.714+0000 7f8f35c32640 1 -- 172.21.15.52:0/1216872807 shutdown_connections 2023-11-05T08:29:33.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.714+0000 7f8f35c32640 1 --2- 172.21.15.52:0/1216872807 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f8f1c06c800 0x7f8f1c06ecc0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:33.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.714+0000 7f8f35c32640 1 --2- 172.21.15.52:0/1216872807 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f301d6f00 0x7f8f301d9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:33.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.714+0000 7f8f35c32640 1 --2- 172.21.15.52:0/1216872807 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8f300b4240 0x7f8f301d69c0 unknown :-1 s=CLOSED pgs=3089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:33.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.714+0000 7f8f35c32640 1 --2- 172.21.15.52:0/1216872807 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f300ade00 0x7f8f30145000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:33.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.714+0000 7f8f35c32640 1 -- 172.21.15.52:0/1216872807 >> 172.21.15.52:0/1216872807 conn(0x7f8f30065cd0 msgr2=0x7f8f300660b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:29:33.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.714+0000 7f8f35c32640 1 -- 172.21.15.52:0/1216872807 shutdown_connections 2023-11-05T08:29:33.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.714+0000 7f8f35c32640 1 -- 172.21.15.52:0/1216872807 wait complete. 2023-11-05T08:29:33.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.714+0000 7f8f35c32640 1 librados: shutdown 2023-11-05T08:29:33.726 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-05T08:29:33.833 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.831+0000 7f1a73b6c640 10 monclient: get_monmap_and_config 2023-11-05T08:29:33.833 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.831+0000 7f1a73b6c640 10 monclient: build_initial_monmap 2023-11-05T08:29:33.833 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.831+0000 7f1a73b6c640 10 monclient: monmap: 2023-11-05T08:29:33.833 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:29:33.833 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:33.834 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:29:33.833430+0000 2023-11-05T08:29:33.834 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:29:33.833430+0000 2023-11-05T08:29:33.834 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:29:33.834 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:33.834 INFO:teuthology.orchestra.run.smithi052.stderr:0: v1:172.21.15.52:6789/0 mon.noname-a-legacy 2023-11-05T08:29:33.835 INFO:teuthology.orchestra.run.smithi052.stderr:1: v1:172.21.15.156:6789/0 mon.noname-c-legacy 2023-11-05T08:29:33.835 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-b 2023-11-05T08:29:33.835 INFO:teuthology.orchestra.run.smithi052.stderr:3: v2:172.21.15.52:3300/0 mon.noname-a 2023-11-05T08:29:33.835 INFO:teuthology.orchestra.run.smithi052.stderr:4: v2:172.21.15.156:3300/0 mon.noname-c 2023-11-05T08:29:33.835 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:33.838 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.832+0000 7f1a73b6c640 1 Processor -- start 2023-11-05T08:29:33.838 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.832+0000 7f1a73b6c640 1 -- start start 2023-11-05T08:29:33.838 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.832+0000 7f1a73b6c640 10 monclient: init 2023-11-05T08:29:33.839 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.833+0000 7f1a73b6c640 10 monclient: _reopen_session rank -1 2023-11-05T08:29:33.839 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.833+0000 7f1a73b6c640 10 monclient: _add_conns ranks=[3,4,2,1,0] 2023-11-05T08:29:33.839 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.833+0000 7f1a73b6c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1a6c0aac60 0x7f1a6c13cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:33.839 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.833+0000 7f1a73b6c640 10 monclient(hunting): picked mon.noname-a con 0x7f1a6c0aac60 addr v2:172.21.15.52:3300/0 2023-11-05T08:29:33.839 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.833+0000 7f1a73b6c640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1a6c0ab040 0x7f1a6c0adac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:33.840 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.833+0000 7f1a73b6c640 10 monclient(hunting): picked mon.noname-c con 0x7f1a6c0ab040 addr v2:172.21.15.156:3300/0 2023-11-05T08:29:33.840 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.833+0000 7f1a73b6c640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1a6c140490 0x7f1a6c0ae000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:33.840 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.833+0000 7f1a73b6c640 10 monclient(hunting): picked mon.noname-b con 0x7f1a6c140490 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:29:33.840 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.833+0000 7f1a73b6c640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:33.840 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.833+0000 7f1a73b6c640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a6c0ac930 con 0x7f1a6c0aac60 2023-11-05T08:29:33.841 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.833+0000 7f1a73b6c640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:33.841 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.833+0000 7f1a73b6c640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a6c13fcd0 con 0x7f1a6c0ab040 2023-11-05T08:29:33.841 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.833+0000 7f1a73b6c640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:33.841 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.833+0000 7f1a73b6c640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a6c0acb60 con 0x7f1a6c140490 2023-11-05T08:29:33.841 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.833+0000 7f1a73b6c640 10 monclient(hunting): _renew_subs 2023-11-05T08:29:33.841 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.833+0000 7f1a73b6c640 10 monclient(hunting): authenticate will time out at 2720.039299s 2023-11-05T08:29:33.842 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.833+0000 7f1a71908640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1a6c0aac60 0x7f1a6c13cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:33.842 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.834+0000 7f1a72109640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1a6c140490 0x7f1a6c0ae000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:33.842 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.834+0000 7f1a71107640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1a6c0ab040 0x7f1a6c0adac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:33.842 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.834+0000 7f1a71908640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1a6c0aac60 0x7f1a6c13cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60158/0 (socket says 172.21.15.52:60158) 2023-11-05T08:29:33.842 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.834+0000 7f1a71908640 1 -- 172.21.15.52:0/2866475302 learned_addr learned my addr 172.21.15.52:0/2866475302 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-11-05T08:29:33.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.834+0000 7f1a71908640 10 monclient(hunting): get_auth_request con 0x7f1a6c0aac60 auth_method 0 2023-11-05T08:29:33.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.834+0000 7f1a71908640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:29:33.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.834+0000 7f1a71908640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:29:33.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.834+0000 7f1a71908640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:29:33.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.834+0000 7f1a71107640 10 monclient(hunting): get_auth_request con 0x7f1a6c0ab040 auth_method 0 2023-11-05T08:29:33.844 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.834+0000 7f1a71107640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:29:33.844 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.834+0000 7f1a71107640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:29:33.844 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.834+0000 7f1a71107640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:29:33.844 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.834+0000 7f1a72109640 10 monclient(hunting): get_auth_request con 0x7f1a6c140490 auth_method 0 2023-11-05T08:29:33.844 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.834+0000 7f1a72109640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:29:33.844 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.834+0000 7f1a72109640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:29:33.845 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.834+0000 7f1a72109640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:29:33.845 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.834+0000 7f1a71908640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:29:33.845 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.834+0000 7f1a71908640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:29:33.845 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.834+0000 7f1a71908640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:29:33.845 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.834+0000 7f1a71107640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:29:33.845 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.834+0000 7f1a71107640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:29:33.846 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.834+0000 7f1a71107640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:29:33.846 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.835+0000 7f1a72109640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:29:33.846 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.835+0000 7f1a72109640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:29:33.846 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.835+0000 7f1a72109640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:29:33.846 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.836+0000 7f1a71107640 10 monclient(hunting): handle_auth_done global_id 20773 payload 274 2023-11-05T08:29:33.847 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.836+0000 7f1a71107640 1 -- 172.21.15.52:0/2866475302 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1a6c140490 msgr2=0x7f1a6c0ae000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-05T08:29:33.847 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.836+0000 7f1a71107640 1 --2- 172.21.15.52:0/2866475302 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1a6c140490 0x7f1a6c0ae000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:33.847 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.836+0000 7f1a71107640 1 -- 172.21.15.52:0/2866475302 >> v2:172.21.15.52:3300/0 conn(0x7f1a6c0aac60 msgr2=0x7f1a6c13cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-05T08:29:33.847 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.836+0000 7f1a71107640 1 --2- 172.21.15.52:0/2866475302 >> v2:172.21.15.52:3300/0 conn(0x7f1a6c0aac60 0x7f1a6c13cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:33.847 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.836+0000 7f1a71107640 10 monclient: _finish_hunting 0 2023-11-05T08:29:33.848 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.836+0000 7f1a71107640 1 monclient: found mon.noname-c 2023-11-05T08:29:33.848 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.836+0000 7f1a71107640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:29:33.848 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.836+0000 7f1a71107640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.156:3300/0 2023-11-05T08:29:33.848 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.836+0000 7f1a71107640 1 -- 172.21.15.52:0/2866475302 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a6c0ace40 con 0x7f1a6c0ab040 2023-11-05T08:29:33.852 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.838+0000 7f1a71107640 1 --2- 172.21.15.52:0/2866475302 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1a6c0ab040 0x7f1a6c0adac0 secure :-1 s=READY pgs=5023 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c13fea0 tx=0x7f1a6002b710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a7d956a13c2a26e6 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:29:33.852 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.842+0000 7f1a70906640 1 -- 172.21.15.52:0/2866475302 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a60030710 con 0x7f1a6c0ab040 2023-11-05T08:29:33.852 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.842+0000 7f1a70906640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:29:33.853 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.842+0000 7f1a70906640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-11-05T08:29:33.853 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.842+0000 7f1a70906640 10 monclient: dump: 2023-11-05T08:29:33.853 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:29:33.853 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:33.853 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:33.853 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:33.854 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:29:33.854 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:33.854 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:29:33.854 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:29:33.854 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:29:33.855 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:33.855 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.842+0000 7f1a70906640 10 monclient: _finish_auth 0 2023-11-05T08:29:33.855 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.842+0000 7f1a70906640 10 monclient: _check_auth_tickets 2023-11-05T08:29:33.855 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.842+0000 7f1a70906640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:29:33.855 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.842+0000 7f1a70906640 1 -- 172.21.15.52:0/2866475302 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a6002e050 con 0x7f1a6c0ab040 2023-11-05T08:29:33.856 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.842+0000 7f1a73b6c640 5 monclient: authenticate success, global_id 20773 2023-11-05T08:29:33.856 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.842+0000 7f1a73b6c640 20 monclient: get_monmap_and_config waiting for monmap|config 2023-11-05T08:29:33.856 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.842+0000 7f1a70906640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:29:33.856 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.842+0000 7f1a73b6c640 10 monclient: get_monmap_and_config success 2023-11-05T08:29:33.856 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.842+0000 7f1a73b6c640 4 set_mon_vals no callback set 2023-11-05T08:29:33.856 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.842+0000 7f1a70906640 1 -- 172.21.15.52:0/2866475302 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a60030a90 con 0x7f1a6c0ab040 2023-11-05T08:29:33.857 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.842+0000 7f1a70906640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:29:33.857 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.842+0000 7f1a70906640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-05T08:29:33.857 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.842+0000 7f1a70906640 10 monclient: dump: 2023-11-05T08:29:33.857 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:29:33.857 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:33.858 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:33.858 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:33.858 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:29:33.858 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:33.858 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:29:33.859 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:29:33.859 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:29:33.859 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:33.859 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.842+0000 7f1a73b6c640 10 monclient: shutdown 2023-11-05T08:29:33.859 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.842+0000 7f1a73b6c640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:29:33.859 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.842+0000 7f1a73b6c640 1 -- 172.21.15.52:0/2866475302 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1a6c0ab040 msgr2=0x7f1a6c0adac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:33.860 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.842+0000 7f1a73b6c640 1 --2- 172.21.15.52:0/2866475302 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1a6c0ab040 0x7f1a6c0adac0 secure :-1 s=READY pgs=5023 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c13fea0 tx=0x7f1a6002b710 comp rx=0 tx=0).stop 2023-11-05T08:29:33.860 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.842+0000 7f1a73b6c640 1 -- 172.21.15.52:0/2866475302 shutdown_connections 2023-11-05T08:29:33.860 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.842+0000 7f1a73b6c640 1 --2- 172.21.15.52:0/2866475302 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1a6c140490 0x7f1a6c0ae000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:33.860 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.842+0000 7f1a73b6c640 1 --2- 172.21.15.52:0/2866475302 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1a6c0ab040 0x7f1a6c0adac0 unknown :-1 s=CLOSED pgs=5023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:33.860 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.842+0000 7f1a73b6c640 1 --2- 172.21.15.52:0/2866475302 >> v2:172.21.15.52:3300/0 conn(0x7f1a6c0aac60 0x7f1a6c13cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:33.861 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.842+0000 7f1a73b6c640 1 -- 172.21.15.52:0/2866475302 >> 172.21.15.52:0/2866475302 conn(0x7f1a6c0b2ff0 msgr2=0x7f1a6c0b3400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:29:33.861 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.843+0000 7f1a73b6c640 1 -- 172.21.15.52:0/2866475302 shutdown_connections 2023-11-05T08:29:33.861 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.843+0000 7f1a73b6c640 1 -- 172.21.15.52:0/2866475302 wait complete. 2023-11-05T08:29:33.861 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.843+0000 7f1a73b6c640 10 monclient: build_initial_monmap 2023-11-05T08:29:33.861 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.843+0000 7f1a73b6c640 10 monclient: monmap: 2023-11-05T08:29:33.861 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:29:33.862 INFO:teuthology.orchestra.run.smithi052.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-05T08:29:33.862 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 0.000000 2023-11-05T08:29:33.862 INFO:teuthology.orchestra.run.smithi052.stderr:created 0.000000 2023-11-05T08:29:33.862 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:29:33.862 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:33.862 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.noname-a 2023-11-05T08:29:33.863 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.noname-b 2023-11-05T08:29:33.863 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-c 2023-11-05T08:29:33.863 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:33.863 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.843+0000 7f1a73b6c640 1 librados: starting msgr at 2023-11-05T08:29:33.863 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.843+0000 7f1a73b6c640 1 librados: starting objecter 2023-11-05T08:29:33.863 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.844+0000 7f1a73b6c640 1 Processor -- start 2023-11-05T08:29:33.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.844+0000 7f1a73b6c640 1 -- start start 2023-11-05T08:29:33.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.844+0000 7f1a73b6c640 1 librados: setting wanted keys 2023-11-05T08:29:33.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.844+0000 7f1a73b6c640 1 librados: calling monclient init 2023-11-05T08:29:33.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.844+0000 7f1a73b6c640 10 monclient: init 2023-11-05T08:29:33.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.844+0000 7f1a73b6c640 10 monclient: _reopen_session rank -1 2023-11-05T08:29:33.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.844+0000 7f1a73b6c640 10 monclient: _add_conns ranks=[0,2,1] 2023-11-05T08:29:33.865 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.844+0000 7f1a73b6c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a6c0aac60 0x7f1a6c135140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:33.865 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.844+0000 7f1a73b6c640 10 monclient(hunting): picked mon.noname-a con 0x7f1a6c0aac60 addr [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] 2023-11-05T08:29:33.865 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.844+0000 7f1a73b6c640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1a6c140490 0x7f1a6c135680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:33.865 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.844+0000 7f1a73b6c640 10 monclient(hunting): picked mon.noname-c con 0x7f1a6c140490 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:29:33.865 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.844+0000 7f1a73b6c640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1a6c1438d0 0x7f1a6c1d4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:33.865 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.844+0000 7f1a73b6c640 10 monclient(hunting): picked mon.noname-b con 0x7f1a6c1438d0 addr [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] 2023-11-05T08:29:33.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.844+0000 7f1a73b6c640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:33.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.844+0000 7f1a73b6c640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a6c06d640 con 0x7f1a6c0aac60 2023-11-05T08:29:33.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.844+0000 7f1a73b6c640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:33.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.844+0000 7f1a73b6c640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a6c135c90 con 0x7f1a6c1438d0 2023-11-05T08:29:33.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.844+0000 7f1a73b6c640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:33.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.844+0000 7f1a73b6c640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a6c135e50 con 0x7f1a6c140490 2023-11-05T08:29:33.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.844+0000 7f1a73b6c640 10 monclient(hunting): _renew_subs 2023-11-05T08:29:33.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.844+0000 7f1a73b6c640 10 monclient(hunting): authenticate will time out at 2720.050624s 2023-11-05T08:29:33.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.845+0000 7f1a71908640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a6c0aac60 0x7f1a6c135140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:33.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.845+0000 7f1a71107640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1a6c140490 0x7f1a6c135680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:33.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.845+0000 7f1a72109640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1a6c1438d0 0x7f1a6c1d4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:33.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.845+0000 7f1a71908640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a6c0aac60 0x7f1a6c135140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60164/0 (socket says 172.21.15.52:60164) 2023-11-05T08:29:33.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.845+0000 7f1a71908640 1 -- 172.21.15.52:0/1761272963 learned_addr learned my addr 172.21.15.52:0/1761272963 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-11-05T08:29:33.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.845+0000 7f1a71908640 10 monclient(hunting): get_auth_request con 0x7f1a6c0aac60 auth_method 0 2023-11-05T08:29:33.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.845+0000 7f1a71908640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:29:33.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.845+0000 7f1a71908640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:29:33.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.845+0000 7f1a71908640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:29:33.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.845+0000 7f1a71107640 10 monclient(hunting): get_auth_request con 0x7f1a6c140490 auth_method 0 2023-11-05T08:29:33.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.845+0000 7f1a71107640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:29:33.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.845+0000 7f1a71107640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:29:33.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.845+0000 7f1a71107640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:29:33.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.845+0000 7f1a72109640 10 monclient(hunting): get_auth_request con 0x7f1a6c1438d0 auth_method 0 2023-11-05T08:29:33.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.845+0000 7f1a72109640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:29:33.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.845+0000 7f1a72109640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:29:33.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.845+0000 7f1a72109640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:29:33.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.845+0000 7f1a71908640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:29:33.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.845+0000 7f1a71908640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:29:33.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.845+0000 7f1a71908640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:29:33.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.846+0000 7f1a72109640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:29:33.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.846+0000 7f1a72109640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:29:33.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.846+0000 7f1a72109640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:29:33.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.846+0000 7f1a71107640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:29:33.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.846+0000 7f1a71107640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:29:33.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.846+0000 7f1a71107640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:29:33.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.848+0000 7f1a72109640 10 monclient(hunting): handle_auth_done global_id 20776 payload 824 2023-11-05T08:29:33.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.848+0000 7f1a72109640 1 -- 172.21.15.52:0/1761272963 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1a6c140490 msgr2=0x7f1a6c135680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:33.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.848+0000 7f1a72109640 1 --2- 172.21.15.52:0/1761272963 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1a6c140490 0x7f1a6c135680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:33.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.848+0000 7f1a72109640 1 -- 172.21.15.52:0/1761272963 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a6c0aac60 msgr2=0x7f1a6c135140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:33.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.848+0000 7f1a72109640 1 --2- 172.21.15.52:0/1761272963 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a6c0aac60 0x7f1a6c135140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:33.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.848+0000 7f1a72109640 10 monclient: _finish_hunting 0 2023-11-05T08:29:33.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.848+0000 7f1a72109640 1 monclient: found mon.noname-b 2023-11-05T08:29:33.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.848+0000 7f1a72109640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:29:33.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.848+0000 7f1a72109640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.156:3300/0 2023-11-05T08:29:33.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.848+0000 7f1a72109640 1 -- 172.21.15.52:0/1761272963 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a60009400 con 0x7f1a6c1438d0 2023-11-05T08:29:33.874 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.850+0000 7f1a72109640 1 -- 172.21.15.52:0/1761272963 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1a6c1438d0 msgr2=0x7f1a6c1d4570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2023-11-05T08:29:33.874 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.850+0000 7f1a72109640 1 -- 172.21.15.52:0/1761272963 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1a6c1438d0 msgr2=0x7f1a6c1d4570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-05T08:29:33.874 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.850+0000 7f1a72109640 1 --2- 172.21.15.52:0/1761272963 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1a6c1438d0 0x7f1a6c1d4570 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0x7f1a6400e7c0 tx=0x7f1a6400ec80 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-05T08:29:33.874 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:33.850+0000 7f1a72109640 1 --2- 172.21.15.52:0/1761272963 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1a6c1438d0 0x7f1a6c1d4570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-05T08:29:34.060 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:34.057+0000 7f1a72109640 1 --2- 172.21.15.52:0/1761272963 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1a6c1438d0 0x7f1a6c1d4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:34.060 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:34.058+0000 7f1a72109640 10 monclient: get_auth_request con 0x7f1a6c1438d0 auth_method 0 2023-11-05T08:29:34.060 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:34.058+0000 7f1a72109640 0 --2- 172.21.15.52:0/1761272963 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1a6c1438d0 0x7f1a6c1d4570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2023-11-05T08:29:34.060 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:34.058+0000 7f1a72109640 1 --2- 172.21.15.52:0/1761272963 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1a6c1438d0 0x7f1a6c1d4570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:34.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:34.058+0000 7f1a6a7fc640 10 monclient: ms_handle_reset current mon [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] 2023-11-05T08:29:34.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:34.058+0000 7f1a6a7fc640 10 monclient: _reopen_session rank -1 2023-11-05T08:29:34.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:34.058+0000 7f1a6a7fc640 1 -- 172.21.15.52:0/1761272963 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1a6c1438d0 msgr2=0x7f1a6c1d4570 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-11-05T08:29:34.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:34.058+0000 7f1a6a7fc640 1 --2- 172.21.15.52:0/1761272963 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1a6c1438d0 0x7f1a6c1d4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:34.062 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:34.058+0000 7f1a6a7fc640 10 monclient: _add_conns ranks=[1,0,2] 2023-11-05T08:29:34.062 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:34.058+0000 7f1a6a7fc640 1 --2- 172.21.15.52:0/1761272963 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1a58003500 0x7f1a58005950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:34.062 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:34.058+0000 7f1a6a7fc640 10 monclient(hunting): picked mon.noname-b con 0x7f1a58003500 addr [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] 2023-11-05T08:29:34.062 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:34.058+0000 7f1a6a7fc640 1 --2- 172.21.15.52:0/1761272963 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a6c0aac60 0x7f1a58008510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:34.062 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:34.058+0000 7f1a6a7fc640 10 monclient(hunting): picked mon.noname-a con 0x7f1a6c0aac60 addr [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] 2023-11-05T08:29:34.063 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:34.058+0000 7f1a6a7fc640 1 --2- 172.21.15.52:0/1761272963 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1a6c140490 0x7f1a5800afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:34.063 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:34.058+0000 7f1a6a7fc640 10 monclient(hunting): picked mon.noname-c con 0x7f1a6c140490 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:29:34.063 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:34.058+0000 7f1a6a7fc640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:34.063 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:34.058+0000 7f1a6a7fc640 1 -- 172.21.15.52:0/1761272963 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a5800b9f0 con 0x7f1a6c0aac60 2023-11-05T08:29:34.063 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:34.058+0000 7f1a6a7fc640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:34.064 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:34.058+0000 7f1a6a7fc640 1 -- 172.21.15.52:0/1761272963 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a5800bb30 con 0x7f1a58003500 2023-11-05T08:29:34.064 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:34.058+0000 7f1a6a7fc640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:34.064 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:34.058+0000 7f1a6a7fc640 1 -- 172.21.15.52:0/1761272963 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a5800bcf0 con 0x7f1a6c140490 2023-11-05T08:29:34.064 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:34.058+0000 7f1a6a7fc640 10 monclient(hunting): _renew_subs 2023-11-05T08:29:34.065 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:34.059+0000 7f1a71908640 1 --2- 172.21.15.52:0/1761272963 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1a58003500 0x7f1a58005950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:34.065 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:34.060+0000 7f1a71908640 10 monclient(hunting): get_auth_request con 0x7f1a58003500 auth_method 0 2023-11-05T08:29:34.066 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:34.060+0000 7f1a71908640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:29:34.066 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:34.060+0000 7f1a71908640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:29:34.066 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:34.060+0000 7f1a71908640 10 monclient(hunting): _init_auth already have auth, reseting 2023-11-05T08:29:34.066 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:34.060+0000 7f1a71908640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:29:34.066 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:34.060+0000 7f1a71908640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:29:34.067 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:34.060+0000 7f1a71908640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2023-11-05T08:29:34.067 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:34.062+0000 7f1a71908640 10 monclient(hunting): handle_auth_done global_id 20776 payload 293 2023-11-05T08:29:34.067 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:34.062+0000 7f1a71908640 1 -- 172.21.15.52:0/1761272963 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1a6c140490 msgr2=0x7f1a5800afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:34.067 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:34.062+0000 7f1a71908640 1 --2- 172.21.15.52:0/1761272963 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1a6c140490 0x7f1a5800afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:34.067 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:34.062+0000 7f1a71908640 1 -- 172.21.15.52:0/1761272963 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a6c0aac60 msgr2=0x7f1a58008510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:34.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:34.062+0000 7f1a71908640 1 --2- 172.21.15.52:0/1761272963 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a6c0aac60 0x7f1a58008510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:34.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:34.062+0000 7f1a71908640 10 monclient: _finish_hunting 0 2023-11-05T08:29:34.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:34.062+0000 7f1a71908640 1 monclient: found mon.noname-b 2023-11-05T08:29:34.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:34.062+0000 7f1a71908640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:29:34.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:34.062+0000 7f1a71908640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.156:3300/0 2023-11-05T08:29:34.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:34.062+0000 7f1a71908640 1 -- 172.21.15.52:0/1761272963 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a5800bf70 con 0x7f1a58003500 2023-11-05T08:29:34.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:34.064+0000 7f1a71908640 1 --2- 172.21.15.52:0/1761272963 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1a58003500 0x7f1a58005950 secure :-1 s=READY pgs=5025 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c0112e0 tx=0x7f1a64009190 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:29:34.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:34.064+0000 7f1a6a7fc640 10 client.?.objecter ms_handle_connect 0x7f1a58003500 2023-11-05T08:29:34.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:34.064+0000 7f1a6a7fc640 10 client.?.objecter resend_mon_ops 2023-11-05T08:29:34.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:34.068+0000 7f1a6a7fc640 1 -- 172.21.15.52:0/1761272963 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a5c010040 con 0x7f1a58003500 2023-11-05T08:29:34.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:34.068+0000 7f1a6a7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:29:34.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:34.068+0000 7f1a6a7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-05T08:29:34.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:34.068+0000 7f1a6a7fc640 10 monclient: dump: 2023-11-05T08:29:34.071 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:29:34.072 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:34.072 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:34.072 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:34.072 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:29:34.072 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:34.073 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:29:34.073 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:29:34.073 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:29:34.073 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:34.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:34.068+0000 7f1a6a7fc640 10 monclient: _finish_auth 0 2023-11-05T08:29:34.074 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:34.068+0000 7f1a6a7fc640 10 monclient: _check_auth_tickets 2023-11-05T08:29:34.074 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:34.068+0000 7f1a6a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:29:34.074 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:34.068+0000 7f1a6a7fc640 1 -- 172.21.15.52:0/1761272963 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a5c0092d0 con 0x7f1a58003500 2023-11-05T08:29:34.074 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:34.068+0000 7f1a73b6c640 5 monclient: authenticate success, global_id 20776 2023-11-05T08:29:34.074 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:34.068+0000 7f1a73b6c640 10 monclient: _renew_subs 2023-11-05T08:29:34.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:34.068+0000 7f1a73b6c640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:29:34.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:34.068+0000 7f1a73b6c640 1 -- 172.21.15.52:0/1761272963 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a6c142ef0 con 0x7f1a58003500 2023-11-05T08:29:34.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:34.068+0000 7f1a6a7fc640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:29:34.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:34.068+0000 7f1a6a7fc640 1 -- 172.21.15.52:0/1761272963 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a5c011ee0 con 0x7f1a58003500 2023-11-05T08:29:34.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:34.068+0000 7f1a6a7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:29:34.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:34.068+0000 7f1a6a7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-05T08:29:34.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:34.068+0000 7f1a6a7fc640 10 monclient: dump: 2023-11-05T08:29:34.076 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:29:34.076 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:34.076 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:34.076 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:34.077 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:29:34.077 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:34.077 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:29:34.077 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:29:34.077 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:29:34.078 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:34.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:34.068+0000 7f1a6bfff640 4 set_mon_vals no callback set 2023-11-05T08:29:34.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:34.068+0000 7f1a73b6c640 10 client.20776.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-05T08:29:34.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:34.068+0000 7f1a73b6c640 10 monclient: _renew_subs 2023-11-05T08:29:34.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:34.068+0000 7f1a73b6c640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:29:34.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:34.068+0000 7f1a73b6c640 1 -- 172.21.15.52:0/1761272963 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a6c140cf0 con 0x7f1a58003500 2023-11-05T08:29:34.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:34.068+0000 7f1a73b6c640 1 librados: init done 2023-11-05T08:29:34.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:34.069+0000 7f1a73b6c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-05T08:29:34.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:34.069+0000 7f1a73b6c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:29:34.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:34.069+0000 7f1a73b6c640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:29:34.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:34.069+0000 7f1a73b6c640 1 -- 172.21.15.52:0/1761272963 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a6c06d860 con 0x7f1a58003500 2023-11-05T08:29:34.324 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:34.323+0000 7f1a6a7fc640 1 -- 172.21.15.52:0/1761272963 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1a5c016670 con 0x7f1a58003500 2023-11-05T08:29:34.325 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:34.323+0000 7f1a6a7fc640 1 --2- 172.21.15.52:0/1761272963 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f1a6c1438d0 0x7f1a58076e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:34.325 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:34.323+0000 7f1a71107640 1 --2- 172.21.15.52:0/1761272963 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f1a6c1438d0 0x7f1a58076e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:34.326 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:34.324+0000 7f1a71107640 10 monclient: get_auth_request con 0x7f1a6c1438d0 auth_method 0 2023-11-05T08:29:34.326 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:34.324+0000 7f1a71107640 1 --2- 172.21.15.52:0/1761272963 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f1a6c1438d0 0x7f1a58076e80 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f1a60034000 tx=0x7f1a6002d000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:29:34.326 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:34.324+0000 7f1a6a7fc640 10 client.20776.objecter ms_handle_connect 0x7f1a6c1438d0 2023-11-05T08:29:34.327 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:34.325+0000 7f1a6a7fc640 1 -- 172.21.15.52:0/1761272963 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(932..932 src has 619..932) v4 ==== 6193+0+0 (secure 0 0 0) 0x7f1a5c0583e0 con 0x7f1a58003500 2023-11-05T08:29:34.327 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:34.325+0000 7f1a6a7fc640 10 client.20776.objecter ms_dispatch 0x7f1a6c000b90 osd_map(932..932 src has 619..932) v4 2023-11-05T08:29:34.327 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:34.325+0000 7f1a6a7fc640 3 client.20776.objecter handle_osd_map got epochs [932,932] > 0 2023-11-05T08:29:34.327 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:34.325+0000 7f1a6a7fc640 3 client.20776.objecter handle_osd_map decoding full epoch 932 2023-11-05T08:29:34.328 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:34.326+0000 7f1a6a7fc640 20 client.20776.objecter dump_active .. 0 homeless 2023-11-05T08:29:34.336 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:34.335+0000 7f1a6a7fc640 1 -- 172.21.15.52:0/1761272963 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1a5c054720 con 0x7f1a58003500 2023-11-05T08:29:34.337 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:34.335+0000 7f1a6a7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:29:34.337 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:34.335+0000 7f1a6a7fc640 10 monclient: _finish_command 1 = system:0 2023-11-05T08:29:34.523 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:34.522+0000 7f1a73b6c640 1 -- 172.21.15.52:0/1761272963 --> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1a6c1431f0 con 0x7f1a6c1438d0 2023-11-05T08:29:34.528 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:34.527+0000 7f1a6a7fc640 1 -- 172.21.15.52:0/1761272963 <== mgr.4108 v2:172.21.15.156:6800/3320012339 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+150568 (secure 0 0 0) 0x7f1a6c1431f0 con 0x7f1a6c1438d0 2023-11-05T08:29:34.530 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:29:34.530 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2023-11-05T08:29:34.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:34.529+0000 7f1a73b6c640 10 librados: watch_flush enter 2023-11-05T08:29:34.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:34.529+0000 7f1a73b6c640 10 librados: watch_flush exit 2023-11-05T08:29:34.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:34.529+0000 7f1a73b6c640 20 client.20776.objecter shutdown clearing up homeless session... 2023-11-05T08:29:34.533 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:34.529+0000 7f1a73b6c640 10 client.20776.objecter successfully canceled tick 2023-11-05T08:29:34.533 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:34.529+0000 7f1a73b6c640 1 -- 172.21.15.52:0/1761272963 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f1a6c1438d0 msgr2=0x7f1a58076e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:34.533 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:34.529+0000 7f1a73b6c640 1 --2- 172.21.15.52:0/1761272963 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f1a6c1438d0 0x7f1a58076e80 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f1a60034000 tx=0x7f1a6002d000 comp rx=0 tx=0).stop 2023-11-05T08:29:34.533 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:34.529+0000 7f1a73b6c640 10 monclient: shutdown 2023-11-05T08:29:34.533 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:34.529+0000 7f1a73b6c640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:29:34.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:34.529+0000 7f1a73b6c640 1 -- 172.21.15.52:0/1761272963 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1a58003500 msgr2=0x7f1a58005950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:34.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:34.529+0000 7f1a73b6c640 1 --2- 172.21.15.52:0/1761272963 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1a58003500 0x7f1a58005950 secure :-1 s=READY pgs=5025 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c0112e0 tx=0x7f1a64009190 comp rx=0 tx=0).stop 2023-11-05T08:29:34.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:34.529+0000 7f1a73b6c640 1 -- 172.21.15.52:0/1761272963 shutdown_connections 2023-11-05T08:29:34.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:34.529+0000 7f1a73b6c640 1 --2- 172.21.15.52:0/1761272963 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f1a6c1438d0 0x7f1a58076e80 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:34.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:34.529+0000 7f1a73b6c640 1 --2- 172.21.15.52:0/1761272963 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1a6c140490 0x7f1a5800afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:34.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:34.529+0000 7f1a73b6c640 1 --2- 172.21.15.52:0/1761272963 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a6c0aac60 0x7f1a58008510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:34.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:34.529+0000 7f1a73b6c640 1 --2- 172.21.15.52:0/1761272963 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1a58003500 0x7f1a58005950 unknown :-1 s=CLOSED pgs=5025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:34.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:34.529+0000 7f1a73b6c640 1 -- 172.21.15.52:0/1761272963 >> 172.21.15.52:0/1761272963 conn(0x7f1a6c0b2ff0 msgr2=0x7f1a6c13aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:29:34.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:34.529+0000 7f1a73b6c640 1 -- 172.21.15.52:0/1761272963 shutdown_connections 2023-11-05T08:29:34.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:34.529+0000 7f1a73b6c640 1 -- 172.21.15.52:0/1761272963 wait complete. 2023-11-05T08:29:34.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:34.529+0000 7f1a73b6c640 1 librados: shutdown 2023-11-05T08:29:34.541 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":1615,"stamp":"2023-11-05T08:29:33.483467+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459285,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":102,"num_read_kb":88,"num_write":120,"num_write_kb":1379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":85,"ondisk_log_size":85,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":522356,"kb_used_data":46680,"kb_used_omap":12,"kb_used_meta":475571,"kb_avail":754452364,"statfs":{"total":773094113280,"available":772559220736,"internally_reserved":0,"allocated":47800320,"data_stored":25897490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":486985272},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":57,"apply_latency_ms":57,"commit_latency_ns":57000000,"apply_latency_ns":57000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.900296"},"pg_stats":[{"pgid":"12.10","version":"0'0","reported_seq":882,"reported_epoch":931,"state":"active+clean","last_fresh":"2023-11-05T08:29:21.357791+0000","last_change":"2023-11-05T08:08:27.690087+0000","last_active":"2023-11-05T08:29:21.357791+0000","last_peered":"2023-11-05T08:29:21.357791+0000","last_clean":"2023-11-05T08:29:21.357791+0000","last_became_active":"2023-11-05T08:08:27.684720+0000","last_became_peered":"2023-11-05T08:08:27.684720+0000","last_unstale":"2023-11-05T08:29:21.357791+0000","last_undegraded":"2023-11-05T08:29:21.357791+0000","last_fullsized":"2023-11-05T08:29:21.357791+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T19:41:08.111512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":890,"reported_epoch":932,"state":"active+clean","last_fresh":"2023-11-05T08:29:30.431006+0000","last_change":"2023-11-05T08:29:30.432912+0000","last_active":"2023-11-05T08:29:30.431006+0000","last_peered":"2023-11-05T08:29:30.431006+0000","last_clean":"2023-11-05T08:29:30.431006+0000","last_became_active":"2023-11-05T08:08:12.972471+0000","last_became_peered":"2023-11-05T08:08:12.972471+0000","last_unstale":"2023-11-05T08:29:30.431006+0000","last_undegraded":"2023-11-05T08:29:30.431006+0000","last_fullsized":"2023-11-05T08:29:30.431006+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:29:30.425815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:29:30.425815+0000","last_clean_scrub_stamp":"2023-11-05T08:29:30.425815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T12:04:08.852166+0000","scrub_duration":0.126394758,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":882,"reported_epoch":931,"state":"active+clean","last_fresh":"2023-11-05T08:29:21.423816+0000","last_change":"2023-11-05T08:08:20.798605+0000","last_active":"2023-11-05T08:29:21.423816+0000","last_peered":"2023-11-05T08:29:21.423816+0000","last_clean":"2023-11-05T08:29:21.423816+0000","last_became_active":"2023-11-05T08:08:20.791671+0000","last_became_peered":"2023-11-05T08:08:20.791671+0000","last_unstale":"2023-11-05T08:29:21.423816+0000","last_undegraded":"2023-11-05T08:29:21.423816+0000","last_fullsized":"2023-11-05T08:29:21.423816+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T13:29:00.846506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":868,"reported_epoch":931,"state":"active+clean","last_fresh":"2023-11-05T08:29:21.574655+0000","last_change":"2023-11-05T08:08:26.582880+0000","last_active":"2023-11-05T08:29:21.574655+0000","last_peered":"2023-11-05T08:29:21.574655+0000","last_clean":"2023-11-05T08:29:21.574655+0000","last_became_active":"2023-11-05T08:08:26.449074+0000","last_became_peered":"2023-11-05T08:08:26.449074+0000","last_unstale":"2023-11-05T08:29:21.574655+0000","last_undegraded":"2023-11-05T08:29:21.574655+0000","last_fullsized":"2023-11-05T08:29:21.574655+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T18:45:21.023650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":895,"reported_epoch":932,"state":"active+clean","last_fresh":"2023-11-05T08:29:23.549350+0000","last_change":"2023-11-05T08:08:32.323831+0000","last_active":"2023-11-05T08:29:23.549350+0000","last_peered":"2023-11-05T08:29:23.549350+0000","last_clean":"2023-11-05T08:29:23.549350+0000","last_became_active":"2023-11-05T08:08:32.275587+0000","last_became_peered":"2023-11-05T08:08:32.275587+0000","last_unstale":"2023-11-05T08:29:23.549350+0000","last_undegraded":"2023-11-05T08:29:23.549350+0000","last_fullsized":"2023-11-05T08:29:23.549350+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":881,"reported_epoch":932,"state":"active+clean","last_fresh":"2023-11-05T08:29:23.541875+0000","last_change":"2023-11-05T08:08:15.985625+0000","last_active":"2023-11-05T08:29:23.541875+0000","last_peered":"2023-11-05T08:29:23.541875+0000","last_clean":"2023-11-05T08:29:23.541875+0000","last_became_active":"2023-11-05T08:08:15.950681+0000","last_became_peered":"2023-11-05T08:08:15.950681+0000","last_unstale":"2023-11-05T08:29:23.541875+0000","last_undegraded":"2023-11-05T08:29:23.541875+0000","last_fullsized":"2023-11-05T08:29:23.541875+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":880,"reported_epoch":932,"state":"active+clean","last_fresh":"2023-11-05T08:29:23.569781+0000","last_change":"2023-11-05T08:08:24.751420+0000","last_active":"2023-11-05T08:29:23.569781+0000","last_peered":"2023-11-05T08:29:23.569781+0000","last_clean":"2023-11-05T08:29:23.569781+0000","last_became_active":"2023-11-05T08:08:24.718463+0000","last_became_peered":"2023-11-05T08:08:24.718463+0000","last_unstale":"2023-11-05T08:29:23.569781+0000","last_undegraded":"2023-11-05T08:29:23.569781+0000","last_fullsized":"2023-11-05T08:29:23.569781+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":881,"reported_epoch":932,"state":"active+clean","last_fresh":"2023-11-05T08:29:23.545014+0000","last_change":"2023-11-05T08:08:13.351797+0000","last_active":"2023-11-05T08:29:23.545014+0000","last_peered":"2023-11-05T08:29:23.545014+0000","last_clean":"2023-11-05T08:29:23.545014+0000","last_became_active":"2023-11-05T08:08:13.341684+0000","last_became_peered":"2023-11-05T08:08:13.341684+0000","last_unstale":"2023-11-05T08:29:23.545014+0000","last_undegraded":"2023-11-05T08:29:23.545014+0000","last_fullsized":"2023-11-05T08:29:23.545014+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":893,"reported_epoch":931,"state":"active+clean","last_fresh":"2023-11-05T08:29:21.828082+0000","last_change":"2023-11-05T08:08:15.525549+0000","last_active":"2023-11-05T08:29:21.828082+0000","last_peered":"2023-11-05T08:29:21.828082+0000","last_clean":"2023-11-05T08:29:21.828082+0000","last_became_active":"2023-11-05T08:08:15.520030+0000","last_became_peered":"2023-11-05T08:08:15.520030+0000","last_unstale":"2023-11-05T08:29:21.828082+0000","last_undegraded":"2023-11-05T08:29:21.828082+0000","last_fullsized":"2023-11-05T08:29:21.828082+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T14:24:09.563061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":893,"reported_epoch":931,"state":"active+clean","last_fresh":"2023-11-05T08:29:21.833891+0000","last_change":"2023-11-05T08:08:15.879034+0000","last_active":"2023-11-05T08:29:21.833891+0000","last_peered":"2023-11-05T08:29:21.833891+0000","last_clean":"2023-11-05T08:29:21.833891+0000","last_became_active":"2023-11-05T08:08:15.871149+0000","last_became_peered":"2023-11-05T08:08:15.871149+0000","last_unstale":"2023-11-05T08:29:21.833891+0000","last_undegraded":"2023-11-05T08:29:21.833891+0000","last_fullsized":"2023-11-05T08:29:21.833891+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T12:39:25.891428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":881,"reported_epoch":932,"state":"active+clean","last_fresh":"2023-11-05T08:29:23.552641+0000","last_change":"2023-11-05T08:08:14.156651+0000","last_active":"2023-11-05T08:29:23.552641+0000","last_peered":"2023-11-05T08:29:23.552641+0000","last_clean":"2023-11-05T08:29:23.552641+0000","last_became_active":"2023-11-05T08:08:14.060255+0000","last_became_peered":"2023-11-05T08:08:14.060255+0000","last_unstale":"2023-11-05T08:29:23.552641+0000","last_undegraded":"2023-11-05T08:29:23.552641+0000","last_fullsized":"2023-11-05T08:29:23.552641+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":894,"reported_epoch":932,"state":"active+clean","last_fresh":"2023-11-05T08:29:23.543329+0000","last_change":"2023-11-05T08:08:15.769320+0000","last_active":"2023-11-05T08:29:23.543329+0000","last_peered":"2023-11-05T08:29:23.543329+0000","last_clean":"2023-11-05T08:29:23.543329+0000","last_became_active":"2023-11-05T08:08:15.726426+0000","last_became_peered":"2023-11-05T08:08:15.726426+0000","last_unstale":"2023-11-05T08:29:23.543329+0000","last_undegraded":"2023-11-05T08:29:23.543329+0000","last_fullsized":"2023-11-05T08:29:23.543329+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":884,"reported_epoch":932,"state":"active+clean","last_fresh":"2023-11-05T08:29:22.673442+0000","last_change":"2023-11-05T08:07:07.897554+0000","last_active":"2023-11-05T08:29:22.673442+0000","last_peered":"2023-11-05T08:29:22.673442+0000","last_clean":"2023-11-05T08:29:22.673442+0000","last_became_active":"2023-11-05T08:07:07.890422+0000","last_became_peered":"2023-11-05T08:07:07.890422+0000","last_unstale":"2023-11-05T08:29:22.673442+0000","last_undegraded":"2023-11-05T08:29:22.673442+0000","last_fullsized":"2023-11-05T08:29:22.673442+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:07:05.115520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:07:05.115520+0000","last_clean_scrub_stamp":"2023-11-05T08:07:05.115520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":882,"reported_epoch":931,"state":"active+clean","last_fresh":"2023-11-05T08:29:21.378093+0000","last_change":"2023-11-05T08:08:38.368346+0000","last_active":"2023-11-05T08:29:21.378093+0000","last_peered":"2023-11-05T08:29:21.378093+0000","last_clean":"2023-11-05T08:29:21.378093+0000","last_became_active":"2023-11-05T08:08:38.362716+0000","last_became_peered":"2023-11-05T08:08:38.362716+0000","last_unstale":"2023-11-05T08:29:21.378093+0000","last_undegraded":"2023-11-05T08:29:21.378093+0000","last_fullsized":"2023-11-05T08:29:21.378093+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T19:21:04.243650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":887,"reported_epoch":931,"state":"active+clean","last_fresh":"2023-11-05T08:29:21.430356+0000","last_change":"2023-11-05T08:07:07.935570+0000","last_active":"2023-11-05T08:29:21.430356+0000","last_peered":"2023-11-05T08:29:21.430356+0000","last_clean":"2023-11-05T08:29:21.430356+0000","last_became_active":"2023-11-05T08:07:07.908128+0000","last_became_peered":"2023-11-05T08:07:07.908128+0000","last_unstale":"2023-11-05T08:29:21.430356+0000","last_undegraded":"2023-11-05T08:29:21.430356+0000","last_fullsized":"2023-11-05T08:29:21.430356+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:07:05.115520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:07:05.115520+0000","last_clean_scrub_stamp":"2023-11-05T08:07:05.115520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T15:25:37.194219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":894,"reported_epoch":931,"state":"active+clean","last_fresh":"2023-11-05T08:29:21.829663+0000","last_change":"2023-11-05T08:08:12.669619+0000","last_active":"2023-11-05T08:29:21.829663+0000","last_peered":"2023-11-05T08:29:21.829663+0000","last_clean":"2023-11-05T08:29:21.829663+0000","last_became_active":"2023-11-05T08:08:12.653053+0000","last_became_peered":"2023-11-05T08:08:12.653053+0000","last_unstale":"2023-11-05T08:29:21.829663+0000","last_undegraded":"2023-11-05T08:29:21.829663+0000","last_fullsized":"2023-11-05T08:29:21.829663+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T17:33:50.738772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":885,"reported_epoch":932,"state":"active+clean","last_fresh":"2023-11-05T08:29:22.666264+0000","last_change":"2023-11-05T08:07:07.213210+0000","last_active":"2023-11-05T08:29:22.666264+0000","last_peered":"2023-11-05T08:29:22.666264+0000","last_clean":"2023-11-05T08:29:22.666264+0000","last_became_active":"2023-11-05T08:07:07.203649+0000","last_became_peered":"2023-11-05T08:07:07.203649+0000","last_unstale":"2023-11-05T08:29:22.666264+0000","last_undegraded":"2023-11-05T08:29:22.666264+0000","last_fullsized":"2023-11-05T08:29:22.666264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:07:05.115520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:07:05.115520+0000","last_clean_scrub_stamp":"2023-11-05T08:07:05.115520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":894,"reported_epoch":931,"state":"active+clean","last_fresh":"2023-11-05T08:29:21.835761+0000","last_change":"2023-11-05T08:08:14.906331+0000","last_active":"2023-11-05T08:29:21.835761+0000","last_peered":"2023-11-05T08:29:21.835761+0000","last_clean":"2023-11-05T08:29:21.835761+0000","last_became_active":"2023-11-05T08:08:14.900486+0000","last_became_peered":"2023-11-05T08:08:14.900486+0000","last_unstale":"2023-11-05T08:29:21.835761+0000","last_undegraded":"2023-11-05T08:29:21.835761+0000","last_fullsized":"2023-11-05T08:29:21.835761+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T14:54:34.273100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":874,"reported_epoch":931,"state":"active+clean","last_fresh":"2023-11-05T08:29:21.568360+0000","last_change":"2023-11-05T08:07:07.403639+0000","last_active":"2023-11-05T08:29:21.568360+0000","last_peered":"2023-11-05T08:29:21.568360+0000","last_clean":"2023-11-05T08:29:21.568360+0000","last_became_active":"2023-11-05T08:07:07.371569+0000","last_became_peered":"2023-11-05T08:07:07.371569+0000","last_unstale":"2023-11-05T08:29:21.568360+0000","last_undegraded":"2023-11-05T08:29:21.568360+0000","last_fullsized":"2023-11-05T08:29:21.568360+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:07:05.115520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:07:05.115520+0000","last_clean_scrub_stamp":"2023-11-05T08:07:05.115520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T14:58:41.385179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":882,"reported_epoch":931,"state":"active+clean","last_fresh":"2023-11-05T08:29:21.425405+0000","last_change":"2023-11-05T08:08:29.214565+0000","last_active":"2023-11-05T08:29:21.425405+0000","last_peered":"2023-11-05T08:29:21.425405+0000","last_clean":"2023-11-05T08:29:21.425405+0000","last_became_active":"2023-11-05T08:08:29.207330+0000","last_became_peered":"2023-11-05T08:08:29.207330+0000","last_unstale":"2023-11-05T08:29:21.425405+0000","last_undegraded":"2023-11-05T08:29:21.425405+0000","last_fullsized":"2023-11-05T08:29:21.425405+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T11:12:17.103935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":893,"reported_epoch":932,"state":"active+clean","last_fresh":"2023-11-05T08:29:30.829377+0000","last_change":"2023-11-05T08:29:30.830783+0000","last_active":"2023-11-05T08:29:30.829377+0000","last_peered":"2023-11-05T08:29:30.829377+0000","last_clean":"2023-11-05T08:29:30.829377+0000","last_became_active":"2023-11-05T08:07:07.344890+0000","last_became_peered":"2023-11-05T08:07:07.344890+0000","last_unstale":"2023-11-05T08:29:30.829377+0000","last_undegraded":"2023-11-05T08:29:30.829377+0000","last_fullsized":"2023-11-05T08:29:30.829377+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:29:30.827954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:29:30.827954+0000","last_clean_scrub_stamp":"2023-11-05T08:29:30.827954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T12:02:27.062242+0000","scrub_duration":0.032635201000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":894,"reported_epoch":931,"state":"active+clean","last_fresh":"2023-11-05T08:29:21.838505+0000","last_change":"2023-11-05T08:08:16.955033+0000","last_active":"2023-11-05T08:29:21.838505+0000","last_peered":"2023-11-05T08:29:21.838505+0000","last_clean":"2023-11-05T08:29:21.838505+0000","last_became_active":"2023-11-05T08:08:16.927690+0000","last_became_peered":"2023-11-05T08:08:16.927690+0000","last_unstale":"2023-11-05T08:29:21.838505+0000","last_undegraded":"2023-11-05T08:29:21.838505+0000","last_fullsized":"2023-11-05T08:29:21.838505+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T16:04:26.654084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":899,"reported_epoch":931,"state":"active+clean","last_fresh":"2023-11-05T08:29:21.832364+0000","last_change":"2023-11-05T08:07:07.085537+0000","last_active":"2023-11-05T08:29:21.832364+0000","last_peered":"2023-11-05T08:29:21.832364+0000","last_clean":"2023-11-05T08:29:21.832364+0000","last_became_active":"2023-11-05T08:07:07.051923+0000","last_became_peered":"2023-11-05T08:07:07.051923+0000","last_unstale":"2023-11-05T08:29:21.832364+0000","last_undegraded":"2023-11-05T08:29:21.832364+0000","last_fullsized":"2023-11-05T08:29:21.832364+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:07:05.115520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:07:05.115520+0000","last_clean_scrub_stamp":"2023-11-05T08:07:05.115520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T09:32:20.473313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":879,"reported_epoch":932,"state":"active+clean","last_fresh":"2023-11-05T08:29:22.675181+0000","last_change":"2023-11-05T08:08:32.728546+0000","last_active":"2023-11-05T08:29:22.675181+0000","last_peered":"2023-11-05T08:29:22.675181+0000","last_clean":"2023-11-05T08:29:22.675181+0000","last_became_active":"2023-11-05T08:08:32.722827+0000","last_became_peered":"2023-11-05T08:08:32.722827+0000","last_unstale":"2023-11-05T08:29:22.675181+0000","last_undegraded":"2023-11-05T08:29:22.675181+0000","last_fullsized":"2023-11-05T08:29:22.675181+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":886,"reported_epoch":932,"state":"active+clean","last_fresh":"2023-11-05T08:29:22.651088+0000","last_change":"2023-11-05T08:07:07.161269+0000","last_active":"2023-11-05T08:29:22.651088+0000","last_peered":"2023-11-05T08:29:22.651088+0000","last_clean":"2023-11-05T08:29:22.651088+0000","last_became_active":"2023-11-05T08:07:07.131650+0000","last_became_peered":"2023-11-05T08:07:07.131650+0000","last_unstale":"2023-11-05T08:29:22.651088+0000","last_undegraded":"2023-11-05T08:29:22.651088+0000","last_fullsized":"2023-11-05T08:29:22.651088+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:07:05.115520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:07:05.115520+0000","last_clean_scrub_stamp":"2023-11-05T08:07:05.115520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":894,"reported_epoch":931,"state":"active+clean","last_fresh":"2023-11-05T08:29:21.843870+0000","last_change":"2023-11-05T08:08:13.856039+0000","last_active":"2023-11-05T08:29:21.843870+0000","last_peered":"2023-11-05T08:29:21.843870+0000","last_clean":"2023-11-05T08:29:21.843870+0000","last_became_active":"2023-11-05T08:08:13.848417+0000","last_became_peered":"2023-11-05T08:08:13.848417+0000","last_unstale":"2023-11-05T08:29:21.843870+0000","last_undegraded":"2023-11-05T08:29:21.843870+0000","last_fullsized":"2023-11-05T08:29:21.843870+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T14:27:44.987944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":885,"reported_epoch":932,"state":"active+clean","last_fresh":"2023-11-05T08:29:22.660763+0000","last_change":"2023-11-05T08:07:07.482345+0000","last_active":"2023-11-05T08:29:22.660763+0000","last_peered":"2023-11-05T08:29:22.660763+0000","last_clean":"2023-11-05T08:29:22.660763+0000","last_became_active":"2023-11-05T08:07:07.467692+0000","last_became_peered":"2023-11-05T08:07:07.467692+0000","last_unstale":"2023-11-05T08:29:22.660763+0000","last_undegraded":"2023-11-05T08:29:22.660763+0000","last_fullsized":"2023-11-05T08:29:22.660763+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:07:05.115520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:07:05.115520+0000","last_clean_scrub_stamp":"2023-11-05T08:07:05.115520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"932'78","reported_seq":1005,"reported_epoch":932,"state":"active+clean","last_fresh":"2023-11-05T08:29:29.568069+0000","last_change":"2023-11-05T08:29:29.570254+0000","last_active":"2023-11-05T08:29:29.568069+0000","last_peered":"2023-11-05T08:29:29.568069+0000","last_clean":"2023-11-05T08:29:29.568069+0000","last_became_active":"2023-11-05T08:07:00.966209+0000","last_became_peered":"2023-11-05T08:07:00.966209+0000","last_unstale":"2023-11-05T08:29:29.568069+0000","last_undegraded":"2023-11-05T08:29:29.568069+0000","last_fullsized":"2023-11-05T08:29:29.568069+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"932'78","last_scrub_stamp":"2023-11-05T08:29:29.566570+0000","last_deep_scrub":"932'78","last_deep_scrub_stamp":"2023-11-05T08:29:29.566570+0000","last_clean_scrub_stamp":"2023-11-05T08:29:29.566570+0000","objects_scrubbed":2,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T11:16:16.599985+0000","scrub_duration":0.22732221699999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":113,"num_write_kb":1372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":880,"reported_epoch":932,"state":"active+clean","last_fresh":"2023-11-05T08:29:22.664565+0000","last_change":"2023-11-05T08:08:16.483616+0000","last_active":"2023-11-05T08:29:22.664565+0000","last_peered":"2023-11-05T08:29:22.664565+0000","last_clean":"2023-11-05T08:29:22.664565+0000","last_became_active":"2023-11-05T08:08:16.476624+0000","last_became_peered":"2023-11-05T08:08:16.476624+0000","last_unstale":"2023-11-05T08:29:22.664565+0000","last_undegraded":"2023-11-05T08:29:22.664565+0000","last_fullsized":"2023-11-05T08:29:22.664565+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":894,"reported_epoch":931,"state":"active+clean","last_fresh":"2023-11-05T08:29:21.842021+0000","last_change":"2023-11-05T08:08:15.541517+0000","last_active":"2023-11-05T08:29:21.842021+0000","last_peered":"2023-11-05T08:29:21.842021+0000","last_clean":"2023-11-05T08:29:21.842021+0000","last_became_active":"2023-11-05T08:08:15.536104+0000","last_became_peered":"2023-11-05T08:08:15.536104+0000","last_unstale":"2023-11-05T08:29:21.842021+0000","last_undegraded":"2023-11-05T08:29:21.842021+0000","last_fullsized":"2023-11-05T08:29:21.842021+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T16:13:04.020842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":880,"reported_epoch":931,"state":"active+clean","last_fresh":"2023-11-05T08:29:21.408598+0000","last_change":"2023-11-05T08:08:24.468665+0000","last_active":"2023-11-05T08:29:21.408598+0000","last_peered":"2023-11-05T08:29:21.408598+0000","last_clean":"2023-11-05T08:29:21.408598+0000","last_became_active":"2023-11-05T08:08:24.441081+0000","last_became_peered":"2023-11-05T08:08:24.441081+0000","last_unstale":"2023-11-05T08:29:21.408598+0000","last_undegraded":"2023-11-05T08:29:21.408598+0000","last_fullsized":"2023-11-05T08:29:21.408598+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T18:53:30.099795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":896,"reported_epoch":932,"state":"active+clean","last_fresh":"2023-11-05T08:29:23.547547+0000","last_change":"2023-11-05T08:08:16.655549+0000","last_active":"2023-11-05T08:29:23.547547+0000","last_peered":"2023-11-05T08:29:23.547547+0000","last_clean":"2023-11-05T08:29:23.547547+0000","last_became_active":"2023-11-05T08:08:16.632044+0000","last_became_peered":"2023-11-05T08:08:16.632044+0000","last_unstale":"2023-11-05T08:29:23.547547+0000","last_undegraded":"2023-11-05T08:29:23.547547+0000","last_fullsized":"2023-11-05T08:29:23.547547+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":883,"reported_epoch":932,"state":"active+clean","last_fresh":"2023-11-05T08:29:23.556935+0000","last_change":"2023-11-05T08:08:14.445311+0000","last_active":"2023-11-05T08:29:23.556935+0000","last_peered":"2023-11-05T08:29:23.556935+0000","last_clean":"2023-11-05T08:29:23.556935+0000","last_became_active":"2023-11-05T08:08:14.425433+0000","last_became_peered":"2023-11-05T08:08:14.425433+0000","last_unstale":"2023-11-05T08:29:23.556935+0000","last_undegraded":"2023-11-05T08:29:23.556935+0000","last_fullsized":"2023-11-05T08:29:23.556935+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":883,"reported_epoch":931,"state":"active+clean","last_fresh":"2023-11-05T08:29:21.437098+0000","last_change":"2023-11-05T08:08:17.165313+0000","last_active":"2023-11-05T08:29:21.437098+0000","last_peered":"2023-11-05T08:29:21.437098+0000","last_clean":"2023-11-05T08:29:21.437098+0000","last_became_active":"2023-11-05T08:08:17.140308+0000","last_became_peered":"2023-11-05T08:08:17.140308+0000","last_unstale":"2023-11-05T08:29:21.437098+0000","last_undegraded":"2023-11-05T08:29:21.437098+0000","last_fullsized":"2023-11-05T08:29:21.437098+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T19:28:30.888743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":883,"reported_epoch":932,"state":"active+clean","last_fresh":"2023-11-05T08:29:23.550901+0000","last_change":"2023-11-05T08:08:14.150663+0000","last_active":"2023-11-05T08:29:23.550901+0000","last_peered":"2023-11-05T08:29:23.550901+0000","last_clean":"2023-11-05T08:29:23.550901+0000","last_became_active":"2023-11-05T08:08:14.137585+0000","last_became_peered":"2023-11-05T08:08:14.137585+0000","last_unstale":"2023-11-05T08:29:23.550901+0000","last_undegraded":"2023-11-05T08:29:23.550901+0000","last_fullsized":"2023-11-05T08:29:23.550901+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1","version":"60'7","reported_seq":896,"reported_epoch":932,"state":"active+clean","last_fresh":"2023-11-05T08:29:23.537480+0000","last_change":"2023-11-05T08:08:15.816866+0000","last_active":"2023-11-05T08:29:23.537480+0000","last_peered":"2023-11-05T08:29:23.537480+0000","last_clean":"2023-11-05T08:29:23.537480+0000","last_became_active":"2023-11-05T08:08:15.787944+0000","last_became_peered":"2023-11-05T08:08:15.787944+0000","last_unstale":"2023-11-05T08:29:23.537480+0000","last_undegraded":"2023-11-05T08:29:23.537480+0000","last_fullsized":"2023-11-05T08:29:23.537480+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":896,"reported_epoch":932,"state":"active+clean","last_fresh":"2023-11-05T08:29:23.534695+0000","last_change":"2023-11-05T08:08:29.552725+0000","last_active":"2023-11-05T08:29:23.534695+0000","last_peered":"2023-11-05T08:29:23.534695+0000","last_clean":"2023-11-05T08:29:23.534695+0000","last_became_active":"2023-11-05T08:08:29.547162+0000","last_became_peered":"2023-11-05T08:08:29.547162+0000","last_unstale":"2023-11-05T08:29:23.534695+0000","last_undegraded":"2023-11-05T08:29:23.534695+0000","last_fullsized":"2023-11-05T08:29:23.534695+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":880,"reported_epoch":932,"state":"active+clean","last_fresh":"2023-11-05T08:29:22.676924+0000","last_change":"2023-11-05T08:08:20.758068+0000","last_active":"2023-11-05T08:29:22.676924+0000","last_peered":"2023-11-05T08:29:22.676924+0000","last_clean":"2023-11-05T08:29:22.676924+0000","last_became_active":"2023-11-05T08:08:20.752405+0000","last_became_peered":"2023-11-05T08:08:20.752405+0000","last_unstale":"2023-11-05T08:29:22.676924+0000","last_undegraded":"2023-11-05T08:29:22.676924+0000","last_fullsized":"2023-11-05T08:29:22.676924+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":882,"reported_epoch":932,"state":"active+clean","last_fresh":"2023-11-05T08:29:23.560849+0000","last_change":"2023-11-05T08:08:14.471293+0000","last_active":"2023-11-05T08:29:23.560849+0000","last_peered":"2023-11-05T08:29:23.560849+0000","last_clean":"2023-11-05T08:29:23.560849+0000","last_became_active":"2023-11-05T08:08:14.458020+0000","last_became_peered":"2023-11-05T08:08:14.458020+0000","last_unstale":"2023-11-05T08:29:23.560849+0000","last_undegraded":"2023-11-05T08:29:23.560849+0000","last_fullsized":"2023-11-05T08:29:23.560849+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":881,"reported_epoch":931,"state":"active+clean","last_fresh":"2023-11-05T08:29:21.411818+0000","last_change":"2023-11-05T08:08:17.325907+0000","last_active":"2023-11-05T08:29:21.411818+0000","last_peered":"2023-11-05T08:29:21.411818+0000","last_clean":"2023-11-05T08:29:21.411818+0000","last_became_active":"2023-11-05T08:08:17.320483+0000","last_became_peered":"2023-11-05T08:08:17.320483+0000","last_unstale":"2023-11-05T08:29:21.411818+0000","last_undegraded":"2023-11-05T08:29:21.411818+0000","last_fullsized":"2023-11-05T08:29:21.411818+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T08:33:36.614472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":868,"reported_epoch":931,"state":"active+clean","last_fresh":"2023-11-05T08:29:21.566735+0000","last_change":"2023-11-05T08:08:20.224993+0000","last_active":"2023-11-05T08:29:21.566735+0000","last_peered":"2023-11-05T08:29:21.566735+0000","last_clean":"2023-11-05T08:29:21.566735+0000","last_became_active":"2023-11-05T08:08:20.218112+0000","last_became_peered":"2023-11-05T08:08:20.218112+0000","last_unstale":"2023-11-05T08:29:21.566735+0000","last_undegraded":"2023-11-05T08:29:21.566735+0000","last_fullsized":"2023-11-05T08:29:21.566735+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T10:27:58.560760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":113,"num_write_kb":1372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":802816,"data_stored":795680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":78,"ondisk_log_size":78,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":0,"up_from":16,"seq":68719477009,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59128,"kb_used_data":5736,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94312712,"statfs":{"total":96636764160,"available":96576217088,"internally_reserved":0,"allocated":5873664,"data_stored":3137725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Nov 5 08:28:43 2023","interfaces":[{"interface":"back","average":{"1min":12.737,"5min":16.405000000000001,"15min":17.103999999999999},"min":{"1min":4.6589999999999998,"5min":4.6589999999999998,"15min":4.5},"max":{"1min":57.667000000000002,"5min":109.83,"15min":214.25299999999999},"last":8.4239999999999995},{"interface":"front","average":{"1min":15.419,"5min":18.902000000000001,"15min":19.364999999999998},"min":{"1min":5.0279999999999996,"5min":5.0279999999999996,"15min":4.6989999999999998},"max":{"1min":92.010000000000005,"5min":171.31999999999999,"15min":252.74000000000001},"last":9.4570000000000007}]},{"osd":2,"last update":"Sun Nov 5 08:28:57 2023","interfaces":[{"interface":"back","average":{"1min":14.499000000000001,"5min":24.434000000000001,"15min":24.056999999999999},"min":{"1min":8.8100000000000005,"5min":6.8419999999999996,"15min":6.3369999999999997},"max":{"1min":31.861999999999998,"5min":147.30199999999999,"15min":227.87100000000001},"last":12.603},{"interface":"front","average":{"1min":16.076000000000001,"5min":28.667000000000002,"15min":28.436},"min":{"1min":9.4179999999999993,"5min":9.0510000000000002,"15min":9.0510000000000002},"max":{"1min":34.857999999999997,"5min":231.124,"15min":343.62599999999998},"last":17.074000000000002}]},{"osd":3,"last update":"Sun Nov 5 08:28:43 2023","interfaces":[{"interface":"back","average":{"1min":21.385999999999999,"5min":27.227,"15min":25.497},"min":{"1min":10.151,"5min":7.6390000000000002,"15min":7.6390000000000002},"max":{"1min":95.622,"5min":165.13900000000001,"15min":242.93899999999999},"last":18.776},{"interface":"front","average":{"1min":14.419,"5min":18.553999999999998,"15min":18.728000000000002},"min":{"1min":8.0359999999999996,"5min":6.7190000000000003,"15min":6.3310000000000004},"max":{"1min":40.043999999999997,"5min":127.40600000000001,"15min":220.85499999999999},"last":13.577}]},{"osd":4,"last update":"Sun Nov 5 08:28:43 2023","interfaces":[{"interface":"back","average":{"1min":13.835000000000001,"5min":19.640000000000001,"15min":18.901},"min":{"1min":9.0429999999999993,"5min":7.6020000000000003,"15min":6.2830000000000004},"max":{"1min":28.248000000000001,"5min":125.905,"15min":176.929},"last":11.653},{"interface":"front","average":{"1min":17.474,"5min":25.137,"15min":24.228999999999999},"min":{"1min":10.781000000000001,"5min":10.333,"15min":7.7300000000000004},"max":{"1min":39.262,"5min":156.762,"15min":230.40600000000001},"last":16.045999999999999}]},{"osd":5,"last update":"Sun Nov 5 08:28:43 2023","interfaces":[{"interface":"back","average":{"1min":16.065000000000001,"5min":22.399000000000001,"15min":22.742000000000001},"min":{"1min":9.9320000000000004,"5min":7.093,"15min":6.8940000000000001},"max":{"1min":52.027999999999999,"5min":116.42,"15min":266.36099999999999},"last":14.276},{"interface":"front","average":{"1min":17.501999999999999,"5min":23.870000000000001,"15min":26.367999999999999},"min":{"1min":11.161,"5min":9.4139999999999997,"15min":9.4139999999999997},"max":{"1min":32.369,"5min":115.401,"15min":260.779},"last":15.289999999999999}]},{"osd":6,"last update":"Sun Nov 5 08:28:43 2023","interfaces":[{"interface":"back","average":{"1min":19.154,"5min":30.417000000000002,"15min":29.405000000000001},"min":{"1min":11.42,"5min":10.246,"15min":10.246},"max":{"1min":37.744999999999997,"5min":147.67599999999999,"15min":280.47199999999998},"last":17.934000000000001},{"interface":"front","average":{"1min":15.041,"5min":22.821999999999999,"15min":22.027999999999999},"min":{"1min":7.7000000000000002,"5min":6.5739999999999998,"15min":6.5739999999999998},"max":{"1min":40.978000000000002,"5min":216.12,"15min":216.12},"last":12.303000000000001}]},{"osd":7,"last update":"Sun Nov 5 08:28:43 2023","interfaces":[{"interface":"back","average":{"1min":21.381,"5min":34.792999999999999,"15min":29.745999999999999},"min":{"1min":12.074999999999999,"5min":11.266999999999999,"15min":10.122},"max":{"1min":44.856000000000002,"5min":281.70800000000003,"15min":281.70800000000003},"last":19.620000000000001},{"interface":"front","average":{"1min":23.933,"5min":40.325000000000003,"15min":34.375},"min":{"1min":16.882000000000001,"5min":13.933,"15min":13.242000000000001},"max":{"1min":45.856999999999999,"5min":284.21199999999999,"15min":284.21199999999999},"last":20.584}]}]},{"osd":3,"up_from":15,"seq":64424509713,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59128,"kb_used_data":5736,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94312712,"statfs":{"total":96636764160,"available":96576217088,"internally_reserved":0,"allocated":5873664,"data_stored":3137725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":54655432},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 5 08:28:39 2023","interfaces":[{"interface":"back","average":{"1min":10.744999999999999,"5min":14.304,"15min":22.193000000000001},"min":{"1min":6.8170000000000002,"5min":5.7539999999999996,"15min":4.5739999999999998},"max":{"1min":20.763000000000002,"5min":112.003,"15min":261.80799999999999},"last":15.191000000000001},{"interface":"front","average":{"1min":9.8160000000000007,"5min":12.709,"15min":21.585999999999999},"min":{"1min":7.25,"5min":4.4930000000000003,"15min":4.4199999999999999},"max":{"1min":15.653,"5min":113.303,"15min":391.05500000000001},"last":13.880000000000001}]},{"osd":1,"last update":"Sun Nov 5 08:28:39 2023","interfaces":[{"interface":"back","average":{"1min":14.669,"5min":18.469999999999999,"15min":25.491},"min":{"1min":8.0709999999999997,"5min":5.4669999999999996,"15min":5.4669999999999996},"max":{"1min":33.857999999999997,"5min":210.03999999999999,"15min":390.67000000000002},"last":19.347000000000001},{"interface":"front","average":{"1min":12.352,"5min":16.792999999999999,"15min":25.196999999999999},"min":{"1min":6.4669999999999996,"5min":6.4669999999999996,"15min":6.4279999999999999},"max":{"1min":29.837,"5min":130.197,"15min":406.154},"last":9.9550000000000001}]},{"osd":2,"last update":"Sun Nov 5 08:28:55 2023","interfaces":[{"interface":"back","average":{"1min":17.161999999999999,"5min":20.928000000000001,"15min":25.690999999999999},"min":{"1min":8.8300000000000001,"5min":7.508,"15min":7.1920000000000002},"max":{"1min":83.262,"5min":143.93100000000001,"15min":356.27800000000002},"last":24.849},{"interface":"front","average":{"1min":18.815000000000001,"5min":22.913,"15min":28.707000000000001},"min":{"1min":10.121,"5min":9.8279999999999994,"15min":7.9210000000000003},"max":{"1min":60.844999999999999,"5min":147.49600000000001,"15min":394.14999999999998},"last":23.231000000000002}]},{"osd":4,"last update":"Sun Nov 5 08:28:39 2023","interfaces":[{"interface":"back","average":{"1min":14.978999999999999,"5min":23.170000000000002,"15min":27.158000000000001},"min":{"1min":9.3439999999999994,"5min":7.1180000000000003,"15min":6.3609999999999998},"max":{"1min":44.747999999999998,"5min":239.07300000000001,"15min":342.72199999999998},"last":12.956},{"interface":"front","average":{"1min":22.855,"5min":29.050999999999998,"15min":32.917000000000002},"min":{"1min":11.836,"5min":9.673,"15min":9.0600000000000005},"max":{"1min":120.264,"5min":240.12799999999999,"15min":343.30799999999999},"last":21.303000000000001}]},{"osd":5,"last update":"Sun Nov 5 08:28:39 2023","interfaces":[{"interface":"back","average":{"1min":18.943000000000001,"5min":21.934000000000001,"15min":30.952999999999999},"min":{"1min":6.3040000000000003,"5min":6.3040000000000003,"15min":6.3040000000000003},"max":{"1min":74.201999999999998,"5min":132.55199999999999,"15min":412.41300000000001},"last":11.739000000000001},{"interface":"front","average":{"1min":16.152999999999999,"5min":17.201000000000001,"15min":27.908999999999999},"min":{"1min":6.6420000000000003,"5min":6.0030000000000001,"15min":6.0030000000000001},"max":{"1min":62.115000000000002,"5min":129.458,"15min":393.334},"last":16.933}]},{"osd":6,"last update":"Sun Nov 5 08:28:39 2023","interfaces":[{"interface":"back","average":{"1min":17.960000000000001,"5min":25.992999999999999,"15min":33.616},"min":{"1min":11.5,"5min":10.747,"15min":8.5289999999999999},"max":{"1min":29.053000000000001,"5min":197.44399999999999,"15min":395.892},"last":20.248000000000001},{"interface":"front","average":{"1min":17.393999999999998,"5min":25.535,"15min":31.867999999999999},"min":{"1min":10.085000000000001,"5min":10.085000000000001,"15min":7.6959999999999997},"max":{"1min":35.482999999999997,"5min":208.23099999999999,"15min":358.10599999999999},"last":18.021999999999998}]},{"osd":7,"last update":"Sun Nov 5 08:28:39 2023","interfaces":[{"interface":"back","average":{"1min":17.265999999999998,"5min":22.513000000000002,"15min":32.591999999999999},"min":{"1min":11.039,"5min":11.039,"15min":10.02},"max":{"1min":25.888999999999999,"5min":140.971,"15min":346.93299999999999},"last":22.917000000000002},{"interface":"front","average":{"1min":14.869999999999999,"5min":18.747,"15min":29.056999999999999},"min":{"1min":8.8059999999999992,"5min":7.7640000000000002,"15min":7.415},"max":{"1min":22.791,"5min":153.31800000000001,"15min":407.678},"last":16.309000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509712,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59120,"kb_used_data":5736,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94312720,"statfs":{"total":96636764160,"available":96576225280,"internally_reserved":0,"allocated":5873664,"data_stored":3137725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 5 08:28:49 2023","interfaces":[{"interface":"back","average":{"1min":11.885,"5min":17.285,"15min":22.297999999999998},"min":{"1min":6.4820000000000002,"5min":6.2279999999999998,"15min":5.0839999999999996},"max":{"1min":24.228000000000002,"5min":115.285,"15min":285.363},"last":9.0280000000000005},{"interface":"front","average":{"1min":16.359000000000002,"5min":22.396999999999998,"15min":28.001999999999999},"min":{"1min":7.1840000000000002,"5min":7.1840000000000002,"15min":7.1840000000000002},"max":{"1min":29.151,"5min":117.806,"15min":342.44999999999999},"last":15.699}]},{"osd":1,"last update":"Sun Nov 5 08:28:36 2023","interfaces":[{"interface":"back","average":{"1min":15.425000000000001,"5min":21.286999999999999,"15min":23.324000000000002},"min":{"1min":9.875,"5min":9.3350000000000009,"15min":5.8529999999999998},"max":{"1min":29.829999999999998,"5min":204.059,"15min":258.88600000000002},"last":15.047000000000001},{"interface":"front","average":{"1min":11.346,"5min":16.706,"15min":22.780000000000001},"min":{"1min":5.681,"5min":5.681,"15min":5.5030000000000001},"max":{"1min":26.155999999999999,"5min":231.86600000000001,"15min":312.77999999999997},"last":8.1280000000000001}]},{"osd":3,"last update":"Sun Nov 5 08:28:49 2023","interfaces":[{"interface":"back","average":{"1min":25.614000000000001,"5min":21.391999999999999,"15min":23.795999999999999},"min":{"1min":7.7069999999999999,"5min":6.976,"15min":6.2439999999999998},"max":{"1min":204.50800000000001,"5min":204.50800000000001,"15min":292.435},"last":12.702},{"interface":"front","average":{"1min":26.190000000000001,"5min":26.041,"15min":29.667000000000002},"min":{"1min":11.888,"5min":10.894,"15min":7.9800000000000004},"max":{"1min":160.86500000000001,"5min":161.327,"15min":288.178},"last":18.329000000000001}]},{"osd":4,"last update":"Sun Nov 5 08:28:49 2023","interfaces":[{"interface":"back","average":{"1min":11.77,"5min":14.837,"15min":18.927},"min":{"1min":6.399,"5min":5.8220000000000001,"15min":5.8220000000000001},"max":{"1min":27.553000000000001,"5min":129.64699999999999,"15min":261.12},"last":9.3499999999999996},{"interface":"front","average":{"1min":18.356000000000002,"5min":20.210999999999999,"15min":24.844999999999999},"min":{"1min":11.032,"5min":8.0190000000000001,"15min":7.8559999999999999},"max":{"1min":28.463000000000001,"5min":136.566,"15min":268.09899999999999},"last":13.289999999999999}]},{"osd":5,"last update":"Sun Nov 5 08:28:49 2023","interfaces":[{"interface":"back","average":{"1min":13.5,"5min":16.428999999999998,"15min":21.143000000000001},"min":{"1min":6.8479999999999999,"5min":6.3949999999999996,"15min":6.3159999999999998},"max":{"1min":30.815999999999999,"5min":110.682,"15min":229.387},"last":16.678000000000001},{"interface":"front","average":{"1min":20.343,"5min":24.088000000000001,"15min":27.779},"min":{"1min":11.023,"5min":11.023,"15min":9.8520000000000003},"max":{"1min":38.786999999999999,"5min":118.762,"15min":301.16899999999998},"last":10.789}]},{"osd":6,"last update":"Sun Nov 5 08:28:49 2023","interfaces":[{"interface":"back","average":{"1min":15.603,"5min":24.457999999999998,"15min":27.021999999999998},"min":{"1min":8.4469999999999992,"5min":8.4469999999999992,"15min":8.4469999999999992},"max":{"1min":26.398,"5min":119.38800000000001,"15min":219.01300000000001},"last":11.483000000000001},{"interface":"front","average":{"1min":18.614999999999998,"5min":19.393999999999998,"15min":22.059000000000001},"min":{"1min":9.875,"5min":8.7929999999999993,"15min":6.5309999999999997},"max":{"1min":34.994,"5min":111.405,"15min":217.93600000000001},"last":12.073}]},{"osd":7,"last update":"Sun Nov 5 08:28:36 2023","interfaces":[{"interface":"back","average":{"1min":23.518000000000001,"5min":23.989000000000001,"15min":27.620999999999999},"min":{"1min":14.113,"5min":9.9079999999999995,"15min":8.4870000000000001},"max":{"1min":65.971000000000004,"5min":135.114,"15min":263.37099999999998},"last":17.491},{"interface":"front","average":{"1min":32.572000000000003,"5min":31.068999999999999,"15min":31.628},"min":{"1min":16.792000000000002,"5min":13.923,"15min":9.5540000000000003},"max":{"1min":141.214,"5min":141.214,"15min":258.42000000000002},"last":19.138000000000002}]}]},{"osd":1,"up_from":15,"seq":64424509711,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59516,"kb_used_data":6132,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94312324,"statfs":{"total":96636764160,"available":96575819776,"internally_reserved":0,"allocated":6279168,"data_stored":3535570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 5 08:28:48 2023","interfaces":[{"interface":"back","average":{"1min":28.224,"5min":20.513999999999999,"15min":21.202999999999999},"min":{"1min":6.6360000000000001,"5min":4.2789999999999999,"15min":4.2789999999999999},"max":{"1min":269.49200000000002,"5min":269.49200000000002,"15min":309.815},"last":14.157999999999999},{"interface":"front","average":{"1min":18.898,"5min":18.010999999999999,"15min":19.018999999999998},"min":{"1min":5.7709999999999999,"5min":4.9089999999999998,"15min":4.4119999999999999},"max":{"1min":140.09,"5min":160.89500000000001,"15min":299.55399999999997},"last":17.658000000000001}]},{"osd":2,"last update":"Sun Nov 5 08:28:48 2023","interfaces":[{"interface":"back","average":{"1min":36.625,"5min":23.963999999999999,"15min":24.616},"min":{"1min":6.9550000000000001,"5min":6.202,"15min":5.7999999999999998},"max":{"1min":365.68099999999998,"5min":365.68099999999998,"15min":365.68099999999998},"last":11.326000000000001},{"interface":"front","average":{"1min":27.253,"5min":24.193000000000001,"15min":24.239000000000001},"min":{"1min":9.2539999999999996,"5min":7.0990000000000002,"15min":6.8899999999999997},"max":{"1min":143.03700000000001,"5min":188.554,"15min":302.49799999999999},"last":9.9250000000000007}]},{"osd":3,"last update":"Sun Nov 5 08:28:48 2023","interfaces":[{"interface":"back","average":{"1min":34.058,"5min":26.893999999999998,"15min":27.126000000000001},"min":{"1min":8.4090000000000007,"5min":7.1260000000000003,"15min":6.8019999999999996},"max":{"1min":330.101,"5min":330.101,"15min":334.85599999999999},"last":20.736999999999998},{"interface":"front","average":{"1min":32.119,"5min":27.798999999999999,"15min":28.527999999999999},"min":{"1min":7.673,"5min":7.673,"15min":6.9660000000000002},"max":{"1min":268.80900000000003,"5min":268.80900000000003,"15min":382.089},"last":18.577999999999999}]},{"osd":4,"last update":"Sun Nov 5 08:28:48 2023","interfaces":[{"interface":"back","average":{"1min":35.593000000000004,"5min":24.390999999999998,"15min":23.358000000000001},"min":{"1min":8.1560000000000006,"5min":8.0239999999999991,"15min":6.7220000000000004},"max":{"1min":309.38200000000001,"5min":309.38200000000001,"15min":309.38200000000001},"last":16.053000000000001},{"interface":"front","average":{"1min":20.195,"5min":19.210000000000001,"15min":20.236999999999998},"min":{"1min":7.415,"5min":7.1289999999999996,"15min":6.0750000000000002},"max":{"1min":112.929,"5min":161.56700000000001,"15min":161.56700000000001},"last":7.8799999999999999}]},{"osd":5,"last update":"Sun Nov 5 08:28:43 2023","interfaces":[{"interface":"back","average":{"1min":36.268000000000001,"5min":25.178999999999998,"15min":24.058},"min":{"1min":11.022,"5min":8.6549999999999994,"15min":6.1600000000000001},"max":{"1min":312.33699999999999,"5min":312.33699999999999,"15min":312.33699999999999},"last":23.119},{"interface":"front","average":{"1min":23.387,"5min":23.638000000000002,"15min":27.129000000000001},"min":{"1min":11.173999999999999,"5min":10.871,"15min":8.2129999999999992},"max":{"1min":138.23699999999999,"5min":146.816,"15min":297.25299999999999},"last":10.863}]},{"osd":6,"last update":"Sun Nov 5 08:28:43 2023","interfaces":[{"interface":"back","average":{"1min":28.651,"5min":23.355,"15min":26.981999999999999},"min":{"1min":11.853999999999999,"5min":8.3930000000000007,"15min":8.0579999999999998},"max":{"1min":166.16300000000001,"5min":166.16300000000001,"15min":284.84300000000002},"last":12.714},{"interface":"front","average":{"1min":36.008000000000003,"5min":29.831,"15min":32.936},"min":{"1min":13.599,"5min":12.923999999999999,"15min":12.047000000000001},"max":{"1min":225.93899999999999,"5min":225.93899999999999,"15min":290.81099999999998},"last":15.077999999999999}]},{"osd":7,"last update":"Sun Nov 5 08:28:43 2023","interfaces":[{"interface":"back","average":{"1min":20.428000000000001,"5min":23.300000000000001,"15min":31.018999999999998},"min":{"1min":8.9469999999999992,"5min":8.3680000000000003,"15min":8.3680000000000003},"max":{"1min":136.005,"5min":248.667,"15min":248.667},"last":17.047999999999998},{"interface":"front","average":{"1min":38.408999999999999,"5min":28.378,"15min":27.754000000000001},"min":{"1min":12.801,"5min":10.247999999999999,"15min":7.7199999999999998},"max":{"1min":331.02800000000002,"5min":331.02800000000002,"15min":331.02800000000002},"last":21.928000000000001}]}]},{"osd":7,"up_from":14,"seq":60129542416,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":81332,"kb_used_data":5736,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94290508,"statfs":{"total":96636764160,"available":96553480192,"internally_reserved":0,"allocated":5873664,"data_stored":3137725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":77396427},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 5 08:28:46 2023","interfaces":[{"interface":"back","average":{"1min":14.635999999999999,"5min":19.125,"15min":17.983000000000001},"min":{"1min":5.3369999999999997,"5min":4.5030000000000001,"15min":4.3739999999999997},"max":{"1min":92.448999999999998,"5min":198.46799999999999,"15min":198.46799999999999},"last":8.9139999999999997},{"interface":"front","average":{"1min":13.433999999999999,"5min":16.824999999999999,"15min":17.916},"min":{"1min":5.8949999999999996,"5min":5.5869999999999997,"15min":4.4260000000000002},"max":{"1min":65.064999999999998,"5min":129.173,"15min":162.06200000000001},"last":15.605}]},{"osd":1,"last update":"Sun Nov 5 08:28:42 2023","interfaces":[{"interface":"back","average":{"1min":13.074999999999999,"5min":19.145,"15min":23.327999999999999},"min":{"1min":6.7039999999999997,"5min":6.4109999999999996,"15min":5.9939999999999998},"max":{"1min":25.713999999999999,"5min":109.303,"15min":415.255},"last":17.544},{"interface":"front","average":{"1min":13.377000000000001,"5min":21.669,"15min":24.067},"min":{"1min":8.0030000000000001,"5min":7.2640000000000002,"15min":6.0999999999999996},"max":{"1min":24.722000000000001,"5min":146.83799999999999,"15min":305.72800000000001},"last":6.8380000000000001}]},{"osd":2,"last update":"Sun Nov 5 08:28:46 2023","interfaces":[{"interface":"back","average":{"1min":12.632,"5min":19.882999999999999,"15min":24.516999999999999},"min":{"1min":6.8860000000000001,"5min":6.5,"15min":6.5},"max":{"1min":41.588999999999999,"5min":125.071,"15min":196.78100000000001},"last":18.532},{"interface":"front","average":{"1min":14.002000000000001,"5min":21.390000000000001,"15min":23.530999999999999},"min":{"1min":8.2460000000000004,"5min":6.7009999999999996,"15min":6.5410000000000004},"max":{"1min":23.905999999999999,"5min":154.429,"15min":193.77500000000001},"last":10.513999999999999}]},{"osd":3,"last update":"Sun Nov 5 08:28:46 2023","interfaces":[{"interface":"back","average":{"1min":16.510000000000002,"5min":25.837,"15min":28.875},"min":{"1min":9.6649999999999991,"5min":9.1050000000000004,"15min":6.6660000000000004},"max":{"1min":30.847000000000001,"5min":171.90600000000001,"15min":380.88099999999997},"last":16.824000000000002},{"interface":"front","average":{"1min":18.937000000000001,"5min":25.657,"15min":26.742999999999999},"min":{"1min":7.0309999999999997,"5min":7.0309999999999997,"15min":6.3769999999999998},"max":{"1min":46.447000000000003,"5min":143.35499999999999,"15min":233.03},"last":20.161999999999999}]},{"osd":4,"last update":"Sun Nov 5 08:28:42 2023","interfaces":[{"interface":"back","average":{"1min":12.259,"5min":23.219000000000001,"15min":24.393999999999998},"min":{"1min":5.9329999999999998,"5min":5.9329999999999998,"15min":5.9329999999999998},"max":{"1min":35.728999999999999,"5min":158.124,"15min":215.60499999999999},"last":7.8019999999999996},{"interface":"front","average":{"1min":14.186,"5min":26.652000000000001,"15min":27.027999999999999},"min":{"1min":7.6790000000000003,"5min":7.6790000000000003,"15min":7.6790000000000003},"max":{"1min":25.98,"5min":158.79300000000001,"15min":347.35199999999998},"last":13.598000000000001}]},{"osd":5,"last update":"Sun Nov 5 08:28:42 2023","interfaces":[{"interface":"back","average":{"1min":15.875999999999999,"5min":26.494,"15min":28.981999999999999},"min":{"1min":7.8410000000000002,"5min":7.8410000000000002,"15min":7.7199999999999998},"max":{"1min":43.951999999999998,"5min":156.44,"15min":283.54300000000001},"last":14.625},{"interface":"front","average":{"1min":15.382999999999999,"5min":23.811,"15min":27.538},"min":{"1min":7.4290000000000003,"5min":6.5890000000000004,"15min":6.5890000000000004},"max":{"1min":34.548000000000002,"5min":168.31800000000001,"15min":582.69899999999996},"last":11.635999999999999}]},{"osd":6,"last update":"Sun Nov 5 08:28:42 2023","interfaces":[{"interface":"back","average":{"1min":18.151,"5min":25.055,"15min":26.518000000000001},"min":{"1min":12.026,"5min":9.218,"15min":8.7300000000000004},"max":{"1min":28.806000000000001,"5min":140.654,"15min":228.97200000000001},"last":12.249000000000001},{"interface":"front","average":{"1min":17.321000000000002,"5min":24.378,"15min":24.873000000000001},"min":{"1min":8.4280000000000008,"5min":7.806,"15min":7.1740000000000004},"max":{"1min":45.408999999999999,"5min":132.90199999999999,"15min":203.364},"last":19.353999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542417,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77560,"kb_used_data":6128,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94294280,"statfs":{"total":96636764160,"available":96557342720,"internally_reserved":0,"allocated":6275072,"data_stored":3535565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 5 08:28:41 2023","interfaces":[{"interface":"back","average":{"1min":13.449,"5min":11.827999999999999,"15min":17.780000000000001},"min":{"1min":5.0229999999999997,"5min":4.8460000000000001,"15min":4.3799999999999999},"max":{"1min":73.667000000000002,"5min":73.667000000000002,"15min":258.09699999999998},"last":11.398999999999999},{"interface":"front","average":{"1min":17.407,"5min":17.596,"15min":21.952999999999999},"min":{"1min":8.6270000000000007,"5min":4.1600000000000001,"15min":4.1600000000000001},"max":{"1min":76.629000000000005,"5min":231.863,"15min":278.45499999999998},"last":12.038}]},{"osd":1,"last update":"Sun Nov 5 08:28:41 2023","interfaces":[{"interface":"back","average":{"1min":22.600999999999999,"5min":20.210999999999999,"15min":20.777999999999999},"min":{"1min":6.5510000000000002,"5min":6.1609999999999996,"15min":4.351},"max":{"1min":77.555000000000007,"5min":304.47800000000001,"15min":304.47800000000001},"last":5.7350000000000003},{"interface":"front","average":{"1min":23.942,"5min":22.003,"15min":24.678000000000001},"min":{"1min":9.0899999999999999,"5min":6.4649999999999999,"15min":6.2430000000000003},"max":{"1min":89.457999999999998,"5min":167.91900000000001,"15min":286.233},"last":14.198}]},{"osd":2,"last update":"Sun Nov 5 08:28:41 2023","interfaces":[{"interface":"back","average":{"1min":22.696999999999999,"5min":20.16,"15min":22.661999999999999},"min":{"1min":8.1959999999999997,"5min":6.3970000000000002,"15min":5.1210000000000004},"max":{"1min":101.61799999999999,"5min":224.57900000000001,"15min":224.57900000000001},"last":6.8499999999999996},{"interface":"front","average":{"1min":26.762,"5min":23.725000000000001,"15min":27.760999999999999},"min":{"1min":11.435,"5min":7.476,"15min":5.5549999999999997},"max":{"1min":95.575999999999993,"5min":185.56299999999999,"15min":327.26100000000002},"last":14.987}]},{"osd":3,"last update":"Sun Nov 5 08:28:41 2023","interfaces":[{"interface":"back","average":{"1min":24.623000000000001,"5min":23.707000000000001,"15min":23.678999999999998},"min":{"1min":7.8780000000000001,"5min":6.0629999999999997,"15min":6.0629999999999997},"max":{"1min":90.995999999999995,"5min":192.482,"15min":283.94099999999997},"last":7.6520000000000001},{"interface":"front","average":{"1min":27.146000000000001,"5min":24.620999999999999,"15min":24.513999999999999},"min":{"1min":12.201000000000001,"5min":8.859,"15min":6.2729999999999997},"max":{"1min":86.838999999999999,"5min":167.28899999999999,"15min":284.72699999999998},"last":16.289000000000001}]},{"osd":4,"last update":"Sun Nov 5 08:28:41 2023","interfaces":[{"interface":"back","average":{"1min":22.033000000000001,"5min":21.033999999999999,"15min":22.164999999999999},"min":{"1min":10.708,"5min":9.3059999999999992,"15min":6.7409999999999997},"max":{"1min":98.747,"5min":98.747,"15min":244.86099999999999},"last":13.541},{"interface":"front","average":{"1min":12.505000000000001,"5min":14.978,"15min":20.456},"min":{"1min":5.8739999999999997,"5min":5.8739999999999997,"15min":5.8739999999999997},"max":{"1min":53.558,"5min":112.798,"15min":277.55700000000002},"last":10.000999999999999}]},{"osd":6,"last update":"Sun Nov 5 08:28:41 2023","interfaces":[{"interface":"back","average":{"1min":15.161,"5min":20.539999999999999,"15min":24.504000000000001},"min":{"1min":7.093,"5min":7.093,"15min":5.7930000000000001},"max":{"1min":59.149000000000001,"5min":242.536,"15min":242.536},"last":10.694000000000001},{"interface":"front","average":{"1min":25.109000000000002,"5min":26.298999999999999,"15min":27.393999999999998},"min":{"1min":9.1289999999999996,"5min":7.6870000000000003,"15min":7.0300000000000002},"max":{"1min":85.906000000000006,"5min":227.50299999999999,"15min":310.69099999999997},"last":17.597000000000001}]},{"osd":7,"last update":"Sun Nov 5 08:28:41 2023","interfaces":[{"interface":"back","average":{"1min":26.856000000000002,"5min":23.469000000000001,"15min":27.475999999999999},"min":{"1min":11.613,"5min":8.7769999999999992,"15min":8.2379999999999995},"max":{"1min":100.372,"5min":119.51900000000001,"15min":281.71199999999999},"last":9.282},{"interface":"front","average":{"1min":26.722000000000001,"5min":23.254999999999999,"15min":29.834},"min":{"1min":9.8550000000000004,"5min":8.0860000000000003,"15min":8.0860000000000003},"max":{"1min":90.287999999999997,"5min":94.194999999999993,"15min":319.786},"last":18.963000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542418,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63284,"kb_used_data":5736,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94308556,"statfs":{"total":96636764160,"available":96571961344,"internally_reserved":0,"allocated":5873664,"data_stored":3137725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 5 08:28:35 2023","interfaces":[{"interface":"back","average":{"1min":9.3810000000000002,"5min":13.75,"15min":20.544},"min":{"1min":5.633,"5min":5.0940000000000003,"15min":5.0069999999999997},"max":{"1min":27.414000000000001,"5min":75.152000000000001,"15min":243.626},"last":4.6950000000000003},{"interface":"front","average":{"1min":15.006,"5min":19.321000000000002,"15min":24.324999999999999},"min":{"1min":9.4640000000000004,"5min":5.7199999999999998,"15min":5.7199999999999998},"max":{"1min":30.917000000000002,"5min":132.78899999999999,"15min":202.49000000000001},"last":7.6139999999999999}]},{"osd":1,"last update":"Sun Nov 5 08:28:35 2023","interfaces":[{"interface":"back","average":{"1min":12.646000000000001,"5min":16.113,"15min":21.669},"min":{"1min":5.4790000000000001,"5min":4.5709999999999997,"15min":4.274},"max":{"1min":24.260000000000002,"5min":162.90799999999999,"15min":369.267},"last":8.7360000000000007},{"interface":"front","average":{"1min":9.8100000000000005,"5min":15.993,"15min":24.495999999999999},"min":{"1min":5.4930000000000003,"5min":5.4930000000000003,"15min":5.4930000000000003},"max":{"1min":25.135000000000002,"5min":157.459,"15min":340.214},"last":10.349}]},{"osd":2,"last update":"Sun Nov 5 08:28:35 2023","interfaces":[{"interface":"back","average":{"1min":15.661,"5min":21.771000000000001,"15min":27.968},"min":{"1min":7.2199999999999998,"5min":6.7750000000000004,"15min":6.7750000000000004},"max":{"1min":31.937000000000001,"5min":192.44999999999999,"15min":241.934},"last":9.7210000000000001},{"interface":"front","average":{"1min":14.156000000000001,"5min":20.931000000000001,"15min":26.690999999999999},"min":{"1min":6.5110000000000001,"5min":6.5110000000000001,"15min":6.3109999999999999},"max":{"1min":26.538,"5min":183.47900000000001,"15min":368.279},"last":17.657}]},{"osd":3,"last update":"Sun Nov 5 08:28:35 2023","interfaces":[{"interface":"back","average":{"1min":13.609999999999999,"5min":19.948,"15min":24.542000000000002},"min":{"1min":7.9960000000000004,"5min":6.6680000000000001,"15min":6.1200000000000001},"max":{"1min":57.084000000000003,"5min":164.06399999999999,"15min":369.53399999999999},"last":12.318},{"interface":"front","average":{"1min":18.161000000000001,"5min":24.800000000000001,"15min":32.271000000000001},"min":{"1min":6.8920000000000003,"5min":6.8920000000000003,"15min":6.8920000000000003},"max":{"1min":55.741,"5min":196.655,"15min":371.52499999999998},"last":11.484}]},{"osd":5,"last update":"Sun Nov 5 08:28:35 2023","interfaces":[{"interface":"back","average":{"1min":18.956,"5min":26.338000000000001,"15min":32.387999999999998},"min":{"1min":12.984,"5min":8.4469999999999992,"15min":7.0010000000000003},"max":{"1min":35.478999999999999,"5min":202.82900000000001,"15min":283.08100000000002},"last":16.132999999999999},{"interface":"front","average":{"1min":15.491,"5min":25.239999999999998,"15min":27.282},"min":{"1min":9.4550000000000001,"5min":6.6219999999999999,"15min":6.3010000000000002},"max":{"1min":28.989999999999998,"5min":264.10300000000001,"15min":283.94400000000002},"last":14.236000000000001}]},{"osd":6,"last update":"Sun Nov 5 08:28:35 2023","interfaces":[{"interface":"back","average":{"1min":18.690999999999999,"5min":19.449999999999999,"15min":26.378},"min":{"1min":7.7930000000000001,"5min":7.1740000000000004,"15min":6.4359999999999999},"max":{"1min":122.85899999999999,"5min":165.113,"15min":324.98200000000003},"last":15.393000000000001},{"interface":"front","average":{"1min":24.279,"5min":26.126000000000001,"15min":31.824000000000002},"min":{"1min":9.5470000000000006,"5min":9.5470000000000006,"15min":8.5890000000000004},"max":{"1min":125.249,"5min":205.83199999999999,"15min":288.26799999999997},"last":13.909000000000001}]},{"osd":7,"last update":"Sun Nov 5 08:28:35 2023","interfaces":[{"interface":"back","average":{"1min":17.625,"5min":26.843,"15min":29.835999999999999},"min":{"1min":8.8219999999999992,"5min":7.7009999999999996,"15min":7.1559999999999997},"max":{"1min":43.206000000000003,"5min":211.39400000000001,"15min":356.44600000000003},"last":14.962999999999999},{"interface":"front","average":{"1min":20.716999999999999,"5min":27.966000000000001,"15min":30.741},"min":{"1min":13.167999999999999,"5min":9.7159999999999993,"15min":9.7159999999999993},"max":{"1min":41.866999999999997,"5min":208.833,"15min":327.53800000000001},"last":18.463999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575119,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63288,"kb_used_data":5740,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94308552,"statfs":{"total":96636764160,"available":96571957248,"internally_reserved":0,"allocated":5877760,"data_stored":3137730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 5 08:28:46 2023","interfaces":[{"interface":"back","average":{"1min":16.972999999999999,"5min":17.661999999999999,"15min":18.792000000000002},"min":{"1min":4.7169999999999996,"5min":4.1600000000000001,"15min":4.1600000000000001},"max":{"1min":98.253,"5min":165.51900000000001,"15min":187.75899999999999},"last":9.9049999999999994},{"interface":"front","average":{"1min":20.254999999999999,"5min":18.486999999999998,"15min":18.247},"min":{"1min":6.7910000000000004,"5min":5.3049999999999997,"15min":4.6790000000000003},"max":{"1min":119.42100000000001,"5min":168.239,"15min":185.38200000000001},"last":9.0640000000000001}]},{"osd":1,"last update":"Sun Nov 5 08:28:46 2023","interfaces":[{"interface":"back","average":{"1min":17.149000000000001,"5min":23.170000000000002,"15min":24.638999999999999},"min":{"1min":8.7639999999999993,"5min":5.4720000000000004,"15min":5.4720000000000004},"max":{"1min":57.432000000000002,"5min":226.23500000000001,"15min":286.072},"last":8.1839999999999993},{"interface":"front","average":{"1min":17.667999999999999,"5min":20.977,"15min":23.52},"min":{"1min":8.1519999999999992,"5min":5.6980000000000004,"15min":5.6980000000000004},"max":{"1min":72.725999999999999,"5min":168.25899999999999,"15min":309.512},"last":14.834}]},{"osd":2,"last update":"Sun Nov 5 08:28:46 2023","interfaces":[{"interface":"back","average":{"1min":18.177,"5min":23.372,"15min":24.986999999999998},"min":{"1min":7.9550000000000001,"5min":7.0030000000000001,"15min":6.6390000000000002},"max":{"1min":63.627000000000002,"5min":177.25,"15min":244.21100000000001},"last":10.817},{"interface":"front","average":{"1min":22.576000000000001,"5min":31.414000000000001,"15min":29.402999999999999},"min":{"1min":10.571999999999999,"5min":9.4179999999999993,"15min":8.8000000000000007},"max":{"1min":86.832999999999998,"5min":335.95100000000002,"15min":335.95100000000002},"last":18.318000000000001}]},{"osd":3,"last update":"Sun Nov 5 08:28:46 2023","interfaces":[{"interface":"back","average":{"1min":13.595000000000001,"5min":21.442,"15min":26.722000000000001},"min":{"1min":6.5359999999999996,"5min":6.4909999999999997,"15min":6.4909999999999997},"max":{"1min":55.103999999999999,"5min":175.47300000000001,"15min":372.54199999999997},"last":7.4900000000000002},{"interface":"front","average":{"1min":26.343,"5min":22.968,"15min":21.238},"min":{"1min":11.815,"5min":6.2000000000000002,"15min":6.0069999999999997},"max":{"1min":113.185,"5min":152.446,"15min":273.34300000000002},"last":16.795000000000002}]},{"osd":4,"last update":"Sun Nov 5 08:28:46 2023","interfaces":[{"interface":"back","average":{"1min":20.216000000000001,"5min":19.321000000000002,"15min":19.097000000000001},"min":{"1min":8.0090000000000003,"5min":6.468,"15min":6.468},"max":{"1min":91.988,"5min":138.107,"15min":211},"last":11.382},{"interface":"front","average":{"1min":22.460000000000001,"5min":22.382999999999999,"15min":22.785},"min":{"1min":7.6790000000000003,"5min":7.6790000000000003,"15min":7.5670000000000002},"max":{"1min":90.873000000000005,"5min":178.578,"15min":255.61600000000001},"last":11.956}]},{"osd":5,"last update":"Sun Nov 5 08:28:46 2023","interfaces":[{"interface":"back","average":{"1min":27.132999999999999,"5min":21.550999999999998,"15min":27.628},"min":{"1min":6.4169999999999998,"5min":6.4169999999999998,"15min":6.4169999999999998},"max":{"1min":114.03400000000001,"5min":121.566,"15min":915.64300000000003},"last":12.666},{"interface":"front","average":{"1min":35.225999999999999,"5min":28.045000000000002,"15min":34.017000000000003},"min":{"1min":11.31,"5min":11.31,"15min":8.8079999999999998},"max":{"1min":171.06899999999999,"5min":171.06899999999999,"15min":928.67899999999997},"last":17.706}]},{"osd":7,"last update":"Sun Nov 5 08:28:46 2023","interfaces":[{"interface":"back","average":{"1min":26.385000000000002,"5min":22.568000000000001,"15min":23.834},"min":{"1min":10.788,"5min":7.3730000000000002,"15min":7.3730000000000002},"max":{"1min":128.999,"5min":167.63800000000001,"15min":212.917},"last":16.027999999999999},{"interface":"front","average":{"1min":23.076000000000001,"5min":22.853000000000002,"15min":25.146000000000001},"min":{"1min":8.8940000000000001,"5min":8.609,"15min":7.3259999999999996},"max":{"1min":118.515,"5min":182.375,"15min":222.44499999999999},"last":13.984999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-05T08:29:34.547 INFO:tasks.ceph:pgid 12.10 last_scrub_stamp 2023-11-05T08:08:08.520104+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=5, tm_hour=8, tm_min=8, tm_sec=8, tm_wday=6, tm_yday=309, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=5, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=309, tm_isdst=0) 2023-11-05T08:29:34.547 INFO:tasks.ceph:pgid 12.12 last_scrub_stamp 2023-11-05T08:08:08.520104+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=5, tm_hour=8, tm_min=8, tm_sec=8, tm_wday=6, tm_yday=309, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=5, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=309, tm_isdst=0) 2023-11-05T08:29:34.548 INFO:tasks.ceph:pgid 12.13 last_scrub_stamp 2023-11-05T08:08:08.520104+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=5, tm_hour=8, tm_min=8, tm_sec=8, tm_wday=6, tm_yday=309, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=5, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=309, tm_isdst=0) 2023-11-05T08:29:34.548 INFO:tasks.ceph:pgid 12.14 last_scrub_stamp 2023-11-05T08:08:08.520104+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=5, tm_hour=8, tm_min=8, tm_sec=8, tm_wday=6, tm_yday=309, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=5, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=309, tm_isdst=0) 2023-11-05T08:29:34.548 INFO:tasks.ceph:pgid 12.15 last_scrub_stamp 2023-11-05T08:08:08.520104+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=5, tm_hour=8, tm_min=8, tm_sec=8, tm_wday=6, tm_yday=309, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=5, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=309, tm_isdst=0) 2023-11-05T08:29:34.549 INFO:tasks.ceph:pgid 12.16 last_scrub_stamp 2023-11-05T08:08:08.520104+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=5, tm_hour=8, tm_min=8, tm_sec=8, tm_wday=6, tm_yday=309, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=5, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=309, tm_isdst=0) 2023-11-05T08:29:34.549 INFO:tasks.ceph:pgid 12.17 last_scrub_stamp 2023-11-05T08:08:08.520104+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=5, tm_hour=8, tm_min=8, tm_sec=8, tm_wday=6, tm_yday=309, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=5, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=309, tm_isdst=0) 2023-11-05T08:29:34.549 INFO:tasks.ceph:pgid 12.18 last_scrub_stamp 2023-11-05T08:08:08.520104+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=5, tm_hour=8, tm_min=8, tm_sec=8, tm_wday=6, tm_yday=309, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=5, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=309, tm_isdst=0) 2023-11-05T08:29:34.550 INFO:tasks.ceph:pgid 12.19 last_scrub_stamp 2023-11-05T08:08:08.520104+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=5, tm_hour=8, tm_min=8, tm_sec=8, tm_wday=6, tm_yday=309, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=5, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=309, tm_isdst=0) 2023-11-05T08:29:34.550 INFO:tasks.ceph:pgid 12.1a last_scrub_stamp 2023-11-05T08:08:08.520104+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=5, tm_hour=8, tm_min=8, tm_sec=8, tm_wday=6, tm_yday=309, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=5, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=309, tm_isdst=0) 2023-11-05T08:29:34.550 INFO:tasks.ceph:pgid 12.1b last_scrub_stamp 2023-11-05T08:08:08.520104+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=5, tm_hour=8, tm_min=8, tm_sec=8, tm_wday=6, tm_yday=309, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=5, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=309, tm_isdst=0) 2023-11-05T08:29:34.550 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-11-05T08:07:05.115520+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=5, tm_hour=8, tm_min=7, tm_sec=5, tm_wday=6, tm_yday=309, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=5, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=309, tm_isdst=0) 2023-11-05T08:29:34.551 INFO:tasks.ceph:pgid 12.9 last_scrub_stamp 2023-11-05T08:08:08.520104+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=5, tm_hour=8, tm_min=8, tm_sec=8, tm_wday=6, tm_yday=309, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=5, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=309, tm_isdst=0) 2023-11-05T08:29:34.551 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-11-05T08:07:05.115520+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=5, tm_hour=8, tm_min=7, tm_sec=5, tm_wday=6, tm_yday=309, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=5, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=309, tm_isdst=0) 2023-11-05T08:29:34.551 INFO:tasks.ceph:pgid 12.8 last_scrub_stamp 2023-11-05T08:08:08.520104+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=5, tm_hour=8, tm_min=8, tm_sec=8, tm_wday=6, tm_yday=309, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=5, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=309, tm_isdst=0) 2023-11-05T08:29:34.552 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-11-05T08:07:05.115520+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=5, tm_hour=8, tm_min=7, tm_sec=5, tm_wday=6, tm_yday=309, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=5, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=309, tm_isdst=0) 2023-11-05T08:29:34.552 INFO:tasks.ceph:pgid 12.b last_scrub_stamp 2023-11-05T08:08:08.520104+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=5, tm_hour=8, tm_min=8, tm_sec=8, tm_wday=6, tm_yday=309, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=5, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=309, tm_isdst=0) 2023-11-05T08:29:34.552 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-11-05T08:07:05.115520+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=5, tm_hour=8, tm_min=7, tm_sec=5, tm_wday=6, tm_yday=309, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=5, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=309, tm_isdst=0) 2023-11-05T08:29:34.552 INFO:tasks.ceph:pgid 12.a last_scrub_stamp 2023-11-05T08:08:08.520104+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=5, tm_hour=8, tm_min=8, tm_sec=8, tm_wday=6, tm_yday=309, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=5, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=309, tm_isdst=0) 2023-11-05T08:29:34.553 INFO:tasks.ceph:pgid 12.c last_scrub_stamp 2023-11-05T08:08:08.520104+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=5, tm_hour=8, tm_min=8, tm_sec=8, tm_wday=6, tm_yday=309, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=5, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=309, tm_isdst=0) 2023-11-05T08:29:34.553 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-11-05T08:07:05.115520+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=5, tm_hour=8, tm_min=7, tm_sec=5, tm_wday=6, tm_yday=309, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=5, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=309, tm_isdst=0) 2023-11-05T08:29:34.553 INFO:tasks.ceph:pgid 12.f last_scrub_stamp 2023-11-05T08:08:08.520104+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=5, tm_hour=8, tm_min=8, tm_sec=8, tm_wday=6, tm_yday=309, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=5, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=309, tm_isdst=0) 2023-11-05T08:29:34.554 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-11-05T08:07:05.115520+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=5, tm_hour=8, tm_min=7, tm_sec=5, tm_wday=6, tm_yday=309, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=5, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=309, tm_isdst=0) 2023-11-05T08:29:34.554 INFO:tasks.ceph:pgid 12.e last_scrub_stamp 2023-11-05T08:08:08.520104+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=5, tm_hour=8, tm_min=8, tm_sec=8, tm_wday=6, tm_yday=309, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=5, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=309, tm_isdst=0) 2023-11-05T08:29:34.554 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-11-05T08:07:05.115520+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=5, tm_hour=8, tm_min=7, tm_sec=5, tm_wday=6, tm_yday=309, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=5, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=309, tm_isdst=0) 2023-11-05T08:29:34.555 INFO:tasks.ceph:pgid 12.d last_scrub_stamp 2023-11-05T08:08:08.520104+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=5, tm_hour=8, tm_min=8, tm_sec=8, tm_wday=6, tm_yday=309, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=5, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=309, tm_isdst=0) 2023-11-05T08:29:34.555 INFO:tasks.ceph:pgid 12.7 last_scrub_stamp 2023-11-05T08:08:08.520104+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=5, tm_hour=8, tm_min=8, tm_sec=8, tm_wday=6, tm_yday=309, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=5, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=309, tm_isdst=0) 2023-11-05T08:29:34.555 INFO:tasks.ceph:pgid 12.6 last_scrub_stamp 2023-11-05T08:08:08.520104+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=5, tm_hour=8, tm_min=8, tm_sec=8, tm_wday=6, tm_yday=309, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=5, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=309, tm_isdst=0) 2023-11-05T08:29:34.556 INFO:tasks.ceph:pgid 12.5 last_scrub_stamp 2023-11-05T08:08:08.520104+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=5, tm_hour=8, tm_min=8, tm_sec=8, tm_wday=6, tm_yday=309, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=5, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=309, tm_isdst=0) 2023-11-05T08:29:34.556 INFO:tasks.ceph:pgid 12.4 last_scrub_stamp 2023-11-05T08:08:08.520104+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=5, tm_hour=8, tm_min=8, tm_sec=8, tm_wday=6, tm_yday=309, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=5, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=309, tm_isdst=0) 2023-11-05T08:29:34.556 INFO:tasks.ceph:pgid 12.3 last_scrub_stamp 2023-11-05T08:08:08.520104+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=5, tm_hour=8, tm_min=8, tm_sec=8, tm_wday=6, tm_yday=309, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=5, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=309, tm_isdst=0) 2023-11-05T08:29:34.556 INFO:tasks.ceph:pgid 12.2 last_scrub_stamp 2023-11-05T08:08:08.520104+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=5, tm_hour=8, tm_min=8, tm_sec=8, tm_wday=6, tm_yday=309, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=5, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=309, tm_isdst=0) 2023-11-05T08:29:34.557 INFO:tasks.ceph:pgid 12.1 last_scrub_stamp 2023-11-05T08:08:08.520104+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=5, tm_hour=8, tm_min=8, tm_sec=8, tm_wday=6, tm_yday=309, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=5, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=309, tm_isdst=0) 2023-11-05T08:29:34.557 INFO:tasks.ceph:pgid 12.0 last_scrub_stamp 2023-11-05T08:08:08.520104+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=5, tm_hour=8, tm_min=8, tm_sec=8, tm_wday=6, tm_yday=309, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=5, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=309, tm_isdst=0) 2023-11-05T08:29:34.557 INFO:tasks.ceph:pgid 12.1f last_scrub_stamp 2023-11-05T08:08:08.520104+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=5, tm_hour=8, tm_min=8, tm_sec=8, tm_wday=6, tm_yday=309, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=5, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=309, tm_isdst=0) 2023-11-05T08:29:34.558 INFO:tasks.ceph:pgid 12.1e last_scrub_stamp 2023-11-05T08:08:08.520104+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=5, tm_hour=8, tm_min=8, tm_sec=8, tm_wday=6, tm_yday=309, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=5, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=309, tm_isdst=0) 2023-11-05T08:29:34.558 INFO:tasks.ceph:pgid 12.1d last_scrub_stamp 2023-11-05T08:08:08.520104+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=5, tm_hour=8, tm_min=8, tm_sec=8, tm_wday=6, tm_yday=309, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=5, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=309, tm_isdst=0) 2023-11-05T08:29:34.558 INFO:tasks.ceph:pgid 12.1c last_scrub_stamp 2023-11-05T08:08:08.520104+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=5, tm_hour=8, tm_min=8, tm_sec=8, tm_wday=6, tm_yday=309, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=5, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=309, tm_isdst=0) 2023-11-05T08:29:34.559 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-05T08:29:41.436 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:23:44.552 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:29:41.442 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:23:44.558 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:29:41.467 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:23:44.583 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:29:41.485 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:23:44.559 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:29:41.487 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:23:44.562 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:29:41.496 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:23:44.612 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:29:41.500 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:23:44.616 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:29:41.504 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:23:44.578 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:29:41.521 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:23:44.637 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:29:51.467 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:23:54.582 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:29:51.470 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:23:54.586 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:29:51.487 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:23:54.603 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:29:51.518 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:23:54.593 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:29:51.519 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:23:54.635 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:29:51.523 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:23:54.639 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:29:51.523 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:23:54.598 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:29:51.540 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:23:54.614 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:29:51.544 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:23:54.660 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:29:52.161 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:23:55.235 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:29:52.162 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:23:55.236 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:29:52.169 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:23:55.244 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:29:52.190 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:23:55.305 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:29:52.191 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:23:55.307 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:29:52.199 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:23:55.314 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:29:52.227 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:23:55.342 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:29:52.228 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:23:55.344 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:29:52.236 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:23:55.352 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:29:54.560 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-05T08:29:54.671 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.670+0000 7fe845c75640 10 monclient: get_monmap_and_config 2023-11-05T08:29:54.672 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.670+0000 7fe845c75640 10 monclient: build_initial_monmap 2023-11-05T08:29:54.672 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.670+0000 7fe845c75640 10 monclient: monmap: 2023-11-05T08:29:54.672 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:29:54.673 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:54.673 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:29:54.672351+0000 2023-11-05T08:29:54.673 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:29:54.672351+0000 2023-11-05T08:29:54.673 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:29:54.674 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:54.674 INFO:teuthology.orchestra.run.smithi052.stderr:0: v1:172.21.15.52:6789/0 mon.noname-a-legacy 2023-11-05T08:29:54.674 INFO:teuthology.orchestra.run.smithi052.stderr:1: v1:172.21.15.156:6789/0 mon.noname-c-legacy 2023-11-05T08:29:54.674 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-b 2023-11-05T08:29:54.675 INFO:teuthology.orchestra.run.smithi052.stderr:3: v2:172.21.15.52:3300/0 mon.noname-a 2023-11-05T08:29:54.675 INFO:teuthology.orchestra.run.smithi052.stderr:4: v2:172.21.15.156:3300/0 mon.noname-c 2023-11-05T08:29:54.675 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:54.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.671+0000 7fe845c75640 1 Processor -- start 2023-11-05T08:29:54.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.671+0000 7fe845c75640 1 -- start start 2023-11-05T08:29:54.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.671+0000 7fe845c75640 10 monclient: init 2023-11-05T08:29:54.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.672+0000 7fe845c75640 10 monclient: _reopen_session rank -1 2023-11-05T08:29:54.679 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.672+0000 7fe845c75640 10 monclient: _add_conns ranks=[0,3,1,4,2] 2023-11-05T08:29:54.679 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.672+0000 7fe845c75640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fe840065d60 addr v1:172.21.15.52:6789/0 2023-11-05T08:29:54.679 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.672+0000 7fe845c75640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe840071940 0x7fe8401453a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:54.679 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.672+0000 7fe845c75640 10 monclient(hunting): picked mon.noname-a con 0x7fe840071940 addr v2:172.21.15.52:3300/0 2023-11-05T08:29:54.680 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.672+0000 7fe845c75640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fe8400b2260 addr v1:172.21.15.156:6789/0 2023-11-05T08:29:54.680 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.672+0000 7fe845c75640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe840141a40 con 0x7fe840065d60 2023-11-05T08:29:54.680 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.672+0000 7fe845c75640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe84006e930 con 0x7fe8400b2260 2023-11-05T08:29:54.680 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.672+0000 7fe845c75640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:54.681 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.672+0000 7fe845c75640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8400b27d0 con 0x7fe840071940 2023-11-05T08:29:54.681 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.672+0000 7fe845c75640 10 monclient(hunting): _renew_subs 2023-11-05T08:29:54.681 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.672+0000 7fe845c75640 10 monclient(hunting): authenticate will time out at 2740.878221s 2023-11-05T08:29:54.681 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.673+0000 7fe83ffff640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fe8400b2260 0x7fe8401458e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.52:48086/0 (socket says 172.21.15.52:48086) 2023-11-05T08:29:54.681 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.673+0000 7fe83ffff640 1 -- 172.21.15.52:0/3207158586 learned_addr learned my addr 172.21.15.52:0/3207158586 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-11-05T08:29:54.682 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.673+0000 7fe83effd640 1 --2- 172.21.15.52:0/3207158586 >> v2:172.21.15.52:3300/0 conn(0x7fe840071940 0x7fe8401453a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:54.682 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.674+0000 7fe83effd640 10 monclient(hunting): get_auth_request con 0x7fe840071940 auth_method 0 2023-11-05T08:29:54.682 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.674+0000 7fe83effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:29:54.682 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.674+0000 7fe83effd640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:29:54.683 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.674+0000 7fe83effd640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:29:54.683 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.674+0000 7fe83effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:29:54.683 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.674+0000 7fe83effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:29:54.683 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.674+0000 7fe83effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:29:54.683 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.675+0000 7fe83e7fc640 1 -- 172.21.15.52:0/3207158586 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3242842215 0 0) 0x7fe84006e930 con 0x7fe8400b2260 2023-11-05T08:29:54.684 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.675+0000 7fe83e7fc640 10 monclient(hunting): _negotiate 2023-11-05T08:29:54.684 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.675+0000 7fe83e7fc640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:29:54.684 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.675+0000 7fe83e7fc640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:29:54.684 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.675+0000 7fe83e7fc640 10 monclient(hunting): my global_id is 20779 2023-11-05T08:29:54.684 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.675+0000 7fe83e7fc640 1 -- 172.21.15.52:0/3207158586 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe828003520 con 0x7fe8400b2260 2023-11-05T08:29:54.685 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.676+0000 7fe83effd640 10 monclient(hunting): handle_auth_done global_id 15771 payload 274 2023-11-05T08:29:54.685 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.676+0000 7fe83effd640 1 -- 172.21.15.52:0/3207158586 >> v1:172.21.15.156:6789/0 conn(0x7fe8400b2260 legacy=0x7fe8401458e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:54.685 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.676+0000 7fe83effd640 1 -- 172.21.15.52:0/3207158586 >> v1:172.21.15.52:6789/0 conn(0x7fe840065d60 legacy=0x7fe840071230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:54.685 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.676+0000 7fe83effd640 10 monclient: _finish_hunting 0 2023-11-05T08:29:54.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.676+0000 7fe83effd640 1 monclient: found mon.noname-a 2023-11-05T08:29:54.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.676+0000 7fe83effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:29:54.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.676+0000 7fe83effd640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.52:3300/0 2023-11-05T08:29:54.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.676+0000 7fe83effd640 1 -- 172.21.15.52:0/3207158586 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8400b3190 con 0x7fe840071940 2023-11-05T08:29:54.692 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.680+0000 7fe83effd640 1 --2- 172.21.15.52:0/3207158586 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe840071940 0x7fe8401453a0 secure :-1 s=READY pgs=3067 cs=0 l=1 rev1=1 crypto rx=0x7fe8340097a0 tx=0x7fe83402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec8cda7af487dd55 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:29:54.692 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.684+0000 7fe83e7fc640 1 -- 172.21.15.52:0/3207158586 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe834031830 con 0x7fe840071940 2023-11-05T08:29:54.692 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.684+0000 7fe83e7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:29:54.692 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.684+0000 7fe83e7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-11-05T08:29:54.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.684+0000 7fe83e7fc640 10 monclient: dump: 2023-11-05T08:29:54.693 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:29:54.693 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:54.693 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:54.693 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:54.694 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:29:54.694 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:54.694 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:29:54.694 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:29:54.694 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:29:54.695 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:54.695 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.684+0000 7fe83e7fc640 10 monclient: _finish_auth 0 2023-11-05T08:29:54.695 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.684+0000 7fe83e7fc640 10 monclient: _check_auth_tickets 2023-11-05T08:29:54.695 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.684+0000 7fe83e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:29:54.695 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.684+0000 7fe845c75640 5 monclient: authenticate success, global_id 15771 2023-11-05T08:29:54.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.684+0000 7fe845c75640 20 monclient: get_monmap_and_config waiting for monmap|config 2023-11-05T08:29:54.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.685+0000 7fe83e7fc640 1 -- 172.21.15.52:0/3207158586 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe834031990 con 0x7fe840071940 2023-11-05T08:29:54.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.685+0000 7fe83e7fc640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:29:54.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.685+0000 7fe845c75640 10 monclient: get_monmap_and_config success 2023-11-05T08:29:54.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.685+0000 7fe83e7fc640 1 -- 172.21.15.52:0/3207158586 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe834031d00 con 0x7fe840071940 2023-11-05T08:29:54.697 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.685+0000 7fe845c75640 4 set_mon_vals no callback set 2023-11-05T08:29:54.697 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.685+0000 7fe83e7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:29:54.697 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.685+0000 7fe83e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-11-05T08:29:54.697 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.685+0000 7fe83e7fc640 10 monclient: dump: 2023-11-05T08:29:54.697 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:29:54.697 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:54.698 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:54.698 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:54.698 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:29:54.698 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:54.699 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:29:54.699 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:29:54.699 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:29:54.699 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:54.699 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.685+0000 7fe845c75640 10 monclient: shutdown 2023-11-05T08:29:54.700 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.685+0000 7fe845c75640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:29:54.700 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.685+0000 7fe845c75640 1 -- 172.21.15.52:0/3207158586 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe840071940 msgr2=0x7fe8401453a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:54.700 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.685+0000 7fe845c75640 1 --2- 172.21.15.52:0/3207158586 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe840071940 0x7fe8401453a0 secure :-1 s=READY pgs=3067 cs=0 l=1 rev1=1 crypto rx=0x7fe8340097a0 tx=0x7fe83402b8d0 comp rx=0 tx=0).stop 2023-11-05T08:29:54.700 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.685+0000 7fe845c75640 1 -- 172.21.15.52:0/3207158586 shutdown_connections 2023-11-05T08:29:54.700 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.685+0000 7fe845c75640 1 --2- 172.21.15.52:0/3207158586 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe840071940 0x7fe8401453a0 unknown :-1 s=CLOSED pgs=3067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:54.701 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.685+0000 7fe845c75640 1 -- 172.21.15.52:0/3207158586 >> 172.21.15.52:0/3207158586 conn(0x7fe8400b36e0 msgr2=0x7fe8400b3af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:29:54.701 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.685+0000 7fe845c75640 1 -- 172.21.15.52:0/3207158586 shutdown_connections 2023-11-05T08:29:54.701 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.685+0000 7fe845c75640 1 -- 172.21.15.52:0/3207158586 wait complete. 2023-11-05T08:29:54.701 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.686+0000 7fe845c75640 10 monclient: build_initial_monmap 2023-11-05T08:29:54.701 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.686+0000 7fe845c75640 10 monclient: monmap: 2023-11-05T08:29:54.702 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:29:54.702 INFO:teuthology.orchestra.run.smithi052.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-05T08:29:54.702 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 0.000000 2023-11-05T08:29:54.702 INFO:teuthology.orchestra.run.smithi052.stderr:created 0.000000 2023-11-05T08:29:54.703 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:29:54.703 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:54.703 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.noname-a 2023-11-05T08:29:54.703 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.noname-b 2023-11-05T08:29:54.703 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-c 2023-11-05T08:29:54.704 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:54.704 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.686+0000 7fe845c75640 1 librados: starting msgr at 2023-11-05T08:29:54.704 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.686+0000 7fe845c75640 1 librados: starting objecter 2023-11-05T08:29:54.704 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.686+0000 7fe845c75640 1 Processor -- start 2023-11-05T08:29:54.704 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.687+0000 7fe845c75640 1 -- start start 2023-11-05T08:29:54.705 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.687+0000 7fe845c75640 1 librados: setting wanted keys 2023-11-05T08:29:54.705 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.687+0000 7fe845c75640 1 librados: calling monclient init 2023-11-05T08:29:54.705 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.687+0000 7fe845c75640 10 monclient: init 2023-11-05T08:29:54.705 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.687+0000 7fe845c75640 10 monclient: _reopen_session rank -1 2023-11-05T08:29:54.705 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.687+0000 7fe845c75640 10 monclient: _add_conns ranks=[0,1,2] 2023-11-05T08:29:54.706 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.687+0000 7fe845c75640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe840065d60 0x7fe8401406b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:54.706 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.687+0000 7fe845c75640 10 monclient(hunting): picked mon.noname-a con 0x7fe840065d60 addr [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] 2023-11-05T08:29:54.706 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.687+0000 7fe845c75640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe840071940 0x7fe8401d9840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:54.706 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.687+0000 7fe845c75640 10 monclient(hunting): picked mon.noname-b con 0x7fe840071940 addr [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] 2023-11-05T08:29:54.706 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.687+0000 7fe845c75640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe8400b2260 0x7fe8401d9d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:54.707 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.687+0000 7fe845c75640 10 monclient(hunting): picked mon.noname-c con 0x7fe8400b2260 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:29:54.707 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.687+0000 7fe845c75640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:54.707 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.687+0000 7fe845c75640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe84013fb30 con 0x7fe840065d60 2023-11-05T08:29:54.707 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.687+0000 7fe845c75640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:54.707 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.687+0000 7fe845c75640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe840143040 con 0x7fe840071940 2023-11-05T08:29:54.708 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.687+0000 7fe845c75640 10 monclient(hunting): start opening mon connection 2023-11-05T08:29:54.708 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.687+0000 7fe845c75640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe840140c30 con 0x7fe8400b2260 2023-11-05T08:29:54.708 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.687+0000 7fe845c75640 10 monclient(hunting): _renew_subs 2023-11-05T08:29:54.708 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.687+0000 7fe845c75640 10 monclient(hunting): authenticate will time out at 2740.893580s 2023-11-05T08:29:54.708 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.688+0000 7fe83f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe840065d60 0x7fe8401406b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:54.709 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.688+0000 7fe83effd640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe840071940 0x7fe8401d9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:54.709 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.688+0000 7fe83ffff640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe8400b2260 0x7fe8401d9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:54.709 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.688+0000 7fe83f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe840065d60 0x7fe8401406b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54352/0 (socket says 172.21.15.52:54352) 2023-11-05T08:29:54.709 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.688+0000 7fe83f7fe640 1 -- 172.21.15.52:0/3613518970 learned_addr learned my addr 172.21.15.52:0/3613518970 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-11-05T08:29:54.709 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.688+0000 7fe83f7fe640 10 monclient(hunting): get_auth_request con 0x7fe840065d60 auth_method 0 2023-11-05T08:29:54.710 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.688+0000 7fe83f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:29:54.710 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.688+0000 7fe83effd640 1 --2- 172.21.15.52:0/3613518970 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe840071940 0x7fe8401d9840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.52:60386/0 (socket says 172.21.15.52:60386) 2023-11-05T08:29:54.710 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.688+0000 7fe83f7fe640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:29:54.710 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.688+0000 7fe83f7fe640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:29:54.710 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.688+0000 7fe83effd640 10 monclient(hunting): get_auth_request con 0x7fe840071940 auth_method 0 2023-11-05T08:29:54.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.688+0000 7fe83effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:29:54.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.688+0000 7fe83effd640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:29:54.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.688+0000 7fe83effd640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:29:54.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.688+0000 7fe83ffff640 10 monclient(hunting): get_auth_request con 0x7fe8400b2260 auth_method 0 2023-11-05T08:29:54.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.688+0000 7fe83ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:29:54.712 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.688+0000 7fe83ffff640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:29:54.712 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.688+0000 7fe83ffff640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:29:54.712 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.688+0000 7fe83effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:29:54.712 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.688+0000 7fe83effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:29:54.712 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.688+0000 7fe83effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:29:54.712 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.689+0000 7fe83f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:29:54.713 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.689+0000 7fe83f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:29:54.713 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.689+0000 7fe83f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:29:54.713 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.689+0000 7fe83ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:29:54.713 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.689+0000 7fe83ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:29:54.713 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.689+0000 7fe83ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:29:54.715 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.691+0000 7fe83effd640 10 monclient(hunting): handle_auth_done global_id 20782 payload 824 2023-11-05T08:29:54.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.691+0000 7fe83effd640 1 -- 172.21.15.52:0/3613518970 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe8400b2260 msgr2=0x7fe8401d9d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:54.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.691+0000 7fe83effd640 1 --2- 172.21.15.52:0/3613518970 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe8400b2260 0x7fe8401d9d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:54.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.691+0000 7fe83effd640 1 -- 172.21.15.52:0/3613518970 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe840065d60 msgr2=0x7fe8401406b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:54.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.691+0000 7fe83effd640 1 --2- 172.21.15.52:0/3613518970 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe840065d60 0x7fe8401406b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:54.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.691+0000 7fe83effd640 10 monclient: _finish_hunting 0 2023-11-05T08:29:54.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.691+0000 7fe83effd640 1 monclient: found mon.noname-b 2023-11-05T08:29:54.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.691+0000 7fe83effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:29:54.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.691+0000 7fe83effd640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.156:3300/0 2023-11-05T08:29:54.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.691+0000 7fe83effd640 1 -- 172.21.15.52:0/3613518970 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe834009400 con 0x7fe840071940 2023-11-05T08:29:54.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.693+0000 7fe83effd640 1 --2- 172.21.15.52:0/3613518970 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe840071940 0x7fe8401d9840 secure :-1 s=READY pgs=5028 cs=0 l=1 rev1=1 crypto rx=0x7fe834033000 tx=0x7fe8340046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:29:54.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.693+0000 7fe827fff640 10 client.?.objecter ms_handle_connect 0x7fe840071940 2023-11-05T08:29:54.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.693+0000 7fe827fff640 10 client.?.objecter resend_mon_ops 2023-11-05T08:29:54.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.697+0000 7fe827fff640 1 -- 172.21.15.52:0/3613518970 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8340042d0 con 0x7fe840071940 2023-11-05T08:29:54.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.697+0000 7fe827fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:29:54.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.697+0000 7fe827fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2023-11-05T08:29:54.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.697+0000 7fe827fff640 10 monclient: dump: 2023-11-05T08:29:54.719 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:29:54.719 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:54.719 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:54.720 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:54.720 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:29:54.720 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:54.720 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:29:54.720 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:29:54.721 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:29:54.721 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:54.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.697+0000 7fe827fff640 10 monclient: _finish_auth 0 2023-11-05T08:29:54.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.697+0000 7fe827fff640 10 monclient: _check_auth_tickets 2023-11-05T08:29:54.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.697+0000 7fe827fff640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:29:54.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.697+0000 7fe827fff640 1 -- 172.21.15.52:0/3613518970 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe834004430 con 0x7fe840071940 2023-11-05T08:29:54.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.697+0000 7fe845c75640 5 monclient: authenticate success, global_id 20782 2023-11-05T08:29:54.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.697+0000 7fe845c75640 10 monclient: _renew_subs 2023-11-05T08:29:54.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.697+0000 7fe845c75640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:29:54.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.697+0000 7fe845c75640 1 -- 172.21.15.52:0/3613518970 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe840138790 con 0x7fe840071940 2023-11-05T08:29:54.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.697+0000 7fe827fff640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:29:54.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.697+0000 7fe827fff640 1 -- 172.21.15.52:0/3613518970 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe834003830 con 0x7fe840071940 2023-11-05T08:29:54.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.697+0000 7fe827fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:29:54.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.697+0000 7fe827fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-05T08:29:54.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.697+0000 7fe827fff640 10 monclient: dump: 2023-11-05T08:29:54.723 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:29:54.724 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:29:54.724 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:54.724 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:29:54.724 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:29:54.724 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:29:54.725 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:29:54.725 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:29:54.725 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:29:54.725 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:29:54.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.697+0000 7fe845c75640 10 client.20782.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-05T08:29:54.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.697+0000 7fe845c75640 10 monclient: _renew_subs 2023-11-05T08:29:54.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.697+0000 7fe845c75640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:29:54.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.697+0000 7fe845c75640 1 -- 172.21.15.52:0/3613518970 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe840135a90 con 0x7fe840071940 2023-11-05T08:29:54.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.697+0000 7fe845c75640 1 librados: init done 2023-11-05T08:29:54.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.697+0000 7fe83dffb640 4 set_mon_vals no callback set 2023-11-05T08:29:54.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.698+0000 7fe845c75640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-05T08:29:54.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.698+0000 7fe845c75640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:29:54.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.698+0000 7fe845c75640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.156:3300/0 2023-11-05T08:29:54.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.698+0000 7fe845c75640 1 -- 172.21.15.52:0/3613518970 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe84004e9f0 con 0x7fe840071940 2023-11-05T08:29:54.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.939+0000 7fe827fff640 1 -- 172.21.15.52:0/3613518970 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe834003990 con 0x7fe840071940 2023-11-05T08:29:54.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.939+0000 7fe827fff640 1 --2- 172.21.15.52:0/3613518970 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7fe82c06c850 0x7fe82c06ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:29:54.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.939+0000 7fe83f7fe640 1 --2- 172.21.15.52:0/3613518970 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7fe82c06c850 0x7fe82c06ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:29:54.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.939+0000 7fe83f7fe640 10 monclient: get_auth_request con 0x7fe82c06c850 auth_method 0 2023-11-05T08:29:54.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.940+0000 7fe83f7fe640 1 --2- 172.21.15.52:0/3613518970 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7fe82c06c850 0x7fe82c06ed10 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fe830007fd0 tx=0x7fe830009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:29:54.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.940+0000 7fe827fff640 10 client.20782.objecter ms_handle_connect 0x7fe82c06c850 2023-11-05T08:29:54.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.941+0000 7fe827fff640 1 -- 172.21.15.52:0/3613518970 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(932..932 src has 619..932) v4 ==== 6193+0+0 (secure 0 0 0) 0x7fe83404ece0 con 0x7fe840071940 2023-11-05T08:29:54.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.941+0000 7fe827fff640 10 client.20782.objecter ms_dispatch 0x7fe840000b90 osd_map(932..932 src has 619..932) v4 2023-11-05T08:29:54.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.941+0000 7fe827fff640 3 client.20782.objecter handle_osd_map got epochs [932,932] > 0 2023-11-05T08:29:54.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.941+0000 7fe827fff640 3 client.20782.objecter handle_osd_map decoding full epoch 932 2023-11-05T08:29:54.944 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.941+0000 7fe827fff640 20 client.20782.objecter dump_active .. 0 homeless 2023-11-05T08:29:54.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.952+0000 7fe827fff640 1 -- 172.21.15.52:0/3613518970 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe834076ab0 con 0x7fe840071940 2023-11-05T08:29:54.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.952+0000 7fe827fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:29:54.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:54.952+0000 7fe827fff640 10 monclient: _finish_command 1 = system:0 2023-11-05T08:29:55.130 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:55.129+0000 7fe845c75640 1 -- 172.21.15.52:0/3613518970 --> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe840066140 con 0x7fe82c06c850 2023-11-05T08:29:55.135 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:55.134+0000 7fe827fff640 1 -- 172.21.15.52:0/3613518970 <== mgr.4108 v2:172.21.15.156:6800/3320012339 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+151620 (secure 0 0 0) 0x7fe83000f850 con 0x7fe82c06c850 2023-11-05T08:29:55.137 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:29:55.138 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2023-11-05T08:29:55.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:55.136+0000 7fe845c75640 10 librados: watch_flush enter 2023-11-05T08:29:55.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:55.136+0000 7fe845c75640 10 librados: watch_flush exit 2023-11-05T08:29:55.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:55.136+0000 7fe845c75640 20 client.20782.objecter shutdown clearing up homeless session... 2023-11-05T08:29:55.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:55.136+0000 7fe845c75640 10 client.20782.objecter successfully canceled tick 2023-11-05T08:29:55.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:55.137+0000 7fe845c75640 1 -- 172.21.15.52:0/3613518970 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7fe82c06c850 msgr2=0x7fe82c06ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:55.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:55.137+0000 7fe845c75640 1 --2- 172.21.15.52:0/3613518970 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7fe82c06c850 0x7fe82c06ed10 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fe830007fd0 tx=0x7fe830009040 comp rx=0 tx=0).stop 2023-11-05T08:29:55.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:55.137+0000 7fe845c75640 10 monclient: shutdown 2023-11-05T08:29:55.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:55.137+0000 7fe845c75640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:29:55.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:55.137+0000 7fe845c75640 1 -- 172.21.15.52:0/3613518970 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe840071940 msgr2=0x7fe8401d9840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:29:55.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:55.137+0000 7fe845c75640 1 --2- 172.21.15.52:0/3613518970 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe840071940 0x7fe8401d9840 secure :-1 s=READY pgs=5028 cs=0 l=1 rev1=1 crypto rx=0x7fe834033000 tx=0x7fe8340046c0 comp rx=0 tx=0).stop 2023-11-05T08:29:55.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:55.137+0000 7fe845c75640 1 -- 172.21.15.52:0/3613518970 shutdown_connections 2023-11-05T08:29:55.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:55.137+0000 7fe845c75640 1 --2- 172.21.15.52:0/3613518970 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7fe82c06c850 0x7fe82c06ed10 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:55.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:55.137+0000 7fe845c75640 1 --2- 172.21.15.52:0/3613518970 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe8400b2260 0x7fe8401d9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:55.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:55.137+0000 7fe845c75640 1 --2- 172.21.15.52:0/3613518970 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe840071940 0x7fe8401d9840 unknown :-1 s=CLOSED pgs=5028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:55.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:55.137+0000 7fe845c75640 1 --2- 172.21.15.52:0/3613518970 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe840065d60 0x7fe8401406b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:29:55.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:55.137+0000 7fe845c75640 1 -- 172.21.15.52:0/3613518970 >> 172.21.15.52:0/3613518970 conn(0x7fe8400b36e0 msgr2=0x7fe840139430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:29:55.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:55.137+0000 7fe845c75640 1 -- 172.21.15.52:0/3613518970 shutdown_connections 2023-11-05T08:29:55.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:55.137+0000 7fe845c75640 1 -- 172.21.15.52:0/3613518970 wait complete. 2023-11-05T08:29:55.144 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:29:55.137+0000 7fe845c75640 1 librados: shutdown 2023-11-05T08:29:55.149 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":1625,"stamp":"2023-11-05T08:29:53.487535+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459285,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":102,"num_read_kb":88,"num_write":120,"num_write_kb":1379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":86,"ondisk_log_size":86,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":522328,"kb_used_data":46680,"kb_used_omap":12,"kb_used_meta":475571,"kb_avail":754452392,"statfs":{"total":773094113280,"available":772559249408,"internally_reserved":0,"allocated":47800320,"data_stored":25897490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":486985272},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":72,"apply_latency_ms":72,"commit_latency_ns":72000000,"apply_latency_ns":72000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002583"},"pg_stats":[{"pgid":"12.10","version":"0'0","reported_seq":891,"reported_epoch":932,"state":"active+clean","last_fresh":"2023-11-05T08:29:38.803602+0000","last_change":"2023-11-05T08:29:38.804678+0000","last_active":"2023-11-05T08:29:38.803602+0000","last_peered":"2023-11-05T08:29:38.803602+0000","last_clean":"2023-11-05T08:29:38.803602+0000","last_became_active":"2023-11-05T08:08:27.684720+0000","last_became_peered":"2023-11-05T08:08:27.684720+0000","last_unstale":"2023-11-05T08:29:38.803602+0000","last_undegraded":"2023-11-05T08:29:38.803602+0000","last_fullsized":"2023-11-05T08:29:38.803602+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:29:38.802137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:29:38.802137+0000","last_clean_scrub_stamp":"2023-11-05T08:29:38.802137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T11:31:47.977381+0000","scrub_duration":0.031595362000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":890,"reported_epoch":932,"state":"active+clean","last_fresh":"2023-11-05T08:29:30.431006+0000","last_change":"2023-11-05T08:29:30.432912+0000","last_active":"2023-11-05T08:29:30.431006+0000","last_peered":"2023-11-05T08:29:30.431006+0000","last_clean":"2023-11-05T08:29:30.431006+0000","last_became_active":"2023-11-05T08:08:12.972471+0000","last_became_peered":"2023-11-05T08:08:12.972471+0000","last_unstale":"2023-11-05T08:29:30.431006+0000","last_undegraded":"2023-11-05T08:29:30.431006+0000","last_fullsized":"2023-11-05T08:29:30.431006+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:29:30.425815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:29:30.425815+0000","last_clean_scrub_stamp":"2023-11-05T08:29:30.425815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T12:04:08.852166+0000","scrub_duration":0.126394758,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":891,"reported_epoch":932,"state":"active+clean","last_fresh":"2023-11-05T08:29:33.428669+0000","last_change":"2023-11-05T08:29:33.432887+0000","last_active":"2023-11-05T08:29:33.428669+0000","last_peered":"2023-11-05T08:29:33.428669+0000","last_clean":"2023-11-05T08:29:33.428669+0000","last_became_active":"2023-11-05T08:08:20.791671+0000","last_became_peered":"2023-11-05T08:08:20.791671+0000","last_unstale":"2023-11-05T08:29:33.428669+0000","last_undegraded":"2023-11-05T08:29:33.428669+0000","last_fullsized":"2023-11-05T08:29:33.428669+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:29:33.427361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:29:33.427361+0000","last_clean_scrub_stamp":"2023-11-05T08:29:33.427361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T09:09:13.389408+0000","scrub_duration":0.036597826999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":877,"reported_epoch":932,"state":"active+clean","last_fresh":"2023-11-05T08:29:34.200496+0000","last_change":"2023-11-05T08:29:34.201646+0000","last_active":"2023-11-05T08:29:34.200496+0000","last_peered":"2023-11-05T08:29:34.200496+0000","last_clean":"2023-11-05T08:29:34.200496+0000","last_became_active":"2023-11-05T08:08:26.449074+0000","last_became_peered":"2023-11-05T08:08:26.449074+0000","last_unstale":"2023-11-05T08:29:34.200496+0000","last_undegraded":"2023-11-05T08:29:34.200496+0000","last_fullsized":"2023-11-05T08:29:34.200496+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:29:34.199020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:29:34.199020+0000","last_clean_scrub_stamp":"2023-11-05T08:29:34.199020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T09:45:25.860493+0000","scrub_duration":0.071695249000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":903,"reported_epoch":932,"state":"active+clean","last_fresh":"2023-11-05T08:29:38.447628+0000","last_change":"2023-11-05T08:29:38.448729+0000","last_active":"2023-11-05T08:29:38.447628+0000","last_peered":"2023-11-05T08:29:38.447628+0000","last_clean":"2023-11-05T08:29:38.447628+0000","last_became_active":"2023-11-05T08:08:32.275587+0000","last_became_peered":"2023-11-05T08:08:32.275587+0000","last_unstale":"2023-11-05T08:29:38.447628+0000","last_undegraded":"2023-11-05T08:29:38.447628+0000","last_fullsized":"2023-11-05T08:29:38.447628+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:29:38.446240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:29:38.446240+0000","last_clean_scrub_stamp":"2023-11-05T08:29:38.446240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T11:29:15.846147+0000","scrub_duration":0.041710653,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":889,"reported_epoch":932,"state":"active+clean","last_fresh":"2023-11-05T08:29:32.398930+0000","last_change":"2023-11-05T08:29:32.400904+0000","last_active":"2023-11-05T08:29:32.398930+0000","last_peered":"2023-11-05T08:29:32.398930+0000","last_clean":"2023-11-05T08:29:32.398930+0000","last_became_active":"2023-11-05T08:08:15.950681+0000","last_became_peered":"2023-11-05T08:08:15.950681+0000","last_unstale":"2023-11-05T08:29:32.398930+0000","last_undegraded":"2023-11-05T08:29:32.398930+0000","last_fullsized":"2023-11-05T08:29:32.398930+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:29:32.394276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:29:32.394276+0000","last_clean_scrub_stamp":"2023-11-05T08:29:32.394276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T09:27:43.113988+0000","scrub_duration":0.049562779000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":888,"reported_epoch":932,"state":"active+clean","last_fresh":"2023-11-05T08:29:49.250918+0000","last_change":"2023-11-05T08:29:49.255210+0000","last_active":"2023-11-05T08:29:49.250918+0000","last_peered":"2023-11-05T08:29:49.250918+0000","last_clean":"2023-11-05T08:29:49.250918+0000","last_became_active":"2023-11-05T08:08:24.718463+0000","last_became_peered":"2023-11-05T08:08:24.718463+0000","last_unstale":"2023-11-05T08:29:49.250918+0000","last_undegraded":"2023-11-05T08:29:49.250918+0000","last_fullsized":"2023-11-05T08:29:49.250918+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:29:49.249489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:29:49.249489+0000","last_clean_scrub_stamp":"2023-11-05T08:29:49.249489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T14:33:24.509587+0000","scrub_duration":0.047040863000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":889,"reported_epoch":932,"state":"active+clean","last_fresh":"2023-11-05T08:29:37.432923+0000","last_change":"2023-11-05T08:29:37.434877+0000","last_active":"2023-11-05T08:29:37.432923+0000","last_peered":"2023-11-05T08:29:37.432923+0000","last_clean":"2023-11-05T08:29:37.432923+0000","last_became_active":"2023-11-05T08:08:13.341684+0000","last_became_peered":"2023-11-05T08:08:13.341684+0000","last_unstale":"2023-11-05T08:29:37.432923+0000","last_undegraded":"2023-11-05T08:29:37.432923+0000","last_fullsized":"2023-11-05T08:29:37.432923+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:29:37.431369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:29:37.431369+0000","last_clean_scrub_stamp":"2023-11-05T08:29:37.431369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T09:02:09.508128+0000","scrub_duration":0.069524574000000006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":902,"reported_epoch":932,"state":"active+clean","last_fresh":"2023-11-05T08:29:35.480444+0000","last_change":"2023-11-05T08:29:35.481475+0000","last_active":"2023-11-05T08:29:35.480444+0000","last_peered":"2023-11-05T08:29:35.480444+0000","last_clean":"2023-11-05T08:29:35.480444+0000","last_became_active":"2023-11-05T08:08:15.520030+0000","last_became_peered":"2023-11-05T08:08:15.520030+0000","last_unstale":"2023-11-05T08:29:35.480444+0000","last_undegraded":"2023-11-05T08:29:35.480444+0000","last_fullsized":"2023-11-05T08:29:35.480444+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:29:35.479100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:29:35.479100+0000","last_clean_scrub_stamp":"2023-11-05T08:29:35.479100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T10:58:24.058054+0000","scrub_duration":0.042875719,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":902,"reported_epoch":932,"state":"active+clean","last_fresh":"2023-11-05T08:29:37.541118+0000","last_change":"2023-11-05T08:29:37.542149+0000","last_active":"2023-11-05T08:29:37.541118+0000","last_peered":"2023-11-05T08:29:37.541118+0000","last_clean":"2023-11-05T08:29:37.541118+0000","last_became_active":"2023-11-05T08:08:15.871149+0000","last_became_peered":"2023-11-05T08:08:15.871149+0000","last_unstale":"2023-11-05T08:29:37.541118+0000","last_undegraded":"2023-11-05T08:29:37.541118+0000","last_fullsized":"2023-11-05T08:29:37.541118+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:29:37.539742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:29:37.539742+0000","last_clean_scrub_stamp":"2023-11-05T08:29:37.539742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T10:38:29.237901+0000","scrub_duration":0.067395031999999994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":889,"reported_epoch":932,"state":"active+clean","last_fresh":"2023-11-05T08:29:34.401334+0000","last_change":"2023-11-05T08:29:34.403298+0000","last_active":"2023-11-05T08:29:34.401334+0000","last_peered":"2023-11-05T08:29:34.401334+0000","last_clean":"2023-11-05T08:29:34.401334+0000","last_became_active":"2023-11-05T08:08:14.060255+0000","last_became_peered":"2023-11-05T08:08:14.060255+0000","last_unstale":"2023-11-05T08:29:34.401334+0000","last_undegraded":"2023-11-05T08:29:34.401334+0000","last_fullsized":"2023-11-05T08:29:34.401334+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:29:34.396928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:29:34.396928+0000","last_clean_scrub_stamp":"2023-11-05T08:29:34.396928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T16:18:33.820915+0000","scrub_duration":0.051130529000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":902,"reported_epoch":932,"state":"active+clean","last_fresh":"2023-11-05T08:29:36.460111+0000","last_change":"2023-11-05T08:29:36.461711+0000","last_active":"2023-11-05T08:29:36.460111+0000","last_peered":"2023-11-05T08:29:36.460111+0000","last_clean":"2023-11-05T08:29:36.460111+0000","last_became_active":"2023-11-05T08:08:15.726426+0000","last_became_peered":"2023-11-05T08:08:15.726426+0000","last_unstale":"2023-11-05T08:29:36.460111+0000","last_undegraded":"2023-11-05T08:29:36.460111+0000","last_fullsized":"2023-11-05T08:29:36.460111+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:29:36.458598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:29:36.458598+0000","last_clean_scrub_stamp":"2023-11-05T08:29:36.458598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T16:07:19.373018+0000","scrub_duration":0.087798622000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":892,"reported_epoch":932,"state":"active+clean","last_fresh":"2023-11-05T08:29:48.902826+0000","last_change":"2023-11-05T08:29:48.904021+0000","last_active":"2023-11-05T08:29:48.902826+0000","last_peered":"2023-11-05T08:29:48.902826+0000","last_clean":"2023-11-05T08:29:48.902826+0000","last_became_active":"2023-11-05T08:07:07.890422+0000","last_became_peered":"2023-11-05T08:07:07.890422+0000","last_unstale":"2023-11-05T08:29:48.902826+0000","last_undegraded":"2023-11-05T08:29:48.902826+0000","last_fullsized":"2023-11-05T08:29:48.902826+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:29:48.901297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:29:48.901297+0000","last_clean_scrub_stamp":"2023-11-05T08:29:48.901297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T14:00:43.952211+0000","scrub_duration":0.040935908,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":883,"reported_epoch":932,"state":"active+clean","last_fresh":"2023-11-05T08:29:22.606678+0000","last_change":"2023-11-05T08:08:38.368346+0000","last_active":"2023-11-05T08:29:22.606678+0000","last_peered":"2023-11-05T08:29:22.606678+0000","last_clean":"2023-11-05T08:29:22.606678+0000","last_became_active":"2023-11-05T08:08:38.362716+0000","last_became_peered":"2023-11-05T08:08:38.362716+0000","last_unstale":"2023-11-05T08:29:22.606678+0000","last_undegraded":"2023-11-05T08:29:22.606678+0000","last_fullsized":"2023-11-05T08:29:22.606678+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":896,"reported_epoch":932,"state":"active+clean","last_fresh":"2023-11-05T08:29:31.503474+0000","last_change":"2023-11-05T08:29:31.504598+0000","last_active":"2023-11-05T08:29:31.503474+0000","last_peered":"2023-11-05T08:29:31.503474+0000","last_clean":"2023-11-05T08:29:31.503474+0000","last_became_active":"2023-11-05T08:07:07.908128+0000","last_became_peered":"2023-11-05T08:07:07.908128+0000","last_unstale":"2023-11-05T08:29:31.503474+0000","last_undegraded":"2023-11-05T08:29:31.503474+0000","last_fullsized":"2023-11-05T08:29:31.503474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:29:31.502049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:29:31.502049+0000","last_clean_scrub_stamp":"2023-11-05T08:29:31.502049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T10:22:38.526293+0000","scrub_duration":0.042385156,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":903,"reported_epoch":932,"state":"active+clean","last_fresh":"2023-11-05T08:29:36.492479+0000","last_change":"2023-11-05T08:29:36.493529+0000","last_active":"2023-11-05T08:29:36.492479+0000","last_peered":"2023-11-05T08:29:36.492479+0000","last_clean":"2023-11-05T08:29:36.492479+0000","last_became_active":"2023-11-05T08:08:12.653053+0000","last_became_peered":"2023-11-05T08:08:12.653053+0000","last_unstale":"2023-11-05T08:29:36.492479+0000","last_undegraded":"2023-11-05T08:29:36.492479+0000","last_fullsized":"2023-11-05T08:29:36.492479+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:29:36.491096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:29:36.491096+0000","last_clean_scrub_stamp":"2023-11-05T08:29:36.491096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T12:45:52.709010+0000","scrub_duration":0.031561842999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":893,"reported_epoch":932,"state":"active+clean","last_fresh":"2023-11-05T08:29:50.991040+0000","last_change":"2023-11-05T08:29:50.992283+0000","last_active":"2023-11-05T08:29:50.991040+0000","last_peered":"2023-11-05T08:29:50.991040+0000","last_clean":"2023-11-05T08:29:50.991040+0000","last_became_active":"2023-11-05T08:07:07.203649+0000","last_became_peered":"2023-11-05T08:07:07.203649+0000","last_unstale":"2023-11-05T08:29:50.991040+0000","last_undegraded":"2023-11-05T08:29:50.991040+0000","last_fullsized":"2023-11-05T08:29:50.991040+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:29:50.989398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:29:50.989398+0000","last_clean_scrub_stamp":"2023-11-05T08:29:50.989398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T18:26:10.921614+0000","scrub_duration":0.032530934999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":903,"reported_epoch":932,"state":"active+clean","last_fresh":"2023-11-05T08:29:40.454986+0000","last_change":"2023-11-05T08:29:40.456131+0000","last_active":"2023-11-05T08:29:40.454986+0000","last_peered":"2023-11-05T08:29:40.454986+0000","last_clean":"2023-11-05T08:29:40.454986+0000","last_became_active":"2023-11-05T08:08:14.900486+0000","last_became_peered":"2023-11-05T08:08:14.900486+0000","last_unstale":"2023-11-05T08:29:40.454986+0000","last_undegraded":"2023-11-05T08:29:40.454986+0000","last_fullsized":"2023-11-05T08:29:40.454986+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:29:40.453475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:29:40.453475+0000","last_clean_scrub_stamp":"2023-11-05T08:29:40.453475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T17:53:53.051827+0000","scrub_duration":0.066750676999999994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":883,"reported_epoch":932,"state":"active+clean","last_fresh":"2023-11-05T08:29:32.176465+0000","last_change":"2023-11-05T08:29:32.177635+0000","last_active":"2023-11-05T08:29:32.176465+0000","last_peered":"2023-11-05T08:29:32.176465+0000","last_clean":"2023-11-05T08:29:32.176465+0000","last_became_active":"2023-11-05T08:07:07.371569+0000","last_became_peered":"2023-11-05T08:07:07.371569+0000","last_unstale":"2023-11-05T08:29:32.176465+0000","last_undegraded":"2023-11-05T08:29:32.176465+0000","last_fullsized":"2023-11-05T08:29:32.176465+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:29:32.174890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:29:32.174890+0000","last_clean_scrub_stamp":"2023-11-05T08:29:32.174890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T16:16:49.502047+0000","scrub_duration":0.044826601000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":892,"reported_epoch":932,"state":"active+clean","last_fresh":"2023-11-05T08:29:34.443954+0000","last_change":"2023-11-05T08:29:34.445121+0000","last_active":"2023-11-05T08:29:34.443954+0000","last_peered":"2023-11-05T08:29:34.443954+0000","last_clean":"2023-11-05T08:29:34.443954+0000","last_became_active":"2023-11-05T08:08:29.207330+0000","last_became_peered":"2023-11-05T08:08:29.207330+0000","last_unstale":"2023-11-05T08:29:34.443954+0000","last_undegraded":"2023-11-05T08:29:34.443954+0000","last_fullsized":"2023-11-05T08:29:34.443954+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:29:34.440439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:29:34.440439+0000","last_clean_scrub_stamp":"2023-11-05T08:29:34.440439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T12:11:03.179049+0000","scrub_duration":0.054252294999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":893,"reported_epoch":932,"state":"active+clean","last_fresh":"2023-11-05T08:29:30.829377+0000","last_change":"2023-11-05T08:29:30.830783+0000","last_active":"2023-11-05T08:29:30.829377+0000","last_peered":"2023-11-05T08:29:30.829377+0000","last_clean":"2023-11-05T08:29:30.829377+0000","last_became_active":"2023-11-05T08:07:07.344890+0000","last_became_peered":"2023-11-05T08:07:07.344890+0000","last_unstale":"2023-11-05T08:29:30.829377+0000","last_undegraded":"2023-11-05T08:29:30.829377+0000","last_fullsized":"2023-11-05T08:29:30.829377+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:29:30.827954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:29:30.827954+0000","last_clean_scrub_stamp":"2023-11-05T08:29:30.827954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T12:02:27.062242+0000","scrub_duration":0.032635201000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":903,"reported_epoch":932,"state":"active+clean","last_fresh":"2023-11-05T08:29:46.435193+0000","last_change":"2023-11-05T08:29:46.436253+0000","last_active":"2023-11-05T08:29:46.435193+0000","last_peered":"2023-11-05T08:29:46.435193+0000","last_clean":"2023-11-05T08:29:46.435193+0000","last_became_active":"2023-11-05T08:08:16.927690+0000","last_became_peered":"2023-11-05T08:08:16.927690+0000","last_unstale":"2023-11-05T08:29:46.435193+0000","last_undegraded":"2023-11-05T08:29:46.435193+0000","last_fullsized":"2023-11-05T08:29:46.435193+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:29:46.433710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:29:46.433710+0000","last_clean_scrub_stamp":"2023-11-05T08:29:46.433710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T11:23:13.289760+0000","scrub_duration":0.038577383,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":908,"reported_epoch":932,"state":"active+clean","last_fresh":"2023-11-05T08:29:34.471422+0000","last_change":"2023-11-05T08:29:34.475367+0000","last_active":"2023-11-05T08:29:34.471422+0000","last_peered":"2023-11-05T08:29:34.471422+0000","last_clean":"2023-11-05T08:29:34.471422+0000","last_became_active":"2023-11-05T08:07:07.051923+0000","last_became_peered":"2023-11-05T08:07:07.051923+0000","last_unstale":"2023-11-05T08:29:34.471422+0000","last_undegraded":"2023-11-05T08:29:34.471422+0000","last_fullsized":"2023-11-05T08:29:34.471422+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:29:34.468719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:29:34.468719+0000","last_clean_scrub_stamp":"2023-11-05T08:29:34.468719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T16:55:38.996611+0000","scrub_duration":0.058392312000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":879,"reported_epoch":932,"state":"active+clean","last_fresh":"2023-11-05T08:29:22.675181+0000","last_change":"2023-11-05T08:08:32.728546+0000","last_active":"2023-11-05T08:29:22.675181+0000","last_peered":"2023-11-05T08:29:22.675181+0000","last_clean":"2023-11-05T08:29:22.675181+0000","last_became_active":"2023-11-05T08:08:32.722827+0000","last_became_peered":"2023-11-05T08:08:32.722827+0000","last_unstale":"2023-11-05T08:29:22.675181+0000","last_undegraded":"2023-11-05T08:29:22.675181+0000","last_fullsized":"2023-11-05T08:29:22.675181+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":894,"reported_epoch":932,"state":"active+clean","last_fresh":"2023-11-05T08:29:38.934365+0000","last_change":"2023-11-05T08:29:38.938707+0000","last_active":"2023-11-05T08:29:38.934365+0000","last_peered":"2023-11-05T08:29:38.934365+0000","last_clean":"2023-11-05T08:29:38.934365+0000","last_became_active":"2023-11-05T08:07:07.131650+0000","last_became_peered":"2023-11-05T08:07:07.131650+0000","last_unstale":"2023-11-05T08:29:38.934365+0000","last_undegraded":"2023-11-05T08:29:38.934365+0000","last_fullsized":"2023-11-05T08:29:38.934365+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:29:38.932942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:29:38.932942+0000","last_clean_scrub_stamp":"2023-11-05T08:29:38.932942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T17:15:19.926170+0000","scrub_duration":0.032186171999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":903,"reported_epoch":932,"state":"active+clean","last_fresh":"2023-11-05T08:29:49.423773+0000","last_change":"2023-11-05T08:29:49.424926+0000","last_active":"2023-11-05T08:29:49.423773+0000","last_peered":"2023-11-05T08:29:49.423773+0000","last_clean":"2023-11-05T08:29:49.423773+0000","last_became_active":"2023-11-05T08:08:13.848417+0000","last_became_peered":"2023-11-05T08:08:13.848417+0000","last_unstale":"2023-11-05T08:29:49.423773+0000","last_undegraded":"2023-11-05T08:29:49.423773+0000","last_fullsized":"2023-11-05T08:29:49.423773+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:29:49.422231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:29:49.422231+0000","last_clean_scrub_stamp":"2023-11-05T08:29:49.422231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T16:46:18.275715+0000","scrub_duration":0.048981812,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":893,"reported_epoch":932,"state":"active+clean","last_fresh":"2023-11-05T08:29:43.872559+0000","last_change":"2023-11-05T08:29:43.873822+0000","last_active":"2023-11-05T08:29:43.872559+0000","last_peered":"2023-11-05T08:29:43.872559+0000","last_clean":"2023-11-05T08:29:43.872559+0000","last_became_active":"2023-11-05T08:07:07.467692+0000","last_became_peered":"2023-11-05T08:07:07.467692+0000","last_unstale":"2023-11-05T08:29:43.872559+0000","last_undegraded":"2023-11-05T08:29:43.872559+0000","last_fullsized":"2023-11-05T08:29:43.872559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:29:43.870857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:29:43.870857+0000","last_clean_scrub_stamp":"2023-11-05T08:29:43.870857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T19:59:25.342378+0000","scrub_duration":0.038336596000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"932'78","reported_seq":1005,"reported_epoch":932,"state":"active+clean","last_fresh":"2023-11-05T08:29:29.568069+0000","last_change":"2023-11-05T08:29:29.570254+0000","last_active":"2023-11-05T08:29:29.568069+0000","last_peered":"2023-11-05T08:29:29.568069+0000","last_clean":"2023-11-05T08:29:29.568069+0000","last_became_active":"2023-11-05T08:07:00.966209+0000","last_became_peered":"2023-11-05T08:07:00.966209+0000","last_unstale":"2023-11-05T08:29:29.568069+0000","last_undegraded":"2023-11-05T08:29:29.568069+0000","last_fullsized":"2023-11-05T08:29:29.568069+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"932'78","last_scrub_stamp":"2023-11-05T08:29:29.566570+0000","last_deep_scrub":"932'78","last_deep_scrub_stamp":"2023-11-05T08:29:29.566570+0000","last_clean_scrub_stamp":"2023-11-05T08:29:29.566570+0000","objects_scrubbed":2,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T11:16:16.599985+0000","scrub_duration":0.22732221699999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":113,"num_write_kb":1372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":880,"reported_epoch":932,"state":"active+clean","last_fresh":"2023-11-05T08:29:22.664565+0000","last_change":"2023-11-05T08:08:16.483616+0000","last_active":"2023-11-05T08:29:22.664565+0000","last_peered":"2023-11-05T08:29:22.664565+0000","last_clean":"2023-11-05T08:29:22.664565+0000","last_became_active":"2023-11-05T08:08:16.476624+0000","last_became_peered":"2023-11-05T08:08:16.476624+0000","last_unstale":"2023-11-05T08:29:22.664565+0000","last_undegraded":"2023-11-05T08:29:22.664565+0000","last_fullsized":"2023-11-05T08:29:22.664565+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":903,"reported_epoch":932,"state":"active+clean","last_fresh":"2023-11-05T08:29:41.413404+0000","last_change":"2023-11-05T08:29:41.417384+0000","last_active":"2023-11-05T08:29:41.413404+0000","last_peered":"2023-11-05T08:29:41.413404+0000","last_clean":"2023-11-05T08:29:41.413404+0000","last_became_active":"2023-11-05T08:08:15.536104+0000","last_became_peered":"2023-11-05T08:08:15.536104+0000","last_unstale":"2023-11-05T08:29:41.413404+0000","last_undegraded":"2023-11-05T08:29:41.413404+0000","last_fullsized":"2023-11-05T08:29:41.413404+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:29:41.412049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:29:41.412049+0000","last_clean_scrub_stamp":"2023-11-05T08:29:41.412049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T16:55:01.254426+0000","scrub_duration":0.065755995999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":890,"reported_epoch":932,"state":"active+clean","last_fresh":"2023-11-05T08:29:41.775708+0000","last_change":"2023-11-05T08:29:41.775708+0000","last_active":"2023-11-05T08:29:41.775708+0000","last_peered":"2023-11-05T08:29:41.775708+0000","last_clean":"2023-11-05T08:29:41.775708+0000","last_became_active":"2023-11-05T08:08:24.441081+0000","last_became_peered":"2023-11-05T08:08:24.441081+0000","last_unstale":"2023-11-05T08:29:41.775708+0000","last_undegraded":"2023-11-05T08:29:41.775708+0000","last_fullsized":"2023-11-05T08:29:41.775708+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:29:41.773198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:29:41.773198+0000","last_clean_scrub_stamp":"2023-11-05T08:29:41.773198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T09:17:42.568276+0000","scrub_duration":0.036692071,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":904,"reported_epoch":932,"state":"active+clean","last_fresh":"2023-11-05T08:29:37.475909+0000","last_change":"2023-11-05T08:29:37.478284+0000","last_active":"2023-11-05T08:29:37.475909+0000","last_peered":"2023-11-05T08:29:37.475909+0000","last_clean":"2023-11-05T08:29:37.475909+0000","last_became_active":"2023-11-05T08:08:16.632044+0000","last_became_peered":"2023-11-05T08:08:16.632044+0000","last_unstale":"2023-11-05T08:29:37.475909+0000","last_undegraded":"2023-11-05T08:29:37.475909+0000","last_fullsized":"2023-11-05T08:29:37.475909+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:29:37.474463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:29:37.474463+0000","last_clean_scrub_stamp":"2023-11-05T08:29:37.474463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T12:03:26.899591+0000","scrub_duration":0.055078460000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":891,"reported_epoch":932,"state":"active+clean","last_fresh":"2023-11-05T08:29:39.374992+0000","last_change":"2023-11-05T08:29:39.376140+0000","last_active":"2023-11-05T08:29:39.374992+0000","last_peered":"2023-11-05T08:29:39.374992+0000","last_clean":"2023-11-05T08:29:39.374992+0000","last_became_active":"2023-11-05T08:08:14.425433+0000","last_became_peered":"2023-11-05T08:08:14.425433+0000","last_unstale":"2023-11-05T08:29:39.374992+0000","last_undegraded":"2023-11-05T08:29:39.374992+0000","last_fullsized":"2023-11-05T08:29:39.374992+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:29:39.373545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:29:39.373545+0000","last_clean_scrub_stamp":"2023-11-05T08:29:39.373545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T18:35:35.403965+0000","scrub_duration":0.057067181000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":892,"reported_epoch":932,"state":"active+clean","last_fresh":"2023-11-05T08:29:42.529061+0000","last_change":"2023-11-05T08:29:42.534181+0000","last_active":"2023-11-05T08:29:42.529061+0000","last_peered":"2023-11-05T08:29:42.529061+0000","last_clean":"2023-11-05T08:29:42.529061+0000","last_became_active":"2023-11-05T08:08:17.140308+0000","last_became_peered":"2023-11-05T08:08:17.140308+0000","last_unstale":"2023-11-05T08:29:42.529061+0000","last_undegraded":"2023-11-05T08:29:42.529061+0000","last_fullsized":"2023-11-05T08:29:42.529061+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:29:42.527729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:29:42.527729+0000","last_clean_scrub_stamp":"2023-11-05T08:29:42.527729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T15:11:43.277697+0000","scrub_duration":0.058377724999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":891,"reported_epoch":932,"state":"active+clean","last_fresh":"2023-11-05T08:29:36.355084+0000","last_change":"2023-11-05T08:29:36.356229+0000","last_active":"2023-11-05T08:29:36.355084+0000","last_peered":"2023-11-05T08:29:36.355084+0000","last_clean":"2023-11-05T08:29:36.355084+0000","last_became_active":"2023-11-05T08:08:14.137585+0000","last_became_peered":"2023-11-05T08:08:14.137585+0000","last_unstale":"2023-11-05T08:29:36.355084+0000","last_undegraded":"2023-11-05T08:29:36.355084+0000","last_fullsized":"2023-11-05T08:29:36.355084+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:29:36.353668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:29:36.353668+0000","last_clean_scrub_stamp":"2023-11-05T08:29:36.353668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T11:38:43.864262+0000","scrub_duration":0.041332088000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1","version":"932'8","reported_seq":905,"reported_epoch":932,"state":"active+clean","last_fresh":"2023-11-05T08:29:31.402719+0000","last_change":"2023-11-05T08:29:31.409362+0000","last_active":"2023-11-05T08:29:31.402719+0000","last_peered":"2023-11-05T08:29:31.402719+0000","last_clean":"2023-11-05T08:29:31.402719+0000","last_became_active":"2023-11-05T08:08:15.787944+0000","last_became_peered":"2023-11-05T08:08:15.787944+0000","last_unstale":"2023-11-05T08:29:31.402719+0000","last_undegraded":"2023-11-05T08:29:31.402719+0000","last_fullsized":"2023-11-05T08:29:31.402719+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"932'8","last_scrub_stamp":"2023-11-05T08:29:31.400338+0000","last_deep_scrub":"932'8","last_deep_scrub_stamp":"2023-11-05T08:29:31.400338+0000","last_clean_scrub_stamp":"2023-11-05T08:29:31.400338+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T11:55:46.665266+0000","scrub_duration":0.081671240000000006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":904,"reported_epoch":932,"state":"active+clean","last_fresh":"2023-11-05T08:29:35.362318+0000","last_change":"2023-11-05T08:29:35.363441+0000","last_active":"2023-11-05T08:29:35.362318+0000","last_peered":"2023-11-05T08:29:35.362318+0000","last_clean":"2023-11-05T08:29:35.362318+0000","last_became_active":"2023-11-05T08:08:29.547162+0000","last_became_peered":"2023-11-05T08:08:29.547162+0000","last_unstale":"2023-11-05T08:29:35.362318+0000","last_undegraded":"2023-11-05T08:29:35.362318+0000","last_fullsized":"2023-11-05T08:29:35.362318+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:29:35.360901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:29:35.360901+0000","last_clean_scrub_stamp":"2023-11-05T08:29:35.360901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T10:55:16.602689+0000","scrub_duration":0.040452469999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":880,"reported_epoch":932,"state":"active+clean","last_fresh":"2023-11-05T08:29:22.676924+0000","last_change":"2023-11-05T08:08:20.758068+0000","last_active":"2023-11-05T08:29:22.676924+0000","last_peered":"2023-11-05T08:29:22.676924+0000","last_clean":"2023-11-05T08:29:22.676924+0000","last_became_active":"2023-11-05T08:08:20.752405+0000","last_became_peered":"2023-11-05T08:08:20.752405+0000","last_unstale":"2023-11-05T08:29:22.676924+0000","last_undegraded":"2023-11-05T08:29:22.676924+0000","last_fullsized":"2023-11-05T08:29:22.676924+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:08:08.520104+0000","last_clean_scrub_stamp":"2023-11-05T08:08:08.520104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":890,"reported_epoch":932,"state":"active+clean","last_fresh":"2023-11-05T08:29:44.282759+0000","last_change":"2023-11-05T08:29:44.287031+0000","last_active":"2023-11-05T08:29:44.282759+0000","last_peered":"2023-11-05T08:29:44.282759+0000","last_clean":"2023-11-05T08:29:44.282759+0000","last_became_active":"2023-11-05T08:08:14.458020+0000","last_became_peered":"2023-11-05T08:08:14.458020+0000","last_unstale":"2023-11-05T08:29:44.282759+0000","last_undegraded":"2023-11-05T08:29:44.282759+0000","last_fullsized":"2023-11-05T08:29:44.282759+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:29:44.281354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:29:44.281354+0000","last_clean_scrub_stamp":"2023-11-05T08:29:44.281354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T09:21:31.267943+0000","scrub_duration":0.046173069999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":890,"reported_epoch":932,"state":"active+clean","last_fresh":"2023-11-05T08:29:45.845330+0000","last_change":"2023-11-05T08:29:45.846341+0000","last_active":"2023-11-05T08:29:45.845330+0000","last_peered":"2023-11-05T08:29:45.845330+0000","last_clean":"2023-11-05T08:29:45.845330+0000","last_became_active":"2023-11-05T08:08:17.320483+0000","last_became_peered":"2023-11-05T08:08:17.320483+0000","last_unstale":"2023-11-05T08:29:45.845330+0000","last_undegraded":"2023-11-05T08:29:45.845330+0000","last_fullsized":"2023-11-05T08:29:45.845330+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:29:45.844030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:29:45.844030+0000","last_clean_scrub_stamp":"2023-11-05T08:29:45.844030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T09:15:03.236836+0000","scrub_duration":0.064354601999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":877,"reported_epoch":932,"state":"active+clean","last_fresh":"2023-11-05T08:29:35.164608+0000","last_change":"2023-11-05T08:29:35.168351+0000","last_active":"2023-11-05T08:29:35.164608+0000","last_peered":"2023-11-05T08:29:35.164608+0000","last_clean":"2023-11-05T08:29:35.164608+0000","last_became_active":"2023-11-05T08:08:20.218112+0000","last_became_peered":"2023-11-05T08:08:20.218112+0000","last_unstale":"2023-11-05T08:29:35.164608+0000","last_undegraded":"2023-11-05T08:29:35.164608+0000","last_fullsized":"2023-11-05T08:29:35.164608+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:29:35.163222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:29:35.163222+0000","last_clean_scrub_stamp":"2023-11-05T08:29:35.163222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T11:34:49.603304+0000","scrub_duration":0.036598339000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":113,"num_write_kb":1372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":802816,"data_stored":795680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":78,"ondisk_log_size":78,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":0,"up_from":16,"seq":68719477013,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59120,"kb_used_data":5736,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94312720,"statfs":{"total":96636764160,"available":96576225280,"internally_reserved":0,"allocated":5873664,"data_stored":3137725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Nov 5 08:29:43 2023","interfaces":[{"interface":"back","average":{"1min":12.631,"5min":16.599,"15min":16.648},"min":{"1min":5.1029999999999998,"5min":4.6589999999999998,"15min":4.5},"max":{"1min":55.585000000000001,"5min":109.83,"15min":214.25299999999999},"last":8.6630000000000003},{"interface":"front","average":{"1min":10.111000000000001,"5min":18.228999999999999,"15min":18.471},"min":{"1min":5.6600000000000001,"5min":5.0279999999999996,"15min":4.6989999999999998},"max":{"1min":16.812000000000001,"5min":171.31999999999999,"15min":252.74000000000001},"last":5.8780000000000001}]},{"osd":2,"last update":"Sun Nov 5 08:28:57 2023","interfaces":[{"interface":"back","average":{"1min":14.499000000000001,"5min":24.434000000000001,"15min":24.056999999999999},"min":{"1min":8.8100000000000005,"5min":6.8419999999999996,"15min":6.3369999999999997},"max":{"1min":31.861999999999998,"5min":147.30199999999999,"15min":227.87100000000001},"last":10.833},{"interface":"front","average":{"1min":16.076000000000001,"5min":28.667000000000002,"15min":28.436},"min":{"1min":9.4179999999999993,"5min":9.0510000000000002,"15min":9.0510000000000002},"max":{"1min":34.857999999999997,"5min":231.124,"15min":343.62599999999998},"last":17.074999999999999}]},{"osd":3,"last update":"Sun Nov 5 08:29:43 2023","interfaces":[{"interface":"back","average":{"1min":28.651,"5min":28.667000000000002,"15min":24.315000000000001},"min":{"1min":11.773999999999999,"5min":7.6390000000000002,"15min":7.6390000000000002},"max":{"1min":148.577,"5min":165.13900000000001,"15min":223.571},"last":17.736999999999998},{"interface":"front","average":{"1min":18.84,"5min":19.402000000000001,"15min":17.786000000000001},"min":{"1min":6.5259999999999998,"5min":6.5259999999999998,"15min":6.3310000000000004},"max":{"1min":79.772999999999996,"5min":127.40600000000001,"15min":163.684},"last":9.3499999999999996}]},{"osd":4,"last update":"Sun Nov 5 08:29:43 2023","interfaces":[{"interface":"back","average":{"1min":14.632999999999999,"5min":19.460999999999999,"15min":17.978000000000002},"min":{"1min":6.3220000000000001,"5min":6.3220000000000001,"15min":6.3220000000000001},"max":{"1min":78.811999999999998,"5min":125.905,"15min":176.929},"last":15.244999999999999},{"interface":"front","average":{"1min":24.599,"5min":26.015999999999998,"15min":23.614000000000001},"min":{"1min":12.164999999999999,"5min":10.333,"15min":7.7300000000000004},"max":{"1min":140.005,"5min":156.762,"15min":230.40600000000001},"last":19.721}]},{"osd":5,"last update":"Sun Nov 5 08:29:43 2023","interfaces":[{"interface":"back","average":{"1min":12.324999999999999,"5min":21.268999999999998,"15min":21.363},"min":{"1min":8.0090000000000003,"5min":8.0090000000000003,"15min":6.8940000000000001},"max":{"1min":20.827000000000002,"5min":116.42,"15min":266.36099999999999},"last":13.949},{"interface":"front","average":{"1min":17.504000000000001,"5min":22.908999999999999,"15min":24.387},"min":{"1min":11.012,"5min":9.4139999999999997,"15min":9.4139999999999997},"max":{"1min":54.32,"5min":115.401,"15min":260.779},"last":15.882999999999999}]},{"osd":6,"last update":"Sun Nov 5 08:29:43 2023","interfaces":[{"interface":"back","average":{"1min":34.591000000000001,"5min":31.390000000000001,"15min":29.387},"min":{"1min":11.164,"5min":10.246,"15min":10.246},"max":{"1min":149.291,"5min":149.291,"15min":280.47199999999998},"last":18.872},{"interface":"front","average":{"1min":24.835999999999999,"5min":23.594999999999999,"15min":22.251999999999999},"min":{"1min":7.8719999999999999,"5min":7.5510000000000002,"15min":6.5739999999999998},"max":{"1min":119.54000000000001,"5min":216.12,"15min":216.12},"last":10.058999999999999}]},{"osd":7,"last update":"Sun Nov 5 08:29:43 2023","interfaces":[{"interface":"back","average":{"1min":25.760999999999999,"5min":35.155000000000001,"15min":29.527000000000001},"min":{"1min":14.151999999999999,"5min":11.266999999999999,"15min":10.122},"max":{"1min":133.00299999999999,"5min":281.70800000000003,"15min":281.70800000000003},"last":20.553999999999998},{"interface":"front","average":{"1min":27.881,"5min":39.459000000000003,"15min":33.639000000000003},"min":{"1min":15.396000000000001,"5min":13.933,"15min":13.242000000000001},"max":{"1min":137.75,"5min":284.21199999999999,"15min":284.21199999999999},"last":21.381}]}]},{"osd":3,"up_from":15,"seq":64424509717,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59120,"kb_used_data":5736,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94312720,"statfs":{"total":96636764160,"available":96576225280,"internally_reserved":0,"allocated":5873664,"data_stored":3137725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":54655432},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 5 08:29:40 2023","interfaces":[{"interface":"back","average":{"1min":13.492000000000001,"5min":13.631,"15min":20.605},"min":{"1min":5.9930000000000003,"5min":5.7539999999999996,"15min":4.5739999999999998},"max":{"1min":45.722000000000001,"5min":112.003,"15min":261.80799999999999},"last":9.9209999999999994},{"interface":"front","average":{"1min":13.769,"5min":12.737,"15min":19.888999999999999},"min":{"1min":5.3449999999999998,"5min":4.4930000000000003,"15min":4.4199999999999999},"max":{"1min":25.315999999999999,"5min":113.303,"15min":391.05500000000001},"last":7.5069999999999997}]},{"osd":1,"last update":"Sun Nov 5 08:29:40 2023","interfaces":[{"interface":"back","average":{"1min":18.911999999999999,"5min":17.917000000000002,"15min":23.507999999999999},"min":{"1min":9.1859999999999999,"5min":5.4669999999999996,"15min":5.4669999999999996},"max":{"1min":53.768999999999998,"5min":210.03999999999999,"15min":390.67000000000002},"last":11.295},{"interface":"front","average":{"1min":14.065,"5min":14.662000000000001,"15min":23.552},"min":{"1min":7.266,"5min":6.4669999999999996,"15min":6.4279999999999999},"max":{"1min":43.003,"5min":61.921999999999997,"15min":406.154},"last":13.645}]},{"osd":2,"last update":"Sun Nov 5 08:28:55 2023","interfaces":[{"interface":"back","average":{"1min":17.161999999999999,"5min":20.928000000000001,"15min":25.690999999999999},"min":{"1min":8.8300000000000001,"5min":7.508,"15min":7.1920000000000002},"max":{"1min":83.262,"5min":143.93100000000001,"15min":356.27800000000002},"last":10.59},{"interface":"front","average":{"1min":18.815000000000001,"5min":22.913,"15min":28.707000000000001},"min":{"1min":10.121,"5min":9.8279999999999994,"15min":7.9210000000000003},"max":{"1min":60.844999999999999,"5min":147.49600000000001,"15min":394.14999999999998},"last":14.337}]},{"osd":4,"last update":"Sun Nov 5 08:29:40 2023","interfaces":[{"interface":"back","average":{"1min":15.374000000000001,"5min":20.466999999999999,"15min":23.901},"min":{"1min":7.101,"5min":7.101,"15min":6.3609999999999998},"max":{"1min":47.232999999999997,"5min":225.31899999999999,"15min":342.72199999999998},"last":18.452999999999999},{"interface":"front","average":{"1min":22.149000000000001,"5min":26.207000000000001,"15min":29.763999999999999},"min":{"1min":10.785,"5min":9.673,"15min":9.0600000000000005},"max":{"1min":62.420000000000002,"5min":228.22200000000001,"15min":343.30799999999999},"last":20.969999999999999}]},{"osd":5,"last update":"Sun Nov 5 08:29:40 2023","interfaces":[{"interface":"back","average":{"1min":16.158999999999999,"5min":19.032,"15min":28.757999999999999},"min":{"1min":7.1479999999999997,"5min":6.3040000000000003,"15min":6.3040000000000003},"max":{"1min":35.280000000000001,"5min":77.813999999999993,"15min":412.41300000000001},"last":14.429},{"interface":"front","average":{"1min":19.207999999999998,"5min":16.433,"15min":25.469000000000001},"min":{"1min":7.1580000000000004,"5min":6.6420000000000003,"15min":6.0030000000000001},"max":{"1min":48.011000000000003,"5min":73.427999999999997,"15min":393.334},"last":8.3439999999999994}]},{"osd":6,"last update":"Sun Nov 5 08:29:40 2023","interfaces":[{"interface":"back","average":{"1min":20.561,"5min":22.125,"15min":30.265000000000001},"min":{"1min":11.259,"5min":10.747,"15min":8.5289999999999999},"max":{"1min":55.015999999999998,"5min":88.567999999999998,"15min":395.892},"last":15},{"interface":"front","average":{"1min":20.173999999999999,"5min":22.317,"15min":28.960999999999999},"min":{"1min":6.9619999999999997,"5min":6.9619999999999997,"15min":6.9619999999999997},"max":{"1min":60.200000000000003,"5min":208.23099999999999,"15min":343.959},"last":19.896000000000001}]},{"osd":7,"last update":"Sun Nov 5 08:29:40 2023","interfaces":[{"interface":"back","average":{"1min":23.707000000000001,"5min":21.047999999999998,"15min":29.204000000000001},"min":{"1min":11.407,"5min":11.039,"15min":10.02},"max":{"1min":48.933,"5min":76.209999999999994,"15min":346.93299999999999},"last":21.616},{"interface":"front","average":{"1min":19.759,"5min":17.268000000000001,"15min":26.594000000000001},"min":{"1min":8.4830000000000005,"5min":8.4830000000000005,"15min":7.415},"max":{"1min":67.920000000000002,"5min":76.225999999999999,"15min":407.678},"last":8.4559999999999995}]}]},{"osd":2,"up_from":15,"seq":64424509716,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59120,"kb_used_data":5736,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94312720,"statfs":{"total":96636764160,"available":96576225280,"internally_reserved":0,"allocated":5873664,"data_stored":3137725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 5 08:29:51 2023","interfaces":[{"interface":"back","average":{"1min":18.885999999999999,"5min":16.800999999999998,"15min":20.597000000000001},"min":{"1min":6.931,"5min":6.2279999999999998,"15min":5.0839999999999996},"max":{"1min":116.902,"5min":116.902,"15min":270.755},"last":8.1310000000000002},{"interface":"front","average":{"1min":23.391999999999999,"5min":22,"15min":25.920000000000002},"min":{"1min":9.3119999999999994,"5min":7.1840000000000002,"15min":7.1840000000000002},"max":{"1min":119.92,"5min":119.92,"15min":294.77800000000002},"last":13.734999999999999}]},{"osd":1,"last update":"Sun Nov 5 08:29:39 2023","interfaces":[{"interface":"back","average":{"1min":27.905999999999999,"5min":21.661000000000001,"15min":23.449000000000002},"min":{"1min":9.0969999999999995,"5min":9.0969999999999995,"15min":5.9649999999999999},"max":{"1min":103.205,"5min":204.059,"15min":258.88600000000002},"last":9.4670000000000005},{"interface":"front","average":{"1min":26.096,"5min":17.934999999999999,"15min":22.298999999999999},"min":{"1min":6.4729999999999999,"5min":5.681,"15min":5.5030000000000001},"max":{"1min":100.021,"5min":231.86600000000001,"15min":312.77999999999997},"last":8.7089999999999996}]},{"osd":3,"last update":"Sun Nov 5 08:29:51 2023","interfaces":[{"interface":"back","average":{"1min":21.789999999999999,"5min":20.789999999999999,"15min":21.869},"min":{"1min":7.407,"5min":6.976,"15min":6.2439999999999998},"max":{"1min":86.674000000000007,"5min":204.50800000000001,"15min":269.48899999999998},"last":17.248999999999999},{"interface":"front","average":{"1min":28.044,"5min":25.27,"15min":27.812999999999999},"min":{"1min":13.138,"5min":10.894,"15min":7.9800000000000004},"max":{"1min":94.465000000000003,"5min":161.327,"15min":288.178},"last":15.866}]},{"osd":4,"last update":"Sun Nov 5 08:29:51 2023","interfaces":[{"interface":"back","average":{"1min":23.277999999999999,"5min":15.083,"15min":17.805},"min":{"1min":7.1299999999999999,"5min":5.8220000000000001,"15min":5.8220000000000001},"max":{"1min":102.38500000000001,"5min":102.38500000000001,"15min":220.423},"last":10.259},{"interface":"front","average":{"1min":27.518000000000001,"5min":20.283000000000001,"15min":23.658999999999999},"min":{"1min":9.3710000000000004,"5min":8.2959999999999994,"15min":7.8559999999999999},"max":{"1min":101.26900000000001,"5min":101.26900000000001,"15min":260.37},"last":18.058}]},{"osd":5,"last update":"Sun Nov 5 08:29:51 2023","interfaces":[{"interface":"back","average":{"1min":28.899999999999999,"5min":18,"15min":19.873999999999999},"min":{"1min":13.957000000000001,"5min":6.3949999999999996,"15min":6.3159999999999998},"max":{"1min":144.476,"5min":144.476,"15min":229.387},"last":16.481999999999999},{"interface":"front","average":{"1min":21.757999999999999,"5min":21.559999999999999,"15min":26.495000000000001},"min":{"1min":6.3570000000000002,"5min":6.3570000000000002,"15min":6.3570000000000002},"max":{"1min":90.159000000000006,"5min":109.113,"15min":301.16899999999998},"last":10.885999999999999}]},{"osd":6,"last update":"Sun Nov 5 08:29:51 2023","interfaces":[{"interface":"back","average":{"1min":24.658000000000001,"5min":21.952000000000002,"15min":25.928000000000001},"min":{"1min":10.798999999999999,"5min":8.4469999999999992,"15min":8.4469999999999992},"max":{"1min":92.584999999999994,"5min":92.584999999999994,"15min":219.01300000000001},"last":12.663},{"interface":"front","average":{"1min":27.567,"5min":20.327000000000002,"15min":21.161000000000001},"min":{"1min":12.073,"5min":9.1780000000000008,"15min":6.5309999999999997},"max":{"1min":94.736000000000004,"5min":111.405,"15min":217.93600000000001},"last":14.832000000000001}]},{"osd":7,"last update":"Sun Nov 5 08:29:39 2023","interfaces":[{"interface":"back","average":{"1min":26.591999999999999,"5min":23.997,"15min":25.294},"min":{"1min":11.491,"5min":9.9079999999999995,"15min":8.4870000000000001},"max":{"1min":74.543000000000006,"5min":86.188999999999993,"15min":263.37099999999998},"last":18.821999999999999},{"interface":"front","average":{"1min":30.119,"5min":29.321999999999999,"15min":30.911999999999999},"min":{"1min":15.124000000000001,"5min":13.923,"15min":10.188000000000001},"max":{"1min":90.114000000000004,"5min":141.214,"15min":258.42000000000002},"last":20.335000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509715,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59516,"kb_used_data":6132,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94312324,"statfs":{"total":96636764160,"available":96575819776,"internally_reserved":0,"allocated":6279168,"data_stored":3535570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 5 08:28:48 2023","interfaces":[{"interface":"back","average":{"1min":28.224,"5min":20.513999999999999,"15min":21.202999999999999},"min":{"1min":6.6360000000000001,"5min":4.2789999999999999,"15min":4.2789999999999999},"max":{"1min":269.49200000000002,"5min":269.49200000000002,"15min":309.815},"last":8.2430000000000003},{"interface":"front","average":{"1min":18.898,"5min":18.010999999999999,"15min":19.018999999999998},"min":{"1min":5.7709999999999999,"5min":4.9089999999999998,"15min":4.4119999999999999},"max":{"1min":140.09,"5min":160.89500000000001,"15min":299.55399999999997},"last":10.944000000000001}]},{"osd":2,"last update":"Sun Nov 5 08:28:48 2023","interfaces":[{"interface":"back","average":{"1min":36.625,"5min":23.963999999999999,"15min":24.616},"min":{"1min":6.9550000000000001,"5min":6.202,"15min":5.7999999999999998},"max":{"1min":365.68099999999998,"5min":365.68099999999998,"15min":365.68099999999998},"last":8.9420000000000002},{"interface":"front","average":{"1min":27.253,"5min":24.193000000000001,"15min":24.239000000000001},"min":{"1min":9.2539999999999996,"5min":7.0990000000000002,"15min":6.8899999999999997},"max":{"1min":143.03700000000001,"5min":188.554,"15min":302.49799999999999},"last":16.021000000000001}]},{"osd":3,"last update":"Sun Nov 5 08:28:48 2023","interfaces":[{"interface":"back","average":{"1min":34.058,"5min":26.893999999999998,"15min":27.126000000000001},"min":{"1min":8.4090000000000007,"5min":7.1260000000000003,"15min":6.8019999999999996},"max":{"1min":330.101,"5min":330.101,"15min":334.85599999999999},"last":13.050000000000001},{"interface":"front","average":{"1min":32.119,"5min":27.798999999999999,"15min":28.527999999999999},"min":{"1min":7.673,"5min":7.673,"15min":6.9660000000000002},"max":{"1min":268.80900000000003,"5min":268.80900000000003,"15min":382.089},"last":9.6839999999999993}]},{"osd":4,"last update":"Sun Nov 5 08:28:48 2023","interfaces":[{"interface":"back","average":{"1min":35.593000000000004,"5min":24.390999999999998,"15min":23.358000000000001},"min":{"1min":8.1560000000000006,"5min":8.0239999999999991,"15min":6.7220000000000004},"max":{"1min":309.38200000000001,"5min":309.38200000000001,"15min":309.38200000000001},"last":12.401},{"interface":"front","average":{"1min":20.195,"5min":19.210000000000001,"15min":20.236999999999998},"min":{"1min":7.415,"5min":7.1289999999999996,"15min":6.0750000000000002},"max":{"1min":112.929,"5min":161.56700000000001,"15min":161.56700000000001},"last":15.266999999999999}]},{"osd":5,"last update":"Sun Nov 5 08:29:45 2023","interfaces":[{"interface":"back","average":{"1min":32.478999999999999,"5min":28.547999999999998,"15min":24.018999999999998},"min":{"1min":12.393000000000001,"5min":9.0519999999999996,"15min":6.1600000000000001},"max":{"1min":212.40000000000001,"5min":312.33699999999999,"15min":312.33699999999999},"last":13.696999999999999},{"interface":"front","average":{"1min":33.32,"5min":25.873999999999999,"15min":26.352},"min":{"1min":10.863,"5min":10.863,"15min":8.2129999999999992},"max":{"1min":213.625,"5min":213.625,"15min":297.25299999999999},"last":18.085000000000001}]},{"osd":6,"last update":"Sun Nov 5 08:29:45 2023","interfaces":[{"interface":"back","average":{"1min":22.359999999999999,"5min":23.486999999999998,"15min":25.158000000000001},"min":{"1min":11.791,"5min":8.3930000000000007,"15min":8.0579999999999998},"max":{"1min":58.423999999999999,"5min":166.16300000000001,"15min":214.44200000000001},"last":19.102},{"interface":"front","average":{"1min":24.855,"5min":29.579999999999998,"15min":30.934000000000001},"min":{"1min":15.077999999999999,"5min":12.923999999999999,"15min":12.047000000000001},"max":{"1min":61.564,"5min":225.93899999999999,"15min":231.297},"last":19.943999999999999}]},{"osd":7,"last update":"Sun Nov 5 08:29:45 2023","interfaces":[{"interface":"back","average":{"1min":26.605,"5min":24.547999999999998,"15min":29.837},"min":{"1min":8.5730000000000004,"5min":8.3680000000000003,"15min":8.3680000000000003},"max":{"1min":136.04499999999999,"5min":248.667,"15min":248.667},"last":11.74},{"interface":"front","average":{"1min":30.484000000000002,"5min":31.061,"15min":27.375},"min":{"1min":12.778,"5min":12.778,"15min":7.7199999999999998},"max":{"1min":141.821,"5min":331.02800000000002,"15min":331.02800000000002},"last":14.48}]}]},{"osd":7,"up_from":14,"seq":60129542420,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":81328,"kb_used_data":5736,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94290512,"statfs":{"total":96636764160,"available":96553484288,"internally_reserved":0,"allocated":5873664,"data_stored":3137725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":77396427},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 5 08:29:48 2023","interfaces":[{"interface":"back","average":{"1min":17.541,"5min":17.262,"15min":17.343},"min":{"1min":4.6189999999999998,"5min":4.6189999999999998,"15min":4.3739999999999997},"max":{"1min":153.21000000000001,"5min":153.21000000000001,"15min":198.46799999999999},"last":7.8949999999999996},{"interface":"front","average":{"1min":13.877000000000001,"5min":15.654,"15min":16.931999999999999},"min":{"1min":6.2880000000000003,"5min":5.5869999999999997,"15min":4.4260000000000002},"max":{"1min":57.706000000000003,"5min":129.173,"15min":162.06200000000001},"last":16.251000000000001}]},{"osd":1,"last update":"Sun Nov 5 08:29:43 2023","interfaces":[{"interface":"back","average":{"1min":14.241,"5min":18.276,"15min":21.745000000000001},"min":{"1min":7.3899999999999997,"5min":6.4109999999999996,"15min":5.9939999999999998},"max":{"1min":50.340000000000003,"5min":109.303,"15min":415.255},"last":16.878},{"interface":"front","average":{"1min":13.888,"5min":20.027999999999999,"15min":22.440999999999999},"min":{"1min":6.7140000000000004,"5min":6.7140000000000004,"15min":6.0999999999999996},"max":{"1min":58.918999999999997,"5min":146.83799999999999,"15min":305.72800000000001},"last":12.401}]},{"osd":2,"last update":"Sun Nov 5 08:29:48 2023","interfaces":[{"interface":"back","average":{"1min":13.115,"5min":18.558,"15min":21.954000000000001},"min":{"1min":6.7140000000000004,"5min":6.5,"15min":6.5},"max":{"1min":46.798000000000002,"5min":125.071,"15min":175.221},"last":11.696},{"interface":"front","average":{"1min":15.178000000000001,"5min":19.521000000000001,"15min":21.832000000000001},"min":{"1min":8.2940000000000005,"5min":6.8730000000000002,"15min":6.5410000000000004},"max":{"1min":61.103999999999999,"5min":154.429,"15min":183.22},"last":6.8879999999999999}]},{"osd":3,"last update":"Sun Nov 5 08:29:48 2023","interfaces":[{"interface":"back","average":{"1min":16.513999999999999,"5min":23.710999999999999,"15min":26.687000000000001},"min":{"1min":7.1550000000000002,"5min":7.1550000000000002,"15min":6.6660000000000004},"max":{"1min":88.591999999999999,"5min":171.90600000000001,"15min":380.88099999999997},"last":8.7110000000000003},{"interface":"front","average":{"1min":16.789000000000001,"5min":24.103999999999999,"15min":24.213999999999999},"min":{"1min":10.345000000000001,"5min":7.0309999999999997,"15min":6.3769999999999998},"max":{"1min":56.567,"5min":143.35499999999999,"15min":174.41200000000001},"last":17.834}]},{"osd":4,"last update":"Sun Nov 5 08:29:43 2023","interfaces":[{"interface":"back","average":{"1min":15.013,"5min":21.373999999999999,"15min":23.157},"min":{"1min":6.2380000000000004,"5min":5.9329999999999998,"15min":5.9329999999999998},"max":{"1min":47.448,"5min":158.124,"15min":215.60499999999999},"last":9.4209999999999994},{"interface":"front","average":{"1min":18.917000000000002,"5min":24.629000000000001,"15min":26.478000000000002},"min":{"1min":10.778,"5min":7.6790000000000003,"15min":7.6790000000000003},"max":{"1min":48.625999999999998,"5min":158.79300000000001,"15min":347.35199999999998},"last":13.055999999999999}]},{"osd":5,"last update":"Sun Nov 5 08:29:43 2023","interfaces":[{"interface":"back","average":{"1min":19.619,"5min":24.43,"15min":26.936},"min":{"1min":9.9420000000000002,"5min":7.8410000000000002,"15min":7.7199999999999998},"max":{"1min":59.613999999999997,"5min":156.44,"15min":283.54300000000001},"last":10.256},{"interface":"front","average":{"1min":18.870000000000001,"5min":23.658999999999999,"15min":26.283000000000001},"min":{"1min":8.3390000000000004,"5min":6.5890000000000004,"15min":6.5890000000000004},"max":{"1min":95.927999999999997,"5min":168.31800000000001,"15min":582.69899999999996},"last":15.247}]},{"osd":6,"last update":"Sun Nov 5 08:29:43 2023","interfaces":[{"interface":"back","average":{"1min":20.151,"5min":24.338000000000001,"15min":25.146000000000001},"min":{"1min":11.212999999999999,"5min":10.821,"15min":8.7300000000000004},"max":{"1min":95.194999999999993,"5min":140.654,"15min":228.97200000000001},"last":13.848000000000001},{"interface":"front","average":{"1min":20.199999999999999,"5min":24.183,"15min":23.157},"min":{"1min":10.811,"5min":7.9160000000000004,"15min":7.1740000000000004},"max":{"1min":89.944000000000003,"5min":132.90199999999999,"15min":203.364},"last":18.599}]}]},{"osd":5,"up_from":14,"seq":60129542421,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77560,"kb_used_data":6128,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94294280,"statfs":{"total":96636764160,"available":96557342720,"internally_reserved":0,"allocated":6275072,"data_stored":3535565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 5 08:29:41 2023","interfaces":[{"interface":"back","average":{"1min":13.351000000000001,"5min":12.180999999999999,"15min":16.858000000000001},"min":{"1min":5.5359999999999996,"5min":5.0229999999999997,"15min":4.3799999999999999},"max":{"1min":42.975999999999999,"5min":73.667000000000002,"15min":258.09699999999998},"last":8.1859999999999999},{"interface":"front","average":{"1min":16.416,"5min":18.425000000000001,"15min":21.422999999999998},"min":{"1min":9.7710000000000008,"5min":7.6929999999999996,"15min":4.1600000000000001},"max":{"1min":43.841999999999999,"5min":231.863,"15min":278.45499999999998},"last":8.9990000000000006}]},{"osd":1,"last update":"Sun Nov 5 08:29:41 2023","interfaces":[{"interface":"back","average":{"1min":15.255000000000001,"5min":17.472999999999999,"15min":19.978000000000002},"min":{"1min":5.7350000000000003,"5min":5.7350000000000003,"15min":4.351},"max":{"1min":105.19799999999999,"5min":146.76900000000001,"15min":304.47800000000001},"last":17.719999999999999},{"interface":"front","average":{"1min":19.896000000000001,"5min":21.059999999999999,"15min":24.478999999999999},"min":{"1min":7.6820000000000004,"5min":6.4649999999999999,"15min":6.2430000000000003},"max":{"1min":81.875,"5min":103.68600000000001,"15min":286.233},"last":18.395}]},{"osd":2,"last update":"Sun Nov 5 08:29:41 2023","interfaces":[{"interface":"back","average":{"1min":17.228999999999999,"5min":20.09,"15min":22.992000000000001},"min":{"1min":6.8499999999999996,"5min":6.3970000000000002,"15min":5.1210000000000004},"max":{"1min":82.712999999999994,"5min":224.57900000000001,"15min":224.57900000000001},"last":10.179},{"interface":"front","average":{"1min":18.588000000000001,"5min":23.314,"15min":27.890000000000001},"min":{"1min":10.497999999999999,"5min":7.476,"15min":5.5549999999999997},"max":{"1min":50.619999999999997,"5min":185.56299999999999,"15min":327.26100000000002},"last":11.513999999999999}]},{"osd":3,"last update":"Sun Nov 5 08:29:41 2023","interfaces":[{"interface":"back","average":{"1min":19.797999999999998,"5min":24.215,"15min":22.52},"min":{"1min":7.6520000000000001,"5min":6.5739999999999998,"15min":6.0629999999999997},"max":{"1min":107.744,"5min":192.482,"15min":283.94099999999997},"last":16.027000000000001},{"interface":"front","average":{"1min":23.622,"5min":25.544,"15min":23.135000000000002},"min":{"1min":13.44,"5min":12.102,"15min":6.2729999999999997},"max":{"1min":105.955,"5min":167.28899999999999,"15min":284.72699999999998},"last":16.77}]},{"osd":4,"last update":"Sun Nov 5 08:29:41 2023","interfaces":[{"interface":"back","average":{"1min":20.728999999999999,"5min":21.119,"15min":21.757000000000001},"min":{"1min":11.141,"5min":9.3059999999999992,"15min":6.7409999999999997},"max":{"1min":71.869,"5min":98.747,"15min":244.86099999999999},"last":14.295999999999999},{"interface":"front","average":{"1min":12.086,"5min":14.257999999999999,"15min":18.995999999999999},"min":{"1min":6.4459999999999997,"5min":5.8739999999999997,"15min":5.8739999999999997},"max":{"1min":37.384,"5min":112.798,"15min":277.55700000000002},"last":12.768000000000001}]},{"osd":6,"last update":"Sun Nov 5 08:29:41 2023","interfaces":[{"interface":"back","average":{"1min":29.408999999999999,"5min":22.128,"15min":23.648},"min":{"1min":6.4509999999999996,"5min":6.4509999999999996,"15min":5.7930000000000001},"max":{"1min":185.99000000000001,"5min":242.536,"15min":242.536},"last":6.8760000000000003},{"interface":"front","average":{"1min":23.233000000000001,"5min":23.920000000000002,"15min":26.088999999999999},"min":{"1min":9.4280000000000008,"5min":9.1289999999999996,"15min":7.0300000000000002},"max":{"1min":88.948999999999998,"5min":177.25800000000001,"15min":310.69099999999997},"last":10.805999999999999}]},{"osd":7,"last update":"Sun Nov 5 08:29:41 2023","interfaces":[{"interface":"back","average":{"1min":21.954999999999998,"5min":23.161000000000001,"15min":26.053999999999998},"min":{"1min":9.282,"5min":8.7769999999999992,"15min":8.7650000000000006},"max":{"1min":77.509,"5min":119.51900000000001,"15min":281.71199999999999},"last":15.202},{"interface":"front","average":{"1min":20.222999999999999,"5min":22.875,"15min":28.055},"min":{"1min":12.555,"5min":8.0860000000000003,"15min":8.0860000000000003},"max":{"1min":49.790999999999997,"5min":94.194999999999993,"15min":319.786},"last":12.084}]}]},{"osd":4,"up_from":14,"seq":60129542422,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63280,"kb_used_data":5736,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94308560,"statfs":{"total":96636764160,"available":96571965440,"internally_reserved":0,"allocated":5873664,"data_stored":3137725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 5 08:29:37 2023","interfaces":[{"interface":"back","average":{"1min":16.472999999999999,"5min":13.622,"15min":19.138999999999999},"min":{"1min":4.6950000000000003,"5min":4.6950000000000003,"15min":4.6950000000000003},"max":{"1min":62.594000000000001,"5min":73.995999999999995,"15min":243.626},"last":9.7639999999999993},{"interface":"front","average":{"1min":18.378,"5min":17.478000000000002,"15min":23.103999999999999},"min":{"1min":7.6139999999999999,"5min":5.7199999999999998,"15min":5.7199999999999998},"max":{"1min":58.095999999999997,"5min":116.346,"15min":202.49000000000001},"last":10.355}]},{"osd":1,"last update":"Sun Nov 5 08:29:37 2023","interfaces":[{"interface":"back","average":{"1min":11.395,"5min":15.006,"15min":20.481000000000002},"min":{"1min":4.492,"5min":4.492,"15min":4.274},"max":{"1min":34.497,"5min":162.90799999999999,"15min":369.267},"last":7.8840000000000003},{"interface":"front","average":{"1min":16.670000000000002,"5min":15.493,"15min":23.667000000000002},"min":{"1min":7.3029999999999999,"5min":5.4930000000000003,"15min":5.4930000000000003},"max":{"1min":43.347999999999999,"5min":157.459,"15min":340.214},"last":5.9470000000000001}]},{"osd":2,"last update":"Sun Nov 5 08:29:37 2023","interfaces":[{"interface":"back","average":{"1min":18.876999999999999,"5min":19.706,"15min":26.309000000000001},"min":{"1min":7.1580000000000004,"5min":6.7750000000000004,"15min":6.7750000000000004},"max":{"1min":55.881,"5min":192.44999999999999,"15min":241.934},"last":10.98},{"interface":"front","average":{"1min":17.863,"5min":19.148,"15min":25.114000000000001},"min":{"1min":6.6669999999999998,"5min":6.5110000000000001,"15min":6.3109999999999999},"max":{"1min":58.277000000000001,"5min":183.47900000000001,"15min":368.279},"last":16.311}]},{"osd":3,"last update":"Sun Nov 5 08:29:37 2023","interfaces":[{"interface":"back","average":{"1min":13.372999999999999,"5min":16.940999999999999,"15min":20.568000000000001},"min":{"1min":8.2029999999999994,"5min":7.1600000000000001,"15min":6.1200000000000001},"max":{"1min":39.347000000000001,"5min":164.06399999999999,"15min":369.53399999999999},"last":8.7289999999999992},{"interface":"front","average":{"1min":18.693000000000001,"5min":21.747,"15min":26.821000000000002},"min":{"1min":11.484,"5min":6.8920000000000003,"15min":6.8920000000000003},"max":{"1min":54.116,"5min":196.655,"15min":367.93799999999999},"last":11.519}]},{"osd":5,"last update":"Sun Nov 5 08:29:37 2023","interfaces":[{"interface":"back","average":{"1min":18.853000000000002,"5min":23.573,"15min":29.486999999999998},"min":{"1min":10.253,"5min":10.253,"15min":7.0010000000000003},"max":{"1min":57.521000000000001,"5min":202.82900000000001,"15min":283.08100000000002},"last":13.728999999999999},{"interface":"front","average":{"1min":14.643000000000001,"5min":23.018000000000001,"15min":24.649000000000001},"min":{"1min":8.0210000000000008,"5min":7.0640000000000001,"15min":6.3010000000000002},"max":{"1min":46.354999999999997,"5min":264.10300000000001,"15min":283.94400000000002},"last":17.442}]},{"osd":6,"last update":"Sun Nov 5 08:29:41 2023","interfaces":[{"interface":"back","average":{"1min":22.388000000000002,"5min":19.221,"15min":24.875},"min":{"1min":8.3379999999999992,"5min":7.1740000000000004,"15min":6.4359999999999999},"max":{"1min":87.091999999999999,"5min":165.113,"15min":324.98200000000003},"last":15.358000000000001},{"interface":"front","average":{"1min":27.646000000000001,"5min":25.539999999999999,"15min":30.390999999999998},"min":{"1min":11.224,"5min":9.5470000000000006,"15min":8.5890000000000004},"max":{"1min":131.20500000000001,"5min":205.83199999999999,"15min":288.26799999999997},"last":9.4440000000000008}]},{"osd":7,"last update":"Sun Nov 5 08:29:37 2023","interfaces":[{"interface":"back","average":{"1min":17.216000000000001,"5min":22.507999999999999,"15min":27.908999999999999},"min":{"1min":10.464,"5min":7.7009999999999996,"15min":7.1559999999999997},"max":{"1min":41.401000000000003,"5min":210.24600000000001,"15min":356.44600000000003},"last":18.364999999999998},{"interface":"front","average":{"1min":19.631,"5min":25.562999999999999,"15min":28.414000000000001},"min":{"1min":13.189,"5min":9.7159999999999993,"15min":9.7159999999999993},"max":{"1min":44.408999999999999,"5min":208.833,"15min":327.53800000000001},"last":19.175999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575123,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63284,"kb_used_data":5740,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94308556,"statfs":{"total":96636764160,"available":96571961344,"internally_reserved":0,"allocated":5877760,"data_stored":3137730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 5 08:29:47 2023","interfaces":[{"interface":"back","average":{"1min":11.978,"5min":16.218,"15min":17.920000000000002},"min":{"1min":4.7569999999999997,"5min":4.1600000000000001,"15min":4.1600000000000001},"max":{"1min":45.542999999999999,"5min":165.51900000000001,"15min":187.75899999999999},"last":15.146000000000001},{"interface":"front","average":{"1min":10.848000000000001,"5min":16.481999999999999,"15min":17.609000000000002},"min":{"1min":5.1520000000000001,"5min":5.1520000000000001,"15min":4.6790000000000003},"max":{"1min":35.265000000000001,"5min":167.02500000000001,"15min":185.38200000000001},"last":5.835}]},{"osd":1,"last update":"Sun Nov 5 08:29:47 2023","interfaces":[{"interface":"back","average":{"1min":15.435,"5min":20.401,"15min":23.806999999999999},"min":{"1min":7.9909999999999997,"5min":5.4720000000000004,"15min":5.4720000000000004},"max":{"1min":53.835999999999999,"5min":226.23500000000001,"15min":286.072},"last":16.780999999999999},{"interface":"front","average":{"1min":13.073,"5min":18.385999999999999,"15min":23.117999999999999},"min":{"1min":7.141,"5min":5.6980000000000004,"15min":5.6980000000000004},"max":{"1min":36.954999999999998,"5min":168.25899999999999,"15min":309.512},"last":7.5209999999999999}]},{"osd":2,"last update":"Sun Nov 5 08:29:47 2023","interfaces":[{"interface":"back","average":{"1min":21.117999999999999,"5min":21.593,"15min":24.420000000000002},"min":{"1min":9.5980000000000008,"5min":7.0030000000000001,"15min":6.6390000000000002},"max":{"1min":70.394000000000005,"5min":177.25,"15min":205.483},"last":9.5980000000000008},{"interface":"front","average":{"1min":31.692,"5min":30.047000000000001,"15min":29.448},"min":{"1min":12.19,"5min":9.4179999999999993,"15min":8.8000000000000007},"max":{"1min":202.39400000000001,"5min":335.95100000000002,"15min":335.95100000000002},"last":15.946}]},{"osd":3,"last update":"Sun Nov 5 08:29:47 2023","interfaces":[{"interface":"back","average":{"1min":18.739999999999998,"5min":19.548999999999999,"15min":25.298999999999999},"min":{"1min":6.6719999999999997,"5min":6.4909999999999997,"15min":6.4909999999999997},"max":{"1min":134.023,"5min":175.47300000000001,"15min":372.54199999999997},"last":17.582000000000001},{"interface":"front","average":{"1min":25.469000000000001,"5min":23.707000000000001,"15min":20.501999999999999},"min":{"1min":8.7289999999999992,"5min":6.2000000000000002,"15min":6.0069999999999997},"max":{"1min":135.262,"5min":152.446,"15min":273.34300000000002},"last":10.170999999999999}]},{"osd":4,"last update":"Sun Nov 5 08:29:47 2023","interfaces":[{"interface":"back","average":{"1min":13.807,"5min":18.373000000000001,"15min":18.521000000000001},"min":{"1min":7.2670000000000003,"5min":6.468,"15min":6.468},"max":{"1min":40.752000000000002,"5min":138.107,"15min":211},"last":11.319000000000001},{"interface":"front","average":{"1min":17.079999999999998,"5min":21.847999999999999,"15min":22.251999999999999},"min":{"1min":10.082000000000001,"5min":7.6790000000000003,"15min":7.5670000000000002},"max":{"1min":51.920999999999999,"5min":178.578,"15min":255.61600000000001},"last":12.006}]},{"osd":5,"last update":"Sun Nov 5 08:29:47 2023","interfaces":[{"interface":"back","average":{"1min":14.500999999999999,"5min":20.395,"15min":25.998000000000001},"min":{"1min":8.4870000000000001,"5min":6.4169999999999998,"15min":6.4169999999999998},"max":{"1min":37.595999999999997,"5min":121.566,"15min":915.64300000000003},"last":8.9719999999999995},{"interface":"front","average":{"1min":27.268999999999998,"5min":29.074000000000002,"15min":33.276000000000003},"min":{"1min":10.992000000000001,"5min":10.992000000000001,"15min":9.5489999999999995},"max":{"1min":168.72499999999999,"5min":171.06899999999999,"15min":928.67899999999997},"last":18.852}]},{"osd":7,"last update":"Sun Nov 5 08:29:47 2023","interfaces":[{"interface":"back","average":{"1min":21.152000000000001,"5min":23.134,"15min":23.582000000000001},"min":{"1min":10.538,"5min":7.3730000000000002,"15min":7.3730000000000002},"max":{"1min":103.03400000000001,"5min":167.63800000000001,"15min":212.917},"last":14.013},{"interface":"front","average":{"1min":22.355,"5min":22.393000000000001,"15min":24.632000000000001},"min":{"1min":8.3759999999999994,"5min":8.3759999999999994,"15min":7.3259999999999996},"max":{"1min":91.799999999999997,"5min":182.375,"15min":222.44499999999999},"last":12.651999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-05T08:29:55.153 INFO:tasks.ceph:pgid 12.9 last_scrub_stamp 2023-11-05T08:08:08.520104+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=5, tm_hour=8, tm_min=8, tm_sec=8, tm_wday=6, tm_yday=309, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=5, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=309, tm_isdst=0) 2023-11-05T08:29:55.154 INFO:tasks.ceph:pgid 12.f last_scrub_stamp 2023-11-05T08:08:08.520104+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=5, tm_hour=8, tm_min=8, tm_sec=8, tm_wday=6, tm_yday=309, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=5, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=309, tm_isdst=0) 2023-11-05T08:29:55.154 INFO:tasks.ceph:pgid 12.d last_scrub_stamp 2023-11-05T08:08:08.520104+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=5, tm_hour=8, tm_min=8, tm_sec=8, tm_wday=6, tm_yday=309, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=5, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=309, tm_isdst=0) 2023-11-05T08:29:55.155 INFO:tasks.ceph:pgid 12.1f last_scrub_stamp 2023-11-05T08:08:08.520104+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=5, tm_hour=8, tm_min=8, tm_sec=8, tm_wday=6, tm_yday=309, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=5, tm_hour=8, tm_min=29, tm_sec=25, tm_wday=6, tm_yday=309, tm_isdst=0) 2023-11-05T08:29:55.155 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-05T08:30:02.751 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:24:05.867 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:30:02.753 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:24:05.869 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:30:02.770 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:24:05.886 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:30:02.803 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:24:05.877 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:30:02.805 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:24:05.880 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:30:02.808 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:24:05.924 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:30:02.810 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:24:05.926 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:30:02.821 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:24:05.896 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:30:02.826 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:24:05.942 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:30:11.536 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:24:14.652 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:30:11.542 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:24:14.658 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:30:11.558 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:24:14.674 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:30:11.591 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:24:14.665 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:30:11.594 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:24:14.669 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:30:11.595 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:24:14.710 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:30:11.597 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:24:14.713 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:30:11.606 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:24:14.681 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:30:11.613 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:24:14.729 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:30:12.147 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:24:15.221 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:30:12.147 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:24:15.222 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:30:12.155 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:24:15.230 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:30:12.184 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:24:15.299 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:30:12.184 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:24:15.300 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:30:12.193 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:24:15.309 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:30:12.212 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:24:15.328 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:30:12.213 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:24:15.329 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:30:12.222 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:24:15.337 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:30:15.156 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-05T08:30:15.276 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.276+0000 7f5193fb0640 10 monclient: get_monmap_and_config 2023-11-05T08:30:15.277 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.276+0000 7f5193fb0640 10 monclient: build_initial_monmap 2023-11-05T08:30:15.277 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.276+0000 7f5193fb0640 10 monclient: monmap: 2023-11-05T08:30:15.277 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:30:15.277 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:30:15.277 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:30:15.276959+0000 2023-11-05T08:30:15.278 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:30:15.276959+0000 2023-11-05T08:30:15.278 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:30:15.278 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:30:15.278 INFO:teuthology.orchestra.run.smithi052.stderr:0: v1:172.21.15.52:6789/0 mon.noname-a-legacy 2023-11-05T08:30:15.278 INFO:teuthology.orchestra.run.smithi052.stderr:1: v1:172.21.15.156:6789/0 mon.noname-c-legacy 2023-11-05T08:30:15.279 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-b 2023-11-05T08:30:15.279 INFO:teuthology.orchestra.run.smithi052.stderr:3: v2:172.21.15.52:3300/0 mon.noname-a 2023-11-05T08:30:15.279 INFO:teuthology.orchestra.run.smithi052.stderr:4: v2:172.21.15.156:3300/0 mon.noname-c 2023-11-05T08:30:15.279 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:30:15.281 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.277+0000 7f5193fb0640 1 Processor -- start 2023-11-05T08:30:15.282 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.277+0000 7f5193fb0640 1 -- start start 2023-11-05T08:30:15.282 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.277+0000 7f5193fb0640 10 monclient: init 2023-11-05T08:30:15.282 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.277+0000 7f5193fb0640 10 monclient: _reopen_session rank -1 2023-11-05T08:30:15.282 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.277+0000 7f5193fb0640 10 monclient: _add_conns ranks=[2,4,0,1,3] 2023-11-05T08:30:15.282 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.277+0000 7f5193fb0640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f518c06bc90 0x7f518c071460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:30:15.283 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.277+0000 7f5193fb0640 10 monclient(hunting): picked mon.noname-b con 0x7f518c06bc90 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:30:15.283 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.277+0000 7f5193fb0640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f518c06c070 0x7f518c0719a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:30:15.283 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.277+0000 7f5193fb0640 10 monclient(hunting): picked mon.noname-c con 0x7f518c06c070 addr v2:172.21.15.156:3300/0 2023-11-05T08:30:15.283 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.277+0000 7f5193fb0640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f518c141a60 addr v1:172.21.15.52:6789/0 2023-11-05T08:30:15.283 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.278+0000 7f5193fb0640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f518c06b3c0 con 0x7f518c141a60 2023-11-05T08:30:15.283 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.278+0000 7f5193fb0640 10 monclient(hunting): start opening mon connection 2023-11-05T08:30:15.284 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.278+0000 7f5193fb0640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f518c06c740 con 0x7f518c06c070 2023-11-05T08:30:15.284 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.278+0000 7f5193fb0640 10 monclient(hunting): start opening mon connection 2023-11-05T08:30:15.284 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.278+0000 7f5193fb0640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f518c06b0e0 con 0x7f518c06bc90 2023-11-05T08:30:15.284 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.278+0000 7f5193fb0640 10 monclient(hunting): _renew_subs 2023-11-05T08:30:15.284 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.278+0000 7f5193fb0640 10 monclient(hunting): authenticate will time out at 2761.482943s 2023-11-05T08:30:15.285 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.278+0000 7f519254d640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f518c141a60 0x7f518c141ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:41012/0 (socket says 172.21.15.52:41012) 2023-11-05T08:30:15.285 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.278+0000 7f519254d640 1 -- 172.21.15.52:0/3699357414 learned_addr learned my addr 172.21.15.52:0/3699357414 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-11-05T08:30:15.285 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.278+0000 7f5191d4c640 1 --2- 172.21.15.52:0/3699357414 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f518c06bc90 0x7f518c071460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:30:15.285 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.278+0000 7f519154b640 1 --2- 172.21.15.52:0/3699357414 >> v2:172.21.15.156:3300/0 conn(0x7f518c06c070 0x7f518c0719a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:30:15.285 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.279+0000 7f5191d4c640 10 monclient(hunting): get_auth_request con 0x7f518c06bc90 auth_method 0 2023-11-05T08:30:15.286 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.279+0000 7f5191d4c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:30:15.286 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.279+0000 7f5191d4c640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:30:15.286 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.279+0000 7f5191d4c640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:30:15.286 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.279+0000 7f519154b640 10 monclient(hunting): get_auth_request con 0x7f518c06c070 auth_method 0 2023-11-05T08:30:15.286 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.279+0000 7f519154b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:30:15.286 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.279+0000 7f519154b640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:30:15.287 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.279+0000 7f519154b640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:30:15.287 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.279+0000 7f519154b640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:30:15.287 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.279+0000 7f519154b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:30:15.287 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.279+0000 7f519154b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:30:15.287 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.279+0000 7f5191d4c640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:30:15.288 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.279+0000 7f5191d4c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:30:15.288 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.279+0000 7f5191d4c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:30:15.288 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.281+0000 7f519154b640 10 monclient(hunting): handle_auth_done global_id 20785 payload 274 2023-11-05T08:30:15.288 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.281+0000 7f519154b640 1 -- 172.21.15.52:0/3699357414 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f518c06bc90 msgr2=0x7f518c071460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-05T08:30:15.288 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.281+0000 7f519154b640 1 --2- 172.21.15.52:0/3699357414 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f518c06bc90 0x7f518c071460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:30:15.289 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.281+0000 7f519154b640 1 -- 172.21.15.52:0/3699357414 >> v1:172.21.15.52:6789/0 conn(0x7f518c141a60 legacy=0x7f518c141ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:30:15.289 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.281+0000 7f519154b640 10 monclient: _finish_hunting 0 2023-11-05T08:30:15.289 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.281+0000 7f519154b640 1 monclient: found mon.noname-c 2023-11-05T08:30:15.289 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.281+0000 7f519154b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:30:15.289 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.281+0000 7f519154b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.156:3300/0 2023-11-05T08:30:15.290 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.281+0000 7f519154b640 1 -- 172.21.15.52:0/3699357414 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f518c0abde0 con 0x7f518c06c070 2023-11-05T08:30:15.293 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.283+0000 7f519154b640 1 --2- 172.21.15.52:0/3699357414 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f518c06c070 0x7f518c0719a0 secure :-1 s=READY pgs=5030 cs=0 l=1 rev1=1 crypto rx=0x7f517c0097a0 tx=0x7f517c02b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bbe7797dc41a7a3 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:30:15.293 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.287+0000 7f5190d4a640 1 -- 172.21.15.52:0/3699357414 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f517c02e070 con 0x7f518c06c070 2023-11-05T08:30:15.293 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.287+0000 7f5190d4a640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:30:15.294 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.287+0000 7f5190d4a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-11-05T08:30:15.294 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.287+0000 7f5190d4a640 10 monclient: dump: 2023-11-05T08:30:15.294 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:30:15.294 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:30:15.294 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:30:15.295 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:30:15.295 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:30:15.295 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:30:15.295 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:30:15.295 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:30:15.296 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:30:15.296 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:30:15.296 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.287+0000 7f5190d4a640 10 monclient: _finish_auth 0 2023-11-05T08:30:15.296 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.287+0000 7f5190d4a640 10 monclient: _check_auth_tickets 2023-11-05T08:30:15.296 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.287+0000 7f5190d4a640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:30:15.297 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.287+0000 7f5190d4a640 1 -- 172.21.15.52:0/3699357414 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f517c0315a0 con 0x7f518c06c070 2023-11-05T08:30:15.297 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.287+0000 7f5190d4a640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:30:15.297 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.287+0000 7f5190d4a640 1 -- 172.21.15.52:0/3699357414 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f517c031930 con 0x7f518c06c070 2023-11-05T08:30:15.297 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.287+0000 7f5193fb0640 5 monclient: authenticate success, global_id 20785 2023-11-05T08:30:15.297 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.287+0000 7f5193fb0640 10 monclient: get_monmap_and_config success 2023-11-05T08:30:15.298 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.287+0000 7f5193fb0640 4 set_mon_vals no callback set 2023-11-05T08:30:15.298 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.287+0000 7f5190d4a640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:30:15.298 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.287+0000 7f5190d4a640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-05T08:30:15.298 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.287+0000 7f5190d4a640 10 monclient: dump: 2023-11-05T08:30:15.298 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:30:15.299 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:30:15.299 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:30:15.299 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:30:15.299 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:30:15.299 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:30:15.300 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:30:15.300 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:30:15.300 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:30:15.300 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:30:15.300 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.287+0000 7f5193fb0640 10 monclient: shutdown 2023-11-05T08:30:15.301 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.287+0000 7f5193fb0640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:30:15.301 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.287+0000 7f5193fb0640 1 -- 172.21.15.52:0/3699357414 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f518c06c070 msgr2=0x7f518c0719a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:30:15.301 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.287+0000 7f5193fb0640 1 --2- 172.21.15.52:0/3699357414 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f518c06c070 0x7f518c0719a0 secure :-1 s=READY pgs=5030 cs=0 l=1 rev1=1 crypto rx=0x7f517c0097a0 tx=0x7f517c02b840 comp rx=0 tx=0).stop 2023-11-05T08:30:15.301 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.287+0000 7f5193fb0640 1 -- 172.21.15.52:0/3699357414 shutdown_connections 2023-11-05T08:30:15.301 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.287+0000 7f5193fb0640 1 --2- 172.21.15.52:0/3699357414 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f518c06c070 0x7f518c0719a0 unknown :-1 s=CLOSED pgs=5030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:30:15.302 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.287+0000 7f5193fb0640 1 --2- 172.21.15.52:0/3699357414 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f518c06bc90 0x7f518c071460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:30:15.302 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.287+0000 7f5193fb0640 1 -- 172.21.15.52:0/3699357414 >> 172.21.15.52:0/3699357414 conn(0x7f518c0b5050 msgr2=0x7f518c0b5460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:30:15.302 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.287+0000 7f5193fb0640 1 -- 172.21.15.52:0/3699357414 shutdown_connections 2023-11-05T08:30:15.302 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.287+0000 7f5193fb0640 1 -- 172.21.15.52:0/3699357414 wait complete. 2023-11-05T08:30:15.302 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.288+0000 7f5193fb0640 10 monclient: build_initial_monmap 2023-11-05T08:30:15.303 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.288+0000 7f5193fb0640 10 monclient: monmap: 2023-11-05T08:30:15.303 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:30:15.303 INFO:teuthology.orchestra.run.smithi052.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-05T08:30:15.303 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 0.000000 2023-11-05T08:30:15.303 INFO:teuthology.orchestra.run.smithi052.stderr:created 0.000000 2023-11-05T08:30:15.304 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:30:15.304 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:30:15.304 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.noname-a 2023-11-05T08:30:15.304 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.noname-b 2023-11-05T08:30:15.304 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-c 2023-11-05T08:30:15.305 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:30:15.305 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.288+0000 7f5193fb0640 1 librados: starting msgr at 2023-11-05T08:30:15.305 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.288+0000 7f5193fb0640 1 librados: starting objecter 2023-11-05T08:30:15.305 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.289+0000 7f5193fb0640 1 Processor -- start 2023-11-05T08:30:15.305 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.289+0000 7f5193fb0640 1 -- start start 2023-11-05T08:30:15.306 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.289+0000 7f5193fb0640 1 librados: setting wanted keys 2023-11-05T08:30:15.306 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.289+0000 7f5193fb0640 1 librados: calling monclient init 2023-11-05T08:30:15.306 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.289+0000 7f5193fb0640 10 monclient: init 2023-11-05T08:30:15.306 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.289+0000 7f5193fb0640 10 monclient: _reopen_session rank -1 2023-11-05T08:30:15.306 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.289+0000 7f5193fb0640 10 monclient: _add_conns ranks=[0,2,1] 2023-11-05T08:30:15.307 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.289+0000 7f5193fb0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f518c06bc90 0x7f518c1d9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:30:15.307 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.289+0000 7f5193fb0640 10 monclient(hunting): picked mon.noname-a con 0x7f518c06bc90 addr [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] 2023-11-05T08:30:15.307 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.289+0000 7f5193fb0640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f518c141a60 0x7f518c13d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:30:15.307 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.289+0000 7f5193fb0640 10 monclient(hunting): picked mon.noname-c con 0x7f518c141a60 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:30:15.307 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.289+0000 7f5193fb0640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f518c1da210 0x7f518c13db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:30:15.308 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.289+0000 7f5193fb0640 10 monclient(hunting): picked mon.noname-b con 0x7f518c1da210 addr [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] 2023-11-05T08:30:15.308 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.289+0000 7f5193fb0640 10 monclient(hunting): start opening mon connection 2023-11-05T08:30:15.308 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.289+0000 7f5193fb0640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f518c141750 con 0x7f518c06bc90 2023-11-05T08:30:15.308 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.289+0000 7f5193fb0640 10 monclient(hunting): start opening mon connection 2023-11-05T08:30:15.308 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.289+0000 7f5193fb0640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f518c1da7a0 con 0x7f518c1da210 2023-11-05T08:30:15.309 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.289+0000 7f5193fb0640 10 monclient(hunting): start opening mon connection 2023-11-05T08:30:15.310 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.289+0000 7f5193fb0640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f518c13e0c0 con 0x7f518c141a60 2023-11-05T08:30:15.310 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.289+0000 7f5193fb0640 10 monclient(hunting): _renew_subs 2023-11-05T08:30:15.310 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.289+0000 7f5193fb0640 10 monclient(hunting): authenticate will time out at 2761.494619s 2023-11-05T08:30:15.310 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.290+0000 7f5191d4c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f518c06bc90 0x7f518c1d9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:30:15.311 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.290+0000 7f519154b640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f518c141a60 0x7f518c13d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:30:15.311 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.290+0000 7f519254d640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f518c1da210 0x7f518c13db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:30:15.311 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.290+0000 7f5191d4c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f518c06bc90 0x7f518c1d9cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36278/0 (socket says 172.21.15.52:36278) 2023-11-05T08:30:15.311 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.290+0000 7f5191d4c640 1 -- 172.21.15.52:0/2976358848 learned_addr learned my addr 172.21.15.52:0/2976358848 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-11-05T08:30:15.312 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.290+0000 7f5191d4c640 10 monclient(hunting): get_auth_request con 0x7f518c06bc90 auth_method 0 2023-11-05T08:30:15.312 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.290+0000 7f5191d4c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:30:15.312 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.290+0000 7f5191d4c640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:30:15.312 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.290+0000 7f5191d4c640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:30:15.312 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.290+0000 7f519154b640 10 monclient(hunting): get_auth_request con 0x7f518c141a60 auth_method 0 2023-11-05T08:30:15.313 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.290+0000 7f519154b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:30:15.313 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.290+0000 7f519154b640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:30:15.313 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.290+0000 7f519154b640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:30:15.313 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.290+0000 7f519254d640 10 monclient(hunting): get_auth_request con 0x7f518c1da210 auth_method 0 2023-11-05T08:30:15.313 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.290+0000 7f519254d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:30:15.314 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.290+0000 7f519254d640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:30:15.314 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.290+0000 7f519254d640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:30:15.314 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.291+0000 7f5191d4c640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:30:15.314 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.291+0000 7f5191d4c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:30:15.314 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.291+0000 7f5191d4c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:30:15.315 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.291+0000 7f519154b640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:30:15.315 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.291+0000 7f519154b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:30:15.315 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.291+0000 7f519154b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:30:15.315 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.291+0000 7f519254d640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:30:15.315 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.291+0000 7f519254d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:30:15.315 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.291+0000 7f519254d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:30:15.317 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.293+0000 7f5191d4c640 10 monclient(hunting): handle_auth_done global_id 15783 payload 824 2023-11-05T08:30:15.317 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.294+0000 7f5191d4c640 1 -- 172.21.15.52:0/2976358848 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f518c141a60 msgr2=0x7f518c13d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:30:15.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.294+0000 7f5191d4c640 1 --2- 172.21.15.52:0/2976358848 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f518c141a60 0x7f518c13d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:30:15.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.294+0000 7f5191d4c640 1 -- 172.21.15.52:0/2976358848 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f518c1da210 msgr2=0x7f518c13db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:30:15.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.294+0000 7f5191d4c640 1 --2- 172.21.15.52:0/2976358848 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f518c1da210 0x7f518c13db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:30:15.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.294+0000 7f5191d4c640 10 monclient: _finish_hunting 0 2023-11-05T08:30:15.318 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.294+0000 7f5191d4c640 1 monclient: found mon.noname-a 2023-11-05T08:30:15.319 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.294+0000 7f5191d4c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:30:15.319 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.294+0000 7f5191d4c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.52:3300/0 2023-11-05T08:30:15.319 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.294+0000 7f5191d4c640 1 -- 172.21.15.52:0/2976358848 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f517c009400 con 0x7f518c06bc90 2023-11-05T08:30:15.319 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.296+0000 7f5191d4c640 1 --2- 172.21.15.52:0/2976358848 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f518c06bc90 0x7f518c1d9cd0 secure :-1 s=READY pgs=3069 cs=0 l=1 rev1=1 crypto rx=0x7f518400e870 tx=0x7f518400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:30:15.319 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.296+0000 7f51827fc640 10 client.?.objecter ms_handle_connect 0x7f518c06bc90 2023-11-05T08:30:15.320 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.296+0000 7f51827fc640 10 client.?.objecter resend_mon_ops 2023-11-05T08:30:15.320 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.300+0000 7f51827fc640 1 -- 172.21.15.52:0/2976358848 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51840094f0 con 0x7f518c06bc90 2023-11-05T08:30:15.320 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.300+0000 7f51827fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:30:15.320 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.300+0000 7f51827fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-11-05T08:30:15.320 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.300+0000 7f51827fc640 10 monclient: dump: 2023-11-05T08:30:15.321 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:30:15.321 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:30:15.321 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:30:15.321 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:30:15.321 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:30:15.322 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:30:15.322 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:30:15.322 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:30:15.322 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:30:15.322 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:30:15.322 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.300+0000 7f51827fc640 10 monclient: _finish_auth 0 2023-11-05T08:30:15.323 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.300+0000 7f51827fc640 10 monclient: _check_auth_tickets 2023-11-05T08:30:15.323 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.300+0000 7f51827fc640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:30:15.323 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.300+0000 7f51827fc640 1 -- 172.21.15.52:0/2976358848 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f518400c940 con 0x7f518c06bc90 2023-11-05T08:30:15.323 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.300+0000 7f5193fb0640 5 monclient: authenticate success, global_id 15783 2023-11-05T08:30:15.323 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.300+0000 7f5193fb0640 10 monclient: _renew_subs 2023-11-05T08:30:15.324 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.300+0000 7f5193fb0640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.52:3300/0 2023-11-05T08:30:15.324 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.300+0000 7f5193fb0640 1 -- 172.21.15.52:0/2976358848 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f518c0aaf40 con 0x7f518c06bc90 2023-11-05T08:30:15.324 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.300+0000 7f51827fc640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:30:15.324 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.300+0000 7f51827fc640 1 -- 172.21.15.52:0/2976358848 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f518400ccf0 con 0x7f518c06bc90 2023-11-05T08:30:15.324 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.300+0000 7f51827fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:30:15.324 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.300+0000 7f51827fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-11-05T08:30:15.325 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.300+0000 7f51827fc640 10 monclient: dump: 2023-11-05T08:30:15.325 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:30:15.325 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:30:15.325 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:30:15.325 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:30:15.326 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:30:15.326 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:30:15.326 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:30:15.326 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:30:15.326 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:30:15.327 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:30:15.327 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.300+0000 7f5183fff640 4 set_mon_vals no callback set 2023-11-05T08:30:15.327 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.300+0000 7f5193fb0640 10 client.15783.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-05T08:30:15.327 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.300+0000 7f5193fb0640 10 monclient: _renew_subs 2023-11-05T08:30:15.327 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.300+0000 7f5193fb0640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.52:3300/0 2023-11-05T08:30:15.328 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.300+0000 7f5193fb0640 1 -- 172.21.15.52:0/2976358848 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f518c0acb30 con 0x7f518c06bc90 2023-11-05T08:30:15.328 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.300+0000 7f5193fb0640 1 librados: init done 2023-11-05T08:30:15.328 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.301+0000 7f5193fb0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-05T08:30:15.328 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.301+0000 7f5193fb0640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:30:15.328 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.301+0000 7f5193fb0640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.52:3300/0 2023-11-05T08:30:15.328 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.301+0000 7f5193fb0640 1 -- 172.21.15.52:0/2976358848 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f518c1da960 con 0x7f518c06bc90 2023-11-05T08:30:15.329 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.320+0000 7f51827fc640 1 -- 172.21.15.52:0/2976358848 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f5184013470 con 0x7f518c06bc90 2023-11-05T08:30:15.330 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.321+0000 7f51827fc640 1 --2- 172.21.15.52:0/2976358848 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f517006c850 0x7f517006ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:30:15.330 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.321+0000 7f519154b640 1 --2- 172.21.15.52:0/2976358848 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f517006c850 0x7f517006ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:30:15.330 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.321+0000 7f519154b640 10 monclient: get_auth_request con 0x7f517006c850 auth_method 0 2023-11-05T08:30:15.330 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.322+0000 7f519154b640 1 --2- 172.21.15.52:0/2976358848 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f517006c850 0x7f517006ed10 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f517c036000 tx=0x7f517c03d040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:30:15.330 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.322+0000 7f51827fc640 10 client.15783.objecter ms_handle_connect 0x7f517006c850 2023-11-05T08:30:15.574 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.574+0000 7f51827fc640 1 -- 172.21.15.52:0/2976358848 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(932..932 src has 619..932) v4 ==== 6193+0+0 (secure 0 0 0) 0x7f5184058c20 con 0x7f518c06bc90 2023-11-05T08:30:15.575 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.574+0000 7f51827fc640 10 client.15783.objecter ms_dispatch 0x7f518c000b90 osd_map(932..932 src has 619..932) v4 2023-11-05T08:30:15.575 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.574+0000 7f51827fc640 3 client.15783.objecter handle_osd_map got epochs [932,932] > 0 2023-11-05T08:30:15.575 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.574+0000 7f51827fc640 3 client.15783.objecter handle_osd_map decoding full epoch 932 2023-11-05T08:30:15.575 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.574+0000 7f51827fc640 20 client.15783.objecter dump_active .. 0 homeless 2023-11-05T08:30:15.576 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.574+0000 7f51827fc640 1 -- 172.21.15.52:0/2976358848 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5184054f60 con 0x7f518c06bc90 2023-11-05T08:30:15.576 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.574+0000 7f51827fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:30:15.576 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.574+0000 7f51827fc640 10 monclient: _finish_command 1 = system:0 2023-11-05T08:30:15.781 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.781+0000 7f5193fb0640 1 -- 172.21.15.52:0/2976358848 --> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f518c0af360 con 0x7f517006c850 2023-11-05T08:30:15.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.786+0000 7f51827fc640 1 -- 172.21.15.52:0/2976358848 <== mgr.4108 v2:172.21.15.156:6800/3320012339 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+151754 (secure 0 0 0) 0x7f517c0319d0 con 0x7f517006c850 2023-11-05T08:30:15.788 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-11-05T08:30:15.788 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2023-11-05T08:30:15.790 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.789+0000 7f5193fb0640 10 librados: watch_flush enter 2023-11-05T08:30:15.790 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.789+0000 7f5193fb0640 10 librados: watch_flush exit 2023-11-05T08:30:15.791 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.789+0000 7f5193fb0640 20 client.15783.objecter shutdown clearing up homeless session... 2023-11-05T08:30:15.791 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.789+0000 7f5193fb0640 10 client.15783.objecter successfully canceled tick 2023-11-05T08:30:15.791 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.789+0000 7f5193fb0640 1 -- 172.21.15.52:0/2976358848 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f517006c850 msgr2=0x7f517006ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:30:15.791 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.789+0000 7f5193fb0640 1 --2- 172.21.15.52:0/2976358848 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f517006c850 0x7f517006ed10 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f517c036000 tx=0x7f517c03d040 comp rx=0 tx=0).stop 2023-11-05T08:30:15.791 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.789+0000 7f5193fb0640 10 monclient: shutdown 2023-11-05T08:30:15.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.789+0000 7f5193fb0640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:30:15.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.789+0000 7f5193fb0640 1 -- 172.21.15.52:0/2976358848 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f518c06bc90 msgr2=0x7f518c1d9cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:30:15.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.789+0000 7f5193fb0640 1 --2- 172.21.15.52:0/2976358848 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f518c06bc90 0x7f518c1d9cd0 secure :-1 s=READY pgs=3069 cs=0 l=1 rev1=1 crypto rx=0x7f518400e870 tx=0x7f518400ed30 comp rx=0 tx=0).stop 2023-11-05T08:30:15.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.789+0000 7f5193fb0640 1 -- 172.21.15.52:0/2976358848 shutdown_connections 2023-11-05T08:30:15.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.789+0000 7f5193fb0640 1 --2- 172.21.15.52:0/2976358848 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f517006c850 0x7f517006ed10 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:30:15.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.789+0000 7f5193fb0640 1 --2- 172.21.15.52:0/2976358848 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f518c1da210 0x7f518c13db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:30:15.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.789+0000 7f5193fb0640 1 --2- 172.21.15.52:0/2976358848 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f518c141a60 0x7f518c13d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:30:15.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.789+0000 7f5193fb0640 1 --2- 172.21.15.52:0/2976358848 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f518c06bc90 0x7f518c1d9cd0 unknown :-1 s=CLOSED pgs=3069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:30:15.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.789+0000 7f5193fb0640 1 -- 172.21.15.52:0/2976358848 >> 172.21.15.52:0/2976358848 conn(0x7f518c0b5050 msgr2=0x7f518c1cc160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:30:15.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.789+0000 7f5193fb0640 1 -- 172.21.15.52:0/2976358848 shutdown_connections 2023-11-05T08:30:15.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.789+0000 7f5193fb0640 1 -- 172.21.15.52:0/2976358848 wait complete. 2023-11-05T08:30:15.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.789+0000 7f5193fb0640 1 librados: shutdown 2023-11-05T08:30:15.801 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":1636,"stamp":"2023-11-05T08:30:15.492996+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459285,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":102,"num_read_kb":88,"num_write":120,"num_write_kb":1379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":86,"ondisk_log_size":86,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":522328,"kb_used_data":46680,"kb_used_omap":12,"kb_used_meta":475571,"kb_avail":754452392,"statfs":{"total":773094113280,"available":772559249408,"internally_reserved":0,"allocated":47800320,"data_stored":25897490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":486985272},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002809"},"pg_stats":[{"pgid":"12.10","version":"0'0","reported_seq":891,"reported_epoch":932,"state":"active+clean","last_fresh":"2023-11-05T08:29:38.803602+0000","last_change":"2023-11-05T08:29:38.804678+0000","last_active":"2023-11-05T08:29:38.803602+0000","last_peered":"2023-11-05T08:29:38.803602+0000","last_clean":"2023-11-05T08:29:38.803602+0000","last_became_active":"2023-11-05T08:08:27.684720+0000","last_became_peered":"2023-11-05T08:08:27.684720+0000","last_unstale":"2023-11-05T08:29:38.803602+0000","last_undegraded":"2023-11-05T08:29:38.803602+0000","last_fullsized":"2023-11-05T08:29:38.803602+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:29:38.802137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:29:38.802137+0000","last_clean_scrub_stamp":"2023-11-05T08:29:38.802137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T11:31:47.977381+0000","scrub_duration":0.031595362000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":890,"reported_epoch":932,"state":"active+clean","last_fresh":"2023-11-05T08:29:30.431006+0000","last_change":"2023-11-05T08:29:30.432912+0000","last_active":"2023-11-05T08:29:30.431006+0000","last_peered":"2023-11-05T08:29:30.431006+0000","last_clean":"2023-11-05T08:29:30.431006+0000","last_became_active":"2023-11-05T08:08:12.972471+0000","last_became_peered":"2023-11-05T08:08:12.972471+0000","last_unstale":"2023-11-05T08:29:30.431006+0000","last_undegraded":"2023-11-05T08:29:30.431006+0000","last_fullsized":"2023-11-05T08:29:30.431006+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:29:30.425815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:29:30.425815+0000","last_clean_scrub_stamp":"2023-11-05T08:29:30.425815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T12:04:08.852166+0000","scrub_duration":0.126394758,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":891,"reported_epoch":932,"state":"active+clean","last_fresh":"2023-11-05T08:29:33.428669+0000","last_change":"2023-11-05T08:29:33.432887+0000","last_active":"2023-11-05T08:29:33.428669+0000","last_peered":"2023-11-05T08:29:33.428669+0000","last_clean":"2023-11-05T08:29:33.428669+0000","last_became_active":"2023-11-05T08:08:20.791671+0000","last_became_peered":"2023-11-05T08:08:20.791671+0000","last_unstale":"2023-11-05T08:29:33.428669+0000","last_undegraded":"2023-11-05T08:29:33.428669+0000","last_fullsized":"2023-11-05T08:29:33.428669+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:29:33.427361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:29:33.427361+0000","last_clean_scrub_stamp":"2023-11-05T08:29:33.427361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T09:09:13.389408+0000","scrub_duration":0.036597826999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":877,"reported_epoch":932,"state":"active+clean","last_fresh":"2023-11-05T08:29:34.200496+0000","last_change":"2023-11-05T08:29:34.201646+0000","last_active":"2023-11-05T08:29:34.200496+0000","last_peered":"2023-11-05T08:29:34.200496+0000","last_clean":"2023-11-05T08:29:34.200496+0000","last_became_active":"2023-11-05T08:08:26.449074+0000","last_became_peered":"2023-11-05T08:08:26.449074+0000","last_unstale":"2023-11-05T08:29:34.200496+0000","last_undegraded":"2023-11-05T08:29:34.200496+0000","last_fullsized":"2023-11-05T08:29:34.200496+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:29:34.199020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:29:34.199020+0000","last_clean_scrub_stamp":"2023-11-05T08:29:34.199020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T09:45:25.860493+0000","scrub_duration":0.071695249000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":903,"reported_epoch":932,"state":"active+clean","last_fresh":"2023-11-05T08:29:38.447628+0000","last_change":"2023-11-05T08:29:38.448729+0000","last_active":"2023-11-05T08:29:38.447628+0000","last_peered":"2023-11-05T08:29:38.447628+0000","last_clean":"2023-11-05T08:29:38.447628+0000","last_became_active":"2023-11-05T08:08:32.275587+0000","last_became_peered":"2023-11-05T08:08:32.275587+0000","last_unstale":"2023-11-05T08:29:38.447628+0000","last_undegraded":"2023-11-05T08:29:38.447628+0000","last_fullsized":"2023-11-05T08:29:38.447628+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:29:38.446240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:29:38.446240+0000","last_clean_scrub_stamp":"2023-11-05T08:29:38.446240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T11:29:15.846147+0000","scrub_duration":0.041710653,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":890,"reported_epoch":932,"state":"active+clean","last_fresh":"2023-11-05T08:29:32.400904+0000","last_change":"2023-11-05T08:29:32.400904+0000","last_active":"2023-11-05T08:29:32.400904+0000","last_peered":"2023-11-05T08:29:32.400904+0000","last_clean":"2023-11-05T08:29:32.400904+0000","last_became_active":"2023-11-05T08:08:15.950681+0000","last_became_peered":"2023-11-05T08:08:15.950681+0000","last_unstale":"2023-11-05T08:29:32.400904+0000","last_undegraded":"2023-11-05T08:29:32.400904+0000","last_fullsized":"2023-11-05T08:29:32.400904+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:29:32.394276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:29:32.394276+0000","last_clean_scrub_stamp":"2023-11-05T08:29:32.394276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T09:27:43.113988+0000","scrub_duration":0.049562779000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":889,"reported_epoch":932,"state":"active+clean","last_fresh":"2023-11-05T08:29:49.255210+0000","last_change":"2023-11-05T08:29:49.255210+0000","last_active":"2023-11-05T08:29:49.255210+0000","last_peered":"2023-11-05T08:29:49.255210+0000","last_clean":"2023-11-05T08:29:49.255210+0000","last_became_active":"2023-11-05T08:08:24.718463+0000","last_became_peered":"2023-11-05T08:08:24.718463+0000","last_unstale":"2023-11-05T08:29:49.255210+0000","last_undegraded":"2023-11-05T08:29:49.255210+0000","last_fullsized":"2023-11-05T08:29:49.255210+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:29:49.249489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:29:49.249489+0000","last_clean_scrub_stamp":"2023-11-05T08:29:49.249489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T14:33:24.509587+0000","scrub_duration":0.047040863000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":890,"reported_epoch":932,"state":"active+clean","last_fresh":"2023-11-05T08:29:37.434877+0000","last_change":"2023-11-05T08:29:37.434877+0000","last_active":"2023-11-05T08:29:37.434877+0000","last_peered":"2023-11-05T08:29:37.434877+0000","last_clean":"2023-11-05T08:29:37.434877+0000","last_became_active":"2023-11-05T08:08:13.341684+0000","last_became_peered":"2023-11-05T08:08:13.341684+0000","last_unstale":"2023-11-05T08:29:37.434877+0000","last_undegraded":"2023-11-05T08:29:37.434877+0000","last_fullsized":"2023-11-05T08:29:37.434877+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:29:37.431369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:29:37.431369+0000","last_clean_scrub_stamp":"2023-11-05T08:29:37.431369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T09:02:09.508128+0000","scrub_duration":0.069524574000000006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":903,"reported_epoch":932,"state":"active+clean","last_fresh":"2023-11-05T08:29:35.481475+0000","last_change":"2023-11-05T08:29:35.481475+0000","last_active":"2023-11-05T08:29:35.481475+0000","last_peered":"2023-11-05T08:29:35.481475+0000","last_clean":"2023-11-05T08:29:35.481475+0000","last_became_active":"2023-11-05T08:08:15.520030+0000","last_became_peered":"2023-11-05T08:08:15.520030+0000","last_unstale":"2023-11-05T08:29:35.481475+0000","last_undegraded":"2023-11-05T08:29:35.481475+0000","last_fullsized":"2023-11-05T08:29:35.481475+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:29:35.479100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:29:35.479100+0000","last_clean_scrub_stamp":"2023-11-05T08:29:35.479100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T10:58:24.058054+0000","scrub_duration":0.042875719,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":903,"reported_epoch":932,"state":"active+clean","last_fresh":"2023-11-05T08:29:37.542149+0000","last_change":"2023-11-05T08:29:37.542149+0000","last_active":"2023-11-05T08:29:37.542149+0000","last_peered":"2023-11-05T08:29:37.542149+0000","last_clean":"2023-11-05T08:29:37.542149+0000","last_became_active":"2023-11-05T08:08:15.871149+0000","last_became_peered":"2023-11-05T08:08:15.871149+0000","last_unstale":"2023-11-05T08:29:37.542149+0000","last_undegraded":"2023-11-05T08:29:37.542149+0000","last_fullsized":"2023-11-05T08:29:37.542149+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:29:37.539742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:29:37.539742+0000","last_clean_scrub_stamp":"2023-11-05T08:29:37.539742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T10:38:29.237901+0000","scrub_duration":0.067395031999999994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":889,"reported_epoch":932,"state":"active+clean","last_fresh":"2023-11-05T08:29:34.401334+0000","last_change":"2023-11-05T08:29:34.403298+0000","last_active":"2023-11-05T08:29:34.401334+0000","last_peered":"2023-11-05T08:29:34.401334+0000","last_clean":"2023-11-05T08:29:34.401334+0000","last_became_active":"2023-11-05T08:08:14.060255+0000","last_became_peered":"2023-11-05T08:08:14.060255+0000","last_unstale":"2023-11-05T08:29:34.401334+0000","last_undegraded":"2023-11-05T08:29:34.401334+0000","last_fullsized":"2023-11-05T08:29:34.401334+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:29:34.396928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:29:34.396928+0000","last_clean_scrub_stamp":"2023-11-05T08:29:34.396928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T16:18:33.820915+0000","scrub_duration":0.051130529000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":902,"reported_epoch":932,"state":"active+clean","last_fresh":"2023-11-05T08:29:36.460111+0000","last_change":"2023-11-05T08:29:36.461711+0000","last_active":"2023-11-05T08:29:36.460111+0000","last_peered":"2023-11-05T08:29:36.460111+0000","last_clean":"2023-11-05T08:29:36.460111+0000","last_became_active":"2023-11-05T08:08:15.726426+0000","last_became_peered":"2023-11-05T08:08:15.726426+0000","last_unstale":"2023-11-05T08:29:36.460111+0000","last_undegraded":"2023-11-05T08:29:36.460111+0000","last_fullsized":"2023-11-05T08:29:36.460111+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:29:36.458598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:29:36.458598+0000","last_clean_scrub_stamp":"2023-11-05T08:29:36.458598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T16:07:19.373018+0000","scrub_duration":0.087798622000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":892,"reported_epoch":932,"state":"active+clean","last_fresh":"2023-11-05T08:29:48.902826+0000","last_change":"2023-11-05T08:29:48.904021+0000","last_active":"2023-11-05T08:29:48.902826+0000","last_peered":"2023-11-05T08:29:48.902826+0000","last_clean":"2023-11-05T08:29:48.902826+0000","last_became_active":"2023-11-05T08:07:07.890422+0000","last_became_peered":"2023-11-05T08:07:07.890422+0000","last_unstale":"2023-11-05T08:29:48.902826+0000","last_undegraded":"2023-11-05T08:29:48.902826+0000","last_fullsized":"2023-11-05T08:29:48.902826+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:29:48.901297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:29:48.901297+0000","last_clean_scrub_stamp":"2023-11-05T08:29:48.901297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T14:00:43.952211+0000","scrub_duration":0.040935908,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":892,"reported_epoch":932,"state":"active+clean","last_fresh":"2023-11-05T08:29:51.863882+0000","last_change":"2023-11-05T08:29:51.863882+0000","last_active":"2023-11-05T08:29:51.863882+0000","last_peered":"2023-11-05T08:29:51.863882+0000","last_clean":"2023-11-05T08:29:51.863882+0000","last_became_active":"2023-11-05T08:08:38.362716+0000","last_became_peered":"2023-11-05T08:08:38.362716+0000","last_unstale":"2023-11-05T08:29:51.863882+0000","last_undegraded":"2023-11-05T08:29:51.863882+0000","last_fullsized":"2023-11-05T08:29:51.863882+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:29:51.849251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:29:51.849251+0000","last_clean_scrub_stamp":"2023-11-05T08:29:51.849251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T11:46:49.958862+0000","scrub_duration":0.040565457999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":896,"reported_epoch":932,"state":"active+clean","last_fresh":"2023-11-05T08:29:31.503474+0000","last_change":"2023-11-05T08:29:31.504598+0000","last_active":"2023-11-05T08:29:31.503474+0000","last_peered":"2023-11-05T08:29:31.503474+0000","last_clean":"2023-11-05T08:29:31.503474+0000","last_became_active":"2023-11-05T08:07:07.908128+0000","last_became_peered":"2023-11-05T08:07:07.908128+0000","last_unstale":"2023-11-05T08:29:31.503474+0000","last_undegraded":"2023-11-05T08:29:31.503474+0000","last_fullsized":"2023-11-05T08:29:31.503474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:29:31.502049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:29:31.502049+0000","last_clean_scrub_stamp":"2023-11-05T08:29:31.502049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T10:22:38.526293+0000","scrub_duration":0.042385156,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":904,"reported_epoch":932,"state":"active+clean","last_fresh":"2023-11-05T08:29:36.493529+0000","last_change":"2023-11-05T08:29:36.493529+0000","last_active":"2023-11-05T08:29:36.493529+0000","last_peered":"2023-11-05T08:29:36.493529+0000","last_clean":"2023-11-05T08:29:36.493529+0000","last_became_active":"2023-11-05T08:08:12.653053+0000","last_became_peered":"2023-11-05T08:08:12.653053+0000","last_unstale":"2023-11-05T08:29:36.493529+0000","last_undegraded":"2023-11-05T08:29:36.493529+0000","last_fullsized":"2023-11-05T08:29:36.493529+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:29:36.491096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:29:36.491096+0000","last_clean_scrub_stamp":"2023-11-05T08:29:36.491096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T12:45:52.709010+0000","scrub_duration":0.031561842999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":894,"reported_epoch":932,"state":"active+clean","last_fresh":"2023-11-05T08:29:50.992283+0000","last_change":"2023-11-05T08:29:50.992283+0000","last_active":"2023-11-05T08:29:50.992283+0000","last_peered":"2023-11-05T08:29:50.992283+0000","last_clean":"2023-11-05T08:29:50.992283+0000","last_became_active":"2023-11-05T08:07:07.203649+0000","last_became_peered":"2023-11-05T08:07:07.203649+0000","last_unstale":"2023-11-05T08:29:50.992283+0000","last_undegraded":"2023-11-05T08:29:50.992283+0000","last_fullsized":"2023-11-05T08:29:50.992283+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:29:50.989398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:29:50.989398+0000","last_clean_scrub_stamp":"2023-11-05T08:29:50.989398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T18:26:10.921614+0000","scrub_duration":0.032530934999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":903,"reported_epoch":932,"state":"active+clean","last_fresh":"2023-11-05T08:29:40.454986+0000","last_change":"2023-11-05T08:29:40.456131+0000","last_active":"2023-11-05T08:29:40.454986+0000","last_peered":"2023-11-05T08:29:40.454986+0000","last_clean":"2023-11-05T08:29:40.454986+0000","last_became_active":"2023-11-05T08:08:14.900486+0000","last_became_peered":"2023-11-05T08:08:14.900486+0000","last_unstale":"2023-11-05T08:29:40.454986+0000","last_undegraded":"2023-11-05T08:29:40.454986+0000","last_fullsized":"2023-11-05T08:29:40.454986+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:29:40.453475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:29:40.453475+0000","last_clean_scrub_stamp":"2023-11-05T08:29:40.453475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T17:53:53.051827+0000","scrub_duration":0.066750676999999994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":884,"reported_epoch":932,"state":"active+clean","last_fresh":"2023-11-05T08:29:32.177635+0000","last_change":"2023-11-05T08:29:32.177635+0000","last_active":"2023-11-05T08:29:32.177635+0000","last_peered":"2023-11-05T08:29:32.177635+0000","last_clean":"2023-11-05T08:29:32.177635+0000","last_became_active":"2023-11-05T08:07:07.371569+0000","last_became_peered":"2023-11-05T08:07:07.371569+0000","last_unstale":"2023-11-05T08:29:32.177635+0000","last_undegraded":"2023-11-05T08:29:32.177635+0000","last_fullsized":"2023-11-05T08:29:32.177635+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:29:32.174890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:29:32.174890+0000","last_clean_scrub_stamp":"2023-11-05T08:29:32.174890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T16:16:49.502047+0000","scrub_duration":0.044826601000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":892,"reported_epoch":932,"state":"active+clean","last_fresh":"2023-11-05T08:29:34.443954+0000","last_change":"2023-11-05T08:29:34.445121+0000","last_active":"2023-11-05T08:29:34.443954+0000","last_peered":"2023-11-05T08:29:34.443954+0000","last_clean":"2023-11-05T08:29:34.443954+0000","last_became_active":"2023-11-05T08:08:29.207330+0000","last_became_peered":"2023-11-05T08:08:29.207330+0000","last_unstale":"2023-11-05T08:29:34.443954+0000","last_undegraded":"2023-11-05T08:29:34.443954+0000","last_fullsized":"2023-11-05T08:29:34.443954+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:29:34.440439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:29:34.440439+0000","last_clean_scrub_stamp":"2023-11-05T08:29:34.440439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T12:11:03.179049+0000","scrub_duration":0.054252294999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":894,"reported_epoch":932,"state":"active+clean","last_fresh":"2023-11-05T08:29:30.830783+0000","last_change":"2023-11-05T08:29:30.830783+0000","last_active":"2023-11-05T08:29:30.830783+0000","last_peered":"2023-11-05T08:29:30.830783+0000","last_clean":"2023-11-05T08:29:30.830783+0000","last_became_active":"2023-11-05T08:07:07.344890+0000","last_became_peered":"2023-11-05T08:07:07.344890+0000","last_unstale":"2023-11-05T08:29:30.830783+0000","last_undegraded":"2023-11-05T08:29:30.830783+0000","last_fullsized":"2023-11-05T08:29:30.830783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:29:30.827954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:29:30.827954+0000","last_clean_scrub_stamp":"2023-11-05T08:29:30.827954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T12:02:27.062242+0000","scrub_duration":0.032635201000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":903,"reported_epoch":932,"state":"active+clean","last_fresh":"2023-11-05T08:29:46.435193+0000","last_change":"2023-11-05T08:29:46.436253+0000","last_active":"2023-11-05T08:29:46.435193+0000","last_peered":"2023-11-05T08:29:46.435193+0000","last_clean":"2023-11-05T08:29:46.435193+0000","last_became_active":"2023-11-05T08:08:16.927690+0000","last_became_peered":"2023-11-05T08:08:16.927690+0000","last_unstale":"2023-11-05T08:29:46.435193+0000","last_undegraded":"2023-11-05T08:29:46.435193+0000","last_fullsized":"2023-11-05T08:29:46.435193+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:29:46.433710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:29:46.433710+0000","last_clean_scrub_stamp":"2023-11-05T08:29:46.433710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T11:23:13.289760+0000","scrub_duration":0.038577383,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":909,"reported_epoch":932,"state":"active+clean","last_fresh":"2023-11-05T08:29:34.475367+0000","last_change":"2023-11-05T08:29:34.475367+0000","last_active":"2023-11-05T08:29:34.475367+0000","last_peered":"2023-11-05T08:29:34.475367+0000","last_clean":"2023-11-05T08:29:34.475367+0000","last_became_active":"2023-11-05T08:07:07.051923+0000","last_became_peered":"2023-11-05T08:07:07.051923+0000","last_unstale":"2023-11-05T08:29:34.475367+0000","last_undegraded":"2023-11-05T08:29:34.475367+0000","last_fullsized":"2023-11-05T08:29:34.475367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:29:34.468719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:29:34.468719+0000","last_clean_scrub_stamp":"2023-11-05T08:29:34.468719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T16:55:38.996611+0000","scrub_duration":0.058392312000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":887,"reported_epoch":932,"state":"active+clean","last_fresh":"2023-11-05T08:30:01.998696+0000","last_change":"2023-11-05T08:30:02.003244+0000","last_active":"2023-11-05T08:30:01.998696+0000","last_peered":"2023-11-05T08:30:01.998696+0000","last_clean":"2023-11-05T08:30:01.998696+0000","last_became_active":"2023-11-05T08:08:32.722827+0000","last_became_peered":"2023-11-05T08:08:32.722827+0000","last_unstale":"2023-11-05T08:30:01.998696+0000","last_undegraded":"2023-11-05T08:30:01.998696+0000","last_fullsized":"2023-11-05T08:30:01.998696+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:30:01.997248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:30:01.997248+0000","last_clean_scrub_stamp":"2023-11-05T08:30:01.997248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T11:23:41.178196+0000","scrub_duration":0.067880655999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":894,"reported_epoch":932,"state":"active+clean","last_fresh":"2023-11-05T08:29:38.934365+0000","last_change":"2023-11-05T08:29:38.938707+0000","last_active":"2023-11-05T08:29:38.934365+0000","last_peered":"2023-11-05T08:29:38.934365+0000","last_clean":"2023-11-05T08:29:38.934365+0000","last_became_active":"2023-11-05T08:07:07.131650+0000","last_became_peered":"2023-11-05T08:07:07.131650+0000","last_unstale":"2023-11-05T08:29:38.934365+0000","last_undegraded":"2023-11-05T08:29:38.934365+0000","last_fullsized":"2023-11-05T08:29:38.934365+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:29:38.932942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:29:38.932942+0000","last_clean_scrub_stamp":"2023-11-05T08:29:38.932942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T17:15:19.926170+0000","scrub_duration":0.032186171999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":903,"reported_epoch":932,"state":"active+clean","last_fresh":"2023-11-05T08:29:49.423773+0000","last_change":"2023-11-05T08:29:49.424926+0000","last_active":"2023-11-05T08:29:49.423773+0000","last_peered":"2023-11-05T08:29:49.423773+0000","last_clean":"2023-11-05T08:29:49.423773+0000","last_became_active":"2023-11-05T08:08:13.848417+0000","last_became_peered":"2023-11-05T08:08:13.848417+0000","last_unstale":"2023-11-05T08:29:49.423773+0000","last_undegraded":"2023-11-05T08:29:49.423773+0000","last_fullsized":"2023-11-05T08:29:49.423773+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:29:49.422231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:29:49.422231+0000","last_clean_scrub_stamp":"2023-11-05T08:29:49.422231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T16:46:18.275715+0000","scrub_duration":0.048981812,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":894,"reported_epoch":932,"state":"active+clean","last_fresh":"2023-11-05T08:29:43.873822+0000","last_change":"2023-11-05T08:29:43.873822+0000","last_active":"2023-11-05T08:29:43.873822+0000","last_peered":"2023-11-05T08:29:43.873822+0000","last_clean":"2023-11-05T08:29:43.873822+0000","last_became_active":"2023-11-05T08:07:07.467692+0000","last_became_peered":"2023-11-05T08:07:07.467692+0000","last_unstale":"2023-11-05T08:29:43.873822+0000","last_undegraded":"2023-11-05T08:29:43.873822+0000","last_fullsized":"2023-11-05T08:29:43.873822+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:29:43.870857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:29:43.870857+0000","last_clean_scrub_stamp":"2023-11-05T08:29:43.870857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T19:59:25.342378+0000","scrub_duration":0.038336596000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"932'78","reported_seq":1005,"reported_epoch":932,"state":"active+clean","last_fresh":"2023-11-05T08:29:29.568069+0000","last_change":"2023-11-05T08:29:29.570254+0000","last_active":"2023-11-05T08:29:29.568069+0000","last_peered":"2023-11-05T08:29:29.568069+0000","last_clean":"2023-11-05T08:29:29.568069+0000","last_became_active":"2023-11-05T08:07:00.966209+0000","last_became_peered":"2023-11-05T08:07:00.966209+0000","last_unstale":"2023-11-05T08:29:29.568069+0000","last_undegraded":"2023-11-05T08:29:29.568069+0000","last_fullsized":"2023-11-05T08:29:29.568069+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"932'78","last_scrub_stamp":"2023-11-05T08:29:29.566570+0000","last_deep_scrub":"932'78","last_deep_scrub_stamp":"2023-11-05T08:29:29.566570+0000","last_clean_scrub_stamp":"2023-11-05T08:29:29.566570+0000","objects_scrubbed":2,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T11:16:16.599985+0000","scrub_duration":0.22732221699999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":113,"num_write_kb":1372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":888,"reported_epoch":932,"state":"active+clean","last_fresh":"2023-11-05T08:29:52.997977+0000","last_change":"2023-11-05T08:29:53.002683+0000","last_active":"2023-11-05T08:29:52.997977+0000","last_peered":"2023-11-05T08:29:52.997977+0000","last_clean":"2023-11-05T08:29:52.997977+0000","last_became_active":"2023-11-05T08:08:16.476624+0000","last_became_peered":"2023-11-05T08:08:16.476624+0000","last_unstale":"2023-11-05T08:29:52.997977+0000","last_undegraded":"2023-11-05T08:29:52.997977+0000","last_fullsized":"2023-11-05T08:29:52.997977+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:29:52.996574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:29:52.996574+0000","last_clean_scrub_stamp":"2023-11-05T08:29:52.996574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T16:22:07.040487+0000","scrub_duration":0.054729516999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":904,"reported_epoch":932,"state":"active+clean","last_fresh":"2023-11-05T08:29:41.417384+0000","last_change":"2023-11-05T08:29:41.417384+0000","last_active":"2023-11-05T08:29:41.417384+0000","last_peered":"2023-11-05T08:29:41.417384+0000","last_clean":"2023-11-05T08:29:41.417384+0000","last_became_active":"2023-11-05T08:08:15.536104+0000","last_became_peered":"2023-11-05T08:08:15.536104+0000","last_unstale":"2023-11-05T08:29:41.417384+0000","last_undegraded":"2023-11-05T08:29:41.417384+0000","last_fullsized":"2023-11-05T08:29:41.417384+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:29:41.412049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:29:41.412049+0000","last_clean_scrub_stamp":"2023-11-05T08:29:41.412049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T16:55:01.254426+0000","scrub_duration":0.065755995999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":890,"reported_epoch":932,"state":"active+clean","last_fresh":"2023-11-05T08:29:41.775708+0000","last_change":"2023-11-05T08:29:41.775708+0000","last_active":"2023-11-05T08:29:41.775708+0000","last_peered":"2023-11-05T08:29:41.775708+0000","last_clean":"2023-11-05T08:29:41.775708+0000","last_became_active":"2023-11-05T08:08:24.441081+0000","last_became_peered":"2023-11-05T08:08:24.441081+0000","last_unstale":"2023-11-05T08:29:41.775708+0000","last_undegraded":"2023-11-05T08:29:41.775708+0000","last_fullsized":"2023-11-05T08:29:41.775708+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:29:41.773198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:29:41.773198+0000","last_clean_scrub_stamp":"2023-11-05T08:29:41.773198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T09:17:42.568276+0000","scrub_duration":0.036692071,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":904,"reported_epoch":932,"state":"active+clean","last_fresh":"2023-11-05T08:29:37.475909+0000","last_change":"2023-11-05T08:29:37.478284+0000","last_active":"2023-11-05T08:29:37.475909+0000","last_peered":"2023-11-05T08:29:37.475909+0000","last_clean":"2023-11-05T08:29:37.475909+0000","last_became_active":"2023-11-05T08:08:16.632044+0000","last_became_peered":"2023-11-05T08:08:16.632044+0000","last_unstale":"2023-11-05T08:29:37.475909+0000","last_undegraded":"2023-11-05T08:29:37.475909+0000","last_fullsized":"2023-11-05T08:29:37.475909+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:29:37.474463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:29:37.474463+0000","last_clean_scrub_stamp":"2023-11-05T08:29:37.474463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T12:03:26.899591+0000","scrub_duration":0.055078460000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":891,"reported_epoch":932,"state":"active+clean","last_fresh":"2023-11-05T08:29:39.374992+0000","last_change":"2023-11-05T08:29:39.376140+0000","last_active":"2023-11-05T08:29:39.374992+0000","last_peered":"2023-11-05T08:29:39.374992+0000","last_clean":"2023-11-05T08:29:39.374992+0000","last_became_active":"2023-11-05T08:08:14.425433+0000","last_became_peered":"2023-11-05T08:08:14.425433+0000","last_unstale":"2023-11-05T08:29:39.374992+0000","last_undegraded":"2023-11-05T08:29:39.374992+0000","last_fullsized":"2023-11-05T08:29:39.374992+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:29:39.373545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:29:39.373545+0000","last_clean_scrub_stamp":"2023-11-05T08:29:39.373545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T18:35:35.403965+0000","scrub_duration":0.057067181000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":892,"reported_epoch":932,"state":"active+clean","last_fresh":"2023-11-05T08:29:42.529061+0000","last_change":"2023-11-05T08:29:42.534181+0000","last_active":"2023-11-05T08:29:42.529061+0000","last_peered":"2023-11-05T08:29:42.529061+0000","last_clean":"2023-11-05T08:29:42.529061+0000","last_became_active":"2023-11-05T08:08:17.140308+0000","last_became_peered":"2023-11-05T08:08:17.140308+0000","last_unstale":"2023-11-05T08:29:42.529061+0000","last_undegraded":"2023-11-05T08:29:42.529061+0000","last_fullsized":"2023-11-05T08:29:42.529061+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:29:42.527729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:29:42.527729+0000","last_clean_scrub_stamp":"2023-11-05T08:29:42.527729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T15:11:43.277697+0000","scrub_duration":0.058377724999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":891,"reported_epoch":932,"state":"active+clean","last_fresh":"2023-11-05T08:29:36.355084+0000","last_change":"2023-11-05T08:29:36.356229+0000","last_active":"2023-11-05T08:29:36.355084+0000","last_peered":"2023-11-05T08:29:36.355084+0000","last_clean":"2023-11-05T08:29:36.355084+0000","last_became_active":"2023-11-05T08:08:14.137585+0000","last_became_peered":"2023-11-05T08:08:14.137585+0000","last_unstale":"2023-11-05T08:29:36.355084+0000","last_undegraded":"2023-11-05T08:29:36.355084+0000","last_fullsized":"2023-11-05T08:29:36.355084+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:29:36.353668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:29:36.353668+0000","last_clean_scrub_stamp":"2023-11-05T08:29:36.353668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T11:38:43.864262+0000","scrub_duration":0.041332088000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1","version":"932'8","reported_seq":905,"reported_epoch":932,"state":"active+clean","last_fresh":"2023-11-05T08:29:31.402719+0000","last_change":"2023-11-05T08:29:31.409362+0000","last_active":"2023-11-05T08:29:31.402719+0000","last_peered":"2023-11-05T08:29:31.402719+0000","last_clean":"2023-11-05T08:29:31.402719+0000","last_became_active":"2023-11-05T08:08:15.787944+0000","last_became_peered":"2023-11-05T08:08:15.787944+0000","last_unstale":"2023-11-05T08:29:31.402719+0000","last_undegraded":"2023-11-05T08:29:31.402719+0000","last_fullsized":"2023-11-05T08:29:31.402719+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"932'8","last_scrub_stamp":"2023-11-05T08:29:31.400338+0000","last_deep_scrub":"932'8","last_deep_scrub_stamp":"2023-11-05T08:29:31.400338+0000","last_clean_scrub_stamp":"2023-11-05T08:29:31.400338+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T11:55:46.665266+0000","scrub_duration":0.081671240000000006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":904,"reported_epoch":932,"state":"active+clean","last_fresh":"2023-11-05T08:29:35.362318+0000","last_change":"2023-11-05T08:29:35.363441+0000","last_active":"2023-11-05T08:29:35.362318+0000","last_peered":"2023-11-05T08:29:35.362318+0000","last_clean":"2023-11-05T08:29:35.362318+0000","last_became_active":"2023-11-05T08:08:29.547162+0000","last_became_peered":"2023-11-05T08:08:29.547162+0000","last_unstale":"2023-11-05T08:29:35.362318+0000","last_undegraded":"2023-11-05T08:29:35.362318+0000","last_fullsized":"2023-11-05T08:29:35.362318+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:29:35.360901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:29:35.360901+0000","last_clean_scrub_stamp":"2023-11-05T08:29:35.360901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T10:55:16.602689+0000","scrub_duration":0.040452469999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":888,"reported_epoch":932,"state":"active+clean","last_fresh":"2023-11-05T08:30:01.007821+0000","last_change":"2023-11-05T08:30:01.009016+0000","last_active":"2023-11-05T08:30:01.007821+0000","last_peered":"2023-11-05T08:30:01.007821+0000","last_clean":"2023-11-05T08:30:01.007821+0000","last_became_active":"2023-11-05T08:08:20.752405+0000","last_became_peered":"2023-11-05T08:08:20.752405+0000","last_unstale":"2023-11-05T08:30:01.007821+0000","last_undegraded":"2023-11-05T08:30:01.007821+0000","last_fullsized":"2023-11-05T08:30:01.007821+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:30:01.006287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:30:01.006287+0000","last_clean_scrub_stamp":"2023-11-05T08:30:01.006287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T15:58:13.569486+0000","scrub_duration":0.075456434000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":890,"reported_epoch":932,"state":"active+clean","last_fresh":"2023-11-05T08:29:44.282759+0000","last_change":"2023-11-05T08:29:44.287031+0000","last_active":"2023-11-05T08:29:44.282759+0000","last_peered":"2023-11-05T08:29:44.282759+0000","last_clean":"2023-11-05T08:29:44.282759+0000","last_became_active":"2023-11-05T08:08:14.458020+0000","last_became_peered":"2023-11-05T08:08:14.458020+0000","last_unstale":"2023-11-05T08:29:44.282759+0000","last_undegraded":"2023-11-05T08:29:44.282759+0000","last_fullsized":"2023-11-05T08:29:44.282759+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:29:44.281354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:29:44.281354+0000","last_clean_scrub_stamp":"2023-11-05T08:29:44.281354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T09:21:31.267943+0000","scrub_duration":0.046173069999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":890,"reported_epoch":932,"state":"active+clean","last_fresh":"2023-11-05T08:29:45.845330+0000","last_change":"2023-11-05T08:29:45.846341+0000","last_active":"2023-11-05T08:29:45.845330+0000","last_peered":"2023-11-05T08:29:45.845330+0000","last_clean":"2023-11-05T08:29:45.845330+0000","last_became_active":"2023-11-05T08:08:17.320483+0000","last_became_peered":"2023-11-05T08:08:17.320483+0000","last_unstale":"2023-11-05T08:29:45.845330+0000","last_undegraded":"2023-11-05T08:29:45.845330+0000","last_fullsized":"2023-11-05T08:29:45.845330+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:29:45.844030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:29:45.844030+0000","last_clean_scrub_stamp":"2023-11-05T08:29:45.844030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T09:15:03.236836+0000","scrub_duration":0.064354601999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":877,"reported_epoch":932,"state":"active+clean","last_fresh":"2023-11-05T08:29:35.164608+0000","last_change":"2023-11-05T08:29:35.168351+0000","last_active":"2023-11-05T08:29:35.164608+0000","last_peered":"2023-11-05T08:29:35.164608+0000","last_clean":"2023-11-05T08:29:35.164608+0000","last_became_active":"2023-11-05T08:08:20.218112+0000","last_became_peered":"2023-11-05T08:08:20.218112+0000","last_unstale":"2023-11-05T08:29:35.164608+0000","last_undegraded":"2023-11-05T08:29:35.164608+0000","last_fullsized":"2023-11-05T08:29:35.164608+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-05T08:29:35.163222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-05T08:29:35.163222+0000","last_clean_scrub_stamp":"2023-11-05T08:29:35.163222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T11:34:49.603304+0000","scrub_duration":0.036598339000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":113,"num_write_kb":1372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":802816,"data_stored":795680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":78,"ondisk_log_size":78,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":0,"up_from":16,"seq":68719477017,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59120,"kb_used_data":5736,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94312720,"statfs":{"total":96636764160,"available":96576225280,"internally_reserved":0,"allocated":5873664,"data_stored":3137725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Nov 5 08:29:43 2023","interfaces":[{"interface":"back","average":{"1min":12.631,"5min":16.599,"15min":16.648},"min":{"1min":5.1029999999999998,"5min":4.6589999999999998,"15min":4.5},"max":{"1min":55.585000000000001,"5min":109.83,"15min":214.25299999999999},"last":7.8440000000000003},{"interface":"front","average":{"1min":10.111000000000001,"5min":18.228999999999999,"15min":18.471},"min":{"1min":5.6600000000000001,"5min":5.0279999999999996,"15min":4.6989999999999998},"max":{"1min":16.812000000000001,"5min":171.31999999999999,"15min":252.74000000000001},"last":10.75}]},{"osd":2,"last update":"Sun Nov 5 08:29:57 2023","interfaces":[{"interface":"back","average":{"1min":21.702000000000002,"5min":23.414999999999999,"15min":23.356999999999999},"min":{"1min":10.445,"5min":6.8419999999999996,"15min":6.3369999999999997},"max":{"1min":147.10300000000001,"5min":147.30199999999999,"15min":227.87100000000001},"last":29.158000000000001},{"interface":"front","average":{"1min":24.236999999999998,"5min":27.245000000000001,"15min":27.818999999999999},"min":{"1min":11.731999999999999,"5min":9.4179999999999993,"15min":9.0510000000000002},"max":{"1min":148.691,"5min":231.124,"15min":343.62599999999998},"last":28.454999999999998}]},{"osd":3,"last update":"Sun Nov 5 08:29:43 2023","interfaces":[{"interface":"back","average":{"1min":28.651,"5min":28.667000000000002,"15min":24.315000000000001},"min":{"1min":11.773999999999999,"5min":7.6390000000000002,"15min":7.6390000000000002},"max":{"1min":148.577,"5min":165.13900000000001,"15min":223.571},"last":17.050000000000001},{"interface":"front","average":{"1min":18.84,"5min":19.402000000000001,"15min":17.786000000000001},"min":{"1min":6.5259999999999998,"5min":6.5259999999999998,"15min":6.3310000000000004},"max":{"1min":79.772999999999996,"5min":127.40600000000001,"15min":163.684},"last":15.385}]},{"osd":4,"last update":"Sun Nov 5 08:29:43 2023","interfaces":[{"interface":"back","average":{"1min":14.632999999999999,"5min":19.460999999999999,"15min":17.978000000000002},"min":{"1min":6.3220000000000001,"5min":6.3220000000000001,"15min":6.3220000000000001},"max":{"1min":78.811999999999998,"5min":125.905,"15min":176.929},"last":13.157999999999999},{"interface":"front","average":{"1min":24.599,"5min":26.015999999999998,"15min":23.614000000000001},"min":{"1min":12.164999999999999,"5min":10.333,"15min":7.7300000000000004},"max":{"1min":140.005,"5min":156.762,"15min":230.40600000000001},"last":17.91}]},{"osd":5,"last update":"Sun Nov 5 08:29:43 2023","interfaces":[{"interface":"back","average":{"1min":12.324999999999999,"5min":21.268999999999998,"15min":21.363},"min":{"1min":8.0090000000000003,"5min":8.0090000000000003,"15min":6.8940000000000001},"max":{"1min":20.827000000000002,"5min":116.42,"15min":266.36099999999999},"last":14.494},{"interface":"front","average":{"1min":17.504000000000001,"5min":22.908999999999999,"15min":24.387},"min":{"1min":11.012,"5min":9.4139999999999997,"15min":9.4139999999999997},"max":{"1min":54.32,"5min":115.401,"15min":260.779},"last":19.306999999999999}]},{"osd":6,"last update":"Sun Nov 5 08:29:43 2023","interfaces":[{"interface":"back","average":{"1min":34.591000000000001,"5min":31.390000000000001,"15min":29.387},"min":{"1min":11.164,"5min":10.246,"15min":10.246},"max":{"1min":149.291,"5min":149.291,"15min":280.47199999999998},"last":22.524999999999999},{"interface":"front","average":{"1min":24.835999999999999,"5min":23.594999999999999,"15min":22.251999999999999},"min":{"1min":7.8719999999999999,"5min":7.5510000000000002,"15min":6.5739999999999998},"max":{"1min":119.54000000000001,"5min":216.12,"15min":216.12},"last":11.669}]},{"osd":7,"last update":"Sun Nov 5 08:29:43 2023","interfaces":[{"interface":"back","average":{"1min":25.760999999999999,"5min":35.155000000000001,"15min":29.527000000000001},"min":{"1min":14.151999999999999,"5min":11.266999999999999,"15min":10.122},"max":{"1min":133.00299999999999,"5min":281.70800000000003,"15min":281.70800000000003},"last":25.326000000000001},{"interface":"front","average":{"1min":27.881,"5min":39.459000000000003,"15min":33.639000000000003},"min":{"1min":15.396000000000001,"5min":13.933,"15min":13.242000000000001},"max":{"1min":137.75,"5min":284.21199999999999,"15min":284.21199999999999},"last":26.602}]}]},{"osd":3,"up_from":15,"seq":64424509721,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59120,"kb_used_data":5736,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94312720,"statfs":{"total":96636764160,"available":96576225280,"internally_reserved":0,"allocated":5873664,"data_stored":3137725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":54655432},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 5 08:29:40 2023","interfaces":[{"interface":"back","average":{"1min":13.492000000000001,"5min":13.631,"15min":20.605},"min":{"1min":5.9930000000000003,"5min":5.7539999999999996,"15min":4.5739999999999998},"max":{"1min":45.722000000000001,"5min":112.003,"15min":261.80799999999999},"last":9.4250000000000007},{"interface":"front","average":{"1min":13.769,"5min":12.737,"15min":19.888999999999999},"min":{"1min":5.3449999999999998,"5min":4.4930000000000003,"15min":4.4199999999999999},"max":{"1min":25.315999999999999,"5min":113.303,"15min":391.05500000000001},"last":15.619}]},{"osd":1,"last update":"Sun Nov 5 08:29:40 2023","interfaces":[{"interface":"back","average":{"1min":18.911999999999999,"5min":17.917000000000002,"15min":23.507999999999999},"min":{"1min":9.1859999999999999,"5min":5.4669999999999996,"15min":5.4669999999999996},"max":{"1min":53.768999999999998,"5min":210.03999999999999,"15min":390.67000000000002},"last":16.312000000000001},{"interface":"front","average":{"1min":14.065,"5min":14.662000000000001,"15min":23.552},"min":{"1min":7.266,"5min":6.4669999999999996,"15min":6.4279999999999999},"max":{"1min":43.003,"5min":61.921999999999997,"15min":406.154},"last":7.1219999999999999}]},{"osd":2,"last update":"Sun Nov 5 08:29:57 2023","interfaces":[{"interface":"back","average":{"1min":19.114999999999998,"5min":18.285,"15min":23.512},"min":{"1min":8.2230000000000008,"5min":7.508,"15min":7.1920000000000002},"max":{"1min":88.292000000000002,"5min":108.79000000000001,"15min":356.27800000000002},"last":10.122},{"interface":"front","average":{"1min":21.77,"5min":20.149000000000001,"15min":26.5},"min":{"1min":10.429,"5min":10.121,"15min":7.9210000000000003},"max":{"1min":58.625999999999998,"5min":74.634,"15min":394.14999999999998},"last":12.231999999999999}]},{"osd":4,"last update":"Sun Nov 5 08:29:40 2023","interfaces":[{"interface":"back","average":{"1min":15.374000000000001,"5min":20.466999999999999,"15min":23.901},"min":{"1min":7.101,"5min":7.101,"15min":6.3609999999999998},"max":{"1min":47.232999999999997,"5min":225.31899999999999,"15min":342.72199999999998},"last":17.474},{"interface":"front","average":{"1min":22.149000000000001,"5min":26.207000000000001,"15min":29.763999999999999},"min":{"1min":10.785,"5min":9.673,"15min":9.0600000000000005},"max":{"1min":62.420000000000002,"5min":228.22200000000001,"15min":343.30799999999999},"last":18.167000000000002}]},{"osd":5,"last update":"Sun Nov 5 08:29:40 2023","interfaces":[{"interface":"back","average":{"1min":16.158999999999999,"5min":19.032,"15min":28.757999999999999},"min":{"1min":7.1479999999999997,"5min":6.3040000000000003,"15min":6.3040000000000003},"max":{"1min":35.280000000000001,"5min":77.813999999999993,"15min":412.41300000000001},"last":10.792999999999999},{"interface":"front","average":{"1min":19.207999999999998,"5min":16.433,"15min":25.469000000000001},"min":{"1min":7.1580000000000004,"5min":6.6420000000000003,"15min":6.0030000000000001},"max":{"1min":48.011000000000003,"5min":73.427999999999997,"15min":393.334},"last":8.7469999999999999}]},{"osd":6,"last update":"Sun Nov 5 08:29:40 2023","interfaces":[{"interface":"back","average":{"1min":20.561,"5min":22.125,"15min":30.265000000000001},"min":{"1min":11.259,"5min":10.747,"15min":8.5289999999999999},"max":{"1min":55.015999999999998,"5min":88.567999999999998,"15min":395.892},"last":11.583},{"interface":"front","average":{"1min":20.173999999999999,"5min":22.317,"15min":28.960999999999999},"min":{"1min":6.9619999999999997,"5min":6.9619999999999997,"15min":6.9619999999999997},"max":{"1min":60.200000000000003,"5min":208.23099999999999,"15min":343.959},"last":19.286999999999999}]},{"osd":7,"last update":"Sun Nov 5 08:29:40 2023","interfaces":[{"interface":"back","average":{"1min":23.707000000000001,"5min":21.047999999999998,"15min":29.204000000000001},"min":{"1min":11.407,"5min":11.039,"15min":10.02},"max":{"1min":48.933,"5min":76.209999999999994,"15min":346.93299999999999},"last":20.311},{"interface":"front","average":{"1min":19.759,"5min":17.268000000000001,"15min":26.594000000000001},"min":{"1min":8.4830000000000005,"5min":8.4830000000000005,"15min":7.415},"max":{"1min":67.920000000000002,"5min":76.225999999999999,"15min":407.678},"last":14.090999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509720,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59120,"kb_used_data":5736,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94312720,"statfs":{"total":96636764160,"available":96576225280,"internally_reserved":0,"allocated":5873664,"data_stored":3137725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 5 08:29:51 2023","interfaces":[{"interface":"back","average":{"1min":18.885999999999999,"5min":16.800999999999998,"15min":20.597000000000001},"min":{"1min":6.931,"5min":6.2279999999999998,"15min":5.0839999999999996},"max":{"1min":116.902,"5min":116.902,"15min":270.755},"last":8.3379999999999992},{"interface":"front","average":{"1min":23.391999999999999,"5min":22,"15min":25.920000000000002},"min":{"1min":9.3119999999999994,"5min":7.1840000000000002,"15min":7.1840000000000002},"max":{"1min":119.92,"5min":119.92,"15min":294.77800000000002},"last":17.242999999999999}]},{"osd":1,"last update":"Sun Nov 5 08:29:39 2023","interfaces":[{"interface":"back","average":{"1min":27.905999999999999,"5min":21.661000000000001,"15min":23.449000000000002},"min":{"1min":9.0969999999999995,"5min":9.0969999999999995,"15min":5.9649999999999999},"max":{"1min":103.205,"5min":204.059,"15min":258.88600000000002},"last":10.472},{"interface":"front","average":{"1min":26.096,"5min":17.934999999999999,"15min":22.298999999999999},"min":{"1min":6.4729999999999999,"5min":5.681,"15min":5.5030000000000001},"max":{"1min":100.021,"5min":231.86600000000001,"15min":312.77999999999997},"last":9.0589999999999993}]},{"osd":3,"last update":"Sun Nov 5 08:29:51 2023","interfaces":[{"interface":"back","average":{"1min":21.789999999999999,"5min":20.789999999999999,"15min":21.869},"min":{"1min":7.407,"5min":6.976,"15min":6.2439999999999998},"max":{"1min":86.674000000000007,"5min":204.50800000000001,"15min":269.48899999999998},"last":11.16},{"interface":"front","average":{"1min":28.044,"5min":25.27,"15min":27.812999999999999},"min":{"1min":13.138,"5min":10.894,"15min":7.9800000000000004},"max":{"1min":94.465000000000003,"5min":161.327,"15min":288.178},"last":9.8350000000000009}]},{"osd":4,"last update":"Sun Nov 5 08:29:51 2023","interfaces":[{"interface":"back","average":{"1min":23.277999999999999,"5min":15.083,"15min":17.805},"min":{"1min":7.1299999999999999,"5min":5.8220000000000001,"15min":5.8220000000000001},"max":{"1min":102.38500000000001,"5min":102.38500000000001,"15min":220.423},"last":12.801},{"interface":"front","average":{"1min":27.518000000000001,"5min":20.283000000000001,"15min":23.658999999999999},"min":{"1min":9.3710000000000004,"5min":8.2959999999999994,"15min":7.8559999999999999},"max":{"1min":101.26900000000001,"5min":101.26900000000001,"15min":260.37},"last":11.821}]},{"osd":5,"last update":"Sun Nov 5 08:29:51 2023","interfaces":[{"interface":"back","average":{"1min":28.899999999999999,"5min":18,"15min":19.873999999999999},"min":{"1min":13.957000000000001,"5min":6.3949999999999996,"15min":6.3159999999999998},"max":{"1min":144.476,"5min":144.476,"15min":229.387},"last":18.109000000000002},{"interface":"front","average":{"1min":21.757999999999999,"5min":21.559999999999999,"15min":26.495000000000001},"min":{"1min":6.3570000000000002,"5min":6.3570000000000002,"15min":6.3570000000000002},"max":{"1min":90.159000000000006,"5min":109.113,"15min":301.16899999999998},"last":13.478999999999999}]},{"osd":6,"last update":"Sun Nov 5 08:29:51 2023","interfaces":[{"interface":"back","average":{"1min":24.658000000000001,"5min":21.952000000000002,"15min":25.928000000000001},"min":{"1min":10.798999999999999,"5min":8.4469999999999992,"15min":8.4469999999999992},"max":{"1min":92.584999999999994,"5min":92.584999999999994,"15min":219.01300000000001},"last":14.109},{"interface":"front","average":{"1min":27.567,"5min":20.327000000000002,"15min":21.161000000000001},"min":{"1min":12.073,"5min":9.1780000000000008,"15min":6.5309999999999997},"max":{"1min":94.736000000000004,"5min":111.405,"15min":217.93600000000001},"last":14.733000000000001}]},{"osd":7,"last update":"Sun Nov 5 08:29:39 2023","interfaces":[{"interface":"back","average":{"1min":26.591999999999999,"5min":23.997,"15min":25.294},"min":{"1min":11.491,"5min":9.9079999999999995,"15min":8.4870000000000001},"max":{"1min":74.543000000000006,"5min":86.188999999999993,"15min":263.37099999999998},"last":19.108000000000001},{"interface":"front","average":{"1min":30.119,"5min":29.321999999999999,"15min":30.911999999999999},"min":{"1min":15.124000000000001,"5min":13.923,"15min":10.188000000000001},"max":{"1min":90.114000000000004,"5min":141.214,"15min":258.42000000000002},"last":19.757000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509719,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59516,"kb_used_data":6132,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94312324,"statfs":{"total":96636764160,"available":96575819776,"internally_reserved":0,"allocated":6279168,"data_stored":3535570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 5 08:29:51 2023","interfaces":[{"interface":"back","average":{"1min":16.16,"5min":20.414000000000001,"15min":20.443999999999999},"min":{"1min":5.4790000000000001,"5min":4.5469999999999997,"15min":4.2789999999999999},"max":{"1min":56.488,"5min":269.49200000000002,"15min":309.815},"last":10.694000000000001},{"interface":"front","average":{"1min":16.651,"5min":18.565000000000001,"15min":18.603000000000002},"min":{"1min":5.0819999999999999,"5min":5.0819999999999999,"15min":4.4119999999999999},"max":{"1min":56.802,"5min":160.89500000000001,"15min":299.55399999999997},"last":5.5650000000000004}]},{"osd":2,"last update":"Sun Nov 5 08:29:51 2023","interfaces":[{"interface":"back","average":{"1min":13.724,"5min":22.388999999999999,"15min":23.727},"min":{"1min":7.2400000000000002,"5min":6.202,"15min":5.7999999999999998},"max":{"1min":49.456000000000003,"5min":365.68099999999998,"15min":365.68099999999998},"last":12.757},{"interface":"front","average":{"1min":18.856000000000002,"5min":22.832999999999998,"15min":23.542999999999999},"min":{"1min":9.1280000000000001,"5min":7.0990000000000002,"15min":6.8899999999999997},"max":{"1min":77.353999999999999,"5min":188.554,"15min":302.49799999999999},"last":12.087}]},{"osd":3,"last update":"Sun Nov 5 08:29:51 2023","interfaces":[{"interface":"back","average":{"1min":21.911999999999999,"5min":26.832000000000001,"15min":25.928000000000001},"min":{"1min":7.9349999999999996,"5min":7.1260000000000003,"15min":6.8019999999999996},"max":{"1min":100.79300000000001,"5min":330.101,"15min":332.63299999999998},"last":14.747999999999999},{"interface":"front","average":{"1min":39.548999999999999,"5min":30.308,"15min":27.765999999999998},"min":{"1min":9.6839999999999993,"5min":7.673,"15min":6.9660000000000002},"max":{"1min":233.095,"5min":268.80900000000003,"15min":306.11399999999998},"last":17.609999999999999}]},{"osd":4,"last update":"Sun Nov 5 08:29:51 2023","interfaces":[{"interface":"back","average":{"1min":18.934000000000001,"5min":23.846,"15min":22.911000000000001},"min":{"1min":10.617000000000001,"5min":8.1560000000000006,"15min":6.7220000000000004},"max":{"1min":42.033999999999999,"5min":309.38200000000001,"15min":309.38200000000001},"last":13.455},{"interface":"front","average":{"1min":15.901999999999999,"5min":18.266999999999999,"15min":19.510999999999999},"min":{"1min":7.6769999999999996,"5min":7.1289999999999996,"15min":6.0750000000000002},"max":{"1min":41.146999999999998,"5min":161.56700000000001,"15min":161.56700000000001},"last":11.194000000000001}]},{"osd":5,"last update":"Sun Nov 5 08:29:45 2023","interfaces":[{"interface":"back","average":{"1min":32.478999999999999,"5min":28.547999999999998,"15min":24.018999999999998},"min":{"1min":12.393000000000001,"5min":9.0519999999999996,"15min":6.1600000000000001},"max":{"1min":212.40000000000001,"5min":312.33699999999999,"15min":312.33699999999999},"last":19.286000000000001},{"interface":"front","average":{"1min":33.32,"5min":25.873999999999999,"15min":26.352},"min":{"1min":10.863,"5min":10.863,"15min":8.2129999999999992},"max":{"1min":213.625,"5min":213.625,"15min":297.25299999999999},"last":21.166}]},{"osd":6,"last update":"Sun Nov 5 08:29:45 2023","interfaces":[{"interface":"back","average":{"1min":22.359999999999999,"5min":23.486999999999998,"15min":25.158000000000001},"min":{"1min":11.791,"5min":8.3930000000000007,"15min":8.0579999999999998},"max":{"1min":58.423999999999999,"5min":166.16300000000001,"15min":214.44200000000001},"last":22.803000000000001},{"interface":"front","average":{"1min":24.855,"5min":29.579999999999998,"15min":30.934000000000001},"min":{"1min":15.077999999999999,"5min":12.923999999999999,"15min":12.047000000000001},"max":{"1min":61.564,"5min":225.93899999999999,"15min":231.297},"last":23.890999999999998}]},{"osd":7,"last update":"Sun Nov 5 08:29:45 2023","interfaces":[{"interface":"back","average":{"1min":26.605,"5min":24.547999999999998,"15min":29.837},"min":{"1min":8.5730000000000004,"5min":8.3680000000000003,"15min":8.3680000000000003},"max":{"1min":136.04499999999999,"5min":248.667,"15min":248.667},"last":16.927},{"interface":"front","average":{"1min":30.484000000000002,"5min":31.061,"15min":27.375},"min":{"1min":12.778,"5min":12.778,"15min":7.7199999999999998},"max":{"1min":141.821,"5min":331.02800000000002,"15min":331.02800000000002},"last":20.215}]}]},{"osd":7,"up_from":14,"seq":60129542424,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":81328,"kb_used_data":5736,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94290512,"statfs":{"total":96636764160,"available":96553484288,"internally_reserved":0,"allocated":5873664,"data_stored":3137725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":77396427},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 5 08:29:48 2023","interfaces":[{"interface":"back","average":{"1min":17.541,"5min":17.262,"15min":17.343},"min":{"1min":4.6189999999999998,"5min":4.6189999999999998,"15min":4.3739999999999997},"max":{"1min":153.21000000000001,"5min":153.21000000000001,"15min":198.46799999999999},"last":11.506},{"interface":"front","average":{"1min":13.877000000000001,"5min":15.654,"15min":16.931999999999999},"min":{"1min":6.2880000000000003,"5min":5.5869999999999997,"15min":4.4260000000000002},"max":{"1min":57.706000000000003,"5min":129.173,"15min":162.06200000000001},"last":6.0670000000000002}]},{"osd":1,"last update":"Sun Nov 5 08:29:43 2023","interfaces":[{"interface":"back","average":{"1min":14.241,"5min":18.276,"15min":21.745000000000001},"min":{"1min":7.3899999999999997,"5min":6.4109999999999996,"15min":5.9939999999999998},"max":{"1min":50.340000000000003,"5min":109.303,"15min":415.255},"last":8.0350000000000001},{"interface":"front","average":{"1min":13.888,"5min":20.027999999999999,"15min":22.440999999999999},"min":{"1min":6.7140000000000004,"5min":6.7140000000000004,"15min":6.0999999999999996},"max":{"1min":58.918999999999997,"5min":146.83799999999999,"15min":305.72800000000001},"last":13.01}]},{"osd":2,"last update":"Sun Nov 5 08:29:48 2023","interfaces":[{"interface":"back","average":{"1min":13.115,"5min":18.558,"15min":21.954000000000001},"min":{"1min":6.7140000000000004,"5min":6.5,"15min":6.5},"max":{"1min":46.798000000000002,"5min":125.071,"15min":175.221},"last":10.206},{"interface":"front","average":{"1min":15.178000000000001,"5min":19.521000000000001,"15min":21.832000000000001},"min":{"1min":8.2940000000000005,"5min":6.8730000000000002,"15min":6.5410000000000004},"max":{"1min":61.103999999999999,"5min":154.429,"15min":183.22},"last":15.814}]},{"osd":3,"last update":"Sun Nov 5 08:29:48 2023","interfaces":[{"interface":"back","average":{"1min":16.513999999999999,"5min":23.710999999999999,"15min":26.687000000000001},"min":{"1min":7.1550000000000002,"5min":7.1550000000000002,"15min":6.6660000000000004},"max":{"1min":88.591999999999999,"5min":171.90600000000001,"15min":380.88099999999997},"last":11.032999999999999},{"interface":"front","average":{"1min":16.789000000000001,"5min":24.103999999999999,"15min":24.213999999999999},"min":{"1min":10.345000000000001,"5min":7.0309999999999997,"15min":6.3769999999999998},"max":{"1min":56.567,"5min":143.35499999999999,"15min":174.41200000000001},"last":16.695}]},{"osd":4,"last update":"Sun Nov 5 08:29:43 2023","interfaces":[{"interface":"back","average":{"1min":15.013,"5min":21.373999999999999,"15min":23.157},"min":{"1min":6.2380000000000004,"5min":5.9329999999999998,"15min":5.9329999999999998},"max":{"1min":47.448,"5min":158.124,"15min":215.60499999999999},"last":17.323},{"interface":"front","average":{"1min":18.917000000000002,"5min":24.629000000000001,"15min":26.478000000000002},"min":{"1min":10.778,"5min":7.6790000000000003,"15min":7.6790000000000003},"max":{"1min":48.625999999999998,"5min":158.79300000000001,"15min":347.35199999999998},"last":19.300999999999998}]},{"osd":5,"last update":"Sun Nov 5 08:29:43 2023","interfaces":[{"interface":"back","average":{"1min":19.619,"5min":24.43,"15min":26.936},"min":{"1min":9.9420000000000002,"5min":7.8410000000000002,"15min":7.7199999999999998},"max":{"1min":59.613999999999997,"5min":156.44,"15min":283.54300000000001},"last":20.173999999999999},{"interface":"front","average":{"1min":18.870000000000001,"5min":23.658999999999999,"15min":26.283000000000001},"min":{"1min":8.3390000000000004,"5min":6.5890000000000004,"15min":6.5890000000000004},"max":{"1min":95.927999999999997,"5min":168.31800000000001,"15min":582.69899999999996},"last":13.695}]},{"osd":6,"last update":"Sun Nov 5 08:29:43 2023","interfaces":[{"interface":"back","average":{"1min":20.151,"5min":24.338000000000001,"15min":25.146000000000001},"min":{"1min":11.212999999999999,"5min":10.821,"15min":8.7300000000000004},"max":{"1min":95.194999999999993,"5min":140.654,"15min":228.97200000000001},"last":18.292999999999999},{"interface":"front","average":{"1min":20.199999999999999,"5min":24.183,"15min":23.157},"min":{"1min":10.811,"5min":7.9160000000000004,"15min":7.1740000000000004},"max":{"1min":89.944000000000003,"5min":132.90199999999999,"15min":203.364},"last":14.805999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542425,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77560,"kb_used_data":6128,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94294280,"statfs":{"total":96636764160,"available":96557342720,"internally_reserved":0,"allocated":6275072,"data_stored":3535565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 5 08:29:41 2023","interfaces":[{"interface":"back","average":{"1min":13.351000000000001,"5min":12.180999999999999,"15min":16.858000000000001},"min":{"1min":5.5359999999999996,"5min":5.0229999999999997,"15min":4.3799999999999999},"max":{"1min":42.975999999999999,"5min":73.667000000000002,"15min":258.09699999999998},"last":9.1950000000000003},{"interface":"front","average":{"1min":16.416,"5min":18.425000000000001,"15min":21.422999999999998},"min":{"1min":9.7710000000000008,"5min":7.6929999999999996,"15min":4.1600000000000001},"max":{"1min":43.841999999999999,"5min":231.863,"15min":278.45499999999998},"last":12.103}]},{"osd":1,"last update":"Sun Nov 5 08:29:41 2023","interfaces":[{"interface":"back","average":{"1min":15.255000000000001,"5min":17.472999999999999,"15min":19.978000000000002},"min":{"1min":5.7350000000000003,"5min":5.7350000000000003,"15min":4.351},"max":{"1min":105.19799999999999,"5min":146.76900000000001,"15min":304.47800000000001},"last":11.198},{"interface":"front","average":{"1min":19.896000000000001,"5min":21.059999999999999,"15min":24.478999999999999},"min":{"1min":7.6820000000000004,"5min":6.4649999999999999,"15min":6.2430000000000003},"max":{"1min":81.875,"5min":103.68600000000001,"15min":286.233},"last":13.647}]},{"osd":2,"last update":"Sun Nov 5 08:29:41 2023","interfaces":[{"interface":"back","average":{"1min":17.228999999999999,"5min":20.09,"15min":22.992000000000001},"min":{"1min":6.8499999999999996,"5min":6.3970000000000002,"15min":5.1210000000000004},"max":{"1min":82.712999999999994,"5min":224.57900000000001,"15min":224.57900000000001},"last":15.119999999999999},{"interface":"front","average":{"1min":18.588000000000001,"5min":23.314,"15min":27.890000000000001},"min":{"1min":10.497999999999999,"5min":7.476,"15min":5.5549999999999997},"max":{"1min":50.619999999999997,"5min":185.56299999999999,"15min":327.26100000000002},"last":14.326000000000001}]},{"osd":3,"last update":"Sun Nov 5 08:29:41 2023","interfaces":[{"interface":"back","average":{"1min":19.797999999999998,"5min":24.215,"15min":22.52},"min":{"1min":7.6520000000000001,"5min":6.5739999999999998,"15min":6.0629999999999997},"max":{"1min":107.744,"5min":192.482,"15min":283.94099999999997},"last":20.675000000000001},{"interface":"front","average":{"1min":23.622,"5min":25.544,"15min":23.135000000000002},"min":{"1min":13.44,"5min":12.102,"15min":6.2729999999999997},"max":{"1min":105.955,"5min":167.28899999999999,"15min":284.72699999999998},"last":23.731999999999999}]},{"osd":4,"last update":"Sun Nov 5 08:29:41 2023","interfaces":[{"interface":"back","average":{"1min":20.728999999999999,"5min":21.119,"15min":21.757000000000001},"min":{"1min":11.141,"5min":9.3059999999999992,"15min":6.7409999999999997},"max":{"1min":71.869,"5min":98.747,"15min":244.86099999999999},"last":22.702999999999999},{"interface":"front","average":{"1min":12.086,"5min":14.257999999999999,"15min":18.995999999999999},"min":{"1min":6.4459999999999997,"5min":5.8739999999999997,"15min":5.8739999999999997},"max":{"1min":37.384,"5min":112.798,"15min":277.55700000000002},"last":8.0800000000000001}]},{"osd":6,"last update":"Sun Nov 5 08:29:41 2023","interfaces":[{"interface":"back","average":{"1min":29.408999999999999,"5min":22.128,"15min":23.648},"min":{"1min":6.4509999999999996,"5min":6.4509999999999996,"15min":5.7930000000000001},"max":{"1min":185.99000000000001,"5min":242.536,"15min":242.536},"last":10.195},{"interface":"front","average":{"1min":23.233000000000001,"5min":23.920000000000002,"15min":26.088999999999999},"min":{"1min":9.4280000000000008,"5min":9.1289999999999996,"15min":7.0300000000000002},"max":{"1min":88.948999999999998,"5min":177.25800000000001,"15min":310.69099999999997},"last":12.949}]},{"osd":7,"last update":"Sun Nov 5 08:29:41 2023","interfaces":[{"interface":"back","average":{"1min":21.954999999999998,"5min":23.161000000000001,"15min":26.053999999999998},"min":{"1min":9.282,"5min":8.7769999999999992,"15min":8.7650000000000006},"max":{"1min":77.509,"5min":119.51900000000001,"15min":281.71199999999999},"last":24.635999999999999},{"interface":"front","average":{"1min":20.222999999999999,"5min":22.875,"15min":28.055},"min":{"1min":12.555,"5min":8.0860000000000003,"15min":8.0860000000000003},"max":{"1min":49.790999999999997,"5min":94.194999999999993,"15min":319.786},"last":20.236999999999998}]}]},{"osd":4,"up_from":14,"seq":60129542427,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63280,"kb_used_data":5736,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94308560,"statfs":{"total":96636764160,"available":96571965440,"internally_reserved":0,"allocated":5873664,"data_stored":3137725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 5 08:29:37 2023","interfaces":[{"interface":"back","average":{"1min":16.472999999999999,"5min":13.622,"15min":19.138999999999999},"min":{"1min":4.6950000000000003,"5min":4.6950000000000003,"15min":4.6950000000000003},"max":{"1min":62.594000000000001,"5min":73.995999999999995,"15min":243.626},"last":5.2519999999999998},{"interface":"front","average":{"1min":18.378,"5min":17.478000000000002,"15min":23.103999999999999},"min":{"1min":7.6139999999999999,"5min":5.7199999999999998,"15min":5.7199999999999998},"max":{"1min":58.095999999999997,"5min":116.346,"15min":202.49000000000001},"last":17.972999999999999}]},{"osd":1,"last update":"Sun Nov 5 08:29:37 2023","interfaces":[{"interface":"back","average":{"1min":11.395,"5min":15.006,"15min":20.481000000000002},"min":{"1min":4.492,"5min":4.492,"15min":4.274},"max":{"1min":34.497,"5min":162.90799999999999,"15min":369.267},"last":11.242000000000001},{"interface":"front","average":{"1min":16.670000000000002,"5min":15.493,"15min":23.667000000000002},"min":{"1min":7.3029999999999999,"5min":5.4930000000000003,"15min":5.4930000000000003},"max":{"1min":43.347999999999999,"5min":157.459,"15min":340.214},"last":9.6329999999999991}]},{"osd":2,"last update":"Sun Nov 5 08:29:37 2023","interfaces":[{"interface":"back","average":{"1min":18.876999999999999,"5min":19.706,"15min":26.309000000000001},"min":{"1min":7.1580000000000004,"5min":6.7750000000000004,"15min":6.7750000000000004},"max":{"1min":55.881,"5min":192.44999999999999,"15min":241.934},"last":20.641999999999999},{"interface":"front","average":{"1min":17.863,"5min":19.148,"15min":25.114000000000001},"min":{"1min":6.6669999999999998,"5min":6.5110000000000001,"15min":6.3109999999999999},"max":{"1min":58.277000000000001,"5min":183.47900000000001,"15min":368.279},"last":12.923999999999999}]},{"osd":3,"last update":"Sun Nov 5 08:29:37 2023","interfaces":[{"interface":"back","average":{"1min":13.372999999999999,"5min":16.940999999999999,"15min":20.568000000000001},"min":{"1min":8.2029999999999994,"5min":7.1600000000000001,"15min":6.1200000000000001},"max":{"1min":39.347000000000001,"5min":164.06399999999999,"15min":369.53399999999999},"last":10.332000000000001},{"interface":"front","average":{"1min":18.693000000000001,"5min":21.747,"15min":26.821000000000002},"min":{"1min":11.484,"5min":6.8920000000000003,"15min":6.8920000000000003},"max":{"1min":54.116,"5min":196.655,"15min":367.93799999999999},"last":19.611999999999998}]},{"osd":5,"last update":"Sun Nov 5 08:29:37 2023","interfaces":[{"interface":"back","average":{"1min":18.853000000000002,"5min":23.573,"15min":29.486999999999998},"min":{"1min":10.253,"5min":10.253,"15min":7.0010000000000003},"max":{"1min":57.521000000000001,"5min":202.82900000000001,"15min":283.08100000000002},"last":18.928000000000001},{"interface":"front","average":{"1min":14.643000000000001,"5min":23.018000000000001,"15min":24.649000000000001},"min":{"1min":8.0210000000000008,"5min":7.0640000000000001,"15min":6.3010000000000002},"max":{"1min":46.354999999999997,"5min":264.10300000000001,"15min":283.94400000000002},"last":16.012}]},{"osd":6,"last update":"Sun Nov 5 08:29:41 2023","interfaces":[{"interface":"back","average":{"1min":22.388000000000002,"5min":19.221,"15min":24.875},"min":{"1min":8.3379999999999992,"5min":7.1740000000000004,"15min":6.4359999999999999},"max":{"1min":87.091999999999999,"5min":165.113,"15min":324.98200000000003},"last":21.489000000000001},{"interface":"front","average":{"1min":27.646000000000001,"5min":25.539999999999999,"15min":30.390999999999998},"min":{"1min":11.224,"5min":9.5470000000000006,"15min":8.5890000000000004},"max":{"1min":131.20500000000001,"5min":205.83199999999999,"15min":288.26799999999997},"last":12.085000000000001}]},{"osd":7,"last update":"Sun Nov 5 08:29:37 2023","interfaces":[{"interface":"back","average":{"1min":17.216000000000001,"5min":22.507999999999999,"15min":27.908999999999999},"min":{"1min":10.464,"5min":7.7009999999999996,"15min":7.1559999999999997},"max":{"1min":41.401000000000003,"5min":210.24600000000001,"15min":356.44600000000003},"last":14.641999999999999},{"interface":"front","average":{"1min":19.631,"5min":25.562999999999999,"15min":28.414000000000001},"min":{"1min":13.189,"5min":9.7159999999999993,"15min":9.7159999999999993},"max":{"1min":44.408999999999999,"5min":208.833,"15min":327.53800000000001},"last":16.954000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575128,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63284,"kb_used_data":5740,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94308556,"statfs":{"total":96636764160,"available":96571961344,"internally_reserved":0,"allocated":5877760,"data_stored":3137730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 5 08:29:47 2023","interfaces":[{"interface":"back","average":{"1min":11.978,"5min":16.218,"15min":17.920000000000002},"min":{"1min":4.7569999999999997,"5min":4.1600000000000001,"15min":4.1600000000000001},"max":{"1min":45.542999999999999,"5min":165.51900000000001,"15min":187.75899999999999},"last":16.626999999999999},{"interface":"front","average":{"1min":10.848000000000001,"5min":16.481999999999999,"15min":17.609000000000002},"min":{"1min":5.1520000000000001,"5min":5.1520000000000001,"15min":4.6790000000000003},"max":{"1min":35.265000000000001,"5min":167.02500000000001,"15min":185.38200000000001},"last":8.8529999999999998}]},{"osd":1,"last update":"Sun Nov 5 08:29:47 2023","interfaces":[{"interface":"back","average":{"1min":15.435,"5min":20.401,"15min":23.806999999999999},"min":{"1min":7.9909999999999997,"5min":5.4720000000000004,"15min":5.4720000000000004},"max":{"1min":53.835999999999999,"5min":226.23500000000001,"15min":286.072},"last":9.5009999999999994},{"interface":"front","average":{"1min":13.073,"5min":18.385999999999999,"15min":23.117999999999999},"min":{"1min":7.141,"5min":5.6980000000000004,"15min":5.6980000000000004},"max":{"1min":36.954999999999998,"5min":168.25899999999999,"15min":309.512},"last":10.786}]},{"osd":2,"last update":"Sun Nov 5 08:29:47 2023","interfaces":[{"interface":"back","average":{"1min":21.117999999999999,"5min":21.593,"15min":24.420000000000002},"min":{"1min":9.5980000000000008,"5min":7.0030000000000001,"15min":6.6390000000000002},"max":{"1min":70.394000000000005,"5min":177.25,"15min":205.483},"last":11.467000000000001},{"interface":"front","average":{"1min":31.692,"5min":30.047000000000001,"15min":29.448},"min":{"1min":12.19,"5min":9.4179999999999993,"15min":8.8000000000000007},"max":{"1min":202.39400000000001,"5min":335.95100000000002,"15min":335.95100000000002},"last":18.309999999999999}]},{"osd":3,"last update":"Sun Nov 5 08:29:47 2023","interfaces":[{"interface":"back","average":{"1min":18.739999999999998,"5min":19.548999999999999,"15min":25.298999999999999},"min":{"1min":6.6719999999999997,"5min":6.4909999999999997,"15min":6.4909999999999997},"max":{"1min":134.023,"5min":175.47300000000001,"15min":372.54199999999997},"last":13.960000000000001},{"interface":"front","average":{"1min":25.469000000000001,"5min":23.707000000000001,"15min":20.501999999999999},"min":{"1min":8.7289999999999992,"5min":6.2000000000000002,"15min":6.0069999999999997},"max":{"1min":135.262,"5min":152.446,"15min":273.34300000000002},"last":10.157}]},{"osd":4,"last update":"Sun Nov 5 08:29:47 2023","interfaces":[{"interface":"back","average":{"1min":13.807,"5min":18.373000000000001,"15min":18.521000000000001},"min":{"1min":7.2670000000000003,"5min":6.468,"15min":6.468},"max":{"1min":40.752000000000002,"5min":138.107,"15min":211},"last":6.5149999999999997},{"interface":"front","average":{"1min":17.079999999999998,"5min":21.847999999999999,"15min":22.251999999999999},"min":{"1min":10.082000000000001,"5min":7.6790000000000003,"15min":7.5670000000000002},"max":{"1min":51.920999999999999,"5min":178.578,"15min":255.61600000000001},"last":14.653}]},{"osd":5,"last update":"Sun Nov 5 08:29:47 2023","interfaces":[{"interface":"back","average":{"1min":14.500999999999999,"5min":20.395,"15min":25.998000000000001},"min":{"1min":8.4870000000000001,"5min":6.4169999999999998,"15min":6.4169999999999998},"max":{"1min":37.595999999999997,"5min":121.566,"15min":915.64300000000003},"last":7.9279999999999999},{"interface":"front","average":{"1min":27.268999999999998,"5min":29.074000000000002,"15min":33.276000000000003},"min":{"1min":10.992000000000001,"5min":10.992000000000001,"15min":9.5489999999999995},"max":{"1min":168.72499999999999,"5min":171.06899999999999,"15min":928.67899999999997},"last":17.303000000000001}]},{"osd":7,"last update":"Sun Nov 5 08:29:47 2023","interfaces":[{"interface":"back","average":{"1min":21.152000000000001,"5min":23.134,"15min":23.582000000000001},"min":{"1min":10.538,"5min":7.3730000000000002,"15min":7.3730000000000002},"max":{"1min":103.03400000000001,"5min":167.63800000000001,"15min":212.917},"last":12.19},{"interface":"front","average":{"1min":22.355,"5min":22.393000000000001,"15min":24.632000000000001},"min":{"1min":8.3759999999999994,"5min":8.3759999999999994,"15min":7.3259999999999996},"max":{"1min":91.799999999999997,"5min":182.375,"15min":222.44499999999999},"last":15.337}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-05T08:30:15.806 DEBUG:teuthology.orchestra.run.smithi052:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-11-05T08:30:15.915 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.914+0000 7f3e8796c640 10 monclient: get_monmap_and_config 2023-11-05T08:30:15.915 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.914+0000 7f3e8796c640 10 monclient: build_initial_monmap 2023-11-05T08:30:15.916 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.914+0000 7f3e8796c640 10 monclient: monmap: 2023-11-05T08:30:15.916 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:30:15.916 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:30:15.916 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:30:15.915267+0000 2023-11-05T08:30:15.916 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:30:15.915267+0000 2023-11-05T08:30:15.917 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:30:15.917 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:30:15.917 INFO:teuthology.orchestra.run.smithi052.stderr:0: v1:172.21.15.52:6789/0 mon.noname-a-legacy 2023-11-05T08:30:15.917 INFO:teuthology.orchestra.run.smithi052.stderr:1: v1:172.21.15.156:6789/0 mon.noname-c-legacy 2023-11-05T08:30:15.917 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-b 2023-11-05T08:30:15.917 INFO:teuthology.orchestra.run.smithi052.stderr:3: v2:172.21.15.52:3300/0 mon.noname-a 2023-11-05T08:30:15.918 INFO:teuthology.orchestra.run.smithi052.stderr:4: v2:172.21.15.156:3300/0 mon.noname-c 2023-11-05T08:30:15.918 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:30:15.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.915+0000 7f3e8796c640 1 Processor -- start 2023-11-05T08:30:15.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.915+0000 7f3e8796c640 1 -- start start 2023-11-05T08:30:15.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.915+0000 7f3e8796c640 10 monclient: init 2023-11-05T08:30:15.920 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.916+0000 7f3e8796c640 10 monclient: _reopen_session rank -1 2023-11-05T08:30:15.920 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.916+0000 7f3e8796c640 10 monclient: _add_conns ranks=[2,4,1,0,3] 2023-11-05T08:30:15.921 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.916+0000 7f3e8796c640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3e800ae7e0 0x7f3e800accb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:30:15.921 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.916+0000 7f3e8796c640 10 monclient(hunting): picked mon.noname-b con 0x7f3e800ae7e0 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:30:15.921 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.916+0000 7f3e8796c640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f3e800aebc0 0x7f3e800aace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:30:15.921 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.916+0000 7f3e8796c640 10 monclient(hunting): picked mon.noname-c con 0x7f3e800aebc0 addr v2:172.21.15.156:3300/0 2023-11-05T08:30:15.922 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.916+0000 7f3e8796c640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f3e80141c40 addr v1:172.21.15.156:6789/0 2023-11-05T08:30:15.922 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.916+0000 7f3e8796c640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e800ac2d0 con 0x7f3e80141c40 2023-11-05T08:30:15.922 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.916+0000 7f3e8796c640 10 monclient(hunting): start opening mon connection 2023-11-05T08:30:15.922 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.916+0000 7f3e8796c640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e800ab220 con 0x7f3e800aebc0 2023-11-05T08:30:15.922 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.916+0000 7f3e8796c640 10 monclient(hunting): start opening mon connection 2023-11-05T08:30:15.923 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.916+0000 7f3e8796c640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e800aa7c0 con 0x7f3e800ae7e0 2023-11-05T08:30:15.923 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.916+0000 7f3e8796c640 10 monclient(hunting): _renew_subs 2023-11-05T08:30:15.923 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.916+0000 7f3e8796c640 10 monclient(hunting): authenticate will time out at 2762.121074s 2023-11-05T08:30:15.923 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.916+0000 7f3e85708640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3e800ae7e0 0x7f3e800accb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:30:15.923 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.916+0000 7f3e84f07640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f3e800aebc0 0x7f3e800aace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:30:15.923 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.917+0000 7f3e85708640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3e800ae7e0 0x7f3e800accb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.52:41326/0 (socket says 172.21.15.52:41326) 2023-11-05T08:30:15.924 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.917+0000 7f3e85708640 1 -- 172.21.15.52:0/3385087856 learned_addr learned my addr 172.21.15.52:0/3385087856 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-11-05T08:30:15.924 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.917+0000 7f3e85708640 10 monclient(hunting): get_auth_request con 0x7f3e800ae7e0 auth_method 0 2023-11-05T08:30:15.924 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.917+0000 7f3e85708640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:30:15.924 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.917+0000 7f3e85708640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:30:15.924 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.917+0000 7f3e85708640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:30:15.924 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.917+0000 7f3e84f07640 10 monclient(hunting): get_auth_request con 0x7f3e800aebc0 auth_method 0 2023-11-05T08:30:15.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.917+0000 7f3e84f07640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:30:15.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.917+0000 7f3e84f07640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:30:15.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.917+0000 7f3e84f07640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:30:15.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.917+0000 7f3e84f07640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:30:15.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.917+0000 7f3e84f07640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:30:15.926 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.917+0000 7f3e84f07640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:30:15.926 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.917+0000 7f3e85708640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:30:15.926 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.917+0000 7f3e85708640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:30:15.926 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.917+0000 7f3e85708640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:30:15.926 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.919+0000 7f3e84f07640 10 monclient(hunting): handle_auth_done global_id 20791 payload 274 2023-11-05T08:30:15.927 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.919+0000 7f3e84f07640 1 -- 172.21.15.52:0/3385087856 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3e800ae7e0 msgr2=0x7f3e800accb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-05T08:30:15.927 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.919+0000 7f3e84f07640 1 --2- 172.21.15.52:0/3385087856 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3e800ae7e0 0x7f3e800accb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:30:15.927 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.919+0000 7f3e84f07640 1 -- 172.21.15.52:0/3385087856 >> v1:172.21.15.156:6789/0 conn(0x7f3e80141c40 legacy=0x7f3e8013bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-05T08:30:15.927 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.919+0000 7f3e84f07640 10 monclient: _finish_hunting 0 2023-11-05T08:30:15.927 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.919+0000 7f3e84f07640 1 monclient: found mon.noname-c 2023-11-05T08:30:15.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.919+0000 7f3e84f07640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:30:15.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.919+0000 7f3e84f07640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.156:3300/0 2023-11-05T08:30:15.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.919+0000 7f3e84f07640 1 -- 172.21.15.52:0/3385087856 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e80071cb0 con 0x7f3e800aebc0 2023-11-05T08:30:15.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.922+0000 7f3e84f07640 1 --2- 172.21.15.52:0/3385087856 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3e800aebc0 0x7f3e800aace0 secure :-1 s=READY pgs=5031 cs=0 l=1 rev1=1 crypto rx=0x7f3e700097a0 tx=0x7f3e7002b7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=23bd9fe45da415d server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:30:15.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.925+0000 7f3e77fff640 1 -- 172.21.15.52:0/3385087856 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e7002f050 con 0x7f3e800aebc0 2023-11-05T08:30:15.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.925+0000 7f3e77fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:30:15.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.925+0000 7f3e77fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-11-05T08:30:15.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.925+0000 7f3e77fff640 10 monclient: dump: 2023-11-05T08:30:15.935 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:30:15.935 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:30:15.935 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:30:15.935 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:30:15.936 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:30:15.936 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:30:15.936 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:30:15.936 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:30:15.936 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:30:15.936 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:30:15.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.925+0000 7f3e77fff640 10 monclient: _finish_auth 0 2023-11-05T08:30:15.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.925+0000 7f3e77fff640 10 monclient: _check_auth_tickets 2023-11-05T08:30:15.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.925+0000 7f3e77fff640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:30:15.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.925+0000 7f3e77fff640 1 -- 172.21.15.52:0/3385087856 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e70031700 con 0x7f3e800aebc0 2023-11-05T08:30:15.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.925+0000 7f3e77fff640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:30:15.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.925+0000 7f3e77fff640 1 -- 172.21.15.52:0/3385087856 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e70031a90 con 0x7f3e800aebc0 2023-11-05T08:30:15.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.925+0000 7f3e77fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:30:15.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.925+0000 7f3e77fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2023-11-05T08:30:15.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.925+0000 7f3e77fff640 10 monclient: dump: 2023-11-05T08:30:15.938 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:30:15.939 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:30:15.939 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:30:15.939 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:30:15.939 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:30:15.939 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:30:15.940 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:30:15.940 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:30:15.940 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:30:15.940 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:30:15.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.925+0000 7f3e8796c640 5 monclient: authenticate success, global_id 20791 2023-11-05T08:30:15.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.925+0000 7f3e8796c640 10 monclient: get_monmap_and_config success 2023-11-05T08:30:15.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.925+0000 7f3e8796c640 4 set_mon_vals no callback set 2023-11-05T08:30:15.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.926+0000 7f3e8796c640 10 monclient: shutdown 2023-11-05T08:30:15.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.926+0000 7f3e8796c640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:30:15.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.926+0000 7f3e8796c640 1 -- 172.21.15.52:0/3385087856 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3e800aebc0 msgr2=0x7f3e800aace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:30:15.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.926+0000 7f3e8796c640 1 --2- 172.21.15.52:0/3385087856 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3e800aebc0 0x7f3e800aace0 secure :-1 s=READY pgs=5031 cs=0 l=1 rev1=1 crypto rx=0x7f3e700097a0 tx=0x7f3e7002b7a0 comp rx=0 tx=0).stop 2023-11-05T08:30:15.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.926+0000 7f3e8796c640 1 -- 172.21.15.52:0/3385087856 shutdown_connections 2023-11-05T08:30:15.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.926+0000 7f3e8796c640 1 --2- 172.21.15.52:0/3385087856 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3e800aebc0 0x7f3e800aace0 unknown :-1 s=CLOSED pgs=5031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:30:15.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.926+0000 7f3e8796c640 1 --2- 172.21.15.52:0/3385087856 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3e800ae7e0 0x7f3e800accb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:30:15.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.926+0000 7f3e8796c640 1 -- 172.21.15.52:0/3385087856 >> 172.21.15.52:0/3385087856 conn(0x7f3e800b3170 msgr2=0x7f3e800b3580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:30:15.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.926+0000 7f3e8796c640 1 -- 172.21.15.52:0/3385087856 shutdown_connections 2023-11-05T08:30:15.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.926+0000 7f3e8796c640 1 -- 172.21.15.52:0/3385087856 wait complete. 2023-11-05T08:30:15.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.927+0000 7f3e8796c640 10 monclient: build_initial_monmap 2023-11-05T08:30:15.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.927+0000 7f3e8796c640 10 monclient: monmap: 2023-11-05T08:30:15.943 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 0 2023-11-05T08:30:15.943 INFO:teuthology.orchestra.run.smithi052.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-11-05T08:30:15.943 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 0.000000 2023-11-05T08:30:15.944 INFO:teuthology.orchestra.run.smithi052.stderr:created 0.000000 2023-11-05T08:30:15.944 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 0 (unknown) 2023-11-05T08:30:15.944 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:30:15.944 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.noname-a 2023-11-05T08:30:15.944 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.noname-b 2023-11-05T08:30:15.945 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.noname-c 2023-11-05T08:30:15.945 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:30:15.945 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.927+0000 7f3e8796c640 1 librados: starting msgr at 2023-11-05T08:30:15.945 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.927+0000 7f3e8796c640 1 librados: starting objecter 2023-11-05T08:30:15.945 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.927+0000 7f3e8796c640 1 Processor -- start 2023-11-05T08:30:15.945 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.927+0000 7f3e8796c640 1 -- start start 2023-11-05T08:30:15.946 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.927+0000 7f3e8796c640 1 librados: setting wanted keys 2023-11-05T08:30:15.946 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.927+0000 7f3e8796c640 1 librados: calling monclient init 2023-11-05T08:30:15.946 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.927+0000 7f3e8796c640 10 monclient: init 2023-11-05T08:30:15.946 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.928+0000 7f3e8796c640 10 monclient: _reopen_session rank -1 2023-11-05T08:30:15.946 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.928+0000 7f3e8796c640 10 monclient: _add_conns ranks=[1,0,2] 2023-11-05T08:30:15.947 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.928+0000 7f3e8796c640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3e800ae7e0 0x7f3e801358c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:30:15.947 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.928+0000 7f3e8796c640 10 monclient(hunting): picked mon.noname-b con 0x7f3e800ae7e0 addr [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] 2023-11-05T08:30:15.947 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.928+0000 7f3e8796c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e80141c40 0x7f3e801d98e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:30:15.947 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.928+0000 7f3e8796c640 10 monclient(hunting): picked mon.noname-a con 0x7f3e80141c40 addr [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] 2023-11-05T08:30:15.947 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.928+0000 7f3e8796c640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3e8006cf30 0x7f3e801d9e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:30:15.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.928+0000 7f3e8796c640 10 monclient(hunting): picked mon.noname-c con 0x7f3e8006cf30 addr [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] 2023-11-05T08:30:15.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.928+0000 7f3e8796c640 10 monclient(hunting): start opening mon connection 2023-11-05T08:30:15.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.928+0000 7f3e8796c640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e8006df90 con 0x7f3e80141c40 2023-11-05T08:30:15.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.928+0000 7f3e8796c640 10 monclient(hunting): start opening mon connection 2023-11-05T08:30:15.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.928+0000 7f3e8796c640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e8014a930 con 0x7f3e800ae7e0 2023-11-05T08:30:15.949 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.928+0000 7f3e8796c640 10 monclient(hunting): start opening mon connection 2023-11-05T08:30:15.949 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.928+0000 7f3e8796c640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e801491a0 con 0x7f3e8006cf30 2023-11-05T08:30:15.949 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.928+0000 7f3e8796c640 10 monclient(hunting): _renew_subs 2023-11-05T08:30:15.949 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.928+0000 7f3e8796c640 10 monclient(hunting): authenticate will time out at 2762.133072s 2023-11-05T08:30:15.950 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.928+0000 7f3e84f07640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e80141c40 0x7f3e801d98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:30:15.950 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.928+0000 7f3e85708640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3e800ae7e0 0x7f3e801358c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:30:15.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.928+0000 7f3e85f09640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3e8006cf30 0x7f3e801d9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:30:15.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.928+0000 7f3e85708640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3e800ae7e0 0x7f3e801358c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.52:52028/0 (socket says 172.21.15.52:52028) 2023-11-05T08:30:15.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.928+0000 7f3e85708640 1 -- 172.21.15.52:0/3248927446 learned_addr learned my addr 172.21.15.52:0/3248927446 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-11-05T08:30:15.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.928+0000 7f3e85708640 10 monclient(hunting): get_auth_request con 0x7f3e800ae7e0 auth_method 0 2023-11-05T08:30:15.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.928+0000 7f3e85708640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:30:15.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.928+0000 7f3e85708640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:30:15.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.928+0000 7f3e85708640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:30:15.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.928+0000 7f3e84f07640 10 monclient(hunting): get_auth_request con 0x7f3e80141c40 auth_method 0 2023-11-05T08:30:15.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.928+0000 7f3e84f07640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:30:15.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.928+0000 7f3e84f07640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:30:15.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.928+0000 7f3e84f07640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:30:15.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.929+0000 7f3e85f09640 10 monclient(hunting): get_auth_request con 0x7f3e8006cf30 auth_method 0 2023-11-05T08:30:15.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.929+0000 7f3e85f09640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-11-05T08:30:15.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.929+0000 7f3e85f09640 10 monclient(hunting): _init_auth method 2 2023-11-05T08:30:15.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.929+0000 7f3e85f09640 10 monclient(hunting): _init_auth creating new auth 2023-11-05T08:30:15.954 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.929+0000 7f3e85708640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:30:15.954 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.929+0000 7f3e85708640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:30:15.954 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.929+0000 7f3e85708640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:30:15.954 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.929+0000 7f3e84f07640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:30:15.954 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.929+0000 7f3e84f07640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:30:15.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.929+0000 7f3e84f07640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:30:15.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.929+0000 7f3e85f09640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-11-05T08:30:15.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.929+0000 7f3e85f09640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-11-05T08:30:15.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.929+0000 7f3e85f09640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-11-05T08:30:15.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.932+0000 7f3e84f07640 10 monclient(hunting): handle_auth_done global_id 15786 payload 824 2023-11-05T08:30:15.956 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.932+0000 7f3e84f07640 1 -- 172.21.15.52:0/3248927446 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3e8006cf30 msgr2=0x7f3e801d9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:30:15.956 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.932+0000 7f3e84f07640 1 --2- 172.21.15.52:0/3248927446 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3e8006cf30 0x7f3e801d9e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:30:15.956 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.932+0000 7f3e84f07640 1 -- 172.21.15.52:0/3248927446 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3e800ae7e0 msgr2=0x7f3e801358c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:30:15.956 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.932+0000 7f3e84f07640 1 --2- 172.21.15.52:0/3248927446 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3e800ae7e0 0x7f3e801358c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:30:15.956 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.932+0000 7f3e84f07640 10 monclient: _finish_hunting 0 2023-11-05T08:30:15.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.932+0000 7f3e84f07640 1 monclient: found mon.noname-a 2023-11-05T08:30:15.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.932+0000 7f3e84f07640 20 monclient: _un_backoff reopen_interval_multipler now 1 2023-11-05T08:30:15.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.932+0000 7f3e84f07640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.52:3300/0 2023-11-05T08:30:15.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.932+0000 7f3e84f07640 1 -- 172.21.15.52:0/3248927446 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e70009400 con 0x7f3e80141c40 2023-11-05T08:30:15.959 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.934+0000 7f3e84f07640 1 --2- 172.21.15.52:0/3248927446 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e80141c40 0x7f3e801d98e0 secure :-1 s=READY pgs=3070 cs=0 l=1 rev1=1 crypto rx=0x7f3e70033000 tx=0x7f3e700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:30:15.959 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.934+0000 7f3e75ffb640 10 client.?.objecter ms_handle_connect 0x7f3e80141c40 2023-11-05T08:30:15.960 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.934+0000 7f3e75ffb640 10 client.?.objecter resend_mon_ops 2023-11-05T08:30:15.960 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.938+0000 7f3e75ffb640 1 -- 172.21.15.52:0/3248927446 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e70033bb0 con 0x7f3e80141c40 2023-11-05T08:30:15.960 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.938+0000 7f3e75ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:30:15.960 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.938+0000 7f3e75ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-11-05T08:30:15.960 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.938+0000 7f3e75ffb640 10 monclient: dump: 2023-11-05T08:30:15.961 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:30:15.961 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:30:15.961 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:30:15.961 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:30:15.961 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:30:15.962 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:30:15.962 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:30:15.962 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:30:15.962 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:30:15.962 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:30:15.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.938+0000 7f3e75ffb640 10 monclient: _finish_auth 0 2023-11-05T08:30:15.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.938+0000 7f3e75ffb640 10 monclient: _check_auth_tickets 2023-11-05T08:30:15.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.938+0000 7f3e75ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2023-11-05T08:30:15.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.938+0000 7f3e75ffb640 1 -- 172.21.15.52:0/3248927446 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e70033d30 con 0x7f3e80141c40 2023-11-05T08:30:15.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.938+0000 7f3e75ffb640 10 monclient: handle_config config(0 keys) v1 2023-11-05T08:30:15.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.938+0000 7f3e75ffb640 1 -- 172.21.15.52:0/3248927446 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e70033ea0 con 0x7f3e80141c40 2023-11-05T08:30:15.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.938+0000 7f3e75ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-11-05T08:30:15.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.938+0000 7f3e75ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-11-05T08:30:15.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.938+0000 7f3e75ffb640 10 monclient: dump: 2023-11-05T08:30:15.964 INFO:teuthology.orchestra.run.smithi052.stderr:epoch 1 2023-11-05T08:30:15.965 INFO:teuthology.orchestra.run.smithi052.stderr:fsid b7fdc914-b520-409f-b9d7-902b05a64252 2023-11-05T08:30:15.965 INFO:teuthology.orchestra.run.smithi052.stderr:last_changed 2023-11-05T08:05:27.666481+0000 2023-11-05T08:30:15.965 INFO:teuthology.orchestra.run.smithi052.stderr:created 2023-11-05T08:05:27.666481+0000 2023-11-05T08:30:15.965 INFO:teuthology.orchestra.run.smithi052.stderr:min_mon_release 18 (reef) 2023-11-05T08:30:15.965 INFO:teuthology.orchestra.run.smithi052.stderr:election_strategy: 1 2023-11-05T08:30:15.965 INFO:teuthology.orchestra.run.smithi052.stderr:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-11-05T08:30:15.966 INFO:teuthology.orchestra.run.smithi052.stderr:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2023-11-05T08:30:15.966 INFO:teuthology.orchestra.run.smithi052.stderr:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2023-11-05T08:30:15.966 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:30:15.966 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.938+0000 7f3e8796c640 5 monclient: authenticate success, global_id 15786 2023-11-05T08:30:15.966 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.938+0000 7f3e8796c640 10 monclient: _renew_subs 2023-11-05T08:30:15.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.938+0000 7f3e777fe640 4 set_mon_vals no callback set 2023-11-05T08:30:15.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.938+0000 7f3e8796c640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.52:3300/0 2023-11-05T08:30:15.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.938+0000 7f3e8796c640 1 -- 172.21.15.52:0/3248927446 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e8014a550 con 0x7f3e80141c40 2023-11-05T08:30:15.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.938+0000 7f3e8796c640 10 client.15786.objecter _maybe_request_map subscribing (onetime) to next osd map 2023-11-05T08:30:15.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.938+0000 7f3e8796c640 10 monclient: _renew_subs 2023-11-05T08:30:15.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.938+0000 7f3e8796c640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.52:3300/0 2023-11-05T08:30:15.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.938+0000 7f3e8796c640 1 -- 172.21.15.52:0/3248927446 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e8012ff30 con 0x7f3e80141c40 2023-11-05T08:30:15.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.938+0000 7f3e8796c640 1 librados: init done 2023-11-05T08:30:15.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.939+0000 7f3e8796c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2023-11-05T08:30:15.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.939+0000 7f3e8796c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:30:15.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.939+0000 7f3e8796c640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.52:3300/0 2023-11-05T08:30:15.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.939+0000 7f3e8796c640 1 -- 172.21.15.52:0/3248927446 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e8004e9f0 con 0x7f3e80141c40 2023-11-05T08:30:15.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.958+0000 7f3e75ffb640 1 -- 172.21.15.52:0/3248927446 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3e7003a050 con 0x7f3e80141c40 2023-11-05T08:30:15.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.958+0000 7f3e75ffb640 1 --2- 172.21.15.52:0/3248927446 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f3e6406c880 0x7f3e6406ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-05T08:30:15.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.958+0000 7f3e85708640 1 --2- 172.21.15.52:0/3248927446 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f3e6406c880 0x7f3e6406ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-05T08:30:15.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.958+0000 7f3e85708640 10 monclient: get_auth_request con 0x7f3e6406c880 auth_method 0 2023-11-05T08:30:15.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.959+0000 7f3e85708640 1 --2- 172.21.15.52:0/3248927446 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f3e6406c880 0x7f3e6406ed40 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f3e7c006f40 tx=0x7f3e7c009240 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-05T08:30:15.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.959+0000 7f3e75ffb640 10 client.15786.objecter ms_handle_connect 0x7f3e6406c880 2023-11-05T08:30:15.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.960+0000 7f3e75ffb640 1 -- 172.21.15.52:0/3248927446 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(932..932 src has 619..932) v4 ==== 6193+0+0 (secure 0 0 0) 0x7f3e7007a180 con 0x7f3e80141c40 2023-11-05T08:30:15.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.960+0000 7f3e75ffb640 10 client.15786.objecter ms_dispatch 0x7f3e80000b90 osd_map(932..932 src has 619..932) v4 2023-11-05T08:30:15.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.960+0000 7f3e75ffb640 3 client.15786.objecter handle_osd_map got epochs [932,932] > 0 2023-11-05T08:30:15.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.960+0000 7f3e75ffb640 3 client.15786.objecter handle_osd_map decoding full epoch 932 2023-11-05T08:30:15.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:15.960+0000 7f3e75ffb640 20 client.15786.objecter dump_active .. 0 homeless 2023-11-05T08:30:16.216 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:16.216+0000 7f3e75ffb640 1 -- 172.21.15.52:0/3248927446 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3e700764c0 con 0x7f3e80141c40 2023-11-05T08:30:16.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:16.216+0000 7f3e75ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2023-11-05T08:30:16.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:16.216+0000 7f3e75ffb640 10 monclient: _finish_command 1 = system:0 2023-11-05T08:30:16.397 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:16.397+0000 7f3e8796c640 10 start_mon_command cmd=[{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}] 2023-11-05T08:30:16.397 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:16.397+0000 7f3e8796c640 10 monclient: _send_command 2 [{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}] 2023-11-05T08:30:16.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:16.397+0000 7f3e8796c640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.52:3300/0 2023-11-05T08:30:16.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:16.397+0000 7f3e8796c640 1 -- 172.21.15.52:0/3248927446 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f3e8014a6e0 con 0x7f3e80141c40 2023-11-05T08:30:16.538 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:16.538+0000 7f3e75ffb640 1 -- 172.21.15.52:0/3248927446 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v2)=0 v2) v1 ==== 123+0+0 (secure 0 0 0) 0x7f3e700380c0 con 0x7f3e80141c40 2023-11-05T08:30:16.539 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:16.538+0000 7f3e75ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}] 2023-11-05T08:30:16.539 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:16.538+0000 7f3e75ffb640 10 monclient: _finish_command 2 = system:0 2023-11-05T08:30:16.539 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:16.538+0000 7f3e75ffb640 1 -- 172.21.15.52:0/3248927446 <== mon.0 v2:172.21.15.52:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f3e700764c0 con 0x7f3e80141c40 2023-11-05T08:30:16.539 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:16.538+0000 7f3e75ffb640 10 monclient: handle_config config(1 keys) v1 2023-11-05T08:30:16.540 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:16.538+0000 7f3e76ffd640 4 set_mon_vals no callback set 2023-11-05T08:30:16.540 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:16.538+0000 7f3e76ffd640 10 set_mon_vals mon_health_to_clog = false 2023-11-05T08:30:16.541 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:16.540+0000 7f3e8796c640 10 librados: watch_flush enter 2023-11-05T08:30:16.541 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:16.540+0000 7f3e8796c640 10 librados: watch_flush exit 2023-11-05T08:30:16.542 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:16.540+0000 7f3e8796c640 20 client.15786.objecter shutdown clearing up homeless session... 2023-11-05T08:30:16.542 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:16.540+0000 7f3e8796c640 10 client.15786.objecter successfully canceled tick 2023-11-05T08:30:16.542 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:16.540+0000 7f3e8796c640 1 -- 172.21.15.52:0/3248927446 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f3e6406c880 msgr2=0x7f3e6406ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:30:16.542 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:16.540+0000 7f3e8796c640 1 --2- 172.21.15.52:0/3248927446 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f3e6406c880 0x7f3e6406ed40 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f3e7c006f40 tx=0x7f3e7c009240 comp rx=0 tx=0).stop 2023-11-05T08:30:16.542 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:16.540+0000 7f3e8796c640 10 monclient: shutdown 2023-11-05T08:30:16.543 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:16.540+0000 7f3e8796c640 20 monclient: shutdown discarding 0 pending message(s) 2023-11-05T08:30:16.543 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:16.540+0000 7f3e8796c640 1 -- 172.21.15.52:0/3248927446 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e80141c40 msgr2=0x7f3e801d98e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-05T08:30:16.543 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:16.540+0000 7f3e8796c640 1 --2- 172.21.15.52:0/3248927446 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e80141c40 0x7f3e801d98e0 secure :-1 s=READY pgs=3070 cs=0 l=1 rev1=1 crypto rx=0x7f3e70033000 tx=0x7f3e700046c0 comp rx=0 tx=0).stop 2023-11-05T08:30:16.543 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:16.540+0000 7f3e8796c640 1 -- 172.21.15.52:0/3248927446 shutdown_connections 2023-11-05T08:30:16.543 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:16.540+0000 7f3e8796c640 1 --2- 172.21.15.52:0/3248927446 >> [v2:172.21.15.156:6800/3320012339,v1:172.21.15.156:6801/3320012339] conn(0x7f3e6406c880 0x7f3e6406ed40 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:30:16.544 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:16.540+0000 7f3e8796c640 1 --2- 172.21.15.52:0/3248927446 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3e8006cf30 0x7f3e801d9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:30:16.544 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:16.540+0000 7f3e8796c640 1 --2- 172.21.15.52:0/3248927446 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e80141c40 0x7f3e801d98e0 unknown :-1 s=CLOSED pgs=3070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:30:16.544 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:16.540+0000 7f3e8796c640 1 --2- 172.21.15.52:0/3248927446 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3e800ae7e0 0x7f3e801358c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-05T08:30:16.544 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:16.540+0000 7f3e8796c640 1 -- 172.21.15.52:0/3248927446 >> 172.21.15.52:0/3248927446 conn(0x7f3e800b3170 msgr2=0x7f3e800aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-05T08:30:16.544 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:16.540+0000 7f3e8796c640 1 -- 172.21.15.52:0/3248927446 shutdown_connections 2023-11-05T08:30:16.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:16.540+0000 7f3e8796c640 1 -- 172.21.15.52:0/3248927446 wait complete. 2023-11-05T08:30:16.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-11-05T08:30:16.540+0000 7f3e8796c640 1 librados: shutdown 2023-11-05T08:30:16.552 INFO:teuthology.misc:Shutting down mds daemons... 2023-11-05T08:30:16.552 INFO:teuthology.misc:Shutting down osd daemons... 2023-11-05T08:30:16.553 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-11-05T08:30:16.553 INFO:teuthology.orchestra.run:waiting for 300 2023-11-05T08:30:16.566 INFO:tasks.ceph.osd.0.smithi052.stderr:2023-11-05T08:30:16.557+0000 b47e640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.0.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 0 (PID: 86209) UID: 0 2023-11-05T08:30:16.568 INFO:tasks.ceph.osd.0.smithi052.stderr:2023-11-05T08:30:16.558+0000 b47e640 -1 osd.0 932 *** Got signal Terminated *** 2023-11-05T08:30:22.386 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2023-11-05T08:30:22.655 INFO:tasks.ceph.osd.0:Stopped 2023-11-05T08:30:22.655 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-11-05T08:30:22.656 INFO:teuthology.orchestra.run:waiting for 300 2023-11-05T08:30:22.669 INFO:tasks.ceph.osd.1.smithi052.stderr:2023-11-05T08:30:22.660+0000 b47e640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.1.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 1 (PID: 86211) UID: 0 2023-11-05T08:30:22.669 INFO:tasks.ceph.osd.1.smithi052.stderr:2023-11-05T08:30:22.661+0000 b47e640 -1 osd.1 934 *** Got signal Terminated *** 2023-11-05T08:30:26.626 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:24:29.742 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:30:26.628 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:24:29.744 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:30:26.652 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:24:29.768 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:30:26.669 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:24:29.744 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:30:26.673 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:24:29.748 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:30:26.676 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:24:29.792 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:30:26.680 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:24:29.796 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:30:26.692 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:24:29.767 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:30:26.703 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:24:29.819 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:30:28.595 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2023-11-05T08:30:36.740 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:24:39.855 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:30:36.747 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:24:39.862 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:30:36.763 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:24:39.879 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:30:36.790 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:24:39.864 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:30:36.791 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:24:39.866 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:30:36.796 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:24:39.912 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:30:36.799 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:24:39.915 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:30:36.802 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:24:39.877 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:30:36.810 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:24:39.926 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:30:46.675 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:24:49.790 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:30:46.677 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:24:49.793 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:30:46.694 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:24:49.810 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:30:46.727 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:24:49.802 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:30:46.729 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:24:49.804 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:30:46.729 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:24:49.845 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:30:46.733 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:24:49.849 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:30:46.745 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:24:49.861 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:30:46.746 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:24:49.821 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:30:56.736 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:24:59.852 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:30:56.739 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:24:59.855 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:30:56.754 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:24:59.870 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:30:56.781 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:24:59.896 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:30:56.788 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:24:59.863 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:30:56.789 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:24:59.905 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:30:56.793 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:24:59.865 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:30:56.805 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:24:59.921 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:30:56.807 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:24:59.882 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:31:06.761 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:25:09.877 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:31:06.762 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:25:09.878 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:31:06.776 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:25:09.892 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:31:06.812 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:25:09.928 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:31:06.817 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:25:09.892 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:31:06.818 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:25:09.933 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:31:06.818 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:25:09.893 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:31:06.829 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:25:09.904 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:31:06.831 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:25:09.947 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:31:16.781 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:25:19.897 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:31:16.784 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:25:19.900 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:31:16.802 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:25:19.918 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:31:16.836 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:25:19.952 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:31:16.837 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:25:19.911 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:31:16.838 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:25:19.913 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:31:16.842 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:25:19.958 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:31:16.849 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:25:19.924 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:31:16.856 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:25:19.972 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:31:26.872 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:25:29.987 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:31:26.875 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:25:29.991 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:31:26.893 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:25:30.009 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:31:26.922 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:25:29.997 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:31:26.923 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:25:29.998 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:31:26.924 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:25:30.039 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:31:26.929 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:25:30.045 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:31:26.938 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:25:30.013 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:31:26.945 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:25:30.061 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:31:36.897 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:25:40.012 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:31:36.902 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:25:40.018 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:31:36.918 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:25:40.034 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:31:36.952 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:25:40.027 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:31:36.954 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:25:40.028 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:31:36.966 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:25:40.040 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:31:36.971 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:25:40.087 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:31:36.975 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:25:40.091 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:31:36.988 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:25:40.104 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:31:46.927 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:25:50.043 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:31:46.930 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:25:50.046 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:31:46.942 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:25:50.058 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:31:46.974 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:25:50.049 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:31:46.975 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:25:50.050 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:31:46.978 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:25:50.094 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:31:46.980 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:25:50.096 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:31:46.986 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:25:50.060 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:31:46.996 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:25:50.112 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:31:56.950 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:26:00.066 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:31:56.952 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:26:00.068 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:31:56.971 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:26:00.087 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:31:56.998 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:26:00.073 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:31:57.001 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:26:00.075 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:31:57.004 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:26:00.120 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:31:57.013 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:26:00.088 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:31:57.013 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:26:00.129 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:31:57.026 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:26:00.142 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:32:06.983 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:26:10.098 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:32:06.984 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:26:10.100 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:32:06.997 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:26:10.113 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:32:07.030 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:26:10.105 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:32:07.032 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:26:10.107 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:32:07.046 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:26:10.119 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:32:07.054 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:26:10.170 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:32:07.057 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:26:10.173 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:32:07.069 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:26:10.185 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:32:17.013 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:26:20.129 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:32:17.017 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:26:20.133 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:32:17.029 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:26:20.145 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:32:17.059 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:26:20.134 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:32:17.063 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:26:20.137 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:32:17.066 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:26:20.182 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:32:17.071 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:26:20.187 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:32:17.076 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:26:20.151 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:32:17.083 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:26:20.199 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:32:18.582 INFO:tasks.ceph.osd.1:Stopped 2023-11-05T08:32:18.582 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-11-05T08:32:18.583 INFO:teuthology.orchestra.run:waiting for 300 2023-11-05T08:32:18.595 INFO:tasks.ceph.osd.2.smithi052.stderr:2023-11-05T08:32:18.586+0000 b47e640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.2.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 2 (PID: 86213) UID: 0 2023-11-05T08:32:18.596 INFO:tasks.ceph.osd.2.smithi052.stderr:2023-11-05T08:32:18.587+0000 b47e640 -1 osd.2 936 *** Got signal Terminated *** 2023-11-05T08:32:24.685 INFO:tasks.ceph.osd.2:Stopped 2023-11-05T08:32:24.685 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-11-05T08:32:24.686 INFO:teuthology.orchestra.run:waiting for 300 2023-11-05T08:32:24.699 INFO:tasks.ceph.osd.3.smithi052.stderr:2023-11-05T08:32:24.689+0000 b47e640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.3.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 3 (PID: 86214) UID: 0 2023-11-05T08:32:24.699 INFO:tasks.ceph.osd.3.smithi052.stderr:2023-11-05T08:32:24.690+0000 b47e640 -1 osd.3 938 *** Got signal Terminated *** 2023-11-05T08:32:27.035 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:26:30.151 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:32:27.042 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:26:30.157 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:32:27.060 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:26:30.176 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:32:27.085 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:26:30.160 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:32:27.088 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:26:30.163 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:32:27.092 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:26:30.208 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:32:27.097 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:26:30.213 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:32:27.105 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:26:30.180 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:32:27.115 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:26:30.231 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:32:30.787 INFO:tasks.ceph.osd.3:Stopped 2023-11-05T08:32:30.788 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-11-05T08:32:30.789 INFO:teuthology.orchestra.run:waiting for 300 2023-11-05T08:32:30.802 INFO:tasks.ceph.osd.4.smithi156.stderr:2023-11-05T08:32:30.792+0000 b47e640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.4.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 4 (PID: 86234) UID: 0 2023-11-05T08:32:30.803 INFO:tasks.ceph.osd.4.smithi156.stderr:2023-11-05T08:32:30.794+0000 b47e640 -1 osd.4 940 *** Got signal Terminated *** 2023-11-05T08:32:36.890 INFO:tasks.ceph.osd.4:Stopped 2023-11-05T08:32:36.891 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-11-05T08:32:36.891 INFO:teuthology.orchestra.run:waiting for 300 2023-11-05T08:32:36.905 INFO:tasks.ceph.osd.5.smithi156.stderr:2023-11-05T08:32:36.895+0000 b47e640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.5.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 5 (PID: 86236) UID: 0 2023-11-05T08:32:36.905 INFO:tasks.ceph.osd.5.smithi156.stderr:2023-11-05T08:32:36.896+0000 b47e640 -1 osd.5 943 *** Got signal Terminated *** 2023-11-05T08:32:37.242 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:26:40.358 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:32:37.246 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:26:40.362 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:32:37.262 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:26:40.377 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:32:37.295 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:26:40.369 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:32:37.296 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:26:40.371 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:32:37.297 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:26:40.413 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:32:37.298 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:26:40.414 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:32:37.311 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:26:40.386 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:32:37.314 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:26:40.430 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:32:42.269 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:26:45.385 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:32:42.272 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:26:45.388 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:32:42.288 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:26:45.404 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:32:42.317 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:26:45.392 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:32:42.318 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:26:45.393 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:32:42.326 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:26:45.442 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:32:42.327 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:26:45.443 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:32:42.330 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:26:45.405 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:32:42.339 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:26:45.455 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:32:57.189 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:27:00.304 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:32:57.192 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:27:00.308 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:32:57.207 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:27:00.323 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:32:57.240 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:27:00.314 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:32:57.242 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:27:00.317 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:32:57.245 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:27:00.361 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:32:57.249 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:27:00.365 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:32:57.260 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:27:00.335 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:32:57.266 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:27:00.381 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:33:01.822 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:27:04.938 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:33:01.824 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:27:04.940 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:33:01.838 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:27:04.954 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:33:01.867 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:27:04.942 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:33:01.871 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:27:04.946 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:33:01.878 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:27:04.994 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:33:01.881 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:27:04.996 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:33:01.885 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:27:04.960 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:33:01.896 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:27:05.012 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:33:02.571 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:27:05.645 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:33:02.572 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:27:05.646 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:33:02.579 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:27:05.654 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:33:02.610 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:27:05.725 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:33:02.611 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:27:05.727 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:33:02.614 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:27:05.729 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:33:02.615 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:27:05.731 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:33:02.620 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:27:05.736 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:33:02.624 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:27:05.740 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:33:17.262 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:27:20.378 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:33:17.265 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:27:20.381 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:33:17.281 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:27:20.397 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:33:17.311 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:27:20.385 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:33:17.313 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:27:20.388 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:33:17.318 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:27:20.434 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:33:17.322 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:27:20.438 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:33:17.330 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:27:20.404 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:33:17.341 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:27:20.457 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:33:22.271 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:27:25.387 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:33:22.276 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:27:25.392 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:33:22.288 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:27:25.404 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:33:22.320 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:27:25.394 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:33:22.323 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:27:25.439 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:33:22.324 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:27:25.399 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:33:22.327 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:27:25.443 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:33:22.334 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:27:25.409 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:33:22.341 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:27:25.457 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:33:37.328 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:27:40.444 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:33:37.330 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:27:40.446 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:33:37.344 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:27:40.460 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:33:37.374 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:27:40.449 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:33:37.376 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:27:40.450 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:33:37.381 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:27:40.497 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:33:37.383 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:27:40.499 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:33:37.389 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:27:40.464 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:33:37.402 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:27:40.518 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:33:42.338 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:27:45.454 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:33:42.342 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:27:45.458 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:33:42.355 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:27:45.470 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:33:42.386 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:27:45.461 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:33:42.390 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:27:45.464 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:33:42.392 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:27:45.508 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:33:42.393 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:27:45.509 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:33:42.404 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:27:45.520 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:33:42.405 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:27:45.479 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:33:57.385 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:28:00.500 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:33:57.390 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:28:00.505 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:33:57.406 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:28:00.522 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:33:57.434 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:28:00.509 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:33:57.438 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:28:00.513 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:33:57.444 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:28:00.560 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:33:57.446 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:28:00.561 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:33:57.458 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:28:00.533 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:33:57.461 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:28:00.577 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:34:02.403 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:28:05.519 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:34:02.405 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:28:05.521 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:34:02.415 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:28:05.531 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:34:02.447 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:28:05.522 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:34:02.451 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:28:05.525 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:34:02.453 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:28:05.569 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:34:02.455 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:28:05.571 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:34:02.466 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:28:05.540 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:34:02.470 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:28:05.586 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:34:17.575 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:28:20.691 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:34:17.579 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:28:20.695 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:34:17.593 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:28:20.709 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:34:17.627 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:28:20.742 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:34:17.627 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:28:20.702 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:34:17.630 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:28:20.746 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:34:17.632 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:28:20.706 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:34:17.645 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:28:20.761 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:34:17.652 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:28:20.727 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:34:22.476 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:28:25.592 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:34:22.480 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:28:25.596 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:34:22.493 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:28:25.609 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:34:22.527 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:28:25.601 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:34:22.529 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:28:25.604 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:34:22.544 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:28:25.619 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:34:22.554 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:28:25.670 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:34:22.558 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:28:25.674 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:34:22.572 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:28:25.688 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:34:37.525 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:28:40.641 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:34:37.528 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:28:40.644 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:34:37.544 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:28:40.660 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:34:37.573 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:28:40.648 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:34:37.580 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:28:40.655 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:34:37.582 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:28:40.698 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:34:37.584 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:28:40.700 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:34:37.595 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:28:40.670 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:34:37.601 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:28:40.717 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:34:42.540 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:28:45.656 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:34:42.543 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:28:45.659 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:34:42.553 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:28:45.669 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:34:42.584 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:28:45.659 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:34:42.586 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:28:45.661 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:34:42.592 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:28:45.708 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:34:42.594 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:28:45.710 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:34:42.600 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:28:45.674 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:34:42.607 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:28:45.723 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:34:57.584 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:29:00.700 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:34:57.589 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:29:00.705 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:34:57.612 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:29:00.728 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:34:57.638 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:29:00.713 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:34:57.641 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:29:00.716 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:34:57.649 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:29:00.765 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:34:57.652 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:29:00.768 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:34:57.662 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:29:00.737 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:34:57.668 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:29:00.784 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:35:02.604 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:29:05.719 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:35:02.605 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:29:05.721 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:35:02.616 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:29:05.732 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:35:02.647 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:29:05.722 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:35:02.650 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:29:05.725 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:35:02.665 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:29:05.740 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:35:02.677 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:29:05.793 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:35:02.679 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:29:05.795 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:35:02.690 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:29:05.806 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:35:17.621 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:29:20.737 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:35:17.674 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:29:20.790 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:35:17.692 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:29:20.808 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:35:17.724 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:29:20.798 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:35:17.726 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:29:20.801 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:35:17.729 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:29:20.843 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:35:17.730 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:29:20.846 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:35:17.745 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:29:20.861 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:35:17.747 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:29:20.822 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:35:22.670 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:29:25.785 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:35:22.672 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:29:25.788 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:35:22.683 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:29:25.799 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:35:22.717 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:29:25.792 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:35:22.720 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:29:25.795 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:35:22.725 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:29:25.840 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:35:22.727 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:29:25.843 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:35:22.734 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:29:25.808 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:35:22.737 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:29:25.853 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:35:37.710 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:29:40.826 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:35:37.714 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:29:40.830 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:35:37.732 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:29:40.848 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:35:37.762 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:29:40.837 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:35:37.765 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:29:40.881 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:35:37.765 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:29:40.840 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:35:37.768 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:29:40.884 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:35:37.780 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:29:40.855 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:35:37.784 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:29:40.899 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:35:42.733 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:29:45.849 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:35:42.735 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:29:45.851 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:35:42.751 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:29:45.867 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:35:42.779 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:29:45.854 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:35:42.782 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:29:45.857 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:35:42.787 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:29:45.903 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:35:42.790 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:29:45.906 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:35:42.794 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:29:45.869 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:35:42.803 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:29:45.919 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:35:57.931 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:30:01.046 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:35:57.932 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:30:01.048 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:35:57.955 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:30:01.071 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:35:57.976 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:30:01.051 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:35:57.979 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:30:01.054 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:35:57.987 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:30:01.103 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:35:57.990 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:30:01.106 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:35:57.995 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:30:01.069 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:35:58.005 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:30:01.121 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:36:02.777 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:30:05.893 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:36:02.830 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:30:05.946 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:36:02.840 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:30:05.915 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:36:02.842 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:30:05.958 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:36:02.879 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:30:05.994 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:36:02.880 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:30:05.955 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:36:02.881 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:30:05.997 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:36:02.890 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:30:05.965 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:36:02.892 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:30:06.008 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:36:15.938 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:30:19.054 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:36:15.941 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:30:19.057 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:36:15.971 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:30:19.086 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:36:15.994 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:30:19.069 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:36:15.996 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:30:19.071 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:36:16.008 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:30:19.124 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:36:16.009 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:30:19.125 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:36:16.015 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:30:19.090 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:36:16.028 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:30:19.144 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:36:17.888 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:30:21.004 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:36:17.891 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:30:21.007 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:36:17.904 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:30:21.020 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:36:17.935 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:30:21.009 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:36:17.940 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:30:21.014 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:36:17.944 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:30:21.060 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:36:17.946 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:30:21.062 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:36:17.950 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:30:21.024 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:36:17.956 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:30:21.072 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:36:22.905 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:30:26.021 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:36:22.909 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:30:26.025 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:36:22.924 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:30:26.040 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:36:22.950 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:30:26.025 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:36:22.955 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:30:26.029 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:36:22.965 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:30:26.040 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:36:22.979 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:30:26.095 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:36:22.983 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:30:26.099 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:36:22.993 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:30:26.109 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:36:37.971 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:30:41.086 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:36:37.973 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:30:41.089 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:36:37.993 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:30:41.109 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:36:38.017 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:30:41.092 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:36:38.020 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:30:41.135 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:36:38.020 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:30:41.094 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:36:38.023 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:30:41.139 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:36:38.039 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:30:41.113 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:36:38.041 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:30:41.157 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:36:38.457 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:30:41.573 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:36:38.458 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:30:41.574 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:36:38.469 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:30:41.585 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:36:38.474 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:30:41.548 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:36:38.475 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:30:41.549 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:36:38.483 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:30:41.557 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:36:38.536 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:30:41.652 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:36:38.538 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:30:41.654 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:36:38.549 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:30:41.665 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:36:40.945 INFO:tasks.ceph.osd.5:Stopped 2023-11-05T08:36:40.946 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-11-05T08:36:40.946 INFO:teuthology.orchestra.run:waiting for 300 2023-11-05T08:36:40.959 INFO:tasks.ceph.osd.6.smithi156.stderr:2023-11-05T08:36:40.950+0000 b47e640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.6.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 6 (PID: 86239) UID: 0 2023-11-05T08:36:40.960 INFO:tasks.ceph.osd.6.smithi156.stderr:2023-11-05T08:36:40.951+0000 b47e640 -1 osd.6 946 *** Got signal Terminated *** 2023-11-05T08:36:58.034 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:31:01.149 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:36:58.035 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:31:01.151 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:36:58.053 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:31:01.169 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:36:58.079 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:31:01.154 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:36:58.082 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:31:01.157 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:36:58.087 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:31:01.203 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:36:58.088 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:31:01.204 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:36:58.100 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:31:01.175 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:36:58.106 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:31:01.222 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:36:58.651 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:31:01.726 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:36:58.652 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:31:01.727 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:36:58.655 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:31:01.771 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:36:58.656 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:31:01.772 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:36:58.661 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:31:01.735 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:36:58.664 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:31:01.780 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:36:58.716 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:31:01.832 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:36:58.718 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:31:01.834 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:36:58.728 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:31:01.844 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:37:18.106 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:31:21.222 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:37:18.108 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:31:21.224 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:37:18.125 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:31:21.241 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:37:18.154 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:31:21.228 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:37:18.157 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:31:21.273 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:37:18.159 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:31:21.234 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:37:18.160 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:31:21.276 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:37:18.176 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:31:21.251 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:37:18.185 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:31:21.301 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:37:18.724 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:31:21.798 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:37:18.724 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:31:21.799 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:37:18.732 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:31:21.807 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:37:18.744 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:31:21.860 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:37:18.745 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:31:21.861 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:37:18.754 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:31:21.870 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:37:18.804 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:31:21.920 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:37:18.805 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:31:21.921 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:37:18.813 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:31:21.929 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:37:38.163 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:31:41.278 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:37:38.179 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:31:41.295 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:37:38.210 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:31:41.325 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:37:38.229 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:31:41.303 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:37:38.230 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:31:41.305 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:37:38.240 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:31:41.355 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:37:38.242 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:31:41.358 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:37:38.249 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:31:41.324 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:37:38.263 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:31:41.379 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:37:38.807 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:31:41.882 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:37:38.808 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:31:41.883 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:37:38.816 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:31:41.891 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:37:38.829 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:31:41.945 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:37:38.830 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:31:41.946 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:37:38.839 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:31:41.955 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:37:38.879 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:31:41.995 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:37:38.880 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:31:41.996 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:37:38.888 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:31:42.004 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:37:58.222 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:32:01.338 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:37:58.227 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:32:01.343 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:37:58.277 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:32:01.393 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:37:58.278 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:32:01.352 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:37:58.279 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:32:01.354 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:37:58.286 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:32:01.402 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:37:58.290 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:32:01.406 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:37:58.298 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:32:01.373 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:37:58.311 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:32:01.427 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:37:58.849 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:32:01.924 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:37:58.850 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:32:01.925 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:37:58.861 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:32:01.935 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:37:58.891 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:32:02.007 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:37:58.941 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:32:02.057 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:37:58.950 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:32:02.066 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:37:58.982 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:32:02.098 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:37:58.984 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:32:02.100 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:37:58.992 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:32:02.108 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:38:06.204 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:38:06.200+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:38:07.207 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:38:07.206+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:38:08.226 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:38:08.221+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:38:09.224 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:38:09.223+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:38:10.231 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:38:10.230+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:38:11.245 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:38:11.244+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:38:12.255 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:38:12.254+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:38:13.214 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:38:13.212+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:38:14.263 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:38:14.262+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:38:15.263 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:38:15.262+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:38:16.243 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:38:16.242+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:38:17.281 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:38:17.280+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:38:18.298 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:32:21.414 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:38:18.299 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:38:18.297+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:38:18.300 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:32:21.416 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:38:18.321 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:32:21.437 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:38:18.349 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:32:21.423 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:38:18.350 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:32:21.425 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:38:18.352 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:32:21.468 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:38:18.354 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:32:21.470 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:38:18.368 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:32:21.442 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:38:18.372 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:32:21.488 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:38:18.941 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:32:22.016 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:38:18.942 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:32:22.017 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:38:18.950 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:32:22.025 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:38:18.965 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:32:22.081 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:38:18.967 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:32:22.082 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:38:18.975 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:32:22.091 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:38:19.006 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:32:22.121 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:38:19.007 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:32:22.123 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:38:19.015 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:32:22.131 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:38:19.250 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:38:19.248+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:38:20.288 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:38:20.287+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:38:21.292 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:38:21.290+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:38:22.296 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:38:22.295+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:38:23.254 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:38:23.253+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:38:24.246 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:38:24.244+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:38:25.263 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:38:25.262+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:38:26.223 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:38:26.222+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:38:27.196 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:38:27.195+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:38:28.187 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:38:28.186+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:38:29.221 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:38:29.220+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:38:30.183 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:38:30.181+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:38:31.216 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:38:31.215+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:38:32.258 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:38:32.257+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:38:33.305 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:38:33.304+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:38:34.319 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:38:34.317+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:38:35.287 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:38:35.285+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:38:36.313 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:38:36.311+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:38:37.360 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:38:37.358+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:38:38.355 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:32:41.471 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:38:38.359 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:32:41.475 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:38:38.380 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:32:41.495 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:38:38.406 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:38:38.404+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:38:38.409 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:32:41.483 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:38:38.410 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:32:41.485 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:38:38.412 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:32:41.528 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:38:38.415 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:32:41.531 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:38:38.427 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:32:41.502 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:38:38.433 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:32:41.549 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:38:39.006 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:32:42.081 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:38:39.007 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:32:42.082 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:38:39.009 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:32:42.125 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:38:39.010 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:32:42.126 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:38:39.015 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:32:42.089 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:38:39.019 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:32:42.135 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:38:39.056 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:32:42.172 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:38:39.057 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:32:42.173 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:38:39.065 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:32:42.181 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:38:39.393 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:38:39.392+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:38:40.412 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:38:40.411+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:38:41.424 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:38:41.423+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:38:42.469 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:38:42.468+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:38:43.454 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:38:43.453+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:38:44.447 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:38:44.446+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:38:45.442 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:38:45.441+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:38:46.423 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:38:46.423+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:38:47.389 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:38:47.389+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:38:48.372 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:38:48.372+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:38:49.337 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:38:49.336+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:38:50.333 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:38:50.332+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:38:51.303 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:38:51.302+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:38:52.313 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:38:52.312+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:38:53.357 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:38:53.353+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:38:54.344 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:38:54.343+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:38:55.379 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:38:55.377+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:38:56.361 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:38:56.360+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:38:57.373 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:38:57.371+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:38:58.363 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:38:58.361+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:38:58.441 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:33:01.557 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:38:58.445 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:33:01.561 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:38:58.471 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:33:01.587 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:38:58.488 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:33:01.562 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:38:58.490 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:33:01.565 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:38:58.502 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:33:01.618 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:38:58.504 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:33:01.620 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:38:58.508 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:33:01.582 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:38:58.526 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:33:01.642 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:38:59.098 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:33:02.169 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:38:59.099 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:33:02.171 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:38:59.104 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:33:02.179 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:38:59.105 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:33:02.221 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:38:59.106 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:33:02.222 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:38:59.114 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:33:02.230 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:38:59.148 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:33:02.264 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:38:59.149 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:33:02.265 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:38:59.157 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:33:02.273 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:38:59.386 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:38:59.385+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:39:00.389 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:39:00.387+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:39:01.341 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:39:01.339+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:39:02.298 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:39:02.297+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:39:03.281 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:39:03.280+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:39:04.258 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:39:04.257+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:39:05.267 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:39:05.266+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:39:06.220 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:39:06.218+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:39:07.241 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:39:07.240+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:39:08.214 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:39:08.212+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:39:09.210 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:39:09.209+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:39:10.198 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:39:10.197+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:39:11.221 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:39:11.220+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:39:12.205 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:39:12.204+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:39:13.171 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:39:13.170+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:39:14.155 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:39:14.154+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:39:15.175 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:39:15.173+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:39:16.146 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:39:16.145+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:39:17.114 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:39:17.113+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:39:18.141 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:39:18.139+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:39:19.098 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:39:19.097+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:39:20.100 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:39:20.098+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:39:21.066 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:39:21.065+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:39:22.018 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:39:22.016+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:39:23.032 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:39:23.030+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:39:23.517 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:33:26.592 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:39:23.519 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:33:26.593 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:39:23.520 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:33:26.636 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:39:23.522 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:33:26.638 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:39:23.539 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:33:26.613 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:39:23.547 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:33:26.662 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:39:23.577 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:33:26.692 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:39:23.581 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:33:26.697 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:39:23.602 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:33:26.718 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:39:24.048 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:39:24.046+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:39:24.137 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:33:27.212 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:39:24.138 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:33:27.213 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:39:24.146 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:33:27.221 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:39:24.208 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:33:27.324 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:39:24.210 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:33:27.326 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:39:24.221 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:33:27.337 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:39:24.252 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:33:27.368 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:39:24.253 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:33:27.369 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:39:24.262 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:33:27.378 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:39:25.055 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:39:25.054+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:39:26.077 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:39:26.076+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:39:27.088 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:39:27.087+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:39:28.077 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:39:28.075+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:39:29.076 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:39:29.075+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:39:30.094 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:39:30.093+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:39:31.062 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:39:31.061+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:39:32.038 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:39:32.037+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:39:33.046 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:39:33.044+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:39:33.681 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:33:36.797 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:39:33.690 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:33:36.803 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:39:33.706 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:33:36.822 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:39:33.737 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:33:36.811 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:39:33.739 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:33:36.814 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:39:33.743 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:33:36.858 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:39:33.747 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:33:36.862 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:39:33.756 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:33:36.830 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:39:33.763 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:33:36.879 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:39:34.074 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:39:34.073+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:39:35.035 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:39:35.034+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:39:36.017 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:39:36.016+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:39:37.004 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:39:37.002+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:39:38.010 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:39:38.008+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:39:39.054 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:39:39.052+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:39:40.096 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:39:40.094+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:39:41.086 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:39:41.085+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:39:42.055 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:39:42.053+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:39:43.041 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:39:43.039+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:39:43.571 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:33:46.686 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:39:43.575 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:33:46.691 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:39:43.596 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:33:46.706 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:39:43.628 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:33:46.742 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:39:43.629 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:33:46.744 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:39:43.630 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:33:46.696 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:39:43.630 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:33:46.699 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:39:43.637 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:33:46.711 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:39:43.642 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:33:46.757 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:39:44.019 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:39:44.017+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:39:45.014 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:39:45.012+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:39:46.004 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:39:46.002+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:39:46.963 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:39:46.961+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:39:48.003 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:39:48.002+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:39:48.595 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:33:51.711 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:39:48.598 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:33:51.714 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:39:48.609 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:33:51.725 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:39:48.639 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:33:51.713 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:39:48.643 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:33:51.718 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:39:48.646 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:33:51.762 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:39:48.648 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:33:51.764 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:39:48.654 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:33:51.729 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:39:48.680 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:33:51.796 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:39:49.049 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:39:49.047+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:39:50.040 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:39:50.038+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:39:51.088 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:39:51.087+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:39:52.065 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:39:52.064+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:39:53.062 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:39:53.060+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:39:54.020 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:39:54.019+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:39:55.050 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:39:55.050+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:39:56.035 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:39:56.035+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:39:57.002 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:39:57.000+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:39:57.990 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:39:57.988+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:39:58.967 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:39:58.966+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:39:59.960 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:39:59.959+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:40:01.007 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:40:01.006+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:40:02.031 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:40:02.029+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:40:03.050 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:40:03.049+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:40:03.643 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:34:06.759 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:40:03.645 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:34:06.761 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:40:03.660 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:34:06.776 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:40:03.694 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:34:06.768 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:40:03.695 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:34:06.769 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:40:03.712 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:34:06.787 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:40:03.728 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:34:06.843 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:40:03.730 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:34:06.846 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:40:03.745 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:34:06.861 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:40:04.018 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:40:04.017+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:40:05.009 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:40:05.008+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:40:05.987 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:40:05.985+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:40:06.958 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:40:06.957+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:40:07.976 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:40:07.974+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:40:08.654 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:34:11.770 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:40:08.659 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:34:11.775 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:40:08.673 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:34:11.788 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:40:08.706 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:34:11.781 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:40:08.707 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:34:11.782 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:40:08.711 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:34:11.826 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:40:08.715 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:34:11.831 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:40:08.719 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:34:11.794 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:40:08.730 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:34:11.846 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:40:08.967 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:40:08.966+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:40:10.004 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:40:10.000+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:40:10.962 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:40:10.960+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:40:12.004 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:40:12.002+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:40:13.042 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:40:13.040+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:40:14.078 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:40:14.076+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:40:15.103 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:40:15.102+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:40:16.083 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:40:16.081+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:40:17.043 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:40:17.042+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:40:18.027 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:40:18.026+0000 ea58640 -1 osd.7 946 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:40:19.014 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:40:19.012+0000 ea58640 -1 osd.7 947 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:40:19.977 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:40:19.975+0000 ea58640 -1 osd.7 947 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:40:21.017 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:40:21.016+0000 ea58640 -1 osd.7 947 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:40:22.011 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:40:22.010+0000 ea58640 -1 osd.7 947 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:40:23.013 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:40:23.011+0000 ea58640 -1 osd.7 947 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:40:23.877 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:34:26.993 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:40:23.882 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:34:26.998 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:40:23.899 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:34:27.015 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:40:23.931 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:34:27.005 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:40:23.932 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:34:27.007 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:40:23.933 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:34:27.049 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:40:23.935 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:34:27.051 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:40:23.948 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:34:27.023 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:40:23.951 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:34:27.067 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:40:24.033 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:40:24.031+0000 ea58640 -1 osd.7 948 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:40:25.004 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:40:25.003+0000 ea58640 -1 osd.7 948 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:40:26.052 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:40:26.050+0000 ea58640 -1 osd.7 948 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:40:27.094 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:40:27.093+0000 ea58640 -1 osd.7 948 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:40:28.055 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:40:28.054+0000 ea58640 -1 osd.7 948 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:40:28.875 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:34:31.991 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:40:28.879 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:34:31.995 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:40:28.890 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:34:32.006 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:40:28.925 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:34:31.999 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:40:28.926 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:34:32.042 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:40:28.927 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:34:32.001 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:40:28.938 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:34:32.013 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:40:28.952 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:34:32.068 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:40:28.964 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:34:32.080 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:40:29.073 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:40:29.072+0000 ea58640 -1 osd.7 949 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:40:30.116 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:40:30.115+0000 ea58640 -1 osd.7 949 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:40:31.067 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:40:31.066+0000 ea58640 -1 osd.7 949 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:40:32.059 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:40:32.057+0000 ea58640 -1 osd.7 949 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:40:33.029 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:40:33.028+0000 ea58640 -1 osd.7 949 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:40:34.063 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:40:34.061+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:40:35.088 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:40:35.086+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:40:36.099 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:40:36.097+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:40:37.094 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:40:37.093+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:40:38.062 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:40:38.061+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:40:39.086 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:40:39.085+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:40:40.138 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:40:40.136+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:40:41.175 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:40:41.173+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:40:42.206 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:40:42.204+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:40:43.214 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:40:43.213+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:40:44.180 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:40:44.178+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:40:45.132 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:40:45.131+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:40:46.185 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:40:46.183+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:40:47.228 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:40:47.227+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:40:48.205 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:40:48.203+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:40:48.836 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:34:51.952 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:40:48.841 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:34:51.957 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:40:48.864 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:34:51.979 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:40:48.886 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:34:51.961 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:40:48.889 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:34:51.964 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:40:48.893 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:34:52.009 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:40:48.896 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:34:52.012 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:40:48.907 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:34:51.982 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:40:48.919 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:34:52.035 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:40:49.208 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:40:49.207+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:40:50.188 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:40:50.186+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:40:51.216 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:40:51.214+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:40:52.180 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:40:52.179+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:40:53.138 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:40:53.136+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:40:54.167 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:40:54.165+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:40:55.180 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:40:55.178+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:40:56.158 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:40:56.156+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:40:57.205 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:40:57.204+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:40:58.194 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:40:58.192+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:40:59.193 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:40:59.192+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:41:00.214 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:41:00.212+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:41:01.264 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:41:01.263+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:41:02.233 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:41:02.233+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:41:03.249 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:41:03.249+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:41:03.882 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:35:06.998 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:41:03.887 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:35:07.003 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:41:03.905 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:35:07.021 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:41:03.935 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:35:07.010 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:41:03.937 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:35:07.012 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:41:03.941 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:35:07.057 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:41:03.943 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:35:07.059 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:41:03.952 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:35:07.027 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:41:03.959 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:35:07.074 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:41:04.235 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:41:04.234+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:41:05.227 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:41:05.225+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:41:06.252 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:41:06.250+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:41:07.229 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:41:07.228+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:41:08.202 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:41:08.200+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:41:08.899 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:35:12.015 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:41:08.902 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:35:12.018 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:41:08.913 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:35:12.028 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:41:08.946 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:35:12.061 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:41:08.950 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:35:12.024 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:41:08.951 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:35:12.026 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:41:08.953 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:35:12.069 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:41:08.961 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:35:12.036 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:41:08.965 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:35:12.080 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:41:09.194 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:41:09.193+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:41:10.169 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:41:10.168+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:41:11.202 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:41:11.200+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:41:12.173 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:41:12.172+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:41:13.200 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:41:13.199+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:41:14.162 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:41:14.160+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:41:15.168 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:41:15.167+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:41:16.132 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:41:16.131+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:41:17.127 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:41:17.126+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:41:18.080 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:41:18.079+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:41:19.096 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:41:19.094+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:41:20.114 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:41:20.113+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:41:21.096 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:41:21.095+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:41:22.122 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:41:22.121+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:41:23.113 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:41:23.112+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:41:24.047 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:35:27.163 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:41:24.049 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:35:27.165 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:41:24.068 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:35:27.184 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:41:24.100 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:35:27.175 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:41:24.103 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:35:27.178 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:41:24.105 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:35:27.221 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:41:24.106 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:35:27.223 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:41:24.122 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:35:27.197 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:41:24.125 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:35:27.241 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:41:24.153 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:41:24.152+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:41:25.190 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:41:25.189+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:41:26.146 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:41:26.145+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:41:27.121 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:41:27.120+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:41:28.108 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:41:28.107+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:41:29.011 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:35:32.126 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:41:29.014 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:35:32.130 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:41:29.025 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:35:32.141 85926== Warning: unimplemented fcntl command: 1036 2023-11-05T08:41:29.061 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:35:32.135 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:41:29.062 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:35:32.137 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:41:29.064 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:35:32.180 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:41:29.065 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:35:32.181 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:41:29.072 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:35:32.146 85625== Warning: unimplemented fcntl command: 1036 2023-11-05T08:41:29.077 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:41:29.075+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:41:29.078 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:35:32.194 85930== Warning: unimplemented fcntl command: 1036 2023-11-05T08:41:30.107 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:41:30.106+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:41:31.134 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:41:31.132+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:41:32.089 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:41:32.087+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:41:33.071 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:41:33.069+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:41:34.080 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:41:34.079+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:41:35.109 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:41:35.108+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:41:36.102 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:41:36.100+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:41:37.109 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:41:37.107+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:41:38.082 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:41:38.081+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:41:39.076 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:41:39.075+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:41:40.015 INFO:teuthology.misc:Shutting down mgr daemons... 2023-11-05T08:41:40.016 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-11-05T08:41:40.017 INFO:teuthology.orchestra.run:waiting for 300 2023-11-05T08:41:40.041 INFO:tasks.ceph.mgr.y:Stopped 2023-11-05T08:41:40.041 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-11-05T08:41:40.042 INFO:teuthology.orchestra.run:waiting for 300 2023-11-05T08:41:40.042 INFO:tasks.ceph.mgr.x.smithi156.stderr:2023-11-05T08:41:40.042+0000 7f1364407640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-mgr -f --cluster ceph -i x (PID: 85623) UID: 0 2023-11-05T08:41:40.075 INFO:tasks.ceph.mgr.x:Stopped 2023-11-05T08:41:40.075 INFO:teuthology.misc:Shutting down mon daemons... 2023-11-05T08:41:40.076 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-11-05T08:41:40.076 INFO:teuthology.orchestra.run:waiting for 300 2023-11-05T08:41:40.102 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:41:40.100+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:41:40.104 INFO:tasks.ceph.mon.a.smithi052.stderr:2023-11-05T08:41:40.091+0000 9f5c640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a (PID: 85892) UID: 0 2023-11-05T08:41:40.107 INFO:tasks.ceph.mon.a.smithi052.stderr:2023-11-05T08:41:40.092+0000 9f5c640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2023-11-05T08:41:41.120 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:41:41.118+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:41:42.087 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:41:42.085+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:41:43.044 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:41:43.043+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:41:43.765 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:35:46.881 85926== 2023-11-05T08:41:43.765 INFO:tasks.ceph.mon.a.smithi052.stderr:==00:00:35:46.881 85926== Exit program on first error (--exit-on-first-error=yes) 2023-11-05T08:41:43.784 INFO:tasks.ceph.mon.a.smithi052.stderr:daemon-helper: command failed with exit status 42 2023-11-05T08:41:44.075 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:41:44.073+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:41:45.110 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:41:45.108+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:41:46.070 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:41:46.069+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:41:46.178 DEBUG:teuthology.orchestra.run:got remote process result: 42 2023-11-05T08:41:46.179 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_420cd129397301b1521ceb74e1bdbd9b855d2189/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_420cd129397301b1521ceb74e1bdbd9b855d2189/qa/tasks/ceph.py", line 1471, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi052 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a" 2023-11-05T08:41:46.180 INFO:tasks.ceph.mon.a:Stopped 2023-11-05T08:41:46.180 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-11-05T08:41:46.180 INFO:teuthology.orchestra.run:waiting for 300 2023-11-05T08:41:46.196 INFO:tasks.ceph.mon.c.smithi052.stderr:2023-11-05T08:41:46.185+0000 9f5c640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c (PID: 85894) UID: 0 2023-11-05T08:41:46.197 INFO:tasks.ceph.mon.c.smithi052.stderr:2023-11-05T08:41:46.186+0000 9f5c640 -1 mon.c@2(peon) e1 *** Got Signal Terminated *** 2023-11-05T08:41:47.048 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:41:47.047+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:41:48.016 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:41:48.014+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:41:49.029 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:41:49.028+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:41:50.001 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:41:50.000+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:41:51.014 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:41:51.013+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:41:52.012 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:41:52.010+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:41:53.061 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:41:53.059+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:41:54.069 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:41:54.068+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:41:55.068 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:41:55.067+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:41:56.038 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:41:56.037+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:41:57.040 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:41:57.039+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:41:58.006 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:41:58.005+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:41:59.040 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:41:59.038+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:42:00.054 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:42:00.052+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:42:01.037 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:42:01.036+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:42:02.038 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:42:02.037+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:42:03.029 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:42:03.028+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:42:04.077 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:42:04.076+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:42:05.118 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:42:05.117+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:42:06.089 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:42:06.086+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:42:07.073 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:42:07.063+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:42:08.099 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:42:08.098+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:42:09.110 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:42:09.109+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:42:10.125 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:42:10.124+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:42:11.111 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:42:11.111+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:42:12.085 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:42:12.084+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:42:13.075 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:42:13.073+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:42:14.054 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:42:14.052+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:42:15.019 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:42:15.018+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:42:15.975 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:42:15.973+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:42:16.957 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:42:16.955+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:42:17.948 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:42:17.947+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:42:18.953 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:42:18.952+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:42:19.939 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:42:19.938+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:42:20.949 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:42:20.948+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:42:21.960 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:42:21.959+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:42:22.924 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:42:22.923+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:42:23.928 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:42:23.927+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:42:24.974 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:42:24.972+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:42:25.988 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:42:25.987+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:42:27.021 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:42:27.020+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:42:28.009 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:42:28.008+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:42:28.976 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:42:28.975+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:42:29.960 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:42:29.959+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:42:30.183 INFO:tasks.ceph.mon.b.smithi156.stderr:2023-11-05T08:42:30.177+0000 d762640 -1 mon.b@1(probing) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed immediate osd.6 [v2:172.21.15.156:6826/2586579514,v1:172.21.15.156:6827/2586579514] for 81sec e950 v950) 2023-11-05T08:42:30.967 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:42:30.965+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:42:31.973 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:42:31.971+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:42:32.989 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:42:32.987+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:42:34.028 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:42:34.027+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:42:35.039 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:42:35.037+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:42:35.183 INFO:tasks.ceph.mon.b.smithi156.stderr:2023-11-05T08:42:35.182+0000 d762640 -1 mon.b@1(probing) e1 get_health_metrics reporting 3 slow ops, oldest is osd_failure(failed immediate osd.6 [v2:172.21.15.156:6826/2586579514,v1:172.21.15.156:6827/2586579514] for 81sec e950 v950) 2023-11-05T08:42:36.053 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:42:36.051+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:42:37.014 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:42:37.013+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:42:38.035 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:42:38.033+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:42:39.063 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:42:39.061+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:42:40.102 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:42:40.100+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:42:40.184 INFO:tasks.ceph.mon.b.smithi156.stderr:2023-11-05T08:42:40.183+0000 d762640 -1 mon.b@1(probing) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed immediate osd.6 [v2:172.21.15.156:6826/2586579514,v1:172.21.15.156:6827/2586579514] for 81sec e950 v950) 2023-11-05T08:42:41.068 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:42:41.067+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:42:42.033 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:42:42.032+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:42:42.986 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:42:42.985+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:42:44.009 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:42:44.008+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:42:44.965 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:42:44.964+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:42:45.185 INFO:tasks.ceph.mon.b.smithi156.stderr:2023-11-05T08:42:45.184+0000 d762640 -1 mon.b@1(probing) e1 get_health_metrics reporting 8 slow ops, oldest is osd_failure(failed immediate osd.6 [v2:172.21.15.156:6826/2586579514,v1:172.21.15.156:6827/2586579514] for 81sec e950 v950) 2023-11-05T08:42:45.941 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:42:45.939+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:42:46.929 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:42:46.928+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:42:47.942 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:42:47.940+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:42:48.980 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:42:48.978+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:42:49.945 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:42:49.944+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:42:50.186 INFO:tasks.ceph.mon.b.smithi156.stderr:2023-11-05T08:42:50.185+0000 d762640 -1 mon.b@1(probing) e1 get_health_metrics reporting 10 slow ops, oldest is osd_failure(failed immediate osd.6 [v2:172.21.15.156:6826/2586579514,v1:172.21.15.156:6827/2586579514] for 81sec e950 v950) 2023-11-05T08:42:50.904 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:42:50.903+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:42:51.907 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:42:51.905+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:42:52.931 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:42:52.929+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:42:53.958 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:42:53.957+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:42:55.004 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:42:55.003+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:42:55.187 INFO:tasks.ceph.mon.b.smithi156.stderr:2023-11-05T08:42:55.186+0000 d762640 -1 mon.b@1(probing) e1 get_health_metrics reporting 12 slow ops, oldest is osd_failure(failed immediate osd.6 [v2:172.21.15.156:6826/2586579514,v1:172.21.15.156:6827/2586579514] for 81sec e950 v950) 2023-11-05T08:42:56.054 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:42:56.053+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:42:57.009 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:42:57.007+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:42:57.966 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:42:57.965+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:42:58.917 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:42:58.916+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:42:59.894 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:42:59.892+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:43:00.188 INFO:tasks.ceph.mon.b.smithi156.stderr:2023-11-05T08:43:00.187+0000 d762640 -1 mon.b@1(probing) e1 get_health_metrics reporting 15 slow ops, oldest is osd_failure(failed immediate osd.6 [v2:172.21.15.156:6826/2586579514,v1:172.21.15.156:6827/2586579514] for 81sec e950 v950) 2023-11-05T08:43:00.880 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:43:00.879+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:43:01.862 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:43:01.861+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:43:02.855 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:43:02.854+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:43:03.851 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:43:03.850+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:43:04.862 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:43:04.858+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:43:05.192 INFO:tasks.ceph.mon.b.smithi156.stderr:2023-11-05T08:43:05.188+0000 d762640 -1 mon.b@1(probing) e1 get_health_metrics reporting 17 slow ops, oldest is osd_failure(failed immediate osd.6 [v2:172.21.15.156:6826/2586579514,v1:172.21.15.156:6827/2586579514] for 81sec e950 v950) 2023-11-05T08:43:05.847 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:43:05.846+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:43:06.896 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:43:06.895+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:43:07.939 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:43:07.938+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:43:08.967 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:43:08.966+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:43:09.983 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:43:09.981+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:43:10.190 INFO:tasks.ceph.mon.b.smithi156.stderr:2023-11-05T08:43:10.189+0000 d762640 -1 mon.b@1(probing) e1 get_health_metrics reporting 19 slow ops, oldest is osd_failure(failed immediate osd.6 [v2:172.21.15.156:6826/2586579514,v1:172.21.15.156:6827/2586579514] for 81sec e950 v950) 2023-11-05T08:43:10.946 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:43:10.945+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:43:11.976 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:43:11.975+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:43:13.024 INFO:tasks.ceph.osd.7.smithi156.stderr:2023-11-05T08:43:13.023+0000 ea58640 -1 osd.7 950 heartbeat_check: no reply from 172.21.15.156:6830 osd.6 since back 2023-11-05T08:36:40.030817+0000 front 2023-11-05T08:36:40.031959+0000 (oldest deadline 2023-11-05T08:38:05.330105+0000) 2023-11-05T08:43:15.191 INFO:tasks.ceph.mon.b.smithi156.stderr:2023-11-05T08:43:15.190+0000 d762640 -1 mon.b@1(probing) e1 get_health_metrics reporting 22 slow ops, oldest is osd_failure(failed immediate osd.6 [v2:172.21.15.156:6826/2586579514,v1:172.21.15.156:6827/2586579514] for 81sec e950 v950) 2023-11-05T08:43:15.680 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2023-11-05T08:43:18.885 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:37:22.001 85930== 2023-11-05T08:43:18.886 INFO:tasks.ceph.mon.c.smithi052.stderr:==00:00:37:22.001 85930== Exit program on first error (--exit-on-first-error=yes) 2023-11-05T08:43:18.902 INFO:tasks.ceph.mon.c.smithi052.stderr:daemon-helper: command failed with exit status 42 2023-11-05T08:43:20.193 INFO:tasks.ceph.mon.b.smithi156.stderr:2023-11-05T08:43:20.192+0000 d762640 -1 mon.b@1(probing) e1 get_health_metrics reporting 27 slow ops, oldest is osd_failure(failed immediate osd.6 [v2:172.21.15.156:6826/2586579514,v1:172.21.15.156:6827/2586579514] for 81sec e950 v950) 2023-11-05T08:43:20.883 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~5s 2023-11-05T08:43:20.883 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2023-11-05T08:43:23.804 DEBUG:teuthology.orchestra.run:got remote process result: 42 2023-11-05T08:43:23.804 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_420cd129397301b1521ceb74e1bdbd9b855d2189/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_420cd129397301b1521ceb74e1bdbd9b855d2189/qa/tasks/ceph.py", line 1471, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi052 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c" 2023-11-05T08:43:23.805 INFO:tasks.ceph.mon.c:Stopped 2023-11-05T08:43:23.806 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-11-05T08:43:23.806 INFO:teuthology.orchestra.run:waiting for 300 2023-11-05T08:43:23.822 INFO:tasks.ceph.mon.b.smithi156.stderr:2023-11-05T08:43:23.810+0000 9f5c640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b (PID: 85620) UID: 0 2023-11-05T08:43:23.825 INFO:tasks.ceph.mon.b.smithi156.stderr:2023-11-05T08:43:23.811+0000 9f5c640 -1 mon.b@1(probing) e1 *** Got Signal Terminated *** 2023-11-05T08:43:24.368 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:37:27.443 85625== 2023-11-05T08:43:24.368 INFO:tasks.ceph.mon.b.smithi156.stderr:==00:00:37:27.443 85625== Exit program on first error (--exit-on-first-error=yes) 2023-11-05T08:43:24.386 INFO:tasks.ceph.mon.b.smithi156.stderr:daemon-helper: command failed with exit status 42 2023-11-05T08:43:25.985 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~11s 2023-11-05T08:43:25.986 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2023-11-05T08:43:25.986 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2023-11-05T08:43:29.909 DEBUG:teuthology.orchestra.run:got remote process result: 42 2023-11-05T08:43:29.909 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_420cd129397301b1521ceb74e1bdbd9b855d2189/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_420cd129397301b1521ceb74e1bdbd9b855d2189/qa/tasks/ceph.py", line 1471, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi156 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b" 2023-11-05T08:43:29.910 INFO:tasks.ceph.mon.b:Stopped 2023-11-05T08:43:29.911 INFO:tasks.ceph:Checking cluster log for badness... 2023-11-05T08:43:29.911 DEBUG:teuthology.orchestra.run.smithi052:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v 'reached quota' | egrep -v 'overall HEALTH_' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(POOL_FULL\)' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(CACHE_POOL_NEAR_FULL\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(OBJECT_MISPLACED\)' | egrep -v 'slow request' | egrep -v 'overall HEALTH_' | egrep -v '\(PG_' | egrep -v '\(MON_DOWN\)' | egrep -v '\(SLOW_OPS\)' | egrep -v 'slow request' | head -n 1 2023-11-05T08:43:29.956 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi052.front.sepia.ceph.com 2023-11-05T08:43:29.957 DEBUG:teuthology.orchestra.run.smithi052:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-11-05T08:43:30.175 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi052.front.sepia.ceph.com 2023-11-05T08:43:30.176 DEBUG:teuthology.orchestra.run.smithi052:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-11-05T08:43:30.241 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi052.front.sepia.ceph.com 2023-11-05T08:43:30.241 DEBUG:teuthology.orchestra.run.smithi052:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-11-05T08:43:30.303 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi052.front.sepia.ceph.com 2023-11-05T08:43:30.303 DEBUG:teuthology.orchestra.run.smithi052:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-11-05T08:43:30.369 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi156.front.sepia.ceph.com 2023-11-05T08:43:30.370 DEBUG:teuthology.orchestra.run.smithi156:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-11-05T08:43:30.531 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi156.front.sepia.ceph.com 2023-11-05T08:43:30.532 DEBUG:teuthology.orchestra.run.smithi156:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-11-05T08:43:30.612 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi156.front.sepia.ceph.com 2023-11-05T08:43:30.613 DEBUG:teuthology.orchestra.run.smithi156:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-11-05T08:43:30.701 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi156.front.sepia.ceph.com 2023-11-05T08:43:30.702 DEBUG:teuthology.orchestra.run.smithi156:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-11-05T08:43:30.754 INFO:teuthology.orchestra.run.smithi156.stderr:umount: /var/lib/ceph/osd/ceph-7: target is busy. 2023-11-05T08:43:30.755 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-05T08:43:30.756 DEBUG:teuthology.orchestra.run.smithi156:> sudo PATH=/usr/sbin:$PATH lsof ; ps auxf 2023-11-05T08:43:30.985 INFO:teuthology.orchestra.run.smithi156.stdout:COMMAND PID TID TASKCMD USER FD TYPE DEVICE SIZE/OFF NODE NAME 2023-11-05T08:43:30.986 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:30.986 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:30.986 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root txt REG 8,1 102120 20353 /usr/lib/systemd/systemd 2023-11-05T08:43:30.986 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root mem REG 8,1 596532 1027 /etc/selinux/targeted/contexts/files/file_contexts.bin 2023-11-05T08:43:30.986 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:30.987 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-05T08:43:30.987 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-05T08:43:30.987 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-05T08:43:30.987 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:30.988 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root mem REG 8,1 21219 1168 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2023-11-05T08:43:30.988 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:30.988 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-05T08:43:30.988 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root mem REG 8,1 3645472 49253 /usr/lib64/systemd/libsystemd-shared-252.so 2023-11-05T08:43:30.989 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-05T08:43:30.989 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-05T08:43:30.989 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root mem REG 8,1 28552 9804 /usr/lib64/libattr.so.1.1.2501 2023-11-05T08:43:30.989 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:30.990 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-05T08:43:30.990 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-05T08:43:30.990 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-05T08:43:30.990 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root mem REG 8,1 2174088 49251 /usr/lib64/systemd/libsystemd-core-252.so 2023-11-05T08:43:30.991 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-05T08:43:30.991 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-05T08:43:30.991 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:30.991 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-05T08:43:30.992 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root mem REG 8,1 41120 9806 /usr/lib64/libacl.so.1.1.2301 2023-11-05T08:43:30.992 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-05T08:43:30.992 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:30.992 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root mem REG 8,1 107424 10180 /usr/lib64/libkmod.so.2.3.6 2023-11-05T08:43:30.993 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-05T08:43:30.993 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-05T08:43:30.993 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root mem REG 8,1 127680 9972 /usr/lib64/libseccomp.so.2.5.2 2023-11-05T08:43:30.993 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:30.994 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:30.994 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root mem REG 0,19 0 19 /sys/fs/selinux/status 2023-11-05T08:43:30.994 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root 0u CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:30.994 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root 1u CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:30.995 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root 2u CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:30.995 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root 3w CHR 1,11 0t0 10 /dev/kmsg 2023-11-05T08:43:30.995 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root 4u a_inode 0,14 0 1084 [eventpoll:5,6,8,9,11,14,15,16,17,18,19,44,45,46,47,50,53,60,69,70,84,85,102,103,106,111,112,113,116,125,128,129...] 2023-11-05T08:43:30.996 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root 5u a_inode 0,14 0 1084 [signalfd] 2023-11-05T08:43:30.996 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root 6r a_inode 0,14 0 1084 inotify 2023-11-05T08:43:30.997 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root 7r DIR 0,25 0 1 /sys/fs/cgroup 2023-11-05T08:43:30.997 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root 8u a_inode 0,14 0 1084 [timerfd] 2023-11-05T08:43:30.997 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root 9u a_inode 0,14 0 1084 [eventpoll:10,13] 2023-11-05T08:43:30.998 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root 10r REG 0,20 0 14388 /proc/1/mountinfo 2023-11-05T08:43:30.998 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root 11r a_inode 0,14 0 1084 inotify 2023-11-05T08:43:30.998 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root 12u netlink 0t0 17561 AUDIT 2023-11-05T08:43:30.998 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root 13r a_inode 0,14 0 1084 inotify 2023-11-05T08:43:30.998 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root 14r REG 0,20 0 4026532076 /proc/swaps 2023-11-05T08:43:30.999 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root 15u netlink 0t0 17553 KOBJECT_UEVENT 2023-11-05T08:43:30.999 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root 16u unix 0xffff8da318832640 0t0 17555 /run/systemd/private type=STREAM (LISTEN) 2023-11-05T08:43:30.999 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root 17u a_inode 0,14 0 1084 [timerfd] 2023-11-05T08:43:30.999 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root 18r a_inode 0,14 0 1084 inotify 2023-11-05T08:43:30.999 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root 19r a_inode 0,14 0 1084 inotify 2023-11-05T08:43:31.000 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root 20u a_inode 0,14 0 1084 bpf-prog 2023-11-05T08:43:31.000 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root 21u a_inode 0,14 0 1084 bpf-prog 2023-11-05T08:43:31.000 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root 22u a_inode 0,14 0 1084 bpf-prog 2023-11-05T08:43:31.000 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root 23u a_inode 0,14 0 1084 bpf-prog 2023-11-05T08:43:31.000 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root 24u a_inode 0,14 0 1084 bpf-prog 2023-11-05T08:43:31.001 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root 25u unix 0xffff8da307b29980 0t0 18571 type=DGRAM (CONNECTED) 2023-11-05T08:43:31.001 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root 26u a_inode 0,14 0 1084 bpf-prog 2023-11-05T08:43:31.001 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root 27r CHR 10,235 0t0 111 /dev/autofs 2023-11-05T08:43:31.001 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root 28u a_inode 0,14 0 1084 bpf-prog 2023-11-05T08:43:31.002 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root 29u a_inode 0,14 0 1084 bpf-prog 2023-11-05T08:43:31.002 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root 30u a_inode 0,14 0 1084 bpf-prog 2023-11-05T08:43:31.002 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root 31u a_inode 0,14 0 1084 bpf-prog 2023-11-05T08:43:31.002 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root 44u unix 0xffff8da318210cc0 0t0 14396 /run/systemd/io.system.ManagedOOM type=STREAM (LISTEN) 2023-11-05T08:43:31.002 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root 45u unix 0xffff8da318212640 0t0 14395 /run/systemd/userdb/io.systemd.DynamicUser type=STREAM (LISTEN) 2023-11-05T08:43:31.003 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root 46u unix 0xffff8da31821a200 0t0 14390 /run/systemd/notify type=DGRAM (CONNECTED) 2023-11-05T08:43:31.003 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root 47u unix 0xffff8da31821c400 0t0 14391 type=DGRAM (CONNECTED) 2023-11-05T08:43:31.003 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root 48u unix 0xffff8da31821c840 0t0 14392 type=DGRAM (CONNECTED) 2023-11-05T08:43:31.003 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root 50u a_inode 0,14 0 1084 [timerfd] 2023-11-05T08:43:31.003 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root 53u unix 0xffff8da3188350c0 0t0 17690 /run/.heim_org.h5l.kcm-socket type=STREAM (LISTEN) 2023-11-05T08:43:31.004 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root 60u unix 0xffff8da318833fc0 0t0 17696 type=STREAM (CONNECTED) 2023-11-05T08:43:31.004 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root 63u unix 0xffff8da318830880 0t0 17688 /run/dbus/system_bus_socket type=STREAM (LISTEN) 2023-11-05T08:43:31.004 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root 64u unix 0xffff8da31891aec0 0t0 213 /run/rpcbind.sock type=STREAM (LISTEN) 2023-11-05T08:43:31.004 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root 65u IPv4 18548 0t0 TCP *:sunrpc (LISTEN) 2023-11-05T08:43:31.004 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root 66u IPv4 18554 0t0 UDP *:sunrpc 2023-11-05T08:43:31.005 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root 67u IPv6 20879 0t0 TCP *:sunrpc (LISTEN) 2023-11-05T08:43:31.005 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root 68u IPv6 18560 0t0 UDP *:sunrpc 2023-11-05T08:43:31.005 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root 69u FIFO 0,24 0t0 441 /run/dmeventd-server 2023-11-05T08:43:31.005 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root 70u FIFO 0,24 0t0 442 /run/dmeventd-client 2023-11-05T08:43:31.005 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root 74u unix 0xffff8da318804c80 0t0 1143 /run/systemd/journal/socket type=DGRAM (CONNECTED) 2023-11-05T08:43:31.005 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root 75u unix 0xffff8da307d8aa80 0t0 1145 /run/systemd/journal/stdout type=STREAM (LISTEN) 2023-11-05T08:43:31.006 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root 84u unix 0xffff8da318923300 0t0 223 /run/systemd/coredump type=SEQPACKET (LISTEN) 2023-11-05T08:43:31.006 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root 85r FIFO 0,13 0t0 208 pipe 2023-11-05T08:43:31.006 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root 102u unix 0xffff8da318210000 0t0 1463 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-05T08:43:31.006 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root 103u unix 0xffff8da31886f700 0t0 17639 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-05T08:43:31.006 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root 104u unix 0xffff8da307d89100 0t0 18681 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-05T08:43:31.007 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root 106u unix 0xffff8da318370cc0 0t0 18682 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-05T08:43:31.007 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root 107u unix 0xffff8da318372ec0 0t0 18685 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-05T08:43:31.007 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root 108u unix 0xffff8da318835d80 0t0 18692 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-05T08:43:31.007 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root 109u unix 0xffff8da31832d500 0t0 18693 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-05T08:43:31.007 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root 110u unix 0xffff8da31891aa80 0t0 18697 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-05T08:43:31.008 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root 111u unix 0xffff8da307d88cc0 0t0 16051 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-05T08:43:31.008 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root 112u unix 0xffff8da318371980 0t0 22991 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-05T08:43:31.008 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root 113u unix 0xffff8da318372200 0t0 22992 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-05T08:43:31.008 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root 114u unix 0xffff8da318329100 0t0 17800 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-05T08:43:31.008 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root 115u unix 0xffff8da31891d0c0 0t0 21218 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-05T08:43:31.008 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root 116u unix 0xffff8da307b09dc0 0t0 160695 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-05T08:43:31.009 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root 125u FIFO 0,24 0t0 447 /run/initctl 2023-11-05T08:43:31.009 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root 126u unix 0xffff8da318806a40 0t0 1141 /run/systemd/journal/dev-log type=DGRAM (CONNECTED) 2023-11-05T08:43:31.009 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root 127u unix 0xffff8da318927700 0t0 225 /run/udev/control type=SEQPACKET (LISTEN) 2023-11-05T08:43:31.009 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root 128u unix 0xffff8da31891e600 0t0 211 /run/lvm/lvmpolld.socket type=STREAM (LISTEN) 2023-11-05T08:43:31.009 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root 129u CHR 10,242 0t0 165 /dev/rfkill 2023-11-05T08:43:31.010 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1 root 130u netlink 0t0 227 KOBJECT_UEVENT 2023-11-05T08:43:31.010 INFO:teuthology.orchestra.run.smithi156.stdout:kthreadd 2 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.010 INFO:teuthology.orchestra.run.smithi156.stdout:kthreadd 2 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.010 INFO:teuthology.orchestra.run.smithi156.stdout:kthreadd 2 root txt unknown /proc/2/exe 2023-11-05T08:43:31.010 INFO:teuthology.orchestra.run.smithi156.stdout:rcu_gp 3 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.010 INFO:teuthology.orchestra.run.smithi156.stdout:rcu_gp 3 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.011 INFO:teuthology.orchestra.run.smithi156.stdout:rcu_gp 3 root txt unknown /proc/3/exe 2023-11-05T08:43:31.011 INFO:teuthology.orchestra.run.smithi156.stdout:rcu_par_g 4 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.011 INFO:teuthology.orchestra.run.smithi156.stdout:rcu_par_g 4 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.011 INFO:teuthology.orchestra.run.smithi156.stdout:rcu_par_g 4 root txt unknown /proc/4/exe 2023-11-05T08:43:31.012 INFO:teuthology.orchestra.run.smithi156.stdout:slub_flus 5 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.012 INFO:teuthology.orchestra.run.smithi156.stdout:slub_flus 5 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.012 INFO:teuthology.orchestra.run.smithi156.stdout:slub_flus 5 root txt unknown /proc/5/exe 2023-11-05T08:43:31.012 INFO:teuthology.orchestra.run.smithi156.stdout:netns 6 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.012 INFO:teuthology.orchestra.run.smithi156.stdout:netns 6 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.013 INFO:teuthology.orchestra.run.smithi156.stdout:netns 6 root txt unknown /proc/6/exe 2023-11-05T08:43:31.013 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/0 8 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.013 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/0 8 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.013 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/0 8 root txt unknown /proc/8/exe 2023-11-05T08:43:31.013 INFO:teuthology.orchestra.run.smithi156.stdout:mm_percpu 11 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.013 INFO:teuthology.orchestra.run.smithi156.stdout:mm_percpu 11 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.014 INFO:teuthology.orchestra.run.smithi156.stdout:mm_percpu 11 root txt unknown /proc/11/exe 2023-11-05T08:43:31.014 INFO:teuthology.orchestra.run.smithi156.stdout:rcu_tasks 13 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.014 INFO:teuthology.orchestra.run.smithi156.stdout:rcu_tasks 13 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.014 INFO:teuthology.orchestra.run.smithi156.stdout:rcu_tasks 13 root txt unknown /proc/13/exe 2023-11-05T08:43:31.014 INFO:teuthology.orchestra.run.smithi156.stdout:rcu_tasks 14 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.015 INFO:teuthology.orchestra.run.smithi156.stdout:rcu_tasks 14 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.015 INFO:teuthology.orchestra.run.smithi156.stdout:rcu_tasks 14 root txt unknown /proc/14/exe 2023-11-05T08:43:31.015 INFO:teuthology.orchestra.run.smithi156.stdout:rcu_tasks 15 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.015 INFO:teuthology.orchestra.run.smithi156.stdout:rcu_tasks 15 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.015 INFO:teuthology.orchestra.run.smithi156.stdout:rcu_tasks 15 root txt unknown /proc/15/exe 2023-11-05T08:43:31.016 INFO:teuthology.orchestra.run.smithi156.stdout:ksoftirqd 16 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.016 INFO:teuthology.orchestra.run.smithi156.stdout:ksoftirqd 16 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.016 INFO:teuthology.orchestra.run.smithi156.stdout:ksoftirqd 16 root txt unknown /proc/16/exe 2023-11-05T08:43:31.016 INFO:teuthology.orchestra.run.smithi156.stdout:pr/ttyS1 17 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.016 INFO:teuthology.orchestra.run.smithi156.stdout:pr/ttyS1 17 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.016 INFO:teuthology.orchestra.run.smithi156.stdout:pr/ttyS1 17 root txt unknown /proc/17/exe 2023-11-05T08:43:31.017 INFO:teuthology.orchestra.run.smithi156.stdout:rcu_preem 18 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.017 INFO:teuthology.orchestra.run.smithi156.stdout:rcu_preem 18 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.017 INFO:teuthology.orchestra.run.smithi156.stdout:rcu_preem 18 root txt unknown /proc/18/exe 2023-11-05T08:43:31.017 INFO:teuthology.orchestra.run.smithi156.stdout:migration 19 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.017 INFO:teuthology.orchestra.run.smithi156.stdout:migration 19 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.018 INFO:teuthology.orchestra.run.smithi156.stdout:migration 19 root txt unknown /proc/19/exe 2023-11-05T08:43:31.018 INFO:teuthology.orchestra.run.smithi156.stdout:idle_inje 20 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.018 INFO:teuthology.orchestra.run.smithi156.stdout:idle_inje 20 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.018 INFO:teuthology.orchestra.run.smithi156.stdout:idle_inje 20 root txt unknown /proc/20/exe 2023-11-05T08:43:31.018 INFO:teuthology.orchestra.run.smithi156.stdout:cpuhp/0 21 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.019 INFO:teuthology.orchestra.run.smithi156.stdout:cpuhp/0 21 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.019 INFO:teuthology.orchestra.run.smithi156.stdout:cpuhp/0 21 root txt unknown /proc/21/exe 2023-11-05T08:43:31.019 INFO:teuthology.orchestra.run.smithi156.stdout:cpuhp/1 22 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.019 INFO:teuthology.orchestra.run.smithi156.stdout:cpuhp/1 22 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.019 INFO:teuthology.orchestra.run.smithi156.stdout:cpuhp/1 22 root txt unknown /proc/22/exe 2023-11-05T08:43:31.019 INFO:teuthology.orchestra.run.smithi156.stdout:idle_inje 23 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.020 INFO:teuthology.orchestra.run.smithi156.stdout:idle_inje 23 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.020 INFO:teuthology.orchestra.run.smithi156.stdout:idle_inje 23 root txt unknown /proc/23/exe 2023-11-05T08:43:31.020 INFO:teuthology.orchestra.run.smithi156.stdout:migration 24 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.020 INFO:teuthology.orchestra.run.smithi156.stdout:migration 24 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.020 INFO:teuthology.orchestra.run.smithi156.stdout:migration 24 root txt unknown /proc/24/exe 2023-11-05T08:43:31.020 INFO:teuthology.orchestra.run.smithi156.stdout:ksoftirqd 25 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.021 INFO:teuthology.orchestra.run.smithi156.stdout:ksoftirqd 25 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.021 INFO:teuthology.orchestra.run.smithi156.stdout:ksoftirqd 25 root txt unknown /proc/25/exe 2023-11-05T08:43:31.021 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/1 27 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.021 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/1 27 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.021 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/1 27 root txt unknown /proc/27/exe 2023-11-05T08:43:31.022 INFO:teuthology.orchestra.run.smithi156.stdout:cpuhp/2 28 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.022 INFO:teuthology.orchestra.run.smithi156.stdout:cpuhp/2 28 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.022 INFO:teuthology.orchestra.run.smithi156.stdout:cpuhp/2 28 root txt unknown /proc/28/exe 2023-11-05T08:43:31.022 INFO:teuthology.orchestra.run.smithi156.stdout:idle_inje 29 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.022 INFO:teuthology.orchestra.run.smithi156.stdout:idle_inje 29 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.022 INFO:teuthology.orchestra.run.smithi156.stdout:idle_inje 29 root txt unknown /proc/29/exe 2023-11-05T08:43:31.023 INFO:teuthology.orchestra.run.smithi156.stdout:migration 30 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.023 INFO:teuthology.orchestra.run.smithi156.stdout:migration 30 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.023 INFO:teuthology.orchestra.run.smithi156.stdout:migration 30 root txt unknown /proc/30/exe 2023-11-05T08:43:31.023 INFO:teuthology.orchestra.run.smithi156.stdout:ksoftirqd 31 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.023 INFO:teuthology.orchestra.run.smithi156.stdout:ksoftirqd 31 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.024 INFO:teuthology.orchestra.run.smithi156.stdout:ksoftirqd 31 root txt unknown /proc/31/exe 2023-11-05T08:43:31.024 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/2 33 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.024 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/2 33 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.024 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/2 33 root txt unknown /proc/33/exe 2023-11-05T08:43:31.024 INFO:teuthology.orchestra.run.smithi156.stdout:cpuhp/3 34 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.024 INFO:teuthology.orchestra.run.smithi156.stdout:cpuhp/3 34 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.025 INFO:teuthology.orchestra.run.smithi156.stdout:cpuhp/3 34 root txt unknown /proc/34/exe 2023-11-05T08:43:31.025 INFO:teuthology.orchestra.run.smithi156.stdout:idle_inje 35 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.025 INFO:teuthology.orchestra.run.smithi156.stdout:idle_inje 35 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.025 INFO:teuthology.orchestra.run.smithi156.stdout:idle_inje 35 root txt unknown /proc/35/exe 2023-11-05T08:43:31.025 INFO:teuthology.orchestra.run.smithi156.stdout:migration 36 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.026 INFO:teuthology.orchestra.run.smithi156.stdout:migration 36 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.026 INFO:teuthology.orchestra.run.smithi156.stdout:migration 36 root txt unknown /proc/36/exe 2023-11-05T08:43:31.026 INFO:teuthology.orchestra.run.smithi156.stdout:ksoftirqd 37 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.026 INFO:teuthology.orchestra.run.smithi156.stdout:ksoftirqd 37 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.026 INFO:teuthology.orchestra.run.smithi156.stdout:ksoftirqd 37 root txt unknown /proc/37/exe 2023-11-05T08:43:31.026 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/3 39 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.027 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/3 39 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.027 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/3 39 root txt unknown /proc/39/exe 2023-11-05T08:43:31.027 INFO:teuthology.orchestra.run.smithi156.stdout:cpuhp/4 40 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.027 INFO:teuthology.orchestra.run.smithi156.stdout:cpuhp/4 40 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.027 INFO:teuthology.orchestra.run.smithi156.stdout:cpuhp/4 40 root txt unknown /proc/40/exe 2023-11-05T08:43:31.028 INFO:teuthology.orchestra.run.smithi156.stdout:idle_inje 41 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.028 INFO:teuthology.orchestra.run.smithi156.stdout:idle_inje 41 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.028 INFO:teuthology.orchestra.run.smithi156.stdout:idle_inje 41 root txt unknown /proc/41/exe 2023-11-05T08:43:31.028 INFO:teuthology.orchestra.run.smithi156.stdout:migration 42 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.028 INFO:teuthology.orchestra.run.smithi156.stdout:migration 42 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.029 INFO:teuthology.orchestra.run.smithi156.stdout:migration 42 root txt unknown /proc/42/exe 2023-11-05T08:43:31.029 INFO:teuthology.orchestra.run.smithi156.stdout:ksoftirqd 43 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.029 INFO:teuthology.orchestra.run.smithi156.stdout:ksoftirqd 43 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.029 INFO:teuthology.orchestra.run.smithi156.stdout:ksoftirqd 43 root txt unknown /proc/43/exe 2023-11-05T08:43:31.029 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/4 45 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.030 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/4 45 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.030 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/4 45 root txt unknown /proc/45/exe 2023-11-05T08:43:31.030 INFO:teuthology.orchestra.run.smithi156.stdout:cpuhp/5 46 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.030 INFO:teuthology.orchestra.run.smithi156.stdout:cpuhp/5 46 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.030 INFO:teuthology.orchestra.run.smithi156.stdout:cpuhp/5 46 root txt unknown /proc/46/exe 2023-11-05T08:43:31.031 INFO:teuthology.orchestra.run.smithi156.stdout:idle_inje 47 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.031 INFO:teuthology.orchestra.run.smithi156.stdout:idle_inje 47 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.031 INFO:teuthology.orchestra.run.smithi156.stdout:idle_inje 47 root txt unknown /proc/47/exe 2023-11-05T08:43:31.031 INFO:teuthology.orchestra.run.smithi156.stdout:migration 48 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.031 INFO:teuthology.orchestra.run.smithi156.stdout:migration 48 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.031 INFO:teuthology.orchestra.run.smithi156.stdout:migration 48 root txt unknown /proc/48/exe 2023-11-05T08:43:31.032 INFO:teuthology.orchestra.run.smithi156.stdout:ksoftirqd 49 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.032 INFO:teuthology.orchestra.run.smithi156.stdout:ksoftirqd 49 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.032 INFO:teuthology.orchestra.run.smithi156.stdout:ksoftirqd 49 root txt unknown /proc/49/exe 2023-11-05T08:43:31.032 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/5 51 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.032 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/5 51 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.033 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/5 51 root txt unknown /proc/51/exe 2023-11-05T08:43:31.033 INFO:teuthology.orchestra.run.smithi156.stdout:cpuhp/6 52 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.033 INFO:teuthology.orchestra.run.smithi156.stdout:cpuhp/6 52 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.033 INFO:teuthology.orchestra.run.smithi156.stdout:cpuhp/6 52 root txt unknown /proc/52/exe 2023-11-05T08:43:31.033 INFO:teuthology.orchestra.run.smithi156.stdout:idle_inje 53 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.033 INFO:teuthology.orchestra.run.smithi156.stdout:idle_inje 53 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.034 INFO:teuthology.orchestra.run.smithi156.stdout:idle_inje 53 root txt unknown /proc/53/exe 2023-11-05T08:43:31.034 INFO:teuthology.orchestra.run.smithi156.stdout:migration 54 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.034 INFO:teuthology.orchestra.run.smithi156.stdout:migration 54 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.034 INFO:teuthology.orchestra.run.smithi156.stdout:migration 54 root txt unknown /proc/54/exe 2023-11-05T08:43:31.034 INFO:teuthology.orchestra.run.smithi156.stdout:ksoftirqd 55 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.035 INFO:teuthology.orchestra.run.smithi156.stdout:ksoftirqd 55 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.035 INFO:teuthology.orchestra.run.smithi156.stdout:ksoftirqd 55 root txt unknown /proc/55/exe 2023-11-05T08:43:31.035 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/6 57 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.035 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/6 57 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.035 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/6 57 root txt unknown /proc/57/exe 2023-11-05T08:43:31.036 INFO:teuthology.orchestra.run.smithi156.stdout:cpuhp/7 58 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.036 INFO:teuthology.orchestra.run.smithi156.stdout:cpuhp/7 58 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.036 INFO:teuthology.orchestra.run.smithi156.stdout:cpuhp/7 58 root txt unknown /proc/58/exe 2023-11-05T08:43:31.036 INFO:teuthology.orchestra.run.smithi156.stdout:idle_inje 59 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.036 INFO:teuthology.orchestra.run.smithi156.stdout:idle_inje 59 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.036 INFO:teuthology.orchestra.run.smithi156.stdout:idle_inje 59 root txt unknown /proc/59/exe 2023-11-05T08:43:31.037 INFO:teuthology.orchestra.run.smithi156.stdout:migration 60 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.037 INFO:teuthology.orchestra.run.smithi156.stdout:migration 60 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.037 INFO:teuthology.orchestra.run.smithi156.stdout:migration 60 root txt unknown /proc/60/exe 2023-11-05T08:43:31.037 INFO:teuthology.orchestra.run.smithi156.stdout:ksoftirqd 61 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.037 INFO:teuthology.orchestra.run.smithi156.stdout:ksoftirqd 61 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.038 INFO:teuthology.orchestra.run.smithi156.stdout:ksoftirqd 61 root txt unknown /proc/61/exe 2023-11-05T08:43:31.038 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/7 63 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.038 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/7 63 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.038 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/7 63 root txt unknown /proc/63/exe 2023-11-05T08:43:31.038 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/u 67 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.038 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/u 67 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.039 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/u 67 root txt unknown /proc/67/exe 2023-11-05T08:43:31.039 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/u 70 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.039 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/u 70 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.039 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/u 70 root txt unknown /proc/70/exe 2023-11-05T08:43:31.039 INFO:teuthology.orchestra.run.smithi156.stdout:kdevtmpfs 71 root cwd DIR 0,5 3500 1 / 2023-11-05T08:43:31.040 INFO:teuthology.orchestra.run.smithi156.stdout:kdevtmpfs 71 root rtd DIR 0,5 3500 1 / 2023-11-05T08:43:31.040 INFO:teuthology.orchestra.run.smithi156.stdout:kdevtmpfs 71 root txt unknown /proc/71/exe 2023-11-05T08:43:31.040 INFO:teuthology.orchestra.run.smithi156.stdout:inet_frag 72 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.040 INFO:teuthology.orchestra.run.smithi156.stdout:inet_frag 72 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.040 INFO:teuthology.orchestra.run.smithi156.stdout:inet_frag 72 root txt unknown /proc/72/exe 2023-11-05T08:43:31.040 INFO:teuthology.orchestra.run.smithi156.stdout:kauditd 73 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.041 INFO:teuthology.orchestra.run.smithi156.stdout:kauditd 73 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.041 INFO:teuthology.orchestra.run.smithi156.stdout:kauditd 73 root txt unknown /proc/73/exe 2023-11-05T08:43:31.041 INFO:teuthology.orchestra.run.smithi156.stdout:khungtask 75 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.041 INFO:teuthology.orchestra.run.smithi156.stdout:khungtask 75 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.041 INFO:teuthology.orchestra.run.smithi156.stdout:khungtask 75 root txt unknown /proc/75/exe 2023-11-05T08:43:31.042 INFO:teuthology.orchestra.run.smithi156.stdout:oom_reape 76 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.042 INFO:teuthology.orchestra.run.smithi156.stdout:oom_reape 76 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.042 INFO:teuthology.orchestra.run.smithi156.stdout:oom_reape 76 root txt unknown /proc/76/exe 2023-11-05T08:43:31.042 INFO:teuthology.orchestra.run.smithi156.stdout:writeback 77 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.042 INFO:teuthology.orchestra.run.smithi156.stdout:writeback 77 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.043 INFO:teuthology.orchestra.run.smithi156.stdout:writeback 77 root txt unknown /proc/77/exe 2023-11-05T08:43:31.043 INFO:teuthology.orchestra.run.smithi156.stdout:kcompactd 78 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.043 INFO:teuthology.orchestra.run.smithi156.stdout:kcompactd 78 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.043 INFO:teuthology.orchestra.run.smithi156.stdout:kcompactd 78 root txt unknown /proc/78/exe 2023-11-05T08:43:31.043 INFO:teuthology.orchestra.run.smithi156.stdout:ksmd 79 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.043 INFO:teuthology.orchestra.run.smithi156.stdout:ksmd 79 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.044 INFO:teuthology.orchestra.run.smithi156.stdout:ksmd 79 root txt unknown /proc/79/exe 2023-11-05T08:43:31.044 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/6 80 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.044 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/6 80 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.044 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/6 80 root txt unknown /proc/80/exe 2023-11-05T08:43:31.044 INFO:teuthology.orchestra.run.smithi156.stdout:khugepage 81 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.044 INFO:teuthology.orchestra.run.smithi156.stdout:khugepage 81 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.045 INFO:teuthology.orchestra.run.smithi156.stdout:khugepage 81 root txt unknown /proc/81/exe 2023-11-05T08:43:31.045 INFO:teuthology.orchestra.run.smithi156.stdout:cryptd 82 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.045 INFO:teuthology.orchestra.run.smithi156.stdout:cryptd 82 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.045 INFO:teuthology.orchestra.run.smithi156.stdout:cryptd 82 root txt unknown /proc/82/exe 2023-11-05T08:43:31.045 INFO:teuthology.orchestra.run.smithi156.stdout:kintegrit 83 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.046 INFO:teuthology.orchestra.run.smithi156.stdout:kintegrit 83 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.046 INFO:teuthology.orchestra.run.smithi156.stdout:kintegrit 83 root txt unknown /proc/83/exe 2023-11-05T08:43:31.046 INFO:teuthology.orchestra.run.smithi156.stdout:kblockd 84 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.046 INFO:teuthology.orchestra.run.smithi156.stdout:kblockd 84 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.046 INFO:teuthology.orchestra.run.smithi156.stdout:kblockd 84 root txt unknown /proc/84/exe 2023-11-05T08:43:31.046 INFO:teuthology.orchestra.run.smithi156.stdout:blkcg_pun 85 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.047 INFO:teuthology.orchestra.run.smithi156.stdout:blkcg_pun 85 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.048 INFO:teuthology.orchestra.run.smithi156.stdout:blkcg_pun 85 root txt unknown /proc/85/exe 2023-11-05T08:43:31.048 INFO:teuthology.orchestra.run.smithi156.stdout:tpm_dev_w 86 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.048 INFO:teuthology.orchestra.run.smithi156.stdout:tpm_dev_w 86 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.048 INFO:teuthology.orchestra.run.smithi156.stdout:tpm_dev_w 86 root txt unknown /proc/86/exe 2023-11-05T08:43:31.048 INFO:teuthology.orchestra.run.smithi156.stdout:md 87 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.049 INFO:teuthology.orchestra.run.smithi156.stdout:md 87 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.049 INFO:teuthology.orchestra.run.smithi156.stdout:md 87 root txt unknown /proc/87/exe 2023-11-05T08:43:31.049 INFO:teuthology.orchestra.run.smithi156.stdout:md_bitmap 88 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.049 INFO:teuthology.orchestra.run.smithi156.stdout:md_bitmap 88 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.049 INFO:teuthology.orchestra.run.smithi156.stdout:md_bitmap 88 root txt unknown /proc/88/exe 2023-11-05T08:43:31.050 INFO:teuthology.orchestra.run.smithi156.stdout:edac-poll 89 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.050 INFO:teuthology.orchestra.run.smithi156.stdout:edac-poll 89 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.050 INFO:teuthology.orchestra.run.smithi156.stdout:edac-poll 89 root txt unknown /proc/89/exe 2023-11-05T08:43:31.050 INFO:teuthology.orchestra.run.smithi156.stdout:watchdogd 90 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.050 INFO:teuthology.orchestra.run.smithi156.stdout:watchdogd 90 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.051 INFO:teuthology.orchestra.run.smithi156.stdout:watchdogd 90 root txt unknown /proc/90/exe 2023-11-05T08:43:31.051 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/5 92 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.051 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/5 92 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.051 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/5 92 root txt unknown /proc/92/exe 2023-11-05T08:43:31.051 INFO:teuthology.orchestra.run.smithi156.stdout:kswapd0 93 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.051 INFO:teuthology.orchestra.run.smithi156.stdout:kswapd0 93 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.052 INFO:teuthology.orchestra.run.smithi156.stdout:kswapd0 93 root txt unknown /proc/93/exe 2023-11-05T08:43:31.052 INFO:teuthology.orchestra.run.smithi156.stdout:kthrotld 99 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.052 INFO:teuthology.orchestra.run.smithi156.stdout:kthrotld 99 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.052 INFO:teuthology.orchestra.run.smithi156.stdout:kthrotld 99 root txt unknown /proc/99/exe 2023-11-05T08:43:31.052 INFO:teuthology.orchestra.run.smithi156.stdout:acpi_ther 109 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.053 INFO:teuthology.orchestra.run.smithi156.stdout:acpi_ther 109 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.053 INFO:teuthology.orchestra.run.smithi156.stdout:acpi_ther 109 root txt unknown /proc/109/exe 2023-11-05T08:43:31.053 INFO:teuthology.orchestra.run.smithi156.stdout:kmpath_rd 110 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.053 INFO:teuthology.orchestra.run.smithi156.stdout:kmpath_rd 110 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.053 INFO:teuthology.orchestra.run.smithi156.stdout:kmpath_rd 110 root txt unknown /proc/110/exe 2023-11-05T08:43:31.054 INFO:teuthology.orchestra.run.smithi156.stdout:kaluad 111 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.054 INFO:teuthology.orchestra.run.smithi156.stdout:kaluad 111 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.054 INFO:teuthology.orchestra.run.smithi156.stdout:kaluad 111 root txt unknown /proc/111/exe 2023-11-05T08:43:31.054 INFO:teuthology.orchestra.run.smithi156.stdout:mld 113 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.054 INFO:teuthology.orchestra.run.smithi156.stdout:mld 113 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.055 INFO:teuthology.orchestra.run.smithi156.stdout:mld 113 root txt unknown /proc/113/exe 2023-11-05T08:43:31.055 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/1 114 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.055 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/1 114 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.055 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/1 114 root txt unknown /proc/114/exe 2023-11-05T08:43:31.055 INFO:teuthology.orchestra.run.smithi156.stdout:ipv6_addr 115 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.055 INFO:teuthology.orchestra.run.smithi156.stdout:ipv6_addr 115 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.056 INFO:teuthology.orchestra.run.smithi156.stdout:ipv6_addr 115 root txt unknown /proc/115/exe 2023-11-05T08:43:31.056 INFO:teuthology.orchestra.run.smithi156.stdout:kstrp 124 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.056 INFO:teuthology.orchestra.run.smithi156.stdout:kstrp 124 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.056 INFO:teuthology.orchestra.run.smithi156.stdout:kstrp 124 root txt unknown /proc/124/exe 2023-11-05T08:43:31.056 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/3 126 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.057 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/3 126 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.057 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/3 126 root txt unknown /proc/126/exe 2023-11-05T08:43:31.057 INFO:teuthology.orchestra.run.smithi156.stdout:zswap-shr 131 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.057 INFO:teuthology.orchestra.run.smithi156.stdout:zswap-shr 131 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.057 INFO:teuthology.orchestra.run.smithi156.stdout:zswap-shr 131 root txt unknown /proc/131/exe 2023-11-05T08:43:31.058 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/u 239 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.058 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/u 239 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.058 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/u 239 root txt unknown /proc/239/exe 2023-11-05T08:43:31.058 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/6 289 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.058 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/6 289 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.059 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/6 289 root txt unknown /proc/289/exe 2023-11-05T08:43:31.059 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/3 290 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.059 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/3 290 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.059 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/3 290 root txt unknown /proc/290/exe 2023-11-05T08:43:31.059 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/4 305 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.059 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/4 305 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.060 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/4 305 root txt unknown /proc/305/exe 2023-11-05T08:43:31.060 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/2 353 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.060 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/2 353 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.060 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/2 353 root txt unknown /proc/353/exe 2023-11-05T08:43:31.061 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/0 377 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.061 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/0 377 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.061 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/0 377 root txt unknown /proc/377/exe 2023-11-05T08:43:31.061 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/7 411 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.061 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/7 411 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.061 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/7 411 root txt unknown /proc/411/exe 2023-11-05T08:43:31.062 INFO:teuthology.orchestra.run.smithi156.stdout:nvme-wq 427 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.062 INFO:teuthology.orchestra.run.smithi156.stdout:nvme-wq 427 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.062 INFO:teuthology.orchestra.run.smithi156.stdout:nvme-wq 427 root txt unknown /proc/427/exe 2023-11-05T08:43:31.062 INFO:teuthology.orchestra.run.smithi156.stdout:ata_sff 428 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.062 INFO:teuthology.orchestra.run.smithi156.stdout:ata_sff 428 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.063 INFO:teuthology.orchestra.run.smithi156.stdout:ata_sff 428 root txt unknown /proc/428/exe 2023-11-05T08:43:31.063 INFO:teuthology.orchestra.run.smithi156.stdout:nvme-rese 431 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.063 INFO:teuthology.orchestra.run.smithi156.stdout:nvme-rese 431 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.063 INFO:teuthology.orchestra.run.smithi156.stdout:nvme-rese 431 root txt unknown /proc/431/exe 2023-11-05T08:43:31.063 INFO:teuthology.orchestra.run.smithi156.stdout:nvme-dele 432 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.064 INFO:teuthology.orchestra.run.smithi156.stdout:nvme-dele 432 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.064 INFO:teuthology.orchestra.run.smithi156.stdout:nvme-dele 432 root txt unknown /proc/432/exe 2023-11-05T08:43:31.064 INFO:teuthology.orchestra.run.smithi156.stdout:nvme-auth 434 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.064 INFO:teuthology.orchestra.run.smithi156.stdout:nvme-auth 434 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.064 INFO:teuthology.orchestra.run.smithi156.stdout:nvme-auth 434 root txt unknown /proc/434/exe 2023-11-05T08:43:31.064 INFO:teuthology.orchestra.run.smithi156.stdout:ixgbe 438 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.065 INFO:teuthology.orchestra.run.smithi156.stdout:ixgbe 438 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.065 INFO:teuthology.orchestra.run.smithi156.stdout:ixgbe 438 root txt unknown /proc/438/exe 2023-11-05T08:43:31.065 INFO:teuthology.orchestra.run.smithi156.stdout:scsi_eh_0 447 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.065 INFO:teuthology.orchestra.run.smithi156.stdout:scsi_eh_0 447 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.065 INFO:teuthology.orchestra.run.smithi156.stdout:scsi_eh_0 447 root txt unknown /proc/447/exe 2023-11-05T08:43:31.066 INFO:teuthology.orchestra.run.smithi156.stdout:scsi_tmf_ 448 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.066 INFO:teuthology.orchestra.run.smithi156.stdout:scsi_tmf_ 448 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.066 INFO:teuthology.orchestra.run.smithi156.stdout:scsi_tmf_ 448 root txt unknown /proc/448/exe 2023-11-05T08:43:31.066 INFO:teuthology.orchestra.run.smithi156.stdout:scsi_eh_1 449 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.066 INFO:teuthology.orchestra.run.smithi156.stdout:scsi_eh_1 449 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.066 INFO:teuthology.orchestra.run.smithi156.stdout:scsi_eh_1 449 root txt unknown /proc/449/exe 2023-11-05T08:43:31.067 INFO:teuthology.orchestra.run.smithi156.stdout:scsi_tmf_ 450 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.067 INFO:teuthology.orchestra.run.smithi156.stdout:scsi_tmf_ 450 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.067 INFO:teuthology.orchestra.run.smithi156.stdout:scsi_tmf_ 450 root txt unknown /proc/450/exe 2023-11-05T08:43:31.067 INFO:teuthology.orchestra.run.smithi156.stdout:scsi_eh_2 451 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.067 INFO:teuthology.orchestra.run.smithi156.stdout:scsi_eh_2 451 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.068 INFO:teuthology.orchestra.run.smithi156.stdout:scsi_eh_2 451 root txt unknown /proc/451/exe 2023-11-05T08:43:31.068 INFO:teuthology.orchestra.run.smithi156.stdout:scsi_tmf_ 452 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.068 INFO:teuthology.orchestra.run.smithi156.stdout:scsi_tmf_ 452 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.068 INFO:teuthology.orchestra.run.smithi156.stdout:scsi_tmf_ 452 root txt unknown /proc/452/exe 2023-11-05T08:43:31.068 INFO:teuthology.orchestra.run.smithi156.stdout:scsi_eh_3 453 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.068 INFO:teuthology.orchestra.run.smithi156.stdout:scsi_eh_3 453 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.069 INFO:teuthology.orchestra.run.smithi156.stdout:scsi_eh_3 453 root txt unknown /proc/453/exe 2023-11-05T08:43:31.069 INFO:teuthology.orchestra.run.smithi156.stdout:scsi_tmf_ 454 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.069 INFO:teuthology.orchestra.run.smithi156.stdout:scsi_tmf_ 454 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.069 INFO:teuthology.orchestra.run.smithi156.stdout:scsi_tmf_ 454 root txt unknown /proc/454/exe 2023-11-05T08:43:31.069 INFO:teuthology.orchestra.run.smithi156.stdout:scsi_eh_4 455 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.070 INFO:teuthology.orchestra.run.smithi156.stdout:scsi_eh_4 455 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.070 INFO:teuthology.orchestra.run.smithi156.stdout:scsi_eh_4 455 root txt unknown /proc/455/exe 2023-11-05T08:43:31.070 INFO:teuthology.orchestra.run.smithi156.stdout:scsi_tmf_ 456 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.070 INFO:teuthology.orchestra.run.smithi156.stdout:scsi_tmf_ 456 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.070 INFO:teuthology.orchestra.run.smithi156.stdout:scsi_tmf_ 456 root txt unknown /proc/456/exe 2023-11-05T08:43:31.071 INFO:teuthology.orchestra.run.smithi156.stdout:scsi_eh_5 457 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.071 INFO:teuthology.orchestra.run.smithi156.stdout:scsi_eh_5 457 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.071 INFO:teuthology.orchestra.run.smithi156.stdout:scsi_eh_5 457 root txt unknown /proc/457/exe 2023-11-05T08:43:31.071 INFO:teuthology.orchestra.run.smithi156.stdout:scsi_tmf_ 458 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.071 INFO:teuthology.orchestra.run.smithi156.stdout:scsi_tmf_ 458 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.071 INFO:teuthology.orchestra.run.smithi156.stdout:scsi_tmf_ 458 root txt unknown /proc/458/exe 2023-11-05T08:43:31.072 INFO:teuthology.orchestra.run.smithi156.stdout:scsi_eh_6 459 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.072 INFO:teuthology.orchestra.run.smithi156.stdout:scsi_eh_6 459 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.072 INFO:teuthology.orchestra.run.smithi156.stdout:scsi_eh_6 459 root txt unknown /proc/459/exe 2023-11-05T08:43:31.072 INFO:teuthology.orchestra.run.smithi156.stdout:scsi_tmf_ 460 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.072 INFO:teuthology.orchestra.run.smithi156.stdout:scsi_tmf_ 460 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.073 INFO:teuthology.orchestra.run.smithi156.stdout:scsi_tmf_ 460 root txt unknown /proc/460/exe 2023-11-05T08:43:31.073 INFO:teuthology.orchestra.run.smithi156.stdout:scsi_eh_7 461 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.073 INFO:teuthology.orchestra.run.smithi156.stdout:scsi_eh_7 461 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.073 INFO:teuthology.orchestra.run.smithi156.stdout:scsi_eh_7 461 root txt unknown /proc/461/exe 2023-11-05T08:43:31.073 INFO:teuthology.orchestra.run.smithi156.stdout:scsi_tmf_ 462 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.073 INFO:teuthology.orchestra.run.smithi156.stdout:scsi_tmf_ 462 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.074 INFO:teuthology.orchestra.run.smithi156.stdout:scsi_tmf_ 462 root txt unknown /proc/462/exe 2023-11-05T08:43:31.074 INFO:teuthology.orchestra.run.smithi156.stdout:scsi_eh_8 463 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.074 INFO:teuthology.orchestra.run.smithi156.stdout:scsi_eh_8 463 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.074 INFO:teuthology.orchestra.run.smithi156.stdout:scsi_eh_8 463 root txt unknown /proc/463/exe 2023-11-05T08:43:31.074 INFO:teuthology.orchestra.run.smithi156.stdout:scsi_tmf_ 464 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.075 INFO:teuthology.orchestra.run.smithi156.stdout:scsi_tmf_ 464 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.075 INFO:teuthology.orchestra.run.smithi156.stdout:scsi_tmf_ 464 root txt unknown /proc/464/exe 2023-11-05T08:43:31.075 INFO:teuthology.orchestra.run.smithi156.stdout:scsi_eh_9 465 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.075 INFO:teuthology.orchestra.run.smithi156.stdout:scsi_eh_9 465 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.075 INFO:teuthology.orchestra.run.smithi156.stdout:scsi_eh_9 465 root txt unknown /proc/465/exe 2023-11-05T08:43:31.076 INFO:teuthology.orchestra.run.smithi156.stdout:scsi_tmf_ 466 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.076 INFO:teuthology.orchestra.run.smithi156.stdout:scsi_tmf_ 466 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.076 INFO:teuthology.orchestra.run.smithi156.stdout:scsi_tmf_ 466 root txt unknown /proc/466/exe 2023-11-05T08:43:31.076 INFO:teuthology.orchestra.run.smithi156.stdout:jbd2/sda1 489 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.076 INFO:teuthology.orchestra.run.smithi156.stdout:jbd2/sda1 489 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.076 INFO:teuthology.orchestra.run.smithi156.stdout:jbd2/sda1 489 root txt unknown /proc/489/exe 2023-11-05T08:43:31.077 INFO:teuthology.orchestra.run.smithi156.stdout:ext4-rsv- 490 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.077 INFO:teuthology.orchestra.run.smithi156.stdout:ext4-rsv- 490 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.077 INFO:teuthology.orchestra.run.smithi156.stdout:ext4-rsv- 490 root txt unknown /proc/490/exe 2023-11-05T08:43:31.077 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-j 565 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.077 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-j 565 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.078 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-j 565 root txt REG 8,1 185496 20360 /usr/lib/systemd/systemd-journald 2023-11-05T08:43:31.078 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-j 565 root mem REG 0,24 8388608 58 /run/log/journal/15949e3c88704300882482eddfd7baae/system.journal 2023-11-05T08:43:31.078 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-j 565 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-05T08:43:31.078 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-j 565 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-05T08:43:31.078 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-j 565 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-05T08:43:31.078 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-j 565 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-05T08:43:31.079 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-j 565 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:31.079 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-j 565 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:31.079 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-j 565 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:31.079 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-j 565 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-05T08:43:31.079 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-j 565 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-05T08:43:31.080 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-j 565 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-05T08:43:31.080 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-j 565 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-05T08:43:31.080 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-j 565 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-05T08:43:31.080 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-j 565 root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-05T08:43:31.080 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-j 565 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:31.080 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-j 565 root mem REG 8,1 28552 9804 /usr/lib64/libattr.so.1.1.2501 2023-11-05T08:43:31.081 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-j 565 root mem REG 8,1 127680 9972 /usr/lib64/libseccomp.so.2.5.2 2023-11-05T08:43:31.081 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-j 565 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-05T08:43:31.081 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-j 565 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-05T08:43:31.081 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-j 565 root mem REG 8,1 107424 10180 /usr/lib64/libkmod.so.2.3.6 2023-11-05T08:43:31.081 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-j 565 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-05T08:43:31.082 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-j 565 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-05T08:43:31.082 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-j 565 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:31.082 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-j 565 root mem REG 8,1 3645472 49253 /usr/lib64/systemd/libsystemd-shared-252.so 2023-11-05T08:43:31.082 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-j 565 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-05T08:43:31.082 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-j 565 root mem REG 8,1 41120 9806 /usr/lib64/libacl.so.1.1.2301 2023-11-05T08:43:31.083 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-j 565 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:31.083 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-j 565 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:31.083 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-j 565 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:31.083 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-j 565 root mem REG 0,24 8 55 /run/systemd/journal/kernel-seqnum 2023-11-05T08:43:31.083 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-j 565 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.083 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-j 565 root 1w CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.084 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-j 565 root 2w CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.084 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-j 565 root 3u unix 0xffff8da318804c80 0t0 1143 /run/systemd/journal/socket type=DGRAM (CONNECTED) 2023-11-05T08:43:31.084 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-j 565 root 4u unix 0xffff8da307d8aa80 0t0 1145 /run/systemd/journal/stdout type=STREAM (LISTEN) 2023-11-05T08:43:31.084 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-j 565 root 5u unix 0xffff8da318806a40 0t0 1141 /run/systemd/journal/dev-log type=DGRAM (CONNECTED) 2023-11-05T08:43:31.084 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-j 565 root 6w CHR 1,11 0t0 10 /dev/kmsg 2023-11-05T08:43:31.085 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-j 565 root 7u a_inode 0,14 0 1084 [eventpoll:3,4,5,8,9,10,11,12,13,15,17,18,19,20,23,24,25,26,27,28,29,30,32,33] 2023-11-05T08:43:31.085 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-j 565 root 8u CHR 1,11 0t0 10 /dev/kmsg 2023-11-05T08:43:31.085 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-j 565 root 9u unix 0xffff8da31832f700 0t0 19830 /run/systemd/journal/io.systemd.journal type=STREAM (LISTEN) 2023-11-05T08:43:31.085 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-j 565 root 10r REG 0,20 0 12 /proc/sys/kernel/hostname 2023-11-05T08:43:31.085 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-j 565 root 11u a_inode 0,14 0 1084 [signalfd] 2023-11-05T08:43:31.085 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-j 565 root 12u a_inode 0,14 0 1084 [signalfd] 2023-11-05T08:43:31.086 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-j 565 root 13u a_inode 0,14 0 1084 [signalfd] 2023-11-05T08:43:31.086 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-j 565 root 14u unix 0xffff8da318331100 0t0 19831 type=DGRAM (CONNECTED) 2023-11-05T08:43:31.086 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-j 565 root 15u a_inode 0,14 0 1084 [timerfd] 2023-11-05T08:43:31.086 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-j 565 root 16u REG 0,24 8388608 58 /run/log/journal/15949e3c88704300882482eddfd7baae/system.journal 2023-11-05T08:43:31.086 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-j 565 root 17u unix 0xffff8da318210000 0t0 1463 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-05T08:43:31.087 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-j 565 root 18u unix 0xffff8da307d89100 0t0 18681 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-05T08:43:31.087 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-j 565 root 19u unix 0xffff8da31886f700 0t0 17639 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-05T08:43:31.087 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-j 565 root 20u unix 0xffff8da318370cc0 0t0 18682 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-05T08:43:31.087 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-j 565 root 23u unix 0xffff8da318372ec0 0t0 18685 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-05T08:43:31.087 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-j 565 root 24u unix 0xffff8da318835d80 0t0 18692 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-05T08:43:31.088 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-j 565 root 25u unix 0xffff8da31832d500 0t0 18693 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-05T08:43:31.088 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-j 565 root 26u unix 0xffff8da307b09dc0 0t0 160695 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-05T08:43:31.088 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-j 565 root 27u unix 0xffff8da307d88cc0 0t0 16051 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-05T08:43:31.088 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-j 565 root 28u unix 0xffff8da31891aa80 0t0 18697 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-05T08:43:31.088 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-j 565 root 29u unix 0xffff8da318371980 0t0 22991 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-05T08:43:31.088 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-j 565 root 30u unix 0xffff8da318372200 0t0 22992 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-05T08:43:31.089 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-j 565 root 32u unix 0xffff8da318329100 0t0 17800 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-05T08:43:31.089 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-j 565 root 33u unix 0xffff8da31891d0c0 0t0 21218 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-05T08:43:31.089 INFO:teuthology.orchestra.run.smithi156.stdout:ext4lazyi 571 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.089 INFO:teuthology.orchestra.run.smithi156.stdout:ext4lazyi 571 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.089 INFO:teuthology.orchestra.run.smithi156.stdout:ext4lazyi 571 root txt unknown /proc/571/exe 2023-11-05T08:43:31.090 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-u 581 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.090 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-u 581 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.090 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-u 581 root txt REG 8,1 597744 11595 /usr/bin/udevadm 2023-11-05T08:43:31.090 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-u 581 root mem REG 8,1 11730661 64128 /etc/udev/hwdb.bin 2023-11-05T08:43:31.090 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-u 581 root mem REG 8,1 596532 1027 /etc/selinux/targeted/contexts/files/file_contexts.bin 2023-11-05T08:43:31.090 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-u 581 root mem REG 8,1 21219 1168 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2023-11-05T08:43:31.091 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-u 581 root mem REG 8,1 566315 265239 /usr/lib/modules/5.14.0-378.el9.x86_64/modules.symbols.bin 2023-11-05T08:43:31.091 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-u 581 root mem REG 8,1 821166 265236 /usr/lib/modules/5.14.0-378.el9.x86_64/modules.alias.bin 2023-11-05T08:43:31.091 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-u 581 root mem REG 8,1 383471 265245 /usr/lib/modules/5.14.0-378.el9.x86_64/modules.dep.bin 2023-11-05T08:43:31.091 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-u 581 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-05T08:43:31.091 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-u 581 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:31.092 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-u 581 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-05T08:43:31.092 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-u 581 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-05T08:43:31.092 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-u 581 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-05T08:43:31.092 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-u 581 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-05T08:43:31.092 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-u 581 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:31.092 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-u 581 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:31.093 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-u 581 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-05T08:43:31.093 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-u 581 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-05T08:43:31.093 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-u 581 root mem REG 8,1 28552 9804 /usr/lib64/libattr.so.1.1.2501 2023-11-05T08:43:31.093 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-u 581 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-05T08:43:31.093 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-u 581 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:31.094 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-u 581 root mem REG 8,1 127680 9972 /usr/lib64/libseccomp.so.2.5.2 2023-11-05T08:43:31.094 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-u 581 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-05T08:43:31.094 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-u 581 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-05T08:43:31.094 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-u 581 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:31.094 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-u 581 root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-05T08:43:31.095 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-u 581 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-05T08:43:31.095 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-u 581 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-05T08:43:31.095 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-u 581 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-05T08:43:31.095 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-u 581 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:31.095 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-u 581 root mem REG 8,1 41120 9806 /usr/lib64/libacl.so.1.1.2301 2023-11-05T08:43:31.095 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-u 581 root mem REG 8,1 3645472 49253 /usr/lib64/systemd/libsystemd-shared-252.so 2023-11-05T08:43:31.096 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-u 581 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:31.096 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-u 581 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-05T08:43:31.096 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-u 581 root mem REG 8,1 107424 10180 /usr/lib64/libkmod.so.2.3.6 2023-11-05T08:43:31.096 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-u 581 root mem REG 8,1 11812 265240 /usr/lib/modules/5.14.0-378.el9.x86_64/modules.builtin.bin 2023-11-05T08:43:31.096 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-u 581 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:31.097 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-u 581 root mem REG 0,19 0 19 /sys/fs/selinux/status 2023-11-05T08:43:31.097 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-u 581 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.097 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-u 581 root 1u unix 0xffff8da318212a80 0t0 20905 type=STREAM (CONNECTED) 2023-11-05T08:43:31.097 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-u 581 root 2u unix 0xffff8da318212a80 0t0 20905 type=STREAM (CONNECTED) 2023-11-05T08:43:31.097 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-u 581 root 3u netlink 0t0 227 KOBJECT_UEVENT 2023-11-05T08:43:31.098 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-u 581 root 4u unix 0xffff8da318927700 0t0 225 /run/udev/control type=SEQPACKET (LISTEN) 2023-11-05T08:43:31.098 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-u 581 root 5u unix 0xffff8da31821f700 0t0 20917 type=DGRAM (CONNECTED) 2023-11-05T08:43:31.098 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-u 581 root 6u unix 0xffff8da31821d500 0t0 20921 type=DGRAM (CONNECTED) 2023-11-05T08:43:31.098 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-u 581 root 7u unix 0xffff8da318218440 0t0 20922 type=DGRAM (CONNECTED) 2023-11-05T08:43:31.098 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-u 581 root 8r a_inode 0,14 0 1084 inotify 2023-11-05T08:43:31.098 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-u 581 root 9u a_inode 0,14 0 1084 [eventpoll:3,4,6,8,10,11,14] 2023-11-05T08:43:31.099 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-u 581 root 10u a_inode 0,14 0 1084 [signalfd] 2023-11-05T08:43:31.099 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-u 581 root 11u a_inode 0,14 0 1084 [timerfd] 2023-11-05T08:43:31.099 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-u 581 root 12r REG 8,1 11730661 64128 /etc/udev/hwdb.bin 2023-11-05T08:43:31.099 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-u 581 root 14u a_inode 0,14 0 1084 [timerfd] 2023-11-05T08:43:31.099 INFO:teuthology.orchestra.run.smithi156.stdout:ipmi-msgh 624 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.100 INFO:teuthology.orchestra.run.smithi156.stdout:ipmi-msgh 624 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.100 INFO:teuthology.orchestra.run.smithi156.stdout:ipmi-msgh 624 root txt unknown /proc/624/exe 2023-11-05T08:43:31.100 INFO:teuthology.orchestra.run.smithi156.stdout:kipmi0 633 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.100 INFO:teuthology.orchestra.run.smithi156.stdout:kipmi0 633 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.100 INFO:teuthology.orchestra.run.smithi156.stdout:kipmi0 633 root txt unknown /proc/633/exe 2023-11-05T08:43:31.101 INFO:teuthology.orchestra.run.smithi156.stdout:rpcbind 651 rpc cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.101 INFO:teuthology.orchestra.run.smithi156.stdout:rpcbind 651 rpc rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.101 INFO:teuthology.orchestra.run.smithi156.stdout:rpcbind 651 rpc txt REG 8,1 61200 14999 /usr/bin/rpcbind 2023-11-05T08:43:31.101 INFO:teuthology.orchestra.run.smithi156.stdout:rpcbind 651 rpc mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:31.101 INFO:teuthology.orchestra.run.smithi156.stdout:rpcbind 651 rpc mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-05T08:43:31.101 INFO:teuthology.orchestra.run.smithi156.stdout:rpcbind 651 rpc mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:31.102 INFO:teuthology.orchestra.run.smithi156.stdout:rpcbind 651 rpc mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:31.102 INFO:teuthology.orchestra.run.smithi156.stdout:rpcbind 651 rpc mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-05T08:43:31.102 INFO:teuthology.orchestra.run.smithi156.stdout:rpcbind 651 rpc mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-05T08:43:31.102 INFO:teuthology.orchestra.run.smithi156.stdout:rpcbind 651 rpc mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-05T08:43:31.102 INFO:teuthology.orchestra.run.smithi156.stdout:rpcbind 651 rpc mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-05T08:43:31.103 INFO:teuthology.orchestra.run.smithi156.stdout:rpcbind 651 rpc mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:31.103 INFO:teuthology.orchestra.run.smithi156.stdout:rpcbind 651 rpc mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-05T08:43:31.103 INFO:teuthology.orchestra.run.smithi156.stdout:rpcbind 651 rpc mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-05T08:43:31.103 INFO:teuthology.orchestra.run.smithi156.stdout:rpcbind 651 rpc mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-05T08:43:31.103 INFO:teuthology.orchestra.run.smithi156.stdout:rpcbind 651 rpc mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-05T08:43:31.103 INFO:teuthology.orchestra.run.smithi156.stdout:rpcbind 651 rpc mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:31.104 INFO:teuthology.orchestra.run.smithi156.stdout:rpcbind 651 rpc mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-05T08:43:31.104 INFO:teuthology.orchestra.run.smithi156.stdout:rpcbind 651 rpc mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:31.104 INFO:teuthology.orchestra.run.smithi156.stdout:rpcbind 651 rpc mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-05T08:43:31.104 INFO:teuthology.orchestra.run.smithi156.stdout:rpcbind 651 rpc mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-05T08:43:31.104 INFO:teuthology.orchestra.run.smithi156.stdout:rpcbind 651 rpc mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-05T08:43:31.105 INFO:teuthology.orchestra.run.smithi156.stdout:rpcbind 651 rpc mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-05T08:43:31.105 INFO:teuthology.orchestra.run.smithi156.stdout:rpcbind 651 rpc mem REG 8,1 196112 11431 /usr/lib64/libtirpc.so.3.0.0 2023-11-05T08:43:31.105 INFO:teuthology.orchestra.run.smithi156.stdout:rpcbind 651 rpc mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:31.105 INFO:teuthology.orchestra.run.smithi156.stdout:rpcbind 651 rpc 0r CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.105 INFO:teuthology.orchestra.run.smithi156.stdout:rpcbind 651 rpc 1u unix 0xffff8da318869100 0t0 16514 type=STREAM (CONNECTED) 2023-11-05T08:43:31.105 INFO:teuthology.orchestra.run.smithi156.stdout:rpcbind 651 rpc 2u unix 0xffff8da318869100 0t0 16514 type=STREAM (CONNECTED) 2023-11-05T08:43:31.106 INFO:teuthology.orchestra.run.smithi156.stdout:rpcbind 651 rpc 3u unix 0xffff8da31891aec0 0t0 213 /run/rpcbind.sock type=STREAM (LISTEN) 2023-11-05T08:43:31.106 INFO:teuthology.orchestra.run.smithi156.stdout:rpcbind 651 rpc 4u IPv4 18548 0t0 TCP *:sunrpc (LISTEN) 2023-11-05T08:43:31.106 INFO:teuthology.orchestra.run.smithi156.stdout:rpcbind 651 rpc 5u IPv4 18554 0t0 UDP *:sunrpc 2023-11-05T08:43:31.106 INFO:teuthology.orchestra.run.smithi156.stdout:rpcbind 651 rpc 6u IPv6 20879 0t0 TCP *:sunrpc (LISTEN) 2023-11-05T08:43:31.106 INFO:teuthology.orchestra.run.smithi156.stdout:rpcbind 651 rpc 7u IPv6 18560 0t0 UDP *:sunrpc 2023-11-05T08:43:31.107 INFO:teuthology.orchestra.run.smithi156.stdout:rpcbind 651 rpc 8rW REG 0,24 0 1071 /run/rpcbind/rpcbind.lock 2023-11-05T08:43:31.107 INFO:teuthology.orchestra.run.smithi156.stdout:rpciod 659 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.107 INFO:teuthology.orchestra.run.smithi156.stdout:rpciod 659 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.107 INFO:teuthology.orchestra.run.smithi156.stdout:rpciod 659 root txt unknown /proc/659/exe 2023-11-05T08:43:31.107 INFO:teuthology.orchestra.run.smithi156.stdout:xprtiod 660 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.108 INFO:teuthology.orchestra.run.smithi156.stdout:xprtiod 660 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.108 INFO:teuthology.orchestra.run.smithi156.stdout:xprtiod 660 root txt unknown /proc/660/exe 2023-11-05T08:43:31.108 INFO:teuthology.orchestra.run.smithi156.stdout:auditd 663 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.108 INFO:teuthology.orchestra.run.smithi156.stdout:auditd 663 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.108 INFO:teuthology.orchestra.run.smithi156.stdout:auditd 663 root txt REG 8,1 144576 11776 /usr/sbin/auditd 2023-11-05T08:43:31.108 INFO:teuthology.orchestra.run.smithi156.stdout:auditd 663 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-05T08:43:31.109 INFO:teuthology.orchestra.run.smithi156.stdout:auditd 663 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:31.109 INFO:teuthology.orchestra.run.smithi156.stdout:auditd 663 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:31.109 INFO:teuthology.orchestra.run.smithi156.stdout:auditd 663 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:31.109 INFO:teuthology.orchestra.run.smithi156.stdout:auditd 663 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:31.109 INFO:teuthology.orchestra.run.smithi156.stdout:auditd 663 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-05T08:43:31.110 INFO:teuthology.orchestra.run.smithi156.stdout:auditd 663 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-05T08:43:31.110 INFO:teuthology.orchestra.run.smithi156.stdout:auditd 663 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-05T08:43:31.110 INFO:teuthology.orchestra.run.smithi156.stdout:auditd 663 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-05T08:43:31.110 INFO:teuthology.orchestra.run.smithi156.stdout:auditd 663 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-05T08:43:31.110 INFO:teuthology.orchestra.run.smithi156.stdout:auditd 663 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-05T08:43:31.110 INFO:teuthology.orchestra.run.smithi156.stdout:auditd 663 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-05T08:43:31.111 INFO:teuthology.orchestra.run.smithi156.stdout:auditd 663 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-05T08:43:31.111 INFO:teuthology.orchestra.run.smithi156.stdout:auditd 663 root mem REG 8,1 143568 9730 /usr/lib64/libauparse.so.0.0.0 2023-11-05T08:43:31.111 INFO:teuthology.orchestra.run.smithi156.stdout:auditd 663 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-05T08:43:31.111 INFO:teuthology.orchestra.run.smithi156.stdout:auditd 663 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:31.111 INFO:teuthology.orchestra.run.smithi156.stdout:auditd 663 root 0u CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.112 INFO:teuthology.orchestra.run.smithi156.stdout:auditd 663 root 1u CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.112 INFO:teuthology.orchestra.run.smithi156.stdout:auditd 663 root 2u CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.112 INFO:teuthology.orchestra.run.smithi156.stdout:auditd 663 root 3u netlink 0t0 18665 AUDIT 2023-11-05T08:43:31.112 INFO:teuthology.orchestra.run.smithi156.stdout:auditd 663 root 4w REG 8,1 5694173 58043 /var/log/audit/audit.log 2023-11-05T08:43:31.112 INFO:teuthology.orchestra.run.smithi156.stdout:auditd 663 root 6u unix 0xffff8da318330000 0t0 19948 type=DGRAM (CONNECTED) 2023-11-05T08:43:31.112 INFO:teuthology.orchestra.run.smithi156.stdout:auditd 663 root 7u unix 0xffff8da31832b740 0t0 19947 type=STREAM (CONNECTED) 2023-11-05T08:43:31.113 INFO:teuthology.orchestra.run.smithi156.stdout:auditd 663 root 8u unix 0xffff8da31832aa80 0t0 19949 type=STREAM (CONNECTED) 2023-11-05T08:43:31.113 INFO:teuthology.orchestra.run.smithi156.stdout:auditd 663 root 9u unix 0xffff8da318328000 0t0 19950 type=STREAM (CONNECTED) 2023-11-05T08:43:31.113 INFO:teuthology.orchestra.run.smithi156.stdout:auditd 663 root 10u a_inode 0,14 0 1084 [eventfd:0] 2023-11-05T08:43:31.113 INFO:teuthology.orchestra.run.smithi156.stdout:auditd 663 664 auditd root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.113 INFO:teuthology.orchestra.run.smithi156.stdout:auditd 663 664 auditd root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.113 INFO:teuthology.orchestra.run.smithi156.stdout:auditd 663 664 auditd root txt REG 8,1 144576 11776 /usr/sbin/auditd 2023-11-05T08:43:31.114 INFO:teuthology.orchestra.run.smithi156.stdout:auditd 663 664 auditd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-05T08:43:31.114 INFO:teuthology.orchestra.run.smithi156.stdout:auditd 663 664 auditd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:31.114 INFO:teuthology.orchestra.run.smithi156.stdout:auditd 663 664 auditd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:31.114 INFO:teuthology.orchestra.run.smithi156.stdout:auditd 663 664 auditd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:31.114 INFO:teuthology.orchestra.run.smithi156.stdout:auditd 663 664 auditd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:31.115 INFO:teuthology.orchestra.run.smithi156.stdout:auditd 663 664 auditd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-05T08:43:31.115 INFO:teuthology.orchestra.run.smithi156.stdout:auditd 663 664 auditd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-05T08:43:31.115 INFO:teuthology.orchestra.run.smithi156.stdout:auditd 663 664 auditd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-05T08:43:31.115 INFO:teuthology.orchestra.run.smithi156.stdout:auditd 663 664 auditd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-05T08:43:31.115 INFO:teuthology.orchestra.run.smithi156.stdout:auditd 663 664 auditd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-05T08:43:31.115 INFO:teuthology.orchestra.run.smithi156.stdout:auditd 663 664 auditd root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-05T08:43:31.116 INFO:teuthology.orchestra.run.smithi156.stdout:auditd 663 664 auditd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-05T08:43:31.116 INFO:teuthology.orchestra.run.smithi156.stdout:auditd 663 664 auditd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-05T08:43:31.116 INFO:teuthology.orchestra.run.smithi156.stdout:auditd 663 664 auditd root mem REG 8,1 143568 9730 /usr/lib64/libauparse.so.0.0.0 2023-11-05T08:43:31.116 INFO:teuthology.orchestra.run.smithi156.stdout:auditd 663 664 auditd root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-05T08:43:31.116 INFO:teuthology.orchestra.run.smithi156.stdout:auditd 663 664 auditd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:31.117 INFO:teuthology.orchestra.run.smithi156.stdout:auditd 663 664 auditd root 0u CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.117 INFO:teuthology.orchestra.run.smithi156.stdout:auditd 663 664 auditd root 1u CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.117 INFO:teuthology.orchestra.run.smithi156.stdout:auditd 663 664 auditd root 2u CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.117 INFO:teuthology.orchestra.run.smithi156.stdout:auditd 663 664 auditd root 3u netlink 0t0 18665 AUDIT 2023-11-05T08:43:31.117 INFO:teuthology.orchestra.run.smithi156.stdout:auditd 663 664 auditd root 4w REG 8,1 5694173 58043 /var/log/audit/audit.log 2023-11-05T08:43:31.118 INFO:teuthology.orchestra.run.smithi156.stdout:auditd 663 664 auditd root 6u unix 0xffff8da318330000 0t0 19948 type=DGRAM (CONNECTED) 2023-11-05T08:43:31.118 INFO:teuthology.orchestra.run.smithi156.stdout:auditd 663 664 auditd root 7u unix 0xffff8da31832b740 0t0 19947 type=STREAM (CONNECTED) 2023-11-05T08:43:31.118 INFO:teuthology.orchestra.run.smithi156.stdout:auditd 663 664 auditd root 8u unix 0xffff8da31832aa80 0t0 19949 type=STREAM (CONNECTED) 2023-11-05T08:43:31.118 INFO:teuthology.orchestra.run.smithi156.stdout:auditd 663 664 auditd root 9u unix 0xffff8da318328000 0t0 19950 type=STREAM (CONNECTED) 2023-11-05T08:43:31.118 INFO:teuthology.orchestra.run.smithi156.stdout:auditd 663 664 auditd root 10u a_inode 0,14 0 1084 [eventfd:0] 2023-11-05T08:43:31.118 INFO:teuthology.orchestra.run.smithi156.stdout:auditd 663 666 auditd root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.119 INFO:teuthology.orchestra.run.smithi156.stdout:auditd 663 666 auditd root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.119 INFO:teuthology.orchestra.run.smithi156.stdout:auditd 663 666 auditd root txt REG 8,1 144576 11776 /usr/sbin/auditd 2023-11-05T08:43:31.119 INFO:teuthology.orchestra.run.smithi156.stdout:auditd 663 666 auditd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-05T08:43:31.119 INFO:teuthology.orchestra.run.smithi156.stdout:auditd 663 666 auditd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:31.119 INFO:teuthology.orchestra.run.smithi156.stdout:auditd 663 666 auditd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:31.120 INFO:teuthology.orchestra.run.smithi156.stdout:auditd 663 666 auditd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:31.120 INFO:teuthology.orchestra.run.smithi156.stdout:auditd 663 666 auditd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:31.120 INFO:teuthology.orchestra.run.smithi156.stdout:auditd 663 666 auditd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-05T08:43:31.120 INFO:teuthology.orchestra.run.smithi156.stdout:auditd 663 666 auditd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-05T08:43:31.120 INFO:teuthology.orchestra.run.smithi156.stdout:auditd 663 666 auditd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-05T08:43:31.121 INFO:teuthology.orchestra.run.smithi156.stdout:auditd 663 666 auditd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-05T08:43:31.121 INFO:teuthology.orchestra.run.smithi156.stdout:auditd 663 666 auditd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-05T08:43:31.121 INFO:teuthology.orchestra.run.smithi156.stdout:auditd 663 666 auditd root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-05T08:43:31.121 INFO:teuthology.orchestra.run.smithi156.stdout:auditd 663 666 auditd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-05T08:43:31.121 INFO:teuthology.orchestra.run.smithi156.stdout:auditd 663 666 auditd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-05T08:43:31.121 INFO:teuthology.orchestra.run.smithi156.stdout:auditd 663 666 auditd root mem REG 8,1 143568 9730 /usr/lib64/libauparse.so.0.0.0 2023-11-05T08:43:31.122 INFO:teuthology.orchestra.run.smithi156.stdout:auditd 663 666 auditd root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-05T08:43:31.122 INFO:teuthology.orchestra.run.smithi156.stdout:auditd 663 666 auditd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:31.122 INFO:teuthology.orchestra.run.smithi156.stdout:auditd 663 666 auditd root 0u CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.122 INFO:teuthology.orchestra.run.smithi156.stdout:auditd 663 666 auditd root 1u CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.122 INFO:teuthology.orchestra.run.smithi156.stdout:auditd 663 666 auditd root 2u CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.123 INFO:teuthology.orchestra.run.smithi156.stdout:auditd 663 666 auditd root 3u netlink 0t0 18665 AUDIT 2023-11-05T08:43:31.123 INFO:teuthology.orchestra.run.smithi156.stdout:auditd 663 666 auditd root 4w REG 8,1 5694173 58043 /var/log/audit/audit.log 2023-11-05T08:43:31.123 INFO:teuthology.orchestra.run.smithi156.stdout:auditd 663 666 auditd root 6u unix 0xffff8da318330000 0t0 19948 type=DGRAM (CONNECTED) 2023-11-05T08:43:31.123 INFO:teuthology.orchestra.run.smithi156.stdout:auditd 663 666 auditd root 7u unix 0xffff8da31832b740 0t0 19947 type=STREAM (CONNECTED) 2023-11-05T08:43:31.123 INFO:teuthology.orchestra.run.smithi156.stdout:auditd 663 666 auditd root 8u unix 0xffff8da31832aa80 0t0 19949 type=STREAM (CONNECTED) 2023-11-05T08:43:31.124 INFO:teuthology.orchestra.run.smithi156.stdout:auditd 663 666 auditd root 9u unix 0xffff8da318328000 0t0 19950 type=STREAM (CONNECTED) 2023-11-05T08:43:31.124 INFO:teuthology.orchestra.run.smithi156.stdout:auditd 663 666 auditd root 10u a_inode 0,14 0 1084 [eventfd:0] 2023-11-05T08:43:31.124 INFO:teuthology.orchestra.run.smithi156.stdout:sedispatc 665 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.124 INFO:teuthology.orchestra.run.smithi156.stdout:sedispatc 665 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.124 INFO:teuthology.orchestra.run.smithi156.stdout:sedispatc 665 root txt REG 8,1 19624 11914 /usr/sbin/sedispatch 2023-11-05T08:43:31.124 INFO:teuthology.orchestra.run.smithi156.stdout:sedispatc 665 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-05T08:43:31.125 INFO:teuthology.orchestra.run.smithi156.stdout:sedispatc 665 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:31.125 INFO:teuthology.orchestra.run.smithi156.stdout:sedispatc 665 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-05T08:43:31.125 INFO:teuthology.orchestra.run.smithi156.stdout:sedispatc 665 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-05T08:43:31.125 INFO:teuthology.orchestra.run.smithi156.stdout:sedispatc 665 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-05T08:43:31.125 INFO:teuthology.orchestra.run.smithi156.stdout:sedispatc 665 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-05T08:43:31.126 INFO:teuthology.orchestra.run.smithi156.stdout:sedispatc 665 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:31.126 INFO:teuthology.orchestra.run.smithi156.stdout:sedispatc 665 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-05T08:43:31.126 INFO:teuthology.orchestra.run.smithi156.stdout:sedispatc 665 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:31.126 INFO:teuthology.orchestra.run.smithi156.stdout:sedispatc 665 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:31.126 INFO:teuthology.orchestra.run.smithi156.stdout:sedispatc 665 root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-05T08:43:31.126 INFO:teuthology.orchestra.run.smithi156.stdout:sedispatc 665 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:31.127 INFO:teuthology.orchestra.run.smithi156.stdout:sedispatc 665 root mem REG 8,1 143568 9730 /usr/lib64/libauparse.so.0.0.0 2023-11-05T08:43:31.127 INFO:teuthology.orchestra.run.smithi156.stdout:sedispatc 665 root mem REG 8,1 343752 10128 /usr/lib64/libdbus-1.so.3.19.13 2023-11-05T08:43:31.127 INFO:teuthology.orchestra.run.smithi156.stdout:sedispatc 665 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-05T08:43:31.127 INFO:teuthology.orchestra.run.smithi156.stdout:sedispatc 665 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:31.127 INFO:teuthology.orchestra.run.smithi156.stdout:sedispatc 665 root 0u unix 0xffff8da31832d940 0t0 19946 type=STREAM (CONNECTED) 2023-11-05T08:43:31.128 INFO:teuthology.orchestra.run.smithi156.stdout:sedispatc 665 root 1u CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.128 INFO:teuthology.orchestra.run.smithi156.stdout:sedispatc 665 root 2u CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.128 INFO:teuthology.orchestra.run.smithi156.stdout:sedispatc 665 root 3u unix 0xffff8da31886aa80 0t0 17171 type=STREAM (CONNECTED) 2023-11-05T08:43:31.128 INFO:teuthology.orchestra.run.smithi156.stdout:dbus-brok 702 dbus cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.128 INFO:teuthology.orchestra.run.smithi156.stdout:dbus-brok 702 dbus rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.129 INFO:teuthology.orchestra.run.smithi156.stdout:dbus-brok 702 dbus txt REG 8,1 131896 11213 /usr/bin/dbus-broker-launch 2023-11-05T08:43:31.129 INFO:teuthology.orchestra.run.smithi156.stdout:dbus-brok 702 dbus DEL REG 0,1 3072 /memfd:dbus-broker-log 2023-11-05T08:43:31.129 INFO:teuthology.orchestra.run.smithi156.stdout:dbus-brok 702 dbus mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:31.129 INFO:teuthology.orchestra.run.smithi156.stdout:dbus-brok 702 dbus mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-05T08:43:31.129 INFO:teuthology.orchestra.run.smithi156.stdout:dbus-brok 702 dbus mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-05T08:43:31.129 INFO:teuthology.orchestra.run.smithi156.stdout:dbus-brok 702 dbus mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:31.130 INFO:teuthology.orchestra.run.smithi156.stdout:dbus-brok 702 dbus mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-05T08:43:31.130 INFO:teuthology.orchestra.run.smithi156.stdout:dbus-brok 702 dbus mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-05T08:43:31.130 INFO:teuthology.orchestra.run.smithi156.stdout:dbus-brok 702 dbus mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-05T08:43:31.130 INFO:teuthology.orchestra.run.smithi156.stdout:dbus-brok 702 dbus mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:31.130 INFO:teuthology.orchestra.run.smithi156.stdout:dbus-brok 702 dbus mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:31.131 INFO:teuthology.orchestra.run.smithi156.stdout:dbus-brok 702 dbus mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:31.131 INFO:teuthology.orchestra.run.smithi156.stdout:dbus-brok 702 dbus mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:31.131 INFO:teuthology.orchestra.run.smithi156.stdout:dbus-brok 702 dbus mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-05T08:43:31.131 INFO:teuthology.orchestra.run.smithi156.stdout:dbus-brok 702 dbus mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-05T08:43:31.131 INFO:teuthology.orchestra.run.smithi156.stdout:dbus-brok 702 dbus mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-05T08:43:31.132 INFO:teuthology.orchestra.run.smithi156.stdout:dbus-brok 702 dbus mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-05T08:43:31.132 INFO:teuthology.orchestra.run.smithi156.stdout:dbus-brok 702 dbus mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:31.132 INFO:teuthology.orchestra.run.smithi156.stdout:dbus-brok 702 dbus 0r CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.132 INFO:teuthology.orchestra.run.smithi156.stdout:dbus-brok 702 dbus 1u unix 0xffff8da307d8b740 0t0 22925 type=STREAM (CONNECTED) 2023-11-05T08:43:31.132 INFO:teuthology.orchestra.run.smithi156.stdout:dbus-brok 702 dbus 2u unix 0xffff8da307d8b740 0t0 22925 type=STREAM (CONNECTED) 2023-11-05T08:43:31.133 INFO:teuthology.orchestra.run.smithi156.stdout:dbus-brok 702 dbus 3u unix 0xffff8da318830880 0t0 17688 /run/dbus/system_bus_socket type=STREAM (LISTEN) 2023-11-05T08:43:31.133 INFO:teuthology.orchestra.run.smithi156.stdout:dbus-brok 702 dbus 4u unix 0xffff8da318800880 0t0 22935 type=DGRAM (CONNECTED) 2023-11-05T08:43:31.133 INFO:teuthology.orchestra.run.smithi156.stdout:dbus-brok 702 dbus 5u a_inode 0,14 0 1084 [eventpoll:6,7,8,9,10,11] 2023-11-05T08:43:31.133 INFO:teuthology.orchestra.run.smithi156.stdout:dbus-brok 702 dbus 6u a_inode 0,14 0 1084 [signalfd] 2023-11-05T08:43:31.133 INFO:teuthology.orchestra.run.smithi156.stdout:dbus-brok 702 dbus 7r a_inode 0,14 0 1084 inotify 2023-11-05T08:43:31.133 INFO:teuthology.orchestra.run.smithi156.stdout:dbus-brok 702 dbus 8u unix 0xffff8da307d8c400 0t0 22937 type=STREAM (CONNECTED) 2023-11-05T08:43:31.134 INFO:teuthology.orchestra.run.smithi156.stdout:dbus-brok 702 dbus 9u unix 0xffff8da318216600 0t0 21069 type=STREAM (CONNECTED) 2023-11-05T08:43:31.134 INFO:teuthology.orchestra.run.smithi156.stdout:dbus-brok 702 dbus 10u a_inode 0,14 0 1084 [pidfd:703] 2023-11-05T08:43:31.134 INFO:teuthology.orchestra.run.smithi156.stdout:dbus-brok 702 dbus 11u a_inode 0,14 0 1084 [timerfd] 2023-11-05T08:43:31.134 INFO:teuthology.orchestra.run.smithi156.stdout:dbus-brok 702 dbus 12u REG 0,1 2097152 3072 /memfd:dbus-broker-log (deleted) 2023-11-05T08:43:31.134 INFO:teuthology.orchestra.run.smithi156.stdout:dbus-brok 703 dbus cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.135 INFO:teuthology.orchestra.run.smithi156.stdout:dbus-brok 703 dbus rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.135 INFO:teuthology.orchestra.run.smithi156.stdout:dbus-brok 703 dbus txt REG 8,1 236336 11212 /usr/bin/dbus-broker 2023-11-05T08:43:31.135 INFO:teuthology.orchestra.run.smithi156.stdout:dbus-brok 703 dbus mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:31.135 INFO:teuthology.orchestra.run.smithi156.stdout:dbus-brok 703 dbus mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:31.135 INFO:teuthology.orchestra.run.smithi156.stdout:dbus-brok 703 dbus mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:31.136 INFO:teuthology.orchestra.run.smithi156.stdout:dbus-brok 703 dbus mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:31.136 INFO:teuthology.orchestra.run.smithi156.stdout:dbus-brok 703 dbus mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-05T08:43:31.136 INFO:teuthology.orchestra.run.smithi156.stdout:dbus-brok 703 dbus mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-05T08:43:31.136 INFO:teuthology.orchestra.run.smithi156.stdout:dbus-brok 703 dbus mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:31.136 INFO:teuthology.orchestra.run.smithi156.stdout:dbus-brok 703 dbus mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:31.137 INFO:teuthology.orchestra.run.smithi156.stdout:dbus-brok 703 dbus mem REG 0,19 0 19 /sys/fs/selinux/status 2023-11-05T08:43:31.137 INFO:teuthology.orchestra.run.smithi156.stdout:dbus-brok 703 dbus 0r CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.137 INFO:teuthology.orchestra.run.smithi156.stdout:dbus-brok 703 dbus 1u unix 0xffff8da307d8b740 0t0 22925 type=STREAM (CONNECTED) 2023-11-05T08:43:31.137 INFO:teuthology.orchestra.run.smithi156.stdout:dbus-brok 703 dbus 2u unix 0xffff8da307d8b740 0t0 22925 type=STREAM (CONNECTED) 2023-11-05T08:43:31.137 INFO:teuthology.orchestra.run.smithi156.stdout:dbus-brok 703 dbus 3u sock 0,8 0t0 19966 protocol: NETLINK 2023-11-05T08:43:31.138 INFO:teuthology.orchestra.run.smithi156.stdout:dbus-brok 703 dbus 4u unix 0xffff8da318800880 0t0 22935 type=DGRAM (CONNECTED) 2023-11-05T08:43:31.138 INFO:teuthology.orchestra.run.smithi156.stdout:dbus-brok 703 dbus 5u a_inode 0,14 0 1084 [eventpoll:6,7,8,9,10,11,12,13,15,17,18,19] 2023-11-05T08:43:31.138 INFO:teuthology.orchestra.run.smithi156.stdout:dbus-brok 703 dbus 6u a_inode 0,14 0 1084 [signalfd] 2023-11-05T08:43:31.138 INFO:teuthology.orchestra.run.smithi156.stdout:dbus-brok 703 dbus 7u unix 0xffff8da318830880 0t0 17688 /run/dbus/system_bus_socket type=STREAM (LISTEN) 2023-11-05T08:43:31.138 INFO:teuthology.orchestra.run.smithi156.stdout:dbus-brok 703 dbus 8u unix 0xffff8da318837700 0t0 16531 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2023-11-05T08:43:31.138 INFO:teuthology.orchestra.run.smithi156.stdout:dbus-brok 703 dbus 9u unix 0xffff8da307d8bb80 0t0 22938 type=STREAM (CONNECTED) 2023-11-05T08:43:31.139 INFO:teuthology.orchestra.run.smithi156.stdout:dbus-brok 703 dbus 10u unix 0xffff8da318212ec0 0t0 16533 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2023-11-05T08:43:31.139 INFO:teuthology.orchestra.run.smithi156.stdout:dbus-brok 703 dbus 11u unix 0xffff8da31891a200 0t0 16535 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2023-11-05T08:43:31.139 INFO:teuthology.orchestra.run.smithi156.stdout:dbus-brok 703 dbus 12u unix 0xffff8da31832c840 0t0 17709 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2023-11-05T08:43:31.139 INFO:teuthology.orchestra.run.smithi156.stdout:dbus-brok 703 dbus 13u unix 0xffff8da318329dc0 0t0 17711 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2023-11-05T08:43:31.139 INFO:teuthology.orchestra.run.smithi156.stdout:dbus-brok 703 dbus 15u unix 0xffff8da31886c840 0t0 16044 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2023-11-05T08:43:31.140 INFO:teuthology.orchestra.run.smithi156.stdout:dbus-brok 703 dbus 17u unix 0xffff8da318868000 0t0 23357 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2023-11-05T08:43:31.140 INFO:teuthology.orchestra.run.smithi156.stdout:dbus-brok 703 dbus 18u unix 0xffff8da31832bfc0 0t0 23029 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2023-11-05T08:43:31.140 INFO:teuthology.orchestra.run.smithi156.stdout:dbus-brok 703 dbus 19u unix 0xffff8da31886d940 0t0 23073 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2023-11-05T08:43:31.140 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.140 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.140 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 root txt REG 8,1 3644720 11633 /usr/sbin/NetworkManager 2023-11-05T08:43:31.141 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-05T08:43:31.141 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 root mem REG 8,1 317552 52828 /usr/lib64/NetworkManager/1.44.0-2.el9/libnm-settings-plugin-ifcfg-rh.so 2023-11-05T08:43:31.141 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 root mem REG 8,1 343752 10128 /usr/lib64/libdbus-1.so.3.19.13 2023-11-05T08:43:31.141 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 root mem REG 8,1 62456 9782 /usr/lib64/libjansson.so.4.14.0 2023-11-05T08:43:31.141 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 root mem REG 8,1 31792 10954 /usr/lib64/libteamdctl.so.0.1.5 2023-11-05T08:43:31.142 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 root mem REG 8,1 57016 52811 /usr/lib64/NetworkManager/1.44.0-2.el9/libnm-device-plugin-team.so 2023-11-05T08:43:31.142 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-05T08:43:31.142 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-05T08:43:31.142 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-05T08:43:31.142 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-05T08:43:31.143 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-05T08:43:31.143 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-05T08:43:31.143 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-05T08:43:31.143 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-05T08:43:31.143 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-05T08:43:31.143 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-05T08:43:31.144 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-05T08:43:31.144 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-05T08:43:31.144 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-05T08:43:31.144 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-05T08:43:31.144 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 root mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-05T08:43:31.145 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-05T08:43:31.145 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-05T08:43:31.145 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:31.145 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-05T08:43:31.145 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-05T08:43:31.145 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-05T08:43:31.146 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-05T08:43:31.146 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-05T08:43:31.146 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-05T08:43:31.146 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-05T08:43:31.146 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-05T08:43:31.147 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-05T08:43:31.147 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-05T08:43:31.147 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-05T08:43:31.147 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-05T08:43:31.147 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:31.148 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-05T08:43:31.148 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-05T08:43:31.148 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-05T08:43:31.148 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 root mem REG 8,1 626152 9989 /usr/lib64/libhogweed.so.6.5 2023-11-05T08:43:31.148 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-05T08:43:31.148 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-05T08:43:31.149 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-05T08:43:31.149 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:31.149 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-05T08:43:31.149 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 root mem REG 8,1 94112 9901 /usr/lib64/libtasn1.so.6.6.0 2023-11-05T08:43:31.149 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-05T08:43:31.150 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:31.150 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 root mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-05T08:43:31.150 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 root mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-11-05T08:43:31.150 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 root mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-11-05T08:43:31.150 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-05T08:43:31.150 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-05T08:43:31.151 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:31.151 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-05T08:43:31.151 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-05T08:43:31.151 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 root mem REG 8,1 2291576 9994 /usr/lib64/libgnutls.so.30.33.1 2023-11-05T08:43:31.151 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-05T08:43:31.152 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:31.152 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 root mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-11-05T08:43:31.152 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 root mem REG 8,1 32408 11334 /usr/lib64/libndp.so.0.2.0 2023-11-05T08:43:31.152 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-05T08:43:31.152 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-05T08:43:31.152 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-05T08:43:31.153 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-05T08:43:31.153 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-05T08:43:31.153 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-05T08:43:31.153 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:31.153 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-05T08:43:31.154 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.154 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 root 1u unix 0xffff8da318372640 0t0 15999 type=STREAM (CONNECTED) 2023-11-05T08:43:31.154 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 root 2u unix 0xffff8da318372640 0t0 15999 type=STREAM (CONNECTED) 2023-11-05T08:43:31.154 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 root 3u a_inode 0,14 0 1084 [eventfd:3] 2023-11-05T08:43:31.154 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 root 4u a_inode 0,14 0 1084 [eventfd:4] 2023-11-05T08:43:31.155 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 root 5u unix 0xffff8da3183350c0 0t0 20015 type=DGRAM (UNCONNECTED) 2023-11-05T08:43:31.155 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 root 6u unix 0xffff8da31832a200 0t0 20016 type=STREAM (CONNECTED) 2023-11-05T08:43:31.155 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 root 7u a_inode 0,14 0 1084 [eventfd:5] 2023-11-05T08:43:31.155 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 root 8r REG 0,4 0 4026531840 net 2023-11-05T08:43:31.155 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 root 9r REG 0,4 0 4026532495 mnt 2023-11-05T08:43:31.155 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 root 10u netlink 0t0 20020 KOBJECT_UEVENT 2023-11-05T08:43:31.156 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 root 11u netlink 0t0 20021 GENERIC 2023-11-05T08:43:31.156 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 root 12u netlink 0t0 20022 GENERIC 2023-11-05T08:43:31.156 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 root 13u netlink 0t0 20023 ROUTE 2023-11-05T08:43:31.156 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 root 14r a_inode 0,14 0 1084 inotify 2023-11-05T08:43:31.156 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 root 15r a_inode 0,14 0 1084 inotify 2023-11-05T08:43:31.157 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 root 16u netlink 0t0 17715 KOBJECT_UEVENT 2023-11-05T08:43:31.157 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 root 17u a_inode 0,14 0 1084 [eventpoll] 2023-11-05T08:43:31.157 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 root 18u unix 0xffff8da318868880 0t0 16543 type=STREAM (CONNECTED) 2023-11-05T08:43:31.157 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 root 19u a_inode 0,14 0 1084 [eventpoll:21,26] 2023-11-05T08:43:31.157 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 root 20w FIFO 0,24 0t0 1159 /run/systemd/inhibit/1.ref 2023-11-05T08:43:31.157 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 root 21u a_inode 0,14 0 1084 [timerfd] 2023-11-05T08:43:31.158 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 root 23u a_inode 0,14 0 1084 [eventpoll:24,25] 2023-11-05T08:43:31.158 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 root 24u a_inode 0,14 0 1084 [timerfd] 2023-11-05T08:43:31.158 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 root 25u pack 21108 0t0 ARP type=SOCK_DGRAM 2023-11-05T08:43:31.158 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 root 26u IPv4 21109 0t0 UDP smithi156.front.sepia.ceph.com:bootpc->store01.front.sepia.ceph.com:bootps 2023-11-05T08:43:31.158 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 722 gmain root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.159 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 722 gmain root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.159 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 722 gmain root txt REG 8,1 3644720 11633 /usr/sbin/NetworkManager 2023-11-05T08:43:31.159 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 722 gmain root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-05T08:43:31.159 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 722 gmain root mem REG 8,1 317552 52828 /usr/lib64/NetworkManager/1.44.0-2.el9/libnm-settings-plugin-ifcfg-rh.so 2023-11-05T08:43:31.159 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 722 gmain root mem REG 8,1 343752 10128 /usr/lib64/libdbus-1.so.3.19.13 2023-11-05T08:43:31.160 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 722 gmain root mem REG 8,1 62456 9782 /usr/lib64/libjansson.so.4.14.0 2023-11-05T08:43:31.160 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 722 gmain root mem REG 8,1 31792 10954 /usr/lib64/libteamdctl.so.0.1.5 2023-11-05T08:43:31.160 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 722 gmain root mem REG 8,1 57016 52811 /usr/lib64/NetworkManager/1.44.0-2.el9/libnm-device-plugin-team.so 2023-11-05T08:43:31.160 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 722 gmain root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-05T08:43:31.160 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 722 gmain root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-05T08:43:31.161 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 722 gmain root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-05T08:43:31.161 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 722 gmain root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-05T08:43:31.161 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 722 gmain root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-05T08:43:31.161 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 722 gmain root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-05T08:43:31.161 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 722 gmain root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-05T08:43:31.162 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 722 gmain root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-05T08:43:31.162 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 722 gmain root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-05T08:43:31.162 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 722 gmain root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-05T08:43:31.162 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 722 gmain root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-05T08:43:31.162 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 722 gmain root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-05T08:43:31.163 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 722 gmain root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-05T08:43:31.163 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 722 gmain root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-05T08:43:31.163 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 722 gmain root mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-05T08:43:31.163 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 722 gmain root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-05T08:43:31.163 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 722 gmain root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-05T08:43:31.164 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 722 gmain root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:31.164 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 722 gmain root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-05T08:43:31.164 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 722 gmain root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-05T08:43:31.164 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 722 gmain root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-05T08:43:31.164 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 722 gmain root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-05T08:43:31.164 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 722 gmain root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-05T08:43:31.165 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 722 gmain root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-05T08:43:31.165 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 722 gmain root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-05T08:43:31.165 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 722 gmain root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-05T08:43:31.165 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 722 gmain root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-05T08:43:31.165 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 722 gmain root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-05T08:43:31.166 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 722 gmain root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-05T08:43:31.166 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 722 gmain root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-05T08:43:31.166 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 722 gmain root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:31.166 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 722 gmain root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-05T08:43:31.166 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 722 gmain root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-05T08:43:31.167 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 722 gmain root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-05T08:43:31.167 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 722 gmain root mem REG 8,1 626152 9989 /usr/lib64/libhogweed.so.6.5 2023-11-05T08:43:31.167 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 722 gmain root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-05T08:43:31.167 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 722 gmain root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-05T08:43:31.167 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 722 gmain root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-05T08:43:31.167 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 722 gmain root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:31.168 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 722 gmain root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-05T08:43:31.168 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 722 gmain root mem REG 8,1 94112 9901 /usr/lib64/libtasn1.so.6.6.0 2023-11-05T08:43:31.168 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 722 gmain root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-05T08:43:31.168 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 722 gmain root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:31.168 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 722 gmain root mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-05T08:43:31.169 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 722 gmain root mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-11-05T08:43:31.169 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 722 gmain root mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-11-05T08:43:31.169 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 722 gmain root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-05T08:43:31.169 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 722 gmain root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-05T08:43:31.169 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 722 gmain root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:31.169 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 722 gmain root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-05T08:43:31.170 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 722 gmain root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-05T08:43:31.170 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 722 gmain root mem REG 8,1 2291576 9994 /usr/lib64/libgnutls.so.30.33.1 2023-11-05T08:43:31.170 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 722 gmain root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-05T08:43:31.170 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 722 gmain root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:31.170 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 722 gmain root mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-11-05T08:43:31.171 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 722 gmain root mem REG 8,1 32408 11334 /usr/lib64/libndp.so.0.2.0 2023-11-05T08:43:31.171 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 722 gmain root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-05T08:43:31.171 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 722 gmain root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-05T08:43:31.171 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 722 gmain root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-05T08:43:31.171 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 722 gmain root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-05T08:43:31.172 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 722 gmain root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-05T08:43:31.172 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 722 gmain root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-05T08:43:31.172 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 722 gmain root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:31.172 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 722 gmain root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-05T08:43:31.172 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 722 gmain root 0r CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.172 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 722 gmain root 1u unix 0xffff8da318372640 0t0 15999 type=STREAM (CONNECTED) 2023-11-05T08:43:31.173 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 722 gmain root 2u unix 0xffff8da318372640 0t0 15999 type=STREAM (CONNECTED) 2023-11-05T08:43:31.173 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 722 gmain root 3u a_inode 0,14 0 1084 [eventfd:3] 2023-11-05T08:43:31.173 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 722 gmain root 4u a_inode 0,14 0 1084 [eventfd:4] 2023-11-05T08:43:31.173 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 722 gmain root 5u unix 0xffff8da3183350c0 0t0 20015 type=DGRAM (UNCONNECTED) 2023-11-05T08:43:31.173 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 722 gmain root 6u unix 0xffff8da31832a200 0t0 20016 type=STREAM (CONNECTED) 2023-11-05T08:43:31.174 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 722 gmain root 7u a_inode 0,14 0 1084 [eventfd:5] 2023-11-05T08:43:31.174 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 722 gmain root 8r REG 0,4 0 4026531840 net 2023-11-05T08:43:31.174 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 722 gmain root 9r REG 0,4 0 4026532495 mnt 2023-11-05T08:43:31.174 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 722 gmain root 10u netlink 0t0 20020 KOBJECT_UEVENT 2023-11-05T08:43:31.174 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 722 gmain root 11u netlink 0t0 20021 GENERIC 2023-11-05T08:43:31.175 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 722 gmain root 12u netlink 0t0 20022 GENERIC 2023-11-05T08:43:31.175 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 722 gmain root 13u netlink 0t0 20023 ROUTE 2023-11-05T08:43:31.175 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 722 gmain root 14r a_inode 0,14 0 1084 inotify 2023-11-05T08:43:31.175 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 722 gmain root 15r a_inode 0,14 0 1084 inotify 2023-11-05T08:43:31.175 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 722 gmain root 16u netlink 0t0 17715 KOBJECT_UEVENT 2023-11-05T08:43:31.175 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 722 gmain root 17u a_inode 0,14 0 1084 [eventpoll] 2023-11-05T08:43:31.176 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 722 gmain root 18u unix 0xffff8da318868880 0t0 16543 type=STREAM (CONNECTED) 2023-11-05T08:43:31.176 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 722 gmain root 19u a_inode 0,14 0 1084 [eventpoll:21,26] 2023-11-05T08:43:31.176 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 722 gmain root 20w FIFO 0,24 0t0 1159 /run/systemd/inhibit/1.ref 2023-11-05T08:43:31.176 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 722 gmain root 21u a_inode 0,14 0 1084 [timerfd] 2023-11-05T08:43:31.176 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 722 gmain root 23u a_inode 0,14 0 1084 [eventpoll:24,25] 2023-11-05T08:43:31.177 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 722 gmain root 24u a_inode 0,14 0 1084 [timerfd] 2023-11-05T08:43:31.177 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 722 gmain root 25u pack 21108 0t0 ARP type=SOCK_DGRAM 2023-11-05T08:43:31.177 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 722 gmain root 26u IPv4 21109 0t0 UDP smithi156.front.sepia.ceph.com:bootpc->store01.front.sepia.ceph.com:bootps 2023-11-05T08:43:31.177 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 723 gdbus root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.177 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 723 gdbus root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.177 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 723 gdbus root txt REG 8,1 3644720 11633 /usr/sbin/NetworkManager 2023-11-05T08:43:31.178 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 723 gdbus root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-05T08:43:31.178 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 723 gdbus root mem REG 8,1 317552 52828 /usr/lib64/NetworkManager/1.44.0-2.el9/libnm-settings-plugin-ifcfg-rh.so 2023-11-05T08:43:31.178 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 723 gdbus root mem REG 8,1 343752 10128 /usr/lib64/libdbus-1.so.3.19.13 2023-11-05T08:43:31.178 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 723 gdbus root mem REG 8,1 62456 9782 /usr/lib64/libjansson.so.4.14.0 2023-11-05T08:43:31.178 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 723 gdbus root mem REG 8,1 31792 10954 /usr/lib64/libteamdctl.so.0.1.5 2023-11-05T08:43:31.179 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 723 gdbus root mem REG 8,1 57016 52811 /usr/lib64/NetworkManager/1.44.0-2.el9/libnm-device-plugin-team.so 2023-11-05T08:43:31.179 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 723 gdbus root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-05T08:43:31.179 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 723 gdbus root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-05T08:43:31.179 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 723 gdbus root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-05T08:43:31.179 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 723 gdbus root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-05T08:43:31.180 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 723 gdbus root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-05T08:43:31.180 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 723 gdbus root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-05T08:43:31.180 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 723 gdbus root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-05T08:43:31.180 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 723 gdbus root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-05T08:43:31.180 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 723 gdbus root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-05T08:43:31.180 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 723 gdbus root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-05T08:43:31.181 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 723 gdbus root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-05T08:43:31.181 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 723 gdbus root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-05T08:43:31.181 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 723 gdbus root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-05T08:43:31.181 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 723 gdbus root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-05T08:43:31.181 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 723 gdbus root mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-05T08:43:31.181 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 723 gdbus root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-05T08:43:31.182 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 723 gdbus root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-05T08:43:31.182 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 723 gdbus root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:31.182 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 723 gdbus root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-05T08:43:31.182 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 723 gdbus root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-05T08:43:31.182 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 723 gdbus root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-05T08:43:31.183 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 723 gdbus root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-05T08:43:31.183 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 723 gdbus root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-05T08:43:31.183 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 723 gdbus root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-05T08:43:31.183 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 723 gdbus root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-05T08:43:31.183 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 723 gdbus root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-05T08:43:31.183 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 723 gdbus root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-05T08:43:31.184 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 723 gdbus root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-05T08:43:31.184 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 723 gdbus root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-05T08:43:31.184 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 723 gdbus root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-05T08:43:31.184 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 723 gdbus root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:31.184 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 723 gdbus root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-05T08:43:31.185 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 723 gdbus root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-05T08:43:31.185 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 723 gdbus root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-05T08:43:31.185 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 723 gdbus root mem REG 8,1 626152 9989 /usr/lib64/libhogweed.so.6.5 2023-11-05T08:43:31.185 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 723 gdbus root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-05T08:43:31.185 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 723 gdbus root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-05T08:43:31.185 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 723 gdbus root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-05T08:43:31.186 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 723 gdbus root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:31.186 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 723 gdbus root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-05T08:43:31.186 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 723 gdbus root mem REG 8,1 94112 9901 /usr/lib64/libtasn1.so.6.6.0 2023-11-05T08:43:31.186 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 723 gdbus root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-05T08:43:31.186 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 723 gdbus root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:31.187 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 723 gdbus root mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-05T08:43:31.187 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 723 gdbus root mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-11-05T08:43:31.187 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 723 gdbus root mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-11-05T08:43:31.187 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 723 gdbus root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-05T08:43:31.187 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 723 gdbus root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-05T08:43:31.187 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 723 gdbus root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:31.188 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 723 gdbus root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-05T08:43:31.188 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 723 gdbus root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-05T08:43:31.188 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 723 gdbus root mem REG 8,1 2291576 9994 /usr/lib64/libgnutls.so.30.33.1 2023-11-05T08:43:31.188 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 723 gdbus root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-05T08:43:31.188 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 723 gdbus root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:31.189 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 723 gdbus root mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-11-05T08:43:31.189 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 723 gdbus root mem REG 8,1 32408 11334 /usr/lib64/libndp.so.0.2.0 2023-11-05T08:43:31.189 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 723 gdbus root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-05T08:43:31.189 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 723 gdbus root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-05T08:43:31.189 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 723 gdbus root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-05T08:43:31.189 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 723 gdbus root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-05T08:43:31.190 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 723 gdbus root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-05T08:43:31.190 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 723 gdbus root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-05T08:43:31.190 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 723 gdbus root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:31.190 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 723 gdbus root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-05T08:43:31.190 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 723 gdbus root 0r CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.191 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 723 gdbus root 1u unix 0xffff8da318372640 0t0 15999 type=STREAM (CONNECTED) 2023-11-05T08:43:31.191 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 723 gdbus root 2u unix 0xffff8da318372640 0t0 15999 type=STREAM (CONNECTED) 2023-11-05T08:43:31.191 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 723 gdbus root 3u a_inode 0,14 0 1084 [eventfd:3] 2023-11-05T08:43:31.191 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 723 gdbus root 4u a_inode 0,14 0 1084 [eventfd:4] 2023-11-05T08:43:31.191 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 723 gdbus root 5u unix 0xffff8da3183350c0 0t0 20015 type=DGRAM (UNCONNECTED) 2023-11-05T08:43:31.192 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 723 gdbus root 6u unix 0xffff8da31832a200 0t0 20016 type=STREAM (CONNECTED) 2023-11-05T08:43:31.192 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 723 gdbus root 7u a_inode 0,14 0 1084 [eventfd:5] 2023-11-05T08:43:31.192 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 723 gdbus root 8r REG 0,4 0 4026531840 net 2023-11-05T08:43:31.192 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 723 gdbus root 9r REG 0,4 0 4026532495 mnt 2023-11-05T08:43:31.192 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 723 gdbus root 10u netlink 0t0 20020 KOBJECT_UEVENT 2023-11-05T08:43:31.192 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 723 gdbus root 11u netlink 0t0 20021 GENERIC 2023-11-05T08:43:31.193 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 723 gdbus root 12u netlink 0t0 20022 GENERIC 2023-11-05T08:43:31.193 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 723 gdbus root 13u netlink 0t0 20023 ROUTE 2023-11-05T08:43:31.193 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 723 gdbus root 14r a_inode 0,14 0 1084 inotify 2023-11-05T08:43:31.193 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 723 gdbus root 15r a_inode 0,14 0 1084 inotify 2023-11-05T08:43:31.193 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 723 gdbus root 16u netlink 0t0 17715 KOBJECT_UEVENT 2023-11-05T08:43:31.194 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 723 gdbus root 17u a_inode 0,14 0 1084 [eventpoll] 2023-11-05T08:43:31.194 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 723 gdbus root 18u unix 0xffff8da318868880 0t0 16543 type=STREAM (CONNECTED) 2023-11-05T08:43:31.194 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 723 gdbus root 19u a_inode 0,14 0 1084 [eventpoll:21,26] 2023-11-05T08:43:31.194 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 723 gdbus root 20w FIFO 0,24 0t0 1159 /run/systemd/inhibit/1.ref 2023-11-05T08:43:31.194 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 723 gdbus root 21u a_inode 0,14 0 1084 [timerfd] 2023-11-05T08:43:31.195 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 723 gdbus root 23u a_inode 0,14 0 1084 [eventpoll:24,25] 2023-11-05T08:43:31.195 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 723 gdbus root 24u a_inode 0,14 0 1084 [timerfd] 2023-11-05T08:43:31.195 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 723 gdbus root 25u pack 21108 0t0 ARP type=SOCK_DGRAM 2023-11-05T08:43:31.195 INFO:teuthology.orchestra.run.smithi156.stdout:NetworkMa 704 723 gdbus root 26u IPv4 21109 0t0 UDP smithi156.front.sepia.ceph.com:bootpc->store01.front.sepia.ceph.com:bootps 2023-11-05T08:43:31.195 INFO:teuthology.orchestra.run.smithi156.stdout:irqbalanc 707 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.195 INFO:teuthology.orchestra.run.smithi156.stdout:irqbalanc 707 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.196 INFO:teuthology.orchestra.run.smithi156.stdout:irqbalanc 707 root txt REG 8,1 61904 10507 /usr/sbin/irqbalance 2023-11-05T08:43:31.196 INFO:teuthology.orchestra.run.smithi156.stdout:irqbalanc 707 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:31.196 INFO:teuthology.orchestra.run.smithi156.stdout:irqbalanc 707 root mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-05T08:43:31.196 INFO:teuthology.orchestra.run.smithi156.stdout:irqbalanc 707 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:31.196 INFO:teuthology.orchestra.run.smithi156.stdout:irqbalanc 707 root DEL REG 8,1 9998 /usr/lib64/libnuma.so.1.0.0 2023-11-05T08:43:31.197 INFO:teuthology.orchestra.run.smithi156.stdout:irqbalanc 707 root mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-05T08:43:31.197 INFO:teuthology.orchestra.run.smithi156.stdout:irqbalanc 707 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-05T08:43:31.197 INFO:teuthology.orchestra.run.smithi156.stdout:irqbalanc 707 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:31.197 INFO:teuthology.orchestra.run.smithi156.stdout:irqbalanc 707 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.197 INFO:teuthology.orchestra.run.smithi156.stdout:irqbalanc 707 root 1u unix 0xffff8da318376a40 0t0 16008 type=STREAM (CONNECTED) 2023-11-05T08:43:31.198 INFO:teuthology.orchestra.run.smithi156.stdout:irqbalanc 707 root 2u unix 0xffff8da318376a40 0t0 16008 type=STREAM (CONNECTED) 2023-11-05T08:43:31.198 INFO:teuthology.orchestra.run.smithi156.stdout:irqbalanc 707 root 3u a_inode 0,14 0 1084 [eventfd:1] 2023-11-05T08:43:31.198 INFO:teuthology.orchestra.run.smithi156.stdout:irqbalanc 707 root 4u a_inode 0,14 0 1084 [eventfd:2] 2023-11-05T08:43:31.198 INFO:teuthology.orchestra.run.smithi156.stdout:irqbalanc 707 root 5u unix 0xffff8da318372a80 0t0 16021 /run/irqbalance/irqbalance707.sock type=STREAM (LISTEN) 2023-11-05T08:43:31.198 INFO:teuthology.orchestra.run.smithi156.stdout:irqbalanc 707 root 6u unix 0xffff8da318b3a200 0t0 16075 type=DGRAM (CONNECTED) 2023-11-05T08:43:31.199 INFO:teuthology.orchestra.run.smithi156.stdout:irqbalanc 707 714 gmain root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.199 INFO:teuthology.orchestra.run.smithi156.stdout:irqbalanc 707 714 gmain root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.199 INFO:teuthology.orchestra.run.smithi156.stdout:irqbalanc 707 714 gmain root txt REG 8,1 61904 10507 /usr/sbin/irqbalance 2023-11-05T08:43:31.199 INFO:teuthology.orchestra.run.smithi156.stdout:irqbalanc 707 714 gmain root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:31.199 INFO:teuthology.orchestra.run.smithi156.stdout:irqbalanc 707 714 gmain root mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-05T08:43:31.200 INFO:teuthology.orchestra.run.smithi156.stdout:irqbalanc 707 714 gmain root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:31.200 INFO:teuthology.orchestra.run.smithi156.stdout:irqbalanc 707 714 gmain root DEL REG 8,1 9998 /usr/lib64/libnuma.so.1.0.0 2023-11-05T08:43:31.200 INFO:teuthology.orchestra.run.smithi156.stdout:irqbalanc 707 714 gmain root mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-05T08:43:31.200 INFO:teuthology.orchestra.run.smithi156.stdout:irqbalanc 707 714 gmain root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-05T08:43:31.200 INFO:teuthology.orchestra.run.smithi156.stdout:irqbalanc 707 714 gmain root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:31.200 INFO:teuthology.orchestra.run.smithi156.stdout:irqbalanc 707 714 gmain root 0r CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.201 INFO:teuthology.orchestra.run.smithi156.stdout:irqbalanc 707 714 gmain root 1u unix 0xffff8da318376a40 0t0 16008 type=STREAM (CONNECTED) 2023-11-05T08:43:31.201 INFO:teuthology.orchestra.run.smithi156.stdout:irqbalanc 707 714 gmain root 2u unix 0xffff8da318376a40 0t0 16008 type=STREAM (CONNECTED) 2023-11-05T08:43:31.201 INFO:teuthology.orchestra.run.smithi156.stdout:irqbalanc 707 714 gmain root 3u a_inode 0,14 0 1084 [eventfd:1] 2023-11-05T08:43:31.201 INFO:teuthology.orchestra.run.smithi156.stdout:irqbalanc 707 714 gmain root 4u a_inode 0,14 0 1084 [eventfd:2] 2023-11-05T08:43:31.201 INFO:teuthology.orchestra.run.smithi156.stdout:irqbalanc 707 714 gmain root 5u unix 0xffff8da318372a80 0t0 16021 /run/irqbalance/irqbalance707.sock type=STREAM (LISTEN) 2023-11-05T08:43:31.202 INFO:teuthology.orchestra.run.smithi156.stdout:irqbalanc 707 714 gmain root 6u unix 0xffff8da318b3a200 0t0 16075 type=DGRAM (CONNECTED) 2023-11-05T08:43:31.202 INFO:teuthology.orchestra.run.smithi156.stdout:lsmd 708 libstoragemgmt cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.202 INFO:teuthology.orchestra.run.smithi156.stdout:lsmd 708 libstoragemgmt rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.202 INFO:teuthology.orchestra.run.smithi156.stdout:lsmd 708 libstoragemgmt txt REG 8,1 32280 11292 /usr/bin/lsmd 2023-11-05T08:43:31.202 INFO:teuthology.orchestra.run.smithi156.stdout:lsmd 708 libstoragemgmt mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:31.203 INFO:teuthology.orchestra.run.smithi156.stdout:lsmd 708 libstoragemgmt mem REG 8,1 56912 10811 /usr/lib64/libconfig.so.11.0.2 2023-11-05T08:43:31.203 INFO:teuthology.orchestra.run.smithi156.stdout:lsmd 708 libstoragemgmt mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:31.203 INFO:teuthology.orchestra.run.smithi156.stdout:lsmd 708 libstoragemgmt 0r CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.203 INFO:teuthology.orchestra.run.smithi156.stdout:lsmd 708 libstoragemgmt 1u unix 0xffff8da318833b80 0t0 17703 type=STREAM (CONNECTED) 2023-11-05T08:43:31.203 INFO:teuthology.orchestra.run.smithi156.stdout:lsmd 708 libstoragemgmt 2u unix 0xffff8da318833b80 0t0 17703 type=STREAM (CONNECTED) 2023-11-05T08:43:31.203 INFO:teuthology.orchestra.run.smithi156.stdout:lsmd 708 libstoragemgmt 3uW REG 0,24 0 1112 /run/lsm/ipc/.lsmd-ipc-lock 2023-11-05T08:43:31.204 INFO:teuthology.orchestra.run.smithi156.stdout:lsmd 708 libstoragemgmt 5u unix 0xffff8da31832ee80 0t0 19986 /var/run/lsm/ipc/simc type=STREAM (LISTEN) 2023-11-05T08:43:31.204 INFO:teuthology.orchestra.run.smithi156.stdout:lsmd 708 libstoragemgmt 6u unix 0xffff8da318329540 0t0 19987 /var/run/lsm/ipc/sim type=STREAM (LISTEN) 2023-11-05T08:43:31.204 INFO:teuthology.orchestra.run.smithi156.stdout:mcelog 709 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.204 INFO:teuthology.orchestra.run.smithi156.stdout:mcelog 709 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.204 INFO:teuthology.orchestra.run.smithi156.stdout:mcelog 709 root txt REG 8,1 194568 12461 /usr/sbin/mcelog 2023-11-05T08:43:31.205 INFO:teuthology.orchestra.run.smithi156.stdout:mcelog 709 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:31.205 INFO:teuthology.orchestra.run.smithi156.stdout:mcelog 709 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:31.205 INFO:teuthology.orchestra.run.smithi156.stdout:mcelog 709 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.205 INFO:teuthology.orchestra.run.smithi156.stdout:mcelog 709 root 1u unix 0xffff8da318329980 0t0 19972 type=STREAM (CONNECTED) 2023-11-05T08:43:31.205 INFO:teuthology.orchestra.run.smithi156.stdout:mcelog 709 root 2u unix 0xffff8da318329980 0t0 19972 type=STREAM (CONNECTED) 2023-11-05T08:43:31.206 INFO:teuthology.orchestra.run.smithi156.stdout:mcelog 709 root 3r CHR 10,227 0t0 142 /dev/mcelog 2023-11-05T08:43:31.206 INFO:teuthology.orchestra.run.smithi156.stdout:mcelog 709 root 4u unix 0xffff8da318215500 0t0 21072 /var/run/mcelog-client type=STREAM (LISTEN) 2023-11-05T08:43:31.206 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 polkitd cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.206 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 polkitd rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.206 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2023-11-05T08:43:31.206 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-05T08:43:31.207 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:31.207 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:31.207 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-05T08:43:31.207 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:31.207 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-05T08:43:31.208 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-05T08:43:31.208 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-05T08:43:31.208 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-05T08:43:31.208 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-05T08:43:31.208 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2023-11-05T08:43:31.208 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-05T08:43:31.209 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-05T08:43:31.209 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:31.209 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-05T08:43:31.209 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:31.209 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-05T08:43:31.210 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:31.210 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-11-05T08:43:31.210 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:31.210 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-05T08:43:31.210 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-05T08:43:31.210 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-05T08:43:31.211 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-11-05T08:43:31.211 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-11-05T08:43:31.211 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-11-05T08:43:31.211 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:31.211 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.212 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.212 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.212 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 polkitd 3r a_inode 0,14 0 1084 inotify 2023-11-05T08:43:31.212 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 polkitd 4u a_inode 0,14 0 1084 [eventfd:7] 2023-11-05T08:43:31.212 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 polkitd 5u a_inode 0,14 0 1084 [eventfd:8] 2023-11-05T08:43:31.213 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 polkitd 6u unix 0xffff8da318328880 0t0 20061 type=STREAM (CONNECTED) 2023-11-05T08:43:31.213 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 polkitd 7u a_inode 0,14 0 1084 [eventfd:9] 2023-11-05T08:43:31.213 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 polkitd 8r a_inode 0,14 0 1084 inotify 2023-11-05T08:43:31.213 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 polkitd 9u a_inode 0,14 0 1084 [eventfd:6] 2023-11-05T08:43:31.213 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 polkitd 10u unix 0xffff8da318922ec0 0t0 21864 type=DGRAM (CONNECTED) 2023-11-05T08:43:31.213 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 726 gmain polkitd cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.214 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 726 gmain polkitd rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.214 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 726 gmain polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2023-11-05T08:43:31.214 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 726 gmain polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-05T08:43:31.214 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 726 gmain polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:31.214 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 726 gmain polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:31.215 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 726 gmain polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-05T08:43:31.215 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 726 gmain polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:31.215 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 726 gmain polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-05T08:43:31.215 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 726 gmain polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-05T08:43:31.215 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 726 gmain polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-05T08:43:31.215 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 726 gmain polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-05T08:43:31.216 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 726 gmain polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-05T08:43:31.216 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 726 gmain polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2023-11-05T08:43:31.216 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 726 gmain polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-05T08:43:31.216 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 726 gmain polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-05T08:43:31.216 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 726 gmain polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:31.217 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 726 gmain polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-05T08:43:31.217 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 726 gmain polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:31.217 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 726 gmain polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-05T08:43:31.217 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 726 gmain polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:31.217 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 726 gmain polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-11-05T08:43:31.217 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 726 gmain polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:31.218 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 726 gmain polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-05T08:43:31.218 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 726 gmain polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-05T08:43:31.218 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 726 gmain polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-05T08:43:31.218 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 726 gmain polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-11-05T08:43:31.218 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 726 gmain polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-11-05T08:43:31.219 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 726 gmain polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-11-05T08:43:31.219 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 726 gmain polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:31.219 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 726 gmain polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.219 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 726 gmain polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.219 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 726 gmain polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.219 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 726 gmain polkitd 3r a_inode 0,14 0 1084 inotify 2023-11-05T08:43:31.220 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 726 gmain polkitd 4u a_inode 0,14 0 1084 [eventfd:7] 2023-11-05T08:43:31.220 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 726 gmain polkitd 5u a_inode 0,14 0 1084 [eventfd:8] 2023-11-05T08:43:31.220 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 726 gmain polkitd 6u unix 0xffff8da318328880 0t0 20061 type=STREAM (CONNECTED) 2023-11-05T08:43:31.220 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 726 gmain polkitd 7u a_inode 0,14 0 1084 [eventfd:9] 2023-11-05T08:43:31.220 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 726 gmain polkitd 8r a_inode 0,14 0 1084 inotify 2023-11-05T08:43:31.221 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 726 gmain polkitd 9u a_inode 0,14 0 1084 [eventfd:6] 2023-11-05T08:43:31.221 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 726 gmain polkitd 10u unix 0xffff8da318922ec0 0t0 21864 type=DGRAM (CONNECTED) 2023-11-05T08:43:31.221 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 727 gdbus polkitd cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.221 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 727 gdbus polkitd rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.221 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 727 gdbus polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2023-11-05T08:43:31.221 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 727 gdbus polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-05T08:43:31.222 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 727 gdbus polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:31.222 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 727 gdbus polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:31.222 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 727 gdbus polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-05T08:43:31.222 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 727 gdbus polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:31.222 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 727 gdbus polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-05T08:43:31.223 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 727 gdbus polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-05T08:43:31.223 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 727 gdbus polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-05T08:43:31.223 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 727 gdbus polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-05T08:43:31.223 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 727 gdbus polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-05T08:43:31.223 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 727 gdbus polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2023-11-05T08:43:31.224 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 727 gdbus polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-05T08:43:31.224 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 727 gdbus polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-05T08:43:31.224 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 727 gdbus polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:31.224 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 727 gdbus polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-05T08:43:31.224 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 727 gdbus polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:31.224 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 727 gdbus polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-05T08:43:31.225 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 727 gdbus polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:31.225 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 727 gdbus polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-11-05T08:43:31.225 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 727 gdbus polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:31.225 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 727 gdbus polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-05T08:43:31.225 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 727 gdbus polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-05T08:43:31.226 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 727 gdbus polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-05T08:43:31.226 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 727 gdbus polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-11-05T08:43:31.226 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 727 gdbus polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-11-05T08:43:31.226 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 727 gdbus polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-11-05T08:43:31.226 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 727 gdbus polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:31.227 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 727 gdbus polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.227 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 727 gdbus polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.227 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 727 gdbus polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.227 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 727 gdbus polkitd 3r a_inode 0,14 0 1084 inotify 2023-11-05T08:43:31.227 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 727 gdbus polkitd 4u a_inode 0,14 0 1084 [eventfd:7] 2023-11-05T08:43:31.228 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 727 gdbus polkitd 5u a_inode 0,14 0 1084 [eventfd:8] 2023-11-05T08:43:31.228 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 727 gdbus polkitd 6u unix 0xffff8da318328880 0t0 20061 type=STREAM (CONNECTED) 2023-11-05T08:43:31.228 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 727 gdbus polkitd 7u a_inode 0,14 0 1084 [eventfd:9] 2023-11-05T08:43:31.228 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 727 gdbus polkitd 8r a_inode 0,14 0 1084 inotify 2023-11-05T08:43:31.228 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 727 gdbus polkitd 9u a_inode 0,14 0 1084 [eventfd:6] 2023-11-05T08:43:31.228 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 727 gdbus polkitd 10u unix 0xffff8da318922ec0 0t0 21864 type=DGRAM (CONNECTED) 2023-11-05T08:43:31.229 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 728 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.229 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 728 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.229 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 728 JS\x20Hel polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2023-11-05T08:43:31.229 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 728 JS\x20Hel polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-05T08:43:31.229 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 728 JS\x20Hel polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:31.230 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 728 JS\x20Hel polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:31.230 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 728 JS\x20Hel polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-05T08:43:31.230 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 728 JS\x20Hel polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:31.230 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 728 JS\x20Hel polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-05T08:43:31.230 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 728 JS\x20Hel polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-05T08:43:31.231 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 728 JS\x20Hel polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-05T08:43:31.231 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 728 JS\x20Hel polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-05T08:43:31.231 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 728 JS\x20Hel polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-05T08:43:31.231 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 728 JS\x20Hel polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2023-11-05T08:43:31.231 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 728 JS\x20Hel polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-05T08:43:31.231 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 728 JS\x20Hel polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-05T08:43:31.232 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 728 JS\x20Hel polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:31.232 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 728 JS\x20Hel polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-05T08:43:31.232 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 728 JS\x20Hel polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:31.232 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 728 JS\x20Hel polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-05T08:43:31.232 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 728 JS\x20Hel polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:31.233 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 728 JS\x20Hel polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-11-05T08:43:31.233 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 728 JS\x20Hel polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:31.233 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 728 JS\x20Hel polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-05T08:43:31.233 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 728 JS\x20Hel polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-05T08:43:31.233 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 728 JS\x20Hel polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-05T08:43:31.233 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 728 JS\x20Hel polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-11-05T08:43:31.234 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 728 JS\x20Hel polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-11-05T08:43:31.234 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 728 JS\x20Hel polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-11-05T08:43:31.234 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 728 JS\x20Hel polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:31.234 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 728 JS\x20Hel polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.234 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 728 JS\x20Hel polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.235 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 728 JS\x20Hel polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.235 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 728 JS\x20Hel polkitd 3r a_inode 0,14 0 1084 inotify 2023-11-05T08:43:31.235 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 728 JS\x20Hel polkitd 4u a_inode 0,14 0 1084 [eventfd:7] 2023-11-05T08:43:31.235 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 728 JS\x20Hel polkitd 5u a_inode 0,14 0 1084 [eventfd:8] 2023-11-05T08:43:31.235 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 728 JS\x20Hel polkitd 6u unix 0xffff8da318328880 0t0 20061 type=STREAM (CONNECTED) 2023-11-05T08:43:31.236 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 728 JS\x20Hel polkitd 7u a_inode 0,14 0 1084 [eventfd:9] 2023-11-05T08:43:31.236 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 728 JS\x20Hel polkitd 8r a_inode 0,14 0 1084 inotify 2023-11-05T08:43:31.236 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 728 JS\x20Hel polkitd 9u a_inode 0,14 0 1084 [eventfd:6] 2023-11-05T08:43:31.236 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 728 JS\x20Hel polkitd 10u unix 0xffff8da318922ec0 0t0 21864 type=DGRAM (CONNECTED) 2023-11-05T08:43:31.236 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 729 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.237 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 729 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.237 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 729 JS\x20Hel polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2023-11-05T08:43:31.237 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 729 JS\x20Hel polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-05T08:43:31.237 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 729 JS\x20Hel polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:31.237 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 729 JS\x20Hel polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:31.237 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 729 JS\x20Hel polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-05T08:43:31.238 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 729 JS\x20Hel polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:31.238 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 729 JS\x20Hel polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-05T08:43:31.238 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 729 JS\x20Hel polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-05T08:43:31.238 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 729 JS\x20Hel polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-05T08:43:31.238 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 729 JS\x20Hel polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-05T08:43:31.239 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 729 JS\x20Hel polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-05T08:43:31.239 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 729 JS\x20Hel polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2023-11-05T08:43:31.239 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 729 JS\x20Hel polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-05T08:43:31.239 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 729 JS\x20Hel polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-05T08:43:31.239 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 729 JS\x20Hel polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:31.240 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 729 JS\x20Hel polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-05T08:43:31.240 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 729 JS\x20Hel polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:31.240 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 729 JS\x20Hel polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-05T08:43:31.240 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 729 JS\x20Hel polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:31.240 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 729 JS\x20Hel polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-11-05T08:43:31.240 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 729 JS\x20Hel polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:31.241 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 729 JS\x20Hel polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-05T08:43:31.241 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 729 JS\x20Hel polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-05T08:43:31.241 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 729 JS\x20Hel polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-05T08:43:31.241 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 729 JS\x20Hel polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-11-05T08:43:31.241 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 729 JS\x20Hel polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-11-05T08:43:31.242 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 729 JS\x20Hel polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-11-05T08:43:31.242 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 729 JS\x20Hel polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:31.242 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 729 JS\x20Hel polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.242 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 729 JS\x20Hel polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.242 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 729 JS\x20Hel polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.243 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 729 JS\x20Hel polkitd 3r a_inode 0,14 0 1084 inotify 2023-11-05T08:43:31.243 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 729 JS\x20Hel polkitd 4u a_inode 0,14 0 1084 [eventfd:7] 2023-11-05T08:43:31.243 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 729 JS\x20Hel polkitd 5u a_inode 0,14 0 1084 [eventfd:8] 2023-11-05T08:43:31.243 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 729 JS\x20Hel polkitd 6u unix 0xffff8da318328880 0t0 20061 type=STREAM (CONNECTED) 2023-11-05T08:43:31.243 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 729 JS\x20Hel polkitd 7u a_inode 0,14 0 1084 [eventfd:9] 2023-11-05T08:43:31.243 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 729 JS\x20Hel polkitd 8r a_inode 0,14 0 1084 inotify 2023-11-05T08:43:31.244 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 729 JS\x20Hel polkitd 9u a_inode 0,14 0 1084 [eventfd:6] 2023-11-05T08:43:31.244 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 729 JS\x20Hel polkitd 10u unix 0xffff8da318922ec0 0t0 21864 type=DGRAM (CONNECTED) 2023-11-05T08:43:31.244 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 730 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.244 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 730 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.244 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 730 JS\x20Hel polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2023-11-05T08:43:31.244 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 730 JS\x20Hel polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-05T08:43:31.245 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 730 JS\x20Hel polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:31.245 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 730 JS\x20Hel polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:31.245 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 730 JS\x20Hel polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-05T08:43:31.245 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 730 JS\x20Hel polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:31.245 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 730 JS\x20Hel polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-05T08:43:31.246 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 730 JS\x20Hel polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-05T08:43:31.246 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 730 JS\x20Hel polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-05T08:43:31.246 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 730 JS\x20Hel polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-05T08:43:31.246 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 730 JS\x20Hel polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-05T08:43:31.246 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 730 JS\x20Hel polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2023-11-05T08:43:31.247 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 730 JS\x20Hel polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-05T08:43:31.247 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 730 JS\x20Hel polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-05T08:43:31.247 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 730 JS\x20Hel polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:31.247 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 730 JS\x20Hel polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-05T08:43:31.247 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 730 JS\x20Hel polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:31.247 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 730 JS\x20Hel polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-05T08:43:31.248 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 730 JS\x20Hel polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:31.248 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 730 JS\x20Hel polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-11-05T08:43:31.248 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 730 JS\x20Hel polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:31.248 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 730 JS\x20Hel polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-05T08:43:31.248 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 730 JS\x20Hel polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-05T08:43:31.249 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 730 JS\x20Hel polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-05T08:43:31.249 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 730 JS\x20Hel polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-11-05T08:43:31.249 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 730 JS\x20Hel polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-11-05T08:43:31.249 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 730 JS\x20Hel polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-11-05T08:43:31.249 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 730 JS\x20Hel polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:31.249 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 730 JS\x20Hel polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.250 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 730 JS\x20Hel polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.250 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 730 JS\x20Hel polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.250 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 730 JS\x20Hel polkitd 3r a_inode 0,14 0 1084 inotify 2023-11-05T08:43:31.250 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 730 JS\x20Hel polkitd 4u a_inode 0,14 0 1084 [eventfd:7] 2023-11-05T08:43:31.250 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 730 JS\x20Hel polkitd 5u a_inode 0,14 0 1084 [eventfd:8] 2023-11-05T08:43:31.251 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 730 JS\x20Hel polkitd 6u unix 0xffff8da318328880 0t0 20061 type=STREAM (CONNECTED) 2023-11-05T08:43:31.251 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 730 JS\x20Hel polkitd 7u a_inode 0,14 0 1084 [eventfd:9] 2023-11-05T08:43:31.251 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 730 JS\x20Hel polkitd 8r a_inode 0,14 0 1084 inotify 2023-11-05T08:43:31.251 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 730 JS\x20Hel polkitd 9u a_inode 0,14 0 1084 [eventfd:6] 2023-11-05T08:43:31.251 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 730 JS\x20Hel polkitd 10u unix 0xffff8da318922ec0 0t0 21864 type=DGRAM (CONNECTED) 2023-11-05T08:43:31.251 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 731 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.252 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 731 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.252 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 731 JS\x20Hel polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2023-11-05T08:43:31.252 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 731 JS\x20Hel polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-05T08:43:31.252 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 731 JS\x20Hel polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:31.252 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 731 JS\x20Hel polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:31.253 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 731 JS\x20Hel polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-05T08:43:31.253 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 731 JS\x20Hel polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:31.253 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 731 JS\x20Hel polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-05T08:43:31.253 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 731 JS\x20Hel polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-05T08:43:31.253 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 731 JS\x20Hel polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-05T08:43:31.254 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 731 JS\x20Hel polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-05T08:43:31.254 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 731 JS\x20Hel polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-05T08:43:31.254 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 731 JS\x20Hel polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2023-11-05T08:43:31.254 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 731 JS\x20Hel polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-05T08:43:31.254 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 731 JS\x20Hel polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-05T08:43:31.254 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 731 JS\x20Hel polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:31.255 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 731 JS\x20Hel polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-05T08:43:31.255 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 731 JS\x20Hel polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:31.255 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 731 JS\x20Hel polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-05T08:43:31.255 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 731 JS\x20Hel polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:31.255 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 731 JS\x20Hel polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-11-05T08:43:31.256 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 731 JS\x20Hel polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:31.256 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 731 JS\x20Hel polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-05T08:43:31.256 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 731 JS\x20Hel polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-05T08:43:31.256 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 731 JS\x20Hel polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-05T08:43:31.256 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 731 JS\x20Hel polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-11-05T08:43:31.256 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 731 JS\x20Hel polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-11-05T08:43:31.257 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 731 JS\x20Hel polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-11-05T08:43:31.257 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 731 JS\x20Hel polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:31.257 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 731 JS\x20Hel polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.257 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 731 JS\x20Hel polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.257 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 731 JS\x20Hel polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.258 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 731 JS\x20Hel polkitd 3r a_inode 0,14 0 1084 inotify 2023-11-05T08:43:31.258 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 731 JS\x20Hel polkitd 4u a_inode 0,14 0 1084 [eventfd:7] 2023-11-05T08:43:31.258 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 731 JS\x20Hel polkitd 5u a_inode 0,14 0 1084 [eventfd:8] 2023-11-05T08:43:31.258 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 731 JS\x20Hel polkitd 6u unix 0xffff8da318328880 0t0 20061 type=STREAM (CONNECTED) 2023-11-05T08:43:31.258 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 731 JS\x20Hel polkitd 7u a_inode 0,14 0 1084 [eventfd:9] 2023-11-05T08:43:31.259 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 731 JS\x20Hel polkitd 8r a_inode 0,14 0 1084 inotify 2023-11-05T08:43:31.259 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 731 JS\x20Hel polkitd 9u a_inode 0,14 0 1084 [eventfd:6] 2023-11-05T08:43:31.259 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 731 JS\x20Hel polkitd 10u unix 0xffff8da318922ec0 0t0 21864 type=DGRAM (CONNECTED) 2023-11-05T08:43:31.259 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 732 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.259 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 732 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.259 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 732 JS\x20Hel polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2023-11-05T08:43:31.260 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 732 JS\x20Hel polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-05T08:43:31.260 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 732 JS\x20Hel polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:31.260 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 732 JS\x20Hel polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:31.260 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 732 JS\x20Hel polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-05T08:43:31.261 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 732 JS\x20Hel polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:31.261 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 732 JS\x20Hel polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-05T08:43:31.261 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 732 JS\x20Hel polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-05T08:43:31.261 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 732 JS\x20Hel polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-05T08:43:31.261 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 732 JS\x20Hel polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-05T08:43:31.261 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 732 JS\x20Hel polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-05T08:43:31.262 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 732 JS\x20Hel polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2023-11-05T08:43:31.262 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 732 JS\x20Hel polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-05T08:43:31.262 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 732 JS\x20Hel polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-05T08:43:31.262 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 732 JS\x20Hel polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:31.262 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 732 JS\x20Hel polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-05T08:43:31.263 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 732 JS\x20Hel polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:31.263 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 732 JS\x20Hel polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-05T08:43:31.263 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 732 JS\x20Hel polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:31.263 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 732 JS\x20Hel polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-11-05T08:43:31.263 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 732 JS\x20Hel polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:31.264 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 732 JS\x20Hel polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-05T08:43:31.264 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 732 JS\x20Hel polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-05T08:43:31.264 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 732 JS\x20Hel polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-05T08:43:31.264 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 732 JS\x20Hel polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-11-05T08:43:31.264 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 732 JS\x20Hel polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-11-05T08:43:31.264 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 732 JS\x20Hel polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-11-05T08:43:31.265 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 732 JS\x20Hel polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:31.265 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 732 JS\x20Hel polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.265 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 732 JS\x20Hel polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.265 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 732 JS\x20Hel polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.265 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 732 JS\x20Hel polkitd 3r a_inode 0,14 0 1084 inotify 2023-11-05T08:43:31.266 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 732 JS\x20Hel polkitd 4u a_inode 0,14 0 1084 [eventfd:7] 2023-11-05T08:43:31.266 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 732 JS\x20Hel polkitd 5u a_inode 0,14 0 1084 [eventfd:8] 2023-11-05T08:43:31.266 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 732 JS\x20Hel polkitd 6u unix 0xffff8da318328880 0t0 20061 type=STREAM (CONNECTED) 2023-11-05T08:43:31.266 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 732 JS\x20Hel polkitd 7u a_inode 0,14 0 1084 [eventfd:9] 2023-11-05T08:43:31.266 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 732 JS\x20Hel polkitd 8r a_inode 0,14 0 1084 inotify 2023-11-05T08:43:31.266 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 732 JS\x20Hel polkitd 9u a_inode 0,14 0 1084 [eventfd:6] 2023-11-05T08:43:31.267 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 732 JS\x20Hel polkitd 10u unix 0xffff8da318922ec0 0t0 21864 type=DGRAM (CONNECTED) 2023-11-05T08:43:31.267 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 733 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.267 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 733 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.267 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 733 JS\x20Hel polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2023-11-05T08:43:31.267 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 733 JS\x20Hel polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-05T08:43:31.268 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 733 JS\x20Hel polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:31.268 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 733 JS\x20Hel polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:31.268 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 733 JS\x20Hel polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-05T08:43:31.268 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 733 JS\x20Hel polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:31.268 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 733 JS\x20Hel polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-05T08:43:31.269 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 733 JS\x20Hel polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-05T08:43:31.269 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 733 JS\x20Hel polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-05T08:43:31.269 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 733 JS\x20Hel polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-05T08:43:31.269 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 733 JS\x20Hel polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-05T08:43:31.269 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 733 JS\x20Hel polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2023-11-05T08:43:31.269 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 733 JS\x20Hel polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-05T08:43:31.270 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 733 JS\x20Hel polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-05T08:43:31.270 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 733 JS\x20Hel polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:31.270 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 733 JS\x20Hel polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-05T08:43:31.270 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 733 JS\x20Hel polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:31.270 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 733 JS\x20Hel polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-05T08:43:31.271 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 733 JS\x20Hel polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:31.271 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 733 JS\x20Hel polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-11-05T08:43:31.271 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 733 JS\x20Hel polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:31.271 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 733 JS\x20Hel polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-05T08:43:31.271 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 733 JS\x20Hel polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-05T08:43:31.271 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 733 JS\x20Hel polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-05T08:43:31.272 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 733 JS\x20Hel polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-11-05T08:43:31.272 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 733 JS\x20Hel polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-11-05T08:43:31.272 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 733 JS\x20Hel polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-11-05T08:43:31.272 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 733 JS\x20Hel polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:31.272 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 733 JS\x20Hel polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.273 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 733 JS\x20Hel polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.273 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 733 JS\x20Hel polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.273 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 733 JS\x20Hel polkitd 3r a_inode 0,14 0 1084 inotify 2023-11-05T08:43:31.273 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 733 JS\x20Hel polkitd 4u a_inode 0,14 0 1084 [eventfd:7] 2023-11-05T08:43:31.273 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 733 JS\x20Hel polkitd 5u a_inode 0,14 0 1084 [eventfd:8] 2023-11-05T08:43:31.274 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 733 JS\x20Hel polkitd 6u unix 0xffff8da318328880 0t0 20061 type=STREAM (CONNECTED) 2023-11-05T08:43:31.274 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 733 JS\x20Hel polkitd 7u a_inode 0,14 0 1084 [eventfd:9] 2023-11-05T08:43:31.274 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 733 JS\x20Hel polkitd 8r a_inode 0,14 0 1084 inotify 2023-11-05T08:43:31.274 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 733 JS\x20Hel polkitd 9u a_inode 0,14 0 1084 [eventfd:6] 2023-11-05T08:43:31.274 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 733 JS\x20Hel polkitd 10u unix 0xffff8da318922ec0 0t0 21864 type=DGRAM (CONNECTED) 2023-11-05T08:43:31.274 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 734 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.275 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 734 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.275 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 734 JS\x20Hel polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2023-11-05T08:43:31.275 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 734 JS\x20Hel polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-05T08:43:31.275 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 734 JS\x20Hel polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:31.275 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 734 JS\x20Hel polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:31.276 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 734 JS\x20Hel polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-05T08:43:31.276 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 734 JS\x20Hel polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:31.276 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 734 JS\x20Hel polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-05T08:43:31.276 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 734 JS\x20Hel polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-05T08:43:31.276 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 734 JS\x20Hel polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-05T08:43:31.276 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 734 JS\x20Hel polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-05T08:43:31.277 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 734 JS\x20Hel polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-05T08:43:31.277 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 734 JS\x20Hel polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2023-11-05T08:43:31.277 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 734 JS\x20Hel polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-05T08:43:31.277 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 734 JS\x20Hel polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-05T08:43:31.277 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 734 JS\x20Hel polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:31.278 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 734 JS\x20Hel polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-05T08:43:31.278 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 734 JS\x20Hel polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:31.278 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 734 JS\x20Hel polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-05T08:43:31.278 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 734 JS\x20Hel polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:31.278 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 734 JS\x20Hel polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-11-05T08:43:31.278 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 734 JS\x20Hel polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:31.279 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 734 JS\x20Hel polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-05T08:43:31.279 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 734 JS\x20Hel polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-05T08:43:31.279 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 734 JS\x20Hel polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-05T08:43:31.279 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 734 JS\x20Hel polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-11-05T08:43:31.279 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 734 JS\x20Hel polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-11-05T08:43:31.280 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 734 JS\x20Hel polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-11-05T08:43:31.280 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 734 JS\x20Hel polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:31.280 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 734 JS\x20Hel polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.280 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 734 JS\x20Hel polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.280 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 734 JS\x20Hel polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.280 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 734 JS\x20Hel polkitd 3r a_inode 0,14 0 1084 inotify 2023-11-05T08:43:31.281 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 734 JS\x20Hel polkitd 4u a_inode 0,14 0 1084 [eventfd:7] 2023-11-05T08:43:31.281 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 734 JS\x20Hel polkitd 5u a_inode 0,14 0 1084 [eventfd:8] 2023-11-05T08:43:31.281 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 734 JS\x20Hel polkitd 6u unix 0xffff8da318328880 0t0 20061 type=STREAM (CONNECTED) 2023-11-05T08:43:31.281 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 734 JS\x20Hel polkitd 7u a_inode 0,14 0 1084 [eventfd:9] 2023-11-05T08:43:31.281 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 734 JS\x20Hel polkitd 8r a_inode 0,14 0 1084 inotify 2023-11-05T08:43:31.282 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 734 JS\x20Hel polkitd 9u a_inode 0,14 0 1084 [eventfd:6] 2023-11-05T08:43:31.282 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 734 JS\x20Hel polkitd 10u unix 0xffff8da318922ec0 0t0 21864 type=DGRAM (CONNECTED) 2023-11-05T08:43:31.282 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 735 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.282 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 735 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.282 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 735 JS\x20Hel polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2023-11-05T08:43:31.283 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 735 JS\x20Hel polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-05T08:43:31.283 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 735 JS\x20Hel polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:31.283 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 735 JS\x20Hel polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:31.283 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 735 JS\x20Hel polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-05T08:43:31.283 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 735 JS\x20Hel polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:31.283 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 735 JS\x20Hel polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-05T08:43:31.284 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 735 JS\x20Hel polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-05T08:43:31.284 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 735 JS\x20Hel polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-05T08:43:31.284 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 735 JS\x20Hel polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-05T08:43:31.284 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 735 JS\x20Hel polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-05T08:43:31.284 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 735 JS\x20Hel polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2023-11-05T08:43:31.285 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 735 JS\x20Hel polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-05T08:43:31.285 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 735 JS\x20Hel polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-05T08:43:31.285 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 735 JS\x20Hel polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:31.285 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 735 JS\x20Hel polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-05T08:43:31.285 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 735 JS\x20Hel polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:31.285 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 735 JS\x20Hel polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-05T08:43:31.286 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 735 JS\x20Hel polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:31.286 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 735 JS\x20Hel polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-11-05T08:43:31.286 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 735 JS\x20Hel polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:31.286 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 735 JS\x20Hel polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-05T08:43:31.286 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 735 JS\x20Hel polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-05T08:43:31.287 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 735 JS\x20Hel polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-05T08:43:31.287 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 735 JS\x20Hel polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-11-05T08:43:31.287 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 735 JS\x20Hel polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-11-05T08:43:31.287 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 735 JS\x20Hel polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-11-05T08:43:31.287 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 735 JS\x20Hel polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:31.287 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 735 JS\x20Hel polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.288 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 735 JS\x20Hel polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.288 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 735 JS\x20Hel polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.288 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 735 JS\x20Hel polkitd 3r a_inode 0,14 0 1084 inotify 2023-11-05T08:43:31.288 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 735 JS\x20Hel polkitd 4u a_inode 0,14 0 1084 [eventfd:7] 2023-11-05T08:43:31.288 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 735 JS\x20Hel polkitd 5u a_inode 0,14 0 1084 [eventfd:8] 2023-11-05T08:43:31.289 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 735 JS\x20Hel polkitd 6u unix 0xffff8da318328880 0t0 20061 type=STREAM (CONNECTED) 2023-11-05T08:43:31.289 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 735 JS\x20Hel polkitd 7u a_inode 0,14 0 1084 [eventfd:9] 2023-11-05T08:43:31.289 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 735 JS\x20Hel polkitd 8r a_inode 0,14 0 1084 inotify 2023-11-05T08:43:31.289 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 735 JS\x20Hel polkitd 9u a_inode 0,14 0 1084 [eventfd:6] 2023-11-05T08:43:31.289 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 735 JS\x20Hel polkitd 10u unix 0xffff8da318922ec0 0t0 21864 type=DGRAM (CONNECTED) 2023-11-05T08:43:31.290 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 737 polkitd polkitd cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.290 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 737 polkitd polkitd rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.290 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 737 polkitd polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2023-11-05T08:43:31.290 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 737 polkitd polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-05T08:43:31.290 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 737 polkitd polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:31.290 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 737 polkitd polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:31.291 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 737 polkitd polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-05T08:43:31.291 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 737 polkitd polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:31.291 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 737 polkitd polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-05T08:43:31.291 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 737 polkitd polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-05T08:43:31.291 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 737 polkitd polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-05T08:43:31.292 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 737 polkitd polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-05T08:43:31.292 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 737 polkitd polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-05T08:43:31.292 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 737 polkitd polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2023-11-05T08:43:31.292 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 737 polkitd polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-05T08:43:31.292 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 737 polkitd polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-05T08:43:31.292 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 737 polkitd polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:31.293 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 737 polkitd polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-05T08:43:31.293 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 737 polkitd polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:31.293 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 737 polkitd polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-05T08:43:31.293 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 737 polkitd polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:31.293 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 737 polkitd polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-11-05T08:43:31.294 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 737 polkitd polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:31.294 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 737 polkitd polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-05T08:43:31.294 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 737 polkitd polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-05T08:43:31.294 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 737 polkitd polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-05T08:43:31.295 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 737 polkitd polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-11-05T08:43:31.295 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 737 polkitd polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-11-05T08:43:31.295 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 737 polkitd polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-11-05T08:43:31.295 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 737 polkitd polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:31.295 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 737 polkitd polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.296 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 737 polkitd polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.296 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 737 polkitd polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.296 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 737 polkitd polkitd 3r a_inode 0,14 0 1084 inotify 2023-11-05T08:43:31.296 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 737 polkitd polkitd 4u a_inode 0,14 0 1084 [eventfd:7] 2023-11-05T08:43:31.296 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 737 polkitd polkitd 5u a_inode 0,14 0 1084 [eventfd:8] 2023-11-05T08:43:31.296 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 737 polkitd polkitd 6u unix 0xffff8da318328880 0t0 20061 type=STREAM (CONNECTED) 2023-11-05T08:43:31.297 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 737 polkitd polkitd 7u a_inode 0,14 0 1084 [eventfd:9] 2023-11-05T08:43:31.297 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 737 polkitd polkitd 8r a_inode 0,14 0 1084 inotify 2023-11-05T08:43:31.297 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 737 polkitd polkitd 9u a_inode 0,14 0 1084 [eventfd:6] 2023-11-05T08:43:31.297 INFO:teuthology.orchestra.run.smithi156.stdout:polkitd 710 737 polkitd polkitd 10u unix 0xffff8da318922ec0 0t0 21864 type=DGRAM (CONNECTED) 2023-11-05T08:43:31.297 INFO:teuthology.orchestra.run.smithi156.stdout:smartd 711 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.298 INFO:teuthology.orchestra.run.smithi156.stdout:smartd 711 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.298 INFO:teuthology.orchestra.run.smithi156.stdout:smartd 711 root txt REG 8,1 622048 12498 /usr/sbin/smartd 2023-11-05T08:43:31.298 INFO:teuthology.orchestra.run.smithi156.stdout:smartd 711 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:31.298 INFO:teuthology.orchestra.run.smithi156.stdout:smartd 711 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-05T08:43:31.298 INFO:teuthology.orchestra.run.smithi156.stdout:smartd 711 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:31.299 INFO:teuthology.orchestra.run.smithi156.stdout:smartd 711 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-05T08:43:31.299 INFO:teuthology.orchestra.run.smithi156.stdout:smartd 711 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:31.299 INFO:teuthology.orchestra.run.smithi156.stdout:smartd 711 root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-05T08:43:31.299 INFO:teuthology.orchestra.run.smithi156.stdout:smartd 711 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-05T08:43:31.299 INFO:teuthology.orchestra.run.smithi156.stdout:smartd 711 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-05T08:43:31.299 INFO:teuthology.orchestra.run.smithi156.stdout:smartd 711 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-05T08:43:31.300 INFO:teuthology.orchestra.run.smithi156.stdout:smartd 711 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:31.300 INFO:teuthology.orchestra.run.smithi156.stdout:smartd 711 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:31.300 INFO:teuthology.orchestra.run.smithi156.stdout:smartd 711 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:31.300 INFO:teuthology.orchestra.run.smithi156.stdout:smartd 711 root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-05T08:43:31.300 INFO:teuthology.orchestra.run.smithi156.stdout:smartd 711 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-05T08:43:31.301 INFO:teuthology.orchestra.run.smithi156.stdout:smartd 711 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:31.301 INFO:teuthology.orchestra.run.smithi156.stdout:smartd 711 root 0u CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.301 INFO:teuthology.orchestra.run.smithi156.stdout:smartd 711 root 1u CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.301 INFO:teuthology.orchestra.run.smithi156.stdout:smartd 711 root 2u CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.301 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-l 713 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.301 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-l 713 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.302 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-l 713 root txt REG 8,1 306896 20362 /usr/lib/systemd/systemd-logind 2023-11-05T08:43:31.302 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-l 713 root mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2023-11-05T08:43:31.302 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-l 713 root mem REG 8,1 596532 1027 /etc/selinux/targeted/contexts/files/file_contexts.bin 2023-11-05T08:43:31.302 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-l 713 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-05T08:43:31.302 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-l 713 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:31.303 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-l 713 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-05T08:43:31.303 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-l 713 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-05T08:43:31.303 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-l 713 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-05T08:43:31.303 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-l 713 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:31.303 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-l 713 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-05T08:43:31.304 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-l 713 root mem REG 8,1 28552 9804 /usr/lib64/libattr.so.1.1.2501 2023-11-05T08:43:31.304 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-l 713 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:31.304 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-l 713 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-05T08:43:31.304 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-l 713 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-05T08:43:31.304 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-l 713 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:31.304 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-l 713 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-05T08:43:31.305 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-l 713 root mem REG 8,1 127680 9972 /usr/lib64/libseccomp.so.2.5.2 2023-11-05T08:43:31.305 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-l 713 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-05T08:43:31.305 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-l 713 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-05T08:43:31.305 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-l 713 root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-05T08:43:31.305 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-l 713 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-05T08:43:31.306 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-l 713 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:31.306 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-l 713 root mem REG 8,1 107424 10180 /usr/lib64/libkmod.so.2.3.6 2023-11-05T08:43:31.306 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-l 713 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-05T08:43:31.306 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-l 713 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-05T08:43:31.306 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-l 713 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:31.307 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-l 713 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-05T08:43:31.307 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-l 713 root mem REG 8,1 41120 9806 /usr/lib64/libacl.so.1.1.2301 2023-11-05T08:43:31.307 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-l 713 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:31.307 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-l 713 root mem REG 8,1 3645472 49253 /usr/lib64/systemd/libsystemd-shared-252.so 2023-11-05T08:43:31.307 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-l 713 root mem REG 8,1 21219 1168 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2023-11-05T08:43:31.307 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-l 713 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:31.308 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-l 713 root mem REG 0,19 0 19 /sys/fs/selinux/status 2023-11-05T08:43:31.308 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-l 713 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.308 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-l 713 root 1u unix 0xffff8da318918000 0t0 21745 type=STREAM (CONNECTED) 2023-11-05T08:43:31.308 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-l 713 root 2u unix 0xffff8da318918000 0t0 21745 type=STREAM (CONNECTED) 2023-11-05T08:43:31.308 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-l 713 root 3u unix 0xffff8da318920440 0t0 21772 type=DGRAM (CONNECTED) 2023-11-05T08:43:31.309 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-l 713 root 4u a_inode 0,14 0 1084 [eventpoll:5,6,7,8,9,10,11,12,13,14,15,16,17,18,20] 2023-11-05T08:43:31.309 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-l 713 root 5u a_inode 0,14 0 1084 [signalfd] 2023-11-05T08:43:31.309 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-l 713 root 6u a_inode 0,14 0 1084 [timerfd] 2023-11-05T08:43:31.309 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-l 713 root 7r REG 0,21 4096 22923 /sys/devices/virtual/tty/tty0/active 2023-11-05T08:43:31.309 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-l 713 root 8u netlink 0t0 21783 KOBJECT_UEVENT 2023-11-05T08:43:31.310 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-l 713 root 9r a_inode 0,14 0 1084 inotify 2023-11-05T08:43:31.310 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-l 713 root 10r FIFO 0,24 0t0 1159 /run/systemd/inhibit/1.ref 2023-11-05T08:43:31.310 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-l 713 root 11u netlink 0t0 21784 KOBJECT_UEVENT 2023-11-05T08:43:31.310 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-l 713 root 12u netlink 0t0 21785 KOBJECT_UEVENT 2023-11-05T08:43:31.310 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-l 713 root 13u netlink 0t0 21786 KOBJECT_UEVENT 2023-11-05T08:43:31.311 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-l 713 root 14u unix 0xffff8da31891b300 0t0 21787 type=STREAM (CONNECTED) 2023-11-05T08:43:31.311 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-l 713 root 15u a_inode 0,14 0 1084 [timerfd] 2023-11-05T08:43:31.311 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-l 713 root 16u CHR 13,65 0t0 138 /dev/input/event1 2023-11-05T08:43:31.311 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-l 713 root 17u CHR 13,64 0t0 137 /dev/input/event0 2023-11-05T08:43:31.311 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-l 713 root 18u CHR 13,66 0t0 148 /dev/input/event2 2023-11-05T08:43:31.311 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-l 713 root 19u CHR 4,6 0t0 25 /dev/tty6 2023-11-05T08:43:31.312 INFO:teuthology.orchestra.run.smithi156.stdout:systemd-l 713 root 20r FIFO 0,24 0t0 1609 /run/systemd/sessions/4.ref 2023-11-05T08:43:31.312 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 756 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.312 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 756 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.312 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 756 root txt REG 8,1 968800 13744 /usr/sbin/sshd 2023-11-05T08:43:31.312 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 756 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-05T08:43:31.313 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 756 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-05T08:43:31.313 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 756 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-05T08:43:31.313 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 756 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-05T08:43:31.313 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 756 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:31.313 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 756 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-05T08:43:31.313 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 756 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-05T08:43:31.314 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 756 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-05T08:43:31.314 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 756 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:31.314 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 756 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:31.314 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 756 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:31.314 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 756 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-05T08:43:31.315 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 756 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:31.315 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 756 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-05T08:43:31.315 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 756 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-05T08:43:31.315 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 756 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-05T08:43:31.315 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 756 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-05T08:43:31.315 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 756 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-05T08:43:31.316 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 756 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-05T08:43:31.316 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 756 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-05T08:43:31.316 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 756 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-05T08:43:31.316 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 756 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:31.316 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 756 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:31.317 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 756 root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-05T08:43:31.317 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 756 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-05T08:43:31.317 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 756 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-05T08:43:31.317 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 756 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:31.317 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 756 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.318 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 756 root 1u unix 0xffff8da318373300 0t0 16052 type=STREAM (CONNECTED) 2023-11-05T08:43:31.318 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 756 root 2u unix 0xffff8da318373300 0t0 16052 type=STREAM (CONNECTED) 2023-11-05T08:43:31.318 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 756 root 3u IPv4 20107 0t0 TCP *:ssh (LISTEN) 2023-11-05T08:43:31.318 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 756 root 4u IPv6 20109 0t0 TCP *:ssh (LISTEN) 2023-11-05T08:43:31.318 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.318 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.319 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 root txt REG 8,1 15448 10498 /usr/bin/python3.9 2023-11-05T08:43:31.319 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-05T08:43:31.319 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-05T08:43:31.319 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-05T08:43:31.319 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 root mem REG 8,1 204696 37013 /usr/lib64/girepository-1.0/GLib-2.0.typelib 2023-11-05T08:43:31.320 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:31.320 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-05T08:43:31.320 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:31.320 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-05T08:43:31.320 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 root mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-11-05T08:43:31.320 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 root mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-11-05T08:43:31.321 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-05T08:43:31.321 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 root mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-11-05T08:43:31.321 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 root mem REG 8,1 143200 10195 /usr/lib64/libgirepository-1.0.so.1.0.0 2023-11-05T08:43:31.321 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 root mem REG 8,1 357112 39324 /usr/lib64/python3.9/site-packages/gi/_gi.cpython-39-x86_64-linux-gnu.so 2023-11-05T08:43:31.321 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 root mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-05T08:43:31.322 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 root mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-05T08:43:31.322 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 root mem REG 8,1 24736 39204 /usr/lib64/python3.9/site-packages/_dbus_glib_bindings.so 2023-11-05T08:43:31.322 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-05T08:43:31.322 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-05T08:43:31.322 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-05T08:43:31.322 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:31.323 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-05T08:43:31.323 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-05T08:43:31.323 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-05T08:43:31.323 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:31.323 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-05T08:43:31.324 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 root mem REG 8,1 343752 10128 /usr/lib64/libdbus-1.so.3.19.13 2023-11-05T08:43:31.324 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 root mem REG 8,1 171376 39203 /usr/lib64/python3.9/site-packages/_dbus_bindings.so 2023-11-05T08:43:31.324 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-05T08:43:31.324 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-05T08:43:31.324 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-05T08:43:31.325 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-05T08:43:31.325 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-05T08:43:31.325 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-05T08:43:31.325 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-05T08:43:31.325 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-05T08:43:31.325 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:31.326 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-05T08:43:31.326 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-05T08:43:31.326 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-05T08:43:31.326 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-05T08:43:31.326 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-05T08:43:31.327 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-05T08:43:31.327 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-05T08:43:31.327 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-05T08:43:31.327 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-05T08:43:31.327 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-05T08:43:31.327 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:31.328 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-05T08:43:31.328 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-05T08:43:31.328 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:31.328 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-05T08:43:31.328 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-05T08:43:31.329 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-05T08:43:31.329 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-05T08:43:31.329 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-05T08:43:31.329 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:31.329 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.330 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 root 1u unix 0xffff8da318376e80 0t0 16055 type=STREAM (CONNECTED) 2023-11-05T08:43:31.330 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 root 2u unix 0xffff8da318376e80 0t0 16055 type=STREAM (CONNECTED) 2023-11-05T08:43:31.330 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 root 3w REG 8,1 10371 1216 /var/log/tuned/tuned.log 2023-11-05T08:43:31.330 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 root 4u sock 0,8 0t0 20126 protocol: NETLINK 2023-11-05T08:43:31.330 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 root 5u unix 0xffff8da31832d0c0 0t0 20132 type=STREAM (CONNECTED) 2023-11-05T08:43:31.330 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 root 6u a_inode 0,14 0 1084 [eventfd:17] 2023-11-05T08:43:31.331 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 root 7u unix 0xffff8da318211980 0t0 21106 type=STREAM (CONNECTED) 2023-11-05T08:43:31.331 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 root 8u unix 0xffff8da318213300 0t0 21107 type=STREAM (CONNECTED) 2023-11-05T08:43:31.331 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 852 tuned root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.331 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 852 tuned root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.331 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 852 tuned root txt REG 8,1 15448 10498 /usr/bin/python3.9 2023-11-05T08:43:31.332 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 852 tuned root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-05T08:43:31.332 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 852 tuned root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-05T08:43:31.332 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 852 tuned root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-05T08:43:31.332 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 852 tuned root mem REG 8,1 204696 37013 /usr/lib64/girepository-1.0/GLib-2.0.typelib 2023-11-05T08:43:31.332 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 852 tuned root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:31.333 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 852 tuned root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-05T08:43:31.333 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 852 tuned root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:31.333 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 852 tuned root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-05T08:43:31.333 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 852 tuned root mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-11-05T08:43:31.333 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 852 tuned root mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-11-05T08:43:31.334 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 852 tuned root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-05T08:43:31.334 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 852 tuned root mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-11-05T08:43:31.334 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 852 tuned root mem REG 8,1 143200 10195 /usr/lib64/libgirepository-1.0.so.1.0.0 2023-11-05T08:43:31.334 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 852 tuned root mem REG 8,1 357112 39324 /usr/lib64/python3.9/site-packages/gi/_gi.cpython-39-x86_64-linux-gnu.so 2023-11-05T08:43:31.334 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 852 tuned root mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-05T08:43:31.334 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 852 tuned root mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-05T08:43:31.335 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 852 tuned root mem REG 8,1 24736 39204 /usr/lib64/python3.9/site-packages/_dbus_glib_bindings.so 2023-11-05T08:43:31.335 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 852 tuned root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-05T08:43:31.335 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 852 tuned root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-05T08:43:31.335 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 852 tuned root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-05T08:43:31.335 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 852 tuned root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:31.336 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 852 tuned root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-05T08:43:31.336 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 852 tuned root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-05T08:43:31.336 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 852 tuned root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-05T08:43:31.336 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 852 tuned root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:31.336 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 852 tuned root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-05T08:43:31.337 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 852 tuned root mem REG 8,1 343752 10128 /usr/lib64/libdbus-1.so.3.19.13 2023-11-05T08:43:31.337 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 852 tuned root mem REG 8,1 171376 39203 /usr/lib64/python3.9/site-packages/_dbus_bindings.so 2023-11-05T08:43:31.337 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 852 tuned root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-05T08:43:31.337 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 852 tuned root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-05T08:43:31.337 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 852 tuned root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-05T08:43:31.337 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 852 tuned root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-05T08:43:31.338 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 852 tuned root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-05T08:43:31.338 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 852 tuned root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-05T08:43:31.338 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 852 tuned root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-05T08:43:31.338 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 852 tuned root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-05T08:43:31.338 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 852 tuned root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:31.339 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 852 tuned root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-05T08:43:31.339 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 852 tuned root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-05T08:43:31.339 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 852 tuned root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-05T08:43:31.339 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 852 tuned root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-05T08:43:31.339 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 852 tuned root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-05T08:43:31.340 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 852 tuned root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-05T08:43:31.340 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 852 tuned root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-05T08:43:31.340 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 852 tuned root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-05T08:43:31.340 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 852 tuned root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-05T08:43:31.340 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 852 tuned root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-05T08:43:31.340 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 852 tuned root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:31.341 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 852 tuned root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-05T08:43:31.341 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 852 tuned root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-05T08:43:31.341 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 852 tuned root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:31.341 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 852 tuned root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-05T08:43:31.341 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 852 tuned root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-05T08:43:31.342 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 852 tuned root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-05T08:43:31.342 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 852 tuned root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-05T08:43:31.342 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 852 tuned root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-05T08:43:31.342 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 852 tuned root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:31.342 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 852 tuned root 0r CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.343 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 852 tuned root 1u unix 0xffff8da318376e80 0t0 16055 type=STREAM (CONNECTED) 2023-11-05T08:43:31.343 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 852 tuned root 2u unix 0xffff8da318376e80 0t0 16055 type=STREAM (CONNECTED) 2023-11-05T08:43:31.343 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 852 tuned root 3w REG 8,1 10371 1216 /var/log/tuned/tuned.log 2023-11-05T08:43:31.343 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 852 tuned root 4u sock 0,8 0t0 20126 protocol: NETLINK 2023-11-05T08:43:31.343 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 852 tuned root 5u unix 0xffff8da31832d0c0 0t0 20132 type=STREAM (CONNECTED) 2023-11-05T08:43:31.343 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 852 tuned root 6u a_inode 0,14 0 1084 [eventfd:17] 2023-11-05T08:43:31.344 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 852 tuned root 7u unix 0xffff8da318211980 0t0 21106 type=STREAM (CONNECTED) 2023-11-05T08:43:31.344 INFO:teuthology.orchestra.run.smithi156.stdout:tuned 757 852 tuned root 8u unix 0xffff8da318213300 0t0 21107 type=STREAM (CONNECTED) 2023-11-05T08:43:31.344 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.344 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.344 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 root txt REG 8,1 127680 15021 /usr/sbin/gssproxy 2023-11-05T08:43:31.345 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-05T08:43:31.345 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:31.345 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-05T08:43:31.345 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 root mem REG 8,1 70960 15011 /usr/lib64/libev.so.4.0.0 2023-11-05T08:43:31.345 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 root mem REG 8,1 16168 15018 /usr/lib64/libverto-libev.so.1.0.0 2023-11-05T08:43:31.345 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-05T08:43:31.346 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:31.346 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:31.346 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-05T08:43:31.346 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-05T08:43:31.346 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-05T08:43:31.347 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-05T08:43:31.347 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:31.347 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 root mem REG 8,1 15912 9764 /usr/lib64/libbasicobjects.so.0.1.0 2023-11-05T08:43:31.347 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 root mem REG 8,1 20304 9968 /usr/lib64/libpath_utils.so.1.0.1 2023-11-05T08:43:31.347 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 root mem REG 8,1 58392 9766 /usr/lib64/libcollection.so.4.1.1 2023-11-05T08:43:31.348 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-05T08:43:31.348 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-05T08:43:31.348 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-05T08:43:31.348 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-05T08:43:31.348 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-05T08:43:31.348 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 root mem REG 8,1 142168 11395 /usr/lib64/libgssrpc.so.4.2 2023-11-05T08:43:31.349 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:31.349 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 root mem REG 8,1 16056 9768 /usr/lib64/libref_array.so.1.2.1 2023-11-05T08:43:31.349 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 root mem REG 8,1 120640 9970 /usr/lib64/libini_config.so.5.2.1 2023-11-05T08:43:31.349 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 root mem REG 8,1 28472 11392 /usr/lib64/libverto.so.1.0.0 2023-11-05T08:43:31.349 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-05T08:43:31.350 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-05T08:43:31.350 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 root mem REG 8,1 58368 9689 /usr/lib64/libpopt.so.0.0.1 2023-11-05T08:43:31.350 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-05T08:43:31.350 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-05T08:43:31.350 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-05T08:43:31.350 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-05T08:43:31.351 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-05T08:43:31.351 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-05T08:43:31.351 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:31.351 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-05T08:43:31.351 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.352 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 root 1u unix 0xffff8da307d8fb40 0t0 22987 type=STREAM (CONNECTED) 2023-11-05T08:43:31.352 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 root 2u unix 0xffff8da307d8fb40 0t0 22987 type=STREAM (CONNECTED) 2023-11-05T08:43:31.352 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 root 3u unix 0xffff8da318b39980 0t0 16058 type=DGRAM (CONNECTED) 2023-11-05T08:43:31.352 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 root 4r FIFO 0,13 0t0 16063 pipe 2023-11-05T08:43:31.352 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 root 5u a_inode 0,14 0 1084 [eventpoll:4,6,7,8] 2023-11-05T08:43:31.352 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 root 6u a_inode 0,14 0 1084 [eventfd:16] 2023-11-05T08:43:31.353 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 root 7u unix 0xffff8da318370000 0t0 16059 /var/lib/gssproxy/default.sock type=STREAM (LISTEN) 2023-11-05T08:43:31.353 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 root 8u unix 0xffff8da318375940 0t0 16060 /run/gssproxy.sock type=STREAM (LISTEN) 2023-11-05T08:43:31.353 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 root 9w FIFO 0,13 0t0 16063 pipe 2023-11-05T08:43:31.353 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 772 gssproxy root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.353 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 772 gssproxy root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.354 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 772 gssproxy root txt REG 8,1 127680 15021 /usr/sbin/gssproxy 2023-11-05T08:43:31.354 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 772 gssproxy root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-05T08:43:31.354 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 772 gssproxy root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:31.354 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 772 gssproxy root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-05T08:43:31.354 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 772 gssproxy root mem REG 8,1 70960 15011 /usr/lib64/libev.so.4.0.0 2023-11-05T08:43:31.355 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 772 gssproxy root mem REG 8,1 16168 15018 /usr/lib64/libverto-libev.so.1.0.0 2023-11-05T08:43:31.355 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 772 gssproxy root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-05T08:43:31.355 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 772 gssproxy root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:31.355 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 772 gssproxy root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:31.355 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 772 gssproxy root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-05T08:43:31.355 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 772 gssproxy root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-05T08:43:31.356 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 772 gssproxy root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-05T08:43:31.356 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 772 gssproxy root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-05T08:43:31.356 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 772 gssproxy root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:31.356 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 772 gssproxy root mem REG 8,1 15912 9764 /usr/lib64/libbasicobjects.so.0.1.0 2023-11-05T08:43:31.356 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 772 gssproxy root mem REG 8,1 20304 9968 /usr/lib64/libpath_utils.so.1.0.1 2023-11-05T08:43:31.357 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 772 gssproxy root mem REG 8,1 58392 9766 /usr/lib64/libcollection.so.4.1.1 2023-11-05T08:43:31.357 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 772 gssproxy root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-05T08:43:31.357 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 772 gssproxy root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-05T08:43:31.357 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 772 gssproxy root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-05T08:43:31.357 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 772 gssproxy root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-05T08:43:31.357 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 772 gssproxy root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-05T08:43:31.358 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 772 gssproxy root mem REG 8,1 142168 11395 /usr/lib64/libgssrpc.so.4.2 2023-11-05T08:43:31.358 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 772 gssproxy root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:31.358 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 772 gssproxy root mem REG 8,1 16056 9768 /usr/lib64/libref_array.so.1.2.1 2023-11-05T08:43:31.358 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 772 gssproxy root mem REG 8,1 120640 9970 /usr/lib64/libini_config.so.5.2.1 2023-11-05T08:43:31.358 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 772 gssproxy root mem REG 8,1 28472 11392 /usr/lib64/libverto.so.1.0.0 2023-11-05T08:43:31.359 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 772 gssproxy root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-05T08:43:31.359 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 772 gssproxy root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-05T08:43:31.359 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 772 gssproxy root mem REG 8,1 58368 9689 /usr/lib64/libpopt.so.0.0.1 2023-11-05T08:43:31.359 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 772 gssproxy root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-05T08:43:31.359 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 772 gssproxy root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-05T08:43:31.359 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 772 gssproxy root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-05T08:43:31.360 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 772 gssproxy root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-05T08:43:31.360 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 772 gssproxy root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-05T08:43:31.360 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 772 gssproxy root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-05T08:43:31.360 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 772 gssproxy root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:31.361 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 772 gssproxy root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-05T08:43:31.361 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 772 gssproxy root 0r CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.361 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 772 gssproxy root 1u unix 0xffff8da307d8fb40 0t0 22987 type=STREAM (CONNECTED) 2023-11-05T08:43:31.361 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 772 gssproxy root 2u unix 0xffff8da307d8fb40 0t0 22987 type=STREAM (CONNECTED) 2023-11-05T08:43:31.361 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 772 gssproxy root 3u unix 0xffff8da318b39980 0t0 16058 type=DGRAM (CONNECTED) 2023-11-05T08:43:31.361 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 772 gssproxy root 4r FIFO 0,13 0t0 16063 pipe 2023-11-05T08:43:31.362 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 772 gssproxy root 5u a_inode 0,14 0 1084 [eventpoll:4,6,7,8] 2023-11-05T08:43:31.362 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 772 gssproxy root 6u a_inode 0,14 0 1084 [eventfd:16] 2023-11-05T08:43:31.362 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 772 gssproxy root 7u unix 0xffff8da318370000 0t0 16059 /var/lib/gssproxy/default.sock type=STREAM (LISTEN) 2023-11-05T08:43:31.362 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 772 gssproxy root 8u unix 0xffff8da318375940 0t0 16060 /run/gssproxy.sock type=STREAM (LISTEN) 2023-11-05T08:43:31.362 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 772 gssproxy root 9w FIFO 0,13 0t0 16063 pipe 2023-11-05T08:43:31.363 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 773 gssproxy root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.363 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 773 gssproxy root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.363 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 773 gssproxy root txt REG 8,1 127680 15021 /usr/sbin/gssproxy 2023-11-05T08:43:31.363 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 773 gssproxy root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-05T08:43:31.363 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 773 gssproxy root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:31.363 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 773 gssproxy root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-05T08:43:31.364 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 773 gssproxy root mem REG 8,1 70960 15011 /usr/lib64/libev.so.4.0.0 2023-11-05T08:43:31.364 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 773 gssproxy root mem REG 8,1 16168 15018 /usr/lib64/libverto-libev.so.1.0.0 2023-11-05T08:43:31.364 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 773 gssproxy root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-05T08:43:31.364 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 773 gssproxy root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:31.364 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 773 gssproxy root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:31.365 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 773 gssproxy root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-05T08:43:31.365 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 773 gssproxy root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-05T08:43:31.365 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 773 gssproxy root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-05T08:43:31.365 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 773 gssproxy root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-05T08:43:31.365 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 773 gssproxy root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:31.365 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 773 gssproxy root mem REG 8,1 15912 9764 /usr/lib64/libbasicobjects.so.0.1.0 2023-11-05T08:43:31.366 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 773 gssproxy root mem REG 8,1 20304 9968 /usr/lib64/libpath_utils.so.1.0.1 2023-11-05T08:43:31.366 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 773 gssproxy root mem REG 8,1 58392 9766 /usr/lib64/libcollection.so.4.1.1 2023-11-05T08:43:31.366 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 773 gssproxy root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-05T08:43:31.366 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 773 gssproxy root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-05T08:43:31.366 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 773 gssproxy root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-05T08:43:31.367 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 773 gssproxy root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-05T08:43:31.367 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 773 gssproxy root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-05T08:43:31.367 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 773 gssproxy root mem REG 8,1 142168 11395 /usr/lib64/libgssrpc.so.4.2 2023-11-05T08:43:31.367 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 773 gssproxy root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:31.367 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 773 gssproxy root mem REG 8,1 16056 9768 /usr/lib64/libref_array.so.1.2.1 2023-11-05T08:43:31.367 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 773 gssproxy root mem REG 8,1 120640 9970 /usr/lib64/libini_config.so.5.2.1 2023-11-05T08:43:31.368 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 773 gssproxy root mem REG 8,1 28472 11392 /usr/lib64/libverto.so.1.0.0 2023-11-05T08:43:31.368 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 773 gssproxy root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-05T08:43:31.368 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 773 gssproxy root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-05T08:43:31.368 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 773 gssproxy root mem REG 8,1 58368 9689 /usr/lib64/libpopt.so.0.0.1 2023-11-05T08:43:31.368 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 773 gssproxy root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-05T08:43:31.369 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 773 gssproxy root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-05T08:43:31.369 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 773 gssproxy root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-05T08:43:31.369 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 773 gssproxy root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-05T08:43:31.369 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 773 gssproxy root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-05T08:43:31.369 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 773 gssproxy root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-05T08:43:31.369 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 773 gssproxy root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:31.370 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 773 gssproxy root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-05T08:43:31.370 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 773 gssproxy root 0r CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.370 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 773 gssproxy root 1u unix 0xffff8da307d8fb40 0t0 22987 type=STREAM (CONNECTED) 2023-11-05T08:43:31.370 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 773 gssproxy root 2u unix 0xffff8da307d8fb40 0t0 22987 type=STREAM (CONNECTED) 2023-11-05T08:43:31.370 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 773 gssproxy root 3u unix 0xffff8da318b39980 0t0 16058 type=DGRAM (CONNECTED) 2023-11-05T08:43:31.371 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 773 gssproxy root 4r FIFO 0,13 0t0 16063 pipe 2023-11-05T08:43:31.371 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 773 gssproxy root 5u a_inode 0,14 0 1084 [eventpoll:4,6,7,8] 2023-11-05T08:43:31.371 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 773 gssproxy root 6u a_inode 0,14 0 1084 [eventfd:16] 2023-11-05T08:43:31.371 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 773 gssproxy root 7u unix 0xffff8da318370000 0t0 16059 /var/lib/gssproxy/default.sock type=STREAM (LISTEN) 2023-11-05T08:43:31.371 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 773 gssproxy root 8u unix 0xffff8da318375940 0t0 16060 /run/gssproxy.sock type=STREAM (LISTEN) 2023-11-05T08:43:31.372 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 773 gssproxy root 9w FIFO 0,13 0t0 16063 pipe 2023-11-05T08:43:31.372 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 774 gssproxy root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.372 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 774 gssproxy root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.372 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 774 gssproxy root txt REG 8,1 127680 15021 /usr/sbin/gssproxy 2023-11-05T08:43:31.372 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 774 gssproxy root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-05T08:43:31.372 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 774 gssproxy root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:31.373 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 774 gssproxy root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-05T08:43:31.373 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 774 gssproxy root mem REG 8,1 70960 15011 /usr/lib64/libev.so.4.0.0 2023-11-05T08:43:31.373 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 774 gssproxy root mem REG 8,1 16168 15018 /usr/lib64/libverto-libev.so.1.0.0 2023-11-05T08:43:31.373 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 774 gssproxy root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-05T08:43:31.373 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 774 gssproxy root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:31.374 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 774 gssproxy root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:31.374 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 774 gssproxy root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-05T08:43:31.374 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 774 gssproxy root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-05T08:43:31.374 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 774 gssproxy root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-05T08:43:31.374 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 774 gssproxy root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-05T08:43:31.375 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 774 gssproxy root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:31.375 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 774 gssproxy root mem REG 8,1 15912 9764 /usr/lib64/libbasicobjects.so.0.1.0 2023-11-05T08:43:31.375 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 774 gssproxy root mem REG 8,1 20304 9968 /usr/lib64/libpath_utils.so.1.0.1 2023-11-05T08:43:31.375 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 774 gssproxy root mem REG 8,1 58392 9766 /usr/lib64/libcollection.so.4.1.1 2023-11-05T08:43:31.375 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 774 gssproxy root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-05T08:43:31.375 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 774 gssproxy root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-05T08:43:31.376 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 774 gssproxy root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-05T08:43:31.376 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 774 gssproxy root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-05T08:43:31.376 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 774 gssproxy root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-05T08:43:31.376 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 774 gssproxy root mem REG 8,1 142168 11395 /usr/lib64/libgssrpc.so.4.2 2023-11-05T08:43:31.376 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 774 gssproxy root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:31.377 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 774 gssproxy root mem REG 8,1 16056 9768 /usr/lib64/libref_array.so.1.2.1 2023-11-05T08:43:31.377 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 774 gssproxy root mem REG 8,1 120640 9970 /usr/lib64/libini_config.so.5.2.1 2023-11-05T08:43:31.377 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 774 gssproxy root mem REG 8,1 28472 11392 /usr/lib64/libverto.so.1.0.0 2023-11-05T08:43:31.377 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 774 gssproxy root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-05T08:43:31.377 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 774 gssproxy root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-05T08:43:31.377 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 774 gssproxy root mem REG 8,1 58368 9689 /usr/lib64/libpopt.so.0.0.1 2023-11-05T08:43:31.378 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 774 gssproxy root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-05T08:43:31.378 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 774 gssproxy root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-05T08:43:31.378 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 774 gssproxy root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-05T08:43:31.378 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 774 gssproxy root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-05T08:43:31.378 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 774 gssproxy root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-05T08:43:31.379 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 774 gssproxy root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-05T08:43:31.379 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 774 gssproxy root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:31.379 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 774 gssproxy root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-05T08:43:31.379 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 774 gssproxy root 0r CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.379 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 774 gssproxy root 1u unix 0xffff8da307d8fb40 0t0 22987 type=STREAM (CONNECTED) 2023-11-05T08:43:31.380 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 774 gssproxy root 2u unix 0xffff8da307d8fb40 0t0 22987 type=STREAM (CONNECTED) 2023-11-05T08:43:31.380 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 774 gssproxy root 3u unix 0xffff8da318b39980 0t0 16058 type=DGRAM (CONNECTED) 2023-11-05T08:43:31.380 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 774 gssproxy root 4r FIFO 0,13 0t0 16063 pipe 2023-11-05T08:43:31.380 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 774 gssproxy root 5u a_inode 0,14 0 1084 [eventpoll:4,6,7,8] 2023-11-05T08:43:31.380 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 774 gssproxy root 6u a_inode 0,14 0 1084 [eventfd:16] 2023-11-05T08:43:31.380 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 774 gssproxy root 7u unix 0xffff8da318370000 0t0 16059 /var/lib/gssproxy/default.sock type=STREAM (LISTEN) 2023-11-05T08:43:31.381 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 774 gssproxy root 8u unix 0xffff8da318375940 0t0 16060 /run/gssproxy.sock type=STREAM (LISTEN) 2023-11-05T08:43:31.381 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 774 gssproxy root 9w FIFO 0,13 0t0 16063 pipe 2023-11-05T08:43:31.381 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 775 gssproxy root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.382 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 775 gssproxy root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.382 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 775 gssproxy root txt REG 8,1 127680 15021 /usr/sbin/gssproxy 2023-11-05T08:43:31.382 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 775 gssproxy root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-05T08:43:31.382 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 775 gssproxy root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:31.382 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 775 gssproxy root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-05T08:43:31.383 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 775 gssproxy root mem REG 8,1 70960 15011 /usr/lib64/libev.so.4.0.0 2023-11-05T08:43:31.383 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 775 gssproxy root mem REG 8,1 16168 15018 /usr/lib64/libverto-libev.so.1.0.0 2023-11-05T08:43:31.383 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 775 gssproxy root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-05T08:43:31.383 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 775 gssproxy root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:31.383 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 775 gssproxy root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:31.383 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 775 gssproxy root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-05T08:43:31.384 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 775 gssproxy root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-05T08:43:31.384 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 775 gssproxy root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-05T08:43:31.384 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 775 gssproxy root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-05T08:43:31.384 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 775 gssproxy root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:31.384 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 775 gssproxy root mem REG 8,1 15912 9764 /usr/lib64/libbasicobjects.so.0.1.0 2023-11-05T08:43:31.385 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 775 gssproxy root mem REG 8,1 20304 9968 /usr/lib64/libpath_utils.so.1.0.1 2023-11-05T08:43:31.385 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 775 gssproxy root mem REG 8,1 58392 9766 /usr/lib64/libcollection.so.4.1.1 2023-11-05T08:43:31.385 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 775 gssproxy root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-05T08:43:31.385 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 775 gssproxy root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-05T08:43:31.385 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 775 gssproxy root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-05T08:43:31.386 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 775 gssproxy root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-05T08:43:31.386 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 775 gssproxy root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-05T08:43:31.386 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 775 gssproxy root mem REG 8,1 142168 11395 /usr/lib64/libgssrpc.so.4.2 2023-11-05T08:43:31.386 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 775 gssproxy root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:31.386 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 775 gssproxy root mem REG 8,1 16056 9768 /usr/lib64/libref_array.so.1.2.1 2023-11-05T08:43:31.386 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 775 gssproxy root mem REG 8,1 120640 9970 /usr/lib64/libini_config.so.5.2.1 2023-11-05T08:43:31.387 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 775 gssproxy root mem REG 8,1 28472 11392 /usr/lib64/libverto.so.1.0.0 2023-11-05T08:43:31.387 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 775 gssproxy root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-05T08:43:31.387 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 775 gssproxy root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-05T08:43:31.387 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 775 gssproxy root mem REG 8,1 58368 9689 /usr/lib64/libpopt.so.0.0.1 2023-11-05T08:43:31.387 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 775 gssproxy root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-05T08:43:31.388 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 775 gssproxy root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-05T08:43:31.388 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 775 gssproxy root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-05T08:43:31.388 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 775 gssproxy root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-05T08:43:31.388 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 775 gssproxy root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-05T08:43:31.388 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 775 gssproxy root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-05T08:43:31.388 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 775 gssproxy root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:31.389 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 775 gssproxy root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-05T08:43:31.389 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 775 gssproxy root 0r CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.389 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 775 gssproxy root 1u unix 0xffff8da307d8fb40 0t0 22987 type=STREAM (CONNECTED) 2023-11-05T08:43:31.389 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 775 gssproxy root 2u unix 0xffff8da307d8fb40 0t0 22987 type=STREAM (CONNECTED) 2023-11-05T08:43:31.389 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 775 gssproxy root 3u unix 0xffff8da318b39980 0t0 16058 type=DGRAM (CONNECTED) 2023-11-05T08:43:31.390 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 775 gssproxy root 4r FIFO 0,13 0t0 16063 pipe 2023-11-05T08:43:31.390 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 775 gssproxy root 5u a_inode 0,14 0 1084 [eventpoll:4,6,7,8] 2023-11-05T08:43:31.390 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 775 gssproxy root 6u a_inode 0,14 0 1084 [eventfd:16] 2023-11-05T08:43:31.390 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 775 gssproxy root 7u unix 0xffff8da318370000 0t0 16059 /var/lib/gssproxy/default.sock type=STREAM (LISTEN) 2023-11-05T08:43:31.390 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 775 gssproxy root 8u unix 0xffff8da318375940 0t0 16060 /run/gssproxy.sock type=STREAM (LISTEN) 2023-11-05T08:43:31.390 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 775 gssproxy root 9w FIFO 0,13 0t0 16063 pipe 2023-11-05T08:43:31.391 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 776 gssproxy root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.391 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 776 gssproxy root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.391 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 776 gssproxy root txt REG 8,1 127680 15021 /usr/sbin/gssproxy 2023-11-05T08:43:31.391 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 776 gssproxy root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-05T08:43:31.392 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 776 gssproxy root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:31.392 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 776 gssproxy root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-05T08:43:31.392 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 776 gssproxy root mem REG 8,1 70960 15011 /usr/lib64/libev.so.4.0.0 2023-11-05T08:43:31.392 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 776 gssproxy root mem REG 8,1 16168 15018 /usr/lib64/libverto-libev.so.1.0.0 2023-11-05T08:43:31.392 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 776 gssproxy root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-05T08:43:31.393 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 776 gssproxy root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:31.393 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 776 gssproxy root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:31.393 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 776 gssproxy root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-05T08:43:31.393 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 776 gssproxy root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-05T08:43:31.393 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 776 gssproxy root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-05T08:43:31.394 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 776 gssproxy root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-05T08:43:31.394 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 776 gssproxy root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:31.394 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 776 gssproxy root mem REG 8,1 15912 9764 /usr/lib64/libbasicobjects.so.0.1.0 2023-11-05T08:43:31.394 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 776 gssproxy root mem REG 8,1 20304 9968 /usr/lib64/libpath_utils.so.1.0.1 2023-11-05T08:43:31.394 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 776 gssproxy root mem REG 8,1 58392 9766 /usr/lib64/libcollection.so.4.1.1 2023-11-05T08:43:31.394 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 776 gssproxy root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-05T08:43:31.395 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 776 gssproxy root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-05T08:43:31.395 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 776 gssproxy root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-05T08:43:31.395 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 776 gssproxy root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-05T08:43:31.395 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 776 gssproxy root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-05T08:43:31.395 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 776 gssproxy root mem REG 8,1 142168 11395 /usr/lib64/libgssrpc.so.4.2 2023-11-05T08:43:31.396 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 776 gssproxy root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:31.396 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 776 gssproxy root mem REG 8,1 16056 9768 /usr/lib64/libref_array.so.1.2.1 2023-11-05T08:43:31.396 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 776 gssproxy root mem REG 8,1 120640 9970 /usr/lib64/libini_config.so.5.2.1 2023-11-05T08:43:31.396 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 776 gssproxy root mem REG 8,1 28472 11392 /usr/lib64/libverto.so.1.0.0 2023-11-05T08:43:31.396 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 776 gssproxy root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-05T08:43:31.397 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 776 gssproxy root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-05T08:43:31.397 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 776 gssproxy root mem REG 8,1 58368 9689 /usr/lib64/libpopt.so.0.0.1 2023-11-05T08:43:31.397 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 776 gssproxy root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-05T08:43:31.397 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 776 gssproxy root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-05T08:43:31.397 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 776 gssproxy root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-05T08:43:31.398 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 776 gssproxy root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-05T08:43:31.398 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 776 gssproxy root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-05T08:43:31.398 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 776 gssproxy root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-05T08:43:31.398 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 776 gssproxy root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:31.398 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 776 gssproxy root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-05T08:43:31.398 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 776 gssproxy root 0r CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.399 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 776 gssproxy root 1u unix 0xffff8da307d8fb40 0t0 22987 type=STREAM (CONNECTED) 2023-11-05T08:43:31.399 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 776 gssproxy root 2u unix 0xffff8da307d8fb40 0t0 22987 type=STREAM (CONNECTED) 2023-11-05T08:43:31.399 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 776 gssproxy root 3u unix 0xffff8da318b39980 0t0 16058 type=DGRAM (CONNECTED) 2023-11-05T08:43:31.399 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 776 gssproxy root 4r FIFO 0,13 0t0 16063 pipe 2023-11-05T08:43:31.399 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 776 gssproxy root 5u a_inode 0,14 0 1084 [eventpoll:4,6,7,8] 2023-11-05T08:43:31.400 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 776 gssproxy root 6u a_inode 0,14 0 1084 [eventfd:16] 2023-11-05T08:43:31.400 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 776 gssproxy root 7u unix 0xffff8da318370000 0t0 16059 /var/lib/gssproxy/default.sock type=STREAM (LISTEN) 2023-11-05T08:43:31.400 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 776 gssproxy root 8u unix 0xffff8da318375940 0t0 16060 /run/gssproxy.sock type=STREAM (LISTEN) 2023-11-05T08:43:31.400 INFO:teuthology.orchestra.run.smithi156.stdout:gssproxy 771 776 gssproxy root 9w FIFO 0,13 0t0 16063 pipe 2023-11-05T08:43:31.400 INFO:teuthology.orchestra.run.smithi156.stdout:atd 778 root cwd DIR 8,1 4096 1657 /var/spool/at 2023-11-05T08:43:31.401 INFO:teuthology.orchestra.run.smithi156.stdout:atd 778 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.401 INFO:teuthology.orchestra.run.smithi156.stdout:atd 778 root txt REG 8,1 32680 12473 /usr/sbin/atd 2023-11-05T08:43:31.401 INFO:teuthology.orchestra.run.smithi156.stdout:atd 778 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-05T08:43:31.401 INFO:teuthology.orchestra.run.smithi156.stdout:atd 778 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:31.401 INFO:teuthology.orchestra.run.smithi156.stdout:atd 778 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:31.401 INFO:teuthology.orchestra.run.smithi156.stdout:atd 778 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:31.402 INFO:teuthology.orchestra.run.smithi156.stdout:atd 778 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-05T08:43:31.402 INFO:teuthology.orchestra.run.smithi156.stdout:atd 778 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-05T08:43:31.402 INFO:teuthology.orchestra.run.smithi156.stdout:atd 778 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:31.402 INFO:teuthology.orchestra.run.smithi156.stdout:atd 778 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-05T08:43:31.402 INFO:teuthology.orchestra.run.smithi156.stdout:atd 778 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:31.403 INFO:teuthology.orchestra.run.smithi156.stdout:atd 778 root 0u CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.403 INFO:teuthology.orchestra.run.smithi156.stdout:atd 778 root 1u CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.403 INFO:teuthology.orchestra.run.smithi156.stdout:atd 778 root 2u CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.403 INFO:teuthology.orchestra.run.smithi156.stdout:atd 778 root 3uW REG 0,24 4 1181 /run/atd.pid 2023-11-05T08:43:31.403 INFO:teuthology.orchestra.run.smithi156.stdout:crond 779 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.403 INFO:teuthology.orchestra.run.smithi156.stdout:crond 779 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.404 INFO:teuthology.orchestra.run.smithi156.stdout:crond 779 root txt REG 8,1 74552 11234 /usr/sbin/crond 2023-11-05T08:43:31.404 INFO:teuthology.orchestra.run.smithi156.stdout:crond 779 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-05T08:43:31.404 INFO:teuthology.orchestra.run.smithi156.stdout:crond 779 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-05T08:43:31.404 INFO:teuthology.orchestra.run.smithi156.stdout:crond 779 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:31.404 INFO:teuthology.orchestra.run.smithi156.stdout:crond 779 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-05T08:43:31.405 INFO:teuthology.orchestra.run.smithi156.stdout:crond 779 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-05T08:43:31.405 INFO:teuthology.orchestra.run.smithi156.stdout:crond 779 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-05T08:43:31.405 INFO:teuthology.orchestra.run.smithi156.stdout:crond 779 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-05T08:43:31.405 INFO:teuthology.orchestra.run.smithi156.stdout:crond 779 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-05T08:43:31.405 INFO:teuthology.orchestra.run.smithi156.stdout:crond 779 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:31.406 INFO:teuthology.orchestra.run.smithi156.stdout:crond 779 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-05T08:43:31.406 INFO:teuthology.orchestra.run.smithi156.stdout:crond 779 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:31.406 INFO:teuthology.orchestra.run.smithi156.stdout:crond 779 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-05T08:43:31.406 INFO:teuthology.orchestra.run.smithi156.stdout:crond 779 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-05T08:43:31.406 INFO:teuthology.orchestra.run.smithi156.stdout:crond 779 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:31.407 INFO:teuthology.orchestra.run.smithi156.stdout:crond 779 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-05T08:43:31.407 INFO:teuthology.orchestra.run.smithi156.stdout:crond 779 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-05T08:43:31.407 INFO:teuthology.orchestra.run.smithi156.stdout:crond 779 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-05T08:43:31.407 INFO:teuthology.orchestra.run.smithi156.stdout:crond 779 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-05T08:43:31.407 INFO:teuthology.orchestra.run.smithi156.stdout:crond 779 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-05T08:43:31.407 INFO:teuthology.orchestra.run.smithi156.stdout:crond 779 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-05T08:43:31.408 INFO:teuthology.orchestra.run.smithi156.stdout:crond 779 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:31.408 INFO:teuthology.orchestra.run.smithi156.stdout:crond 779 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-05T08:43:31.408 INFO:teuthology.orchestra.run.smithi156.stdout:crond 779 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.408 INFO:teuthology.orchestra.run.smithi156.stdout:crond 779 root 1u unix 0xffff8da31832dd80 0t0 20114 type=STREAM (CONNECTED) 2023-11-05T08:43:31.408 INFO:teuthology.orchestra.run.smithi156.stdout:crond 779 root 2u unix 0xffff8da31832dd80 0t0 20114 type=STREAM (CONNECTED) 2023-11-05T08:43:31.409 INFO:teuthology.orchestra.run.smithi156.stdout:crond 779 root 3uW REG 0,24 4 1182 /run/crond.pid 2023-11-05T08:43:31.409 INFO:teuthology.orchestra.run.smithi156.stdout:crond 779 root 4u unix 0xffff8da318335d80 0t0 20117 type=DGRAM (CONNECTED) 2023-11-05T08:43:31.409 INFO:teuthology.orchestra.run.smithi156.stdout:crond 779 root 5r a_inode 0,14 0 1084 inotify 2023-11-05T08:43:31.409 INFO:teuthology.orchestra.run.smithi156.stdout:nrpe 873 nrpe cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.409 INFO:teuthology.orchestra.run.smithi156.stdout:nrpe 873 nrpe rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.410 INFO:teuthology.orchestra.run.smithi156.stdout:nrpe 873 nrpe txt REG 8,1 80984 12959 /usr/sbin/nrpe 2023-11-05T08:43:31.410 INFO:teuthology.orchestra.run.smithi156.stdout:nrpe 873 nrpe mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:31.410 INFO:teuthology.orchestra.run.smithi156.stdout:nrpe 873 nrpe mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-05T08:43:31.410 INFO:teuthology.orchestra.run.smithi156.stdout:nrpe 873 nrpe mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:31.410 INFO:teuthology.orchestra.run.smithi156.stdout:nrpe 873 nrpe mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-05T08:43:31.410 INFO:teuthology.orchestra.run.smithi156.stdout:nrpe 873 nrpe mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:31.411 INFO:teuthology.orchestra.run.smithi156.stdout:nrpe 873 nrpe 0r CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.411 INFO:teuthology.orchestra.run.smithi156.stdout:nrpe 873 nrpe 1w CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.411 INFO:teuthology.orchestra.run.smithi156.stdout:nrpe 873 nrpe 2w CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.411 INFO:teuthology.orchestra.run.smithi156.stdout:nrpe 873 nrpe 3u IPv4 18820 0t0 TCP *:nrpe (LISTEN) 2023-11-05T08:43:31.411 INFO:teuthology.orchestra.run.smithi156.stdout:nrpe 873 nrpe 4u unix 0xffff8da307b2c400 0t0 18812 type=DGRAM (CONNECTED) 2023-11-05T08:43:31.412 INFO:teuthology.orchestra.run.smithi156.stdout:nrpe 873 nrpe 5u IPv6 18821 0t0 TCP *:nrpe (LISTEN) 2023-11-05T08:43:31.412 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1183 ubuntu cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.412 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1183 ubuntu rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.412 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1183 ubuntu txt REG 8,1 102120 20353 /usr/lib/systemd/systemd 2023-11-05T08:43:31.412 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1183 ubuntu DEL REG 8,1 1167 /etc/selinux/targeted/contexts/files/file_contexts.bin 2023-11-05T08:43:31.413 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1183 ubuntu mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:31.413 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1183 ubuntu mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:31.413 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1183 ubuntu mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-05T08:43:31.413 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1183 ubuntu mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-05T08:43:31.413 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1183 ubuntu DEL REG 8,1 1696 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2023-11-05T08:43:31.413 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1183 ubuntu mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-05T08:43:31.414 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1183 ubuntu mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-05T08:43:31.414 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1183 ubuntu mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:31.414 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1183 ubuntu mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-05T08:43:31.414 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1183 ubuntu mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-05T08:43:31.414 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1183 ubuntu mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:31.415 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1183 ubuntu mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-05T08:43:31.415 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1183 ubuntu mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-05T08:43:31.415 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1183 ubuntu mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-05T08:43:31.415 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1183 ubuntu mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-05T08:43:31.415 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1183 ubuntu mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-05T08:43:31.415 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1183 ubuntu mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:31.416 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1183 ubuntu mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-05T08:43:31.416 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1183 ubuntu mem REG 8,1 3645472 49253 /usr/lib64/systemd/libsystemd-shared-252.so 2023-11-05T08:43:31.416 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1183 ubuntu mem REG 8,1 28552 9804 /usr/lib64/libattr.so.1.1.2501 2023-11-05T08:43:31.416 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1183 ubuntu mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-05T08:43:31.416 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1183 ubuntu mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:31.417 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1183 ubuntu mem REG 8,1 107424 10180 /usr/lib64/libkmod.so.2.3.6 2023-11-05T08:43:31.417 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1183 ubuntu mem REG 8,1 2174088 49251 /usr/lib64/systemd/libsystemd-core-252.so 2023-11-05T08:43:31.417 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1183 ubuntu mem REG 8,1 41120 9806 /usr/lib64/libacl.so.1.1.2301 2023-11-05T08:43:31.417 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1183 ubuntu mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-05T08:43:31.417 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1183 ubuntu mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-05T08:43:31.417 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1183 ubuntu mem REG 8,1 127680 9972 /usr/lib64/libseccomp.so.2.5.2 2023-11-05T08:43:31.418 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1183 ubuntu mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:31.418 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1183 ubuntu mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:31.418 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1183 ubuntu mem REG 0,19 0 19 /sys/fs/selinux/status 2023-11-05T08:43:31.418 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1183 ubuntu 0r CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.418 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1183 ubuntu 1u unix 0xffff8da31891f700 0t0 22000 type=STREAM (CONNECTED) 2023-11-05T08:43:31.419 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1183 ubuntu 2u unix 0xffff8da31891f700 0t0 22000 type=STREAM (CONNECTED) 2023-11-05T08:43:31.419 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1183 ubuntu 3u unix 0xffff8da318926600 0t0 22028 type=DGRAM (CONNECTED) 2023-11-05T08:43:31.419 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1183 ubuntu 4u a_inode 0,14 0 1084 [eventpoll:5,6,8,9,11,12,14,15,16,17,19,20,21] 2023-11-05T08:43:31.419 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1183 ubuntu 5u a_inode 0,14 0 1084 [signalfd] 2023-11-05T08:43:31.419 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1183 ubuntu 6r a_inode 0,14 0 1084 inotify 2023-11-05T08:43:31.420 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1183 ubuntu 7r DIR 0,25 0 3211 /sys/fs/cgroup/user.slice/user-1000.slice/user@1000.service 2023-11-05T08:43:31.420 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1183 ubuntu 8u a_inode 0,14 0 1084 [timerfd] 2023-11-05T08:43:31.420 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1183 ubuntu 9u a_inode 0,14 0 1084 [eventpoll:10,13] 2023-11-05T08:43:31.420 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1183 ubuntu 10r REG 0,20 0 22017 /proc/1183/mountinfo 2023-11-05T08:43:31.420 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1183 ubuntu 11r a_inode 0,14 0 1084 inotify 2023-11-05T08:43:31.420 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1183 ubuntu 12u unix 0xffff8da31886b740 0t0 16627 /run/user/1000/bus type=STREAM (LISTEN) 2023-11-05T08:43:31.421 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1183 ubuntu 13r a_inode 0,14 0 1084 inotify 2023-11-05T08:43:31.421 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1183 ubuntu 14r REG 0,20 0 4026532076 /proc/swaps 2023-11-05T08:43:31.421 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1183 ubuntu 15u netlink 0t0 20273 KOBJECT_UEVENT 2023-11-05T08:43:31.421 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1183 ubuntu 16u unix 0xffff8da31887b300 0t0 16614 /run/user/1000/systemd/notify type=DGRAM (UNCONNECTED) 2023-11-05T08:43:31.421 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1183 ubuntu 17u unix 0xffff8da31887f700 0t0 16615 type=DGRAM (CONNECTED) 2023-11-05T08:43:31.422 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1183 ubuntu 18u unix 0xffff8da31887d500 0t0 16616 type=DGRAM (CONNECTED) 2023-11-05T08:43:31.422 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1183 ubuntu 19u unix 0xffff8da318868440 0t0 16617 /run/user/1000/systemd/private type=STREAM (LISTEN) 2023-11-05T08:43:31.422 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1183 ubuntu 20u unix 0xffff8da318869dc0 0t0 16619 type=STREAM (CONNECTED) 2023-11-05T08:43:31.422 INFO:teuthology.orchestra.run.smithi156.stdout:systemd 1183 ubuntu 21u a_inode 0,14 0 1084 [timerfd] 2023-11-05T08:43:31.422 INFO:teuthology.orchestra.run.smithi156.stdout:(sd-pam) 1186 ubuntu cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.422 INFO:teuthology.orchestra.run.smithi156.stdout:(sd-pam) 1186 ubuntu rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.423 INFO:teuthology.orchestra.run.smithi156.stdout:(sd-pam) 1186 ubuntu txt REG 8,1 102120 20353 /usr/lib/systemd/systemd 2023-11-05T08:43:31.423 INFO:teuthology.orchestra.run.smithi156.stdout:(sd-pam) 1186 ubuntu mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2023-11-05T08:43:31.423 INFO:teuthology.orchestra.run.smithi156.stdout:(sd-pam) 1186 ubuntu mem REG 8,1 14928 32270 /usr/lib64/security/pam_deny.so 2023-11-05T08:43:31.423 INFO:teuthology.orchestra.run.smithi156.stdout:(sd-pam) 1186 ubuntu mem REG 8,1 19600 10967 /usr/lib64/libpam_misc.so.0.82.1 2023-11-05T08:43:31.423 INFO:teuthology.orchestra.run.smithi156.stdout:(sd-pam) 1186 ubuntu mem REG 8,1 19400 32305 /usr/lib64/security/pam_succeed_if.so 2023-11-05T08:43:31.424 INFO:teuthology.orchestra.run.smithi156.stdout:(sd-pam) 1186 ubuntu mem REG 8,1 514280 32422 /usr/lib64/security/pam_systemd.so 2023-11-05T08:43:31.424 INFO:teuthology.orchestra.run.smithi156.stdout:(sd-pam) 1186 ubuntu mem REG 8,1 27536 32284 /usr/lib64/security/pam_limits.so 2023-11-05T08:43:31.424 INFO:teuthology.orchestra.run.smithi156.stdout:(sd-pam) 1186 ubuntu mem REG 8,1 44152 32291 /usr/lib64/security/pam_namespace.so 2023-11-05T08:43:31.424 INFO:teuthology.orchestra.run.smithi156.stdout:(sd-pam) 1186 ubuntu mem REG 8,1 15184 32309 /usr/lib64/security/pam_umask.so 2023-11-05T08:43:31.424 INFO:teuthology.orchestra.run.smithi156.stdout:(sd-pam) 1186 ubuntu mem REG 8,1 15352 32282 /usr/lib64/security/pam_keyinit.so 2023-11-05T08:43:31.424 INFO:teuthology.orchestra.run.smithi156.stdout:(sd-pam) 1186 ubuntu mem REG 8,1 15240 32287 /usr/lib64/security/pam_loginuid.so 2023-11-05T08:43:31.425 INFO:teuthology.orchestra.run.smithi156.stdout:(sd-pam) 1186 ubuntu mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:31.425 INFO:teuthology.orchestra.run.smithi156.stdout:(sd-pam) 1186 ubuntu mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-05T08:43:31.425 INFO:teuthology.orchestra.run.smithi156.stdout:(sd-pam) 1186 ubuntu mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-05T08:43:31.425 INFO:teuthology.orchestra.run.smithi156.stdout:(sd-pam) 1186 ubuntu mem REG 8,1 27616 32299 /usr/lib64/security/pam_selinux.so 2023-11-05T08:43:31.425 INFO:teuthology.orchestra.run.smithi156.stdout:(sd-pam) 1186 ubuntu DEL REG 8,1 63926 /etc/selinux/targeted/contexts/files/file_contexts.bin 2023-11-05T08:43:31.426 INFO:teuthology.orchestra.run.smithi156.stdout:(sd-pam) 1186 ubuntu mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-05T08:43:31.426 INFO:teuthology.orchestra.run.smithi156.stdout:(sd-pam) 1186 ubuntu mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:31.426 INFO:teuthology.orchestra.run.smithi156.stdout:(sd-pam) 1186 ubuntu mem REG 8,1 56712 32310 /usr/lib64/security/pam_unix.so 2023-11-05T08:43:31.426 INFO:teuthology.orchestra.run.smithi156.stdout:(sd-pam) 1186 ubuntu mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:31.426 INFO:teuthology.orchestra.run.smithi156.stdout:(sd-pam) 1186 ubuntu mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-05T08:43:31.426 INFO:teuthology.orchestra.run.smithi156.stdout:(sd-pam) 1186 ubuntu mem REG 8,1 3645472 49253 /usr/lib64/systemd/libsystemd-shared-252.so 2023-11-05T08:43:31.427 INFO:teuthology.orchestra.run.smithi156.stdout:(sd-pam) 1186 ubuntu mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-05T08:43:31.427 INFO:teuthology.orchestra.run.smithi156.stdout:(sd-pam) 1186 ubuntu mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-05T08:43:31.427 INFO:teuthology.orchestra.run.smithi156.stdout:(sd-pam) 1186 ubuntu mem REG 8,1 28552 9804 /usr/lib64/libattr.so.1.1.2501 2023-11-05T08:43:31.427 INFO:teuthology.orchestra.run.smithi156.stdout:(sd-pam) 1186 ubuntu mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:31.427 INFO:teuthology.orchestra.run.smithi156.stdout:(sd-pam) 1186 ubuntu mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-05T08:43:31.428 INFO:teuthology.orchestra.run.smithi156.stdout:(sd-pam) 1186 ubuntu mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-05T08:43:31.428 INFO:teuthology.orchestra.run.smithi156.stdout:(sd-pam) 1186 ubuntu mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-05T08:43:31.428 INFO:teuthology.orchestra.run.smithi156.stdout:(sd-pam) 1186 ubuntu mem REG 8,1 2174088 49251 /usr/lib64/systemd/libsystemd-core-252.so 2023-11-05T08:43:31.428 INFO:teuthology.orchestra.run.smithi156.stdout:(sd-pam) 1186 ubuntu mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-05T08:43:31.428 INFO:teuthology.orchestra.run.smithi156.stdout:(sd-pam) 1186 ubuntu mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-05T08:43:31.429 INFO:teuthology.orchestra.run.smithi156.stdout:(sd-pam) 1186 ubuntu mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:31.429 INFO:teuthology.orchestra.run.smithi156.stdout:(sd-pam) 1186 ubuntu mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-05T08:43:31.429 INFO:teuthology.orchestra.run.smithi156.stdout:(sd-pam) 1186 ubuntu mem REG 8,1 41120 9806 /usr/lib64/libacl.so.1.1.2301 2023-11-05T08:43:31.429 INFO:teuthology.orchestra.run.smithi156.stdout:(sd-pam) 1186 ubuntu mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-05T08:43:31.429 INFO:teuthology.orchestra.run.smithi156.stdout:(sd-pam) 1186 ubuntu mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:31.429 INFO:teuthology.orchestra.run.smithi156.stdout:(sd-pam) 1186 ubuntu mem REG 8,1 107424 10180 /usr/lib64/libkmod.so.2.3.6 2023-11-05T08:43:31.430 INFO:teuthology.orchestra.run.smithi156.stdout:(sd-pam) 1186 ubuntu mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-05T08:43:31.430 INFO:teuthology.orchestra.run.smithi156.stdout:(sd-pam) 1186 ubuntu mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-05T08:43:31.430 INFO:teuthology.orchestra.run.smithi156.stdout:(sd-pam) 1186 ubuntu mem REG 8,1 127680 9972 /usr/lib64/libseccomp.so.2.5.2 2023-11-05T08:43:31.430 INFO:teuthology.orchestra.run.smithi156.stdout:(sd-pam) 1186 ubuntu mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:31.430 INFO:teuthology.orchestra.run.smithi156.stdout:(sd-pam) 1186 ubuntu DEL REG 8,1 63928 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2023-11-05T08:43:31.431 INFO:teuthology.orchestra.run.smithi156.stdout:(sd-pam) 1186 ubuntu mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:31.431 INFO:teuthology.orchestra.run.smithi156.stdout:(sd-pam) 1186 ubuntu mem REG 0,19 0 19 /sys/fs/selinux/status 2023-11-05T08:43:31.431 INFO:teuthology.orchestra.run.smithi156.stdout:(sd-pam) 1186 ubuntu 0r CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.431 INFO:teuthology.orchestra.run.smithi156.stdout:(sd-pam) 1186 ubuntu 1u unix 0xffff8da31891f700 0t0 22000 type=STREAM (CONNECTED) 2023-11-05T08:43:31.431 INFO:teuthology.orchestra.run.smithi156.stdout:(sd-pam) 1186 ubuntu 2u unix 0xffff8da31891f700 0t0 22000 type=STREAM (CONNECTED) 2023-11-05T08:43:31.431 INFO:teuthology.orchestra.run.smithi156.stdout:(sd-pam) 1186 ubuntu 3u a_inode 0,14 0 1084 [eventfd:13] 2023-11-05T08:43:31.432 INFO:teuthology.orchestra.run.smithi156.stdout:(sd-pam) 1186 ubuntu 4u a_inode 0,14 0 1084 [eventfd:14] 2023-11-05T08:43:31.432 INFO:teuthology.orchestra.run.smithi156.stdout:(sd-pam) 1186 ubuntu 6w FIFO 0,13 0t0 22004 pipe 2023-11-05T08:43:31.432 INFO:teuthology.orchestra.run.smithi156.stdout:(sd-pam) 1186 ubuntu 7u unix 0xffff8da318922640 0t0 22020 type=DGRAM (CONNECTED) 2023-11-05T08:43:31.432 INFO:teuthology.orchestra.run.smithi156.stdout:agetty 1311 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.432 INFO:teuthology.orchestra.run.smithi156.stdout:agetty 1311 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.433 INFO:teuthology.orchestra.run.smithi156.stdout:agetty 1311 root txt REG 8,1 58072 13690 /usr/sbin/agetty 2023-11-05T08:43:31.433 INFO:teuthology.orchestra.run.smithi156.stdout:agetty 1311 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:31.433 INFO:teuthology.orchestra.run.smithi156.stdout:agetty 1311 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-05T08:43:31.433 INFO:teuthology.orchestra.run.smithi156.stdout:agetty 1311 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-05T08:43:31.433 INFO:teuthology.orchestra.run.smithi156.stdout:agetty 1311 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:31.434 INFO:teuthology.orchestra.run.smithi156.stdout:agetty 1311 root 0u CHR 4,1 0t0 20 /dev/tty1 2023-11-05T08:43:31.434 INFO:teuthology.orchestra.run.smithi156.stdout:agetty 1311 root 1u CHR 4,1 0t0 20 /dev/tty1 2023-11-05T08:43:31.434 INFO:teuthology.orchestra.run.smithi156.stdout:agetty 1311 root 2u CHR 4,1 0t0 20 /dev/tty1 2023-11-05T08:43:31.434 INFO:teuthology.orchestra.run.smithi156.stdout:agetty 1311 root 4r a_inode 0,14 0 1084 inotify 2023-11-05T08:43:31.434 INFO:teuthology.orchestra.run.smithi156.stdout:agetty 1312 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.434 INFO:teuthology.orchestra.run.smithi156.stdout:agetty 1312 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.435 INFO:teuthology.orchestra.run.smithi156.stdout:agetty 1312 root txt REG 8,1 58072 13690 /usr/sbin/agetty 2023-11-05T08:43:31.435 INFO:teuthology.orchestra.run.smithi156.stdout:agetty 1312 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-05T08:43:31.435 INFO:teuthology.orchestra.run.smithi156.stdout:agetty 1312 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:31.435 INFO:teuthology.orchestra.run.smithi156.stdout:agetty 1312 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-05T08:43:31.435 INFO:teuthology.orchestra.run.smithi156.stdout:agetty 1312 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-05T08:43:31.436 INFO:teuthology.orchestra.run.smithi156.stdout:agetty 1312 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-05T08:43:31.436 INFO:teuthology.orchestra.run.smithi156.stdout:agetty 1312 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-05T08:43:31.436 INFO:teuthology.orchestra.run.smithi156.stdout:agetty 1312 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-05T08:43:31.436 INFO:teuthology.orchestra.run.smithi156.stdout:agetty 1312 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-05T08:43:31.436 INFO:teuthology.orchestra.run.smithi156.stdout:agetty 1312 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-05T08:43:31.437 INFO:teuthology.orchestra.run.smithi156.stdout:agetty 1312 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-05T08:43:31.437 INFO:teuthology.orchestra.run.smithi156.stdout:agetty 1312 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-05T08:43:31.437 INFO:teuthology.orchestra.run.smithi156.stdout:agetty 1312 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-05T08:43:31.437 INFO:teuthology.orchestra.run.smithi156.stdout:agetty 1312 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-05T08:43:31.437 INFO:teuthology.orchestra.run.smithi156.stdout:agetty 1312 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:31.438 INFO:teuthology.orchestra.run.smithi156.stdout:agetty 1312 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-05T08:43:31.438 INFO:teuthology.orchestra.run.smithi156.stdout:agetty 1312 root 0u CHR 4,65 0t0 114 /dev/ttyS1 2023-11-05T08:43:31.438 INFO:teuthology.orchestra.run.smithi156.stdout:agetty 1312 root 1u CHR 4,65 0t0 114 /dev/ttyS1 2023-11-05T08:43:31.438 INFO:teuthology.orchestra.run.smithi156.stdout:agetty 1312 root 2u CHR 4,65 0t0 114 /dev/ttyS1 2023-11-05T08:43:31.438 INFO:teuthology.orchestra.run.smithi156.stdout:agetty 1312 root 4r a_inode 0,14 0 1084 inotify 2023-11-05T08:43:31.439 INFO:teuthology.orchestra.run.smithi156.stdout:rsyslogd 4979 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.439 INFO:teuthology.orchestra.run.smithi156.stdout:rsyslogd 4979 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.439 INFO:teuthology.orchestra.run.smithi156.stdout:rsyslogd 4979 root txt REG 8,1 769928 12237 /usr/sbin/rsyslogd 2023-11-05T08:43:31.439 INFO:teuthology.orchestra.run.smithi156.stdout:rsyslogd 4979 root mem REG 0,24 8388608 58 /run/log/journal/15949e3c88704300882482eddfd7baae/system.journal 2023-11-05T08:43:31.439 INFO:teuthology.orchestra.run.smithi156.stdout:rsyslogd 4979 root mem REG 8,1 33592 12207 /usr/lib64/rsyslog/imjournal.so 2023-11-05T08:43:31.439 INFO:teuthology.orchestra.run.smithi156.stdout:rsyslogd 4979 root mem REG 8,1 42248 12214 /usr/lib64/rsyslog/imuxsock.so 2023-11-05T08:43:31.440 INFO:teuthology.orchestra.run.smithi156.stdout:rsyslogd 4979 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-05T08:43:31.440 INFO:teuthology.orchestra.run.smithi156.stdout:rsyslogd 4979 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-05T08:43:31.440 INFO:teuthology.orchestra.run.smithi156.stdout:rsyslogd 4979 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-05T08:43:31.440 INFO:teuthology.orchestra.run.smithi156.stdout:rsyslogd 4979 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:31.440 INFO:teuthology.orchestra.run.smithi156.stdout:rsyslogd 4979 root mem REG 8,1 32808 12215 /usr/lib64/rsyslog/lmnet.so 2023-11-05T08:43:31.441 INFO:teuthology.orchestra.run.smithi156.stdout:rsyslogd 4979 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-05T08:43:31.441 INFO:teuthology.orchestra.run.smithi156.stdout:rsyslogd 4979 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-05T08:43:31.441 INFO:teuthology.orchestra.run.smithi156.stdout:rsyslogd 4979 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:31.441 INFO:teuthology.orchestra.run.smithi156.stdout:rsyslogd 4979 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:31.441 INFO:teuthology.orchestra.run.smithi156.stdout:rsyslogd 4979 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-05T08:43:31.441 INFO:teuthology.orchestra.run.smithi156.stdout:rsyslogd 4979 root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-05T08:43:31.442 INFO:teuthology.orchestra.run.smithi156.stdout:rsyslogd 4979 root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-05T08:43:31.442 INFO:teuthology.orchestra.run.smithi156.stdout:rsyslogd 4979 root mem REG 8,1 52856 12201 /usr/lib64/libfastjson.so.4.3.0 2023-11-05T08:43:31.442 INFO:teuthology.orchestra.run.smithi156.stdout:rsyslogd 4979 root mem REG 8,1 16032 12200 /usr/lib64/libestr.so.0.0.0 2023-11-05T08:43:31.442 INFO:teuthology.orchestra.run.smithi156.stdout:rsyslogd 4979 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:31.442 INFO:teuthology.orchestra.run.smithi156.stdout:rsyslogd 4979 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:31.443 INFO:teuthology.orchestra.run.smithi156.stdout:rsyslogd 4979 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.443 INFO:teuthology.orchestra.run.smithi156.stdout:rsyslogd 4979 root 1w CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.443 INFO:teuthology.orchestra.run.smithi156.stdout:rsyslogd 4979 root 2w CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.443 INFO:teuthology.orchestra.run.smithi156.stdout:rsyslogd 4979 root 3r CHR 1,9 0t0 9 /dev/urandom 2023-11-05T08:43:31.443 INFO:teuthology.orchestra.run.smithi156.stdout:rsyslogd 4979 root 4w REG 8,1 700038 1642 /var/log/secure 2023-11-05T08:43:31.444 INFO:teuthology.orchestra.run.smithi156.stdout:rsyslogd 4979 root 5u unix 0xffff8da318803300 0t0 23356 type=DGRAM (CONNECTED) 2023-11-05T08:43:31.444 INFO:teuthology.orchestra.run.smithi156.stdout:rsyslogd 4979 root 6r a_inode 0,14 0 1084 inotify 2023-11-05T08:43:31.444 INFO:teuthology.orchestra.run.smithi156.stdout:rsyslogd 4979 root 7w REG 8,1 1871 1220 /var/log/cron 2023-11-05T08:43:31.444 INFO:teuthology.orchestra.run.smithi156.stdout:rsyslogd 4979 root 8w REG 8,1 1420234 1641 /var/log/messages 2023-11-05T08:43:31.444 INFO:teuthology.orchestra.run.smithi156.stdout:rsyslogd 4979 root 9r REG 0,24 8388608 58 /run/log/journal/15949e3c88704300882482eddfd7baae/system.journal 2023-11-05T08:43:31.444 INFO:teuthology.orchestra.run.smithi156.stdout:rsyslogd 4979 4981 in:imjour root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.445 INFO:teuthology.orchestra.run.smithi156.stdout:rsyslogd 4979 4981 in:imjour root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.445 INFO:teuthology.orchestra.run.smithi156.stdout:rsyslogd 4979 4981 in:imjour root txt REG 8,1 769928 12237 /usr/sbin/rsyslogd 2023-11-05T08:43:31.445 INFO:teuthology.orchestra.run.smithi156.stdout:rsyslogd 4979 4981 in:imjour root mem REG 0,24 8388608 58 /run/log/journal/15949e3c88704300882482eddfd7baae/system.journal 2023-11-05T08:43:31.445 INFO:teuthology.orchestra.run.smithi156.stdout:rsyslogd 4979 4981 in:imjour root mem REG 8,1 33592 12207 /usr/lib64/rsyslog/imjournal.so 2023-11-05T08:43:31.445 INFO:teuthology.orchestra.run.smithi156.stdout:rsyslogd 4979 4981 in:imjour root mem REG 8,1 42248 12214 /usr/lib64/rsyslog/imuxsock.so 2023-11-05T08:43:31.446 INFO:teuthology.orchestra.run.smithi156.stdout:rsyslogd 4979 4981 in:imjour root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-05T08:43:31.446 INFO:teuthology.orchestra.run.smithi156.stdout:rsyslogd 4979 4981 in:imjour root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-05T08:43:31.446 INFO:teuthology.orchestra.run.smithi156.stdout:rsyslogd 4979 4981 in:imjour root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-05T08:43:31.446 INFO:teuthology.orchestra.run.smithi156.stdout:rsyslogd 4979 4981 in:imjour root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:31.446 INFO:teuthology.orchestra.run.smithi156.stdout:rsyslogd 4979 4981 in:imjour root mem REG 8,1 32808 12215 /usr/lib64/rsyslog/lmnet.so 2023-11-05T08:43:31.446 INFO:teuthology.orchestra.run.smithi156.stdout:rsyslogd 4979 4981 in:imjour root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-05T08:43:31.447 INFO:teuthology.orchestra.run.smithi156.stdout:rsyslogd 4979 4981 in:imjour root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-05T08:43:31.447 INFO:teuthology.orchestra.run.smithi156.stdout:rsyslogd 4979 4981 in:imjour root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:31.447 INFO:teuthology.orchestra.run.smithi156.stdout:rsyslogd 4979 4981 in:imjour root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:31.447 INFO:teuthology.orchestra.run.smithi156.stdout:rsyslogd 4979 4981 in:imjour root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-05T08:43:31.447 INFO:teuthology.orchestra.run.smithi156.stdout:rsyslogd 4979 4981 in:imjour root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-05T08:43:31.448 INFO:teuthology.orchestra.run.smithi156.stdout:rsyslogd 4979 4981 in:imjour root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-05T08:43:31.448 INFO:teuthology.orchestra.run.smithi156.stdout:rsyslogd 4979 4981 in:imjour root mem REG 8,1 52856 12201 /usr/lib64/libfastjson.so.4.3.0 2023-11-05T08:43:31.448 INFO:teuthology.orchestra.run.smithi156.stdout:rsyslogd 4979 4981 in:imjour root mem REG 8,1 16032 12200 /usr/lib64/libestr.so.0.0.0 2023-11-05T08:43:31.448 INFO:teuthology.orchestra.run.smithi156.stdout:rsyslogd 4979 4981 in:imjour root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:31.448 INFO:teuthology.orchestra.run.smithi156.stdout:rsyslogd 4979 4981 in:imjour root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:31.448 INFO:teuthology.orchestra.run.smithi156.stdout:rsyslogd 4979 4981 in:imjour root 0r CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.449 INFO:teuthology.orchestra.run.smithi156.stdout:rsyslogd 4979 4981 in:imjour root 1w CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.449 INFO:teuthology.orchestra.run.smithi156.stdout:rsyslogd 4979 4981 in:imjour root 2w CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.449 INFO:teuthology.orchestra.run.smithi156.stdout:rsyslogd 4979 4981 in:imjour root 3r CHR 1,9 0t0 9 /dev/urandom 2023-11-05T08:43:31.449 INFO:teuthology.orchestra.run.smithi156.stdout:rsyslogd 4979 4981 in:imjour root 4w REG 8,1 700038 1642 /var/log/secure 2023-11-05T08:43:31.449 INFO:teuthology.orchestra.run.smithi156.stdout:rsyslogd 4979 4981 in:imjour root 5u unix 0xffff8da318803300 0t0 23356 type=DGRAM (CONNECTED) 2023-11-05T08:43:31.450 INFO:teuthology.orchestra.run.smithi156.stdout:rsyslogd 4979 4981 in:imjour root 6r a_inode 0,14 0 1084 inotify 2023-11-05T08:43:31.450 INFO:teuthology.orchestra.run.smithi156.stdout:rsyslogd 4979 4981 in:imjour root 7w REG 8,1 1871 1220 /var/log/cron 2023-11-05T08:43:31.450 INFO:teuthology.orchestra.run.smithi156.stdout:rsyslogd 4979 4981 in:imjour root 8w REG 8,1 1420234 1641 /var/log/messages 2023-11-05T08:43:31.450 INFO:teuthology.orchestra.run.smithi156.stdout:rsyslogd 4979 4981 in:imjour root 9r REG 0,24 8388608 58 /run/log/journal/15949e3c88704300882482eddfd7baae/system.journal 2023-11-05T08:43:31.450 INFO:teuthology.orchestra.run.smithi156.stdout:rsyslogd 4979 4982 rs:main root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.450 INFO:teuthology.orchestra.run.smithi156.stdout:rsyslogd 4979 4982 rs:main root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.451 INFO:teuthology.orchestra.run.smithi156.stdout:rsyslogd 4979 4982 rs:main root txt REG 8,1 769928 12237 /usr/sbin/rsyslogd 2023-11-05T08:43:31.451 INFO:teuthology.orchestra.run.smithi156.stdout:rsyslogd 4979 4982 rs:main root mem REG 0,24 8388608 58 /run/log/journal/15949e3c88704300882482eddfd7baae/system.journal 2023-11-05T08:43:31.451 INFO:teuthology.orchestra.run.smithi156.stdout:rsyslogd 4979 4982 rs:main root mem REG 8,1 33592 12207 /usr/lib64/rsyslog/imjournal.so 2023-11-05T08:43:31.451 INFO:teuthology.orchestra.run.smithi156.stdout:rsyslogd 4979 4982 rs:main root mem REG 8,1 42248 12214 /usr/lib64/rsyslog/imuxsock.so 2023-11-05T08:43:31.451 INFO:teuthology.orchestra.run.smithi156.stdout:rsyslogd 4979 4982 rs:main root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-05T08:43:31.452 INFO:teuthology.orchestra.run.smithi156.stdout:rsyslogd 4979 4982 rs:main root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-05T08:43:31.452 INFO:teuthology.orchestra.run.smithi156.stdout:rsyslogd 4979 4982 rs:main root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-05T08:43:31.452 INFO:teuthology.orchestra.run.smithi156.stdout:rsyslogd 4979 4982 rs:main root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:31.452 INFO:teuthology.orchestra.run.smithi156.stdout:rsyslogd 4979 4982 rs:main root mem REG 8,1 32808 12215 /usr/lib64/rsyslog/lmnet.so 2023-11-05T08:43:31.452 INFO:teuthology.orchestra.run.smithi156.stdout:rsyslogd 4979 4982 rs:main root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-05T08:43:31.452 INFO:teuthology.orchestra.run.smithi156.stdout:rsyslogd 4979 4982 rs:main root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-05T08:43:31.453 INFO:teuthology.orchestra.run.smithi156.stdout:rsyslogd 4979 4982 rs:main root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:31.453 INFO:teuthology.orchestra.run.smithi156.stdout:rsyslogd 4979 4982 rs:main root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:31.453 INFO:teuthology.orchestra.run.smithi156.stdout:rsyslogd 4979 4982 rs:main root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-05T08:43:31.453 INFO:teuthology.orchestra.run.smithi156.stdout:rsyslogd 4979 4982 rs:main root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-05T08:43:31.453 INFO:teuthology.orchestra.run.smithi156.stdout:rsyslogd 4979 4982 rs:main root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-05T08:43:31.454 INFO:teuthology.orchestra.run.smithi156.stdout:rsyslogd 4979 4982 rs:main root mem REG 8,1 52856 12201 /usr/lib64/libfastjson.so.4.3.0 2023-11-05T08:43:31.454 INFO:teuthology.orchestra.run.smithi156.stdout:rsyslogd 4979 4982 rs:main root mem REG 8,1 16032 12200 /usr/lib64/libestr.so.0.0.0 2023-11-05T08:43:31.454 INFO:teuthology.orchestra.run.smithi156.stdout:rsyslogd 4979 4982 rs:main root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:31.454 INFO:teuthology.orchestra.run.smithi156.stdout:rsyslogd 4979 4982 rs:main root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:31.454 INFO:teuthology.orchestra.run.smithi156.stdout:rsyslogd 4979 4982 rs:main root 0r CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.454 INFO:teuthology.orchestra.run.smithi156.stdout:rsyslogd 4979 4982 rs:main root 1w CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.455 INFO:teuthology.orchestra.run.smithi156.stdout:rsyslogd 4979 4982 rs:main root 2w CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.455 INFO:teuthology.orchestra.run.smithi156.stdout:rsyslogd 4979 4982 rs:main root 3r CHR 1,9 0t0 9 /dev/urandom 2023-11-05T08:43:31.455 INFO:teuthology.orchestra.run.smithi156.stdout:rsyslogd 4979 4982 rs:main root 4w REG 8,1 700038 1642 /var/log/secure 2023-11-05T08:43:31.455 INFO:teuthology.orchestra.run.smithi156.stdout:rsyslogd 4979 4982 rs:main root 5u unix 0xffff8da318803300 0t0 23356 type=DGRAM (CONNECTED) 2023-11-05T08:43:31.455 INFO:teuthology.orchestra.run.smithi156.stdout:rsyslogd 4979 4982 rs:main root 6r a_inode 0,14 0 1084 inotify 2023-11-05T08:43:31.456 INFO:teuthology.orchestra.run.smithi156.stdout:rsyslogd 4979 4982 rs:main root 7w REG 8,1 1871 1220 /var/log/cron 2023-11-05T08:43:31.456 INFO:teuthology.orchestra.run.smithi156.stdout:rsyslogd 4979 4982 rs:main root 8w REG 8,1 1420234 1641 /var/log/messages 2023-11-05T08:43:31.456 INFO:teuthology.orchestra.run.smithi156.stdout:rsyslogd 4979 4982 rs:main root 9r REG 0,24 8388608 58 /run/log/journal/15949e3c88704300882482eddfd7baae/system.journal 2023-11-05T08:43:31.456 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/4 6564 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.456 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/4 6564 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.456 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/4 6564 root txt unknown /proc/6564/exe 2023-11-05T08:43:31.457 INFO:teuthology.orchestra.run.smithi156.stdout:tls-strp 60996 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.457 INFO:teuthology.orchestra.run.smithi156.stdout:tls-strp 60996 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.457 INFO:teuthology.orchestra.run.smithi156.stdout:tls-strp 60996 root txt unknown /proc/60996/exe 2023-11-05T08:43:31.457 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/0 66730 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.457 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/0 66730 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.458 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/0 66730 root txt unknown /proc/66730/exe 2023-11-05T08:43:31.458 INFO:teuthology.orchestra.run.smithi156.stdout:kdmflush/ 70295 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.458 INFO:teuthology.orchestra.run.smithi156.stdout:kdmflush/ 70295 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.458 INFO:teuthology.orchestra.run.smithi156.stdout:kdmflush/ 70295 root txt unknown /proc/70295/exe 2023-11-05T08:43:31.458 INFO:teuthology.orchestra.run.smithi156.stdout:kdmflush/ 70415 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.458 INFO:teuthology.orchestra.run.smithi156.stdout:kdmflush/ 70415 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.459 INFO:teuthology.orchestra.run.smithi156.stdout:kdmflush/ 70415 root txt unknown /proc/70415/exe 2023-11-05T08:43:31.459 INFO:teuthology.orchestra.run.smithi156.stdout:kdmflush/ 70535 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.459 INFO:teuthology.orchestra.run.smithi156.stdout:kdmflush/ 70535 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.459 INFO:teuthology.orchestra.run.smithi156.stdout:kdmflush/ 70535 root txt unknown /proc/70535/exe 2023-11-05T08:43:31.459 INFO:teuthology.orchestra.run.smithi156.stdout:kdmflush/ 70655 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.460 INFO:teuthology.orchestra.run.smithi156.stdout:kdmflush/ 70655 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.460 INFO:teuthology.orchestra.run.smithi156.stdout:kdmflush/ 70655 root txt unknown /proc/70655/exe 2023-11-05T08:43:31.460 INFO:teuthology.orchestra.run.smithi156.stdout:kdmflush/ 70775 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.460 INFO:teuthology.orchestra.run.smithi156.stdout:kdmflush/ 70775 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.460 INFO:teuthology.orchestra.run.smithi156.stdout:kdmflush/ 70775 root txt unknown /proc/70775/exe 2023-11-05T08:43:31.461 INFO:teuthology.orchestra.run.smithi156.stdout:xfsalloc 71668 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.461 INFO:teuthology.orchestra.run.smithi156.stdout:xfsalloc 71668 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.461 INFO:teuthology.orchestra.run.smithi156.stdout:xfsalloc 71668 root txt unknown /proc/71668/exe 2023-11-05T08:43:31.461 INFO:teuthology.orchestra.run.smithi156.stdout:xfs_mru_c 71669 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.461 INFO:teuthology.orchestra.run.smithi156.stdout:xfs_mru_c 71669 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.462 INFO:teuthology.orchestra.run.smithi156.stdout:xfs_mru_c 71669 root txt unknown /proc/71669/exe 2023-11-05T08:43:31.462 INFO:teuthology.orchestra.run.smithi156.stdout:xfs-buf/d 71670 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.462 INFO:teuthology.orchestra.run.smithi156.stdout:xfs-buf/d 71670 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.462 INFO:teuthology.orchestra.run.smithi156.stdout:xfs-buf/d 71670 root txt unknown /proc/71670/exe 2023-11-05T08:43:31.462 INFO:teuthology.orchestra.run.smithi156.stdout:xfs-conv/ 71671 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.462 INFO:teuthology.orchestra.run.smithi156.stdout:xfs-conv/ 71671 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.463 INFO:teuthology.orchestra.run.smithi156.stdout:xfs-conv/ 71671 root txt unknown /proc/71671/exe 2023-11-05T08:43:31.463 INFO:teuthology.orchestra.run.smithi156.stdout:xfs-recla 71672 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.463 INFO:teuthology.orchestra.run.smithi156.stdout:xfs-recla 71672 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.463 INFO:teuthology.orchestra.run.smithi156.stdout:xfs-recla 71672 root txt unknown /proc/71672/exe 2023-11-05T08:43:31.463 INFO:teuthology.orchestra.run.smithi156.stdout:xfs-block 71673 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.463 INFO:teuthology.orchestra.run.smithi156.stdout:xfs-block 71673 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.464 INFO:teuthology.orchestra.run.smithi156.stdout:xfs-block 71673 root txt unknown /proc/71673/exe 2023-11-05T08:43:31.464 INFO:teuthology.orchestra.run.smithi156.stdout:xfs-inode 71674 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.464 INFO:teuthology.orchestra.run.smithi156.stdout:xfs-inode 71674 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.464 INFO:teuthology.orchestra.run.smithi156.stdout:xfs-inode 71674 root txt unknown /proc/71674/exe 2023-11-05T08:43:31.464 INFO:teuthology.orchestra.run.smithi156.stdout:xfs-log/d 71675 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.465 INFO:teuthology.orchestra.run.smithi156.stdout:xfs-log/d 71675 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.465 INFO:teuthology.orchestra.run.smithi156.stdout:xfs-log/d 71675 root txt unknown /proc/71675/exe 2023-11-05T08:43:31.465 INFO:teuthology.orchestra.run.smithi156.stdout:xfs-cil/d 71676 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.465 INFO:teuthology.orchestra.run.smithi156.stdout:xfs-cil/d 71676 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.465 INFO:teuthology.orchestra.run.smithi156.stdout:xfs-cil/d 71676 root txt unknown /proc/71676/exe 2023-11-05T08:43:31.465 INFO:teuthology.orchestra.run.smithi156.stdout:xfsaild/d 71677 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.466 INFO:teuthology.orchestra.run.smithi156.stdout:xfsaild/d 71677 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.466 INFO:teuthology.orchestra.run.smithi156.stdout:xfsaild/d 71677 root txt unknown /proc/71677/exe 2023-11-05T08:43:31.466 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74711 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.466 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74711 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.466 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74711 root txt REG 8,1 968800 13744 /usr/sbin/sshd 2023-11-05T08:43:31.467 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74711 root mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2023-11-05T08:43:31.467 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74711 root mem REG 8,1 19520 32283 /usr/lib64/security/pam_lastlog.so 2023-11-05T08:43:31.467 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74711 root mem REG 8,1 15184 32309 /usr/lib64/security/pam_umask.so 2023-11-05T08:43:31.467 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74711 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-05T08:43:31.467 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74711 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-05T08:43:31.468 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74711 root mem REG 8,1 19600 10967 /usr/lib64/libpam_misc.so.0.82.1 2023-11-05T08:43:31.468 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74711 root mem REG 8,1 19400 32305 /usr/lib64/security/pam_succeed_if.so 2023-11-05T08:43:31.468 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74711 root mem REG 8,1 514280 32422 /usr/lib64/security/pam_systemd.so 2023-11-05T08:43:31.468 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74711 root mem REG 8,1 27536 32284 /usr/lib64/security/pam_limits.so 2023-11-05T08:43:31.468 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74711 root mem REG 8,1 15264 32290 /usr/lib64/security/pam_motd.so 2023-11-05T08:43:31.468 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74711 root mem REG 8,1 15352 32282 /usr/lib64/security/pam_keyinit.so 2023-11-05T08:43:31.469 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74711 root mem REG 8,1 44152 32291 /usr/lib64/security/pam_namespace.so 2023-11-05T08:43:31.469 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74711 root mem REG 8,1 27616 32299 /usr/lib64/security/pam_selinux.so 2023-11-05T08:43:31.469 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74711 root mem REG 8,1 48392 10228 /usr/lib64/libcrack.so.2.9.0 2023-11-05T08:43:31.469 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74711 root mem REG 8,1 32608 10961 /usr/lib64/libpwquality.so.1.0.2 2023-11-05T08:43:31.469 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74711 root mem REG 8,1 15240 32287 /usr/lib64/security/pam_loginuid.so 2023-11-05T08:43:31.470 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74711 root mem REG 8,1 15840 32264 /usr/lib64/security/pam_pwquality.so 2023-11-05T08:43:31.470 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74711 root mem REG 8,1 15232 32292 /usr/lib64/security/pam_nologin.so 2023-11-05T08:43:31.470 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74711 root mem REG 8,1 19368 32301 /usr/lib64/security/pam_sepermit.so 2023-11-05T08:43:31.470 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74711 root mem REG 8,1 14928 32270 /usr/lib64/security/pam_deny.so 2023-11-05T08:43:31.470 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74711 root mem REG 8,1 56712 32310 /usr/lib64/security/pam_unix.so 2023-11-05T08:43:31.470 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74711 root mem REG 8,1 15184 32274 /usr/lib64/security/pam_faildelay.so 2023-11-05T08:43:31.471 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74711 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-05T08:43:31.471 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74711 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-05T08:43:31.471 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74711 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-05T08:43:31.471 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74711 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:31.471 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74711 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-05T08:43:31.471 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74711 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-05T08:43:31.472 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74711 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:31.472 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74711 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:31.472 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74711 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-05T08:43:31.472 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74711 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:31.472 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74711 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-05T08:43:31.473 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74711 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-05T08:43:31.473 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74711 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-05T08:43:31.473 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74711 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-05T08:43:31.473 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74711 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:31.473 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74711 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-05T08:43:31.473 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74711 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-05T08:43:31.474 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74711 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-05T08:43:31.474 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74711 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-05T08:43:31.474 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74711 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-05T08:43:31.474 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74711 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:31.474 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74711 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-05T08:43:31.475 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74711 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:31.475 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74711 root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-05T08:43:31.475 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74711 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-05T08:43:31.475 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74711 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-05T08:43:31.475 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74711 root mem REG 8,1 19464 32272 /usr/lib64/security/pam_env.so 2023-11-05T08:43:31.475 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74711 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:31.476 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74711 root mem REG 0,19 0 19 /sys/fs/selinux/status 2023-11-05T08:43:31.476 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74711 root 0u CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.476 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74711 root 1u CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.476 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74711 root 2u CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.476 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74711 root 3u unix 0xffff8da31821cc80 0t0 159236 type=DGRAM (CONNECTED) 2023-11-05T08:43:31.477 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74711 root 4u IPv4 160243 0t0 TCP smithi156.front.sepia.ceph.com:ssh->teuthology.front.sepia.ceph.com:37562 (ESTABLISHED) 2023-11-05T08:43:31.477 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74711 root 6u unix 0xffff8da318210880 0t0 159211 type=STREAM (CONNECTED) 2023-11-05T08:43:31.477 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74711 root 7w FIFO 0,24 0t0 1609 /run/systemd/sessions/4.ref 2023-11-05T08:43:31.477 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74711 root 8u unix 0xffff8da318210440 0t0 159240 type=STREAM (CONNECTED) 2023-11-05T08:43:31.477 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74714 ubuntu cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.477 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74714 ubuntu rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.478 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74714 ubuntu txt REG 8,1 968800 13744 /usr/sbin/sshd 2023-11-05T08:43:31.478 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74714 ubuntu mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2023-11-05T08:43:31.478 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74714 ubuntu mem REG 8,1 19520 32283 /usr/lib64/security/pam_lastlog.so 2023-11-05T08:43:31.478 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74714 ubuntu mem REG 8,1 15184 32309 /usr/lib64/security/pam_umask.so 2023-11-05T08:43:31.478 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74714 ubuntu mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-05T08:43:31.479 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74714 ubuntu mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-05T08:43:31.479 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74714 ubuntu mem REG 8,1 19600 10967 /usr/lib64/libpam_misc.so.0.82.1 2023-11-05T08:43:31.479 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74714 ubuntu mem REG 8,1 19400 32305 /usr/lib64/security/pam_succeed_if.so 2023-11-05T08:43:31.479 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74714 ubuntu mem REG 8,1 514280 32422 /usr/lib64/security/pam_systemd.so 2023-11-05T08:43:31.479 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74714 ubuntu mem REG 8,1 27536 32284 /usr/lib64/security/pam_limits.so 2023-11-05T08:43:31.479 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74714 ubuntu mem REG 8,1 15264 32290 /usr/lib64/security/pam_motd.so 2023-11-05T08:43:31.480 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74714 ubuntu mem REG 8,1 15352 32282 /usr/lib64/security/pam_keyinit.so 2023-11-05T08:43:31.480 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74714 ubuntu mem REG 8,1 44152 32291 /usr/lib64/security/pam_namespace.so 2023-11-05T08:43:31.480 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74714 ubuntu mem REG 8,1 27616 32299 /usr/lib64/security/pam_selinux.so 2023-11-05T08:43:31.480 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74714 ubuntu mem REG 8,1 48392 10228 /usr/lib64/libcrack.so.2.9.0 2023-11-05T08:43:31.480 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74714 ubuntu mem REG 8,1 32608 10961 /usr/lib64/libpwquality.so.1.0.2 2023-11-05T08:43:31.481 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74714 ubuntu mem REG 8,1 15240 32287 /usr/lib64/security/pam_loginuid.so 2023-11-05T08:43:31.481 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74714 ubuntu mem REG 8,1 15840 32264 /usr/lib64/security/pam_pwquality.so 2023-11-05T08:43:31.481 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74714 ubuntu mem REG 8,1 15232 32292 /usr/lib64/security/pam_nologin.so 2023-11-05T08:43:31.481 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74714 ubuntu mem REG 8,1 19368 32301 /usr/lib64/security/pam_sepermit.so 2023-11-05T08:43:31.481 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74714 ubuntu mem REG 8,1 14928 32270 /usr/lib64/security/pam_deny.so 2023-11-05T08:43:31.481 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74714 ubuntu mem REG 8,1 56712 32310 /usr/lib64/security/pam_unix.so 2023-11-05T08:43:31.482 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74714 ubuntu mem REG 8,1 15184 32274 /usr/lib64/security/pam_faildelay.so 2023-11-05T08:43:31.482 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74714 ubuntu mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-05T08:43:31.482 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74714 ubuntu mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-05T08:43:31.482 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74714 ubuntu mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-05T08:43:31.482 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74714 ubuntu mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:31.483 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74714 ubuntu mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-05T08:43:31.483 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74714 ubuntu mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-05T08:43:31.483 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74714 ubuntu mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:31.483 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74714 ubuntu mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:31.483 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74714 ubuntu mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-05T08:43:31.484 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74714 ubuntu mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:31.484 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74714 ubuntu mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-05T08:43:31.484 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74714 ubuntu mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-05T08:43:31.484 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74714 ubuntu mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-05T08:43:31.484 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74714 ubuntu mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-05T08:43:31.484 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74714 ubuntu mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:31.485 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74714 ubuntu mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-05T08:43:31.485 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74714 ubuntu mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-05T08:43:31.485 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74714 ubuntu mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-05T08:43:31.485 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74714 ubuntu mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-05T08:43:31.485 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74714 ubuntu mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-05T08:43:31.486 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74714 ubuntu mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:31.486 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74714 ubuntu mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-05T08:43:31.486 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74714 ubuntu mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:31.486 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74714 ubuntu mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-05T08:43:31.486 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74714 ubuntu mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-05T08:43:31.487 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74714 ubuntu mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-05T08:43:31.487 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74714 ubuntu mem REG 8,1 19464 32272 /usr/lib64/security/pam_env.so 2023-11-05T08:43:31.487 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74714 ubuntu mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:31.487 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74714 ubuntu mem REG 0,19 0 19 /sys/fs/selinux/status 2023-11-05T08:43:31.487 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74714 ubuntu 0u CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.487 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74714 ubuntu 1u CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.488 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74714 ubuntu 2u CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.488 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74714 ubuntu 3u unix 0xffff8da31821cc80 0t0 159236 type=DGRAM (CONNECTED) 2023-11-05T08:43:31.488 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74714 ubuntu 4u IPv4 160243 0t0 TCP smithi156.front.sepia.ceph.com:ssh->teuthology.front.sepia.ceph.com:37562 (ESTABLISHED) 2023-11-05T08:43:31.488 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74714 ubuntu 5u unix 0xffff8da318216a40 0t0 159239 type=STREAM (CONNECTED) 2023-11-05T08:43:31.488 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74714 ubuntu 6u unix 0xffff8da318210880 0t0 159211 type=STREAM (CONNECTED) 2023-11-05T08:43:31.489 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74714 ubuntu 7w FIFO 0,24 0t0 1609 /run/systemd/sessions/4.ref 2023-11-05T08:43:31.489 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74714 ubuntu 12r FIFO 0,13 0t0 200383 pipe 2023-11-05T08:43:31.489 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74714 ubuntu 14r FIFO 0,13 0t0 200384 pipe 2023-11-05T08:43:31.489 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74714 ubuntu 25w FIFO 0,13 0t0 182739 pipe 2023-11-05T08:43:31.489 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74714 ubuntu 27r FIFO 0,13 0t0 182740 pipe 2023-11-05T08:43:31.489 INFO:teuthology.orchestra.run.smithi156.stdout:sshd 74714 ubuntu 29r FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:31.490 INFO:teuthology.orchestra.run.smithi156.stdout:chronyd 74775 chrony cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.490 INFO:teuthology.orchestra.run.smithi156.stdout:chronyd 74775 chrony rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.490 INFO:teuthology.orchestra.run.smithi156.stdout:chronyd 74775 chrony txt REG 8,1 353408 12490 /usr/sbin/chronyd 2023-11-05T08:43:31.490 INFO:teuthology.orchestra.run.smithi156.stdout:chronyd 74775 chrony mem REG 8,1 626152 9989 /usr/lib64/libhogweed.so.6.5 2023-11-05T08:43:31.490 INFO:teuthology.orchestra.run.smithi156.stdout:chronyd 74775 chrony mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-05T08:43:31.491 INFO:teuthology.orchestra.run.smithi156.stdout:chronyd 74775 chrony mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:31.491 INFO:teuthology.orchestra.run.smithi156.stdout:chronyd 74775 chrony mem REG 8,1 94112 9901 /usr/lib64/libtasn1.so.6.6.0 2023-11-05T08:43:31.491 INFO:teuthology.orchestra.run.smithi156.stdout:chronyd 74775 chrony mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-05T08:43:31.491 INFO:teuthology.orchestra.run.smithi156.stdout:chronyd 74775 chrony mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-05T08:43:31.491 INFO:teuthology.orchestra.run.smithi156.stdout:chronyd 74775 chrony mem REG 8,1 2291576 9994 /usr/lib64/libgnutls.so.30.33.1 2023-11-05T08:43:31.491 INFO:teuthology.orchestra.run.smithi156.stdout:chronyd 74775 chrony mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-05T08:43:31.492 INFO:teuthology.orchestra.run.smithi156.stdout:chronyd 74775 chrony mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-05T08:43:31.492 INFO:teuthology.orchestra.run.smithi156.stdout:chronyd 74775 chrony mem REG 8,1 127680 9972 /usr/lib64/libseccomp.so.2.5.2 2023-11-05T08:43:31.492 INFO:teuthology.orchestra.run.smithi156.stdout:chronyd 74775 chrony mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:31.492 INFO:teuthology.orchestra.run.smithi156.stdout:chronyd 74775 chrony mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:31.492 INFO:teuthology.orchestra.run.smithi156.stdout:chronyd 74775 chrony mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:31.493 INFO:teuthology.orchestra.run.smithi156.stdout:chronyd 74775 chrony 0r CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.493 INFO:teuthology.orchestra.run.smithi156.stdout:chronyd 74775 chrony 1w CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.493 INFO:teuthology.orchestra.run.smithi156.stdout:chronyd 74775 chrony 2u CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.493 INFO:teuthology.orchestra.run.smithi156.stdout:chronyd 74775 chrony 3u unix 0xffff8da318802200 0t0 164138 type=DGRAM (CONNECTED) 2023-11-05T08:43:31.493 INFO:teuthology.orchestra.run.smithi156.stdout:chronyd 74775 chrony 5u IPv4 164143 0t0 UDP localhost:323 2023-11-05T08:43:31.493 INFO:teuthology.orchestra.run.smithi156.stdout:chronyd 74775 chrony 6u IPv6 164144 0t0 UDP localhost:323 2023-11-05T08:43:31.494 INFO:teuthology.orchestra.run.smithi156.stdout:chronyd 74775 chrony 7u unix 0xffff8da318804400 0t0 164145 /run/chrony/chronyd.sock type=DGRAM (UNCONNECTED) 2023-11-05T08:43:31.494 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/4 74927 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.494 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/4 74927 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.494 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/4 74927 root txt unknown /proc/74927/exe 2023-11-05T08:43:31.494 INFO:teuthology.orchestra.run.smithi156.stdout:ceph-cras 74992 ceph cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.495 INFO:teuthology.orchestra.run.smithi156.stdout:ceph-cras 74992 ceph rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.495 INFO:teuthology.orchestra.run.smithi156.stdout:ceph-cras 74992 ceph txt REG 8,1 15448 10498 /usr/bin/python3.9 2023-11-05T08:43:31.495 INFO:teuthology.orchestra.run.smithi156.stdout:ceph-cras 74992 ceph mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-05T08:43:31.495 INFO:teuthology.orchestra.run.smithi156.stdout:ceph-cras 74992 ceph mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-05T08:43:31.495 INFO:teuthology.orchestra.run.smithi156.stdout:ceph-cras 74992 ceph mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-05T08:43:31.496 INFO:teuthology.orchestra.run.smithi156.stdout:ceph-cras 74992 ceph mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-05T08:43:31.496 INFO:teuthology.orchestra.run.smithi156.stdout:ceph-cras 74992 ceph mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:31.496 INFO:teuthology.orchestra.run.smithi156.stdout:ceph-cras 74992 ceph mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-05T08:43:31.496 INFO:teuthology.orchestra.run.smithi156.stdout:ceph-cras 74992 ceph mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-05T08:43:31.496 INFO:teuthology.orchestra.run.smithi156.stdout:ceph-cras 74992 ceph mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-05T08:43:31.496 INFO:teuthology.orchestra.run.smithi156.stdout:ceph-cras 74992 ceph mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-05T08:43:31.497 INFO:teuthology.orchestra.run.smithi156.stdout:ceph-cras 74992 ceph mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-05T08:43:31.497 INFO:teuthology.orchestra.run.smithi156.stdout:ceph-cras 74992 ceph mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:31.497 INFO:teuthology.orchestra.run.smithi156.stdout:ceph-cras 74992 ceph mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-05T08:43:31.497 INFO:teuthology.orchestra.run.smithi156.stdout:ceph-cras 74992 ceph mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-05T08:43:31.497 INFO:teuthology.orchestra.run.smithi156.stdout:ceph-cras 74992 ceph mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:31.498 INFO:teuthology.orchestra.run.smithi156.stdout:ceph-cras 74992 ceph mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-05T08:43:31.498 INFO:teuthology.orchestra.run.smithi156.stdout:ceph-cras 74992 ceph mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-05T08:43:31.498 INFO:teuthology.orchestra.run.smithi156.stdout:ceph-cras 74992 ceph mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-05T08:43:31.498 INFO:teuthology.orchestra.run.smithi156.stdout:ceph-cras 74992 ceph mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-05T08:43:31.498 INFO:teuthology.orchestra.run.smithi156.stdout:ceph-cras 74992 ceph mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:31.498 INFO:teuthology.orchestra.run.smithi156.stdout:ceph-cras 74992 ceph 0r CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.499 INFO:teuthology.orchestra.run.smithi156.stdout:ceph-cras 74992 ceph 1u unix 0xffff8da307b0d940 0t0 165338 type=STREAM (CONNECTED) 2023-11-05T08:43:31.499 INFO:teuthology.orchestra.run.smithi156.stdout:ceph-cras 74992 ceph 2u unix 0xffff8da307b0d940 0t0 165338 type=STREAM (CONNECTED) 2023-11-05T08:43:31.499 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/2 76735 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.499 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/2 76735 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.499 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/2 76735 root txt unknown /proc/76735/exe 2023-11-05T08:43:31.500 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/3 76946 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.500 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/3 76946 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.500 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/3 76946 root txt unknown /proc/76946/exe 2023-11-05T08:43:31.500 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/7 78350 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.500 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/7 78350 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.500 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/7 78350 root txt unknown /proc/78350/exe 2023-11-05T08:43:31.501 INFO:teuthology.orchestra.run.smithi156.stdout:anacron 79130 root cwd DIR 8,1 4096 1136 /var/spool/anacron 2023-11-05T08:43:31.501 INFO:teuthology.orchestra.run.smithi156.stdout:anacron 79130 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.501 INFO:teuthology.orchestra.run.smithi156.stdout:anacron 79130 root txt REG 8,1 41136 11229 /usr/sbin/anacron 2023-11-05T08:43:31.501 INFO:teuthology.orchestra.run.smithi156.stdout:anacron 79130 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-05T08:43:31.501 INFO:teuthology.orchestra.run.smithi156.stdout:anacron 79130 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:31.502 INFO:teuthology.orchestra.run.smithi156.stdout:anacron 79130 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-05T08:43:31.502 INFO:teuthology.orchestra.run.smithi156.stdout:anacron 79130 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-05T08:43:31.502 INFO:teuthology.orchestra.run.smithi156.stdout:anacron 79130 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-05T08:43:31.502 INFO:teuthology.orchestra.run.smithi156.stdout:anacron 79130 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-05T08:43:31.502 INFO:teuthology.orchestra.run.smithi156.stdout:anacron 79130 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-05T08:43:31.503 INFO:teuthology.orchestra.run.smithi156.stdout:anacron 79130 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-05T08:43:31.503 INFO:teuthology.orchestra.run.smithi156.stdout:anacron 79130 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-05T08:43:31.503 INFO:teuthology.orchestra.run.smithi156.stdout:anacron 79130 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-05T08:43:31.503 INFO:teuthology.orchestra.run.smithi156.stdout:anacron 79130 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-05T08:43:31.503 INFO:teuthology.orchestra.run.smithi156.stdout:anacron 79130 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-05T08:43:31.503 INFO:teuthology.orchestra.run.smithi156.stdout:anacron 79130 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-05T08:43:31.504 INFO:teuthology.orchestra.run.smithi156.stdout:anacron 79130 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:31.504 INFO:teuthology.orchestra.run.smithi156.stdout:anacron 79130 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-05T08:43:31.504 INFO:teuthology.orchestra.run.smithi156.stdout:anacron 79130 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.504 INFO:teuthology.orchestra.run.smithi156.stdout:anacron 79130 root 1w CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.504 INFO:teuthology.orchestra.run.smithi156.stdout:anacron 79130 root 2w CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.505 INFO:teuthology.orchestra.run.smithi156.stdout:anacron 79130 root 4u unix 0xffff8da3188061c0 0t0 175468 type=DGRAM (CONNECTED) 2023-11-05T08:43:31.505 INFO:teuthology.orchestra.run.smithi156.stdout:anacron 79130 root 5uW REG 8,1 0 1139 /var/spool/anacron/cron.weekly 2023-11-05T08:43:31.505 INFO:teuthology.orchestra.run.smithi156.stdout:anacron 79130 root 6uW REG 8,1 0 1140 /var/spool/anacron/cron.monthly 2023-11-05T08:43:31.505 INFO:teuthology.orchestra.run.smithi156.stdout:xfs-buf/d 80398 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.505 INFO:teuthology.orchestra.run.smithi156.stdout:xfs-buf/d 80398 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.505 INFO:teuthology.orchestra.run.smithi156.stdout:xfs-buf/d 80398 root txt unknown /proc/80398/exe 2023-11-05T08:43:31.506 INFO:teuthology.orchestra.run.smithi156.stdout:xfs-conv/ 80399 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.506 INFO:teuthology.orchestra.run.smithi156.stdout:xfs-conv/ 80399 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.506 INFO:teuthology.orchestra.run.smithi156.stdout:xfs-conv/ 80399 root txt unknown /proc/80399/exe 2023-11-05T08:43:31.506 INFO:teuthology.orchestra.run.smithi156.stdout:xfs-recla 80400 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.506 INFO:teuthology.orchestra.run.smithi156.stdout:xfs-recla 80400 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.507 INFO:teuthology.orchestra.run.smithi156.stdout:xfs-recla 80400 root txt unknown /proc/80400/exe 2023-11-05T08:43:31.507 INFO:teuthology.orchestra.run.smithi156.stdout:xfs-block 80401 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.507 INFO:teuthology.orchestra.run.smithi156.stdout:xfs-block 80401 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.507 INFO:teuthology.orchestra.run.smithi156.stdout:xfs-block 80401 root txt unknown /proc/80401/exe 2023-11-05T08:43:31.507 INFO:teuthology.orchestra.run.smithi156.stdout:xfs-inode 80402 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.507 INFO:teuthology.orchestra.run.smithi156.stdout:xfs-inode 80402 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.508 INFO:teuthology.orchestra.run.smithi156.stdout:xfs-inode 80402 root txt unknown /proc/80402/exe 2023-11-05T08:43:31.508 INFO:teuthology.orchestra.run.smithi156.stdout:xfs-log/d 80403 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.508 INFO:teuthology.orchestra.run.smithi156.stdout:xfs-log/d 80403 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.508 INFO:teuthology.orchestra.run.smithi156.stdout:xfs-log/d 80403 root txt unknown /proc/80403/exe 2023-11-05T08:43:31.508 INFO:teuthology.orchestra.run.smithi156.stdout:xfs-cil/d 80404 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.509 INFO:teuthology.orchestra.run.smithi156.stdout:xfs-cil/d 80404 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.509 INFO:teuthology.orchestra.run.smithi156.stdout:xfs-cil/d 80404 root txt unknown /proc/80404/exe 2023-11-05T08:43:31.509 INFO:teuthology.orchestra.run.smithi156.stdout:xfsaild/d 80405 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.509 INFO:teuthology.orchestra.run.smithi156.stdout:xfsaild/d 80405 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.509 INFO:teuthology.orchestra.run.smithi156.stdout:xfsaild/d 80405 root txt unknown /proc/80405/exe 2023-11-05T08:43:31.510 INFO:teuthology.orchestra.run.smithi156.stdout:dio/dm-3 83973 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.510 INFO:teuthology.orchestra.run.smithi156.stdout:dio/dm-3 83973 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.510 INFO:teuthology.orchestra.run.smithi156.stdout:dio/dm-3 83973 root txt unknown /proc/83973/exe 2023-11-05T08:43:31.510 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/2 84361 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:31.510 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/2 84361 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.510 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/2 84361 root txt unknown /proc/84361/exe 2023-11-05T08:43:31.511 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 86195 root cwd DIR 8,1 4096 265785 /home/ubuntu/cephtest 2023-11-05T08:43:31.511 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 86195 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.511 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 86195 root txt REG 8,1 185296 11759 /usr/bin/sudo 2023-11-05T08:43:31.511 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 86195 root mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2023-11-05T08:43:31.511 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 86195 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-05T08:43:31.512 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 86195 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:31.512 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 86195 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-05T08:43:31.512 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 86195 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:31.512 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 86195 root mem REG 8,1 19600 10967 /usr/lib64/libpam_misc.so.0.82.1 2023-11-05T08:43:31.512 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 86195 root mem REG 8,1 19400 32305 /usr/lib64/security/pam_succeed_if.so 2023-11-05T08:43:31.513 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 86195 root mem REG 8,1 514280 32422 /usr/lib64/security/pam_systemd.so 2023-11-05T08:43:31.513 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 86195 root mem REG 8,1 27536 32284 /usr/lib64/security/pam_limits.so 2023-11-05T08:43:31.513 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 86195 root mem REG 8,1 48392 10228 /usr/lib64/libcrack.so.2.9.0 2023-11-05T08:43:31.513 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 86195 root mem REG 8,1 32608 10961 /usr/lib64/libpwquality.so.1.0.2 2023-11-05T08:43:31.513 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 86195 root mem REG 8,1 15352 32282 /usr/lib64/security/pam_keyinit.so 2023-11-05T08:43:31.513 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 86195 root mem REG 8,1 15840 32264 /usr/lib64/security/pam_pwquality.so 2023-11-05T08:43:31.514 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 86195 root mem REG 8,1 56712 32310 /usr/lib64/security/pam_unix.so 2023-11-05T08:43:31.514 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 86195 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-05T08:43:31.514 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 86195 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-05T08:43:31.514 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 86195 root mem REG 8,1 14928 32270 /usr/lib64/security/pam_deny.so 2023-11-05T08:43:31.514 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 86195 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-05T08:43:31.515 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 86195 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-05T08:43:31.515 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 86195 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-05T08:43:31.515 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 86195 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-05T08:43:31.515 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 86195 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-05T08:43:31.515 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 86195 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-05T08:43:31.516 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 86195 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-05T08:43:31.516 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 86195 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-05T08:43:31.516 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 86195 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-05T08:43:31.516 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 86195 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:31.516 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 86195 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:31.516 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 86195 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-05T08:43:31.517 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 86195 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-05T08:43:31.517 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 86195 root mem REG 8,1 15184 32274 /usr/lib64/security/pam_faildelay.so 2023-11-05T08:43:31.517 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 86195 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-05T08:43:31.517 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 86195 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-05T08:43:31.517 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 86195 root mem REG 8,1 472568 54513 /usr/libexec/sudo/sudoers.so 2023-11-05T08:43:31.517 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 86195 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:31.518 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 86195 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:31.518 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 86195 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-05T08:43:31.518 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 86195 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-05T08:43:31.518 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 86195 root mem REG 8,1 19464 32272 /usr/lib64/security/pam_env.so 2023-11-05T08:43:31.518 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 86195 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-05T08:43:31.519 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 86195 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-05T08:43:31.519 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 86195 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-05T08:43:31.519 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 86195 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-05T08:43:31.519 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 86195 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-05T08:43:31.519 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 86195 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-05T08:43:31.519 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 86195 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-05T08:43:31.520 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 86195 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-05T08:43:31.520 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 86195 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-05T08:43:31.520 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 86195 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-05T08:43:31.520 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 86195 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-05T08:43:31.520 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 86195 root mem REG 8,1 119832 54509 /usr/libexec/sudo/libsudo_util.so.0.0.0 2023-11-05T08:43:31.521 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 86195 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:31.521 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 86195 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-05T08:43:31.521 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 86195 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-05T08:43:31.521 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 86195 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:31.521 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 86195 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-05T08:43:31.522 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 86195 root 0r FIFO 0,13 0t0 182739 pipe 2023-11-05T08:43:31.522 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 86195 root 1w FIFO 0,13 0t0 182740 pipe 2023-11-05T08:43:31.522 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 86195 root 2w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:31.522 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 86195 root 3r FIFO 0,13 0t0 182747 pipe 2023-11-05T08:43:31.522 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 86195 root 4w FIFO 0,13 0t0 182747 pipe 2023-11-05T08:43:31.522 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 86195 root 5u netlink 0t0 182752 AUDIT 2023-11-05T08:43:31.523 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 86195 root 6u unix 0xffff8da318800cc0 0t0 182753 type=DGRAM (CONNECTED) 2023-11-05T08:43:31.523 INFO:teuthology.orchestra.run.smithi156.stdout:daemon-he 86241 root cwd DIR 8,1 4096 265785 /home/ubuntu/cephtest 2023-11-05T08:43:31.523 INFO:teuthology.orchestra.run.smithi156.stdout:daemon-he 86241 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.523 INFO:teuthology.orchestra.run.smithi156.stdout:daemon-he 86241 root txt REG 8,1 15448 10498 /usr/bin/python3.9 2023-11-05T08:43:31.523 INFO:teuthology.orchestra.run.smithi156.stdout:daemon-he 86241 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-05T08:43:31.523 INFO:teuthology.orchestra.run.smithi156.stdout:daemon-he 86241 root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-05T08:43:31.524 INFO:teuthology.orchestra.run.smithi156.stdout:daemon-he 86241 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:31.524 INFO:teuthology.orchestra.run.smithi156.stdout:daemon-he 86241 root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-05T08:43:31.524 INFO:teuthology.orchestra.run.smithi156.stdout:daemon-he 86241 root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-05T08:43:31.524 INFO:teuthology.orchestra.run.smithi156.stdout:daemon-he 86241 root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-05T08:43:31.524 INFO:teuthology.orchestra.run.smithi156.stdout:daemon-he 86241 root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-05T08:43:31.525 INFO:teuthology.orchestra.run.smithi156.stdout:daemon-he 86241 root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-05T08:43:31.525 INFO:teuthology.orchestra.run.smithi156.stdout:daemon-he 86241 root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-05T08:43:31.525 INFO:teuthology.orchestra.run.smithi156.stdout:daemon-he 86241 root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-05T08:43:31.525 INFO:teuthology.orchestra.run.smithi156.stdout:daemon-he 86241 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:31.525 INFO:teuthology.orchestra.run.smithi156.stdout:daemon-he 86241 root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-05T08:43:31.526 INFO:teuthology.orchestra.run.smithi156.stdout:daemon-he 86241 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-05T08:43:31.526 INFO:teuthology.orchestra.run.smithi156.stdout:daemon-he 86241 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:31.526 INFO:teuthology.orchestra.run.smithi156.stdout:daemon-he 86241 root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-05T08:43:31.526 INFO:teuthology.orchestra.run.smithi156.stdout:daemon-he 86241 root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-05T08:43:31.526 INFO:teuthology.orchestra.run.smithi156.stdout:daemon-he 86241 root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-05T08:43:31.527 INFO:teuthology.orchestra.run.smithi156.stdout:daemon-he 86241 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-05T08:43:31.527 INFO:teuthology.orchestra.run.smithi156.stdout:daemon-he 86241 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:31.527 INFO:teuthology.orchestra.run.smithi156.stdout:daemon-he 86241 root 0r FIFO 0,13 0t0 182739 pipe 2023-11-05T08:43:31.527 INFO:teuthology.orchestra.run.smithi156.stdout:daemon-he 86241 root 1w FIFO 0,13 0t0 182740 pipe 2023-11-05T08:43:31.527 INFO:teuthology.orchestra.run.smithi156.stdout:daemon-he 86241 root 2w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:31.527 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root cwd DIR 8,1 4096 265785 /home/ubuntu/cephtest 2023-11-05T08:43:31.528 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.528 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-05T08:43:31.528 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:31.528 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:31.528 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-05T08:43:31.529 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-05T08:43:31.529 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root mem REG 8,1 15752 265597 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-05T08:43:31.529 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-05T08:43:31.529 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-05T08:43:31.529 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-05T08:43:31.529 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-05T08:43:31.530 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-05T08:43:31.530 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-05T08:43:31.530 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:31.530 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-05T08:43:31.530 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-05T08:43:31.531 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:31.531 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-05T08:43:31.531 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-05T08:43:31.531 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-05T08:43:31.531 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-05T08:43:31.531 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-05T08:43:31.532 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-05T08:43:31.532 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:31.532 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:31.532 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:31.532 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-05T08:43:31.532 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-05T08:43:31.533 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-05T08:43:31.533 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-05T08:43:31.533 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-05T08:43:31.533 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-05T08:43:31.533 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-05T08:43:31.534 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-05T08:43:31.534 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-05T08:43:31.534 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-05T08:43:31.534 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-05T08:43:31.534 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-05T08:43:31.535 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-05T08:43:31.535 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-05T08:43:31.535 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-05T08:43:31.535 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-05T08:43:31.535 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-05T08:43:31.536 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-05T08:43:31.536 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-05T08:43:31.536 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-05T08:43:31.536 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-05T08:43:31.536 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:31.537 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-05T08:43:31.537 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:31.537 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-05T08:43:31.537 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-05T08:43:31.537 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-05T08:43:31.538 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-05T08:43:31.538 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-05T08:43:31.538 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root mem REG 8,1 83456 265542 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-05T08:43:31.538 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root mem REG 8,1 370416 265532 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-05T08:43:31.538 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root mem REG 8,1 1481856 265536 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-05T08:43:31.538 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root mem REG 8,1 45648 265517 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-05T08:43:31.539 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root mem REG 8,1 41304 265576 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-05T08:43:31.539 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root mem REG 8,1 49912 265561 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-05T08:43:31.539 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root mem REG 8,1 418096 265585 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-05T08:43:31.539 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root mem REG 8,1 83208 265579 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-05T08:43:31.539 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-05T08:43:31.540 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root mem REG 8,1 79224 265555 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-05T08:43:31.540 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root mem REG 8,1 49744 265609 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-05T08:43:31.540 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root mem REG 8,1 49856 265552 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-05T08:43:31.540 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root mem REG 8,1 83632 265549 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-05T08:43:31.540 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root mem REG 8,1 78744 265606 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-05T08:43:31.540 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root mem REG 8,1 53880 265603 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-05T08:43:31.541 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root mem REG 8,1 872944 265588 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-05T08:43:31.541 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root mem REG 8,1 116592 265558 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-05T08:43:31.541 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-05T08:43:31.541 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root mem REG 8,1 1242808 265591 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-05T08:43:31.541 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root mem REG 8,1 62224 265570 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-05T08:43:31.541 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root mem REG 8,1 95808 265564 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-05T08:43:31.542 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root mem REG 8,1 37272 265600 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-05T08:43:31.542 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root mem REG 8,1 104024 265582 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-05T08:43:31.542 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root mem REG 8,1 133480 265546 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-05T08:43:31.542 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root mem REG 8,1 834760 265573 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-05T08:43:31.542 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-05T08:43:31.543 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root mem REG 8,1 129280 265594 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-05T08:43:31.543 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root mem REG 8,1 83224 265567 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-05T08:43:31.543 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root mem REG 8,1 48 3081 /tmp/vgdb-pipe-shared-mem-vgdb-86246-by-root-on-??? 2023-11-05T08:43:31.543 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root DEL REG 0,17 182056 /[aio] 2023-11-05T08:43:31.543 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root DEL REG 0,17 182868 /[aio] 2023-11-05T08:43:31.544 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.544 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root 1w FIFO 0,13 0t0 182740 pipe 2023-11-05T08:43:31.544 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root 2w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:31.544 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root 3w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:31.544 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root 4r FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:31.544 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root 5w FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:31.545 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root 6u a_inode 0,14 0 1084 [eventpoll:7,20,21,22,23,24,25,26,27,66] 2023-11-05T08:43:31.545 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root 7r FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:31.545 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root 8w FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:31.545 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root 9u a_inode 0,14 0 1084 [eventpoll:10,67] 2023-11-05T08:43:31.545 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root 10r FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:31.546 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root 11w FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:31.546 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root 12u a_inode 0,14 0 1084 [eventpoll:13] 2023-11-05T08:43:31.546 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root 13r FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:31.546 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root 14w FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:31.546 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root 15w REG 8,1 465910012 276998 /var/log/ceph/ceph-osd.7.log 2023-11-05T08:43:31.546 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root 16uW REG 0,24 6 1974 /run/ceph/ceph-osd.7.pid 2023-11-05T08:43:31.576 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root 17r FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:31.576 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root 18w FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:31.577 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root 19u unix 0xffff8da307b0b300 0t0 187412 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-05T08:43:31.577 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root 20u IPv4 185761 0t0 TCP *:6802 (LISTEN) 2023-11-05T08:43:31.577 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root 21u IPv4 185765 0t0 TCP *:6803 (LISTEN) 2023-11-05T08:43:31.577 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root 22u IPv4 185770 0t0 TCP *:6804 (LISTEN) 2023-11-05T08:43:31.577 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root 23u IPv4 185776 0t0 TCP *:6805 (LISTEN) 2023-11-05T08:43:31.578 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root 24u IPv4 185783 0t0 TCP *:6806 (LISTEN) 2023-11-05T08:43:31.578 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root 25u IPv4 185791 0t0 TCP *:6807 (LISTEN) 2023-11-05T08:43:31.578 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root 26u IPv4 185800 0t0 TCP *:6808 (LISTEN) 2023-11-05T08:43:31.578 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root 27u IPv4 185810 0t0 TCP *:6809 (LISTEN) 2023-11-05T08:43:31.578 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root 28r FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:31.579 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root 29w FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:31.579 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root 30r FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:31.579 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root 31w FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:31.579 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root 32u sock 0,8 0t0 182041 protocol: UDPv6 2023-11-05T08:43:31.579 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-05T08:43:31.579 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-05T08:43:31.580 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.580 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.580 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.580 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.580 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.581 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.581 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.581 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.581 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.581 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.582 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.582 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.582 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.582 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.582 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.582 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.583 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.583 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.583 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.583 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.583 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.584 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.584 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.584 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.584 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root 60r FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:31.584 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root 61w FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:31.584 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root 62r FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:31.585 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root 63w FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:31.585 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root 66u IPv4 199302 0t0 TCP smithi156.front.sepia.ceph.com:56964->smithi156.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-05T08:43:31.585 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root 67u IPv4 199303 0t0 TCP smithi156.front.sepia.ceph.com:6802->smithi156.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-05T08:43:31.585 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:31.585 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root *525u REG 8,1 32 3087 /tmp/valgrind_proc_86246_cmdline_85358a06 (deleted) 2023-11-05T08:43:31.586 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root *526u REG 8,1 336 3088 /tmp/valgrind_proc_86246_auxv_85358a06 (deleted) 2023-11-05T08:43:31.586 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root *527w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:31.586 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root *528w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:31.586 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root *529r FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:31.586 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root *530w FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:31.587 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 root *531r FIFO 8,1 0t0 3091 /tmp/vgdb-pipe-from-vgdb-to-86246-by-root-on-??? 2023-11-05T08:43:31.587 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root cwd DIR 8,1 4096 265785 /home/ubuntu/cephtest 2023-11-05T08:43:31.587 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.587 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-05T08:43:31.587 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:31.588 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:31.588 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-05T08:43:31.588 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-05T08:43:31.588 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root mem REG 8,1 15752 265597 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-05T08:43:31.589 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-05T08:43:31.589 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-05T08:43:31.589 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-05T08:43:31.589 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-05T08:43:31.589 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-05T08:43:31.589 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-05T08:43:31.590 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:31.590 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-05T08:43:31.590 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-05T08:43:31.590 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:31.590 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-05T08:43:31.591 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-05T08:43:31.591 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-05T08:43:31.591 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-05T08:43:31.591 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-05T08:43:31.591 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-05T08:43:31.591 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:31.592 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:31.592 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:31.592 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-05T08:43:31.592 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-05T08:43:31.592 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-05T08:43:31.593 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-05T08:43:31.593 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-05T08:43:31.593 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-05T08:43:31.593 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-05T08:43:31.593 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-05T08:43:31.593 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-05T08:43:31.594 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-05T08:43:31.594 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-05T08:43:31.594 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-05T08:43:31.594 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-05T08:43:31.594 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-05T08:43:31.595 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-05T08:43:31.595 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-05T08:43:31.595 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-05T08:43:31.595 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-05T08:43:31.595 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-05T08:43:31.595 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-05T08:43:31.596 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-05T08:43:31.596 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:31.596 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-05T08:43:31.596 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:31.596 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-05T08:43:31.597 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-05T08:43:31.597 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-05T08:43:31.597 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-05T08:43:31.597 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-05T08:43:31.597 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root mem REG 8,1 83456 265542 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-05T08:43:31.598 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root mem REG 8,1 370416 265532 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-05T08:43:31.598 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root mem REG 8,1 1481856 265536 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-05T08:43:31.598 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root mem REG 8,1 45648 265517 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-05T08:43:31.598 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root mem REG 8,1 41304 265576 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-05T08:43:31.598 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root mem REG 8,1 49912 265561 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-05T08:43:31.598 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root mem REG 8,1 418096 265585 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-05T08:43:31.599 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root mem REG 8,1 83208 265579 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-05T08:43:31.599 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-05T08:43:31.599 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root mem REG 8,1 79224 265555 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-05T08:43:31.599 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root mem REG 8,1 49744 265609 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-05T08:43:31.600 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root mem REG 8,1 49856 265552 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-05T08:43:31.600 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root mem REG 8,1 83632 265549 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-05T08:43:31.600 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root mem REG 8,1 78744 265606 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-05T08:43:31.600 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root mem REG 8,1 53880 265603 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-05T08:43:31.600 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root mem REG 8,1 872944 265588 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-05T08:43:31.600 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root mem REG 8,1 116592 265558 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-05T08:43:31.601 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-05T08:43:31.601 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root mem REG 8,1 1242808 265591 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-05T08:43:31.601 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root mem REG 8,1 62224 265570 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-05T08:43:31.601 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root mem REG 8,1 95808 265564 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-05T08:43:31.601 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root mem REG 8,1 37272 265600 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-05T08:43:31.602 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root mem REG 8,1 104024 265582 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-05T08:43:31.602 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root mem REG 8,1 133480 265546 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-05T08:43:31.602 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root mem REG 8,1 834760 265573 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-05T08:43:31.602 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-05T08:43:31.602 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root mem REG 8,1 129280 265594 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-05T08:43:31.603 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root mem REG 8,1 83224 265567 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-05T08:43:31.603 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root mem REG 8,1 48 3081 /tmp/vgdb-pipe-shared-mem-vgdb-86246-by-root-on-??? 2023-11-05T08:43:31.603 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root DEL REG 0,17 182056 /[aio] 2023-11-05T08:43:31.603 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root DEL REG 0,17 182868 /[aio] 2023-11-05T08:43:31.603 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root 0r CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.604 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root 1w FIFO 0,13 0t0 182740 pipe 2023-11-05T08:43:31.604 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root 2w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:31.604 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root 3w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:31.604 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root 4r FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:31.604 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root 5w FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:31.604 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root 6u a_inode 0,14 0 1084 [eventpoll:7,20,21,22,23,24,25,26,27,66] 2023-11-05T08:43:31.605 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root 7r FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:31.605 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root 8w FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:31.605 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root 9u a_inode 0,14 0 1084 [eventpoll:10,67] 2023-11-05T08:43:31.605 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root 10r FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:31.605 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root 11w FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:31.606 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root 12u a_inode 0,14 0 1084 [eventpoll:13] 2023-11-05T08:43:31.606 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root 13r FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:31.606 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root 14w FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:31.606 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root 15w REG 8,1 465910012 276998 /var/log/ceph/ceph-osd.7.log 2023-11-05T08:43:31.606 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root 16uW REG 0,24 6 1974 /run/ceph/ceph-osd.7.pid 2023-11-05T08:43:31.607 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root 17r FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:31.607 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root 18w FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:31.607 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root 19u unix 0xffff8da307b0b300 0t0 187412 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-05T08:43:31.607 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root 20u IPv4 185761 0t0 TCP *:6802 (LISTEN) 2023-11-05T08:43:31.607 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root 21u IPv4 185765 0t0 TCP *:6803 (LISTEN) 2023-11-05T08:43:31.607 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root 22u IPv4 185770 0t0 TCP *:6804 (LISTEN) 2023-11-05T08:43:31.608 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root 23u IPv4 185776 0t0 TCP *:6805 (LISTEN) 2023-11-05T08:43:31.608 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root 24u IPv4 185783 0t0 TCP *:6806 (LISTEN) 2023-11-05T08:43:31.608 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root 25u IPv4 185791 0t0 TCP *:6807 (LISTEN) 2023-11-05T08:43:31.608 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root 26u IPv4 185800 0t0 TCP *:6808 (LISTEN) 2023-11-05T08:43:31.608 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root 27u IPv4 185810 0t0 TCP *:6809 (LISTEN) 2023-11-05T08:43:31.609 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root 28r FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:31.609 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root 29w FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:31.609 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root 30r FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:31.609 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root 31w FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:31.609 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root 32u sock 0,8 0t0 182041 protocol: UDPv6 2023-11-05T08:43:31.610 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-05T08:43:31.610 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-05T08:43:31.610 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.610 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.610 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.610 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.611 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.611 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.611 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.611 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.612 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.612 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.612 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.612 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.612 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.612 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.613 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.613 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.613 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.613 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.613 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.614 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.614 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.614 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.614 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.614 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.615 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root 60r FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:31.615 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root 61w FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:31.615 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root 62r FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:31.615 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root 63w FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:31.615 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root 66u IPv4 199302 0t0 TCP smithi156.front.sepia.ceph.com:56964->smithi156.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-05T08:43:31.615 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root 67u IPv4 199303 0t0 TCP smithi156.front.sepia.ceph.com:6802->smithi156.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-05T08:43:31.616 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:31.616 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root *525u REG 8,1 32 3087 /tmp/valgrind_proc_86246_cmdline_85358a06 (deleted) 2023-11-05T08:43:31.616 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root *526u REG 8,1 336 3088 /tmp/valgrind_proc_86246_auxv_85358a06 (deleted) 2023-11-05T08:43:31.616 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root *527w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:31.616 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root *528w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:31.617 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root *529r FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:31.617 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root *530w FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:31.617 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86251 log root *531r FIFO 8,1 0t0 3091 /tmp/vgdb-pipe-from-vgdb-to-86246-by-root-on-??? 2023-11-05T08:43:31.617 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root cwd DIR 8,1 4096 265785 /home/ubuntu/cephtest 2023-11-05T08:43:31.617 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.617 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-05T08:43:31.618 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:31.618 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:31.618 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-05T08:43:31.618 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-05T08:43:31.618 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root mem REG 8,1 15752 265597 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-05T08:43:31.619 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-05T08:43:31.619 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-05T08:43:31.619 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-05T08:43:31.619 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-05T08:43:31.619 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-05T08:43:31.619 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-05T08:43:31.620 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:31.620 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-05T08:43:31.620 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-05T08:43:31.620 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:31.620 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-05T08:43:31.621 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-05T08:43:31.621 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-05T08:43:31.621 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-05T08:43:31.621 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-05T08:43:31.621 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-05T08:43:31.621 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:31.622 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:31.622 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:31.622 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-05T08:43:31.622 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-05T08:43:31.622 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-05T08:43:31.623 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-05T08:43:31.623 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-05T08:43:31.623 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-05T08:43:31.623 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-05T08:43:31.623 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-05T08:43:31.624 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-05T08:43:31.624 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-05T08:43:31.624 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-05T08:43:31.624 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-05T08:43:31.624 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-05T08:43:31.625 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-05T08:43:31.625 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-05T08:43:31.625 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-05T08:43:31.625 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-05T08:43:31.625 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-05T08:43:31.625 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-05T08:43:31.626 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-05T08:43:31.626 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-05T08:43:31.626 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:31.626 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-05T08:43:31.626 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:31.627 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-05T08:43:31.627 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-05T08:43:31.627 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-05T08:43:31.627 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-05T08:43:31.627 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-05T08:43:31.627 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root mem REG 8,1 83456 265542 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-05T08:43:31.628 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root mem REG 8,1 370416 265532 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-05T08:43:31.628 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root mem REG 8,1 1481856 265536 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-05T08:43:31.628 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root mem REG 8,1 45648 265517 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-05T08:43:31.628 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root mem REG 8,1 41304 265576 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-05T08:43:31.628 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root mem REG 8,1 49912 265561 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-05T08:43:31.629 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root mem REG 8,1 418096 265585 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-05T08:43:31.629 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root mem REG 8,1 83208 265579 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-05T08:43:31.629 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-05T08:43:31.629 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root mem REG 8,1 79224 265555 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-05T08:43:31.629 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root mem REG 8,1 49744 265609 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-05T08:43:31.629 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root mem REG 8,1 49856 265552 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-05T08:43:31.630 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root mem REG 8,1 83632 265549 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-05T08:43:31.630 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root mem REG 8,1 78744 265606 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-05T08:43:31.630 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root mem REG 8,1 53880 265603 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-05T08:43:31.630 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root mem REG 8,1 872944 265588 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-05T08:43:31.630 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root mem REG 8,1 116592 265558 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-05T08:43:31.631 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-05T08:43:31.631 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root mem REG 8,1 1242808 265591 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-05T08:43:31.631 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root mem REG 8,1 62224 265570 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-05T08:43:31.631 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root mem REG 8,1 95808 265564 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-05T08:43:31.631 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root mem REG 8,1 37272 265600 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-05T08:43:31.632 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root mem REG 8,1 104024 265582 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-05T08:43:31.632 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root mem REG 8,1 133480 265546 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-05T08:43:31.632 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root mem REG 8,1 834760 265573 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-05T08:43:31.632 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-05T08:43:31.632 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root mem REG 8,1 129280 265594 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-05T08:43:31.632 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root mem REG 8,1 83224 265567 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-05T08:43:31.633 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root mem REG 8,1 48 3081 /tmp/vgdb-pipe-shared-mem-vgdb-86246-by-root-on-??? 2023-11-05T08:43:31.633 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root DEL REG 0,17 182056 /[aio] 2023-11-05T08:43:31.633 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root DEL REG 0,17 182868 /[aio] 2023-11-05T08:43:31.633 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.633 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root 1w FIFO 0,13 0t0 182740 pipe 2023-11-05T08:43:31.634 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root 2w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:31.634 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root 3w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:31.634 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root 4r FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:31.634 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root 5w FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:31.634 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root 6u a_inode 0,14 0 1084 [eventpoll:7,20,21,22,23,24,25,26,27,66] 2023-11-05T08:43:31.635 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root 7r FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:31.635 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root 8w FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:31.635 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root 9u a_inode 0,14 0 1084 [eventpoll:10,67] 2023-11-05T08:43:31.635 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root 10r FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:31.635 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root 11w FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:31.636 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root 12u a_inode 0,14 0 1084 [eventpoll:13] 2023-11-05T08:43:31.636 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root 13r FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:31.636 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root 14w FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:31.636 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root 15w REG 8,1 465910012 276998 /var/log/ceph/ceph-osd.7.log 2023-11-05T08:43:31.636 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root 16uW REG 0,24 6 1974 /run/ceph/ceph-osd.7.pid 2023-11-05T08:43:31.636 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root 17r FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:31.637 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root 18w FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:31.637 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root 19u unix 0xffff8da307b0b300 0t0 187412 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-05T08:43:31.637 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root 20u IPv4 185761 0t0 TCP *:6802 (LISTEN) 2023-11-05T08:43:31.637 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root 21u IPv4 185765 0t0 TCP *:6803 (LISTEN) 2023-11-05T08:43:31.637 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root 22u IPv4 185770 0t0 TCP *:6804 (LISTEN) 2023-11-05T08:43:31.638 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root 23u IPv4 185776 0t0 TCP *:6805 (LISTEN) 2023-11-05T08:43:31.638 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root 24u IPv4 185783 0t0 TCP *:6806 (LISTEN) 2023-11-05T08:43:31.638 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root 25u IPv4 185791 0t0 TCP *:6807 (LISTEN) 2023-11-05T08:43:31.638 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root 26u IPv4 185800 0t0 TCP *:6808 (LISTEN) 2023-11-05T08:43:31.638 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root 27u IPv4 185810 0t0 TCP *:6809 (LISTEN) 2023-11-05T08:43:31.639 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root 28r FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:31.639 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root 29w FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:31.639 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root 30r FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:31.639 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root 31w FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:31.639 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root 32u sock 0,8 0t0 182041 protocol: UDPv6 2023-11-05T08:43:31.640 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-05T08:43:31.640 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-05T08:43:31.640 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.640 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.640 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.640 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.641 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.641 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.641 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.641 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.641 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.642 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.642 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.642 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.642 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.642 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.643 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.643 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.643 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.643 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.643 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.643 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.644 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.644 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.644 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.644 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.644 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root 60r FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:31.645 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root 61w FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:31.645 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root 62r FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:31.645 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root 63w FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:31.645 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root 66u IPv4 199302 0t0 TCP smithi156.front.sepia.ceph.com:56964->smithi156.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-05T08:43:31.645 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root 67u IPv4 199303 0t0 TCP smithi156.front.sepia.ceph.com:6802->smithi156.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-05T08:43:31.646 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:31.646 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root *525u REG 8,1 32 3087 /tmp/valgrind_proc_86246_cmdline_85358a06 (deleted) 2023-11-05T08:43:31.646 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root *526u REG 8,1 336 3088 /tmp/valgrind_proc_86246_auxv_85358a06 (deleted) 2023-11-05T08:43:31.646 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root *527w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:31.646 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root *528w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:31.647 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root *529r FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:31.647 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root *530w FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:31.647 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86258 msgr-work root *531r FIFO 8,1 0t0 3091 /tmp/vgdb-pipe-from-vgdb-to-86246-by-root-on-??? 2023-11-05T08:43:31.647 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root cwd DIR 8,1 4096 265785 /home/ubuntu/cephtest 2023-11-05T08:43:31.647 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.648 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-05T08:43:31.648 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:31.648 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:31.648 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-05T08:43:31.648 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-05T08:43:31.649 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root mem REG 8,1 15752 265597 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-05T08:43:31.649 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-05T08:43:31.649 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-05T08:43:31.649 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-05T08:43:31.649 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-05T08:43:31.649 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-05T08:43:31.650 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-05T08:43:31.650 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:31.650 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-05T08:43:31.650 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-05T08:43:31.650 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:31.651 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-05T08:43:31.651 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-05T08:43:31.651 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-05T08:43:31.651 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-05T08:43:31.651 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-05T08:43:31.652 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-05T08:43:31.652 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:31.652 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:31.652 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:31.652 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-05T08:43:31.652 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-05T08:43:31.653 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-05T08:43:31.653 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-05T08:43:31.653 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-05T08:43:31.653 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-05T08:43:31.653 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-05T08:43:31.654 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-05T08:43:31.654 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-05T08:43:31.654 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-05T08:43:31.654 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-05T08:43:31.654 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-05T08:43:31.654 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-05T08:43:31.655 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-05T08:43:31.655 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-05T08:43:31.655 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-05T08:43:31.655 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-05T08:43:31.655 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-05T08:43:31.656 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-05T08:43:31.656 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-05T08:43:31.656 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-05T08:43:31.656 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:31.656 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-05T08:43:31.656 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:31.657 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-05T08:43:31.782 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-05T08:43:31.782 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-05T08:43:31.783 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-05T08:43:31.783 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-05T08:43:31.783 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root mem REG 8,1 83456 265542 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-05T08:43:31.783 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root mem REG 8,1 370416 265532 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-05T08:43:31.784 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root mem REG 8,1 1481856 265536 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-05T08:43:31.784 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root mem REG 8,1 45648 265517 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-05T08:43:31.784 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root mem REG 8,1 41304 265576 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-05T08:43:31.784 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root mem REG 8,1 49912 265561 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-05T08:43:31.784 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root mem REG 8,1 418096 265585 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-05T08:43:31.785 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root mem REG 8,1 83208 265579 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-05T08:43:31.785 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-05T08:43:31.785 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root mem REG 8,1 79224 265555 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-05T08:43:31.785 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root mem REG 8,1 49744 265609 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-05T08:43:31.785 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root mem REG 8,1 49856 265552 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-05T08:43:31.785 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root mem REG 8,1 83632 265549 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-05T08:43:31.786 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root mem REG 8,1 78744 265606 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-05T08:43:31.786 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root mem REG 8,1 53880 265603 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-05T08:43:31.786 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root mem REG 8,1 872944 265588 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-05T08:43:31.786 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root mem REG 8,1 116592 265558 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-05T08:43:31.786 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-05T08:43:31.787 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root mem REG 8,1 1242808 265591 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-05T08:43:31.787 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root mem REG 8,1 62224 265570 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-05T08:43:31.787 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root mem REG 8,1 95808 265564 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-05T08:43:31.787 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root mem REG 8,1 37272 265600 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-05T08:43:31.787 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root mem REG 8,1 104024 265582 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-05T08:43:31.788 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root mem REG 8,1 133480 265546 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-05T08:43:31.788 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root mem REG 8,1 834760 265573 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-05T08:43:31.788 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-05T08:43:31.788 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root mem REG 8,1 129280 265594 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-05T08:43:31.788 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root mem REG 8,1 83224 265567 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-05T08:43:31.788 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root mem REG 8,1 48 3081 /tmp/vgdb-pipe-shared-mem-vgdb-86246-by-root-on-??? 2023-11-05T08:43:31.789 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root DEL REG 0,17 182056 /[aio] 2023-11-05T08:43:31.789 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root DEL REG 0,17 182868 /[aio] 2023-11-05T08:43:31.789 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.789 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root 1w FIFO 0,13 0t0 182740 pipe 2023-11-05T08:43:31.789 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root 2w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:31.790 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root 3w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:31.790 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root 4r FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:31.790 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root 5w FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:31.790 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root 6u a_inode 0,14 0 1084 [eventpoll:7,20,21,22,23,24,25,26,27,66] 2023-11-05T08:43:31.790 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root 7r FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:31.791 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root 8w FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:31.791 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root 9u a_inode 0,14 0 1084 [eventpoll:10,67] 2023-11-05T08:43:31.791 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root 10r FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:31.791 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root 11w FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:31.791 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root 12u a_inode 0,14 0 1084 [eventpoll:13] 2023-11-05T08:43:31.791 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root 13r FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:31.792 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root 14w FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:31.792 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root 15w REG 8,1 465910012 276998 /var/log/ceph/ceph-osd.7.log 2023-11-05T08:43:31.792 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root 16uW REG 0,24 6 1974 /run/ceph/ceph-osd.7.pid 2023-11-05T08:43:31.792 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root 17r FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:31.792 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root 18w FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:31.793 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root 19u unix 0xffff8da307b0b300 0t0 187412 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-05T08:43:31.793 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root 20u IPv4 185761 0t0 TCP *:6802 (LISTEN) 2023-11-05T08:43:31.793 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root 21u IPv4 185765 0t0 TCP *:6803 (LISTEN) 2023-11-05T08:43:31.793 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root 22u IPv4 185770 0t0 TCP *:6804 (LISTEN) 2023-11-05T08:43:31.793 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root 23u IPv4 185776 0t0 TCP *:6805 (LISTEN) 2023-11-05T08:43:31.793 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root 24u IPv4 185783 0t0 TCP *:6806 (LISTEN) 2023-11-05T08:43:31.794 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root 25u IPv4 185791 0t0 TCP *:6807 (LISTEN) 2023-11-05T08:43:31.794 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root 26u IPv4 185800 0t0 TCP *:6808 (LISTEN) 2023-11-05T08:43:31.794 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root 27u IPv4 185810 0t0 TCP *:6809 (LISTEN) 2023-11-05T08:43:31.794 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root 28r FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:31.795 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root 29w FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:31.795 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root 30r FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:31.795 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root 31w FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:31.795 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root 32u sock 0,8 0t0 182041 protocol: UDPv6 2023-11-05T08:43:31.795 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-05T08:43:31.795 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-05T08:43:31.796 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.796 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.796 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.796 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.796 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.797 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.797 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.797 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.797 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.797 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.798 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.798 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.798 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.798 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.798 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.798 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.799 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.799 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.799 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.799 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.799 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.800 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.800 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.800 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.800 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root 60r FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:31.800 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root 61w FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:31.800 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root 62r FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:31.801 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root 63w FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:31.801 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root 66u IPv4 199302 0t0 TCP smithi156.front.sepia.ceph.com:56964->smithi156.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-05T08:43:31.801 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root 67u IPv4 199303 0t0 TCP smithi156.front.sepia.ceph.com:6802->smithi156.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-05T08:43:31.801 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:31.801 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root *525u REG 8,1 32 3087 /tmp/valgrind_proc_86246_cmdline_85358a06 (deleted) 2023-11-05T08:43:31.802 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root *526u REG 8,1 336 3088 /tmp/valgrind_proc_86246_auxv_85358a06 (deleted) 2023-11-05T08:43:31.802 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root *527w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:31.802 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root *528w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:31.802 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root *529r FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:31.802 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root *530w FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:31.802 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86259 msgr-work root *531r FIFO 8,1 0t0 3091 /tmp/vgdb-pipe-from-vgdb-to-86246-by-root-on-??? 2023-11-05T08:43:31.803 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root cwd DIR 8,1 4096 265785 /home/ubuntu/cephtest 2023-11-05T08:43:31.803 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.803 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-05T08:43:31.803 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:31.803 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:31.804 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-05T08:43:31.804 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-05T08:43:31.804 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root mem REG 8,1 15752 265597 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-05T08:43:31.804 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-05T08:43:31.804 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-05T08:43:31.804 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-05T08:43:31.805 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-05T08:43:31.805 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-05T08:43:31.805 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-05T08:43:31.805 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:31.805 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-05T08:43:31.806 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-05T08:43:31.806 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:31.806 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-05T08:43:31.806 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-05T08:43:31.806 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-05T08:43:31.807 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-05T08:43:31.807 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-05T08:43:31.807 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-05T08:43:31.807 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:31.807 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:31.808 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:31.808 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-05T08:43:31.808 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-05T08:43:31.808 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-05T08:43:31.808 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-05T08:43:31.808 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-05T08:43:31.809 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-05T08:43:31.809 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-05T08:43:31.809 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-05T08:43:31.809 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-05T08:43:31.809 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-05T08:43:31.810 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-05T08:43:31.810 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-05T08:43:31.810 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-05T08:43:31.810 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-05T08:43:31.810 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-05T08:43:31.810 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-05T08:43:31.811 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-05T08:43:31.811 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-05T08:43:31.811 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-05T08:43:31.811 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-05T08:43:31.811 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-05T08:43:31.812 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:31.812 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-05T08:43:31.812 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:31.812 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-05T08:43:31.812 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-05T08:43:31.812 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-05T08:43:31.813 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-05T08:43:31.813 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-05T08:43:31.813 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root mem REG 8,1 83456 265542 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-05T08:43:31.813 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root mem REG 8,1 370416 265532 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-05T08:43:31.813 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root mem REG 8,1 1481856 265536 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-05T08:43:31.814 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root mem REG 8,1 45648 265517 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-05T08:43:31.814 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root mem REG 8,1 41304 265576 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-05T08:43:31.814 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root mem REG 8,1 49912 265561 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-05T08:43:31.814 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root mem REG 8,1 418096 265585 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-05T08:43:31.814 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root mem REG 8,1 83208 265579 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-05T08:43:31.814 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-05T08:43:31.815 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root mem REG 8,1 79224 265555 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-05T08:43:31.815 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root mem REG 8,1 49744 265609 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-05T08:43:31.815 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root mem REG 8,1 49856 265552 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-05T08:43:31.815 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root mem REG 8,1 83632 265549 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-05T08:43:31.815 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root mem REG 8,1 78744 265606 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-05T08:43:31.816 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root mem REG 8,1 53880 265603 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-05T08:43:31.816 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root mem REG 8,1 872944 265588 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-05T08:43:31.816 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root mem REG 8,1 116592 265558 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-05T08:43:31.816 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-05T08:43:31.816 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root mem REG 8,1 1242808 265591 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-05T08:43:31.816 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root mem REG 8,1 62224 265570 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-05T08:43:31.817 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root mem REG 8,1 95808 265564 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-05T08:43:31.817 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root mem REG 8,1 37272 265600 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-05T08:43:31.817 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root mem REG 8,1 104024 265582 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-05T08:43:31.817 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root mem REG 8,1 133480 265546 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-05T08:43:31.817 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root mem REG 8,1 834760 265573 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-05T08:43:31.818 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-05T08:43:31.818 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root mem REG 8,1 129280 265594 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-05T08:43:31.818 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root mem REG 8,1 83224 265567 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-05T08:43:31.818 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root mem REG 8,1 48 3081 /tmp/vgdb-pipe-shared-mem-vgdb-86246-by-root-on-??? 2023-11-05T08:43:31.818 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root DEL REG 0,17 182056 /[aio] 2023-11-05T08:43:31.819 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root DEL REG 0,17 182868 /[aio] 2023-11-05T08:43:31.819 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.819 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root 1w FIFO 0,13 0t0 182740 pipe 2023-11-05T08:43:31.819 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root 2w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:31.819 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root 3w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:31.819 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root 4r FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:31.820 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root 5w FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:31.820 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root 6u a_inode 0,14 0 1084 [eventpoll:7,20,21,22,23,24,25,26,27,66] 2023-11-05T08:43:31.820 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root 7r FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:31.820 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root 8w FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:31.820 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root 9u a_inode 0,14 0 1084 [eventpoll:10,67] 2023-11-05T08:43:31.821 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root 10r FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:31.821 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root 11w FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:31.821 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root 12u a_inode 0,14 0 1084 [eventpoll:13] 2023-11-05T08:43:31.821 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root 13r FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:31.821 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root 14w FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:31.821 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root 15w REG 8,1 465910012 276998 /var/log/ceph/ceph-osd.7.log 2023-11-05T08:43:31.822 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root 16uW REG 0,24 6 1974 /run/ceph/ceph-osd.7.pid 2023-11-05T08:43:31.822 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root 17r FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:31.822 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root 18w FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:31.822 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root 19u unix 0xffff8da307b0b300 0t0 187412 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-05T08:43:31.822 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root 20u IPv4 185761 0t0 TCP *:6802 (LISTEN) 2023-11-05T08:43:31.823 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root 21u IPv4 185765 0t0 TCP *:6803 (LISTEN) 2023-11-05T08:43:31.823 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root 22u IPv4 185770 0t0 TCP *:6804 (LISTEN) 2023-11-05T08:43:31.823 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root 23u IPv4 185776 0t0 TCP *:6805 (LISTEN) 2023-11-05T08:43:31.823 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root 24u IPv4 185783 0t0 TCP *:6806 (LISTEN) 2023-11-05T08:43:31.823 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root 25u IPv4 185791 0t0 TCP *:6807 (LISTEN) 2023-11-05T08:43:31.824 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root 26u IPv4 185800 0t0 TCP *:6808 (LISTEN) 2023-11-05T08:43:31.824 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root 27u IPv4 185810 0t0 TCP *:6809 (LISTEN) 2023-11-05T08:43:31.824 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root 28r FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:31.824 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root 29w FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:31.824 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root 30r FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:31.824 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root 31w FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:31.825 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root 32u sock 0,8 0t0 182041 protocol: UDPv6 2023-11-05T08:43:31.825 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-05T08:43:31.825 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-05T08:43:31.825 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.825 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.825 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.826 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.826 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.826 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.826 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.826 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.827 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.827 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.827 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.827 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.827 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.827 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.828 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.828 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.828 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.828 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.828 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.829 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.829 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.829 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.829 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.829 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.830 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root 60r FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:31.830 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root 61w FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:31.830 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root 62r FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:31.830 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root 63w FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:31.830 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root 66u IPv4 199302 0t0 TCP smithi156.front.sepia.ceph.com:56964->smithi156.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-05T08:43:31.831 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root 67u IPv4 199303 0t0 TCP smithi156.front.sepia.ceph.com:6802->smithi156.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-05T08:43:31.831 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:31.831 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root *525u REG 8,1 32 3087 /tmp/valgrind_proc_86246_cmdline_85358a06 (deleted) 2023-11-05T08:43:31.831 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root *526u REG 8,1 336 3088 /tmp/valgrind_proc_86246_auxv_85358a06 (deleted) 2023-11-05T08:43:31.831 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root *527w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:31.832 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root *528w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:31.832 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root *529r FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:31.832 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root *530w FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:31.832 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86261 msgr-work root *531r FIFO 8,1 0t0 3091 /tmp/vgdb-pipe-from-vgdb-to-86246-by-root-on-??? 2023-11-05T08:43:31.832 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root cwd DIR 8,1 4096 265785 /home/ubuntu/cephtest 2023-11-05T08:43:31.832 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.833 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-05T08:43:31.833 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:31.833 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:31.833 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-05T08:43:31.833 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-05T08:43:31.833 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root mem REG 8,1 15752 265597 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-05T08:43:31.834 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-05T08:43:31.834 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-05T08:43:31.834 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-05T08:43:31.834 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-05T08:43:31.834 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-05T08:43:31.835 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-05T08:43:31.835 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:31.835 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-05T08:43:31.835 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-05T08:43:31.835 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:31.835 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-05T08:43:31.836 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-05T08:43:31.836 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-05T08:43:31.836 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-05T08:43:31.836 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-05T08:43:31.836 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-05T08:43:31.837 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:31.837 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:31.837 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:31.837 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-05T08:43:31.837 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-05T08:43:31.838 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-05T08:43:31.838 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-05T08:43:31.838 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-05T08:43:31.838 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-05T08:43:31.838 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-05T08:43:31.838 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-05T08:43:31.839 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-05T08:43:31.839 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-05T08:43:31.839 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-05T08:43:31.839 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-05T08:43:31.839 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-05T08:43:31.840 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-05T08:43:31.840 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-05T08:43:31.840 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-05T08:43:31.840 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-05T08:43:31.840 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-05T08:43:31.841 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-05T08:43:31.841 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-05T08:43:31.841 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-05T08:43:31.841 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:31.841 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-05T08:43:31.841 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:31.842 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-05T08:43:31.842 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-05T08:43:31.842 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-05T08:43:31.842 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-05T08:43:31.842 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-05T08:43:31.843 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root mem REG 8,1 83456 265542 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-05T08:43:31.843 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root mem REG 8,1 370416 265532 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-05T08:43:31.843 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root mem REG 8,1 1481856 265536 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-05T08:43:31.843 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root mem REG 8,1 45648 265517 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-05T08:43:31.843 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root mem REG 8,1 41304 265576 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-05T08:43:31.843 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root mem REG 8,1 49912 265561 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-05T08:43:31.844 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root mem REG 8,1 418096 265585 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-05T08:43:31.844 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root mem REG 8,1 83208 265579 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-05T08:43:31.844 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-05T08:43:31.844 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root mem REG 8,1 79224 265555 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-05T08:43:31.844 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root mem REG 8,1 49744 265609 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-05T08:43:31.845 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root mem REG 8,1 49856 265552 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-05T08:43:31.845 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root mem REG 8,1 83632 265549 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-05T08:43:31.845 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root mem REG 8,1 78744 265606 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-05T08:43:31.845 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root mem REG 8,1 53880 265603 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-05T08:43:31.845 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root mem REG 8,1 872944 265588 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-05T08:43:31.845 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root mem REG 8,1 116592 265558 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-05T08:43:31.846 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-05T08:43:31.846 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root mem REG 8,1 1242808 265591 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-05T08:43:31.846 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root mem REG 8,1 62224 265570 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-05T08:43:31.846 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root mem REG 8,1 95808 265564 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-05T08:43:31.846 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root mem REG 8,1 37272 265600 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-05T08:43:31.847 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root mem REG 8,1 104024 265582 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-05T08:43:31.847 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root mem REG 8,1 133480 265546 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-05T08:43:31.847 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root mem REG 8,1 834760 265573 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-05T08:43:31.847 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-05T08:43:31.847 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root mem REG 8,1 129280 265594 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-05T08:43:31.848 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root mem REG 8,1 83224 265567 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-05T08:43:31.848 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root mem REG 8,1 48 3081 /tmp/vgdb-pipe-shared-mem-vgdb-86246-by-root-on-??? 2023-11-05T08:43:31.848 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root DEL REG 0,17 182056 /[aio] 2023-11-05T08:43:31.848 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root DEL REG 0,17 182868 /[aio] 2023-11-05T08:43:31.848 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root 0r CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.848 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root 1w FIFO 0,13 0t0 182740 pipe 2023-11-05T08:43:31.849 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root 2w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:31.849 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root 3w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:31.849 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root 4r FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:31.849 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root 5w FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:31.849 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root 6u a_inode 0,14 0 1084 [eventpoll:7,20,21,22,23,24,25,26,27,66] 2023-11-05T08:43:31.849 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root 7r FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:31.850 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root 8w FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:31.850 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root 9u a_inode 0,14 0 1084 [eventpoll:10,67] 2023-11-05T08:43:31.850 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root 10r FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:31.850 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root 11w FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:31.850 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root 12u a_inode 0,14 0 1084 [eventpoll:13] 2023-11-05T08:43:31.851 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root 13r FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:31.851 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root 14w FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:31.851 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root 15w REG 8,1 465910012 276998 /var/log/ceph/ceph-osd.7.log 2023-11-05T08:43:31.851 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root 16uW REG 0,24 6 1974 /run/ceph/ceph-osd.7.pid 2023-11-05T08:43:31.852 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root 17r FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:31.852 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root 18w FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:31.852 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root 19u unix 0xffff8da307b0b300 0t0 187412 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-05T08:43:31.852 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root 20u IPv4 185761 0t0 TCP *:6802 (LISTEN) 2023-11-05T08:43:31.852 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root 21u IPv4 185765 0t0 TCP *:6803 (LISTEN) 2023-11-05T08:43:31.852 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root 22u IPv4 185770 0t0 TCP *:6804 (LISTEN) 2023-11-05T08:43:31.853 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root 23u IPv4 185776 0t0 TCP *:6805 (LISTEN) 2023-11-05T08:43:31.853 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root 24u IPv4 185783 0t0 TCP *:6806 (LISTEN) 2023-11-05T08:43:31.853 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root 25u IPv4 185791 0t0 TCP *:6807 (LISTEN) 2023-11-05T08:43:31.853 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root 26u IPv4 185800 0t0 TCP *:6808 (LISTEN) 2023-11-05T08:43:31.853 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root 27u IPv4 185810 0t0 TCP *:6809 (LISTEN) 2023-11-05T08:43:31.854 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root 28r FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:31.854 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root 29w FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:31.854 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root 30r FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:31.854 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root 31w FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:31.854 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root 32u sock 0,8 0t0 182041 protocol: UDPv6 2023-11-05T08:43:31.854 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-05T08:43:31.855 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-05T08:43:31.855 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.855 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.855 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.855 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.856 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.856 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.856 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.856 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.856 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.856 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.857 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.857 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.857 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.857 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.857 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.857 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.858 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.858 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.858 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.858 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.858 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.859 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.859 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.859 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.859 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root 60r FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:31.859 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root 61w FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:31.860 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root 62r FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:31.860 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root 63w FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:31.860 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root 66u IPv4 199302 0t0 TCP smithi156.front.sepia.ceph.com:56964->smithi156.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-05T08:43:31.860 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root 67u IPv4 199303 0t0 TCP smithi156.front.sepia.ceph.com:6802->smithi156.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-05T08:43:31.860 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:31.860 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root *525u REG 8,1 32 3087 /tmp/valgrind_proc_86246_cmdline_85358a06 (deleted) 2023-11-05T08:43:31.861 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root *526u REG 8,1 336 3088 /tmp/valgrind_proc_86246_auxv_85358a06 (deleted) 2023-11-05T08:43:31.861 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root *527w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:31.861 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root *528w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:31.861 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root *529r FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:31.861 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root *530w FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:31.862 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86283 service root *531r FIFO 8,1 0t0 3091 /tmp/vgdb-pipe-from-vgdb-to-86246-by-root-on-??? 2023-11-05T08:43:31.862 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root cwd DIR 8,1 4096 265785 /home/ubuntu/cephtest 2023-11-05T08:43:31.862 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.862 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-05T08:43:31.862 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:31.863 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:31.863 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-05T08:43:31.863 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-05T08:43:31.863 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root mem REG 8,1 15752 265597 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-05T08:43:31.863 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-05T08:43:31.864 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-05T08:43:31.864 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-05T08:43:31.864 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-05T08:43:31.864 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-05T08:43:31.864 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-05T08:43:31.865 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:31.865 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-05T08:43:31.865 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-05T08:43:31.865 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:31.865 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-05T08:43:31.865 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-05T08:43:31.866 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-05T08:43:31.866 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-05T08:43:31.866 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-05T08:43:31.866 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-05T08:43:31.866 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:31.867 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:31.867 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:31.867 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-05T08:43:31.867 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-05T08:43:31.867 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-05T08:43:31.867 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-05T08:43:31.868 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-05T08:43:31.868 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-05T08:43:31.868 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-05T08:43:31.868 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-05T08:43:31.868 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-05T08:43:31.869 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-05T08:43:31.869 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-05T08:43:31.869 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-05T08:43:31.869 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-05T08:43:31.869 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-05T08:43:31.869 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-05T08:43:31.870 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-05T08:43:31.870 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-05T08:43:31.870 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-05T08:43:31.870 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-05T08:43:31.870 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-05T08:43:31.871 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-05T08:43:31.871 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:31.871 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-05T08:43:31.871 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:31.871 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-05T08:43:31.871 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-05T08:43:31.872 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-05T08:43:31.872 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-05T08:43:31.872 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-05T08:43:31.872 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root mem REG 8,1 83456 265542 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-05T08:43:31.872 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root mem REG 8,1 370416 265532 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-05T08:43:31.873 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root mem REG 8,1 1481856 265536 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-05T08:43:31.873 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root mem REG 8,1 45648 265517 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-05T08:43:31.873 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root mem REG 8,1 41304 265576 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-05T08:43:31.873 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root mem REG 8,1 49912 265561 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-05T08:43:31.873 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root mem REG 8,1 418096 265585 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-05T08:43:31.873 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root mem REG 8,1 83208 265579 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-05T08:43:31.874 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-05T08:43:31.874 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root mem REG 8,1 79224 265555 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-05T08:43:31.874 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root mem REG 8,1 49744 265609 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-05T08:43:31.874 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root mem REG 8,1 49856 265552 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-05T08:43:31.875 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root mem REG 8,1 83632 265549 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-05T08:43:31.875 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root mem REG 8,1 78744 265606 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-05T08:43:31.875 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root mem REG 8,1 53880 265603 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-05T08:43:31.875 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root mem REG 8,1 872944 265588 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-05T08:43:31.875 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root mem REG 8,1 116592 265558 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-05T08:43:31.875 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-05T08:43:31.876 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root mem REG 8,1 1242808 265591 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-05T08:43:31.876 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root mem REG 8,1 62224 265570 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-05T08:43:31.876 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root mem REG 8,1 95808 265564 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-05T08:43:31.876 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root mem REG 8,1 37272 265600 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-05T08:43:31.876 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root mem REG 8,1 104024 265582 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-05T08:43:31.877 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root mem REG 8,1 133480 265546 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-05T08:43:31.877 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root mem REG 8,1 834760 265573 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-05T08:43:31.877 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-05T08:43:31.877 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root mem REG 8,1 129280 265594 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-05T08:43:31.877 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root mem REG 8,1 83224 265567 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-05T08:43:31.878 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root mem REG 8,1 48 3081 /tmp/vgdb-pipe-shared-mem-vgdb-86246-by-root-on-??? 2023-11-05T08:43:31.878 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root DEL REG 0,17 182056 /[aio] 2023-11-05T08:43:31.878 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root DEL REG 0,17 182868 /[aio] 2023-11-05T08:43:31.878 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root 0r CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.878 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root 1w FIFO 0,13 0t0 182740 pipe 2023-11-05T08:43:31.878 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root 2w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:31.879 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root 3w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:31.879 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root 4r FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:31.879 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root 5w FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:31.879 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root 6u a_inode 0,14 0 1084 [eventpoll:7,20,21,22,23,24,25,26,27,66] 2023-11-05T08:43:31.879 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root 7r FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:31.880 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root 8w FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:31.880 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root 9u a_inode 0,14 0 1084 [eventpoll:10,67] 2023-11-05T08:43:31.880 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root 10r FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:31.880 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root 11w FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:31.880 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root 12u a_inode 0,14 0 1084 [eventpoll:13] 2023-11-05T08:43:31.881 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root 13r FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:31.881 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root 14w FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:31.881 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root 15w REG 8,1 465910012 276998 /var/log/ceph/ceph-osd.7.log 2023-11-05T08:43:31.881 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root 16uW REG 0,24 6 1974 /run/ceph/ceph-osd.7.pid 2023-11-05T08:43:31.881 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root 17r FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:31.881 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root 18w FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:31.882 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root 19u unix 0xffff8da307b0b300 0t0 187412 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-05T08:43:31.882 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root 20u IPv4 185761 0t0 TCP *:6802 (LISTEN) 2023-11-05T08:43:31.882 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root 21u IPv4 185765 0t0 TCP *:6803 (LISTEN) 2023-11-05T08:43:31.882 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root 22u IPv4 185770 0t0 TCP *:6804 (LISTEN) 2023-11-05T08:43:31.882 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root 23u IPv4 185776 0t0 TCP *:6805 (LISTEN) 2023-11-05T08:43:31.883 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root 24u IPv4 185783 0t0 TCP *:6806 (LISTEN) 2023-11-05T08:43:31.883 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root 25u IPv4 185791 0t0 TCP *:6807 (LISTEN) 2023-11-05T08:43:31.883 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root 26u IPv4 185800 0t0 TCP *:6808 (LISTEN) 2023-11-05T08:43:31.883 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root 27u IPv4 185810 0t0 TCP *:6809 (LISTEN) 2023-11-05T08:43:31.883 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root 28r FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:31.883 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root 29w FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:31.884 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root 30r FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:31.884 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root 31w FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:31.884 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root 32u sock 0,8 0t0 182041 protocol: UDPv6 2023-11-05T08:43:31.884 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-05T08:43:31.884 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-05T08:43:31.885 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.885 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.885 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.885 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.885 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.886 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.886 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.886 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.886 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.886 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.887 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.887 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.887 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.887 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.887 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.888 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.888 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.888 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.888 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.888 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.889 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.889 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.889 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.889 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.889 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root 60r FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:31.889 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root 61w FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:31.890 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root 62r FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:31.890 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root 63w FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:31.890 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root 66u IPv4 199302 0t0 TCP smithi156.front.sepia.ceph.com:56964->smithi156.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-05T08:43:31.890 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root 67u IPv4 199303 0t0 TCP smithi156.front.sepia.ceph.com:6802->smithi156.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-05T08:43:31.890 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:31.891 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root *525u REG 8,1 32 3087 /tmp/valgrind_proc_86246_cmdline_85358a06 (deleted) 2023-11-05T08:43:31.891 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root *526u REG 8,1 336 3088 /tmp/valgrind_proc_86246_auxv_85358a06 (deleted) 2023-11-05T08:43:31.891 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root *527w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:31.891 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root *528w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:31.891 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root *529r FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:31.892 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root *530w FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:31.892 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86284 admin_soc root *531r FIFO 8,1 0t0 3091 /tmp/vgdb-pipe-from-vgdb-to-86246-by-root-on-??? 2023-11-05T08:43:31.892 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root cwd DIR 8,1 4096 265785 /home/ubuntu/cephtest 2023-11-05T08:43:31.892 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.892 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-05T08:43:31.892 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:31.893 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:31.893 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-05T08:43:31.893 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-05T08:43:31.893 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root mem REG 8,1 15752 265597 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-05T08:43:31.893 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-05T08:43:31.894 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-05T08:43:31.894 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-05T08:43:31.894 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-05T08:43:31.894 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-05T08:43:31.894 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-05T08:43:31.895 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:31.895 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-05T08:43:31.895 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-05T08:43:31.895 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:31.895 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-05T08:43:31.895 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-05T08:43:31.896 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-05T08:43:31.896 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-05T08:43:31.896 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-05T08:43:31.896 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-05T08:43:31.896 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:31.897 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:31.897 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:31.897 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-05T08:43:31.897 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-05T08:43:31.897 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-05T08:43:31.898 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-05T08:43:31.898 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-05T08:43:31.898 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-05T08:43:31.898 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-05T08:43:31.898 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-05T08:43:31.899 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-05T08:43:31.899 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-05T08:43:31.899 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-05T08:43:31.899 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-05T08:43:31.899 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-05T08:43:31.899 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-05T08:43:31.900 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-05T08:43:31.900 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-05T08:43:31.900 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-05T08:43:31.900 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-05T08:43:31.900 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-05T08:43:31.901 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-05T08:43:31.901 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-05T08:43:31.901 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:31.901 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-05T08:43:31.901 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:31.902 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-05T08:43:31.902 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-05T08:43:31.902 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-05T08:43:31.902 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-05T08:43:31.902 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-05T08:43:31.902 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root mem REG 8,1 83456 265542 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-05T08:43:31.903 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root mem REG 8,1 370416 265532 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-05T08:43:31.903 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root mem REG 8,1 1481856 265536 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-05T08:43:31.903 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root mem REG 8,1 45648 265517 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-05T08:43:31.903 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root mem REG 8,1 41304 265576 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-05T08:43:31.903 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root mem REG 8,1 49912 265561 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-05T08:43:31.904 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root mem REG 8,1 418096 265585 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-05T08:43:31.904 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root mem REG 8,1 83208 265579 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-05T08:43:31.904 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-05T08:43:31.904 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root mem REG 8,1 79224 265555 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-05T08:43:31.904 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root mem REG 8,1 49744 265609 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-05T08:43:31.905 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root mem REG 8,1 49856 265552 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-05T08:43:31.905 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root mem REG 8,1 83632 265549 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-05T08:43:31.905 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root mem REG 8,1 78744 265606 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-05T08:43:31.905 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root mem REG 8,1 53880 265603 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-05T08:43:31.905 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root mem REG 8,1 872944 265588 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-05T08:43:31.905 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root mem REG 8,1 116592 265558 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-05T08:43:31.906 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-05T08:43:31.906 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root mem REG 8,1 1242808 265591 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-05T08:43:31.906 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root mem REG 8,1 62224 265570 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-05T08:43:31.906 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root mem REG 8,1 95808 265564 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-05T08:43:31.906 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root mem REG 8,1 37272 265600 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-05T08:43:31.907 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root mem REG 8,1 104024 265582 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-05T08:43:31.907 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root mem REG 8,1 133480 265546 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-05T08:43:31.907 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root mem REG 8,1 834760 265573 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-05T08:43:31.907 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-05T08:43:31.907 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root mem REG 8,1 129280 265594 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-05T08:43:31.908 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root mem REG 8,1 83224 265567 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-05T08:43:31.908 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root mem REG 8,1 48 3081 /tmp/vgdb-pipe-shared-mem-vgdb-86246-by-root-on-??? 2023-11-05T08:43:31.908 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root DEL REG 0,17 182056 /[aio] 2023-11-05T08:43:31.908 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root DEL REG 0,17 182868 /[aio] 2023-11-05T08:43:31.908 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root 0r CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.909 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root 1w FIFO 0,13 0t0 182740 pipe 2023-11-05T08:43:31.909 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root 2w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:31.909 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root 3w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:31.909 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root 4r FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:31.909 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root 5w FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:31.910 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root 6u a_inode 0,14 0 1084 [eventpoll:7,20,21,22,23,24,25,26,27,66] 2023-11-05T08:43:31.910 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root 7r FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:31.910 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root 8w FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:31.910 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root 9u a_inode 0,14 0 1084 [eventpoll:10,67] 2023-11-05T08:43:31.910 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root 10r FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:31.911 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root 11w FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:31.911 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root 12u a_inode 0,14 0 1084 [eventpoll:13] 2023-11-05T08:43:31.911 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root 13r FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:31.911 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root 14w FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:31.911 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root 15w REG 8,1 465910012 276998 /var/log/ceph/ceph-osd.7.log 2023-11-05T08:43:31.912 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root 16uW REG 0,24 6 1974 /run/ceph/ceph-osd.7.pid 2023-11-05T08:43:31.912 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root 17r FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:31.912 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root 18w FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:31.912 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root 19u unix 0xffff8da307b0b300 0t0 187412 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-05T08:43:31.912 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root 20u IPv4 185761 0t0 TCP *:6802 (LISTEN) 2023-11-05T08:43:31.912 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root 21u IPv4 185765 0t0 TCP *:6803 (LISTEN) 2023-11-05T08:43:31.913 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root 22u IPv4 185770 0t0 TCP *:6804 (LISTEN) 2023-11-05T08:43:31.913 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root 23u IPv4 185776 0t0 TCP *:6805 (LISTEN) 2023-11-05T08:43:31.913 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root 24u IPv4 185783 0t0 TCP *:6806 (LISTEN) 2023-11-05T08:43:31.913 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root 25u IPv4 185791 0t0 TCP *:6807 (LISTEN) 2023-11-05T08:43:31.913 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root 26u IPv4 185800 0t0 TCP *:6808 (LISTEN) 2023-11-05T08:43:31.914 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root 27u IPv4 185810 0t0 TCP *:6809 (LISTEN) 2023-11-05T08:43:31.914 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root 28r FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:31.914 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root 29w FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:31.914 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root 30r FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:31.914 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root 31w FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:31.915 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root 32u sock 0,8 0t0 182041 protocol: UDPv6 2023-11-05T08:43:31.915 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-05T08:43:31.915 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-05T08:43:31.915 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.915 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.916 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.916 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.916 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.916 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.916 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.916 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.917 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.917 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.917 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.917 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.917 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.918 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.918 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.918 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.918 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.918 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.918 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.919 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.919 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.919 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.919 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.919 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.920 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root 60r FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:31.920 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root 61w FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:31.920 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root 62r FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:31.920 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root 63w FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:31.920 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root 66u IPv4 199302 0t0 TCP smithi156.front.sepia.ceph.com:56964->smithi156.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-05T08:43:31.921 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root 67u IPv4 199303 0t0 TCP smithi156.front.sepia.ceph.com:6802->smithi156.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-05T08:43:31.921 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:31.921 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root *525u REG 8,1 32 3087 /tmp/valgrind_proc_86246_cmdline_85358a06 (deleted) 2023-11-05T08:43:31.921 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root *526u REG 8,1 336 3088 /tmp/valgrind_proc_86246_auxv_85358a06 (deleted) 2023-11-05T08:43:31.921 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root *527w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:31.922 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root *528w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:31.922 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root *529r FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:31.922 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root *530w FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:31.922 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86307 signal_ha root *531r FIFO 8,1 0t0 3091 /tmp/vgdb-pipe-from-vgdb-to-86246-by-root-on-??? 2023-11-05T08:43:31.922 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root cwd DIR 8,1 4096 265785 /home/ubuntu/cephtest 2023-11-05T08:43:31.923 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.923 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-05T08:43:31.923 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:31.923 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:31.923 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-05T08:43:31.923 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-05T08:43:31.924 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root mem REG 8,1 15752 265597 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-05T08:43:31.924 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-05T08:43:31.924 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-05T08:43:31.924 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-05T08:43:31.924 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-05T08:43:31.925 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-05T08:43:31.925 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-05T08:43:31.925 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:31.925 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-05T08:43:31.925 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-05T08:43:31.925 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:31.926 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-05T08:43:31.926 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-05T08:43:31.926 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-05T08:43:31.926 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-05T08:43:31.926 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-05T08:43:31.927 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-05T08:43:31.927 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:31.927 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:31.927 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:31.927 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-05T08:43:31.928 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-05T08:43:31.928 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-05T08:43:31.928 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-05T08:43:31.928 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-05T08:43:31.928 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-05T08:43:31.928 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-05T08:43:31.929 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-05T08:43:31.929 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-05T08:43:31.929 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-05T08:43:31.929 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-05T08:43:31.929 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-05T08:43:31.930 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-05T08:43:31.930 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-05T08:43:31.930 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-05T08:43:31.930 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-05T08:43:31.930 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-05T08:43:31.931 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-05T08:43:31.931 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-05T08:43:31.931 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-05T08:43:31.931 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-05T08:43:31.931 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:31.932 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-05T08:43:31.932 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:31.932 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-05T08:43:31.932 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-05T08:43:31.932 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-05T08:43:31.933 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-05T08:43:31.933 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-05T08:43:31.933 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root mem REG 8,1 83456 265542 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-05T08:43:31.933 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root mem REG 8,1 370416 265532 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-05T08:43:31.933 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root mem REG 8,1 1481856 265536 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-05T08:43:31.934 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root mem REG 8,1 45648 265517 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-05T08:43:31.934 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root mem REG 8,1 41304 265576 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-05T08:43:31.934 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root mem REG 8,1 49912 265561 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-05T08:43:31.934 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root mem REG 8,1 418096 265585 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-05T08:43:31.934 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root mem REG 8,1 83208 265579 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-05T08:43:31.935 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-05T08:43:31.935 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root mem REG 8,1 79224 265555 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-05T08:43:31.935 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root mem REG 8,1 49744 265609 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-05T08:43:31.935 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root mem REG 8,1 49856 265552 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-05T08:43:31.935 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root mem REG 8,1 83632 265549 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-05T08:43:31.935 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root mem REG 8,1 78744 265606 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-05T08:43:31.936 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root mem REG 8,1 53880 265603 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-05T08:43:31.936 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root mem REG 8,1 872944 265588 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-05T08:43:31.936 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root mem REG 8,1 116592 265558 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-05T08:43:31.936 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-05T08:43:31.936 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root mem REG 8,1 1242808 265591 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-05T08:43:31.937 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root mem REG 8,1 62224 265570 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-05T08:43:31.937 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root mem REG 8,1 95808 265564 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-05T08:43:31.937 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root mem REG 8,1 37272 265600 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-05T08:43:31.937 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root mem REG 8,1 104024 265582 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-05T08:43:31.937 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root mem REG 8,1 133480 265546 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-05T08:43:31.937 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root mem REG 8,1 834760 265573 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-05T08:43:31.938 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-05T08:43:31.938 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root mem REG 8,1 129280 265594 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-05T08:43:31.938 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root mem REG 8,1 83224 265567 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-05T08:43:31.938 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root mem REG 8,1 48 3081 /tmp/vgdb-pipe-shared-mem-vgdb-86246-by-root-on-??? 2023-11-05T08:43:31.938 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root DEL REG 0,17 182056 /[aio] 2023-11-05T08:43:31.939 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root DEL REG 0,17 182868 /[aio] 2023-11-05T08:43:31.939 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.939 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root 1w FIFO 0,13 0t0 182740 pipe 2023-11-05T08:43:31.939 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root 2w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:31.939 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root 3w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:31.939 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root 4r FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:31.940 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root 5w FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:31.940 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root 6u a_inode 0,14 0 1084 [eventpoll:7,20,21,22,23,24,25,26,27,66] 2023-11-05T08:43:31.940 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root 7r FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:31.940 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root 8w FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:31.940 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root 9u a_inode 0,14 0 1084 [eventpoll:10,67] 2023-11-05T08:43:31.941 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root 10r FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:31.941 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root 11w FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:31.941 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root 12u a_inode 0,14 0 1084 [eventpoll:13] 2023-11-05T08:43:31.941 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root 13r FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:31.941 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root 14w FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:31.941 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root 15w REG 8,1 465910012 276998 /var/log/ceph/ceph-osd.7.log 2023-11-05T08:43:31.942 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root 16uW REG 0,24 6 1974 /run/ceph/ceph-osd.7.pid 2023-11-05T08:43:31.942 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root 17r FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:31.942 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root 18w FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:31.942 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root 19u unix 0xffff8da307b0b300 0t0 187412 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-05T08:43:31.942 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root 20u IPv4 185761 0t0 TCP *:6802 (LISTEN) 2023-11-05T08:43:31.943 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root 21u IPv4 185765 0t0 TCP *:6803 (LISTEN) 2023-11-05T08:43:31.943 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root 22u IPv4 185770 0t0 TCP *:6804 (LISTEN) 2023-11-05T08:43:31.943 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root 23u IPv4 185776 0t0 TCP *:6805 (LISTEN) 2023-11-05T08:43:31.943 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root 24u IPv4 185783 0t0 TCP *:6806 (LISTEN) 2023-11-05T08:43:31.943 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root 25u IPv4 185791 0t0 TCP *:6807 (LISTEN) 2023-11-05T08:43:31.943 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root 26u IPv4 185800 0t0 TCP *:6808 (LISTEN) 2023-11-05T08:43:31.944 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root 27u IPv4 185810 0t0 TCP *:6809 (LISTEN) 2023-11-05T08:43:31.944 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root 28r FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:31.944 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root 29w FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:31.944 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root 30r FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:31.945 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root 31w FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:31.945 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root 32u sock 0,8 0t0 182041 protocol: UDPv6 2023-11-05T08:43:31.945 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-05T08:43:31.945 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-05T08:43:31.945 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.946 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.946 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.946 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.946 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.946 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.946 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.947 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.947 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.947 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.947 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.947 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.948 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.948 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.948 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.948 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.948 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.948 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.949 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.949 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.949 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.949 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.949 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.950 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.950 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root 60r FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:31.950 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root 61w FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:31.950 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root 62r FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:31.950 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root 63w FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:31.950 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root 66u IPv4 199302 0t0 TCP smithi156.front.sepia.ceph.com:56964->smithi156.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-05T08:43:31.951 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root 67u IPv4 199303 0t0 TCP smithi156.front.sepia.ceph.com:6802->smithi156.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-05T08:43:31.951 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:31.951 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root *525u REG 8,1 32 3087 /tmp/valgrind_proc_86246_cmdline_85358a06 (deleted) 2023-11-05T08:43:31.951 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root *526u REG 8,1 336 3088 /tmp/valgrind_proc_86246_auxv_85358a06 (deleted) 2023-11-05T08:43:31.951 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root *527w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:31.952 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root *528w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:31.952 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root *529r FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:31.952 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root *530w FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:31.952 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86308 io_contex root *531r FIFO 8,1 0t0 3091 /tmp/vgdb-pipe-from-vgdb-to-86246-by-root-on-??? 2023-11-05T08:43:31.952 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root cwd DIR 8,1 4096 265785 /home/ubuntu/cephtest 2023-11-05T08:43:31.953 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.953 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-05T08:43:31.953 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:31.953 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:31.953 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-05T08:43:31.953 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-05T08:43:31.954 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root mem REG 8,1 15752 265597 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-05T08:43:31.954 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-05T08:43:31.954 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-05T08:43:31.954 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-05T08:43:31.954 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-05T08:43:31.955 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-05T08:43:31.955 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-05T08:43:31.955 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:31.955 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-05T08:43:31.955 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-05T08:43:31.956 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:31.956 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-05T08:43:31.956 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-05T08:43:31.956 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-05T08:43:31.956 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-05T08:43:31.957 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-05T08:43:31.957 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-05T08:43:31.957 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:31.957 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:31.957 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:31.957 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-05T08:43:31.958 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-05T08:43:31.958 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-05T08:43:31.958 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-05T08:43:31.958 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-05T08:43:31.958 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-05T08:43:31.959 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-05T08:43:31.959 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-05T08:43:31.959 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-05T08:43:31.959 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-05T08:43:31.959 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-05T08:43:31.960 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-05T08:43:31.960 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-05T08:43:31.960 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-05T08:43:31.960 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-05T08:43:31.960 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-05T08:43:31.960 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-05T08:43:31.961 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-05T08:43:31.961 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-05T08:43:31.961 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-05T08:43:31.961 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-05T08:43:31.961 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:31.962 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-05T08:43:31.962 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:31.962 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-05T08:43:31.962 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-05T08:43:31.962 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-05T08:43:31.963 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-05T08:43:31.963 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-05T08:43:31.963 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root mem REG 8,1 83456 265542 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-05T08:43:31.963 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root mem REG 8,1 370416 265532 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-05T08:43:31.963 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root mem REG 8,1 1481856 265536 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-05T08:43:31.963 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root mem REG 8,1 45648 265517 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-05T08:43:31.964 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root mem REG 8,1 41304 265576 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-05T08:43:31.964 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root mem REG 8,1 49912 265561 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-05T08:43:31.964 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root mem REG 8,1 418096 265585 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-05T08:43:31.964 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root mem REG 8,1 83208 265579 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-05T08:43:31.964 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-05T08:43:31.965 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root mem REG 8,1 79224 265555 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-05T08:43:31.965 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root mem REG 8,1 49744 265609 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-05T08:43:31.965 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root mem REG 8,1 49856 265552 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-05T08:43:31.965 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root mem REG 8,1 83632 265549 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-05T08:43:31.965 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root mem REG 8,1 78744 265606 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-05T08:43:31.966 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root mem REG 8,1 53880 265603 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-05T08:43:31.966 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root mem REG 8,1 872944 265588 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-05T08:43:31.966 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root mem REG 8,1 116592 265558 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-05T08:43:31.966 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-05T08:43:31.966 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root mem REG 8,1 1242808 265591 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-05T08:43:31.967 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root mem REG 8,1 62224 265570 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-05T08:43:31.967 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root mem REG 8,1 95808 265564 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-05T08:43:31.967 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root mem REG 8,1 37272 265600 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-05T08:43:31.967 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root mem REG 8,1 104024 265582 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-05T08:43:31.967 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root mem REG 8,1 133480 265546 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-05T08:43:31.968 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root mem REG 8,1 834760 265573 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-05T08:43:31.968 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-05T08:43:31.968 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root mem REG 8,1 129280 265594 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-05T08:43:31.968 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root mem REG 8,1 83224 265567 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-05T08:43:31.968 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root mem REG 8,1 48 3081 /tmp/vgdb-pipe-shared-mem-vgdb-86246-by-root-on-??? 2023-11-05T08:43:31.969 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root DEL REG 0,17 182056 /[aio] 2023-11-05T08:43:31.969 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root DEL REG 0,17 182868 /[aio] 2023-11-05T08:43:31.969 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.969 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root 1w FIFO 0,13 0t0 182740 pipe 2023-11-05T08:43:31.969 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root 2w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:31.969 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root 3w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:31.970 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root 4r FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:31.970 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root 5w FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:31.970 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root 6u a_inode 0,14 0 1084 [eventpoll:7,20,21,22,23,24,25,26,27,66] 2023-11-05T08:43:31.970 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root 7r FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:31.970 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root 8w FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:31.971 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root 9u a_inode 0,14 0 1084 [eventpoll:10,67] 2023-11-05T08:43:31.971 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root 10r FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:31.971 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root 11w FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:31.971 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root 12u a_inode 0,14 0 1084 [eventpoll:13] 2023-11-05T08:43:31.971 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root 13r FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:31.972 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root 14w FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:31.972 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root 15w REG 8,1 465910012 276998 /var/log/ceph/ceph-osd.7.log 2023-11-05T08:43:31.972 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root 16uW REG 0,24 6 1974 /run/ceph/ceph-osd.7.pid 2023-11-05T08:43:31.972 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root 17r FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:31.972 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root 18w FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:31.972 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root 19u unix 0xffff8da307b0b300 0t0 187412 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-05T08:43:31.973 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root 20u IPv4 185761 0t0 TCP *:6802 (LISTEN) 2023-11-05T08:43:31.973 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root 21u IPv4 185765 0t0 TCP *:6803 (LISTEN) 2023-11-05T08:43:31.973 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root 22u IPv4 185770 0t0 TCP *:6804 (LISTEN) 2023-11-05T08:43:31.973 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root 23u IPv4 185776 0t0 TCP *:6805 (LISTEN) 2023-11-05T08:43:31.973 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root 24u IPv4 185783 0t0 TCP *:6806 (LISTEN) 2023-11-05T08:43:31.974 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root 25u IPv4 185791 0t0 TCP *:6807 (LISTEN) 2023-11-05T08:43:31.974 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root 26u IPv4 185800 0t0 TCP *:6808 (LISTEN) 2023-11-05T08:43:31.974 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root 27u IPv4 185810 0t0 TCP *:6809 (LISTEN) 2023-11-05T08:43:31.974 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root 28r FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:31.974 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root 29w FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:31.975 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root 30r FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:31.975 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root 31w FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:31.975 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root 32u sock 0,8 0t0 182041 protocol: UDPv6 2023-11-05T08:43:31.975 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-05T08:43:31.975 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-05T08:43:31.975 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.976 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.976 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.976 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.976 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.976 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.977 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.977 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.977 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.977 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.977 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.977 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.978 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.978 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.978 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.978 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.978 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.979 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.979 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.979 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.979 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.980 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.980 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.980 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:31.980 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root 60r FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:31.980 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root 61w FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:31.980 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root 62r FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:31.981 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root 63w FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:31.981 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root 66u IPv4 199302 0t0 TCP smithi156.front.sepia.ceph.com:56964->smithi156.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-05T08:43:31.981 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root 67u IPv4 199303 0t0 TCP smithi156.front.sepia.ceph.com:6802->smithi156.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-05T08:43:31.981 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:31.981 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root *525u REG 8,1 32 3087 /tmp/valgrind_proc_86246_cmdline_85358a06 (deleted) 2023-11-05T08:43:31.982 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root *526u REG 8,1 336 3088 /tmp/valgrind_proc_86246_auxv_85358a06 (deleted) 2023-11-05T08:43:31.982 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root *527w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:31.982 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root *528w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:31.982 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root *529r FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:31.982 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root *530w FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:31.983 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86309 io_contex root *531r FIFO 8,1 0t0 3091 /tmp/vgdb-pipe-from-vgdb-to-86246-by-root-on-??? 2023-11-05T08:43:31.983 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root cwd DIR 8,1 4096 265785 /home/ubuntu/cephtest 2023-11-05T08:43:31.983 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:31.983 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-05T08:43:31.983 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:31.983 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:31.984 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-05T08:43:31.984 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-05T08:43:31.984 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root mem REG 8,1 15752 265597 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-05T08:43:31.984 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-05T08:43:31.984 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-05T08:43:31.985 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-05T08:43:31.985 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-05T08:43:31.985 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-05T08:43:31.985 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-05T08:43:31.985 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:31.986 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-05T08:43:31.986 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-05T08:43:31.986 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:31.986 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-05T08:43:31.986 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-05T08:43:31.986 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-05T08:43:31.987 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-05T08:43:31.987 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-05T08:43:31.987 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-05T08:43:31.987 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:31.987 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:31.988 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:31.988 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-05T08:43:31.988 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-05T08:43:31.988 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-05T08:43:31.988 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-05T08:43:31.989 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-05T08:43:31.989 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-05T08:43:31.989 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-05T08:43:31.989 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-05T08:43:31.989 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-05T08:43:31.989 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-05T08:43:31.990 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-05T08:43:31.990 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-05T08:43:31.990 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-05T08:43:31.990 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-05T08:43:31.991 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-05T08:43:31.991 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-05T08:43:31.991 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-05T08:43:31.991 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-05T08:43:31.991 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-05T08:43:31.991 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-05T08:43:31.992 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-05T08:43:31.992 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:31.992 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-05T08:43:31.992 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:31.992 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-05T08:43:31.992 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-05T08:43:31.993 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-05T08:43:31.993 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-05T08:43:31.993 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-05T08:43:31.993 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root mem REG 8,1 83456 265542 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-05T08:43:31.993 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root mem REG 8,1 370416 265532 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-05T08:43:31.994 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root mem REG 8,1 1481856 265536 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-05T08:43:31.994 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root mem REG 8,1 45648 265517 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-05T08:43:31.994 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root mem REG 8,1 41304 265576 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-05T08:43:31.994 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root mem REG 8,1 49912 265561 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-05T08:43:31.994 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root mem REG 8,1 418096 265585 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-05T08:43:31.995 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root mem REG 8,1 83208 265579 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-05T08:43:31.995 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-05T08:43:31.995 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root mem REG 8,1 79224 265555 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-05T08:43:31.995 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root mem REG 8,1 49744 265609 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-05T08:43:31.995 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root mem REG 8,1 49856 265552 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-05T08:43:31.995 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root mem REG 8,1 83632 265549 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-05T08:43:31.996 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root mem REG 8,1 78744 265606 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-05T08:43:31.996 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root mem REG 8,1 53880 265603 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-05T08:43:31.996 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root mem REG 8,1 872944 265588 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-05T08:43:31.996 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root mem REG 8,1 116592 265558 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-05T08:43:31.996 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-05T08:43:31.996 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root mem REG 8,1 1242808 265591 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-05T08:43:31.997 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root mem REG 8,1 62224 265570 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-05T08:43:31.997 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root mem REG 8,1 95808 265564 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-05T08:43:31.997 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root mem REG 8,1 37272 265600 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-05T08:43:31.997 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root mem REG 8,1 104024 265582 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-05T08:43:31.997 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root mem REG 8,1 133480 265546 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-05T08:43:31.998 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root mem REG 8,1 834760 265573 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-05T08:43:31.998 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-05T08:43:31.998 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root mem REG 8,1 129280 265594 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-05T08:43:31.998 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root mem REG 8,1 83224 265567 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-05T08:43:31.998 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root mem REG 8,1 48 3081 /tmp/vgdb-pipe-shared-mem-vgdb-86246-by-root-on-??? 2023-11-05T08:43:31.998 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root DEL REG 0,17 182056 /[aio] 2023-11-05T08:43:31.999 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root DEL REG 0,17 182868 /[aio] 2023-11-05T08:43:31.999 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root 0r CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:31.999 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root 1w FIFO 0,13 0t0 182740 pipe 2023-11-05T08:43:31.999 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root 2w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:31.999 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root 3w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:32.000 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root 4r FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:32.000 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root 5w FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:32.000 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root 6u a_inode 0,14 0 1084 [eventpoll:7,20,21,22,23,24,25,26,27,66] 2023-11-05T08:43:32.000 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root 7r FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:32.000 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root 8w FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:32.000 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root 9u a_inode 0,14 0 1084 [eventpoll:10,67] 2023-11-05T08:43:32.001 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root 10r FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:32.001 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root 11w FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:32.001 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root 12u a_inode 0,14 0 1084 [eventpoll:13] 2023-11-05T08:43:32.001 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root 13r FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:32.002 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root 14w FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:32.002 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root 15w REG 8,1 465910012 276998 /var/log/ceph/ceph-osd.7.log 2023-11-05T08:43:32.002 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root 16uW REG 0,24 6 1974 /run/ceph/ceph-osd.7.pid 2023-11-05T08:43:32.002 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root 17r FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:32.002 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root 18w FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:32.002 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root 19u unix 0xffff8da307b0b300 0t0 187412 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-05T08:43:32.003 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root 20u IPv4 185761 0t0 TCP *:6802 (LISTEN) 2023-11-05T08:43:32.003 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root 21u IPv4 185765 0t0 TCP *:6803 (LISTEN) 2023-11-05T08:43:32.003 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root 22u IPv4 185770 0t0 TCP *:6804 (LISTEN) 2023-11-05T08:43:32.003 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root 23u IPv4 185776 0t0 TCP *:6805 (LISTEN) 2023-11-05T08:43:32.003 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root 24u IPv4 185783 0t0 TCP *:6806 (LISTEN) 2023-11-05T08:43:32.004 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root 25u IPv4 185791 0t0 TCP *:6807 (LISTEN) 2023-11-05T08:43:32.004 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root 26u IPv4 185800 0t0 TCP *:6808 (LISTEN) 2023-11-05T08:43:32.004 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root 27u IPv4 185810 0t0 TCP *:6809 (LISTEN) 2023-11-05T08:43:32.004 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root 28r FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:32.004 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root 29w FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:32.004 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root 30r FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:32.005 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root 31w FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:32.005 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root 32u sock 0,8 0t0 182041 protocol: UDPv6 2023-11-05T08:43:32.005 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-05T08:43:32.005 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-05T08:43:32.005 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.006 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.006 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.006 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.006 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.006 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.006 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.007 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.007 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.007 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.007 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.007 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.008 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.008 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.008 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.008 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.008 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.008 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.009 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.009 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.009 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.009 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.009 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.010 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.010 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root 60r FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:32.010 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root 61w FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:32.010 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root 62r FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:32.010 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root 63w FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:32.011 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root 66u IPv4 199302 0t0 TCP smithi156.front.sepia.ceph.com:56964->smithi156.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-05T08:43:32.011 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root 67u IPv4 199303 0t0 TCP smithi156.front.sepia.ceph.com:6802->smithi156.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-05T08:43:32.011 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:32.011 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root *525u REG 8,1 32 3087 /tmp/valgrind_proc_86246_cmdline_85358a06 (deleted) 2023-11-05T08:43:32.011 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root *526u REG 8,1 336 3088 /tmp/valgrind_proc_86246_auxv_85358a06 (deleted) 2023-11-05T08:43:32.012 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root *527w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:32.012 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root *528w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:32.012 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root *529r FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:32.012 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root *530w FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:32.012 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86325 OpHistory root *531r FIFO 8,1 0t0 3091 /tmp/vgdb-pipe-from-vgdb-to-86246-by-root-on-??? 2023-11-05T08:43:32.012 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root cwd DIR 8,1 4096 265785 /home/ubuntu/cephtest 2023-11-05T08:43:32.013 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:32.013 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-05T08:43:32.013 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:32.013 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:32.014 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-05T08:43:32.014 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-05T08:43:32.014 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root mem REG 8,1 15752 265597 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-05T08:43:32.014 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-05T08:43:32.014 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-05T08:43:32.014 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-05T08:43:32.015 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-05T08:43:32.015 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-05T08:43:32.015 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-05T08:43:32.015 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:32.015 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-05T08:43:32.016 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-05T08:43:32.016 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:32.016 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-05T08:43:32.016 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-05T08:43:32.016 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-05T08:43:32.017 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-05T08:43:32.017 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-05T08:43:32.017 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-05T08:43:32.017 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:32.017 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:32.017 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:32.018 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-05T08:43:32.018 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-05T08:43:32.018 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-05T08:43:32.018 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-05T08:43:32.018 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-05T08:43:32.019 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-05T08:43:32.019 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-05T08:43:32.019 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-05T08:43:32.019 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-05T08:43:32.019 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-05T08:43:32.019 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-05T08:43:32.020 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-05T08:43:32.020 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-05T08:43:32.020 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-05T08:43:32.020 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-05T08:43:32.020 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-05T08:43:32.021 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-05T08:43:32.021 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-05T08:43:32.021 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-05T08:43:32.021 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-05T08:43:32.021 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-05T08:43:32.022 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:32.022 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-05T08:43:32.022 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:32.022 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-05T08:43:32.022 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-05T08:43:32.022 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-05T08:43:32.023 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-05T08:43:32.023 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-05T08:43:32.023 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root mem REG 8,1 83456 265542 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-05T08:43:32.023 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root mem REG 8,1 370416 265532 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-05T08:43:32.023 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root mem REG 8,1 1481856 265536 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-05T08:43:32.024 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root mem REG 8,1 45648 265517 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-05T08:43:32.024 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root mem REG 8,1 41304 265576 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-05T08:43:32.024 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root mem REG 8,1 49912 265561 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-05T08:43:32.024 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root mem REG 8,1 418096 265585 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-05T08:43:32.024 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root mem REG 8,1 83208 265579 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-05T08:43:32.025 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-05T08:43:32.025 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root mem REG 8,1 79224 265555 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-05T08:43:32.025 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root mem REG 8,1 49744 265609 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-05T08:43:32.025 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root mem REG 8,1 49856 265552 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-05T08:43:32.025 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root mem REG 8,1 83632 265549 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-05T08:43:32.026 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root mem REG 8,1 78744 265606 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-05T08:43:32.026 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root mem REG 8,1 53880 265603 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-05T08:43:32.026 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root mem REG 8,1 872944 265588 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-05T08:43:32.026 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root mem REG 8,1 116592 265558 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-05T08:43:32.026 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-05T08:43:32.027 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root mem REG 8,1 1242808 265591 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-05T08:43:32.027 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root mem REG 8,1 62224 265570 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-05T08:43:32.027 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root mem REG 8,1 95808 265564 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-05T08:43:32.027 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root mem REG 8,1 37272 265600 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-05T08:43:32.027 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root mem REG 8,1 104024 265582 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-05T08:43:32.027 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root mem REG 8,1 133480 265546 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-05T08:43:32.028 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root mem REG 8,1 834760 265573 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-05T08:43:32.028 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-05T08:43:32.028 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root mem REG 8,1 129280 265594 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-05T08:43:32.028 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root mem REG 8,1 83224 265567 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-05T08:43:32.028 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root mem REG 8,1 48 3081 /tmp/vgdb-pipe-shared-mem-vgdb-86246-by-root-on-??? 2023-11-05T08:43:32.029 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root DEL REG 0,17 182056 /[aio] 2023-11-05T08:43:32.029 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root DEL REG 0,17 182868 /[aio] 2023-11-05T08:43:32.029 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:32.029 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root 1w FIFO 0,13 0t0 182740 pipe 2023-11-05T08:43:32.029 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root 2w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:32.029 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root 3w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:32.030 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root 4r FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:32.030 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root 5w FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:32.030 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root 6u a_inode 0,14 0 1084 [eventpoll:7,20,21,22,23,24,25,26,27,66] 2023-11-05T08:43:32.030 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root 7r FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:32.030 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root 8w FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:32.031 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root 9u a_inode 0,14 0 1084 [eventpoll:10,67] 2023-11-05T08:43:32.031 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root 10r FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:32.031 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root 11w FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:32.031 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root 12u a_inode 0,14 0 1084 [eventpoll:13] 2023-11-05T08:43:32.031 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root 13r FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:32.032 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root 14w FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:32.032 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root 15w REG 8,1 465910012 276998 /var/log/ceph/ceph-osd.7.log 2023-11-05T08:43:32.032 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root 16uW REG 0,24 6 1974 /run/ceph/ceph-osd.7.pid 2023-11-05T08:43:32.032 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root 17r FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:32.032 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root 18w FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:32.033 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root 19u unix 0xffff8da307b0b300 0t0 187412 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-05T08:43:32.033 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root 20u IPv4 185761 0t0 TCP *:6802 (LISTEN) 2023-11-05T08:43:32.033 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root 21u IPv4 185765 0t0 TCP *:6803 (LISTEN) 2023-11-05T08:43:32.033 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root 22u IPv4 185770 0t0 TCP *:6804 (LISTEN) 2023-11-05T08:43:32.033 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root 23u IPv4 185776 0t0 TCP *:6805 (LISTEN) 2023-11-05T08:43:32.033 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root 24u IPv4 185783 0t0 TCP *:6806 (LISTEN) 2023-11-05T08:43:32.034 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root 25u IPv4 185791 0t0 TCP *:6807 (LISTEN) 2023-11-05T08:43:32.034 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root 26u IPv4 185800 0t0 TCP *:6808 (LISTEN) 2023-11-05T08:43:32.034 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root 27u IPv4 185810 0t0 TCP *:6809 (LISTEN) 2023-11-05T08:43:32.034 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root 28r FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:32.034 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root 29w FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:32.035 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root 30r FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:32.035 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root 31w FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:32.035 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root 32u sock 0,8 0t0 182041 protocol: UDPv6 2023-11-05T08:43:32.035 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-05T08:43:32.035 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-05T08:43:32.036 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.036 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.036 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.036 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.036 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.037 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.037 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.037 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.037 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.037 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.038 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.038 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.038 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.038 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.038 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.038 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.039 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.039 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.039 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.039 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.039 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.040 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.040 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.040 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.040 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root 60r FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:32.040 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root 61w FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:32.040 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root 62r FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:32.041 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root 63w FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:32.041 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root 66u IPv4 199302 0t0 TCP smithi156.front.sepia.ceph.com:56964->smithi156.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-05T08:43:32.041 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root 67u IPv4 199303 0t0 TCP smithi156.front.sepia.ceph.com:6802->smithi156.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-05T08:43:32.041 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:32.041 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root *525u REG 8,1 32 3087 /tmp/valgrind_proc_86246_cmdline_85358a06 (deleted) 2023-11-05T08:43:32.042 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root *526u REG 8,1 336 3088 /tmp/valgrind_proc_86246_auxv_85358a06 (deleted) 2023-11-05T08:43:32.042 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root *527w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:32.042 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root *528w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:32.042 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root *529r FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:32.042 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root *530w FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:32.042 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86326 ceph_time root *531r FIFO 8,1 0t0 3091 /tmp/vgdb-pipe-from-vgdb-to-86246-by-root-on-??? 2023-11-05T08:43:32.043 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root cwd DIR 8,1 4096 265785 /home/ubuntu/cephtest 2023-11-05T08:43:32.043 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:32.043 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-05T08:43:32.043 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:32.045 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:32.045 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-05T08:43:32.045 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-05T08:43:32.045 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root mem REG 8,1 15752 265597 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-05T08:43:32.046 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-05T08:43:32.046 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-05T08:43:32.046 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-05T08:43:32.046 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-05T08:43:32.046 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-05T08:43:32.046 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-05T08:43:32.047 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:32.047 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-05T08:43:32.047 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-05T08:43:32.047 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:32.047 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-05T08:43:32.048 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-05T08:43:32.048 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-05T08:43:32.048 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-05T08:43:32.048 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-05T08:43:32.048 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-05T08:43:32.048 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:32.049 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:32.049 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:32.049 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-05T08:43:32.049 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-05T08:43:32.050 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-05T08:43:32.050 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-05T08:43:32.050 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-05T08:43:32.050 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-05T08:43:32.050 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-05T08:43:32.050 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-05T08:43:32.051 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-05T08:43:32.051 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-05T08:43:32.051 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-05T08:43:32.051 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-05T08:43:32.051 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-05T08:43:32.052 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-05T08:43:32.052 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-05T08:43:32.052 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-05T08:43:32.052 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-05T08:43:32.052 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-05T08:43:32.052 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-05T08:43:32.053 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-05T08:43:32.053 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-05T08:43:32.053 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:32.053 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-05T08:43:32.053 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:32.054 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-05T08:43:32.054 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-05T08:43:32.054 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-05T08:43:32.054 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-05T08:43:32.054 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-05T08:43:32.054 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root mem REG 8,1 83456 265542 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-05T08:43:32.055 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root mem REG 8,1 370416 265532 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-05T08:43:32.055 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root mem REG 8,1 1481856 265536 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-05T08:43:32.055 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root mem REG 8,1 45648 265517 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-05T08:43:32.055 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root mem REG 8,1 41304 265576 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-05T08:43:32.055 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root mem REG 8,1 49912 265561 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-05T08:43:32.056 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root mem REG 8,1 418096 265585 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-05T08:43:32.056 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root mem REG 8,1 83208 265579 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-05T08:43:32.056 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-05T08:43:32.056 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root mem REG 8,1 79224 265555 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-05T08:43:32.056 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root mem REG 8,1 49744 265609 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-05T08:43:32.057 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root mem REG 8,1 49856 265552 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-05T08:43:32.057 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root mem REG 8,1 83632 265549 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-05T08:43:32.057 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root mem REG 8,1 78744 265606 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-05T08:43:32.057 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root mem REG 8,1 53880 265603 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-05T08:43:32.057 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root mem REG 8,1 872944 265588 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-05T08:43:32.057 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root mem REG 8,1 116592 265558 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-05T08:43:32.058 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-05T08:43:32.058 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root mem REG 8,1 1242808 265591 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-05T08:43:32.058 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root mem REG 8,1 62224 265570 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-05T08:43:32.058 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root mem REG 8,1 95808 265564 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-05T08:43:32.058 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root mem REG 8,1 37272 265600 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-05T08:43:32.059 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root mem REG 8,1 104024 265582 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-05T08:43:32.059 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root mem REG 8,1 133480 265546 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-05T08:43:32.059 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root mem REG 8,1 834760 265573 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-05T08:43:32.059 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-05T08:43:32.059 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root mem REG 8,1 129280 265594 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-05T08:43:32.059 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root mem REG 8,1 83224 265567 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-05T08:43:32.060 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root mem REG 8,1 48 3081 /tmp/vgdb-pipe-shared-mem-vgdb-86246-by-root-on-??? 2023-11-05T08:43:32.060 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root DEL REG 0,17 182056 /[aio] 2023-11-05T08:43:32.060 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root DEL REG 0,17 182868 /[aio] 2023-11-05T08:43:32.060 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root 0r CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:32.061 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root 1w FIFO 0,13 0t0 182740 pipe 2023-11-05T08:43:32.061 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root 2w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:32.061 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root 3w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:32.061 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root 4r FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:32.061 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root 5w FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:32.062 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root 6u a_inode 0,14 0 1084 [eventpoll:7,20,21,22,23,24,25,26,27,66] 2023-11-05T08:43:32.062 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root 7r FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:32.062 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root 8w FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:32.062 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root 9u a_inode 0,14 0 1084 [eventpoll:10,67] 2023-11-05T08:43:32.062 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root 10r FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:32.062 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root 11w FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:32.063 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root 12u a_inode 0,14 0 1084 [eventpoll:13] 2023-11-05T08:43:32.063 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root 13r FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:32.063 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root 14w FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:32.063 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root 15w REG 8,1 465910012 276998 /var/log/ceph/ceph-osd.7.log 2023-11-05T08:43:32.063 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root 16uW REG 0,24 6 1974 /run/ceph/ceph-osd.7.pid 2023-11-05T08:43:32.064 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root 17r FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:32.064 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root 18w FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:32.064 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root 19u unix 0xffff8da307b0b300 0t0 187412 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-05T08:43:32.064 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root 20u IPv4 185761 0t0 TCP *:6802 (LISTEN) 2023-11-05T08:43:32.064 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root 21u IPv4 185765 0t0 TCP *:6803 (LISTEN) 2023-11-05T08:43:32.065 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root 22u IPv4 185770 0t0 TCP *:6804 (LISTEN) 2023-11-05T08:43:32.065 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root 23u IPv4 185776 0t0 TCP *:6805 (LISTEN) 2023-11-05T08:43:32.065 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root 24u IPv4 185783 0t0 TCP *:6806 (LISTEN) 2023-11-05T08:43:32.065 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root 25u IPv4 185791 0t0 TCP *:6807 (LISTEN) 2023-11-05T08:43:32.065 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root 26u IPv4 185800 0t0 TCP *:6808 (LISTEN) 2023-11-05T08:43:32.065 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root 27u IPv4 185810 0t0 TCP *:6809 (LISTEN) 2023-11-05T08:43:32.066 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root 28r FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:32.066 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root 29w FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:32.066 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root 30r FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:32.066 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root 31w FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:32.066 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root 32u sock 0,8 0t0 182041 protocol: UDPv6 2023-11-05T08:43:32.067 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-05T08:43:32.067 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-05T08:43:32.067 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.067 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.067 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.067 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.068 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.068 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.068 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.068 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.068 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.069 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.069 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.069 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.069 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.069 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.070 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.070 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.070 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.070 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.070 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.070 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.071 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.071 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.071 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.071 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.071 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root 60r FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:32.072 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root 61w FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:32.072 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root 62r FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:32.072 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root 63w FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:32.072 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root 66u IPv4 199302 0t0 TCP smithi156.front.sepia.ceph.com:56964->smithi156.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-05T08:43:32.072 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root 67u IPv4 199303 0t0 TCP smithi156.front.sepia.ceph.com:6802->smithi156.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-05T08:43:32.073 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:32.073 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root *525u REG 8,1 32 3087 /tmp/valgrind_proc_86246_cmdline_85358a06 (deleted) 2023-11-05T08:43:32.073 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root *526u REG 8,1 336 3088 /tmp/valgrind_proc_86246_auxv_85358a06 (deleted) 2023-11-05T08:43:32.073 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root *527w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:32.073 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root *528w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:32.074 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root *529r FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:32.074 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root *530w FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:32.074 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86399 memcheck- root *531r FIFO 8,1 0t0 3091 /tmp/vgdb-pipe-from-vgdb-to-86246-by-root-on-??? 2023-11-05T08:43:32.074 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root cwd DIR 8,1 4096 265785 /home/ubuntu/cephtest 2023-11-05T08:43:32.074 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:32.075 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-05T08:43:32.075 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:32.075 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:32.075 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-05T08:43:32.075 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-05T08:43:32.076 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root mem REG 8,1 15752 265597 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-05T08:43:32.076 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-05T08:43:32.076 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-05T08:43:32.076 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-05T08:43:32.076 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-05T08:43:32.076 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-05T08:43:32.077 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-05T08:43:32.077 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:32.077 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-05T08:43:32.077 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-05T08:43:32.077 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:32.078 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-05T08:43:32.078 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-05T08:43:32.078 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-05T08:43:32.078 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-05T08:43:32.078 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-05T08:43:32.079 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-05T08:43:32.079 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:32.079 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:32.079 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:32.079 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-05T08:43:32.079 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-05T08:43:32.080 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-05T08:43:32.080 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-05T08:43:32.080 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-05T08:43:32.080 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-05T08:43:32.080 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-05T08:43:32.081 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-05T08:43:32.081 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-05T08:43:32.081 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-05T08:43:32.081 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-05T08:43:32.081 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-05T08:43:32.081 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-05T08:43:32.082 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-05T08:43:32.082 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-05T08:43:32.082 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-05T08:43:32.082 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-05T08:43:32.082 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-05T08:43:32.083 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-05T08:43:32.083 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-05T08:43:32.083 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-05T08:43:32.083 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:32.083 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-05T08:43:32.084 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:32.084 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-05T08:43:32.084 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-05T08:43:32.084 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-05T08:43:32.084 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-05T08:43:32.085 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-05T08:43:32.085 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root mem REG 8,1 83456 265542 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-05T08:43:32.085 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root mem REG 8,1 370416 265532 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-05T08:43:32.085 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root mem REG 8,1 1481856 265536 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-05T08:43:32.085 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root mem REG 8,1 45648 265517 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-05T08:43:32.086 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root mem REG 8,1 41304 265576 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-05T08:43:32.086 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root mem REG 8,1 49912 265561 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-05T08:43:32.086 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root mem REG 8,1 418096 265585 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-05T08:43:32.086 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root mem REG 8,1 83208 265579 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-05T08:43:32.086 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-05T08:43:32.086 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root mem REG 8,1 79224 265555 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-05T08:43:32.087 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root mem REG 8,1 49744 265609 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-05T08:43:32.087 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root mem REG 8,1 49856 265552 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-05T08:43:32.087 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root mem REG 8,1 83632 265549 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-05T08:43:32.087 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root mem REG 8,1 78744 265606 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-05T08:43:32.087 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root mem REG 8,1 53880 265603 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-05T08:43:32.088 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root mem REG 8,1 872944 265588 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-05T08:43:32.088 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root mem REG 8,1 116592 265558 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-05T08:43:32.088 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-05T08:43:32.088 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root mem REG 8,1 1242808 265591 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-05T08:43:32.088 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root mem REG 8,1 62224 265570 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-05T08:43:32.088 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root mem REG 8,1 95808 265564 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-05T08:43:32.089 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root mem REG 8,1 37272 265600 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-05T08:43:32.089 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root mem REG 8,1 104024 265582 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-05T08:43:32.089 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root mem REG 8,1 133480 265546 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-05T08:43:32.089 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root mem REG 8,1 834760 265573 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-05T08:43:32.089 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-05T08:43:32.090 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root mem REG 8,1 129280 265594 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-05T08:43:32.090 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root mem REG 8,1 83224 265567 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-05T08:43:32.090 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root mem REG 8,1 48 3081 /tmp/vgdb-pipe-shared-mem-vgdb-86246-by-root-on-??? 2023-11-05T08:43:32.090 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root DEL REG 0,17 182056 /[aio] 2023-11-05T08:43:32.090 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root DEL REG 0,17 182868 /[aio] 2023-11-05T08:43:32.091 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:32.091 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root 1w FIFO 0,13 0t0 182740 pipe 2023-11-05T08:43:32.091 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root 2w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:32.091 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root 3w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:32.091 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root 4r FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:32.091 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root 5w FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:32.092 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root 6u a_inode 0,14 0 1084 [eventpoll:7,20,21,22,23,24,25,26,27,66] 2023-11-05T08:43:32.092 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root 7r FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:32.092 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root 8w FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:32.092 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root 9u a_inode 0,14 0 1084 [eventpoll:10,67] 2023-11-05T08:43:32.092 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root 10r FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:32.093 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root 11w FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:32.093 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root 12u a_inode 0,14 0 1084 [eventpoll:13] 2023-11-05T08:43:32.093 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root 13r FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:32.093 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root 14w FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:32.093 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root 15w REG 8,1 465910012 276998 /var/log/ceph/ceph-osd.7.log 2023-11-05T08:43:32.093 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root 16uW REG 0,24 6 1974 /run/ceph/ceph-osd.7.pid 2023-11-05T08:43:32.094 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root 17r FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:32.094 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root 18w FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:32.094 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root 19u unix 0xffff8da307b0b300 0t0 187412 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-05T08:43:32.094 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root 20u IPv4 185761 0t0 TCP *:6802 (LISTEN) 2023-11-05T08:43:32.094 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root 21u IPv4 185765 0t0 TCP *:6803 (LISTEN) 2023-11-05T08:43:32.095 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root 22u IPv4 185770 0t0 TCP *:6804 (LISTEN) 2023-11-05T08:43:32.095 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root 23u IPv4 185776 0t0 TCP *:6805 (LISTEN) 2023-11-05T08:43:32.095 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root 24u IPv4 185783 0t0 TCP *:6806 (LISTEN) 2023-11-05T08:43:32.095 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root 25u IPv4 185791 0t0 TCP *:6807 (LISTEN) 2023-11-05T08:43:32.095 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root 26u IPv4 185800 0t0 TCP *:6808 (LISTEN) 2023-11-05T08:43:32.096 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root 27u IPv4 185810 0t0 TCP *:6809 (LISTEN) 2023-11-05T08:43:32.096 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root 28r FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:32.096 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root 29w FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:32.096 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root 30r FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:32.096 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root 31w FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:32.096 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root 32u sock 0,8 0t0 182041 protocol: UDPv6 2023-11-05T08:43:32.097 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-05T08:43:32.097 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-05T08:43:32.097 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.097 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.097 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.098 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.098 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.098 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.098 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.098 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.099 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.099 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.099 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.099 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.099 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.099 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.100 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.100 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.100 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.100 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.100 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.101 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.101 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.101 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.101 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.101 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.101 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root 60r FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:32.102 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root 61w FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:32.102 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root 62r FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:32.102 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root 63w FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:32.102 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root 66u IPv4 199302 0t0 TCP smithi156.front.sepia.ceph.com:56964->smithi156.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-05T08:43:32.102 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root 67u IPv4 199303 0t0 TCP smithi156.front.sepia.ceph.com:6802->smithi156.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-05T08:43:32.103 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:32.103 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root *525u REG 8,1 32 3087 /tmp/valgrind_proc_86246_cmdline_85358a06 (deleted) 2023-11-05T08:43:32.103 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root *526u REG 8,1 336 3088 /tmp/valgrind_proc_86246_auxv_85358a06 (deleted) 2023-11-05T08:43:32.103 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root *527w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:32.103 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root *528w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:32.104 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root *529r FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:32.104 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root *530w FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:32.104 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86400 safe_time root *531r FIFO 8,1 0t0 3091 /tmp/vgdb-pipe-from-vgdb-to-86246-by-root-on-??? 2023-11-05T08:43:32.104 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root cwd DIR 8,1 4096 265785 /home/ubuntu/cephtest 2023-11-05T08:43:32.104 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:32.104 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-05T08:43:32.105 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:32.105 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:32.105 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-05T08:43:32.105 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-05T08:43:32.105 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root mem REG 8,1 15752 265597 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-05T08:43:32.106 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-05T08:43:32.106 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-05T08:43:32.106 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-05T08:43:32.106 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-05T08:43:32.106 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-05T08:43:32.106 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-05T08:43:32.107 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:32.107 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-05T08:43:32.107 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-05T08:43:32.107 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:32.108 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-05T08:43:32.108 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-05T08:43:32.108 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-05T08:43:32.108 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-05T08:43:32.108 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-05T08:43:32.108 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-05T08:43:32.109 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:32.109 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:32.109 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:32.109 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-05T08:43:32.109 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-05T08:43:32.110 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-05T08:43:32.110 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-05T08:43:32.110 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-05T08:43:32.110 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-05T08:43:32.110 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-05T08:43:32.111 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-05T08:43:32.111 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-05T08:43:32.111 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-05T08:43:32.111 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-05T08:43:32.111 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-05T08:43:32.111 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-05T08:43:32.112 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-05T08:43:32.112 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-05T08:43:32.112 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-05T08:43:32.112 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-05T08:43:32.112 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-05T08:43:32.113 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-05T08:43:32.113 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-05T08:43:32.113 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-05T08:43:32.113 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:32.113 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-05T08:43:32.113 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:32.114 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-05T08:43:32.114 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-05T08:43:32.114 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-05T08:43:32.114 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-05T08:43:32.114 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-05T08:43:32.115 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root mem REG 8,1 83456 265542 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-05T08:43:32.115 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root mem REG 8,1 370416 265532 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-05T08:43:32.115 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root mem REG 8,1 1481856 265536 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-05T08:43:32.115 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root mem REG 8,1 45648 265517 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-05T08:43:32.115 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root mem REG 8,1 41304 265576 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-05T08:43:32.115 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root mem REG 8,1 49912 265561 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-05T08:43:32.116 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root mem REG 8,1 418096 265585 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-05T08:43:32.116 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root mem REG 8,1 83208 265579 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-05T08:43:32.116 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-05T08:43:32.116 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root mem REG 8,1 79224 265555 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-05T08:43:32.116 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root mem REG 8,1 49744 265609 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-05T08:43:32.117 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root mem REG 8,1 49856 265552 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-05T08:43:32.117 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root mem REG 8,1 83632 265549 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-05T08:43:32.117 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root mem REG 8,1 78744 265606 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-05T08:43:32.117 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root mem REG 8,1 53880 265603 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-05T08:43:32.117 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root mem REG 8,1 872944 265588 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-05T08:43:32.118 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root mem REG 8,1 116592 265558 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-05T08:43:32.118 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-05T08:43:32.118 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root mem REG 8,1 1242808 265591 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-05T08:43:32.118 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root mem REG 8,1 62224 265570 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-05T08:43:32.118 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root mem REG 8,1 95808 265564 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-05T08:43:32.119 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root mem REG 8,1 37272 265600 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-05T08:43:32.119 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root mem REG 8,1 104024 265582 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-05T08:43:32.119 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root mem REG 8,1 133480 265546 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-05T08:43:32.119 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root mem REG 8,1 834760 265573 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-05T08:43:32.119 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-05T08:43:32.120 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root mem REG 8,1 129280 265594 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-05T08:43:32.120 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root mem REG 8,1 83224 265567 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-05T08:43:32.120 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root mem REG 8,1 48 3081 /tmp/vgdb-pipe-shared-mem-vgdb-86246-by-root-on-??? 2023-11-05T08:43:32.120 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root DEL REG 0,17 182056 /[aio] 2023-11-05T08:43:32.120 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root DEL REG 0,17 182868 /[aio] 2023-11-05T08:43:32.120 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:32.121 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root 1w FIFO 0,13 0t0 182740 pipe 2023-11-05T08:43:32.121 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root 2w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:32.121 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root 3w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:32.121 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root 4r FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:32.121 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root 5w FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:32.122 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root 6u a_inode 0,14 0 1084 [eventpoll:7,20,21,22,23,24,25,26,27,66] 2023-11-05T08:43:32.122 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root 7r FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:32.122 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root 8w FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:32.122 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root 9u a_inode 0,14 0 1084 [eventpoll:10,67] 2023-11-05T08:43:32.122 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root 10r FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:32.122 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root 11w FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:32.123 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root 12u a_inode 0,14 0 1084 [eventpoll:13] 2023-11-05T08:43:32.123 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root 13r FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:32.123 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root 14w FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:32.123 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root 15w REG 8,1 465910012 276998 /var/log/ceph/ceph-osd.7.log 2023-11-05T08:43:32.123 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root 16uW REG 0,24 6 1974 /run/ceph/ceph-osd.7.pid 2023-11-05T08:43:32.124 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root 17r FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:32.124 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root 18w FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:32.124 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root 19u unix 0xffff8da307b0b300 0t0 187412 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-05T08:43:32.124 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root 20u IPv4 185761 0t0 TCP *:6802 (LISTEN) 2023-11-05T08:43:32.124 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root 21u IPv4 185765 0t0 TCP *:6803 (LISTEN) 2023-11-05T08:43:32.125 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root 22u IPv4 185770 0t0 TCP *:6804 (LISTEN) 2023-11-05T08:43:32.125 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root 23u IPv4 185776 0t0 TCP *:6805 (LISTEN) 2023-11-05T08:43:32.125 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root 24u IPv4 185783 0t0 TCP *:6806 (LISTEN) 2023-11-05T08:43:32.125 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root 25u IPv4 185791 0t0 TCP *:6807 (LISTEN) 2023-11-05T08:43:32.125 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root 26u IPv4 185800 0t0 TCP *:6808 (LISTEN) 2023-11-05T08:43:32.125 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root 27u IPv4 185810 0t0 TCP *:6809 (LISTEN) 2023-11-05T08:43:32.126 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root 28r FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:32.126 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root 29w FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:32.126 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root 30r FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:32.126 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root 31w FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:32.126 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root 32u sock 0,8 0t0 182041 protocol: UDPv6 2023-11-05T08:43:32.127 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-05T08:43:32.127 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-05T08:43:32.127 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.127 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.127 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.128 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.128 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.128 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.128 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.128 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.128 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.129 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.129 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.129 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.129 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.129 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.130 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.130 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.130 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.130 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.130 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.131 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.131 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.131 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.131 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.131 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.131 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root 60r FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:32.132 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root 61w FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:32.132 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root 62r FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:32.132 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root 63w FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:32.132 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root 66u IPv4 199302 0t0 TCP smithi156.front.sepia.ceph.com:56964->smithi156.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-05T08:43:32.132 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root 67u IPv4 199303 0t0 TCP smithi156.front.sepia.ceph.com:6802->smithi156.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-05T08:43:32.133 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:32.133 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root *525u REG 8,1 32 3087 /tmp/valgrind_proc_86246_cmdline_85358a06 (deleted) 2023-11-05T08:43:32.133 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root *526u REG 8,1 336 3088 /tmp/valgrind_proc_86246_auxv_85358a06 (deleted) 2023-11-05T08:43:32.133 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root *527w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:32.133 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root *528w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:32.134 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root *529r FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:32.134 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root *530w FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:32.134 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86401 safe_time root *531r FIFO 8,1 0t0 3091 /tmp/vgdb-pipe-from-vgdb-to-86246-by-root-on-??? 2023-11-05T08:43:32.134 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root cwd DIR 8,1 4096 265785 /home/ubuntu/cephtest 2023-11-05T08:43:32.134 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:32.134 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-05T08:43:32.135 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:32.135 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:32.135 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-05T08:43:32.135 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-05T08:43:32.135 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root mem REG 8,1 15752 265597 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-05T08:43:32.136 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-05T08:43:32.136 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-05T08:43:32.136 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-05T08:43:32.136 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-05T08:43:32.136 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-05T08:43:32.136 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-05T08:43:32.137 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:32.137 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-05T08:43:32.137 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-05T08:43:32.137 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:32.137 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-05T08:43:32.138 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-05T08:43:32.138 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-05T08:43:32.138 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-05T08:43:32.138 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-05T08:43:32.138 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-05T08:43:32.139 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:32.139 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:32.139 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:32.139 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-05T08:43:32.139 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-05T08:43:32.139 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-05T08:43:32.140 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-05T08:43:32.140 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-05T08:43:32.140 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-05T08:43:32.140 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-05T08:43:32.140 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-05T08:43:32.141 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-05T08:43:32.141 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-05T08:43:32.141 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-05T08:43:32.141 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-05T08:43:32.141 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-05T08:43:32.142 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-05T08:43:32.142 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-05T08:43:32.142 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-05T08:43:32.142 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-05T08:43:32.142 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-05T08:43:32.143 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-05T08:43:32.143 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-05T08:43:32.143 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-05T08:43:32.143 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:32.143 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-05T08:43:32.144 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:32.144 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-05T08:43:32.144 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-05T08:43:32.144 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-05T08:43:32.144 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-05T08:43:32.144 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-05T08:43:32.145 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root mem REG 8,1 83456 265542 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-05T08:43:32.145 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root mem REG 8,1 370416 265532 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-05T08:43:32.145 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root mem REG 8,1 1481856 265536 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-05T08:43:32.145 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root mem REG 8,1 45648 265517 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-05T08:43:32.145 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root mem REG 8,1 41304 265576 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-05T08:43:32.146 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root mem REG 8,1 49912 265561 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-05T08:43:32.146 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root mem REG 8,1 418096 265585 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-05T08:43:32.146 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root mem REG 8,1 83208 265579 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-05T08:43:32.146 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-05T08:43:32.146 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root mem REG 8,1 79224 265555 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-05T08:43:32.146 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root mem REG 8,1 49744 265609 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-05T08:43:32.147 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root mem REG 8,1 49856 265552 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-05T08:43:32.147 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root mem REG 8,1 83632 265549 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-05T08:43:32.147 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root mem REG 8,1 78744 265606 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-05T08:43:32.147 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root mem REG 8,1 53880 265603 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-05T08:43:32.147 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root mem REG 8,1 872944 265588 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-05T08:43:32.148 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root mem REG 8,1 116592 265558 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-05T08:43:32.148 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-05T08:43:32.148 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root mem REG 8,1 1242808 265591 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-05T08:43:32.148 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root mem REG 8,1 62224 265570 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-05T08:43:32.148 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root mem REG 8,1 95808 265564 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-05T08:43:32.148 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root mem REG 8,1 37272 265600 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-05T08:43:32.149 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root mem REG 8,1 104024 265582 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-05T08:43:32.149 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root mem REG 8,1 133480 265546 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-05T08:43:32.149 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root mem REG 8,1 834760 265573 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-05T08:43:32.149 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-05T08:43:32.149 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root mem REG 8,1 129280 265594 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-05T08:43:32.150 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root mem REG 8,1 83224 265567 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-05T08:43:32.150 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root mem REG 8,1 48 3081 /tmp/vgdb-pipe-shared-mem-vgdb-86246-by-root-on-??? 2023-11-05T08:43:32.150 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root DEL REG 0,17 182056 /[aio] 2023-11-05T08:43:32.150 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root DEL REG 0,17 182868 /[aio] 2023-11-05T08:43:32.150 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:32.150 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root 1w FIFO 0,13 0t0 182740 pipe 2023-11-05T08:43:32.151 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root 2w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:32.151 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root 3w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:32.151 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root 4r FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:32.151 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root 5w FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:32.151 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root 6u a_inode 0,14 0 1084 [eventpoll:7,20,21,22,23,24,25,26,27,66] 2023-11-05T08:43:32.152 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root 7r FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:32.152 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root 8w FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:32.152 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root 9u a_inode 0,14 0 1084 [eventpoll:10,67] 2023-11-05T08:43:32.152 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root 10r FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:32.152 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root 11w FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:32.153 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root 12u a_inode 0,14 0 1084 [eventpoll:13] 2023-11-05T08:43:32.153 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root 13r FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:32.153 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root 14w FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:32.153 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root 15w REG 8,1 465910012 276998 /var/log/ceph/ceph-osd.7.log 2023-11-05T08:43:32.153 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root 16uW REG 0,24 6 1974 /run/ceph/ceph-osd.7.pid 2023-11-05T08:43:32.154 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root 17r FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:32.154 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root 18w FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:32.154 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root 19u unix 0xffff8da307b0b300 0t0 187412 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-05T08:43:32.154 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root 20u IPv4 185761 0t0 TCP *:6802 (LISTEN) 2023-11-05T08:43:32.154 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root 21u IPv4 185765 0t0 TCP *:6803 (LISTEN) 2023-11-05T08:43:32.154 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root 22u IPv4 185770 0t0 TCP *:6804 (LISTEN) 2023-11-05T08:43:32.155 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root 23u IPv4 185776 0t0 TCP *:6805 (LISTEN) 2023-11-05T08:43:32.155 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root 24u IPv4 185783 0t0 TCP *:6806 (LISTEN) 2023-11-05T08:43:32.155 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root 25u IPv4 185791 0t0 TCP *:6807 (LISTEN) 2023-11-05T08:43:32.155 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root 26u IPv4 185800 0t0 TCP *:6808 (LISTEN) 2023-11-05T08:43:32.155 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root 27u IPv4 185810 0t0 TCP *:6809 (LISTEN) 2023-11-05T08:43:32.156 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root 28r FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:32.156 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root 29w FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:32.156 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root 30r FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:32.156 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root 31w FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:32.156 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root 32u sock 0,8 0t0 182041 protocol: UDPv6 2023-11-05T08:43:32.156 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-05T08:43:32.157 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-05T08:43:32.157 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.157 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.157 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.157 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.158 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.158 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.158 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.158 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.158 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.158 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.159 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.159 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.159 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.159 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.159 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.160 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.160 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.160 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.160 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.160 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.160 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.161 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.161 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.161 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.161 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root 60r FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:32.161 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root 61w FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:32.162 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root 62r FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:32.162 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root 63w FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:32.162 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root 66u IPv4 199302 0t0 TCP smithi156.front.sepia.ceph.com:56964->smithi156.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-05T08:43:32.162 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root 67u IPv4 199303 0t0 TCP smithi156.front.sepia.ceph.com:6802->smithi156.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-05T08:43:32.162 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:32.162 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root *525u REG 8,1 32 3087 /tmp/valgrind_proc_86246_cmdline_85358a06 (deleted) 2023-11-05T08:43:32.163 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root *526u REG 8,1 336 3088 /tmp/valgrind_proc_86246_auxv_85358a06 (deleted) 2023-11-05T08:43:32.163 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root *527w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:32.163 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root *528w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:32.163 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root *529r FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:32.163 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root *530w FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:32.164 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86402 safe_time root *531r FIFO 8,1 0t0 3091 /tmp/vgdb-pipe-from-vgdb-to-86246-by-root-on-??? 2023-11-05T08:43:32.164 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root cwd DIR 8,1 4096 265785 /home/ubuntu/cephtest 2023-11-05T08:43:32.164 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:32.164 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-05T08:43:32.164 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:32.165 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:32.165 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-05T08:43:32.165 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-05T08:43:32.165 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root mem REG 8,1 15752 265597 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-05T08:43:32.165 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-05T08:43:32.166 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-05T08:43:32.166 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-05T08:43:32.166 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-05T08:43:32.166 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-05T08:43:32.166 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-05T08:43:32.166 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:32.167 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-05T08:43:32.167 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-05T08:43:32.167 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:32.167 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-05T08:43:32.167 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-05T08:43:32.168 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-05T08:43:32.168 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-05T08:43:32.168 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-05T08:43:32.168 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-05T08:43:32.168 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:32.168 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:32.169 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:32.169 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-05T08:43:32.169 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-05T08:43:32.169 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-05T08:43:32.169 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-05T08:43:32.170 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-05T08:43:32.170 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-05T08:43:32.170 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-05T08:43:32.170 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-05T08:43:32.170 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-05T08:43:32.171 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-05T08:43:32.171 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-05T08:43:32.171 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-05T08:43:32.171 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-05T08:43:32.171 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-05T08:43:32.171 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-05T08:43:32.172 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-05T08:43:32.172 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-05T08:43:32.172 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-05T08:43:32.172 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-05T08:43:32.172 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-05T08:43:32.173 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-05T08:43:32.173 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:32.173 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-05T08:43:32.173 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:32.173 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-05T08:43:32.173 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-05T08:43:32.174 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-05T08:43:32.174 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-05T08:43:32.174 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-05T08:43:32.174 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root mem REG 8,1 83456 265542 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-05T08:43:32.174 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root mem REG 8,1 370416 265532 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-05T08:43:32.175 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root mem REG 8,1 1481856 265536 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-05T08:43:32.175 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root mem REG 8,1 45648 265517 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-05T08:43:32.175 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root mem REG 8,1 41304 265576 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-05T08:43:32.175 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root mem REG 8,1 49912 265561 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-05T08:43:32.175 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root mem REG 8,1 418096 265585 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-05T08:43:32.176 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root mem REG 8,1 83208 265579 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-05T08:43:32.176 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-05T08:43:32.176 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root mem REG 8,1 79224 265555 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-05T08:43:32.176 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root mem REG 8,1 49744 265609 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-05T08:43:32.176 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root mem REG 8,1 49856 265552 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-05T08:43:32.177 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root mem REG 8,1 83632 265549 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-05T08:43:32.177 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root mem REG 8,1 78744 265606 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-05T08:43:32.177 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root mem REG 8,1 53880 265603 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-05T08:43:32.177 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root mem REG 8,1 872944 265588 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-05T08:43:32.177 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root mem REG 8,1 116592 265558 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-05T08:43:32.178 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-05T08:43:32.178 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root mem REG 8,1 1242808 265591 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-05T08:43:32.178 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root mem REG 8,1 62224 265570 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-05T08:43:32.178 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root mem REG 8,1 95808 265564 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-05T08:43:32.178 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root mem REG 8,1 37272 265600 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-05T08:43:32.178 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root mem REG 8,1 104024 265582 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-05T08:43:32.179 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root mem REG 8,1 133480 265546 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-05T08:43:32.179 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root mem REG 8,1 834760 265573 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-05T08:43:32.179 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-05T08:43:32.179 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root mem REG 8,1 129280 265594 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-05T08:43:32.179 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root mem REG 8,1 83224 265567 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-05T08:43:32.180 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root mem REG 8,1 48 3081 /tmp/vgdb-pipe-shared-mem-vgdb-86246-by-root-on-??? 2023-11-05T08:43:32.180 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root DEL REG 0,17 182056 /[aio] 2023-11-05T08:43:32.180 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root DEL REG 0,17 182868 /[aio] 2023-11-05T08:43:32.180 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:32.180 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root 1w FIFO 0,13 0t0 182740 pipe 2023-11-05T08:43:32.180 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root 2w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:32.181 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root 3w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:32.181 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root 4r FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:32.181 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root 5w FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:32.181 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root 6u a_inode 0,14 0 1084 [eventpoll:7,20,21,22,23,24,25,26,27,66] 2023-11-05T08:43:32.181 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root 7r FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:32.182 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root 8w FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:32.182 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root 9u a_inode 0,14 0 1084 [eventpoll:10,67] 2023-11-05T08:43:32.182 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root 10r FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:32.182 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root 11w FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:32.182 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root 12u a_inode 0,14 0 1084 [eventpoll:13] 2023-11-05T08:43:32.182 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root 13r FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:32.183 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root 14w FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:32.183 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root 15w REG 8,1 465910012 276998 /var/log/ceph/ceph-osd.7.log 2023-11-05T08:43:32.183 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root 16uW REG 0,24 6 1974 /run/ceph/ceph-osd.7.pid 2023-11-05T08:43:32.183 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root 17r FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:32.183 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root 18w FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:32.184 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root 19u unix 0xffff8da307b0b300 0t0 187412 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-05T08:43:32.184 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root 20u IPv4 185761 0t0 TCP *:6802 (LISTEN) 2023-11-05T08:43:32.184 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root 21u IPv4 185765 0t0 TCP *:6803 (LISTEN) 2023-11-05T08:43:32.184 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root 22u IPv4 185770 0t0 TCP *:6804 (LISTEN) 2023-11-05T08:43:32.184 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root 23u IPv4 185776 0t0 TCP *:6805 (LISTEN) 2023-11-05T08:43:32.184 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root 24u IPv4 185783 0t0 TCP *:6806 (LISTEN) 2023-11-05T08:43:32.185 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root 25u IPv4 185791 0t0 TCP *:6807 (LISTEN) 2023-11-05T08:43:32.185 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root 26u IPv4 185800 0t0 TCP *:6808 (LISTEN) 2023-11-05T08:43:32.185 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root 27u IPv4 185810 0t0 TCP *:6809 (LISTEN) 2023-11-05T08:43:32.185 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root 28r FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:32.185 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root 29w FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:32.186 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root 30r FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:32.186 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root 31w FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:32.186 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root 32u sock 0,8 0t0 182041 protocol: UDPv6 2023-11-05T08:43:32.186 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-05T08:43:32.186 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-05T08:43:32.186 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.187 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.187 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.187 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.187 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.187 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.188 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.188 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.188 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.188 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.188 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.189 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.189 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.189 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.189 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.189 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.189 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.190 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.190 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.190 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.190 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.190 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.191 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.191 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.191 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root 60r FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:32.191 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root 61w FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:32.191 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root 62r FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:32.191 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root 63w FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:32.192 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root 66u IPv4 199302 0t0 TCP smithi156.front.sepia.ceph.com:56964->smithi156.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-05T08:43:32.192 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root 67u IPv4 199303 0t0 TCP smithi156.front.sepia.ceph.com:6802->smithi156.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-05T08:43:32.192 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:32.192 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root *525u REG 8,1 32 3087 /tmp/valgrind_proc_86246_cmdline_85358a06 (deleted) 2023-11-05T08:43:32.192 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root *526u REG 8,1 336 3088 /tmp/valgrind_proc_86246_auxv_85358a06 (deleted) 2023-11-05T08:43:32.193 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root *527w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:32.193 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root *528w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:32.193 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root *529r FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:32.193 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root *530w FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:32.193 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86403 safe_time root *531r FIFO 8,1 0t0 3091 /tmp/vgdb-pipe-from-vgdb-to-86246-by-root-on-??? 2023-11-05T08:43:32.194 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root cwd DIR 8,1 4096 265785 /home/ubuntu/cephtest 2023-11-05T08:43:32.194 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:32.194 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-05T08:43:32.194 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:32.194 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:32.194 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-05T08:43:32.195 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-05T08:43:32.195 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root mem REG 8,1 15752 265597 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-05T08:43:32.195 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-05T08:43:32.195 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-05T08:43:32.195 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-05T08:43:32.196 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-05T08:43:32.196 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-05T08:43:32.196 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-05T08:43:32.196 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:32.196 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-05T08:43:32.196 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-05T08:43:32.197 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:32.197 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-05T08:43:32.197 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-05T08:43:32.197 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-05T08:43:32.197 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-05T08:43:32.198 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-05T08:43:32.198 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-05T08:43:32.198 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:32.198 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:32.198 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:32.199 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-05T08:43:32.199 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-05T08:43:32.199 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-05T08:43:32.199 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-05T08:43:32.199 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-05T08:43:32.200 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-05T08:43:32.200 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-05T08:43:32.200 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-05T08:43:32.200 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-05T08:43:32.200 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-05T08:43:32.201 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-05T08:43:32.201 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-05T08:43:32.201 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-05T08:43:32.201 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-05T08:43:32.201 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-05T08:43:32.201 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-05T08:43:32.202 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-05T08:43:32.202 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-05T08:43:32.202 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-05T08:43:32.202 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-05T08:43:32.202 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-05T08:43:32.203 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:32.203 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-05T08:43:32.203 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:32.203 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-05T08:43:32.203 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-05T08:43:32.203 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-05T08:43:32.204 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-05T08:43:32.204 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-05T08:43:32.204 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root mem REG 8,1 83456 265542 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-05T08:43:32.204 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root mem REG 8,1 370416 265532 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-05T08:43:32.204 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root mem REG 8,1 1481856 265536 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-05T08:43:32.205 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root mem REG 8,1 45648 265517 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-05T08:43:32.205 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root mem REG 8,1 41304 265576 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-05T08:43:32.205 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root mem REG 8,1 49912 265561 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-05T08:43:32.205 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root mem REG 8,1 418096 265585 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-05T08:43:32.205 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root mem REG 8,1 83208 265579 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-05T08:43:32.205 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-05T08:43:32.206 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root mem REG 8,1 79224 265555 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-05T08:43:32.206 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root mem REG 8,1 49744 265609 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-05T08:43:32.206 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root mem REG 8,1 49856 265552 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-05T08:43:32.206 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root mem REG 8,1 83632 265549 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-05T08:43:32.206 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root mem REG 8,1 78744 265606 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-05T08:43:32.207 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root mem REG 8,1 53880 265603 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-05T08:43:32.207 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root mem REG 8,1 872944 265588 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-05T08:43:32.207 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root mem REG 8,1 116592 265558 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-05T08:43:32.207 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-05T08:43:32.207 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root mem REG 8,1 1242808 265591 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-05T08:43:32.207 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root mem REG 8,1 62224 265570 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-05T08:43:32.208 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root mem REG 8,1 95808 265564 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-05T08:43:32.208 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root mem REG 8,1 37272 265600 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-05T08:43:32.208 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root mem REG 8,1 104024 265582 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-05T08:43:32.208 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root mem REG 8,1 133480 265546 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-05T08:43:32.208 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root mem REG 8,1 834760 265573 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-05T08:43:32.209 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-05T08:43:32.209 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root mem REG 8,1 129280 265594 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-05T08:43:32.209 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root mem REG 8,1 83224 265567 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-05T08:43:32.209 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root mem REG 8,1 48 3081 /tmp/vgdb-pipe-shared-mem-vgdb-86246-by-root-on-??? 2023-11-05T08:43:32.209 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root DEL REG 0,17 182056 /[aio] 2023-11-05T08:43:32.210 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root DEL REG 0,17 182868 /[aio] 2023-11-05T08:43:32.210 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root 0r CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:32.210 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root 1w FIFO 0,13 0t0 182740 pipe 2023-11-05T08:43:32.210 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root 2w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:32.210 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root 3w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:32.210 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root 4r FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:32.211 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root 5w FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:32.211 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root 6u a_inode 0,14 0 1084 [eventpoll:7,20,21,22,23,24,25,26,27,66] 2023-11-05T08:43:32.211 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root 7r FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:32.211 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root 8w FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:32.211 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root 9u a_inode 0,14 0 1084 [eventpoll:10,67] 2023-11-05T08:43:32.212 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root 10r FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:32.212 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root 11w FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:32.212 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root 12u a_inode 0,14 0 1084 [eventpoll:13] 2023-11-05T08:43:32.212 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root 13r FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:32.212 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root 14w FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:32.213 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root 15w REG 8,1 465910012 276998 /var/log/ceph/ceph-osd.7.log 2023-11-05T08:43:32.213 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root 16uW REG 0,24 6 1974 /run/ceph/ceph-osd.7.pid 2023-11-05T08:43:32.213 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root 17r FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:32.213 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root 18w FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:32.213 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root 19u unix 0xffff8da307b0b300 0t0 187412 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-05T08:43:32.213 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root 20u IPv4 185761 0t0 TCP *:6802 (LISTEN) 2023-11-05T08:43:32.214 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root 21u IPv4 185765 0t0 TCP *:6803 (LISTEN) 2023-11-05T08:43:32.214 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root 22u IPv4 185770 0t0 TCP *:6804 (LISTEN) 2023-11-05T08:43:32.214 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root 23u IPv4 185776 0t0 TCP *:6805 (LISTEN) 2023-11-05T08:43:32.214 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root 24u IPv4 185783 0t0 TCP *:6806 (LISTEN) 2023-11-05T08:43:32.214 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root 25u IPv4 185791 0t0 TCP *:6807 (LISTEN) 2023-11-05T08:43:32.215 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root 26u IPv4 185800 0t0 TCP *:6808 (LISTEN) 2023-11-05T08:43:32.215 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root 27u IPv4 185810 0t0 TCP *:6809 (LISTEN) 2023-11-05T08:43:32.215 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root 28r FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:32.215 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root 29w FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:32.215 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root 30r FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:32.215 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root 31w FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:32.216 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root 32u sock 0,8 0t0 182041 protocol: UDPv6 2023-11-05T08:43:32.216 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-05T08:43:32.216 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-05T08:43:32.216 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.216 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.216 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.217 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.217 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.217 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.217 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.217 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.218 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.218 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.218 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.218 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.218 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.218 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.219 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.219 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.219 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.219 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.219 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.220 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.220 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.220 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.220 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.220 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.220 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root 60r FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:32.221 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root 61w FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:32.221 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root 62r FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:32.221 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root 63w FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:32.221 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root 66u IPv4 199302 0t0 TCP smithi156.front.sepia.ceph.com:56964->smithi156.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-05T08:43:32.222 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root 67u IPv4 199303 0t0 TCP smithi156.front.sepia.ceph.com:6802->smithi156.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-05T08:43:32.222 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:32.222 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root *525u REG 8,1 32 3087 /tmp/valgrind_proc_86246_cmdline_85358a06 (deleted) 2023-11-05T08:43:32.222 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root *526u REG 8,1 336 3088 /tmp/valgrind_proc_86246_auxv_85358a06 (deleted) 2023-11-05T08:43:32.222 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root *527w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:32.222 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root *528w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:32.223 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root *529r FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:32.223 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root *530w FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:32.223 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86404 fn_anonym root *531r FIFO 8,1 0t0 3091 /tmp/vgdb-pipe-from-vgdb-to-86246-by-root-on-??? 2023-11-05T08:43:32.223 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root cwd DIR 8,1 4096 265785 /home/ubuntu/cephtest 2023-11-05T08:43:32.223 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:32.224 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-05T08:43:32.224 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:32.224 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:32.224 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-05T08:43:32.224 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-05T08:43:32.225 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root mem REG 8,1 15752 265597 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-05T08:43:32.225 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-05T08:43:32.225 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-05T08:43:32.225 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-05T08:43:32.225 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-05T08:43:32.225 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-05T08:43:32.226 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-05T08:43:32.226 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:32.226 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-05T08:43:32.226 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-05T08:43:32.226 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:32.227 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-05T08:43:32.227 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-05T08:43:32.227 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-05T08:43:32.227 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-05T08:43:32.227 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-05T08:43:32.227 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-05T08:43:32.228 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:32.228 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:32.228 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:32.228 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-05T08:43:32.228 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-05T08:43:32.228 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-05T08:43:32.229 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-05T08:43:32.229 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-05T08:43:32.229 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-05T08:43:32.229 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-05T08:43:32.229 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-05T08:43:32.230 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-05T08:43:32.230 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-05T08:43:32.230 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-05T08:43:32.230 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-05T08:43:32.230 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-05T08:43:32.230 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-05T08:43:32.231 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-05T08:43:32.231 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-05T08:43:32.231 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-05T08:43:32.231 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-05T08:43:32.231 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-05T08:43:32.232 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-05T08:43:32.232 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-05T08:43:32.232 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:32.232 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-05T08:43:32.232 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:32.233 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-05T08:43:32.233 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-05T08:43:32.233 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-05T08:43:32.233 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-05T08:43:32.233 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-05T08:43:32.234 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root mem REG 8,1 83456 265542 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-05T08:43:32.234 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root mem REG 8,1 370416 265532 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-05T08:43:32.234 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root mem REG 8,1 1481856 265536 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-05T08:43:32.234 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root mem REG 8,1 45648 265517 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-05T08:43:32.234 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root mem REG 8,1 41304 265576 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-05T08:43:32.234 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root mem REG 8,1 49912 265561 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-05T08:43:32.235 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root mem REG 8,1 418096 265585 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-05T08:43:32.235 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root mem REG 8,1 83208 265579 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-05T08:43:32.235 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-05T08:43:32.235 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root mem REG 8,1 79224 265555 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-05T08:43:32.235 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root mem REG 8,1 49744 265609 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-05T08:43:32.236 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root mem REG 8,1 49856 265552 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-05T08:43:32.236 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root mem REG 8,1 83632 265549 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-05T08:43:32.236 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root mem REG 8,1 78744 265606 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-05T08:43:32.236 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root mem REG 8,1 53880 265603 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-05T08:43:32.236 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root mem REG 8,1 872944 265588 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-05T08:43:32.236 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root mem REG 8,1 116592 265558 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-05T08:43:32.237 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-05T08:43:32.237 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root mem REG 8,1 1242808 265591 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-05T08:43:32.237 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root mem REG 8,1 62224 265570 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-05T08:43:32.237 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root mem REG 8,1 95808 265564 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-05T08:43:32.237 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root mem REG 8,1 37272 265600 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-05T08:43:32.238 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root mem REG 8,1 104024 265582 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-05T08:43:32.238 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root mem REG 8,1 133480 265546 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-05T08:43:32.238 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root mem REG 8,1 834760 265573 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-05T08:43:32.238 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-05T08:43:32.238 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root mem REG 8,1 129280 265594 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-05T08:43:32.238 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root mem REG 8,1 83224 265567 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-05T08:43:32.239 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root mem REG 8,1 48 3081 /tmp/vgdb-pipe-shared-mem-vgdb-86246-by-root-on-??? 2023-11-05T08:43:32.239 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root DEL REG 0,17 182056 /[aio] 2023-11-05T08:43:32.239 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root DEL REG 0,17 182868 /[aio] 2023-11-05T08:43:32.239 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root 0r CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:32.239 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root 1w FIFO 0,13 0t0 182740 pipe 2023-11-05T08:43:32.240 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root 2w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:32.240 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root 3w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:32.240 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root 4r FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:32.240 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root 5w FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:32.240 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root 6u a_inode 0,14 0 1084 [eventpoll:7,20,21,22,23,24,25,26,27,66] 2023-11-05T08:43:32.240 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root 7r FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:32.241 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root 8w FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:32.241 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root 9u a_inode 0,14 0 1084 [eventpoll:10,67] 2023-11-05T08:43:32.241 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root 10r FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:32.241 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root 11w FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:32.241 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root 12u a_inode 0,14 0 1084 [eventpoll:13] 2023-11-05T08:43:32.242 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root 13r FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:32.242 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root 14w FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:32.242 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root 15w REG 8,1 465910012 276998 /var/log/ceph/ceph-osd.7.log 2023-11-05T08:43:32.242 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root 16uW REG 0,24 6 1974 /run/ceph/ceph-osd.7.pid 2023-11-05T08:43:32.242 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root 17r FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:32.243 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root 18w FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:32.243 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root 19u unix 0xffff8da307b0b300 0t0 187412 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-05T08:43:32.243 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root 20u IPv4 185761 0t0 TCP *:6802 (LISTEN) 2023-11-05T08:43:32.243 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root 21u IPv4 185765 0t0 TCP *:6803 (LISTEN) 2023-11-05T08:43:32.243 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root 22u IPv4 185770 0t0 TCP *:6804 (LISTEN) 2023-11-05T08:43:32.244 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root 23u IPv4 185776 0t0 TCP *:6805 (LISTEN) 2023-11-05T08:43:32.244 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root 24u IPv4 185783 0t0 TCP *:6806 (LISTEN) 2023-11-05T08:43:32.244 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root 25u IPv4 185791 0t0 TCP *:6807 (LISTEN) 2023-11-05T08:43:32.244 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root 26u IPv4 185800 0t0 TCP *:6808 (LISTEN) 2023-11-05T08:43:32.244 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root 27u IPv4 185810 0t0 TCP *:6809 (LISTEN) 2023-11-05T08:43:32.245 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root 28r FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:32.245 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root 29w FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:32.245 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root 30r FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:32.245 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root 31w FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:32.245 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root 32u sock 0,8 0t0 182041 protocol: UDPv6 2023-11-05T08:43:32.245 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-05T08:43:32.246 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-05T08:43:32.246 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.246 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.246 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.246 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.247 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.249 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.249 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.249 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.249 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.250 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.250 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.250 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.250 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.250 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.250 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.251 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.251 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.251 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.251 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.251 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.252 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.252 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.252 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.252 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.252 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root 60r FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:32.252 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root 61w FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:32.253 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root 62r FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:32.253 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root 63w FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:32.253 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root 66u IPv4 199302 0t0 TCP smithi156.front.sepia.ceph.com:56964->smithi156.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-05T08:43:32.253 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root 67u IPv4 199303 0t0 TCP smithi156.front.sepia.ceph.com:6802->smithi156.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-05T08:43:32.253 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:32.254 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root *525u REG 8,1 32 3087 /tmp/valgrind_proc_86246_cmdline_85358a06 (deleted) 2023-11-05T08:43:32.254 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root *526u REG 8,1 336 3088 /tmp/valgrind_proc_86246_auxv_85358a06 (deleted) 2023-11-05T08:43:32.254 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root *527w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:32.254 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root *528w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:32.254 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root *529r FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:32.255 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root *530w FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:32.255 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86439 rocksdb:l root *531r FIFO 8,1 0t0 3091 /tmp/vgdb-pipe-from-vgdb-to-86246-by-root-on-??? 2023-11-05T08:43:32.255 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root cwd DIR 8,1 4096 265785 /home/ubuntu/cephtest 2023-11-05T08:43:32.255 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:32.255 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-05T08:43:32.255 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:32.256 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:32.256 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-05T08:43:32.256 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-05T08:43:32.256 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root mem REG 8,1 15752 265597 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-05T08:43:32.256 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-05T08:43:32.257 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-05T08:43:32.257 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-05T08:43:32.257 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-05T08:43:32.257 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-05T08:43:32.257 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-05T08:43:32.258 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:32.258 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-05T08:43:32.258 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-05T08:43:32.258 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:32.258 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-05T08:43:32.259 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-05T08:43:32.259 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-05T08:43:32.259 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-05T08:43:32.259 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-05T08:43:32.259 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-05T08:43:32.259 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:32.260 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:32.260 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:32.260 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-05T08:43:32.260 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-05T08:43:32.260 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-05T08:43:32.261 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-05T08:43:32.261 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-05T08:43:32.261 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-05T08:43:32.261 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-05T08:43:32.261 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-05T08:43:32.262 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-05T08:43:32.262 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-05T08:43:32.262 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-05T08:43:32.262 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-05T08:43:32.262 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-05T08:43:32.263 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-05T08:43:32.263 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-05T08:43:32.263 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-05T08:43:32.263 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-05T08:43:32.263 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-05T08:43:32.264 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-05T08:43:32.264 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-05T08:43:32.264 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-05T08:43:32.264 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:32.264 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-05T08:43:32.264 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:32.265 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-05T08:43:32.265 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-05T08:43:32.265 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-05T08:43:32.265 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-05T08:43:32.265 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-05T08:43:32.266 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root mem REG 8,1 83456 265542 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-05T08:43:32.266 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root mem REG 8,1 370416 265532 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-05T08:43:32.266 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root mem REG 8,1 1481856 265536 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-05T08:43:32.266 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root mem REG 8,1 45648 265517 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-05T08:43:32.266 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root mem REG 8,1 41304 265576 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-05T08:43:32.267 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root mem REG 8,1 49912 265561 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-05T08:43:32.267 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root mem REG 8,1 418096 265585 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-05T08:43:32.267 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root mem REG 8,1 83208 265579 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-05T08:43:32.267 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-05T08:43:32.267 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root mem REG 8,1 79224 265555 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-05T08:43:32.267 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root mem REG 8,1 49744 265609 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-05T08:43:32.268 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root mem REG 8,1 49856 265552 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-05T08:43:32.268 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root mem REG 8,1 83632 265549 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-05T08:43:32.268 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root mem REG 8,1 78744 265606 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-05T08:43:32.268 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root mem REG 8,1 53880 265603 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-05T08:43:32.268 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root mem REG 8,1 872944 265588 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-05T08:43:32.269 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root mem REG 8,1 116592 265558 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-05T08:43:32.269 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-05T08:43:32.269 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root mem REG 8,1 1242808 265591 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-05T08:43:32.269 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root mem REG 8,1 62224 265570 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-05T08:43:32.269 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root mem REG 8,1 95808 265564 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-05T08:43:32.270 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root mem REG 8,1 37272 265600 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-05T08:43:32.270 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root mem REG 8,1 104024 265582 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-05T08:43:32.270 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root mem REG 8,1 133480 265546 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-05T08:43:32.270 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root mem REG 8,1 834760 265573 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-05T08:43:32.270 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-05T08:43:32.271 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root mem REG 8,1 129280 265594 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-05T08:43:32.271 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root mem REG 8,1 83224 265567 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-05T08:43:32.271 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root mem REG 8,1 48 3081 /tmp/vgdb-pipe-shared-mem-vgdb-86246-by-root-on-??? 2023-11-05T08:43:32.271 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root DEL REG 0,17 182056 /[aio] 2023-11-05T08:43:32.271 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root DEL REG 0,17 182868 /[aio] 2023-11-05T08:43:32.271 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root 0r CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:32.272 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root 1w FIFO 0,13 0t0 182740 pipe 2023-11-05T08:43:32.272 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root 2w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:32.272 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root 3w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:32.272 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root 4r FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:32.272 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root 5w FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:32.273 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root 6u a_inode 0,14 0 1084 [eventpoll:7,20,21,22,23,24,25,26,27,66] 2023-11-05T08:43:32.273 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root 7r FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:32.273 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root 8w FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:32.273 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root 9u a_inode 0,14 0 1084 [eventpoll:10,67] 2023-11-05T08:43:32.273 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root 10r FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:32.274 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root 11w FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:32.274 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root 12u a_inode 0,14 0 1084 [eventpoll:13] 2023-11-05T08:43:32.274 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root 13r FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:32.274 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root 14w FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:32.274 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root 15w REG 8,1 465910012 276998 /var/log/ceph/ceph-osd.7.log 2023-11-05T08:43:32.274 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root 16uW REG 0,24 6 1974 /run/ceph/ceph-osd.7.pid 2023-11-05T08:43:32.275 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root 17r FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:32.275 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root 18w FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:32.275 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root 19u unix 0xffff8da307b0b300 0t0 187412 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-05T08:43:32.275 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root 20u IPv4 185761 0t0 TCP *:6802 (LISTEN) 2023-11-05T08:43:32.275 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root 21u IPv4 185765 0t0 TCP *:6803 (LISTEN) 2023-11-05T08:43:32.276 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root 22u IPv4 185770 0t0 TCP *:6804 (LISTEN) 2023-11-05T08:43:32.276 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root 23u IPv4 185776 0t0 TCP *:6805 (LISTEN) 2023-11-05T08:43:32.276 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root 24u IPv4 185783 0t0 TCP *:6806 (LISTEN) 2023-11-05T08:43:32.276 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root 25u IPv4 185791 0t0 TCP *:6807 (LISTEN) 2023-11-05T08:43:32.276 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root 26u IPv4 185800 0t0 TCP *:6808 (LISTEN) 2023-11-05T08:43:32.276 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root 27u IPv4 185810 0t0 TCP *:6809 (LISTEN) 2023-11-05T08:43:32.277 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root 28r FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:32.277 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root 29w FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:32.277 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root 30r FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:32.277 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root 31w FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:32.277 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root 32u sock 0,8 0t0 182041 protocol: UDPv6 2023-11-05T08:43:32.278 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-05T08:43:32.278 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-05T08:43:32.278 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.278 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.278 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.278 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.279 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.279 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.279 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.279 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.279 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.280 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.280 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.280 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.280 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.280 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.281 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.281 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.281 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.281 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.281 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.282 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.282 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.282 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.282 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.282 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.282 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root 60r FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:32.283 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root 61w FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:32.283 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root 62r FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:32.283 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root 63w FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:32.283 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root 66u IPv4 199302 0t0 TCP smithi156.front.sepia.ceph.com:56964->smithi156.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-05T08:43:32.283 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root 67u IPv4 199303 0t0 TCP smithi156.front.sepia.ceph.com:6802->smithi156.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-05T08:43:32.284 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:32.284 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root *525u REG 8,1 32 3087 /tmp/valgrind_proc_86246_cmdline_85358a06 (deleted) 2023-11-05T08:43:32.284 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root *526u REG 8,1 336 3088 /tmp/valgrind_proc_86246_auxv_85358a06 (deleted) 2023-11-05T08:43:32.284 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root *527w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:32.284 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root *528w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:32.285 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root *529r FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:32.285 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root *530w FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:32.285 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86440 rocksdb:l root *531r FIFO 8,1 0t0 3091 /tmp/vgdb-pipe-from-vgdb-to-86246-by-root-on-??? 2023-11-05T08:43:32.285 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root cwd DIR 8,1 4096 265785 /home/ubuntu/cephtest 2023-11-05T08:43:32.285 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:32.285 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-05T08:43:32.286 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:32.286 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:32.286 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-05T08:43:32.286 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-05T08:43:32.286 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root mem REG 8,1 15752 265597 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-05T08:43:32.287 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-05T08:43:32.287 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-05T08:43:32.287 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-05T08:43:32.287 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-05T08:43:32.287 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-05T08:43:32.287 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-05T08:43:32.288 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:32.288 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-05T08:43:32.288 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-05T08:43:32.288 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:32.288 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-05T08:43:32.289 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-05T08:43:32.289 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-05T08:43:32.289 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-05T08:43:32.289 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-05T08:43:32.289 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-05T08:43:32.289 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:32.290 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:32.290 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:32.290 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-05T08:43:32.290 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-05T08:43:32.290 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-05T08:43:32.291 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-05T08:43:32.291 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-05T08:43:32.291 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-05T08:43:32.291 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-05T08:43:32.291 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-05T08:43:32.292 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-05T08:43:32.292 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-05T08:43:32.292 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-05T08:43:32.292 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-05T08:43:32.293 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-05T08:43:32.293 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-05T08:43:32.293 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-05T08:43:32.293 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-05T08:43:32.293 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-05T08:43:32.293 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-05T08:43:32.294 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-05T08:43:32.294 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-05T08:43:32.294 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-05T08:43:32.294 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:32.294 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-05T08:43:32.295 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:32.295 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-05T08:43:32.295 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-05T08:43:32.295 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-05T08:43:32.295 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-05T08:43:32.296 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-05T08:43:32.296 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root mem REG 8,1 83456 265542 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-05T08:43:32.296 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root mem REG 8,1 370416 265532 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-05T08:43:32.296 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root mem REG 8,1 1481856 265536 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-05T08:43:32.296 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root mem REG 8,1 45648 265517 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-05T08:43:32.297 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root mem REG 8,1 41304 265576 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-05T08:43:32.297 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root mem REG 8,1 49912 265561 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-05T08:43:32.297 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root mem REG 8,1 418096 265585 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-05T08:43:32.297 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root mem REG 8,1 83208 265579 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-05T08:43:32.297 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-05T08:43:32.298 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root mem REG 8,1 79224 265555 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-05T08:43:32.298 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root mem REG 8,1 49744 265609 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-05T08:43:32.298 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root mem REG 8,1 49856 265552 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-05T08:43:32.298 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root mem REG 8,1 83632 265549 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-05T08:43:32.298 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root mem REG 8,1 78744 265606 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-05T08:43:32.298 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root mem REG 8,1 53880 265603 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-05T08:43:32.299 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root mem REG 8,1 872944 265588 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-05T08:43:32.299 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root mem REG 8,1 116592 265558 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-05T08:43:32.299 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-05T08:43:32.299 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root mem REG 8,1 1242808 265591 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-05T08:43:32.299 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root mem REG 8,1 62224 265570 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-05T08:43:32.300 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root mem REG 8,1 95808 265564 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-05T08:43:32.300 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root mem REG 8,1 37272 265600 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-05T08:43:32.300 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root mem REG 8,1 104024 265582 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-05T08:43:32.300 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root mem REG 8,1 133480 265546 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-05T08:43:32.300 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root mem REG 8,1 834760 265573 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-05T08:43:32.301 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-05T08:43:32.301 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root mem REG 8,1 129280 265594 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-05T08:43:32.301 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root mem REG 8,1 83224 265567 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-05T08:43:32.301 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root mem REG 8,1 48 3081 /tmp/vgdb-pipe-shared-mem-vgdb-86246-by-root-on-??? 2023-11-05T08:43:32.301 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root DEL REG 0,17 182056 /[aio] 2023-11-05T08:43:32.301 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root DEL REG 0,17 182868 /[aio] 2023-11-05T08:43:32.302 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root 0r CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:32.302 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root 1w FIFO 0,13 0t0 182740 pipe 2023-11-05T08:43:32.302 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root 2w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:32.302 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root 3w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:32.302 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root 4r FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:32.303 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root 5w FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:32.303 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root 6u a_inode 0,14 0 1084 [eventpoll:7,20,21,22,23,24,25,26,27,66] 2023-11-05T08:43:32.303 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root 7r FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:32.303 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root 8w FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:32.303 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root 9u a_inode 0,14 0 1084 [eventpoll:10,67] 2023-11-05T08:43:32.304 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root 10r FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:32.304 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root 11w FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:32.304 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root 12u a_inode 0,14 0 1084 [eventpoll:13] 2023-11-05T08:43:32.304 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root 13r FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:32.304 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root 14w FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:32.305 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root 15w REG 8,1 465910012 276998 /var/log/ceph/ceph-osd.7.log 2023-11-05T08:43:32.305 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root 16uW REG 0,24 6 1974 /run/ceph/ceph-osd.7.pid 2023-11-05T08:43:32.305 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root 17r FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:32.305 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root 18w FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:32.305 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root 19u unix 0xffff8da307b0b300 0t0 187412 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-05T08:43:32.306 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root 20u IPv4 185761 0t0 TCP *:6802 (LISTEN) 2023-11-05T08:43:32.306 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root 21u IPv4 185765 0t0 TCP *:6803 (LISTEN) 2023-11-05T08:43:32.306 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root 22u IPv4 185770 0t0 TCP *:6804 (LISTEN) 2023-11-05T08:43:32.306 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root 23u IPv4 185776 0t0 TCP *:6805 (LISTEN) 2023-11-05T08:43:32.306 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root 24u IPv4 185783 0t0 TCP *:6806 (LISTEN) 2023-11-05T08:43:32.306 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root 25u IPv4 185791 0t0 TCP *:6807 (LISTEN) 2023-11-05T08:43:32.307 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root 26u IPv4 185800 0t0 TCP *:6808 (LISTEN) 2023-11-05T08:43:32.307 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root 27u IPv4 185810 0t0 TCP *:6809 (LISTEN) 2023-11-05T08:43:32.307 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root 28r FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:32.307 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root 29w FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:32.307 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root 30r FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:32.308 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root 31w FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:32.308 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root 32u sock 0,8 0t0 182041 protocol: UDPv6 2023-11-05T08:43:32.308 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-05T08:43:32.308 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-05T08:43:32.308 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.308 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.309 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.309 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.309 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.309 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.309 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.310 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.310 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.310 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.310 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.310 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.310 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.311 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.311 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.311 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.311 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.311 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.312 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.312 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.312 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.312 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.312 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.312 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.313 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root 60r FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:32.313 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root 61w FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:32.313 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root 62r FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:32.313 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root 63w FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:32.313 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root 66u IPv4 199302 0t0 TCP smithi156.front.sepia.ceph.com:56964->smithi156.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-05T08:43:32.314 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root 67u IPv4 199303 0t0 TCP smithi156.front.sepia.ceph.com:6802->smithi156.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-05T08:43:32.314 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:32.314 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root *525u REG 8,1 32 3087 /tmp/valgrind_proc_86246_cmdline_85358a06 (deleted) 2023-11-05T08:43:32.314 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root *526u REG 8,1 336 3088 /tmp/valgrind_proc_86246_auxv_85358a06 (deleted) 2023-11-05T08:43:32.314 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root *527w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:32.314 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root *528w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:32.315 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root *529r FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:32.315 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root *530w FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:32.315 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86441 rocksdb:l root *531r FIFO 8,1 0t0 3091 /tmp/vgdb-pipe-from-vgdb-to-86246-by-root-on-??? 2023-11-05T08:43:32.315 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root cwd DIR 8,1 4096 265785 /home/ubuntu/cephtest 2023-11-05T08:43:32.316 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:32.316 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-05T08:43:32.316 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:32.316 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:32.316 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-05T08:43:32.317 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-05T08:43:32.317 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root mem REG 8,1 15752 265597 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-05T08:43:32.317 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-05T08:43:32.317 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-05T08:43:32.317 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-05T08:43:32.317 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-05T08:43:32.318 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-05T08:43:32.318 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-05T08:43:32.318 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:32.318 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-05T08:43:32.318 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-05T08:43:32.319 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:32.319 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-05T08:43:32.319 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-05T08:43:32.319 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-05T08:43:32.319 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-05T08:43:32.319 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-05T08:43:32.320 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-05T08:43:32.320 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:32.320 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:32.320 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:32.320 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-05T08:43:32.321 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-05T08:43:32.321 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-05T08:43:32.321 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-05T08:43:32.321 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-05T08:43:32.321 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-05T08:43:32.321 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-05T08:43:32.322 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-05T08:43:32.322 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-05T08:43:32.322 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-05T08:43:32.322 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-05T08:43:32.322 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-05T08:43:32.323 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-05T08:43:32.323 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-05T08:43:32.323 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-05T08:43:32.323 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-05T08:43:32.323 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-05T08:43:32.323 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-05T08:43:32.324 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-05T08:43:32.324 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-05T08:43:32.324 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-05T08:43:32.324 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:32.324 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-05T08:43:32.325 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:32.325 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-05T08:43:32.325 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-05T08:43:32.325 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-05T08:43:32.325 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-05T08:43:32.325 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-05T08:43:32.326 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root mem REG 8,1 83456 265542 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-05T08:43:32.326 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root mem REG 8,1 370416 265532 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-05T08:43:32.326 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root mem REG 8,1 1481856 265536 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-05T08:43:32.326 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root mem REG 8,1 45648 265517 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-05T08:43:32.326 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root mem REG 8,1 41304 265576 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-05T08:43:32.327 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root mem REG 8,1 49912 265561 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-05T08:43:32.327 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root mem REG 8,1 418096 265585 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-05T08:43:32.327 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root mem REG 8,1 83208 265579 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-05T08:43:32.327 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-05T08:43:32.327 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root mem REG 8,1 79224 265555 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-05T08:43:32.328 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root mem REG 8,1 49744 265609 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-05T08:43:32.328 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root mem REG 8,1 49856 265552 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-05T08:43:32.328 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root mem REG 8,1 83632 265549 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-05T08:43:32.328 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root mem REG 8,1 78744 265606 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-05T08:43:32.328 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root mem REG 8,1 53880 265603 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-05T08:43:32.329 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root mem REG 8,1 872944 265588 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-05T08:43:32.329 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root mem REG 8,1 116592 265558 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-05T08:43:32.329 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-05T08:43:32.329 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root mem REG 8,1 1242808 265591 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-05T08:43:32.329 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root mem REG 8,1 62224 265570 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-05T08:43:32.330 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root mem REG 8,1 95808 265564 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-05T08:43:32.330 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root mem REG 8,1 37272 265600 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-05T08:43:32.330 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root mem REG 8,1 104024 265582 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-05T08:43:32.330 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root mem REG 8,1 133480 265546 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-05T08:43:32.330 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root mem REG 8,1 834760 265573 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-05T08:43:32.330 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-05T08:43:32.331 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root mem REG 8,1 129280 265594 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-05T08:43:32.331 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root mem REG 8,1 83224 265567 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-05T08:43:32.331 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root mem REG 8,1 48 3081 /tmp/vgdb-pipe-shared-mem-vgdb-86246-by-root-on-??? 2023-11-05T08:43:32.331 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root DEL REG 0,17 182056 /[aio] 2023-11-05T08:43:32.331 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root DEL REG 0,17 182868 /[aio] 2023-11-05T08:43:32.332 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root 0r CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:32.332 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root 1w FIFO 0,13 0t0 182740 pipe 2023-11-05T08:43:32.332 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root 2w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:32.332 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root 3w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:32.332 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root 4r FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:32.332 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root 5w FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:32.333 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root 6u a_inode 0,14 0 1084 [eventpoll:7,20,21,22,23,24,25,26,27,66] 2023-11-05T08:43:32.333 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root 7r FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:32.333 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root 8w FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:32.333 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root 9u a_inode 0,14 0 1084 [eventpoll:10,67] 2023-11-05T08:43:32.333 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root 10r FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:32.333 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root 11w FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:32.334 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root 12u a_inode 0,14 0 1084 [eventpoll:13] 2023-11-05T08:43:32.334 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root 13r FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:32.334 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root 14w FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:32.334 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root 15w REG 8,1 465910012 276998 /var/log/ceph/ceph-osd.7.log 2023-11-05T08:43:32.334 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root 16uW REG 0,24 6 1974 /run/ceph/ceph-osd.7.pid 2023-11-05T08:43:32.335 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root 17r FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:32.335 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root 18w FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:32.335 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root 19u unix 0xffff8da307b0b300 0t0 187412 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-05T08:43:32.335 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root 20u IPv4 185761 0t0 TCP *:6802 (LISTEN) 2023-11-05T08:43:32.335 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root 21u IPv4 185765 0t0 TCP *:6803 (LISTEN) 2023-11-05T08:43:32.336 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root 22u IPv4 185770 0t0 TCP *:6804 (LISTEN) 2023-11-05T08:43:32.336 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root 23u IPv4 185776 0t0 TCP *:6805 (LISTEN) 2023-11-05T08:43:32.336 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root 24u IPv4 185783 0t0 TCP *:6806 (LISTEN) 2023-11-05T08:43:32.336 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root 25u IPv4 185791 0t0 TCP *:6807 (LISTEN) 2023-11-05T08:43:32.336 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root 26u IPv4 185800 0t0 TCP *:6808 (LISTEN) 2023-11-05T08:43:32.336 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root 27u IPv4 185810 0t0 TCP *:6809 (LISTEN) 2023-11-05T08:43:32.337 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root 28r FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:32.337 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root 29w FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:32.337 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root 30r FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:32.337 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root 31w FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:32.337 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root 32u sock 0,8 0t0 182041 protocol: UDPv6 2023-11-05T08:43:32.337 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-05T08:43:32.338 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-05T08:43:32.338 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.338 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.338 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.339 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.339 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.339 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.339 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.339 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.340 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.340 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.340 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.340 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.340 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.340 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.341 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.341 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.341 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.341 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.341 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.341 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.342 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.342 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.342 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.342 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.342 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root 60r FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:32.343 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root 61w FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:32.343 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root 62r FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:32.343 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root 63w FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:32.343 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root 66u IPv4 199302 0t0 TCP smithi156.front.sepia.ceph.com:56964->smithi156.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-05T08:43:32.343 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root 67u IPv4 199303 0t0 TCP smithi156.front.sepia.ceph.com:6802->smithi156.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-05T08:43:32.344 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:32.344 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root *525u REG 8,1 32 3087 /tmp/valgrind_proc_86246_cmdline_85358a06 (deleted) 2023-11-05T08:43:32.344 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root *526u REG 8,1 336 3088 /tmp/valgrind_proc_86246_auxv_85358a06 (deleted) 2023-11-05T08:43:32.344 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root *527w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:32.344 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root *528w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:32.344 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root *529r FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:32.345 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root *530w FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:32.345 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 86442 rocksdb:h root *531r FIFO 8,1 0t0 3091 /tmp/vgdb-pipe-from-vgdb-to-86246-by-root-on-??? 2023-11-05T08:43:32.345 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root cwd DIR 8,1 4096 265785 /home/ubuntu/cephtest 2023-11-05T08:43:32.345 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:32.345 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-05T08:43:32.345 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:32.346 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:32.346 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-05T08:43:32.346 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-05T08:43:32.346 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root mem REG 8,1 15752 265597 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-05T08:43:32.346 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-05T08:43:32.347 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-05T08:43:32.347 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-05T08:43:32.347 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-05T08:43:32.347 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-05T08:43:32.347 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-05T08:43:32.347 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:32.348 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-05T08:43:32.348 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-05T08:43:32.348 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:32.348 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-05T08:43:32.348 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-05T08:43:32.349 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-05T08:43:32.349 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-05T08:43:32.349 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-05T08:43:32.349 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-05T08:43:32.349 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:32.350 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:32.350 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:32.350 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-05T08:43:32.350 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-05T08:43:32.350 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-05T08:43:32.351 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-05T08:43:32.351 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-05T08:43:32.351 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-05T08:43:32.351 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-05T08:43:32.351 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-05T08:43:32.351 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-05T08:43:32.352 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-05T08:43:32.352 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-05T08:43:32.352 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-05T08:43:32.352 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-05T08:43:32.352 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-05T08:43:32.353 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-05T08:43:32.353 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-05T08:43:32.353 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-05T08:43:32.353 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-05T08:43:32.353 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-05T08:43:32.353 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-05T08:43:32.354 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-05T08:43:32.354 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:32.354 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-05T08:43:32.354 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:32.354 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-05T08:43:32.355 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-05T08:43:32.355 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-05T08:43:32.355 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-05T08:43:32.355 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-05T08:43:32.355 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root mem REG 8,1 83456 265542 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-05T08:43:32.356 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root mem REG 8,1 370416 265532 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-05T08:43:32.356 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root mem REG 8,1 1481856 265536 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-05T08:43:32.356 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root mem REG 8,1 45648 265517 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-05T08:43:32.356 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root mem REG 8,1 41304 265576 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-05T08:43:32.356 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root mem REG 8,1 49912 265561 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-05T08:43:32.356 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root mem REG 8,1 418096 265585 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-05T08:43:32.357 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root mem REG 8,1 83208 265579 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-05T08:43:32.357 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-05T08:43:32.357 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root mem REG 8,1 79224 265555 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-05T08:43:32.357 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root mem REG 8,1 49744 265609 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-05T08:43:32.357 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root mem REG 8,1 49856 265552 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-05T08:43:32.358 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root mem REG 8,1 83632 265549 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-05T08:43:32.358 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root mem REG 8,1 78744 265606 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-05T08:43:32.358 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root mem REG 8,1 53880 265603 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-05T08:43:32.358 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root mem REG 8,1 872944 265588 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-05T08:43:32.358 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root mem REG 8,1 116592 265558 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-05T08:43:32.358 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-05T08:43:32.359 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root mem REG 8,1 1242808 265591 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-05T08:43:32.359 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root mem REG 8,1 62224 265570 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-05T08:43:32.359 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root mem REG 8,1 95808 265564 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-05T08:43:32.359 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root mem REG 8,1 37272 265600 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-05T08:43:32.359 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root mem REG 8,1 104024 265582 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-05T08:43:32.360 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root mem REG 8,1 133480 265546 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-05T08:43:32.360 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root mem REG 8,1 834760 265573 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-05T08:43:32.360 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-05T08:43:32.360 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root mem REG 8,1 129280 265594 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-05T08:43:32.360 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root mem REG 8,1 83224 265567 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-05T08:43:32.361 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root mem REG 8,1 48 3081 /tmp/vgdb-pipe-shared-mem-vgdb-86246-by-root-on-??? 2023-11-05T08:43:32.361 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root DEL REG 0,17 182056 /[aio] 2023-11-05T08:43:32.361 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root DEL REG 0,17 182868 /[aio] 2023-11-05T08:43:32.361 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root 0r CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:32.361 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root 1w FIFO 0,13 0t0 182740 pipe 2023-11-05T08:43:32.362 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root 2w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:32.362 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root 3w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:32.362 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root 4r FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:32.362 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root 5w FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:32.362 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root 6u a_inode 0,14 0 1084 [eventpoll:7,20,21,22,23,24,25,26,27,66] 2023-11-05T08:43:32.363 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root 7r FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:32.363 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root 8w FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:32.363 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root 9u a_inode 0,14 0 1084 [eventpoll:10,67] 2023-11-05T08:43:32.363 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root 10r FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:32.363 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root 11w FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:32.363 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root 12u a_inode 0,14 0 1084 [eventpoll:13] 2023-11-05T08:43:32.364 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root 13r FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:32.364 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root 14w FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:32.364 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root 15w REG 8,1 465910012 276998 /var/log/ceph/ceph-osd.7.log 2023-11-05T08:43:32.364 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root 16uW REG 0,24 6 1974 /run/ceph/ceph-osd.7.pid 2023-11-05T08:43:32.364 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root 17r FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:32.365 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root 18w FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:32.365 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root 19u unix 0xffff8da307b0b300 0t0 187412 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-05T08:43:32.365 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root 20u IPv4 185761 0t0 TCP *:6802 (LISTEN) 2023-11-05T08:43:32.365 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root 21u IPv4 185765 0t0 TCP *:6803 (LISTEN) 2023-11-05T08:43:32.365 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root 22u IPv4 185770 0t0 TCP *:6804 (LISTEN) 2023-11-05T08:43:32.365 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root 23u IPv4 185776 0t0 TCP *:6805 (LISTEN) 2023-11-05T08:43:32.366 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root 24u IPv4 185783 0t0 TCP *:6806 (LISTEN) 2023-11-05T08:43:32.366 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root 25u IPv4 185791 0t0 TCP *:6807 (LISTEN) 2023-11-05T08:43:32.366 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root 26u IPv4 185800 0t0 TCP *:6808 (LISTEN) 2023-11-05T08:43:32.366 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root 27u IPv4 185810 0t0 TCP *:6809 (LISTEN) 2023-11-05T08:43:32.366 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root 28r FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:32.367 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root 29w FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:32.367 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root 30r FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:32.367 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root 31w FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:32.367 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root 32u sock 0,8 0t0 182041 protocol: UDPv6 2023-11-05T08:43:32.367 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-05T08:43:32.367 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-05T08:43:32.368 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.368 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.368 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.368 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.368 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.369 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.369 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.369 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.369 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.369 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.369 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.370 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.370 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.370 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.370 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.370 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.371 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.371 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.371 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.371 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.371 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.371 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.372 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.372 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.372 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root 60r FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:32.372 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root 61w FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:32.372 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root 62r FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:32.373 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root 63w FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:32.373 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root 66u IPv4 199302 0t0 TCP smithi156.front.sepia.ceph.com:56964->smithi156.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-05T08:43:32.373 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root 67u IPv4 199303 0t0 TCP smithi156.front.sepia.ceph.com:6802->smithi156.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-05T08:43:32.373 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:32.373 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root *525u REG 8,1 32 3087 /tmp/valgrind_proc_86246_cmdline_85358a06 (deleted) 2023-11-05T08:43:32.374 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root *526u REG 8,1 336 3088 /tmp/valgrind_proc_86246_auxv_85358a06 (deleted) 2023-11-05T08:43:32.374 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root *527w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:32.374 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root *528w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:32.374 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root *529r FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:32.374 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root *530w FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:32.375 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87915 bstore_ai root *531r FIFO 8,1 0t0 3091 /tmp/vgdb-pipe-from-vgdb-to-86246-by-root-on-??? 2023-11-05T08:43:32.375 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root cwd DIR 8,1 4096 265785 /home/ubuntu/cephtest 2023-11-05T08:43:32.375 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:32.375 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-05T08:43:32.375 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:32.375 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:32.376 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-05T08:43:32.376 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-05T08:43:32.376 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root mem REG 8,1 15752 265597 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-05T08:43:32.376 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-05T08:43:32.376 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-05T08:43:32.377 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-05T08:43:32.377 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-05T08:43:32.377 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-05T08:43:32.377 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-05T08:43:32.377 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:32.377 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-05T08:43:32.378 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-05T08:43:32.378 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:32.378 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-05T08:43:32.378 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-05T08:43:32.378 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-05T08:43:32.379 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-05T08:43:32.379 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-05T08:43:32.379 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-05T08:43:32.379 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:32.379 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:32.379 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:32.380 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-05T08:43:32.380 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-05T08:43:32.380 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-05T08:43:32.380 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-05T08:43:32.380 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-05T08:43:32.381 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-05T08:43:32.381 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-05T08:43:32.381 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-05T08:43:32.381 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-05T08:43:32.381 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-05T08:43:32.381 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-05T08:43:32.382 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-05T08:43:32.382 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-05T08:43:32.382 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-05T08:43:32.382 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-05T08:43:32.382 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-05T08:43:32.383 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-05T08:43:32.383 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-05T08:43:32.383 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-05T08:43:32.383 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-05T08:43:32.383 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-05T08:43:32.384 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:32.384 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-05T08:43:32.384 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:32.384 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-05T08:43:32.384 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-05T08:43:32.385 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-05T08:43:32.385 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-05T08:43:32.385 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-05T08:43:32.385 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root mem REG 8,1 83456 265542 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-05T08:43:32.385 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root mem REG 8,1 370416 265532 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-05T08:43:32.385 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root mem REG 8,1 1481856 265536 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-05T08:43:32.386 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root mem REG 8,1 45648 265517 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-05T08:43:32.386 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root mem REG 8,1 41304 265576 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-05T08:43:32.386 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root mem REG 8,1 49912 265561 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-05T08:43:32.386 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root mem REG 8,1 418096 265585 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-05T08:43:32.386 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root mem REG 8,1 83208 265579 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-05T08:43:32.387 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-05T08:43:32.387 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root mem REG 8,1 79224 265555 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-05T08:43:32.387 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root mem REG 8,1 49744 265609 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-05T08:43:32.387 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root mem REG 8,1 49856 265552 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-05T08:43:32.387 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root mem REG 8,1 83632 265549 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-05T08:43:32.387 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root mem REG 8,1 78744 265606 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-05T08:43:32.388 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root mem REG 8,1 53880 265603 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-05T08:43:32.388 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root mem REG 8,1 872944 265588 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-05T08:43:32.388 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root mem REG 8,1 116592 265558 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-05T08:43:32.388 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-05T08:43:32.388 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root mem REG 8,1 1242808 265591 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-05T08:43:32.389 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root mem REG 8,1 62224 265570 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-05T08:43:32.389 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root mem REG 8,1 95808 265564 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-05T08:43:32.389 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root mem REG 8,1 37272 265600 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-05T08:43:32.389 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root mem REG 8,1 104024 265582 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-05T08:43:32.389 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root mem REG 8,1 133480 265546 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-05T08:43:32.389 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root mem REG 8,1 834760 265573 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-05T08:43:32.390 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-05T08:43:32.390 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root mem REG 8,1 129280 265594 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-05T08:43:32.390 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root mem REG 8,1 83224 265567 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-05T08:43:32.390 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root mem REG 8,1 48 3081 /tmp/vgdb-pipe-shared-mem-vgdb-86246-by-root-on-??? 2023-11-05T08:43:32.390 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root DEL REG 0,17 182056 /[aio] 2023-11-05T08:43:32.391 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root DEL REG 0,17 182868 /[aio] 2023-11-05T08:43:32.391 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root 0r CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:32.391 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root 1w FIFO 0,13 0t0 182740 pipe 2023-11-05T08:43:32.391 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root 2w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:32.391 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root 3w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:32.391 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root 4r FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:32.392 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root 5w FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:32.392 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root 6u a_inode 0,14 0 1084 [eventpoll:7,20,21,22,23,24,25,26,27,66] 2023-11-05T08:43:32.392 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root 7r FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:32.392 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root 8w FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:32.392 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root 9u a_inode 0,14 0 1084 [eventpoll:10,67] 2023-11-05T08:43:32.393 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root 10r FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:32.393 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root 11w FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:32.393 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root 12u a_inode 0,14 0 1084 [eventpoll:13] 2023-11-05T08:43:32.393 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root 13r FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:32.393 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root 14w FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:32.393 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root 15w REG 8,1 465910012 276998 /var/log/ceph/ceph-osd.7.log 2023-11-05T08:43:32.394 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root 16uW REG 0,24 6 1974 /run/ceph/ceph-osd.7.pid 2023-11-05T08:43:32.394 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root 17r FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:32.394 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root 18w FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:32.394 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root 19u unix 0xffff8da307b0b300 0t0 187412 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-05T08:43:32.395 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root 20u IPv4 185761 0t0 TCP *:6802 (LISTEN) 2023-11-05T08:43:32.395 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root 21u IPv4 185765 0t0 TCP *:6803 (LISTEN) 2023-11-05T08:43:32.395 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root 22u IPv4 185770 0t0 TCP *:6804 (LISTEN) 2023-11-05T08:43:32.395 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root 23u IPv4 185776 0t0 TCP *:6805 (LISTEN) 2023-11-05T08:43:32.395 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root 24u IPv4 185783 0t0 TCP *:6806 (LISTEN) 2023-11-05T08:43:32.395 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root 25u IPv4 185791 0t0 TCP *:6807 (LISTEN) 2023-11-05T08:43:32.396 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root 26u IPv4 185800 0t0 TCP *:6808 (LISTEN) 2023-11-05T08:43:32.396 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root 27u IPv4 185810 0t0 TCP *:6809 (LISTEN) 2023-11-05T08:43:32.396 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root 28r FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:32.396 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root 29w FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:32.396 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root 30r FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:32.397 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root 31w FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:32.397 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root 32u sock 0,8 0t0 182041 protocol: UDPv6 2023-11-05T08:43:32.397 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-05T08:43:32.397 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-05T08:43:32.397 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.398 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.398 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.398 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.398 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.398 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.398 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.399 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.399 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.399 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.399 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.399 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.400 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.400 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.400 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.400 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.400 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.400 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.401 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.401 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.401 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.401 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.401 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.402 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.402 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root 60r FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:32.402 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root 61w FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:32.402 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root 62r FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:32.402 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root 63w FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:32.403 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root 66u IPv4 199302 0t0 TCP smithi156.front.sepia.ceph.com:56964->smithi156.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-05T08:43:32.403 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root 67u IPv4 199303 0t0 TCP smithi156.front.sepia.ceph.com:6802->smithi156.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-05T08:43:32.403 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:32.403 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root *525u REG 8,1 32 3087 /tmp/valgrind_proc_86246_cmdline_85358a06 (deleted) 2023-11-05T08:43:32.403 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root *526u REG 8,1 336 3088 /tmp/valgrind_proc_86246_auxv_85358a06 (deleted) 2023-11-05T08:43:32.403 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root *527w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:32.404 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root *528w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:32.404 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root *529r FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:32.404 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root *530w FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:32.404 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 87916 bstore_di root *531r FIFO 8,1 0t0 3091 /tmp/vgdb-pipe-from-vgdb-to-86246-by-root-on-??? 2023-11-05T08:43:32.404 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root cwd DIR 8,1 4096 265785 /home/ubuntu/cephtest 2023-11-05T08:43:32.404 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:32.405 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-05T08:43:32.405 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:32.405 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:32.405 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-05T08:43:32.405 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-05T08:43:32.406 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root mem REG 8,1 15752 265597 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-05T08:43:32.406 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-05T08:43:32.406 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-05T08:43:32.406 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-05T08:43:32.407 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-05T08:43:32.407 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-05T08:43:32.407 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-05T08:43:32.407 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:32.407 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-05T08:43:32.407 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-05T08:43:32.408 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:32.408 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-05T08:43:32.408 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-05T08:43:32.408 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-05T08:43:32.408 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-05T08:43:32.409 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-05T08:43:32.409 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-05T08:43:32.409 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:32.409 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:32.409 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:32.409 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-05T08:43:32.410 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-05T08:43:32.410 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-05T08:43:32.410 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-05T08:43:32.410 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-05T08:43:32.410 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-05T08:43:32.411 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-05T08:43:32.411 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-05T08:43:32.411 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-05T08:43:32.411 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-05T08:43:32.411 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-05T08:43:32.411 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-05T08:43:32.412 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-05T08:43:32.412 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-05T08:43:32.412 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-05T08:43:32.412 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-05T08:43:32.412 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-05T08:43:32.413 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-05T08:43:32.413 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-05T08:43:32.413 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-05T08:43:32.413 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-05T08:43:32.413 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:32.413 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-05T08:43:32.414 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:32.414 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-05T08:43:32.414 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-05T08:43:32.414 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-05T08:43:32.414 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-05T08:43:32.415 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-05T08:43:32.415 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root mem REG 8,1 83456 265542 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-05T08:43:32.415 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root mem REG 8,1 370416 265532 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-05T08:43:32.415 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root mem REG 8,1 1481856 265536 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-05T08:43:32.415 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root mem REG 8,1 45648 265517 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-05T08:43:32.416 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root mem REG 8,1 41304 265576 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-05T08:43:32.416 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root mem REG 8,1 49912 265561 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-05T08:43:32.416 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root mem REG 8,1 418096 265585 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-05T08:43:32.416 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root mem REG 8,1 83208 265579 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-05T08:43:32.416 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-05T08:43:32.416 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root mem REG 8,1 79224 265555 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-05T08:43:32.417 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root mem REG 8,1 49744 265609 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-05T08:43:32.417 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root mem REG 8,1 49856 265552 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-05T08:43:32.417 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root mem REG 8,1 83632 265549 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-05T08:43:32.417 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root mem REG 8,1 78744 265606 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-05T08:43:32.417 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root mem REG 8,1 53880 265603 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-05T08:43:32.418 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root mem REG 8,1 872944 265588 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-05T08:43:32.418 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root mem REG 8,1 116592 265558 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-05T08:43:32.418 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-05T08:43:32.418 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root mem REG 8,1 1242808 265591 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-05T08:43:32.418 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root mem REG 8,1 62224 265570 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-05T08:43:32.419 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root mem REG 8,1 95808 265564 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-05T08:43:32.419 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root mem REG 8,1 37272 265600 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-05T08:43:32.419 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root mem REG 8,1 104024 265582 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-05T08:43:32.419 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root mem REG 8,1 133480 265546 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-05T08:43:32.419 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root mem REG 8,1 834760 265573 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-05T08:43:32.419 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-05T08:43:32.420 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root mem REG 8,1 129280 265594 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-05T08:43:32.420 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root mem REG 8,1 83224 265567 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-05T08:43:32.420 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root mem REG 8,1 48 3081 /tmp/vgdb-pipe-shared-mem-vgdb-86246-by-root-on-??? 2023-11-05T08:43:32.420 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root DEL REG 0,17 182056 /[aio] 2023-11-05T08:43:32.420 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root DEL REG 0,17 182868 /[aio] 2023-11-05T08:43:32.421 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root 0r CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:32.421 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root 1w FIFO 0,13 0t0 182740 pipe 2023-11-05T08:43:32.421 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root 2w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:32.421 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root 3w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:32.421 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root 4r FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:32.422 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root 5w FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:32.422 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root 6u a_inode 0,14 0 1084 [eventpoll:7,20,21,22,23,24,25,26,27,66] 2023-11-05T08:43:32.422 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root 7r FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:32.422 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root 8w FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:32.422 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root 9u a_inode 0,14 0 1084 [eventpoll:10,67] 2023-11-05T08:43:32.422 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root 10r FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:32.423 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root 11w FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:32.423 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root 12u a_inode 0,14 0 1084 [eventpoll:13] 2023-11-05T08:43:32.423 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root 13r FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:32.423 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root 14w FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:32.423 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root 15w REG 8,1 465910012 276998 /var/log/ceph/ceph-osd.7.log 2023-11-05T08:43:32.424 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root 16uW REG 0,24 6 1974 /run/ceph/ceph-osd.7.pid 2023-11-05T08:43:32.424 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root 17r FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:32.424 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root 18w FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:32.424 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root 19u unix 0xffff8da307b0b300 0t0 187412 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-05T08:43:32.424 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root 20u IPv4 185761 0t0 TCP *:6802 (LISTEN) 2023-11-05T08:43:32.424 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root 21u IPv4 185765 0t0 TCP *:6803 (LISTEN) 2023-11-05T08:43:32.425 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root 22u IPv4 185770 0t0 TCP *:6804 (LISTEN) 2023-11-05T08:43:32.425 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root 23u IPv4 185776 0t0 TCP *:6805 (LISTEN) 2023-11-05T08:43:32.425 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root 24u IPv4 185783 0t0 TCP *:6806 (LISTEN) 2023-11-05T08:43:32.425 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root 25u IPv4 185791 0t0 TCP *:6807 (LISTEN) 2023-11-05T08:43:32.425 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root 26u IPv4 185800 0t0 TCP *:6808 (LISTEN) 2023-11-05T08:43:32.426 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root 27u IPv4 185810 0t0 TCP *:6809 (LISTEN) 2023-11-05T08:43:32.426 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root 28r FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:32.426 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root 29w FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:32.426 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root 30r FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:32.426 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root 31w FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:32.427 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root 32u sock 0,8 0t0 182041 protocol: UDPv6 2023-11-05T08:43:32.427 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-05T08:43:32.427 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-05T08:43:32.427 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.427 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.427 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.428 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.428 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.428 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.428 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.428 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.429 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.429 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.429 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.429 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.429 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.430 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.430 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.430 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.430 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.430 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.431 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.431 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.431 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.431 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.431 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.431 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.432 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root 60r FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:32.432 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root 61w FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:32.432 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root 62r FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:32.432 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root 63w FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:32.432 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root 66u IPv4 199302 0t0 TCP smithi156.front.sepia.ceph.com:56964->smithi156.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-05T08:43:32.433 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root 67u IPv4 199303 0t0 TCP smithi156.front.sepia.ceph.com:6802->smithi156.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-05T08:43:32.433 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:32.433 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root *525u REG 8,1 32 3087 /tmp/valgrind_proc_86246_cmdline_85358a06 (deleted) 2023-11-05T08:43:32.433 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root *526u REG 8,1 336 3088 /tmp/valgrind_proc_86246_auxv_85358a06 (deleted) 2023-11-05T08:43:32.433 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root *527w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:32.433 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root *528w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:32.434 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root *529r FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:32.434 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root *530w FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:32.434 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88648 bstore_ai root *531r FIFO 8,1 0t0 3091 /tmp/vgdb-pipe-from-vgdb-to-86246-by-root-on-??? 2023-11-05T08:43:32.434 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root cwd DIR 8,1 4096 265785 /home/ubuntu/cephtest 2023-11-05T08:43:32.434 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:32.435 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-05T08:43:32.435 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:32.435 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:32.435 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-05T08:43:32.435 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-05T08:43:32.436 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root mem REG 8,1 15752 265597 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-05T08:43:32.436 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-05T08:43:32.436 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-05T08:43:32.436 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-05T08:43:32.436 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-05T08:43:32.436 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-05T08:43:32.437 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-05T08:43:32.437 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:32.437 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-05T08:43:32.437 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-05T08:43:32.437 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:32.437 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-05T08:43:32.438 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-05T08:43:32.438 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-05T08:43:32.438 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-05T08:43:32.438 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-05T08:43:32.438 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-05T08:43:32.439 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:32.439 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:32.439 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:32.439 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-05T08:43:32.439 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-05T08:43:32.440 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-05T08:43:32.440 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-05T08:43:32.440 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-05T08:43:32.440 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-05T08:43:32.440 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-05T08:43:32.441 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-05T08:43:32.441 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-05T08:43:32.441 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-05T08:43:32.441 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-05T08:43:32.441 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-05T08:43:32.441 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-05T08:43:32.442 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-05T08:43:32.442 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-05T08:43:32.442 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-05T08:43:32.442 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-05T08:43:32.442 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-05T08:43:32.443 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-05T08:43:32.443 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-05T08:43:32.443 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-05T08:43:32.443 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:32.443 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-05T08:43:32.443 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:32.444 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-05T08:43:32.444 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-05T08:43:32.444 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-05T08:43:32.444 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-05T08:43:32.444 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-05T08:43:32.445 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root mem REG 8,1 83456 265542 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-05T08:43:32.445 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root mem REG 8,1 370416 265532 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-05T08:43:32.445 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root mem REG 8,1 1481856 265536 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-05T08:43:32.445 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root mem REG 8,1 45648 265517 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-05T08:43:32.445 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root mem REG 8,1 41304 265576 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-05T08:43:32.445 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root mem REG 8,1 49912 265561 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-05T08:43:32.446 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root mem REG 8,1 418096 265585 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-05T08:43:32.446 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root mem REG 8,1 83208 265579 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-05T08:43:32.446 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-05T08:43:32.446 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root mem REG 8,1 79224 265555 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-05T08:43:32.446 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root mem REG 8,1 49744 265609 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-05T08:43:32.447 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root mem REG 8,1 49856 265552 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-05T08:43:32.447 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root mem REG 8,1 83632 265549 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-05T08:43:32.447 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root mem REG 8,1 78744 265606 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-05T08:43:32.447 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root mem REG 8,1 53880 265603 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-05T08:43:32.447 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root mem REG 8,1 872944 265588 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-05T08:43:32.447 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root mem REG 8,1 116592 265558 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-05T08:43:32.448 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-05T08:43:32.448 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root mem REG 8,1 1242808 265591 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-05T08:43:32.448 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root mem REG 8,1 62224 265570 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-05T08:43:32.448 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root mem REG 8,1 95808 265564 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-05T08:43:32.448 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root mem REG 8,1 37272 265600 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-05T08:43:32.449 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root mem REG 8,1 104024 265582 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-05T08:43:32.449 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root mem REG 8,1 133480 265546 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-05T08:43:32.449 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root mem REG 8,1 834760 265573 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-05T08:43:32.449 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-05T08:43:32.449 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root mem REG 8,1 129280 265594 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-05T08:43:32.449 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root mem REG 8,1 83224 265567 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-05T08:43:32.450 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root mem REG 8,1 48 3081 /tmp/vgdb-pipe-shared-mem-vgdb-86246-by-root-on-??? 2023-11-05T08:43:32.450 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root DEL REG 0,17 182056 /[aio] 2023-11-05T08:43:32.450 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root DEL REG 0,17 182868 /[aio] 2023-11-05T08:43:32.450 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root 0r CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:32.450 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root 1w FIFO 0,13 0t0 182740 pipe 2023-11-05T08:43:32.451 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root 2w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:32.451 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root 3w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:32.451 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root 4r FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:32.451 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root 5w FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:32.451 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root 6u a_inode 0,14 0 1084 [eventpoll:7,20,21,22,23,24,25,26,27,66] 2023-11-05T08:43:32.453 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root 7r FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:32.453 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root 8w FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:32.453 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root 9u a_inode 0,14 0 1084 [eventpoll:10,67] 2023-11-05T08:43:32.453 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root 10r FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:32.454 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root 11w FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:32.454 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root 12u a_inode 0,14 0 1084 [eventpoll:13] 2023-11-05T08:43:32.454 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root 13r FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:32.454 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root 14w FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:32.454 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root 15w REG 8,1 465910012 276998 /var/log/ceph/ceph-osd.7.log 2023-11-05T08:43:32.454 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root 16uW REG 0,24 6 1974 /run/ceph/ceph-osd.7.pid 2023-11-05T08:43:32.455 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root 17r FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:32.455 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root 18w FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:32.455 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root 19u unix 0xffff8da307b0b300 0t0 187412 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-05T08:43:32.455 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root 20u IPv4 185761 0t0 TCP *:6802 (LISTEN) 2023-11-05T08:43:32.455 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root 21u IPv4 185765 0t0 TCP *:6803 (LISTEN) 2023-11-05T08:43:32.456 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root 22u IPv4 185770 0t0 TCP *:6804 (LISTEN) 2023-11-05T08:43:32.456 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root 23u IPv4 185776 0t0 TCP *:6805 (LISTEN) 2023-11-05T08:43:32.456 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root 24u IPv4 185783 0t0 TCP *:6806 (LISTEN) 2023-11-05T08:43:32.456 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root 25u IPv4 185791 0t0 TCP *:6807 (LISTEN) 2023-11-05T08:43:32.456 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root 26u IPv4 185800 0t0 TCP *:6808 (LISTEN) 2023-11-05T08:43:32.456 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root 27u IPv4 185810 0t0 TCP *:6809 (LISTEN) 2023-11-05T08:43:32.457 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root 28r FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:32.457 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root 29w FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:32.457 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root 30r FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:32.457 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root 31w FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:32.457 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root 32u sock 0,8 0t0 182041 protocol: UDPv6 2023-11-05T08:43:32.458 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-05T08:43:32.458 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-05T08:43:32.458 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.458 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.458 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.458 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.459 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.459 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.459 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.459 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.459 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.460 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.460 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.460 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.460 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.460 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.460 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.461 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.461 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.461 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.461 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.461 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.462 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.462 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.462 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.462 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.462 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root 60r FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:32.462 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root 61w FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:32.463 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root 62r FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:32.463 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root 63w FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:32.463 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root 66u IPv4 199302 0t0 TCP smithi156.front.sepia.ceph.com:56964->smithi156.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-05T08:43:32.463 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root 67u IPv4 199303 0t0 TCP smithi156.front.sepia.ceph.com:6802->smithi156.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-05T08:43:32.463 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:32.464 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root *525u REG 8,1 32 3087 /tmp/valgrind_proc_86246_cmdline_85358a06 (deleted) 2023-11-05T08:43:32.464 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root *526u REG 8,1 336 3088 /tmp/valgrind_proc_86246_auxv_85358a06 (deleted) 2023-11-05T08:43:32.464 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root *527w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:32.464 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root *528w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:32.464 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root *529r FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:32.465 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root *530w FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:32.465 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 88650 bstore_di root *531r FIFO 8,1 0t0 3091 /tmp/vgdb-pipe-from-vgdb-to-86246-by-root-on-??? 2023-11-05T08:43:32.465 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root cwd DIR 8,1 4096 265785 /home/ubuntu/cephtest 2023-11-05T08:43:32.465 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:32.465 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-05T08:43:32.465 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:32.466 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:32.466 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-05T08:43:32.466 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-05T08:43:32.466 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root mem REG 8,1 15752 265597 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-05T08:43:32.466 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-05T08:43:32.467 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-05T08:43:32.467 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-05T08:43:32.467 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-05T08:43:32.467 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-05T08:43:32.467 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-05T08:43:32.468 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:32.468 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-05T08:43:32.468 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-05T08:43:32.468 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:32.468 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-05T08:43:32.468 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-05T08:43:32.469 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-05T08:43:32.469 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-05T08:43:32.469 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-05T08:43:32.469 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-05T08:43:32.469 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:32.470 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:32.470 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:32.470 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-05T08:43:32.470 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-05T08:43:32.470 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-05T08:43:32.471 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-05T08:43:32.471 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-05T08:43:32.471 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-05T08:43:32.471 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-05T08:43:32.471 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-05T08:43:32.471 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-05T08:43:32.472 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-05T08:43:32.472 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-05T08:43:32.472 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-05T08:43:32.472 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-05T08:43:32.472 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-05T08:43:32.473 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-05T08:43:32.473 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-05T08:43:32.473 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-05T08:43:32.473 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-05T08:43:32.473 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-05T08:43:32.474 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-05T08:43:32.474 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-05T08:43:32.474 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:32.474 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-05T08:43:32.474 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:32.474 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-05T08:43:32.475 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-05T08:43:32.475 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-05T08:43:32.475 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-05T08:43:32.475 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-05T08:43:32.475 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root mem REG 8,1 83456 265542 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-05T08:43:32.476 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root mem REG 8,1 370416 265532 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-05T08:43:32.476 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root mem REG 8,1 1481856 265536 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-05T08:43:32.476 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root mem REG 8,1 45648 265517 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-05T08:43:32.476 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root mem REG 8,1 41304 265576 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-05T08:43:32.476 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root mem REG 8,1 49912 265561 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-05T08:43:32.477 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root mem REG 8,1 418096 265585 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-05T08:43:32.477 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root mem REG 8,1 83208 265579 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-05T08:43:32.477 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-05T08:43:32.477 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root mem REG 8,1 79224 265555 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-05T08:43:32.477 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root mem REG 8,1 49744 265609 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-05T08:43:32.477 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root mem REG 8,1 49856 265552 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-05T08:43:32.478 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root mem REG 8,1 83632 265549 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-05T08:43:32.478 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root mem REG 8,1 78744 265606 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-05T08:43:32.478 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root mem REG 8,1 53880 265603 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-05T08:43:32.478 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root mem REG 8,1 872944 265588 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-05T08:43:32.478 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root mem REG 8,1 116592 265558 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-05T08:43:32.479 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-05T08:43:32.479 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root mem REG 8,1 1242808 265591 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-05T08:43:32.479 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root mem REG 8,1 62224 265570 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-05T08:43:32.479 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root mem REG 8,1 95808 265564 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-05T08:43:32.479 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root mem REG 8,1 37272 265600 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-05T08:43:32.480 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root mem REG 8,1 104024 265582 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-05T08:43:32.480 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root mem REG 8,1 133480 265546 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-05T08:43:32.480 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root mem REG 8,1 834760 265573 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-05T08:43:32.480 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-05T08:43:32.480 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root mem REG 8,1 129280 265594 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-05T08:43:32.480 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root mem REG 8,1 83224 265567 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-05T08:43:32.481 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root mem REG 8,1 48 3081 /tmp/vgdb-pipe-shared-mem-vgdb-86246-by-root-on-??? 2023-11-05T08:43:32.481 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root DEL REG 0,17 182056 /[aio] 2023-11-05T08:43:32.481 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root DEL REG 0,17 182868 /[aio] 2023-11-05T08:43:32.481 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root 0r CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:32.481 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root 1w FIFO 0,13 0t0 182740 pipe 2023-11-05T08:43:32.481 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root 2w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:32.482 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root 3w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:32.482 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root 4r FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:32.482 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root 5w FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:32.482 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root 6u a_inode 0,14 0 1084 [eventpoll:7,20,21,22,23,24,25,26,27,66] 2023-11-05T08:43:32.482 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root 7r FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:32.483 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root 8w FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:32.483 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root 9u a_inode 0,14 0 1084 [eventpoll:10,67] 2023-11-05T08:43:32.483 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root 10r FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:32.483 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root 11w FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:32.483 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root 12u a_inode 0,14 0 1084 [eventpoll:13] 2023-11-05T08:43:32.483 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root 13r FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:32.484 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root 14w FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:32.484 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root 15w REG 8,1 465910012 276998 /var/log/ceph/ceph-osd.7.log 2023-11-05T08:43:32.484 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root 16uW REG 0,24 6 1974 /run/ceph/ceph-osd.7.pid 2023-11-05T08:43:32.484 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root 17r FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:32.484 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root 18w FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:32.485 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root 19u unix 0xffff8da307b0b300 0t0 187412 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-05T08:43:32.485 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root 20u IPv4 185761 0t0 TCP *:6802 (LISTEN) 2023-11-05T08:43:32.485 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root 21u IPv4 185765 0t0 TCP *:6803 (LISTEN) 2023-11-05T08:43:32.485 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root 22u IPv4 185770 0t0 TCP *:6804 (LISTEN) 2023-11-05T08:43:32.485 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root 23u IPv4 185776 0t0 TCP *:6805 (LISTEN) 2023-11-05T08:43:32.485 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root 24u IPv4 185783 0t0 TCP *:6806 (LISTEN) 2023-11-05T08:43:32.486 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root 25u IPv4 185791 0t0 TCP *:6807 (LISTEN) 2023-11-05T08:43:32.486 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root 26u IPv4 185800 0t0 TCP *:6808 (LISTEN) 2023-11-05T08:43:32.486 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root 27u IPv4 185810 0t0 TCP *:6809 (LISTEN) 2023-11-05T08:43:32.486 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root 28r FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:32.486 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root 29w FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:32.487 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root 30r FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:32.487 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root 31w FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:32.487 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root 32u sock 0,8 0t0 182041 protocol: UDPv6 2023-11-05T08:43:32.487 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-05T08:43:32.488 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-05T08:43:32.488 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.488 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.488 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.488 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.488 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.489 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.489 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.489 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.489 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.489 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.490 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.490 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.490 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.490 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.490 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.490 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.491 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.491 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.491 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.491 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.491 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.492 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.492 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.492 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.492 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root 60r FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:32.492 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root 61w FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:32.492 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root 62r FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:32.493 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root 63w FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:32.493 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root 66u IPv4 199302 0t0 TCP smithi156.front.sepia.ceph.com:56964->smithi156.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-05T08:43:32.493 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root 67u IPv4 199303 0t0 TCP smithi156.front.sepia.ceph.com:6802->smithi156.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-05T08:43:32.493 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:32.493 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root *525u REG 8,1 32 3087 /tmp/valgrind_proc_86246_cmdline_85358a06 (deleted) 2023-11-05T08:43:32.494 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root *526u REG 8,1 336 3088 /tmp/valgrind_proc_86246_auxv_85358a06 (deleted) 2023-11-05T08:43:32.494 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root *527w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:32.494 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root *528w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:32.494 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root *529r FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:32.494 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root *530w FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:32.494 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89376 memcheck- root *531r FIFO 8,1 0t0 3091 /tmp/vgdb-pipe-from-vgdb-to-86246-by-root-on-??? 2023-11-05T08:43:32.495 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root cwd DIR 8,1 4096 265785 /home/ubuntu/cephtest 2023-11-05T08:43:32.495 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:32.495 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-05T08:43:32.495 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:32.495 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:32.496 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-05T08:43:32.496 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-05T08:43:32.496 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root mem REG 8,1 15752 265597 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-05T08:43:32.496 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-05T08:43:32.496 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-05T08:43:32.497 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-05T08:43:32.497 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-05T08:43:32.497 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-05T08:43:32.497 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-05T08:43:32.497 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:32.497 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-05T08:43:32.498 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-05T08:43:32.498 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:32.498 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-05T08:43:32.498 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-05T08:43:32.498 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-05T08:43:32.499 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-05T08:43:32.499 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-05T08:43:32.499 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-05T08:43:32.499 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:32.499 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:32.500 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:32.500 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-05T08:43:32.500 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-05T08:43:32.500 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-05T08:43:32.500 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-05T08:43:32.501 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-05T08:43:32.501 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-05T08:43:32.501 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-05T08:43:32.501 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-05T08:43:32.501 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-05T08:43:32.501 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-05T08:43:32.502 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-05T08:43:32.502 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-05T08:43:32.502 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-05T08:43:32.502 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-05T08:43:32.502 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-05T08:43:32.503 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-05T08:43:32.503 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-05T08:43:32.503 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-05T08:43:32.503 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-05T08:43:32.503 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-05T08:43:32.504 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-05T08:43:32.504 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:32.504 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-05T08:43:32.504 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:32.504 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-05T08:43:32.504 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-05T08:43:32.505 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-05T08:43:32.505 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-05T08:43:32.505 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-05T08:43:32.505 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root mem REG 8,1 83456 265542 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-05T08:43:32.505 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root mem REG 8,1 370416 265532 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-05T08:43:32.506 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root mem REG 8,1 1481856 265536 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-05T08:43:32.506 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root mem REG 8,1 45648 265517 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-05T08:43:32.506 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root mem REG 8,1 41304 265576 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-05T08:43:32.506 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root mem REG 8,1 49912 265561 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-05T08:43:32.506 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root mem REG 8,1 418096 265585 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-05T08:43:32.507 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root mem REG 8,1 83208 265579 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-05T08:43:32.507 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-05T08:43:32.507 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root mem REG 8,1 79224 265555 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-05T08:43:32.507 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root mem REG 8,1 49744 265609 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-05T08:43:32.507 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root mem REG 8,1 49856 265552 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-05T08:43:32.507 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root mem REG 8,1 83632 265549 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-05T08:43:32.508 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root mem REG 8,1 78744 265606 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-05T08:43:32.508 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root mem REG 8,1 53880 265603 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-05T08:43:32.508 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root mem REG 8,1 872944 265588 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-05T08:43:32.508 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root mem REG 8,1 116592 265558 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-05T08:43:32.508 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-05T08:43:32.508 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root mem REG 8,1 1242808 265591 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-05T08:43:32.509 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root mem REG 8,1 62224 265570 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-05T08:43:32.509 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root mem REG 8,1 95808 265564 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-05T08:43:32.509 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root mem REG 8,1 37272 265600 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-05T08:43:32.509 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root mem REG 8,1 104024 265582 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-05T08:43:32.509 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root mem REG 8,1 133480 265546 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-05T08:43:32.510 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root mem REG 8,1 834760 265573 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-05T08:43:32.510 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-05T08:43:32.510 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root mem REG 8,1 129280 265594 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-05T08:43:32.510 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root mem REG 8,1 83224 265567 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-05T08:43:32.510 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root mem REG 8,1 48 3081 /tmp/vgdb-pipe-shared-mem-vgdb-86246-by-root-on-??? 2023-11-05T08:43:32.511 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root DEL REG 0,17 182056 /[aio] 2023-11-05T08:43:32.511 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root DEL REG 0,17 182868 /[aio] 2023-11-05T08:43:32.511 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root 0r CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:32.511 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root 1w FIFO 0,13 0t0 182740 pipe 2023-11-05T08:43:32.511 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root 2w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:32.512 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root 3w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:32.512 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root 4r FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:32.512 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root 5w FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:32.512 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root 6u a_inode 0,14 0 1084 [eventpoll:7,20,21,22,23,24,25,26,27,66] 2023-11-05T08:43:32.512 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root 7r FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:32.512 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root 8w FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:32.513 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root 9u a_inode 0,14 0 1084 [eventpoll:10,67] 2023-11-05T08:43:32.513 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root 10r FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:32.513 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root 11w FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:32.513 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root 12u a_inode 0,14 0 1084 [eventpoll:13] 2023-11-05T08:43:32.513 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root 13r FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:32.514 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root 14w FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:32.514 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root 15w REG 8,1 465910012 276998 /var/log/ceph/ceph-osd.7.log 2023-11-05T08:43:32.514 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root 16uW REG 0,24 6 1974 /run/ceph/ceph-osd.7.pid 2023-11-05T08:43:32.514 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root 17r FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:32.514 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root 18w FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:32.514 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root 19u unix 0xffff8da307b0b300 0t0 187412 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-05T08:43:32.515 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root 20u IPv4 185761 0t0 TCP *:6802 (LISTEN) 2023-11-05T08:43:32.515 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root 21u IPv4 185765 0t0 TCP *:6803 (LISTEN) 2023-11-05T08:43:32.515 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root 22u IPv4 185770 0t0 TCP *:6804 (LISTEN) 2023-11-05T08:43:32.515 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root 23u IPv4 185776 0t0 TCP *:6805 (LISTEN) 2023-11-05T08:43:32.515 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root 24u IPv4 185783 0t0 TCP *:6806 (LISTEN) 2023-11-05T08:43:32.516 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root 25u IPv4 185791 0t0 TCP *:6807 (LISTEN) 2023-11-05T08:43:32.516 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root 26u IPv4 185800 0t0 TCP *:6808 (LISTEN) 2023-11-05T08:43:32.516 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root 27u IPv4 185810 0t0 TCP *:6809 (LISTEN) 2023-11-05T08:43:32.516 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root 28r FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:32.516 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root 29w FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:32.516 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root 30r FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:32.517 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root 31w FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:32.517 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root 32u sock 0,8 0t0 182041 protocol: UDPv6 2023-11-05T08:43:32.517 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-05T08:43:32.517 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-05T08:43:32.517 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.518 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.518 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.518 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.518 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.518 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.519 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.519 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.519 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.519 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.519 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.519 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.520 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.520 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.520 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.520 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.520 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.520 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.521 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.521 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.521 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.521 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.522 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.522 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.522 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root 60r FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:32.522 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root 61w FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:32.522 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root 62r FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:32.522 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root 63w FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:32.523 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root 66u IPv4 199302 0t0 TCP smithi156.front.sepia.ceph.com:56964->smithi156.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-05T08:43:32.523 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root 67u IPv4 199303 0t0 TCP smithi156.front.sepia.ceph.com:6802->smithi156.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-05T08:43:32.523 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:32.523 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root *525u REG 8,1 32 3087 /tmp/valgrind_proc_86246_cmdline_85358a06 (deleted) 2023-11-05T08:43:32.523 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root *526u REG 8,1 336 3088 /tmp/valgrind_proc_86246_auxv_85358a06 (deleted) 2023-11-05T08:43:32.524 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root *527w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:32.524 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root *528w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:32.524 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root *529r FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:32.524 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root *530w FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:32.524 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89378 cfin root *531r FIFO 8,1 0t0 3091 /tmp/vgdb-pipe-from-vgdb-to-86246-by-root-on-??? 2023-11-05T08:43:32.524 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root cwd DIR 8,1 4096 265785 /home/ubuntu/cephtest 2023-11-05T08:43:32.525 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:32.525 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-05T08:43:32.525 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:32.525 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:32.525 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-05T08:43:32.526 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-05T08:43:32.526 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root mem REG 8,1 15752 265597 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-05T08:43:32.526 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-05T08:43:32.526 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-05T08:43:32.526 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-05T08:43:32.527 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-05T08:43:32.527 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-05T08:43:32.527 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-05T08:43:32.527 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:32.527 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-05T08:43:32.528 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-05T08:43:32.528 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:32.528 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-05T08:43:32.528 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-05T08:43:32.528 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-05T08:43:32.528 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-05T08:43:32.529 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-05T08:43:32.529 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-05T08:43:32.529 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:32.529 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:32.529 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:32.530 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-05T08:43:32.530 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-05T08:43:32.530 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-05T08:43:32.530 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-05T08:43:32.530 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-05T08:43:32.530 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-05T08:43:32.531 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-05T08:43:32.531 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-05T08:43:32.531 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-05T08:43:32.531 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-05T08:43:32.531 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-05T08:43:32.532 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-05T08:43:32.532 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-05T08:43:32.532 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-05T08:43:32.532 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-05T08:43:32.532 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-05T08:43:32.532 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-05T08:43:32.533 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-05T08:43:32.533 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-05T08:43:32.533 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-05T08:43:32.533 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-05T08:43:32.533 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:32.534 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-05T08:43:32.534 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:32.534 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-05T08:43:32.534 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-05T08:43:32.534 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-05T08:43:32.535 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-05T08:43:32.535 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-05T08:43:32.535 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root mem REG 8,1 83456 265542 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-05T08:43:32.535 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root mem REG 8,1 370416 265532 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-05T08:43:32.535 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root mem REG 8,1 1481856 265536 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-05T08:43:32.535 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root mem REG 8,1 45648 265517 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-05T08:43:32.536 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root mem REG 8,1 41304 265576 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-05T08:43:32.536 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root mem REG 8,1 49912 265561 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-05T08:43:32.536 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root mem REG 8,1 418096 265585 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-05T08:43:32.536 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root mem REG 8,1 83208 265579 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-05T08:43:32.536 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-05T08:43:32.537 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root mem REG 8,1 79224 265555 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-05T08:43:32.537 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root mem REG 8,1 49744 265609 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-05T08:43:32.537 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root mem REG 8,1 49856 265552 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-05T08:43:32.537 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root mem REG 8,1 83632 265549 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-05T08:43:32.537 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root mem REG 8,1 78744 265606 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-05T08:43:32.538 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root mem REG 8,1 53880 265603 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-05T08:43:32.538 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root mem REG 8,1 872944 265588 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-05T08:43:32.538 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root mem REG 8,1 116592 265558 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-05T08:43:32.538 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-05T08:43:32.538 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root mem REG 8,1 1242808 265591 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-05T08:43:32.539 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root mem REG 8,1 62224 265570 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-05T08:43:32.539 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root mem REG 8,1 95808 265564 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-05T08:43:32.539 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root mem REG 8,1 37272 265600 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-05T08:43:32.539 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root mem REG 8,1 104024 265582 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-05T08:43:32.539 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root mem REG 8,1 133480 265546 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-05T08:43:32.539 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root mem REG 8,1 834760 265573 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-05T08:43:32.540 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-05T08:43:32.540 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root mem REG 8,1 129280 265594 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-05T08:43:32.540 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root mem REG 8,1 83224 265567 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-05T08:43:32.540 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root mem REG 8,1 48 3081 /tmp/vgdb-pipe-shared-mem-vgdb-86246-by-root-on-??? 2023-11-05T08:43:32.540 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root DEL REG 0,17 182056 /[aio] 2023-11-05T08:43:32.541 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root DEL REG 0,17 182868 /[aio] 2023-11-05T08:43:32.541 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root 0r CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:32.541 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root 1w FIFO 0,13 0t0 182740 pipe 2023-11-05T08:43:32.541 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root 2w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:32.541 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root 3w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:32.541 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root 4r FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:32.542 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root 5w FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:32.542 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root 6u a_inode 0,14 0 1084 [eventpoll:7,20,21,22,23,24,25,26,27,66] 2023-11-05T08:43:32.542 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root 7r FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:32.542 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root 8w FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:32.542 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root 9u a_inode 0,14 0 1084 [eventpoll:10,67] 2023-11-05T08:43:32.543 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root 10r FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:32.543 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root 11w FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:32.543 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root 12u a_inode 0,14 0 1084 [eventpoll:13] 2023-11-05T08:43:32.543 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root 13r FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:32.543 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root 14w FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:32.544 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root 15w REG 8,1 465910012 276998 /var/log/ceph/ceph-osd.7.log 2023-11-05T08:43:32.544 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root 16uW REG 0,24 6 1974 /run/ceph/ceph-osd.7.pid 2023-11-05T08:43:32.544 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root 17r FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:32.544 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root 18w FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:32.544 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root 19u unix 0xffff8da307b0b300 0t0 187412 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-05T08:43:32.545 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root 20u IPv4 185761 0t0 TCP *:6802 (LISTEN) 2023-11-05T08:43:32.545 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root 21u IPv4 185765 0t0 TCP *:6803 (LISTEN) 2023-11-05T08:43:32.545 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root 22u IPv4 185770 0t0 TCP *:6804 (LISTEN) 2023-11-05T08:43:32.545 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root 23u IPv4 185776 0t0 TCP *:6805 (LISTEN) 2023-11-05T08:43:32.545 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root 24u IPv4 185783 0t0 TCP *:6806 (LISTEN) 2023-11-05T08:43:32.546 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root 25u IPv4 185791 0t0 TCP *:6807 (LISTEN) 2023-11-05T08:43:32.546 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root 26u IPv4 185800 0t0 TCP *:6808 (LISTEN) 2023-11-05T08:43:32.546 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root 27u IPv4 185810 0t0 TCP *:6809 (LISTEN) 2023-11-05T08:43:32.546 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root 28r FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:32.546 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root 29w FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:32.546 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root 30r FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:32.547 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root 31w FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:32.547 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root 32u sock 0,8 0t0 182041 protocol: UDPv6 2023-11-05T08:43:32.547 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-05T08:43:32.547 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-05T08:43:32.547 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.548 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.548 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.548 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.548 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.548 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.548 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.549 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.549 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.549 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.549 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.549 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.550 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.550 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.550 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.550 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.550 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.550 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.551 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.551 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.551 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.551 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.551 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.552 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.552 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root 60r FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:32.552 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root 61w FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:32.552 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root 62r FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:32.552 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root 63w FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:32.552 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root 66u IPv4 199302 0t0 TCP smithi156.front.sepia.ceph.com:56964->smithi156.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-05T08:43:32.553 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root 67u IPv4 199303 0t0 TCP smithi156.front.sepia.ceph.com:6802->smithi156.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-05T08:43:32.553 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:32.553 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root *525u REG 8,1 32 3087 /tmp/valgrind_proc_86246_cmdline_85358a06 (deleted) 2023-11-05T08:43:32.553 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root *526u REG 8,1 336 3088 /tmp/valgrind_proc_86246_auxv_85358a06 (deleted) 2023-11-05T08:43:32.553 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root *527w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:32.554 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root *528w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:32.554 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root *529r FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:32.554 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root *530w FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:32.554 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89379 bstore_kv root *531r FIFO 8,1 0t0 3091 /tmp/vgdb-pipe-from-vgdb-to-86246-by-root-on-??? 2023-11-05T08:43:32.554 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root cwd DIR 8,1 4096 265785 /home/ubuntu/cephtest 2023-11-05T08:43:32.554 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:32.555 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-05T08:43:32.555 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:32.555 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:32.555 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-05T08:43:32.555 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-05T08:43:32.556 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root mem REG 8,1 15752 265597 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-05T08:43:32.556 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-05T08:43:32.556 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-05T08:43:32.556 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-05T08:43:32.556 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-05T08:43:32.557 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-05T08:43:32.557 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-05T08:43:32.557 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:32.557 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-05T08:43:32.557 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-05T08:43:32.558 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:32.558 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-05T08:43:32.558 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-05T08:43:32.558 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-05T08:43:32.558 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-05T08:43:32.558 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-05T08:43:32.559 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-05T08:43:32.559 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:32.559 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:32.559 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:32.559 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-05T08:43:32.560 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-05T08:43:32.560 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-05T08:43:32.560 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-05T08:43:32.560 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-05T08:43:32.560 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-05T08:43:32.560 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-05T08:43:32.561 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-05T08:43:32.561 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-05T08:43:32.561 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-05T08:43:32.561 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-05T08:43:32.561 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-05T08:43:32.562 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-05T08:43:32.562 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-05T08:43:32.562 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-05T08:43:32.562 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-05T08:43:32.562 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-05T08:43:32.562 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-05T08:43:32.563 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-05T08:43:32.563 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-05T08:43:32.563 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-05T08:43:32.563 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:32.563 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-05T08:43:32.564 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:32.564 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-05T08:43:32.564 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-05T08:43:32.564 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-05T08:43:32.564 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-05T08:43:32.565 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-05T08:43:32.565 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root mem REG 8,1 83456 265542 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-05T08:43:32.565 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root mem REG 8,1 370416 265532 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-05T08:43:32.565 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root mem REG 8,1 1481856 265536 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-05T08:43:32.565 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root mem REG 8,1 45648 265517 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-05T08:43:32.565 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root mem REG 8,1 41304 265576 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-05T08:43:32.566 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root mem REG 8,1 49912 265561 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-05T08:43:32.566 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root mem REG 8,1 418096 265585 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-05T08:43:32.566 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root mem REG 8,1 83208 265579 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-05T08:43:32.566 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-05T08:43:32.566 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root mem REG 8,1 79224 265555 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-05T08:43:32.567 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root mem REG 8,1 49744 265609 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-05T08:43:32.567 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root mem REG 8,1 49856 265552 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-05T08:43:32.567 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root mem REG 8,1 83632 265549 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-05T08:43:32.567 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root mem REG 8,1 78744 265606 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-05T08:43:32.567 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root mem REG 8,1 53880 265603 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-05T08:43:32.568 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root mem REG 8,1 872944 265588 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-05T08:43:32.568 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root mem REG 8,1 116592 265558 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-05T08:43:32.568 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-05T08:43:32.568 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root mem REG 8,1 1242808 265591 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-05T08:43:32.568 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root mem REG 8,1 62224 265570 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-05T08:43:32.568 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root mem REG 8,1 95808 265564 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-05T08:43:32.569 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root mem REG 8,1 37272 265600 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-05T08:43:32.569 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root mem REG 8,1 104024 265582 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-05T08:43:32.569 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root mem REG 8,1 133480 265546 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-05T08:43:32.569 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root mem REG 8,1 834760 265573 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-05T08:43:32.569 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-05T08:43:32.570 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root mem REG 8,1 129280 265594 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-05T08:43:32.570 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root mem REG 8,1 83224 265567 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-05T08:43:32.570 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root mem REG 8,1 48 3081 /tmp/vgdb-pipe-shared-mem-vgdb-86246-by-root-on-??? 2023-11-05T08:43:32.570 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root DEL REG 0,17 182056 /[aio] 2023-11-05T08:43:32.570 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root DEL REG 0,17 182868 /[aio] 2023-11-05T08:43:32.571 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root 0r CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:32.571 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root 1w FIFO 0,13 0t0 182740 pipe 2023-11-05T08:43:32.571 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root 2w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:32.571 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root 3w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:32.571 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root 4r FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:32.571 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root 5w FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:32.572 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root 6u a_inode 0,14 0 1084 [eventpoll:7,20,21,22,23,24,25,26,27,66] 2023-11-05T08:43:32.572 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root 7r FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:32.572 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root 8w FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:32.572 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root 9u a_inode 0,14 0 1084 [eventpoll:10,67] 2023-11-05T08:43:32.572 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root 10r FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:32.573 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root 11w FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:32.573 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root 12u a_inode 0,14 0 1084 [eventpoll:13] 2023-11-05T08:43:32.573 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root 13r FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:32.573 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root 14w FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:32.573 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root 15w REG 8,1 465910012 276998 /var/log/ceph/ceph-osd.7.log 2023-11-05T08:43:32.573 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root 16uW REG 0,24 6 1974 /run/ceph/ceph-osd.7.pid 2023-11-05T08:43:32.574 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root 17r FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:32.574 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root 18w FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:32.574 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root 19u unix 0xffff8da307b0b300 0t0 187412 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-05T08:43:32.574 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root 20u IPv4 185761 0t0 TCP *:6802 (LISTEN) 2023-11-05T08:43:32.574 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root 21u IPv4 185765 0t0 TCP *:6803 (LISTEN) 2023-11-05T08:43:32.575 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root 22u IPv4 185770 0t0 TCP *:6804 (LISTEN) 2023-11-05T08:43:32.575 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root 23u IPv4 185776 0t0 TCP *:6805 (LISTEN) 2023-11-05T08:43:32.575 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root 24u IPv4 185783 0t0 TCP *:6806 (LISTEN) 2023-11-05T08:43:32.575 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root 25u IPv4 185791 0t0 TCP *:6807 (LISTEN) 2023-11-05T08:43:32.575 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root 26u IPv4 185800 0t0 TCP *:6808 (LISTEN) 2023-11-05T08:43:32.575 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root 27u IPv4 185810 0t0 TCP *:6809 (LISTEN) 2023-11-05T08:43:32.576 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root 28r FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:32.576 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root 29w FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:32.576 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root 30r FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:32.576 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root 31w FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:32.576 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root 32u sock 0,8 0t0 182041 protocol: UDPv6 2023-11-05T08:43:32.577 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-05T08:43:32.577 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-05T08:43:32.577 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.577 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.577 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.578 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.578 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.578 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.578 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.578 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.578 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.579 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.579 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.579 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.579 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.579 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.580 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.580 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.580 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.580 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.580 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.581 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.581 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.581 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.581 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.581 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.581 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root 60r FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:32.582 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root 61w FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:32.582 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root 62r FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:32.582 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root 63w FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:32.582 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root 66u IPv4 199302 0t0 TCP smithi156.front.sepia.ceph.com:56964->smithi156.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-05T08:43:32.582 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root 67u IPv4 199303 0t0 TCP smithi156.front.sepia.ceph.com:6802->smithi156.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-05T08:43:32.583 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:32.583 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root *525u REG 8,1 32 3087 /tmp/valgrind_proc_86246_cmdline_85358a06 (deleted) 2023-11-05T08:43:32.583 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root *526u REG 8,1 336 3088 /tmp/valgrind_proc_86246_auxv_85358a06 (deleted) 2023-11-05T08:43:32.583 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root *527w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:32.583 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root *528w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:32.584 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root *529r FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:32.584 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root *530w FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:32.584 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89380 bstore_kv root *531r FIFO 8,1 0t0 3091 /tmp/vgdb-pipe-from-vgdb-to-86246-by-root-on-??? 2023-11-05T08:43:32.584 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root cwd DIR 8,1 4096 265785 /home/ubuntu/cephtest 2023-11-05T08:43:32.584 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:32.584 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-05T08:43:32.585 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:32.585 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:32.585 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-05T08:43:32.585 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-05T08:43:32.585 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root mem REG 8,1 15752 265597 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-05T08:43:32.586 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-05T08:43:32.586 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-05T08:43:32.586 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-05T08:43:32.586 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-05T08:43:32.586 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-05T08:43:32.586 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-05T08:43:32.587 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:32.587 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-05T08:43:32.587 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-05T08:43:32.587 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:32.587 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-05T08:43:32.588 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-05T08:43:32.588 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-05T08:43:32.588 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-05T08:43:32.588 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-05T08:43:32.588 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-05T08:43:32.588 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:32.589 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:32.589 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:32.589 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-05T08:43:32.589 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-05T08:43:32.589 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-05T08:43:32.589 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-05T08:43:32.590 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-05T08:43:32.590 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-05T08:43:32.590 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-05T08:43:32.590 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-05T08:43:32.590 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-05T08:43:32.591 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-05T08:43:32.591 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-05T08:43:32.591 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-05T08:43:32.591 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-05T08:43:32.591 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-05T08:43:32.592 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-05T08:43:32.592 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-05T08:43:32.592 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-05T08:43:32.592 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-05T08:43:32.592 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-05T08:43:32.593 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-05T08:43:32.593 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-05T08:43:32.593 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:32.593 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-05T08:43:32.593 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:32.593 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-05T08:43:32.594 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-05T08:43:32.594 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-05T08:43:32.594 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-05T08:43:32.594 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-05T08:43:32.594 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root mem REG 8,1 83456 265542 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-05T08:43:32.595 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root mem REG 8,1 370416 265532 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-05T08:43:32.595 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root mem REG 8,1 1481856 265536 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-05T08:43:32.595 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root mem REG 8,1 45648 265517 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-05T08:43:32.595 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root mem REG 8,1 41304 265576 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-05T08:43:32.595 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root mem REG 8,1 49912 265561 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-05T08:43:32.596 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root mem REG 8,1 418096 265585 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-05T08:43:32.596 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root mem REG 8,1 83208 265579 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-05T08:43:32.596 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-05T08:43:32.596 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root mem REG 8,1 79224 265555 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-05T08:43:32.596 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root mem REG 8,1 49744 265609 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-05T08:43:32.596 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root mem REG 8,1 49856 265552 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-05T08:43:32.597 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root mem REG 8,1 83632 265549 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-05T08:43:32.597 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root mem REG 8,1 78744 265606 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-05T08:43:32.597 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root mem REG 8,1 53880 265603 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-05T08:43:32.597 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root mem REG 8,1 872944 265588 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-05T08:43:32.597 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root mem REG 8,1 116592 265558 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-05T08:43:32.598 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-05T08:43:32.598 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root mem REG 8,1 1242808 265591 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-05T08:43:32.598 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root mem REG 8,1 62224 265570 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-05T08:43:32.598 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root mem REG 8,1 95808 265564 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-05T08:43:32.598 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root mem REG 8,1 37272 265600 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-05T08:43:32.599 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root mem REG 8,1 104024 265582 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-05T08:43:32.599 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root mem REG 8,1 133480 265546 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-05T08:43:32.599 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root mem REG 8,1 834760 265573 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-05T08:43:32.599 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-05T08:43:32.599 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root mem REG 8,1 129280 265594 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-05T08:43:32.599 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root mem REG 8,1 83224 265567 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-05T08:43:32.600 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root mem REG 8,1 48 3081 /tmp/vgdb-pipe-shared-mem-vgdb-86246-by-root-on-??? 2023-11-05T08:43:32.600 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root DEL REG 0,17 182056 /[aio] 2023-11-05T08:43:32.600 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root DEL REG 0,17 182868 /[aio] 2023-11-05T08:43:32.600 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root 0r CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:32.600 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root 1w FIFO 0,13 0t0 182740 pipe 2023-11-05T08:43:32.601 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root 2w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:32.601 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root 3w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:32.601 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root 4r FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:32.601 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root 5w FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:32.601 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root 6u a_inode 0,14 0 1084 [eventpoll:7,20,21,22,23,24,25,26,27,66] 2023-11-05T08:43:32.602 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root 7r FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:32.602 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root 8w FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:32.602 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root 9u a_inode 0,14 0 1084 [eventpoll:10,67] 2023-11-05T08:43:32.602 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root 10r FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:32.602 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root 11w FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:32.602 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root 12u a_inode 0,14 0 1084 [eventpoll:13] 2023-11-05T08:43:32.603 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root 13r FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:32.603 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root 14w FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:32.603 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root 15w REG 8,1 465910012 276998 /var/log/ceph/ceph-osd.7.log 2023-11-05T08:43:32.603 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root 16uW REG 0,24 6 1974 /run/ceph/ceph-osd.7.pid 2023-11-05T08:43:32.603 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root 17r FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:32.604 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root 18w FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:32.604 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root 19u unix 0xffff8da307b0b300 0t0 187412 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-05T08:43:32.604 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root 20u IPv4 185761 0t0 TCP *:6802 (LISTEN) 2023-11-05T08:43:32.604 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root 21u IPv4 185765 0t0 TCP *:6803 (LISTEN) 2023-11-05T08:43:32.604 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root 22u IPv4 185770 0t0 TCP *:6804 (LISTEN) 2023-11-05T08:43:32.604 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root 23u IPv4 185776 0t0 TCP *:6805 (LISTEN) 2023-11-05T08:43:32.605 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root 24u IPv4 185783 0t0 TCP *:6806 (LISTEN) 2023-11-05T08:43:32.605 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root 25u IPv4 185791 0t0 TCP *:6807 (LISTEN) 2023-11-05T08:43:32.605 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root 26u IPv4 185800 0t0 TCP *:6808 (LISTEN) 2023-11-05T08:43:32.605 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root 27u IPv4 185810 0t0 TCP *:6809 (LISTEN) 2023-11-05T08:43:32.605 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root 28r FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:32.606 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root 29w FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:32.606 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root 30r FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:32.606 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root 31w FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:32.606 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root 32u sock 0,8 0t0 182041 protocol: UDPv6 2023-11-05T08:43:32.606 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-05T08:43:32.606 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-05T08:43:32.607 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.607 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.607 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.607 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.607 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.608 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.608 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.608 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.608 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.608 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.608 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.609 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.609 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.609 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.609 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.609 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.610 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.610 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.610 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.610 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.610 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.610 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.611 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.611 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.611 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root 60r FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:32.611 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root 61w FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:32.611 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root 62r FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:32.612 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root 63w FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:32.612 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root 66u IPv4 199302 0t0 TCP smithi156.front.sepia.ceph.com:56964->smithi156.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-05T08:43:32.612 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root 67u IPv4 199303 0t0 TCP smithi156.front.sepia.ceph.com:6802->smithi156.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-05T08:43:32.612 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:32.612 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root *525u REG 8,1 32 3087 /tmp/valgrind_proc_86246_cmdline_85358a06 (deleted) 2023-11-05T08:43:32.613 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root *526u REG 8,1 336 3088 /tmp/valgrind_proc_86246_auxv_85358a06 (deleted) 2023-11-05T08:43:32.613 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root *527w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:32.613 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root *528w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:32.613 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root *529r FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:32.613 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root *530w FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:32.614 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89382 bstore_me root *531r FIFO 8,1 0t0 3091 /tmp/vgdb-pipe-from-vgdb-to-86246-by-root-on-??? 2023-11-05T08:43:32.614 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root cwd DIR 8,1 4096 265785 /home/ubuntu/cephtest 2023-11-05T08:43:32.614 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:32.614 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-05T08:43:32.614 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:32.614 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:32.615 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-05T08:43:32.615 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-05T08:43:32.615 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root mem REG 8,1 15752 265597 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-05T08:43:32.615 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-05T08:43:32.615 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-05T08:43:32.616 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-05T08:43:32.616 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-05T08:43:32.616 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-05T08:43:32.616 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-05T08:43:32.616 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:32.617 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-05T08:43:32.617 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-05T08:43:32.617 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:32.617 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-05T08:43:32.617 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-05T08:43:32.618 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-05T08:43:32.618 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-05T08:43:32.618 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-05T08:43:32.618 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-05T08:43:32.618 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:32.618 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:32.619 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:32.619 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-05T08:43:32.619 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-05T08:43:32.619 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-05T08:43:32.619 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-05T08:43:32.620 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-05T08:43:32.620 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-05T08:43:32.620 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-05T08:43:32.620 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-05T08:43:32.620 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-05T08:43:32.620 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-05T08:43:32.621 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-05T08:43:32.621 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-05T08:43:32.621 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-05T08:43:32.621 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-05T08:43:32.621 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-05T08:43:32.622 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-05T08:43:32.622 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-05T08:43:32.622 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-05T08:43:32.622 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-05T08:43:32.622 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-05T08:43:32.622 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-05T08:43:32.623 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:32.623 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-05T08:43:32.623 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:32.623 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-05T08:43:32.623 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-05T08:43:32.624 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-05T08:43:32.624 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-05T08:43:32.624 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-05T08:43:32.624 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root mem REG 8,1 83456 265542 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-05T08:43:32.624 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root mem REG 8,1 370416 265532 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-05T08:43:32.625 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root mem REG 8,1 1481856 265536 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-05T08:43:32.625 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root mem REG 8,1 45648 265517 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-05T08:43:32.625 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root mem REG 8,1 41304 265576 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-05T08:43:32.625 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root mem REG 8,1 49912 265561 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-05T08:43:32.625 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root mem REG 8,1 418096 265585 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-05T08:43:32.625 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root mem REG 8,1 83208 265579 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-05T08:43:32.626 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-05T08:43:32.626 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root mem REG 8,1 79224 265555 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-05T08:43:32.626 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root mem REG 8,1 49744 265609 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-05T08:43:32.626 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root mem REG 8,1 49856 265552 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-05T08:43:32.626 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root mem REG 8,1 83632 265549 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-05T08:43:32.627 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root mem REG 8,1 78744 265606 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-05T08:43:32.627 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root mem REG 8,1 53880 265603 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-05T08:43:32.627 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root mem REG 8,1 872944 265588 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-05T08:43:32.627 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root mem REG 8,1 116592 265558 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-05T08:43:32.627 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-05T08:43:32.628 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root mem REG 8,1 1242808 265591 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-05T08:43:32.628 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root mem REG 8,1 62224 265570 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-05T08:43:32.628 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root mem REG 8,1 95808 265564 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-05T08:43:32.628 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root mem REG 8,1 37272 265600 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-05T08:43:32.628 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root mem REG 8,1 104024 265582 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-05T08:43:32.629 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root mem REG 8,1 133480 265546 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-05T08:43:32.629 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root mem REG 8,1 834760 265573 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-05T08:43:32.629 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-05T08:43:32.629 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root mem REG 8,1 129280 265594 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-05T08:43:32.629 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root mem REG 8,1 83224 265567 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-05T08:43:32.629 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root mem REG 8,1 48 3081 /tmp/vgdb-pipe-shared-mem-vgdb-86246-by-root-on-??? 2023-11-05T08:43:32.630 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root DEL REG 0,17 182056 /[aio] 2023-11-05T08:43:32.630 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root DEL REG 0,17 182868 /[aio] 2023-11-05T08:43:32.630 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:32.630 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root 1w FIFO 0,13 0t0 182740 pipe 2023-11-05T08:43:32.630 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root 2w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:32.631 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root 3w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:32.631 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root 4r FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:32.631 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root 5w FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:32.631 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root 6u a_inode 0,14 0 1084 [eventpoll:7,20,21,22,23,24,25,26,27,66] 2023-11-05T08:43:32.631 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root 7r FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:32.632 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root 8w FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:32.632 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root 9u a_inode 0,14 0 1084 [eventpoll:10,67] 2023-11-05T08:43:32.632 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root 10r FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:32.632 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root 11w FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:32.632 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root 12u a_inode 0,14 0 1084 [eventpoll:13] 2023-11-05T08:43:32.632 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root 13r FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:32.633 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root 14w FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:32.633 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root 15w REG 8,1 465910012 276998 /var/log/ceph/ceph-osd.7.log 2023-11-05T08:43:32.633 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root 16uW REG 0,24 6 1974 /run/ceph/ceph-osd.7.pid 2023-11-05T08:43:32.633 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root 17r FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:32.633 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root 18w FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:32.634 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root 19u unix 0xffff8da307b0b300 0t0 187412 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-05T08:43:32.634 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root 20u IPv4 185761 0t0 TCP *:6802 (LISTEN) 2023-11-05T08:43:32.634 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root 21u IPv4 185765 0t0 TCP *:6803 (LISTEN) 2023-11-05T08:43:32.634 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root 22u IPv4 185770 0t0 TCP *:6804 (LISTEN) 2023-11-05T08:43:32.634 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root 23u IPv4 185776 0t0 TCP *:6805 (LISTEN) 2023-11-05T08:43:32.635 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root 24u IPv4 185783 0t0 TCP *:6806 (LISTEN) 2023-11-05T08:43:32.635 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root 25u IPv4 185791 0t0 TCP *:6807 (LISTEN) 2023-11-05T08:43:32.635 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root 26u IPv4 185800 0t0 TCP *:6808 (LISTEN) 2023-11-05T08:43:32.635 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root 27u IPv4 185810 0t0 TCP *:6809 (LISTEN) 2023-11-05T08:43:32.635 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root 28r FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:32.636 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root 29w FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:32.636 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root 30r FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:32.636 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root 31w FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:32.636 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root 32u sock 0,8 0t0 182041 protocol: UDPv6 2023-11-05T08:43:32.636 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-05T08:43:32.637 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-05T08:43:32.637 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.637 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.637 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.637 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.637 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.638 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.638 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.638 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.638 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.638 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.639 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.639 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.639 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.639 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.639 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.639 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.640 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.640 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.640 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.640 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.640 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.641 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.641 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.641 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.641 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root 60r FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:32.641 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root 61w FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:32.641 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root 62r FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:32.642 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root 63w FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:32.642 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root 66u IPv4 199302 0t0 TCP smithi156.front.sepia.ceph.com:56964->smithi156.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-05T08:43:32.642 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root 67u IPv4 199303 0t0 TCP smithi156.front.sepia.ceph.com:6802->smithi156.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-05T08:43:32.642 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:32.642 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root *525u REG 8,1 32 3087 /tmp/valgrind_proc_86246_cmdline_85358a06 (deleted) 2023-11-05T08:43:32.643 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root *526u REG 8,1 336 3088 /tmp/valgrind_proc_86246_auxv_85358a06 (deleted) 2023-11-05T08:43:32.643 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root *527w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:32.643 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root *528w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:32.643 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root *529r FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:32.643 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root *530w FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:32.643 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89397 ms_dispat root *531r FIFO 8,1 0t0 3091 /tmp/vgdb-pipe-from-vgdb-to-86246-by-root-on-??? 2023-11-05T08:43:32.644 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root cwd DIR 8,1 4096 265785 /home/ubuntu/cephtest 2023-11-05T08:43:32.644 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:32.644 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-05T08:43:32.644 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:32.644 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:32.645 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-05T08:43:32.645 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-05T08:43:32.645 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root mem REG 8,1 15752 265597 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-05T08:43:32.645 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-05T08:43:32.645 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-05T08:43:32.645 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-05T08:43:32.646 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-05T08:43:32.646 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-05T08:43:32.646 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-05T08:43:32.646 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:32.646 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-05T08:43:32.647 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-05T08:43:32.647 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:32.647 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-05T08:43:32.647 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-05T08:43:32.647 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-05T08:43:32.648 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-05T08:43:32.648 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-05T08:43:32.648 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-05T08:43:32.648 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:32.648 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:32.648 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:32.649 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-05T08:43:32.649 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-05T08:43:32.649 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-05T08:43:32.649 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-05T08:43:32.649 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-05T08:43:32.650 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-05T08:43:32.650 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-05T08:43:32.650 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-05T08:43:32.650 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-05T08:43:32.650 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-05T08:43:32.651 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-05T08:43:32.651 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-05T08:43:32.651 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-05T08:43:32.651 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-05T08:43:32.651 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-05T08:43:32.651 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-05T08:43:32.652 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-05T08:43:32.652 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-05T08:43:32.652 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-05T08:43:32.652 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-05T08:43:32.652 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-05T08:43:32.653 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:32.653 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-05T08:43:32.653 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:32.653 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-05T08:43:32.653 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-05T08:43:32.653 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-05T08:43:32.654 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-05T08:43:32.654 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-05T08:43:32.654 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root mem REG 8,1 83456 265542 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-05T08:43:32.654 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root mem REG 8,1 370416 265532 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-05T08:43:32.654 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root mem REG 8,1 1481856 265536 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-05T08:43:32.655 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root mem REG 8,1 45648 265517 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-05T08:43:32.655 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root mem REG 8,1 41304 265576 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-05T08:43:32.655 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root mem REG 8,1 49912 265561 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-05T08:43:32.655 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root mem REG 8,1 418096 265585 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-05T08:43:32.655 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root mem REG 8,1 83208 265579 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-05T08:43:32.656 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-05T08:43:32.656 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root mem REG 8,1 79224 265555 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-05T08:43:32.656 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root mem REG 8,1 49744 265609 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-05T08:43:32.656 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root mem REG 8,1 49856 265552 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-05T08:43:32.656 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root mem REG 8,1 83632 265549 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-05T08:43:32.656 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root mem REG 8,1 78744 265606 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-05T08:43:32.657 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root mem REG 8,1 53880 265603 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-05T08:43:32.657 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root mem REG 8,1 872944 265588 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-05T08:43:32.657 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root mem REG 8,1 116592 265558 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-05T08:43:32.657 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-05T08:43:32.657 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root mem REG 8,1 1242808 265591 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-05T08:43:32.658 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root mem REG 8,1 62224 265570 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-05T08:43:32.658 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root mem REG 8,1 95808 265564 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-05T08:43:32.658 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root mem REG 8,1 37272 265600 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-05T08:43:32.658 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root mem REG 8,1 104024 265582 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-05T08:43:32.658 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root mem REG 8,1 133480 265546 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-05T08:43:32.659 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root mem REG 8,1 834760 265573 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-05T08:43:32.659 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-05T08:43:32.659 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root mem REG 8,1 129280 265594 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-05T08:43:32.659 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root mem REG 8,1 83224 265567 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-05T08:43:32.659 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root mem REG 8,1 48 3081 /tmp/vgdb-pipe-shared-mem-vgdb-86246-by-root-on-??? 2023-11-05T08:43:32.661 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root DEL REG 0,17 182056 /[aio] 2023-11-05T08:43:32.661 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root DEL REG 0,17 182868 /[aio] 2023-11-05T08:43:32.661 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:32.661 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root 1w FIFO 0,13 0t0 182740 pipe 2023-11-05T08:43:32.662 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root 2w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:32.662 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root 3w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:32.662 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root 4r FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:32.662 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root 5w FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:32.662 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root 6u a_inode 0,14 0 1084 [eventpoll:7,20,21,22,23,24,25,26,27,66] 2023-11-05T08:43:32.663 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root 7r FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:32.663 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root 8w FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:32.663 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root 9u a_inode 0,14 0 1084 [eventpoll:10,67] 2023-11-05T08:43:32.663 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root 10r FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:32.663 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root 11w FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:32.663 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root 12u a_inode 0,14 0 1084 [eventpoll:13] 2023-11-05T08:43:32.664 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root 13r FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:32.664 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root 14w FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:32.664 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root 15w REG 8,1 465910012 276998 /var/log/ceph/ceph-osd.7.log 2023-11-05T08:43:32.664 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root 16uW REG 0,24 6 1974 /run/ceph/ceph-osd.7.pid 2023-11-05T08:43:32.664 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root 17r FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:32.665 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root 18w FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:32.665 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root 19u unix 0xffff8da307b0b300 0t0 187412 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-05T08:43:32.665 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root 20u IPv4 185761 0t0 TCP *:6802 (LISTEN) 2023-11-05T08:43:32.665 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root 21u IPv4 185765 0t0 TCP *:6803 (LISTEN) 2023-11-05T08:43:32.665 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root 22u IPv4 185770 0t0 TCP *:6804 (LISTEN) 2023-11-05T08:43:32.665 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root 23u IPv4 185776 0t0 TCP *:6805 (LISTEN) 2023-11-05T08:43:32.666 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root 24u IPv4 185783 0t0 TCP *:6806 (LISTEN) 2023-11-05T08:43:32.666 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root 25u IPv4 185791 0t0 TCP *:6807 (LISTEN) 2023-11-05T08:43:32.666 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root 26u IPv4 185800 0t0 TCP *:6808 (LISTEN) 2023-11-05T08:43:32.666 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root 27u IPv4 185810 0t0 TCP *:6809 (LISTEN) 2023-11-05T08:43:32.666 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root 28r FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:32.667 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root 29w FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:32.667 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root 30r FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:32.667 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root 31w FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:32.667 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root 32u sock 0,8 0t0 182041 protocol: UDPv6 2023-11-05T08:43:32.667 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-05T08:43:32.667 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-05T08:43:32.668 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.668 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.668 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.668 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.668 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.669 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.669 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.669 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.669 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.669 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.670 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.670 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.670 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.670 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.670 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.670 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.671 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.671 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.671 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.671 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.671 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.672 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.672 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.672 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.672 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root 60r FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:32.672 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root 61w FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:32.673 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root 62r FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:32.673 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root 63w FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:32.673 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root 66u IPv4 199302 0t0 TCP smithi156.front.sepia.ceph.com:56964->smithi156.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-05T08:43:32.673 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root 67u IPv4 199303 0t0 TCP smithi156.front.sepia.ceph.com:6802->smithi156.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-05T08:43:32.673 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:32.673 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root *525u REG 8,1 32 3087 /tmp/valgrind_proc_86246_cmdline_85358a06 (deleted) 2023-11-05T08:43:32.674 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root *526u REG 8,1 336 3088 /tmp/valgrind_proc_86246_auxv_85358a06 (deleted) 2023-11-05T08:43:32.674 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root *527w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:32.674 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root *528w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:32.674 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root *529r FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:32.674 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root *530w FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:32.675 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89399 ms_local root *531r FIFO 8,1 0t0 3091 /tmp/vgdb-pipe-from-vgdb-to-86246-by-root-on-??? 2023-11-05T08:43:32.675 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root cwd DIR 8,1 4096 265785 /home/ubuntu/cephtest 2023-11-05T08:43:32.675 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:32.675 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-05T08:43:32.675 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:32.676 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:32.676 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-05T08:43:32.676 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-05T08:43:32.676 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root mem REG 8,1 15752 265597 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-05T08:43:32.676 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-05T08:43:32.677 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-05T08:43:32.677 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-05T08:43:32.677 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-05T08:43:32.677 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-05T08:43:32.677 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-05T08:43:32.677 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:32.678 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-05T08:43:32.678 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-05T08:43:32.678 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:32.678 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-05T08:43:32.678 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-05T08:43:32.679 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-05T08:43:32.679 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-05T08:43:32.679 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-05T08:43:32.679 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-05T08:43:32.679 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:32.679 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:32.680 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:32.680 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-05T08:43:32.680 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-05T08:43:32.680 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-05T08:43:32.680 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-05T08:43:32.681 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-05T08:43:32.681 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-05T08:43:32.681 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-05T08:43:32.681 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-05T08:43:32.681 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-05T08:43:32.682 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-05T08:43:32.682 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-05T08:43:32.682 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-05T08:43:32.682 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-05T08:43:32.682 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-05T08:43:32.682 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-05T08:43:32.683 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-05T08:43:32.683 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-05T08:43:32.683 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-05T08:43:32.683 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-05T08:43:32.683 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-05T08:43:32.684 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-05T08:43:32.684 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:32.684 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-05T08:43:32.684 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:32.684 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-05T08:43:32.685 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-05T08:43:32.685 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-05T08:43:32.685 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-05T08:43:32.685 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-05T08:43:32.685 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root mem REG 8,1 83456 265542 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-05T08:43:32.685 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root mem REG 8,1 370416 265532 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-05T08:43:32.686 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root mem REG 8,1 1481856 265536 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-05T08:43:32.686 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root mem REG 8,1 45648 265517 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-05T08:43:32.686 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root mem REG 8,1 41304 265576 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-05T08:43:32.686 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root mem REG 8,1 49912 265561 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-05T08:43:32.686 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root mem REG 8,1 418096 265585 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-05T08:43:32.687 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root mem REG 8,1 83208 265579 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-05T08:43:32.687 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-05T08:43:32.687 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root mem REG 8,1 79224 265555 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-05T08:43:32.687 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root mem REG 8,1 49744 265609 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-05T08:43:32.687 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root mem REG 8,1 49856 265552 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-05T08:43:32.688 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root mem REG 8,1 83632 265549 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-05T08:43:32.688 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root mem REG 8,1 78744 265606 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-05T08:43:32.688 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root mem REG 8,1 53880 265603 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-05T08:43:32.688 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root mem REG 8,1 872944 265588 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-05T08:43:32.688 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root mem REG 8,1 116592 265558 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-05T08:43:32.688 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-05T08:43:32.689 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root mem REG 8,1 1242808 265591 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-05T08:43:32.689 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root mem REG 8,1 62224 265570 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-05T08:43:32.689 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root mem REG 8,1 95808 265564 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-05T08:43:32.689 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root mem REG 8,1 37272 265600 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-05T08:43:32.689 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root mem REG 8,1 104024 265582 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-05T08:43:32.689 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root mem REG 8,1 133480 265546 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-05T08:43:32.690 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root mem REG 8,1 834760 265573 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-05T08:43:32.690 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-05T08:43:32.690 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root mem REG 8,1 129280 265594 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-05T08:43:32.690 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root mem REG 8,1 83224 265567 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-05T08:43:32.690 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root mem REG 8,1 48 3081 /tmp/vgdb-pipe-shared-mem-vgdb-86246-by-root-on-??? 2023-11-05T08:43:32.691 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root DEL REG 0,17 182056 /[aio] 2023-11-05T08:43:32.691 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root DEL REG 0,17 182868 /[aio] 2023-11-05T08:43:32.691 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:32.691 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root 1w FIFO 0,13 0t0 182740 pipe 2023-11-05T08:43:32.691 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root 2w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:32.692 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root 3w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:32.692 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root 4r FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:32.692 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root 5w FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:32.692 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root 6u a_inode 0,14 0 1084 [eventpoll:7,20,21,22,23,24,25,26,27,66] 2023-11-05T08:43:32.692 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root 7r FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:32.692 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root 8w FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:32.693 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root 9u a_inode 0,14 0 1084 [eventpoll:10,67] 2023-11-05T08:43:32.693 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root 10r FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:32.693 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root 11w FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:32.693 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root 12u a_inode 0,14 0 1084 [eventpoll:13] 2023-11-05T08:43:32.693 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root 13r FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:32.693 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root 14w FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:32.694 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root 15w REG 8,1 465910012 276998 /var/log/ceph/ceph-osd.7.log 2023-11-05T08:43:32.694 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root 16uW REG 0,24 6 1974 /run/ceph/ceph-osd.7.pid 2023-11-05T08:43:32.694 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root 17r FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:32.694 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root 18w FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:32.695 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root 19u unix 0xffff8da307b0b300 0t0 187412 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-05T08:43:32.695 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root 20u IPv4 185761 0t0 TCP *:6802 (LISTEN) 2023-11-05T08:43:32.695 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root 21u IPv4 185765 0t0 TCP *:6803 (LISTEN) 2023-11-05T08:43:32.695 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root 22u IPv4 185770 0t0 TCP *:6804 (LISTEN) 2023-11-05T08:43:32.695 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root 23u IPv4 185776 0t0 TCP *:6805 (LISTEN) 2023-11-05T08:43:32.695 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root 24u IPv4 185783 0t0 TCP *:6806 (LISTEN) 2023-11-05T08:43:32.696 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root 25u IPv4 185791 0t0 TCP *:6807 (LISTEN) 2023-11-05T08:43:32.696 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root 26u IPv4 185800 0t0 TCP *:6808 (LISTEN) 2023-11-05T08:43:32.696 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root 27u IPv4 185810 0t0 TCP *:6809 (LISTEN) 2023-11-05T08:43:32.696 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root 28r FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:32.696 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root 29w FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:32.697 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root 30r FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:32.697 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root 31w FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:32.697 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root 32u sock 0,8 0t0 182041 protocol: UDPv6 2023-11-05T08:43:32.697 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-05T08:43:32.697 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-05T08:43:32.697 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.698 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.698 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.698 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.698 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.698 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.699 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.699 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.699 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.699 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.699 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.700 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.700 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.700 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.700 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.700 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.700 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.701 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.701 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.701 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.701 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.701 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.702 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.702 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.702 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root 60r FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:32.702 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root 61w FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:32.702 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root 62r FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:32.702 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root 63w FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:32.703 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root 66u IPv4 199302 0t0 TCP smithi156.front.sepia.ceph.com:56964->smithi156.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-05T08:43:32.703 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root 67u IPv4 199303 0t0 TCP smithi156.front.sepia.ceph.com:6802->smithi156.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-05T08:43:32.703 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:32.703 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root *525u REG 8,1 32 3087 /tmp/valgrind_proc_86246_cmdline_85358a06 (deleted) 2023-11-05T08:43:32.703 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root *526u REG 8,1 336 3088 /tmp/valgrind_proc_86246_auxv_85358a06 (deleted) 2023-11-05T08:43:32.704 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root *527w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:32.704 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root *528w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:32.704 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root *529r FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:32.704 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root *530w FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:32.704 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89400 safe_time root *531r FIFO 8,1 0t0 3091 /tmp/vgdb-pipe-from-vgdb-to-86246-by-root-on-??? 2023-11-05T08:43:32.704 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root cwd DIR 8,1 4096 265785 /home/ubuntu/cephtest 2023-11-05T08:43:32.705 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:32.705 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-05T08:43:32.705 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:32.705 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:32.705 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-05T08:43:32.706 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-05T08:43:32.706 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root mem REG 8,1 15752 265597 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-05T08:43:32.706 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-05T08:43:32.706 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-05T08:43:32.706 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-05T08:43:32.707 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-05T08:43:32.707 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-05T08:43:32.707 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-05T08:43:32.707 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:32.707 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-05T08:43:32.708 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-05T08:43:32.708 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:32.708 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-05T08:43:32.708 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-05T08:43:32.708 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-05T08:43:32.708 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-05T08:43:32.709 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-05T08:43:32.709 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-05T08:43:32.709 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:32.709 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:32.709 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:32.710 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-05T08:43:32.710 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-05T08:43:32.710 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-05T08:43:32.710 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-05T08:43:32.710 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-05T08:43:32.710 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-05T08:43:32.711 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-05T08:43:32.711 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-05T08:43:32.711 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-05T08:43:32.711 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-05T08:43:32.711 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-05T08:43:32.712 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-05T08:43:32.712 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-05T08:43:32.712 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-05T08:43:32.712 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-05T08:43:32.712 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-05T08:43:32.712 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-05T08:43:32.713 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-05T08:43:32.713 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-05T08:43:32.713 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-05T08:43:32.713 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-05T08:43:32.713 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:32.714 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-05T08:43:32.714 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:32.714 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-05T08:43:32.714 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-05T08:43:32.714 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-05T08:43:32.714 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-05T08:43:32.715 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-05T08:43:32.715 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root mem REG 8,1 83456 265542 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-05T08:43:32.715 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root mem REG 8,1 370416 265532 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-05T08:43:32.715 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root mem REG 8,1 1481856 265536 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-05T08:43:32.715 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root mem REG 8,1 45648 265517 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-05T08:43:32.716 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root mem REG 8,1 41304 265576 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-05T08:43:32.716 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root mem REG 8,1 49912 265561 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-05T08:43:32.716 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root mem REG 8,1 418096 265585 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-05T08:43:32.716 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root mem REG 8,1 83208 265579 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-05T08:43:32.716 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-05T08:43:32.716 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root mem REG 8,1 79224 265555 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-05T08:43:32.717 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root mem REG 8,1 49744 265609 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-05T08:43:32.717 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root mem REG 8,1 49856 265552 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-05T08:43:32.717 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root mem REG 8,1 83632 265549 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-05T08:43:32.717 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root mem REG 8,1 78744 265606 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-05T08:43:32.717 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root mem REG 8,1 53880 265603 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-05T08:43:32.718 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root mem REG 8,1 872944 265588 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-05T08:43:32.718 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root mem REG 8,1 116592 265558 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-05T08:43:32.718 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-05T08:43:32.718 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root mem REG 8,1 1242808 265591 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-05T08:43:32.718 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root mem REG 8,1 62224 265570 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-05T08:43:32.719 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root mem REG 8,1 95808 265564 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-05T08:43:32.719 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root mem REG 8,1 37272 265600 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-05T08:43:32.719 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root mem REG 8,1 104024 265582 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-05T08:43:32.719 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root mem REG 8,1 133480 265546 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-05T08:43:32.719 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root mem REG 8,1 834760 265573 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-05T08:43:32.719 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-05T08:43:32.720 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root mem REG 8,1 129280 265594 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-05T08:43:32.720 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root mem REG 8,1 83224 265567 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-05T08:43:32.720 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root mem REG 8,1 48 3081 /tmp/vgdb-pipe-shared-mem-vgdb-86246-by-root-on-??? 2023-11-05T08:43:32.720 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root DEL REG 0,17 182056 /[aio] 2023-11-05T08:43:32.720 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root DEL REG 0,17 182868 /[aio] 2023-11-05T08:43:32.721 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:32.721 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root 1w FIFO 0,13 0t0 182740 pipe 2023-11-05T08:43:32.721 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root 2w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:32.721 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root 3w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:32.721 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root 4r FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:32.721 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root 5w FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:32.722 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root 6u a_inode 0,14 0 1084 [eventpoll:7,20,21,22,23,24,25,26,27,66] 2023-11-05T08:43:32.722 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root 7r FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:32.722 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root 8w FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:32.722 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root 9u a_inode 0,14 0 1084 [eventpoll:10,67] 2023-11-05T08:43:32.722 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root 10r FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:32.723 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root 11w FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:32.723 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root 12u a_inode 0,14 0 1084 [eventpoll:13] 2023-11-05T08:43:32.723 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root 13r FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:32.723 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root 14w FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:32.723 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root 15w REG 8,1 465910012 276998 /var/log/ceph/ceph-osd.7.log 2023-11-05T08:43:32.723 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root 16uW REG 0,24 6 1974 /run/ceph/ceph-osd.7.pid 2023-11-05T08:43:32.724 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root 17r FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:32.724 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root 18w FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:32.724 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root 19u unix 0xffff8da307b0b300 0t0 187412 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-05T08:43:32.724 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root 20u IPv4 185761 0t0 TCP *:6802 (LISTEN) 2023-11-05T08:43:32.724 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root 21u IPv4 185765 0t0 TCP *:6803 (LISTEN) 2023-11-05T08:43:32.725 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root 22u IPv4 185770 0t0 TCP *:6804 (LISTEN) 2023-11-05T08:43:32.725 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root 23u IPv4 185776 0t0 TCP *:6805 (LISTEN) 2023-11-05T08:43:32.725 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root 24u IPv4 185783 0t0 TCP *:6806 (LISTEN) 2023-11-05T08:43:32.725 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root 25u IPv4 185791 0t0 TCP *:6807 (LISTEN) 2023-11-05T08:43:32.725 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root 26u IPv4 185800 0t0 TCP *:6808 (LISTEN) 2023-11-05T08:43:32.725 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root 27u IPv4 185810 0t0 TCP *:6809 (LISTEN) 2023-11-05T08:43:32.726 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root 28r FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:32.726 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root 29w FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:32.726 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root 30r FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:32.726 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root 31w FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:32.726 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root 32u sock 0,8 0t0 182041 protocol: UDPv6 2023-11-05T08:43:32.727 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-05T08:43:32.727 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-05T08:43:32.727 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.727 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.727 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.727 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.728 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.728 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.728 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.728 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.728 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.729 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.729 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.729 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.729 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.729 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.730 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.730 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.730 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.730 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.730 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.730 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.731 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.731 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.731 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.731 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.731 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root 60r FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:32.732 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root 61w FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:32.732 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root 62r FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:32.732 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root 63w FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:32.732 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root 66u IPv4 199302 0t0 TCP smithi156.front.sepia.ceph.com:56964->smithi156.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-05T08:43:32.732 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root 67u IPv4 199303 0t0 TCP smithi156.front.sepia.ceph.com:6802->smithi156.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-05T08:43:32.733 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:32.733 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root *525u REG 8,1 32 3087 /tmp/valgrind_proc_86246_cmdline_85358a06 (deleted) 2023-11-05T08:43:32.733 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root *526u REG 8,1 336 3088 /tmp/valgrind_proc_86246_auxv_85358a06 (deleted) 2023-11-05T08:43:32.733 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root *527w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:32.733 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root *528w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:32.733 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root *529r FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:32.734 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root *530w FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:32.734 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89402 safe_time root *531r FIFO 8,1 0t0 3091 /tmp/vgdb-pipe-from-vgdb-to-86246-by-root-on-??? 2023-11-05T08:43:32.734 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root cwd DIR 8,1 4096 265785 /home/ubuntu/cephtest 2023-11-05T08:43:32.734 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:32.734 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-05T08:43:32.735 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:32.735 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:32.735 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-05T08:43:32.735 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-05T08:43:32.735 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root mem REG 8,1 15752 265597 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-05T08:43:32.736 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-05T08:43:32.736 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-05T08:43:32.736 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-05T08:43:32.736 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-05T08:43:32.736 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-05T08:43:32.736 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-05T08:43:32.737 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:32.737 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-05T08:43:32.737 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-05T08:43:32.737 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:32.737 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-05T08:43:32.737 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-05T08:43:32.738 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-05T08:43:32.738 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-05T08:43:32.738 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-05T08:43:32.738 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-05T08:43:32.738 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:32.739 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:32.739 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:32.739 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-05T08:43:32.739 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-05T08:43:32.739 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-05T08:43:32.740 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-05T08:43:32.740 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-05T08:43:32.740 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-05T08:43:32.740 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-05T08:43:32.740 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-05T08:43:32.740 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-05T08:43:32.741 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-05T08:43:32.741 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-05T08:43:32.741 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-05T08:43:32.741 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-05T08:43:32.741 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-05T08:43:32.742 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-05T08:43:32.742 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-05T08:43:32.742 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-05T08:43:32.742 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-05T08:43:32.742 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-05T08:43:32.742 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-05T08:43:32.743 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-05T08:43:32.743 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:32.743 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-05T08:43:32.743 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:32.743 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-05T08:43:32.744 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-05T08:43:32.744 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-05T08:43:32.744 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-05T08:43:32.744 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-05T08:43:32.744 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root mem REG 8,1 83456 265542 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-05T08:43:32.744 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root mem REG 8,1 370416 265532 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-05T08:43:32.745 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root mem REG 8,1 1481856 265536 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-05T08:43:32.745 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root mem REG 8,1 45648 265517 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-05T08:43:32.745 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root mem REG 8,1 41304 265576 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-05T08:43:32.745 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root mem REG 8,1 49912 265561 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-05T08:43:32.745 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root mem REG 8,1 418096 265585 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-05T08:43:32.746 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root mem REG 8,1 83208 265579 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-05T08:43:32.746 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-05T08:43:32.746 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root mem REG 8,1 79224 265555 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-05T08:43:32.746 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root mem REG 8,1 49744 265609 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-05T08:43:32.746 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root mem REG 8,1 49856 265552 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-05T08:43:32.747 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root mem REG 8,1 83632 265549 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-05T08:43:32.747 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root mem REG 8,1 78744 265606 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-05T08:43:32.747 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root mem REG 8,1 53880 265603 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-05T08:43:32.747 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root mem REG 8,1 872944 265588 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-05T08:43:32.747 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root mem REG 8,1 116592 265558 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-05T08:43:32.747 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-05T08:43:32.748 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root mem REG 8,1 1242808 265591 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-05T08:43:32.748 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root mem REG 8,1 62224 265570 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-05T08:43:32.748 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root mem REG 8,1 95808 265564 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-05T08:43:32.748 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root mem REG 8,1 37272 265600 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-05T08:43:32.748 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root mem REG 8,1 104024 265582 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-05T08:43:32.749 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root mem REG 8,1 133480 265546 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-05T08:43:32.749 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root mem REG 8,1 834760 265573 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-05T08:43:32.749 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-05T08:43:32.749 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root mem REG 8,1 129280 265594 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-05T08:43:32.749 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root mem REG 8,1 83224 265567 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-05T08:43:32.749 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root mem REG 8,1 48 3081 /tmp/vgdb-pipe-shared-mem-vgdb-86246-by-root-on-??? 2023-11-05T08:43:32.750 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root DEL REG 0,17 182056 /[aio] 2023-11-05T08:43:32.750 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root DEL REG 0,17 182868 /[aio] 2023-11-05T08:43:32.750 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:32.750 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root 1w FIFO 0,13 0t0 182740 pipe 2023-11-05T08:43:32.750 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root 2w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:32.751 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root 3w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:32.751 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root 4r FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:32.751 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root 5w FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:32.751 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root 6u a_inode 0,14 0 1084 [eventpoll:7,20,21,22,23,24,25,26,27,66] 2023-11-05T08:43:32.751 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root 7r FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:32.752 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root 8w FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:32.752 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root 9u a_inode 0,14 0 1084 [eventpoll:10,67] 2023-11-05T08:43:32.752 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root 10r FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:32.752 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root 11w FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:32.752 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root 12u a_inode 0,14 0 1084 [eventpoll:13] 2023-11-05T08:43:32.752 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root 13r FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:32.753 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root 14w FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:32.753 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root 15w REG 8,1 465910012 276998 /var/log/ceph/ceph-osd.7.log 2023-11-05T08:43:32.753 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root 16uW REG 0,24 6 1974 /run/ceph/ceph-osd.7.pid 2023-11-05T08:43:32.753 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root 17r FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:32.753 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root 18w FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:32.754 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root 19u unix 0xffff8da307b0b300 0t0 187412 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-05T08:43:32.754 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root 20u IPv4 185761 0t0 TCP *:6802 (LISTEN) 2023-11-05T08:43:32.754 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root 21u IPv4 185765 0t0 TCP *:6803 (LISTEN) 2023-11-05T08:43:32.754 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root 22u IPv4 185770 0t0 TCP *:6804 (LISTEN) 2023-11-05T08:43:32.754 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root 23u IPv4 185776 0t0 TCP *:6805 (LISTEN) 2023-11-05T08:43:32.754 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root 24u IPv4 185783 0t0 TCP *:6806 (LISTEN) 2023-11-05T08:43:32.755 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root 25u IPv4 185791 0t0 TCP *:6807 (LISTEN) 2023-11-05T08:43:32.755 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root 26u IPv4 185800 0t0 TCP *:6808 (LISTEN) 2023-11-05T08:43:32.755 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root 27u IPv4 185810 0t0 TCP *:6809 (LISTEN) 2023-11-05T08:43:32.755 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root 28r FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:32.755 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root 29w FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:32.756 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root 30r FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:32.756 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root 31w FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:32.756 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root 32u sock 0,8 0t0 182041 protocol: UDPv6 2023-11-05T08:43:32.756 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-05T08:43:32.756 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-05T08:43:32.756 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.757 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.757 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.757 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.757 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.757 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.758 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.758 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.758 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.758 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.758 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.758 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.759 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.759 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.759 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.759 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.759 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.760 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.760 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.760 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.760 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.760 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.760 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.761 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.761 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root 60r FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:32.761 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root 61w FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:32.761 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root 62r FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:32.761 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root 63w FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:32.761 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root 66u IPv4 199302 0t0 TCP smithi156.front.sepia.ceph.com:56964->smithi156.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-05T08:43:32.762 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root 67u IPv4 199303 0t0 TCP smithi156.front.sepia.ceph.com:6802->smithi156.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-05T08:43:32.762 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:32.762 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root *525u REG 8,1 32 3087 /tmp/valgrind_proc_86246_cmdline_85358a06 (deleted) 2023-11-05T08:43:32.762 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root *526u REG 8,1 336 3088 /tmp/valgrind_proc_86246_auxv_85358a06 (deleted) 2023-11-05T08:43:32.763 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root *527w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:32.763 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root *528w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:32.763 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root *529r FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:32.763 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root *530w FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:32.763 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89404 ms_dispat root *531r FIFO 8,1 0t0 3091 /tmp/vgdb-pipe-from-vgdb-to-86246-by-root-on-??? 2023-11-05T08:43:32.763 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root cwd DIR 8,1 4096 265785 /home/ubuntu/cephtest 2023-11-05T08:43:32.764 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:32.764 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-05T08:43:32.764 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:32.764 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:32.764 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-05T08:43:32.765 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-05T08:43:32.765 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root mem REG 8,1 15752 265597 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-05T08:43:32.765 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-05T08:43:32.765 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-05T08:43:32.765 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-05T08:43:32.765 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-05T08:43:32.766 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-05T08:43:32.766 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-05T08:43:32.766 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:32.766 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-05T08:43:32.766 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-05T08:43:32.767 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:32.767 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-05T08:43:32.767 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-05T08:43:32.767 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-05T08:43:32.767 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-05T08:43:32.767 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-05T08:43:32.768 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-05T08:43:32.768 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:32.768 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:32.768 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:32.768 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-05T08:43:32.769 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-05T08:43:32.769 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-05T08:43:32.769 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-05T08:43:32.769 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-05T08:43:32.769 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-05T08:43:32.769 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-05T08:43:32.770 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-05T08:43:32.770 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-05T08:43:32.770 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-05T08:43:32.770 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-05T08:43:32.770 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-05T08:43:32.771 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-05T08:43:32.771 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-05T08:43:32.771 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-05T08:43:32.771 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-05T08:43:32.771 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-05T08:43:32.772 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-05T08:43:32.772 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-05T08:43:32.772 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-05T08:43:32.772 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-05T08:43:32.772 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:32.772 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-05T08:43:32.773 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:32.773 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-05T08:43:32.773 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-05T08:43:32.773 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-05T08:43:32.773 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-05T08:43:32.774 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-05T08:43:32.774 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root mem REG 8,1 83456 265542 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-05T08:43:32.774 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root mem REG 8,1 370416 265532 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-05T08:43:32.774 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root mem REG 8,1 1481856 265536 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-05T08:43:32.774 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root mem REG 8,1 45648 265517 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-05T08:43:32.775 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root mem REG 8,1 41304 265576 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-05T08:43:32.775 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root mem REG 8,1 49912 265561 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-05T08:43:32.775 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root mem REG 8,1 418096 265585 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-05T08:43:32.775 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root mem REG 8,1 83208 265579 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-05T08:43:32.775 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-05T08:43:32.776 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root mem REG 8,1 79224 265555 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-05T08:43:32.776 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root mem REG 8,1 49744 265609 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-05T08:43:32.776 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root mem REG 8,1 49856 265552 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-05T08:43:32.776 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root mem REG 8,1 83632 265549 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-05T08:43:32.776 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root mem REG 8,1 78744 265606 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-05T08:43:32.776 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root mem REG 8,1 53880 265603 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-05T08:43:32.777 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root mem REG 8,1 872944 265588 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-05T08:43:32.777 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root mem REG 8,1 116592 265558 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-05T08:43:32.777 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-05T08:43:32.777 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root mem REG 8,1 1242808 265591 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-05T08:43:32.777 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root mem REG 8,1 62224 265570 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-05T08:43:32.778 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root mem REG 8,1 95808 265564 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-05T08:43:32.778 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root mem REG 8,1 37272 265600 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-05T08:43:32.778 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root mem REG 8,1 104024 265582 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-05T08:43:32.778 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root mem REG 8,1 133480 265546 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-05T08:43:32.778 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root mem REG 8,1 834760 265573 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-05T08:43:32.779 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-05T08:43:32.779 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root mem REG 8,1 129280 265594 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-05T08:43:32.779 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root mem REG 8,1 83224 265567 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-05T08:43:32.779 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root mem REG 8,1 48 3081 /tmp/vgdb-pipe-shared-mem-vgdb-86246-by-root-on-??? 2023-11-05T08:43:32.779 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root DEL REG 0,17 182056 /[aio] 2023-11-05T08:43:32.780 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root DEL REG 0,17 182868 /[aio] 2023-11-05T08:43:32.780 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:32.780 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root 1w FIFO 0,13 0t0 182740 pipe 2023-11-05T08:43:32.780 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root 2w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:32.780 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root 3w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:32.781 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root 4r FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:32.781 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root 5w FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:32.781 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root 6u a_inode 0,14 0 1084 [eventpoll:7,20,21,22,23,24,25,26,27,66] 2023-11-05T08:43:32.781 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root 7r FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:32.781 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root 8w FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:32.781 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root 9u a_inode 0,14 0 1084 [eventpoll:10,67] 2023-11-05T08:43:32.782 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root 10r FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:32.782 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root 11w FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:32.782 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root 12u a_inode 0,14 0 1084 [eventpoll:13] 2023-11-05T08:43:32.782 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root 13r FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:32.782 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root 14w FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:32.783 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root 15w REG 8,1 465910012 276998 /var/log/ceph/ceph-osd.7.log 2023-11-05T08:43:32.783 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root 16uW REG 0,24 6 1974 /run/ceph/ceph-osd.7.pid 2023-11-05T08:43:32.783 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root 17r FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:32.783 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root 18w FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:32.783 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root 19u unix 0xffff8da307b0b300 0t0 187412 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-05T08:43:32.784 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root 20u IPv4 185761 0t0 TCP *:6802 (LISTEN) 2023-11-05T08:43:32.784 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root 21u IPv4 185765 0t0 TCP *:6803 (LISTEN) 2023-11-05T08:43:32.784 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root 22u IPv4 185770 0t0 TCP *:6804 (LISTEN) 2023-11-05T08:43:32.784 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root 23u IPv4 185776 0t0 TCP *:6805 (LISTEN) 2023-11-05T08:43:32.784 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root 24u IPv4 185783 0t0 TCP *:6806 (LISTEN) 2023-11-05T08:43:32.784 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root 25u IPv4 185791 0t0 TCP *:6807 (LISTEN) 2023-11-05T08:43:32.785 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root 26u IPv4 185800 0t0 TCP *:6808 (LISTEN) 2023-11-05T08:43:32.785 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root 27u IPv4 185810 0t0 TCP *:6809 (LISTEN) 2023-11-05T08:43:32.785 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root 28r FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:32.785 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root 29w FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:32.785 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root 30r FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:32.786 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root 31w FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:32.786 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root 32u sock 0,8 0t0 182041 protocol: UDPv6 2023-11-05T08:43:32.786 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-05T08:43:32.786 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-05T08:43:32.786 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.787 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.787 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.787 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.787 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.787 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.787 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.788 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.788 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.788 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.788 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.788 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.789 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.789 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.789 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.789 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.789 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.789 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.790 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.790 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.790 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.790 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.790 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.791 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.791 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root 60r FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:32.791 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root 61w FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:32.791 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root 62r FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:32.791 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root 63w FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:32.791 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root 66u IPv4 199302 0t0 TCP smithi156.front.sepia.ceph.com:56964->smithi156.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-05T08:43:32.792 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root 67u IPv4 199303 0t0 TCP smithi156.front.sepia.ceph.com:6802->smithi156.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-05T08:43:32.792 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:32.792 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root *525u REG 8,1 32 3087 /tmp/valgrind_proc_86246_cmdline_85358a06 (deleted) 2023-11-05T08:43:32.792 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root *526u REG 8,1 336 3088 /tmp/valgrind_proc_86246_auxv_85358a06 (deleted) 2023-11-05T08:43:32.792 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root *527w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:32.793 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root *528w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:32.793 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root *529r FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:32.793 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root *530w FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:32.793 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89406 ms_local root *531r FIFO 8,1 0t0 3091 /tmp/vgdb-pipe-from-vgdb-to-86246-by-root-on-??? 2023-11-05T08:43:32.793 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root cwd DIR 8,1 4096 265785 /home/ubuntu/cephtest 2023-11-05T08:43:32.793 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:32.794 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-05T08:43:32.794 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:32.794 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:32.794 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-05T08:43:32.794 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-05T08:43:32.795 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root mem REG 8,1 15752 265597 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-05T08:43:32.795 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-05T08:43:32.795 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-05T08:43:32.795 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-05T08:43:32.795 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-05T08:43:32.795 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-05T08:43:32.796 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-05T08:43:32.796 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:32.796 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-05T08:43:32.796 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-05T08:43:32.796 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:32.797 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-05T08:43:32.797 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-05T08:43:32.797 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-05T08:43:32.797 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-05T08:43:32.797 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-05T08:43:32.798 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-05T08:43:32.798 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:32.798 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:32.798 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:32.798 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-05T08:43:32.799 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-05T08:43:32.799 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-05T08:43:32.799 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-05T08:43:32.799 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-05T08:43:32.799 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-05T08:43:32.799 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-05T08:43:32.800 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-05T08:43:32.800 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-05T08:43:32.800 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-05T08:43:32.800 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-05T08:43:32.800 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-05T08:43:32.801 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-05T08:43:32.801 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-05T08:43:32.801 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-05T08:43:32.801 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-05T08:43:32.801 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-05T08:43:32.801 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-05T08:43:32.802 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-05T08:43:32.802 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-05T08:43:32.802 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-05T08:43:32.802 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:32.802 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-05T08:43:32.803 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:32.803 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-05T08:43:32.803 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-05T08:43:32.803 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-05T08:43:32.803 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-05T08:43:32.803 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-05T08:43:32.804 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root mem REG 8,1 83456 265542 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-05T08:43:32.804 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root mem REG 8,1 370416 265532 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-05T08:43:32.804 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root mem REG 8,1 1481856 265536 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-05T08:43:32.804 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root mem REG 8,1 45648 265517 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-05T08:43:32.804 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root mem REG 8,1 41304 265576 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-05T08:43:32.805 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root mem REG 8,1 49912 265561 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-05T08:43:32.805 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root mem REG 8,1 418096 265585 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-05T08:43:32.805 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root mem REG 8,1 83208 265579 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-05T08:43:32.805 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-05T08:43:32.805 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root mem REG 8,1 79224 265555 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-05T08:43:32.806 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root mem REG 8,1 49744 265609 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-05T08:43:32.806 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root mem REG 8,1 49856 265552 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-05T08:43:32.806 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root mem REG 8,1 83632 265549 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-05T08:43:32.806 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root mem REG 8,1 78744 265606 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-05T08:43:32.806 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root mem REG 8,1 53880 265603 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-05T08:43:32.807 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root mem REG 8,1 872944 265588 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-05T08:43:32.807 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root mem REG 8,1 116592 265558 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-05T08:43:32.807 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-05T08:43:32.807 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root mem REG 8,1 1242808 265591 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-05T08:43:32.807 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root mem REG 8,1 62224 265570 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-05T08:43:32.808 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root mem REG 8,1 95808 265564 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-05T08:43:32.808 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root mem REG 8,1 37272 265600 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-05T08:43:32.808 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root mem REG 8,1 104024 265582 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-05T08:43:32.808 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root mem REG 8,1 133480 265546 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-05T08:43:32.808 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root mem REG 8,1 834760 265573 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-05T08:43:32.809 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-05T08:43:32.809 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root mem REG 8,1 129280 265594 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-05T08:43:32.809 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root mem REG 8,1 83224 265567 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-05T08:43:32.809 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root mem REG 8,1 48 3081 /tmp/vgdb-pipe-shared-mem-vgdb-86246-by-root-on-??? 2023-11-05T08:43:32.809 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root DEL REG 0,17 182056 /[aio] 2023-11-05T08:43:32.810 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root DEL REG 0,17 182868 /[aio] 2023-11-05T08:43:32.810 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:32.810 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root 1w FIFO 0,13 0t0 182740 pipe 2023-11-05T08:43:32.810 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root 2w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:32.810 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root 3w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:32.810 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root 4r FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:32.811 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root 5w FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:32.811 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root 6u a_inode 0,14 0 1084 [eventpoll:7,20,21,22,23,24,25,26,27,66] 2023-11-05T08:43:32.811 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root 7r FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:32.811 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root 8w FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:32.811 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root 9u a_inode 0,14 0 1084 [eventpoll:10,67] 2023-11-05T08:43:32.812 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root 10r FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:32.812 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root 11w FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:32.812 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root 12u a_inode 0,14 0 1084 [eventpoll:13] 2023-11-05T08:43:32.812 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root 13r FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:32.812 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root 14w FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:32.813 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root 15w REG 8,1 465910012 276998 /var/log/ceph/ceph-osd.7.log 2023-11-05T08:43:32.813 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root 16uW REG 0,24 6 1974 /run/ceph/ceph-osd.7.pid 2023-11-05T08:43:32.813 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root 17r FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:32.813 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root 18w FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:32.813 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root 19u unix 0xffff8da307b0b300 0t0 187412 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-05T08:43:32.813 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root 20u IPv4 185761 0t0 TCP *:6802 (LISTEN) 2023-11-05T08:43:32.814 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root 21u IPv4 185765 0t0 TCP *:6803 (LISTEN) 2023-11-05T08:43:32.814 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root 22u IPv4 185770 0t0 TCP *:6804 (LISTEN) 2023-11-05T08:43:32.814 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root 23u IPv4 185776 0t0 TCP *:6805 (LISTEN) 2023-11-05T08:43:32.814 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root 24u IPv4 185783 0t0 TCP *:6806 (LISTEN) 2023-11-05T08:43:32.814 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root 25u IPv4 185791 0t0 TCP *:6807 (LISTEN) 2023-11-05T08:43:32.815 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root 26u IPv4 185800 0t0 TCP *:6808 (LISTEN) 2023-11-05T08:43:32.815 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root 27u IPv4 185810 0t0 TCP *:6809 (LISTEN) 2023-11-05T08:43:32.815 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root 28r FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:32.815 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root 29w FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:32.815 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root 30r FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:32.815 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root 31w FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:32.816 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root 32u sock 0,8 0t0 182041 protocol: UDPv6 2023-11-05T08:43:32.816 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-05T08:43:32.816 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-05T08:43:32.816 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.816 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.817 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.817 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.817 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.817 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.817 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.817 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.818 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.818 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.818 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.818 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.818 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.819 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.819 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.819 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.819 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.819 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.820 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.820 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.820 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.820 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.820 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.820 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.821 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root 60r FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:32.821 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root 61w FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:32.821 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root 62r FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:32.821 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root 63w FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:32.821 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root 66u IPv4 199302 0t0 TCP smithi156.front.sepia.ceph.com:56964->smithi156.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-05T08:43:32.822 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root 67u IPv4 199303 0t0 TCP smithi156.front.sepia.ceph.com:6802->smithi156.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-05T08:43:32.822 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:32.822 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root *525u REG 8,1 32 3087 /tmp/valgrind_proc_86246_cmdline_85358a06 (deleted) 2023-11-05T08:43:32.822 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root *526u REG 8,1 336 3088 /tmp/valgrind_proc_86246_auxv_85358a06 (deleted) 2023-11-05T08:43:32.822 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root *527w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:32.823 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root *528w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:32.823 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root *529r FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:32.823 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root *530w FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:32.823 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89409 ms_dispat root *531r FIFO 8,1 0t0 3091 /tmp/vgdb-pipe-from-vgdb-to-86246-by-root-on-??? 2023-11-05T08:43:32.823 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root cwd DIR 8,1 4096 265785 /home/ubuntu/cephtest 2023-11-05T08:43:32.823 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:32.824 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-05T08:43:32.824 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:32.824 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:32.824 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-05T08:43:32.824 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-05T08:43:32.825 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root mem REG 8,1 15752 265597 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-05T08:43:32.825 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-05T08:43:32.825 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-05T08:43:32.825 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-05T08:43:32.825 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-05T08:43:32.825 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-05T08:43:32.826 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-05T08:43:32.826 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:32.826 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-05T08:43:32.826 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-05T08:43:32.826 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:32.827 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-05T08:43:32.827 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-05T08:43:32.827 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-05T08:43:32.827 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-05T08:43:32.827 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-05T08:43:32.827 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-05T08:43:32.828 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:32.828 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:32.828 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:32.828 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-05T08:43:32.828 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-05T08:43:32.829 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-05T08:43:32.829 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-05T08:43:32.829 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-05T08:43:32.829 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-05T08:43:32.829 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-05T08:43:32.830 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-05T08:43:32.830 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-05T08:43:32.830 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-05T08:43:32.830 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-05T08:43:32.830 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-05T08:43:32.830 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-05T08:43:32.831 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-05T08:43:32.831 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-05T08:43:32.831 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-05T08:43:32.831 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-05T08:43:32.831 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-05T08:43:32.832 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-05T08:43:32.832 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-05T08:43:32.832 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-05T08:43:32.832 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:32.832 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-05T08:43:32.833 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:32.833 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-05T08:43:32.833 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-05T08:43:32.833 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-05T08:43:32.833 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-05T08:43:32.833 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-05T08:43:32.834 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root mem REG 8,1 83456 265542 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-05T08:43:32.834 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root mem REG 8,1 370416 265532 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-05T08:43:32.834 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root mem REG 8,1 1481856 265536 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-05T08:43:32.834 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root mem REG 8,1 45648 265517 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-05T08:43:32.834 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root mem REG 8,1 41304 265576 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-05T08:43:32.835 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root mem REG 8,1 49912 265561 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-05T08:43:32.835 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root mem REG 8,1 418096 265585 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-05T08:43:32.835 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root mem REG 8,1 83208 265579 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-05T08:43:32.835 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-05T08:43:32.835 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root mem REG 8,1 79224 265555 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-05T08:43:32.835 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root mem REG 8,1 49744 265609 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-05T08:43:32.836 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root mem REG 8,1 49856 265552 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-05T08:43:32.836 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root mem REG 8,1 83632 265549 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-05T08:43:32.836 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root mem REG 8,1 78744 265606 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-05T08:43:32.836 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root mem REG 8,1 53880 265603 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-05T08:43:32.836 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root mem REG 8,1 872944 265588 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-05T08:43:32.837 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root mem REG 8,1 116592 265558 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-05T08:43:32.837 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-05T08:43:32.837 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root mem REG 8,1 1242808 265591 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-05T08:43:32.837 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root mem REG 8,1 62224 265570 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-05T08:43:32.837 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root mem REG 8,1 95808 265564 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-05T08:43:32.837 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root mem REG 8,1 37272 265600 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-05T08:43:32.838 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root mem REG 8,1 104024 265582 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-05T08:43:32.838 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root mem REG 8,1 133480 265546 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-05T08:43:32.838 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root mem REG 8,1 834760 265573 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-05T08:43:32.838 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-05T08:43:32.838 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root mem REG 8,1 129280 265594 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-05T08:43:32.839 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root mem REG 8,1 83224 265567 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-05T08:43:32.839 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root mem REG 8,1 48 3081 /tmp/vgdb-pipe-shared-mem-vgdb-86246-by-root-on-??? 2023-11-05T08:43:32.839 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root DEL REG 0,17 182056 /[aio] 2023-11-05T08:43:32.839 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root DEL REG 0,17 182868 /[aio] 2023-11-05T08:43:32.839 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:32.839 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root 1w FIFO 0,13 0t0 182740 pipe 2023-11-05T08:43:32.840 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root 2w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:32.840 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root 3w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:32.840 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root 4r FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:32.840 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root 5w FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:32.840 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root 6u a_inode 0,14 0 1084 [eventpoll:7,20,21,22,23,24,25,26,27,66] 2023-11-05T08:43:32.841 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root 7r FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:32.841 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root 8w FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:32.841 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root 9u a_inode 0,14 0 1084 [eventpoll:10,67] 2023-11-05T08:43:32.841 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root 10r FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:32.841 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root 11w FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:32.841 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root 12u a_inode 0,14 0 1084 [eventpoll:13] 2023-11-05T08:43:32.842 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root 13r FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:32.842 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root 14w FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:32.842 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root 15w REG 8,1 465910012 276998 /var/log/ceph/ceph-osd.7.log 2023-11-05T08:43:32.842 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root 16uW REG 0,24 6 1974 /run/ceph/ceph-osd.7.pid 2023-11-05T08:43:32.843 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root 17r FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:32.843 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root 18w FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:32.843 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root 19u unix 0xffff8da307b0b300 0t0 187412 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-05T08:43:32.843 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root 20u IPv4 185761 0t0 TCP *:6802 (LISTEN) 2023-11-05T08:43:32.843 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root 21u IPv4 185765 0t0 TCP *:6803 (LISTEN) 2023-11-05T08:43:32.843 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root 22u IPv4 185770 0t0 TCP *:6804 (LISTEN) 2023-11-05T08:43:32.844 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root 23u IPv4 185776 0t0 TCP *:6805 (LISTEN) 2023-11-05T08:43:32.844 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root 24u IPv4 185783 0t0 TCP *:6806 (LISTEN) 2023-11-05T08:43:32.844 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root 25u IPv4 185791 0t0 TCP *:6807 (LISTEN) 2023-11-05T08:43:32.844 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root 26u IPv4 185800 0t0 TCP *:6808 (LISTEN) 2023-11-05T08:43:32.844 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root 27u IPv4 185810 0t0 TCP *:6809 (LISTEN) 2023-11-05T08:43:32.845 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root 28r FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:32.845 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root 29w FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:32.845 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root 30r FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:32.845 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root 31w FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:32.845 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root 32u sock 0,8 0t0 182041 protocol: UDPv6 2023-11-05T08:43:32.846 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-05T08:43:32.846 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-05T08:43:32.846 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.846 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.846 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.847 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.847 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.847 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.847 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.847 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.847 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.848 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.848 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.848 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.848 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.848 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.849 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.849 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.849 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.849 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.849 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.849 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.850 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.850 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.850 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.850 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.850 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root 60r FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:32.851 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root 61w FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:32.851 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root 62r FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:32.851 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root 63w FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:32.851 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root 66u IPv4 199302 0t0 TCP smithi156.front.sepia.ceph.com:56964->smithi156.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-05T08:43:32.851 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root 67u IPv4 199303 0t0 TCP smithi156.front.sepia.ceph.com:6802->smithi156.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-05T08:43:32.852 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:32.852 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root *525u REG 8,1 32 3087 /tmp/valgrind_proc_86246_cmdline_85358a06 (deleted) 2023-11-05T08:43:32.852 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root *526u REG 8,1 336 3088 /tmp/valgrind_proc_86246_auxv_85358a06 (deleted) 2023-11-05T08:43:32.852 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root *527w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:32.852 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root *528w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:32.852 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root *529r FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:32.853 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root *530w FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:32.853 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89410 ms_local root *531r FIFO 8,1 0t0 3091 /tmp/vgdb-pipe-from-vgdb-to-86246-by-root-on-??? 2023-11-05T08:43:32.853 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root cwd DIR 8,1 4096 265785 /home/ubuntu/cephtest 2023-11-05T08:43:32.853 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:32.853 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-05T08:43:32.854 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:32.854 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:32.854 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-05T08:43:32.854 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-05T08:43:32.854 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root mem REG 8,1 15752 265597 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-05T08:43:32.855 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-05T08:43:32.855 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-05T08:43:32.855 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-05T08:43:32.855 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-05T08:43:32.855 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-05T08:43:32.855 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-05T08:43:32.856 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:32.856 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-05T08:43:32.856 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-05T08:43:32.856 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:32.856 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-05T08:43:32.857 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-05T08:43:32.857 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-05T08:43:32.857 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-05T08:43:32.857 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-05T08:43:32.857 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-05T08:43:32.857 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:32.858 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:32.858 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:32.858 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-05T08:43:32.858 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-05T08:43:32.858 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-05T08:43:32.859 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-05T08:43:32.859 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-05T08:43:32.859 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-05T08:43:32.859 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-05T08:43:32.859 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-05T08:43:32.859 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-05T08:43:32.860 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-05T08:43:32.860 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-05T08:43:32.860 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-05T08:43:32.860 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-05T08:43:32.860 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-05T08:43:32.861 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-05T08:43:32.861 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-05T08:43:32.861 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-05T08:43:32.861 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-05T08:43:32.861 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-05T08:43:32.861 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-05T08:43:32.862 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-05T08:43:32.862 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:32.862 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-05T08:43:32.862 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:32.862 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-05T08:43:32.863 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-05T08:43:32.863 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-05T08:43:32.863 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-05T08:43:32.863 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-05T08:43:32.863 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root mem REG 8,1 83456 265542 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-05T08:43:32.863 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root mem REG 8,1 370416 265532 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-05T08:43:32.864 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root mem REG 8,1 1481856 265536 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-05T08:43:32.864 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root mem REG 8,1 45648 265517 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-05T08:43:32.864 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root mem REG 8,1 41304 265576 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-05T08:43:32.864 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root mem REG 8,1 49912 265561 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-05T08:43:32.864 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root mem REG 8,1 418096 265585 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-05T08:43:32.865 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root mem REG 8,1 83208 265579 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-05T08:43:32.865 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-05T08:43:32.865 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root mem REG 8,1 79224 265555 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-05T08:43:32.865 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root mem REG 8,1 49744 265609 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-05T08:43:32.865 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root mem REG 8,1 49856 265552 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-05T08:43:32.866 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root mem REG 8,1 83632 265549 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-05T08:43:32.866 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root mem REG 8,1 78744 265606 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-05T08:43:32.866 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root mem REG 8,1 53880 265603 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-05T08:43:32.866 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root mem REG 8,1 872944 265588 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-05T08:43:32.866 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root mem REG 8,1 116592 265558 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-05T08:43:32.866 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-05T08:43:32.867 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root mem REG 8,1 1242808 265591 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-05T08:43:32.867 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root mem REG 8,1 62224 265570 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-05T08:43:32.867 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root mem REG 8,1 95808 265564 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-05T08:43:32.867 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root mem REG 8,1 37272 265600 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-05T08:43:32.867 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root mem REG 8,1 104024 265582 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-05T08:43:32.868 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root mem REG 8,1 133480 265546 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-05T08:43:32.868 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root mem REG 8,1 834760 265573 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-05T08:43:32.868 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-05T08:43:32.868 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root mem REG 8,1 129280 265594 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-05T08:43:32.868 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root mem REG 8,1 83224 265567 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-05T08:43:32.868 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root mem REG 8,1 48 3081 /tmp/vgdb-pipe-shared-mem-vgdb-86246-by-root-on-??? 2023-11-05T08:43:32.869 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root DEL REG 0,17 182056 /[aio] 2023-11-05T08:43:32.869 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root DEL REG 0,17 182868 /[aio] 2023-11-05T08:43:32.869 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:32.869 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root 1w FIFO 0,13 0t0 182740 pipe 2023-11-05T08:43:32.869 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root 2w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:32.870 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root 3w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:32.870 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root 4r FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:32.870 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root 5w FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:32.870 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root 6u a_inode 0,14 0 1084 [eventpoll:7,20,21,22,23,24,25,26,27,66] 2023-11-05T08:43:32.870 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root 7r FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:32.870 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root 8w FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:32.871 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root 9u a_inode 0,14 0 1084 [eventpoll:10,67] 2023-11-05T08:43:32.871 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root 10r FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:32.871 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root 11w FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:32.871 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root 12u a_inode 0,14 0 1084 [eventpoll:13] 2023-11-05T08:43:32.871 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root 13r FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:32.872 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root 14w FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:32.872 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root 15w REG 8,1 465910012 276998 /var/log/ceph/ceph-osd.7.log 2023-11-05T08:43:32.872 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root 16uW REG 0,24 6 1974 /run/ceph/ceph-osd.7.pid 2023-11-05T08:43:32.872 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root 17r FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:32.872 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root 18w FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:32.872 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root 19u unix 0xffff8da307b0b300 0t0 187412 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-05T08:43:32.873 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root 20u IPv4 185761 0t0 TCP *:6802 (LISTEN) 2023-11-05T08:43:32.873 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root 21u IPv4 185765 0t0 TCP *:6803 (LISTEN) 2023-11-05T08:43:32.873 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root 22u IPv4 185770 0t0 TCP *:6804 (LISTEN) 2023-11-05T08:43:32.873 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root 23u IPv4 185776 0t0 TCP *:6805 (LISTEN) 2023-11-05T08:43:32.873 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root 24u IPv4 185783 0t0 TCP *:6806 (LISTEN) 2023-11-05T08:43:32.874 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root 25u IPv4 185791 0t0 TCP *:6807 (LISTEN) 2023-11-05T08:43:32.874 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root 26u IPv4 185800 0t0 TCP *:6808 (LISTEN) 2023-11-05T08:43:32.874 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root 27u IPv4 185810 0t0 TCP *:6809 (LISTEN) 2023-11-05T08:43:32.874 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root 28r FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:32.874 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root 29w FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:32.874 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root 30r FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:32.875 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root 31w FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:32.875 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root 32u sock 0,8 0t0 182041 protocol: UDPv6 2023-11-05T08:43:32.875 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-05T08:43:32.875 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-05T08:43:32.875 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.876 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.876 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.876 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.876 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.876 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.877 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.877 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.877 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.877 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.877 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.877 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.878 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.878 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.878 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.878 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.878 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.879 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.879 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.879 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.879 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.879 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.880 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.880 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.880 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root 60r FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:32.880 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root 61w FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:32.880 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root 62r FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:32.880 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root 63w FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:32.881 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root 66u IPv4 199302 0t0 TCP smithi156.front.sepia.ceph.com:56964->smithi156.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-05T08:43:32.881 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root 67u IPv4 199303 0t0 TCP smithi156.front.sepia.ceph.com:6802->smithi156.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-05T08:43:32.881 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:32.881 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root *525u REG 8,1 32 3087 /tmp/valgrind_proc_86246_cmdline_85358a06 (deleted) 2023-11-05T08:43:32.881 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root *526u REG 8,1 336 3088 /tmp/valgrind_proc_86246_auxv_85358a06 (deleted) 2023-11-05T08:43:32.882 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root *527w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:32.882 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root *528w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:32.882 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root *529r FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:32.882 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root *530w FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:32.882 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89413 ms_dispat root *531r FIFO 8,1 0t0 3091 /tmp/vgdb-pipe-from-vgdb-to-86246-by-root-on-??? 2023-11-05T08:43:32.882 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root cwd DIR 8,1 4096 265785 /home/ubuntu/cephtest 2023-11-05T08:43:32.883 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:32.883 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-05T08:43:32.883 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:32.883 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:32.883 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-05T08:43:32.884 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-05T08:43:32.884 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root mem REG 8,1 15752 265597 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-05T08:43:32.884 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-05T08:43:32.884 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-05T08:43:32.884 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-05T08:43:32.885 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-05T08:43:32.885 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-05T08:43:32.885 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-05T08:43:32.885 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:32.885 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-05T08:43:32.886 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-05T08:43:32.886 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:32.886 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-05T08:43:32.886 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-05T08:43:32.886 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-05T08:43:32.886 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-05T08:43:32.887 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-05T08:43:32.887 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-05T08:43:32.887 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:32.887 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:32.887 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:32.888 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-05T08:43:32.888 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-05T08:43:32.888 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-05T08:43:32.888 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-05T08:43:32.888 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-05T08:43:32.889 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-05T08:43:32.889 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-05T08:43:32.889 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-05T08:43:32.889 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-05T08:43:32.889 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-05T08:43:32.889 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-05T08:43:32.890 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-05T08:43:32.890 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-05T08:43:32.890 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-05T08:43:32.890 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-05T08:43:32.890 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-05T08:43:32.891 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-05T08:43:32.891 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-05T08:43:32.891 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-05T08:43:32.891 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-05T08:43:32.891 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-05T08:43:32.891 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:32.892 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-05T08:43:32.892 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:32.892 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-05T08:43:32.892 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-05T08:43:32.892 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-05T08:43:32.893 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-05T08:43:32.893 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-05T08:43:32.893 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root mem REG 8,1 83456 265542 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-05T08:43:32.893 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root mem REG 8,1 370416 265532 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-05T08:43:32.893 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root mem REG 8,1 1481856 265536 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-05T08:43:32.893 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root mem REG 8,1 45648 265517 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-05T08:43:32.894 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root mem REG 8,1 41304 265576 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-05T08:43:32.894 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root mem REG 8,1 49912 265561 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-05T08:43:32.894 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root mem REG 8,1 418096 265585 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-05T08:43:32.894 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root mem REG 8,1 83208 265579 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-05T08:43:32.894 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-05T08:43:32.895 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root mem REG 8,1 79224 265555 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-05T08:43:32.895 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root mem REG 8,1 49744 265609 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-05T08:43:32.895 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root mem REG 8,1 49856 265552 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-05T08:43:32.895 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root mem REG 8,1 83632 265549 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-05T08:43:32.895 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root mem REG 8,1 78744 265606 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-05T08:43:32.895 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root mem REG 8,1 53880 265603 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-05T08:43:32.896 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root mem REG 8,1 872944 265588 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-05T08:43:32.896 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root mem REG 8,1 116592 265558 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-05T08:43:32.896 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-05T08:43:32.896 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root mem REG 8,1 1242808 265591 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-05T08:43:32.896 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root mem REG 8,1 62224 265570 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-05T08:43:32.897 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root mem REG 8,1 95808 265564 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-05T08:43:32.897 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root mem REG 8,1 37272 265600 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-05T08:43:32.897 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root mem REG 8,1 104024 265582 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-05T08:43:32.897 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root mem REG 8,1 133480 265546 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-05T08:43:32.897 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root mem REG 8,1 834760 265573 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-05T08:43:32.897 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-05T08:43:32.898 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root mem REG 8,1 129280 265594 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-05T08:43:32.898 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root mem REG 8,1 83224 265567 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-05T08:43:32.898 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root mem REG 8,1 48 3081 /tmp/vgdb-pipe-shared-mem-vgdb-86246-by-root-on-??? 2023-11-05T08:43:32.898 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root DEL REG 0,17 182056 /[aio] 2023-11-05T08:43:32.898 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root DEL REG 0,17 182868 /[aio] 2023-11-05T08:43:32.899 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:32.899 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root 1w FIFO 0,13 0t0 182740 pipe 2023-11-05T08:43:32.899 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root 2w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:32.899 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root 3w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:32.899 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root 4r FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:32.900 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root 5w FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:32.900 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root 6u a_inode 0,14 0 1084 [eventpoll:7,20,21,22,23,24,25,26,27,66] 2023-11-05T08:43:32.900 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root 7r FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:32.900 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root 8w FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:32.900 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root 9u a_inode 0,14 0 1084 [eventpoll:10,67] 2023-11-05T08:43:32.901 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root 10r FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:32.901 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root 11w FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:32.901 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root 12u a_inode 0,14 0 1084 [eventpoll:13] 2023-11-05T08:43:32.901 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root 13r FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:32.901 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root 14w FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:32.901 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root 15w REG 8,1 465910012 276998 /var/log/ceph/ceph-osd.7.log 2023-11-05T08:43:32.902 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root 16uW REG 0,24 6 1974 /run/ceph/ceph-osd.7.pid 2023-11-05T08:43:32.902 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root 17r FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:32.902 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root 18w FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:32.902 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root 19u unix 0xffff8da307b0b300 0t0 187412 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-05T08:43:32.902 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root 20u IPv4 185761 0t0 TCP *:6802 (LISTEN) 2023-11-05T08:43:32.903 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root 21u IPv4 185765 0t0 TCP *:6803 (LISTEN) 2023-11-05T08:43:32.903 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root 22u IPv4 185770 0t0 TCP *:6804 (LISTEN) 2023-11-05T08:43:32.903 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root 23u IPv4 185776 0t0 TCP *:6805 (LISTEN) 2023-11-05T08:43:32.903 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root 24u IPv4 185783 0t0 TCP *:6806 (LISTEN) 2023-11-05T08:43:32.903 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root 25u IPv4 185791 0t0 TCP *:6807 (LISTEN) 2023-11-05T08:43:32.904 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root 26u IPv4 185800 0t0 TCP *:6808 (LISTEN) 2023-11-05T08:43:32.904 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root 27u IPv4 185810 0t0 TCP *:6809 (LISTEN) 2023-11-05T08:43:32.904 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root 28r FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:32.904 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root 29w FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:32.904 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root 30r FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:32.904 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root 31w FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:32.905 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root 32u sock 0,8 0t0 182041 protocol: UDPv6 2023-11-05T08:43:32.905 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-05T08:43:32.905 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-05T08:43:32.905 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.905 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.906 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.906 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.906 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.906 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.906 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.906 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.907 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.907 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.907 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.907 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.907 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.908 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.908 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.908 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.908 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.908 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.909 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.909 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.909 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.909 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.909 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.909 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.910 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root 60r FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:32.910 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root 61w FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:32.910 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root 62r FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:32.910 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root 63w FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:32.910 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root 66u IPv4 199302 0t0 TCP smithi156.front.sepia.ceph.com:56964->smithi156.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-05T08:43:32.911 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root 67u IPv4 199303 0t0 TCP smithi156.front.sepia.ceph.com:6802->smithi156.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-05T08:43:32.911 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:32.911 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root *525u REG 8,1 32 3087 /tmp/valgrind_proc_86246_cmdline_85358a06 (deleted) 2023-11-05T08:43:32.911 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root *526u REG 8,1 336 3088 /tmp/valgrind_proc_86246_auxv_85358a06 (deleted) 2023-11-05T08:43:32.911 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root *527w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:32.912 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root *528w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:32.912 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root *529r FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:32.912 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root *530w FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:32.912 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89414 ms_local root *531r FIFO 8,1 0t0 3091 /tmp/vgdb-pipe-from-vgdb-to-86246-by-root-on-??? 2023-11-05T08:43:32.912 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root cwd DIR 8,1 4096 265785 /home/ubuntu/cephtest 2023-11-05T08:43:32.912 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:32.913 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-05T08:43:32.913 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:32.913 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:32.913 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-05T08:43:32.913 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-05T08:43:32.914 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root mem REG 8,1 15752 265597 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-05T08:43:32.914 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-05T08:43:32.914 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-05T08:43:32.914 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-05T08:43:32.914 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-05T08:43:32.914 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-05T08:43:32.915 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-05T08:43:32.915 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:32.915 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-05T08:43:32.915 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-05T08:43:32.915 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:32.916 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-05T08:43:32.916 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-05T08:43:32.916 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-05T08:43:32.916 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-05T08:43:32.916 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-05T08:43:32.916 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-05T08:43:32.917 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:32.917 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:32.917 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:32.917 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-05T08:43:32.917 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-05T08:43:32.918 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-05T08:43:32.918 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-05T08:43:32.918 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-05T08:43:32.918 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-05T08:43:32.918 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-05T08:43:32.918 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-05T08:43:32.919 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-05T08:43:32.919 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-05T08:43:32.919 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-05T08:43:32.919 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-05T08:43:32.919 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-05T08:43:32.920 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-05T08:43:32.920 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-05T08:43:32.920 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-05T08:43:32.920 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-05T08:43:32.920 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-05T08:43:32.921 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-05T08:43:32.921 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-05T08:43:32.921 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-05T08:43:32.921 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:32.921 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-05T08:43:32.921 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:32.922 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-05T08:43:32.922 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-05T08:43:32.922 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-05T08:43:32.922 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-05T08:43:32.922 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-05T08:43:32.923 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root mem REG 8,1 83456 265542 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-05T08:43:32.923 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root mem REG 8,1 370416 265532 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-05T08:43:32.923 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root mem REG 8,1 1481856 265536 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-05T08:43:32.923 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root mem REG 8,1 45648 265517 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-05T08:43:32.923 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root mem REG 8,1 41304 265576 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-05T08:43:32.923 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root mem REG 8,1 49912 265561 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-05T08:43:32.924 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root mem REG 8,1 418096 265585 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-05T08:43:32.924 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root mem REG 8,1 83208 265579 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-05T08:43:32.924 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-05T08:43:32.924 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root mem REG 8,1 79224 265555 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-05T08:43:32.924 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root mem REG 8,1 49744 265609 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-05T08:43:32.925 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root mem REG 8,1 49856 265552 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-05T08:43:32.925 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root mem REG 8,1 83632 265549 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-05T08:43:32.925 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root mem REG 8,1 78744 265606 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-05T08:43:32.925 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root mem REG 8,1 53880 265603 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-05T08:43:32.925 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root mem REG 8,1 872944 265588 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-05T08:43:32.925 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root mem REG 8,1 116592 265558 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-05T08:43:32.926 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-05T08:43:32.926 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root mem REG 8,1 1242808 265591 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-05T08:43:32.926 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root mem REG 8,1 62224 265570 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-05T08:43:32.926 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root mem REG 8,1 95808 265564 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-05T08:43:32.926 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root mem REG 8,1 37272 265600 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-05T08:43:32.927 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root mem REG 8,1 104024 265582 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-05T08:43:32.927 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root mem REG 8,1 133480 265546 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-05T08:43:32.927 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root mem REG 8,1 834760 265573 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-05T08:43:32.927 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-05T08:43:32.927 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root mem REG 8,1 129280 265594 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-05T08:43:32.927 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root mem REG 8,1 83224 265567 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-05T08:43:32.928 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root mem REG 8,1 48 3081 /tmp/vgdb-pipe-shared-mem-vgdb-86246-by-root-on-??? 2023-11-05T08:43:32.928 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root DEL REG 0,17 182056 /[aio] 2023-11-05T08:43:32.928 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root DEL REG 0,17 182868 /[aio] 2023-11-05T08:43:32.928 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:32.928 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root 1w FIFO 0,13 0t0 182740 pipe 2023-11-05T08:43:32.929 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root 2w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:32.929 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root 3w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:32.929 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root 4r FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:32.929 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root 5w FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:32.929 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root 6u a_inode 0,14 0 1084 [eventpoll:7,20,21,22,23,24,25,26,27,66] 2023-11-05T08:43:32.929 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root 7r FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:32.930 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root 8w FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:32.930 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root 9u a_inode 0,14 0 1084 [eventpoll:10,67] 2023-11-05T08:43:32.930 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root 10r FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:32.930 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root 11w FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:32.930 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root 12u a_inode 0,14 0 1084 [eventpoll:13] 2023-11-05T08:43:32.931 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root 13r FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:32.931 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root 14w FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:32.931 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root 15w REG 8,1 465910012 276998 /var/log/ceph/ceph-osd.7.log 2023-11-05T08:43:32.931 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root 16uW REG 0,24 6 1974 /run/ceph/ceph-osd.7.pid 2023-11-05T08:43:32.931 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root 17r FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:32.931 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root 18w FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:32.932 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root 19u unix 0xffff8da307b0b300 0t0 187412 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-05T08:43:32.932 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root 20u IPv4 185761 0t0 TCP *:6802 (LISTEN) 2023-11-05T08:43:32.932 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root 21u IPv4 185765 0t0 TCP *:6803 (LISTEN) 2023-11-05T08:43:32.932 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root 22u IPv4 185770 0t0 TCP *:6804 (LISTEN) 2023-11-05T08:43:32.932 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root 23u IPv4 185776 0t0 TCP *:6805 (LISTEN) 2023-11-05T08:43:32.933 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root 24u IPv4 185783 0t0 TCP *:6806 (LISTEN) 2023-11-05T08:43:32.933 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root 25u IPv4 185791 0t0 TCP *:6807 (LISTEN) 2023-11-05T08:43:32.933 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root 26u IPv4 185800 0t0 TCP *:6808 (LISTEN) 2023-11-05T08:43:32.933 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root 27u IPv4 185810 0t0 TCP *:6809 (LISTEN) 2023-11-05T08:43:32.933 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root 28r FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:32.934 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root 29w FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:32.934 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root 30r FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:32.934 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root 31w FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:32.934 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root 32u sock 0,8 0t0 182041 protocol: UDPv6 2023-11-05T08:43:32.934 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-05T08:43:32.935 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-05T08:43:32.935 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.935 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.935 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.935 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.935 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.936 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.936 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.936 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.936 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.936 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.937 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.937 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.937 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.937 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.937 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.937 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.938 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.938 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.938 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.938 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.938 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.939 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.939 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.939 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.939 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root 60r FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:32.939 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root 61w FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:32.939 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root 62r FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:32.940 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root 63w FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:32.940 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root 66u IPv4 199302 0t0 TCP smithi156.front.sepia.ceph.com:56964->smithi156.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-05T08:43:32.940 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root 67u IPv4 199303 0t0 TCP smithi156.front.sepia.ceph.com:6802->smithi156.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-05T08:43:32.940 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:32.940 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root *525u REG 8,1 32 3087 /tmp/valgrind_proc_86246_cmdline_85358a06 (deleted) 2023-11-05T08:43:32.941 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root *526u REG 8,1 336 3088 /tmp/valgrind_proc_86246_auxv_85358a06 (deleted) 2023-11-05T08:43:32.941 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root *527w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:32.941 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root *528w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:32.941 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root *529r FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:32.941 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root *530w FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:32.942 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89418 ms_dispat root *531r FIFO 8,1 0t0 3091 /tmp/vgdb-pipe-from-vgdb-to-86246-by-root-on-??? 2023-11-05T08:43:32.942 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root cwd DIR 8,1 4096 265785 /home/ubuntu/cephtest 2023-11-05T08:43:32.942 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:32.942 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-05T08:43:32.942 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:32.942 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:32.943 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-05T08:43:32.943 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-05T08:43:32.943 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root mem REG 8,1 15752 265597 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-05T08:43:32.943 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-05T08:43:32.943 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-05T08:43:32.944 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-05T08:43:32.944 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-05T08:43:32.944 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-05T08:43:32.944 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-05T08:43:32.944 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:32.944 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-05T08:43:32.945 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-05T08:43:32.945 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:32.945 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-05T08:43:32.945 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-05T08:43:32.945 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-05T08:43:32.946 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-05T08:43:32.946 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-05T08:43:32.946 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-05T08:43:32.946 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:32.946 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:32.947 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:32.947 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-05T08:43:32.947 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-05T08:43:32.947 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-05T08:43:32.947 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-05T08:43:32.947 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-05T08:43:32.948 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-05T08:43:32.948 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-05T08:43:32.948 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-05T08:43:32.948 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-05T08:43:32.948 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-05T08:43:32.949 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-05T08:43:32.949 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-05T08:43:32.949 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-05T08:43:32.949 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-05T08:43:32.949 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-05T08:43:32.949 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-05T08:43:32.950 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-05T08:43:32.950 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-05T08:43:32.950 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-05T08:43:32.950 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-05T08:43:32.950 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-05T08:43:32.951 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:32.951 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-05T08:43:32.951 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:32.951 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-05T08:43:32.951 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-05T08:43:32.951 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-05T08:43:32.952 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-05T08:43:32.952 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-05T08:43:32.952 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root mem REG 8,1 83456 265542 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-05T08:43:32.952 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root mem REG 8,1 370416 265532 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-05T08:43:32.952 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root mem REG 8,1 1481856 265536 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-05T08:43:32.953 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root mem REG 8,1 45648 265517 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-05T08:43:32.953 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root mem REG 8,1 41304 265576 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-05T08:43:32.953 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root mem REG 8,1 49912 265561 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-05T08:43:32.953 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root mem REG 8,1 418096 265585 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-05T08:43:32.953 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root mem REG 8,1 83208 265579 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-05T08:43:32.953 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-05T08:43:32.954 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root mem REG 8,1 79224 265555 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-05T08:43:32.954 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root mem REG 8,1 49744 265609 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-05T08:43:32.954 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root mem REG 8,1 49856 265552 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-05T08:43:32.954 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root mem REG 8,1 83632 265549 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-05T08:43:32.954 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root mem REG 8,1 78744 265606 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-05T08:43:32.955 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root mem REG 8,1 53880 265603 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-05T08:43:32.955 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root mem REG 8,1 872944 265588 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-05T08:43:32.955 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root mem REG 8,1 116592 265558 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-05T08:43:32.955 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-05T08:43:32.955 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root mem REG 8,1 1242808 265591 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-05T08:43:32.956 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root mem REG 8,1 62224 265570 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-05T08:43:32.956 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root mem REG 8,1 95808 265564 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-05T08:43:32.956 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root mem REG 8,1 37272 265600 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-05T08:43:32.956 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root mem REG 8,1 104024 265582 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-05T08:43:32.956 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root mem REG 8,1 133480 265546 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-05T08:43:32.957 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root mem REG 8,1 834760 265573 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-05T08:43:32.957 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-05T08:43:32.957 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root mem REG 8,1 129280 265594 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-05T08:43:32.957 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root mem REG 8,1 83224 265567 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-05T08:43:32.957 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root mem REG 8,1 48 3081 /tmp/vgdb-pipe-shared-mem-vgdb-86246-by-root-on-??? 2023-11-05T08:43:32.958 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root DEL REG 0,17 182056 /[aio] 2023-11-05T08:43:32.958 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root DEL REG 0,17 182868 /[aio] 2023-11-05T08:43:32.958 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:32.958 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root 1w FIFO 0,13 0t0 182740 pipe 2023-11-05T08:43:32.958 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root 2w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:32.958 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root 3w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:32.959 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root 4r FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:32.959 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root 5w FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:32.959 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root 6u a_inode 0,14 0 1084 [eventpoll:7,20,21,22,23,24,25,26,27,66] 2023-11-05T08:43:32.959 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root 7r FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:32.959 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root 8w FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:32.960 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root 9u a_inode 0,14 0 1084 [eventpoll:10,67] 2023-11-05T08:43:32.960 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root 10r FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:32.960 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root 11w FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:32.960 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root 12u a_inode 0,14 0 1084 [eventpoll:13] 2023-11-05T08:43:32.960 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root 13r FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:32.961 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root 14w FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:32.961 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root 15w REG 8,1 465910012 276998 /var/log/ceph/ceph-osd.7.log 2023-11-05T08:43:32.961 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root 16uW REG 0,24 6 1974 /run/ceph/ceph-osd.7.pid 2023-11-05T08:43:32.961 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root 17r FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:32.961 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root 18w FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:32.962 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root 19u unix 0xffff8da307b0b300 0t0 187412 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-05T08:43:32.962 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root 20u IPv4 185761 0t0 TCP *:6802 (LISTEN) 2023-11-05T08:43:32.962 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root 21u IPv4 185765 0t0 TCP *:6803 (LISTEN) 2023-11-05T08:43:32.962 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root 22u IPv4 185770 0t0 TCP *:6804 (LISTEN) 2023-11-05T08:43:32.962 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root 23u IPv4 185776 0t0 TCP *:6805 (LISTEN) 2023-11-05T08:43:32.963 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root 24u IPv4 185783 0t0 TCP *:6806 (LISTEN) 2023-11-05T08:43:32.963 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root 25u IPv4 185791 0t0 TCP *:6807 (LISTEN) 2023-11-05T08:43:32.963 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root 26u IPv4 185800 0t0 TCP *:6808 (LISTEN) 2023-11-05T08:43:32.963 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root 27u IPv4 185810 0t0 TCP *:6809 (LISTEN) 2023-11-05T08:43:32.963 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root 28r FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:32.963 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root 29w FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:32.964 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root 30r FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:32.964 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root 31w FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:32.964 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root 32u sock 0,8 0t0 182041 protocol: UDPv6 2023-11-05T08:43:32.964 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-05T08:43:32.964 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-05T08:43:32.965 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.965 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.965 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.965 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.965 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.965 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.966 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.966 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.966 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.966 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.966 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.967 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.967 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.967 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.967 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.967 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.968 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.968 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.968 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.968 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.968 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.969 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.969 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.969 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.969 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root 60r FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:32.969 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root 61w FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:32.969 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root 62r FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:32.970 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root 63w FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:32.970 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root 66u IPv4 199302 0t0 TCP smithi156.front.sepia.ceph.com:56964->smithi156.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-05T08:43:32.970 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root 67u IPv4 199303 0t0 TCP smithi156.front.sepia.ceph.com:6802->smithi156.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-05T08:43:32.970 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:32.970 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root *525u REG 8,1 32 3087 /tmp/valgrind_proc_86246_cmdline_85358a06 (deleted) 2023-11-05T08:43:32.971 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root *526u REG 8,1 336 3088 /tmp/valgrind_proc_86246_auxv_85358a06 (deleted) 2023-11-05T08:43:32.971 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root *527w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:32.971 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root *528w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:32.971 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root *529r FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:32.971 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root *530w FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:32.972 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89421 ms_local root *531r FIFO 8,1 0t0 3091 /tmp/vgdb-pipe-from-vgdb-to-86246-by-root-on-??? 2023-11-05T08:43:32.972 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root cwd DIR 8,1 4096 265785 /home/ubuntu/cephtest 2023-11-05T08:43:32.972 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:32.972 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-05T08:43:32.972 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:32.972 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:32.973 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-05T08:43:32.973 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-05T08:43:32.973 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root mem REG 8,1 15752 265597 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-05T08:43:32.973 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-05T08:43:32.973 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-05T08:43:32.974 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-05T08:43:32.974 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-05T08:43:32.974 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-05T08:43:32.974 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-05T08:43:32.974 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:32.974 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-05T08:43:32.975 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-05T08:43:32.975 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:32.975 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-05T08:43:32.975 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-05T08:43:32.975 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-05T08:43:32.976 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-05T08:43:32.976 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-05T08:43:32.976 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-05T08:43:32.976 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:32.976 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:32.976 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:32.977 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-05T08:43:32.977 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-05T08:43:32.977 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-05T08:43:32.977 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-05T08:43:32.977 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-05T08:43:32.978 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-05T08:43:32.978 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-05T08:43:32.978 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-05T08:43:32.978 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-05T08:43:32.978 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-05T08:43:32.978 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-05T08:43:32.979 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-05T08:43:32.979 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-05T08:43:32.979 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-05T08:43:32.979 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-05T08:43:32.979 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-05T08:43:32.980 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-05T08:43:32.980 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-05T08:43:32.980 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-05T08:43:32.980 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-05T08:43:32.980 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-05T08:43:32.981 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:32.981 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-05T08:43:32.981 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:32.981 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-05T08:43:32.981 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-05T08:43:32.981 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-05T08:43:32.982 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-05T08:43:32.982 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-05T08:43:32.982 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root mem REG 8,1 83456 265542 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-05T08:43:32.982 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root mem REG 8,1 370416 265532 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-05T08:43:32.982 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root mem REG 8,1 1481856 265536 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-05T08:43:32.983 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root mem REG 8,1 45648 265517 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-05T08:43:32.983 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root mem REG 8,1 41304 265576 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-05T08:43:32.983 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root mem REG 8,1 49912 265561 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-05T08:43:32.983 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root mem REG 8,1 418096 265585 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-05T08:43:32.983 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root mem REG 8,1 83208 265579 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-05T08:43:32.983 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-05T08:43:32.984 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root mem REG 8,1 79224 265555 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-05T08:43:32.984 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root mem REG 8,1 49744 265609 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-05T08:43:32.984 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root mem REG 8,1 49856 265552 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-05T08:43:32.984 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root mem REG 8,1 83632 265549 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-05T08:43:32.984 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root mem REG 8,1 78744 265606 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-05T08:43:32.985 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root mem REG 8,1 53880 265603 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-05T08:43:32.985 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root mem REG 8,1 872944 265588 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-05T08:43:32.985 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root mem REG 8,1 116592 265558 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-05T08:43:32.985 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-05T08:43:32.985 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root mem REG 8,1 1242808 265591 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-05T08:43:32.985 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root mem REG 8,1 62224 265570 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-05T08:43:32.986 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root mem REG 8,1 95808 265564 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-05T08:43:32.986 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root mem REG 8,1 37272 265600 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-05T08:43:32.986 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root mem REG 8,1 104024 265582 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-05T08:43:32.986 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root mem REG 8,1 133480 265546 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-05T08:43:32.986 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root mem REG 8,1 834760 265573 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-05T08:43:32.987 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-05T08:43:32.987 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root mem REG 8,1 129280 265594 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-05T08:43:32.987 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root mem REG 8,1 83224 265567 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-05T08:43:32.987 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root mem REG 8,1 48 3081 /tmp/vgdb-pipe-shared-mem-vgdb-86246-by-root-on-??? 2023-11-05T08:43:32.987 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root DEL REG 0,17 182056 /[aio] 2023-11-05T08:43:32.987 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root DEL REG 0,17 182868 /[aio] 2023-11-05T08:43:32.988 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:32.988 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root 1w FIFO 0,13 0t0 182740 pipe 2023-11-05T08:43:32.988 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root 2w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:32.988 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root 3w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:32.988 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root 4r FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:32.989 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root 5w FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:32.989 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root 6u a_inode 0,14 0 1084 [eventpoll:7,20,21,22,23,24,25,26,27,66] 2023-11-05T08:43:32.989 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root 7r FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:32.989 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root 8w FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:32.989 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root 9u a_inode 0,14 0 1084 [eventpoll:10,67] 2023-11-05T08:43:32.989 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root 10r FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:32.990 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root 11w FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:32.990 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root 12u a_inode 0,14 0 1084 [eventpoll:13] 2023-11-05T08:43:32.990 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root 13r FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:32.990 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root 14w FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:32.990 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root 15w REG 8,1 465910012 276998 /var/log/ceph/ceph-osd.7.log 2023-11-05T08:43:32.991 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root 16uW REG 0,24 6 1974 /run/ceph/ceph-osd.7.pid 2023-11-05T08:43:32.991 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root 17r FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:32.991 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root 18w FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:32.991 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root 19u unix 0xffff8da307b0b300 0t0 187412 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-05T08:43:32.991 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root 20u IPv4 185761 0t0 TCP *:6802 (LISTEN) 2023-11-05T08:43:32.992 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root 21u IPv4 185765 0t0 TCP *:6803 (LISTEN) 2023-11-05T08:43:32.992 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root 22u IPv4 185770 0t0 TCP *:6804 (LISTEN) 2023-11-05T08:43:32.992 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root 23u IPv4 185776 0t0 TCP *:6805 (LISTEN) 2023-11-05T08:43:32.992 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root 24u IPv4 185783 0t0 TCP *:6806 (LISTEN) 2023-11-05T08:43:32.992 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root 25u IPv4 185791 0t0 TCP *:6807 (LISTEN) 2023-11-05T08:43:32.992 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root 26u IPv4 185800 0t0 TCP *:6808 (LISTEN) 2023-11-05T08:43:32.993 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root 27u IPv4 185810 0t0 TCP *:6809 (LISTEN) 2023-11-05T08:43:32.993 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root 28r FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:32.993 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root 29w FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:32.993 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root 30r FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:32.993 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root 31w FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:32.994 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root 32u sock 0,8 0t0 182041 protocol: UDPv6 2023-11-05T08:43:32.994 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-05T08:43:32.994 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-05T08:43:32.994 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.994 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.994 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.995 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.995 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.995 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.995 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.995 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.996 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.996 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.996 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.996 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.996 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.996 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.997 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.997 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.997 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.997 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.997 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.998 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.998 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.998 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.998 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.998 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:32.998 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root 60r FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:32.999 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root 61w FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:32.999 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root 62r FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:32.999 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root 63w FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:32.999 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root 66u IPv4 199302 0t0 TCP smithi156.front.sepia.ceph.com:56964->smithi156.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-05T08:43:32.999 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root 67u IPv4 199303 0t0 TCP smithi156.front.sepia.ceph.com:6802->smithi156.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-05T08:43:33.000 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:33.000 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root *525u REG 8,1 32 3087 /tmp/valgrind_proc_86246_cmdline_85358a06 (deleted) 2023-11-05T08:43:33.000 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root *526u REG 8,1 336 3088 /tmp/valgrind_proc_86246_auxv_85358a06 (deleted) 2023-11-05T08:43:33.000 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root *527w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:33.000 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root *528w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:33.000 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root *529r FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:33.001 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root *530w FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:33.001 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89425 ms_dispat root *531r FIFO 8,1 0t0 3091 /tmp/vgdb-pipe-from-vgdb-to-86246-by-root-on-??? 2023-11-05T08:43:33.001 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root cwd DIR 8,1 4096 265785 /home/ubuntu/cephtest 2023-11-05T08:43:33.001 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:33.001 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-05T08:43:33.002 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:33.002 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:33.002 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-05T08:43:33.002 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-05T08:43:33.002 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root mem REG 8,1 15752 265597 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-05T08:43:33.003 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-05T08:43:33.003 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-05T08:43:33.003 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-05T08:43:33.003 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-05T08:43:33.003 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-05T08:43:33.003 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-05T08:43:33.004 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:33.004 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-05T08:43:33.004 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-05T08:43:33.004 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:33.004 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-05T08:43:33.005 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-05T08:43:33.005 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-05T08:43:33.005 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-05T08:43:33.005 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-05T08:43:33.005 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-05T08:43:33.005 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:33.006 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:33.006 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:33.006 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-05T08:43:33.006 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-05T08:43:33.006 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-05T08:43:33.007 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-05T08:43:33.007 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-05T08:43:33.007 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-05T08:43:33.007 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-05T08:43:33.007 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-05T08:43:33.008 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-05T08:43:33.008 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-05T08:43:33.008 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-05T08:43:33.008 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-05T08:43:33.008 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-05T08:43:33.008 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-05T08:43:33.009 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-05T08:43:33.009 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-05T08:43:33.009 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-05T08:43:33.009 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-05T08:43:33.009 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-05T08:43:33.010 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-05T08:43:33.010 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-05T08:43:33.010 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:33.010 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-05T08:43:33.010 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:33.010 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-05T08:43:33.011 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-05T08:43:33.011 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-05T08:43:33.011 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-05T08:43:33.011 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-05T08:43:33.011 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root mem REG 8,1 83456 265542 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-05T08:43:33.012 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root mem REG 8,1 370416 265532 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-05T08:43:33.012 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root mem REG 8,1 1481856 265536 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-05T08:43:33.012 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root mem REG 8,1 45648 265517 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-05T08:43:33.012 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root mem REG 8,1 41304 265576 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-05T08:43:33.012 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root mem REG 8,1 49912 265561 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-05T08:43:33.012 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root mem REG 8,1 418096 265585 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-05T08:43:33.013 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root mem REG 8,1 83208 265579 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-05T08:43:33.013 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-05T08:43:33.013 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root mem REG 8,1 79224 265555 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-05T08:43:33.013 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root mem REG 8,1 49744 265609 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-05T08:43:33.013 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root mem REG 8,1 49856 265552 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-05T08:43:33.014 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root mem REG 8,1 83632 265549 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-05T08:43:33.014 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root mem REG 8,1 78744 265606 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-05T08:43:33.014 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root mem REG 8,1 53880 265603 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-05T08:43:33.014 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root mem REG 8,1 872944 265588 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-05T08:43:33.014 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root mem REG 8,1 116592 265558 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-05T08:43:33.015 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-05T08:43:33.015 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root mem REG 8,1 1242808 265591 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-05T08:43:33.015 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root mem REG 8,1 62224 265570 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-05T08:43:33.015 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root mem REG 8,1 95808 265564 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-05T08:43:33.015 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root mem REG 8,1 37272 265600 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-05T08:43:33.015 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root mem REG 8,1 104024 265582 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-05T08:43:33.016 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root mem REG 8,1 133480 265546 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-05T08:43:33.016 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root mem REG 8,1 834760 265573 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-05T08:43:33.016 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-05T08:43:33.016 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root mem REG 8,1 129280 265594 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-05T08:43:33.016 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root mem REG 8,1 83224 265567 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-05T08:43:33.017 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root mem REG 8,1 48 3081 /tmp/vgdb-pipe-shared-mem-vgdb-86246-by-root-on-??? 2023-11-05T08:43:33.017 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root DEL REG 0,17 182056 /[aio] 2023-11-05T08:43:33.017 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root DEL REG 0,17 182868 /[aio] 2023-11-05T08:43:33.017 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:33.017 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root 1w FIFO 0,13 0t0 182740 pipe 2023-11-05T08:43:33.017 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root 2w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:33.018 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root 3w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:33.018 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root 4r FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:33.018 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root 5w FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:33.018 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root 6u a_inode 0,14 0 1084 [eventpoll:7,20,21,22,23,24,25,26,27,66] 2023-11-05T08:43:33.018 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root 7r FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:33.019 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root 8w FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:33.019 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root 9u a_inode 0,14 0 1084 [eventpoll:10,67] 2023-11-05T08:43:33.019 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root 10r FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:33.019 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root 11w FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:33.019 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root 12u a_inode 0,14 0 1084 [eventpoll:13] 2023-11-05T08:43:33.019 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root 13r FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:33.020 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root 14w FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:33.020 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root 15w REG 8,1 465910012 276998 /var/log/ceph/ceph-osd.7.log 2023-11-05T08:43:33.020 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root 16uW REG 0,24 6 1974 /run/ceph/ceph-osd.7.pid 2023-11-05T08:43:33.020 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root 17r FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:33.020 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root 18w FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:33.021 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root 19u unix 0xffff8da307b0b300 0t0 187412 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-05T08:43:33.021 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root 20u IPv4 185761 0t0 TCP *:6802 (LISTEN) 2023-11-05T08:43:33.021 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root 21u IPv4 185765 0t0 TCP *:6803 (LISTEN) 2023-11-05T08:43:33.021 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root 22u IPv4 185770 0t0 TCP *:6804 (LISTEN) 2023-11-05T08:43:33.021 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root 23u IPv4 185776 0t0 TCP *:6805 (LISTEN) 2023-11-05T08:43:33.021 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root 24u IPv4 185783 0t0 TCP *:6806 (LISTEN) 2023-11-05T08:43:33.022 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root 25u IPv4 185791 0t0 TCP *:6807 (LISTEN) 2023-11-05T08:43:33.022 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root 26u IPv4 185800 0t0 TCP *:6808 (LISTEN) 2023-11-05T08:43:33.022 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root 27u IPv4 185810 0t0 TCP *:6809 (LISTEN) 2023-11-05T08:43:33.022 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root 28r FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:33.022 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root 29w FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:33.023 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root 30r FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:33.023 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root 31w FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:33.023 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root 32u sock 0,8 0t0 182041 protocol: UDPv6 2023-11-05T08:43:33.023 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-05T08:43:33.023 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-05T08:43:33.023 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.024 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.024 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.024 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.024 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.024 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.025 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.025 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.025 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.025 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.025 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.026 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.026 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.026 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.026 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.026 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.026 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.027 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.027 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.027 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.027 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.027 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.028 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.028 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.028 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root 60r FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:33.028 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root 61w FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:33.028 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root 62r FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:33.028 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root 63w FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:33.029 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root 66u IPv4 199302 0t0 TCP smithi156.front.sepia.ceph.com:56964->smithi156.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-05T08:43:33.029 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root 67u IPv4 199303 0t0 TCP smithi156.front.sepia.ceph.com:6802->smithi156.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-05T08:43:33.029 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:33.029 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root *525u REG 8,1 32 3087 /tmp/valgrind_proc_86246_cmdline_85358a06 (deleted) 2023-11-05T08:43:33.029 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root *526u REG 8,1 336 3088 /tmp/valgrind_proc_86246_auxv_85358a06 (deleted) 2023-11-05T08:43:33.030 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root *527w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:33.030 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root *528w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:33.030 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root *529r FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:33.030 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root *530w FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:33.030 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89430 ms_local root *531r FIFO 8,1 0t0 3091 /tmp/vgdb-pipe-from-vgdb-to-86246-by-root-on-??? 2023-11-05T08:43:33.031 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root cwd DIR 8,1 4096 265785 /home/ubuntu/cephtest 2023-11-05T08:43:33.031 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:33.031 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-05T08:43:33.031 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:33.031 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:33.031 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-05T08:43:33.032 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-05T08:43:33.032 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root mem REG 8,1 15752 265597 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-05T08:43:33.032 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-05T08:43:33.032 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-05T08:43:33.032 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-05T08:43:33.032 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-05T08:43:33.033 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-05T08:43:33.033 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-05T08:43:33.033 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:33.033 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-05T08:43:33.033 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-05T08:43:33.034 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:33.034 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-05T08:43:33.034 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-05T08:43:33.034 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-05T08:43:33.034 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-05T08:43:33.035 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-05T08:43:33.035 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-05T08:43:33.035 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:33.035 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:33.035 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:33.036 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-05T08:43:33.036 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-05T08:43:33.036 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-05T08:43:33.036 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-05T08:43:33.036 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-05T08:43:33.036 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-05T08:43:33.037 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-05T08:43:33.037 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-05T08:43:33.037 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-05T08:43:33.037 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-05T08:43:33.037 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-05T08:43:33.038 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-05T08:43:33.038 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-05T08:43:33.038 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-05T08:43:33.038 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-05T08:43:33.038 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-05T08:43:33.038 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-05T08:43:33.039 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-05T08:43:33.039 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-05T08:43:33.039 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-05T08:43:33.039 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-05T08:43:33.039 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:33.039 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-05T08:43:33.040 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:33.040 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-05T08:43:33.040 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-05T08:43:33.040 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-05T08:43:33.040 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-05T08:43:33.041 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-05T08:43:33.041 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root mem REG 8,1 83456 265542 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-05T08:43:33.041 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root mem REG 8,1 370416 265532 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-05T08:43:33.041 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root mem REG 8,1 1481856 265536 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-05T08:43:33.041 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root mem REG 8,1 45648 265517 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-05T08:43:33.041 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root mem REG 8,1 41304 265576 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-05T08:43:33.042 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root mem REG 8,1 49912 265561 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-05T08:43:33.042 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root mem REG 8,1 418096 265585 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-05T08:43:33.042 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root mem REG 8,1 83208 265579 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-05T08:43:33.042 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-05T08:43:33.042 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root mem REG 8,1 79224 265555 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-05T08:43:33.043 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root mem REG 8,1 49744 265609 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-05T08:43:33.043 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root mem REG 8,1 49856 265552 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-05T08:43:33.043 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root mem REG 8,1 83632 265549 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-05T08:43:33.043 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root mem REG 8,1 78744 265606 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-05T08:43:33.043 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root mem REG 8,1 53880 265603 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-05T08:43:33.044 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root mem REG 8,1 872944 265588 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-05T08:43:33.044 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root mem REG 8,1 116592 265558 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-05T08:43:33.044 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-05T08:43:33.044 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root mem REG 8,1 1242808 265591 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-05T08:43:33.044 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root mem REG 8,1 62224 265570 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-05T08:43:33.044 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root mem REG 8,1 95808 265564 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-05T08:43:33.045 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root mem REG 8,1 37272 265600 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-05T08:43:33.045 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root mem REG 8,1 104024 265582 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-05T08:43:33.045 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root mem REG 8,1 133480 265546 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-05T08:43:33.045 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root mem REG 8,1 834760 265573 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-05T08:43:33.045 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-05T08:43:33.045 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root mem REG 8,1 129280 265594 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-05T08:43:33.046 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root mem REG 8,1 83224 265567 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-05T08:43:33.046 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root mem REG 8,1 48 3081 /tmp/vgdb-pipe-shared-mem-vgdb-86246-by-root-on-??? 2023-11-05T08:43:33.046 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root DEL REG 0,17 182056 /[aio] 2023-11-05T08:43:33.046 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root DEL REG 0,17 182868 /[aio] 2023-11-05T08:43:33.047 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:33.047 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root 1w FIFO 0,13 0t0 182740 pipe 2023-11-05T08:43:33.047 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root 2w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:33.047 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root 3w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:33.047 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root 4r FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:33.047 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root 5w FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:33.048 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root 6u a_inode 0,14 0 1084 [eventpoll:7,20,21,22,23,24,25,26,27,66] 2023-11-05T08:43:33.048 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root 7r FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:33.048 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root 8w FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:33.048 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root 9u a_inode 0,14 0 1084 [eventpoll:10,67] 2023-11-05T08:43:33.048 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root 10r FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:33.049 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root 11w FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:33.049 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root 12u a_inode 0,14 0 1084 [eventpoll:13] 2023-11-05T08:43:33.049 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root 13r FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:33.049 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root 14w FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:33.049 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root 15w REG 8,1 465910012 276998 /var/log/ceph/ceph-osd.7.log 2023-11-05T08:43:33.050 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root 16uW REG 0,24 6 1974 /run/ceph/ceph-osd.7.pid 2023-11-05T08:43:33.050 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root 17r FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:33.050 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root 18w FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:33.050 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root 19u unix 0xffff8da307b0b300 0t0 187412 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-05T08:43:33.050 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root 20u IPv4 185761 0t0 TCP *:6802 (LISTEN) 2023-11-05T08:43:33.050 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root 21u IPv4 185765 0t0 TCP *:6803 (LISTEN) 2023-11-05T08:43:33.051 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root 22u IPv4 185770 0t0 TCP *:6804 (LISTEN) 2023-11-05T08:43:33.051 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root 23u IPv4 185776 0t0 TCP *:6805 (LISTEN) 2023-11-05T08:43:33.051 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root 24u IPv4 185783 0t0 TCP *:6806 (LISTEN) 2023-11-05T08:43:33.051 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root 25u IPv4 185791 0t0 TCP *:6807 (LISTEN) 2023-11-05T08:43:33.051 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root 26u IPv4 185800 0t0 TCP *:6808 (LISTEN) 2023-11-05T08:43:33.052 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root 27u IPv4 185810 0t0 TCP *:6809 (LISTEN) 2023-11-05T08:43:33.052 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root 28r FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:33.052 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root 29w FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:33.052 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root 30r FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:33.052 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root 31w FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:33.053 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root 32u sock 0,8 0t0 182041 protocol: UDPv6 2023-11-05T08:43:33.053 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-05T08:43:33.053 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-05T08:43:33.053 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.053 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.053 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.054 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.054 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.054 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.054 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.054 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.055 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.055 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.055 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.055 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.055 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.055 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.056 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.056 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.056 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.056 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.056 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.057 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.057 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.057 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.057 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.057 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.057 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root 60r FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:33.058 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root 61w FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:33.058 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root 62r FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:33.058 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root 63w FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:33.058 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root 66u IPv4 199302 0t0 TCP smithi156.front.sepia.ceph.com:56964->smithi156.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-05T08:43:33.059 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root 67u IPv4 199303 0t0 TCP smithi156.front.sepia.ceph.com:6802->smithi156.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-05T08:43:33.059 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:33.059 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root *525u REG 8,1 32 3087 /tmp/valgrind_proc_86246_cmdline_85358a06 (deleted) 2023-11-05T08:43:33.059 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root *526u REG 8,1 336 3088 /tmp/valgrind_proc_86246_auxv_85358a06 (deleted) 2023-11-05T08:43:33.059 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root *527w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:33.059 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root *528w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:33.060 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root *529r FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:33.060 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root *530w FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:33.060 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89434 ms_dispat root *531r FIFO 8,1 0t0 3091 /tmp/vgdb-pipe-from-vgdb-to-86246-by-root-on-??? 2023-11-05T08:43:33.060 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root cwd DIR 8,1 4096 265785 /home/ubuntu/cephtest 2023-11-05T08:43:33.060 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:33.061 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-05T08:43:33.061 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:33.061 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:33.061 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-05T08:43:33.061 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-05T08:43:33.061 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root mem REG 8,1 15752 265597 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-05T08:43:33.062 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-05T08:43:33.062 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-05T08:43:33.062 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-05T08:43:33.062 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-05T08:43:33.062 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-05T08:43:33.063 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-05T08:43:33.063 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:33.063 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-05T08:43:33.063 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-05T08:43:33.063 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:33.063 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-05T08:43:33.064 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-05T08:43:33.064 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-05T08:43:33.064 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-05T08:43:33.064 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-05T08:43:33.064 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-05T08:43:33.065 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:33.065 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:33.065 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:33.065 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-05T08:43:33.065 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-05T08:43:33.066 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-05T08:43:33.066 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-05T08:43:33.066 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-05T08:43:33.066 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-05T08:43:33.066 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-05T08:43:33.066 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-05T08:43:33.067 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-05T08:43:33.067 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-05T08:43:33.067 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-05T08:43:33.067 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-05T08:43:33.067 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-05T08:43:33.068 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-05T08:43:33.068 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-05T08:43:33.068 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-05T08:43:33.068 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-05T08:43:33.068 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-05T08:43:33.068 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-05T08:43:33.069 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-05T08:43:33.069 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-05T08:43:33.069 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:33.069 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-05T08:43:33.069 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:33.070 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-05T08:43:33.070 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-05T08:43:33.070 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-05T08:43:33.070 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-05T08:43:33.070 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-05T08:43:33.071 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root mem REG 8,1 83456 265542 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-05T08:43:33.071 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root mem REG 8,1 370416 265532 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-05T08:43:33.071 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root mem REG 8,1 1481856 265536 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-05T08:43:33.071 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root mem REG 8,1 45648 265517 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-05T08:43:33.071 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root mem REG 8,1 41304 265576 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-05T08:43:33.071 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root mem REG 8,1 49912 265561 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-05T08:43:33.072 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root mem REG 8,1 418096 265585 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-05T08:43:33.072 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root mem REG 8,1 83208 265579 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-05T08:43:33.072 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-05T08:43:33.072 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root mem REG 8,1 79224 265555 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-05T08:43:33.072 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root mem REG 8,1 49744 265609 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-05T08:43:33.073 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root mem REG 8,1 49856 265552 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-05T08:43:33.073 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root mem REG 8,1 83632 265549 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-05T08:43:33.073 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root mem REG 8,1 78744 265606 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-05T08:43:33.073 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root mem REG 8,1 53880 265603 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-05T08:43:33.073 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root mem REG 8,1 872944 265588 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-05T08:43:33.073 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root mem REG 8,1 116592 265558 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-05T08:43:33.074 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-05T08:43:33.074 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root mem REG 8,1 1242808 265591 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-05T08:43:33.074 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root mem REG 8,1 62224 265570 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-05T08:43:33.074 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root mem REG 8,1 95808 265564 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-05T08:43:33.074 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root mem REG 8,1 37272 265600 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-05T08:43:33.075 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root mem REG 8,1 104024 265582 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-05T08:43:33.075 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root mem REG 8,1 133480 265546 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-05T08:43:33.075 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root mem REG 8,1 834760 265573 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-05T08:43:33.075 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-05T08:43:33.075 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root mem REG 8,1 129280 265594 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-05T08:43:33.075 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root mem REG 8,1 83224 265567 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-05T08:43:33.076 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root mem REG 8,1 48 3081 /tmp/vgdb-pipe-shared-mem-vgdb-86246-by-root-on-??? 2023-11-05T08:43:33.076 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root DEL REG 0,17 182056 /[aio] 2023-11-05T08:43:33.076 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root DEL REG 0,17 182868 /[aio] 2023-11-05T08:43:33.076 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:33.076 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root 1w FIFO 0,13 0t0 182740 pipe 2023-11-05T08:43:33.077 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root 2w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:33.077 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root 3w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:33.077 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root 4r FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:33.077 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root 5w FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:33.077 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root 6u a_inode 0,14 0 1084 [eventpoll:7,20,21,22,23,24,25,26,27,66] 2023-11-05T08:43:33.077 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root 7r FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:33.078 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root 8w FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:33.078 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root 9u a_inode 0,14 0 1084 [eventpoll:10,67] 2023-11-05T08:43:33.078 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root 10r FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:33.078 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root 11w FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:33.078 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root 12u a_inode 0,14 0 1084 [eventpoll:13] 2023-11-05T08:43:33.079 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root 13r FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:33.079 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root 14w FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:33.079 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root 15w REG 8,1 465910012 276998 /var/log/ceph/ceph-osd.7.log 2023-11-05T08:43:33.079 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root 16uW REG 0,24 6 1974 /run/ceph/ceph-osd.7.pid 2023-11-05T08:43:33.079 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root 17r FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:33.079 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root 18w FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:33.080 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root 19u unix 0xffff8da307b0b300 0t0 187412 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-05T08:43:33.080 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root 20u IPv4 185761 0t0 TCP *:6802 (LISTEN) 2023-11-05T08:43:33.080 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root 21u IPv4 185765 0t0 TCP *:6803 (LISTEN) 2023-11-05T08:43:33.080 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root 22u IPv4 185770 0t0 TCP *:6804 (LISTEN) 2023-11-05T08:43:33.080 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root 23u IPv4 185776 0t0 TCP *:6805 (LISTEN) 2023-11-05T08:43:33.081 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root 24u IPv4 185783 0t0 TCP *:6806 (LISTEN) 2023-11-05T08:43:33.081 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root 25u IPv4 185791 0t0 TCP *:6807 (LISTEN) 2023-11-05T08:43:33.081 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root 26u IPv4 185800 0t0 TCP *:6808 (LISTEN) 2023-11-05T08:43:33.081 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root 27u IPv4 185810 0t0 TCP *:6809 (LISTEN) 2023-11-05T08:43:33.081 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root 28r FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:33.082 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root 29w FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:33.082 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root 30r FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:33.082 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root 31w FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:33.082 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root 32u sock 0,8 0t0 182041 protocol: UDPv6 2023-11-05T08:43:33.082 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-05T08:43:33.082 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-05T08:43:33.083 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.083 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.083 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.083 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.083 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.084 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.084 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.084 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.084 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.084 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.084 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.085 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.085 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.085 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.085 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.085 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.086 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.086 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.086 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.086 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.086 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.086 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.087 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.087 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.087 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root 60r FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:33.087 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root 61w FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:33.087 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root 62r FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:33.088 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root 63w FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:33.088 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root 66u IPv4 199302 0t0 TCP smithi156.front.sepia.ceph.com:56964->smithi156.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-05T08:43:33.088 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root 67u IPv4 199303 0t0 TCP smithi156.front.sepia.ceph.com:6802->smithi156.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-05T08:43:33.088 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:33.088 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root *525u REG 8,1 32 3087 /tmp/valgrind_proc_86246_cmdline_85358a06 (deleted) 2023-11-05T08:43:33.088 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root *526u REG 8,1 336 3088 /tmp/valgrind_proc_86246_auxv_85358a06 (deleted) 2023-11-05T08:43:33.089 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root *527w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:33.089 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root *528w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:33.089 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root *529r FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:33.089 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root *530w FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:33.089 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89438 ms_local root *531r FIFO 8,1 0t0 3091 /tmp/vgdb-pipe-from-vgdb-to-86246-by-root-on-??? 2023-11-05T08:43:33.090 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root cwd DIR 8,1 4096 265785 /home/ubuntu/cephtest 2023-11-05T08:43:33.090 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:33.090 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-05T08:43:33.090 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:33.090 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:33.091 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-05T08:43:33.091 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-05T08:43:33.091 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root mem REG 8,1 15752 265597 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-05T08:43:33.091 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-05T08:43:33.091 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-05T08:43:33.091 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-05T08:43:33.092 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-05T08:43:33.092 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-05T08:43:33.092 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-05T08:43:33.092 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:33.093 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-05T08:43:33.093 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-05T08:43:33.093 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:33.093 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-05T08:43:33.093 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-05T08:43:33.093 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-05T08:43:33.094 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-05T08:43:33.094 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-05T08:43:33.094 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-05T08:43:33.094 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:33.094 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:33.095 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:33.095 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-05T08:43:33.095 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-05T08:43:33.095 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-05T08:43:33.095 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-05T08:43:33.096 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-05T08:43:33.096 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-05T08:43:33.096 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-05T08:43:33.096 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-05T08:43:33.096 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-05T08:43:33.096 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-05T08:43:33.097 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-05T08:43:33.097 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-05T08:43:33.097 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-05T08:43:33.097 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-05T08:43:33.097 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-05T08:43:33.098 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-05T08:43:33.098 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-05T08:43:33.098 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-05T08:43:33.098 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-05T08:43:33.098 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-05T08:43:33.098 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-05T08:43:33.099 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:33.099 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-05T08:43:33.099 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:33.099 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-05T08:43:33.099 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-05T08:43:33.100 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-05T08:43:33.100 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-05T08:43:33.100 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-05T08:43:33.100 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root mem REG 8,1 83456 265542 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-05T08:43:33.100 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root mem REG 8,1 370416 265532 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-05T08:43:33.100 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root mem REG 8,1 1481856 265536 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-05T08:43:33.101 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root mem REG 8,1 45648 265517 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-05T08:43:33.101 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root mem REG 8,1 41304 265576 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-05T08:43:33.101 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root mem REG 8,1 49912 265561 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-05T08:43:33.101 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root mem REG 8,1 418096 265585 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-05T08:43:33.101 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root mem REG 8,1 83208 265579 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-05T08:43:33.102 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-05T08:43:33.102 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root mem REG 8,1 79224 265555 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-05T08:43:33.102 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root mem REG 8,1 49744 265609 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-05T08:43:33.102 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root mem REG 8,1 49856 265552 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-05T08:43:33.102 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root mem REG 8,1 83632 265549 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-05T08:43:33.103 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root mem REG 8,1 78744 265606 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-05T08:43:33.103 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root mem REG 8,1 53880 265603 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-05T08:43:33.103 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root mem REG 8,1 872944 265588 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-05T08:43:33.103 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root mem REG 8,1 116592 265558 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-05T08:43:33.103 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-05T08:43:33.104 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root mem REG 8,1 1242808 265591 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-05T08:43:33.104 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root mem REG 8,1 62224 265570 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-05T08:43:33.104 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root mem REG 8,1 95808 265564 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-05T08:43:33.104 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root mem REG 8,1 37272 265600 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-05T08:43:33.104 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root mem REG 8,1 104024 265582 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-05T08:43:33.104 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root mem REG 8,1 133480 265546 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-05T08:43:33.105 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root mem REG 8,1 834760 265573 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-05T08:43:33.105 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-05T08:43:33.105 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root mem REG 8,1 129280 265594 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-05T08:43:33.105 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root mem REG 8,1 83224 265567 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-05T08:43:33.105 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root mem REG 8,1 48 3081 /tmp/vgdb-pipe-shared-mem-vgdb-86246-by-root-on-??? 2023-11-05T08:43:33.106 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root DEL REG 0,17 182056 /[aio] 2023-11-05T08:43:33.106 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root DEL REG 0,17 182868 /[aio] 2023-11-05T08:43:33.106 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root 0r CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:33.106 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root 1w FIFO 0,13 0t0 182740 pipe 2023-11-05T08:43:33.106 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root 2w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:33.107 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root 3w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:33.107 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root 4r FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:33.107 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root 5w FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:33.107 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root 6u a_inode 0,14 0 1084 [eventpoll:7,20,21,22,23,24,25,26,27,66] 2023-11-05T08:43:33.107 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root 7r FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:33.107 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root 8w FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:33.108 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root 9u a_inode 0,14 0 1084 [eventpoll:10,67] 2023-11-05T08:43:33.108 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root 10r FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:33.108 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root 11w FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:33.108 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root 12u a_inode 0,14 0 1084 [eventpoll:13] 2023-11-05T08:43:33.108 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root 13r FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:33.109 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root 14w FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:33.109 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root 15w REG 8,1 465910012 276998 /var/log/ceph/ceph-osd.7.log 2023-11-05T08:43:33.109 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root 16uW REG 0,24 6 1974 /run/ceph/ceph-osd.7.pid 2023-11-05T08:43:33.109 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root 17r FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:33.109 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root 18w FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:33.110 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root 19u unix 0xffff8da307b0b300 0t0 187412 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-05T08:43:33.110 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root 20u IPv4 185761 0t0 TCP *:6802 (LISTEN) 2023-11-05T08:43:33.110 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root 21u IPv4 185765 0t0 TCP *:6803 (LISTEN) 2023-11-05T08:43:33.110 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root 22u IPv4 185770 0t0 TCP *:6804 (LISTEN) 2023-11-05T08:43:33.110 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root 23u IPv4 185776 0t0 TCP *:6805 (LISTEN) 2023-11-05T08:43:33.110 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root 24u IPv4 185783 0t0 TCP *:6806 (LISTEN) 2023-11-05T08:43:33.111 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root 25u IPv4 185791 0t0 TCP *:6807 (LISTEN) 2023-11-05T08:43:33.111 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root 26u IPv4 185800 0t0 TCP *:6808 (LISTEN) 2023-11-05T08:43:33.111 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root 27u IPv4 185810 0t0 TCP *:6809 (LISTEN) 2023-11-05T08:43:33.111 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root 28r FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:33.111 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root 29w FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:33.112 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root 30r FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:33.112 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root 31w FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:33.112 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root 32u sock 0,8 0t0 182041 protocol: UDPv6 2023-11-05T08:43:33.112 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-05T08:43:33.112 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-05T08:43:33.113 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.113 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.113 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.113 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.113 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.113 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.114 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.114 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.114 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.114 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.114 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.115 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.115 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.115 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.115 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.115 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.116 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.116 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.116 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.116 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.116 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.116 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.117 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.117 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.117 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root 60r FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:33.117 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root 61w FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:33.117 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root 62r FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:33.118 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root 63w FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:33.118 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root 66u IPv4 199302 0t0 TCP smithi156.front.sepia.ceph.com:56964->smithi156.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-05T08:43:33.118 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root 67u IPv4 199303 0t0 TCP smithi156.front.sepia.ceph.com:6802->smithi156.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-05T08:43:33.118 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:33.118 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root *525u REG 8,1 32 3087 /tmp/valgrind_proc_86246_cmdline_85358a06 (deleted) 2023-11-05T08:43:33.119 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root *526u REG 8,1 336 3088 /tmp/valgrind_proc_86246_auxv_85358a06 (deleted) 2023-11-05T08:43:33.119 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root *527w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:33.119 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root *528w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:33.119 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root *529r FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:33.119 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root *530w FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:33.120 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89442 fn_anonym root *531r FIFO 8,1 0t0 3091 /tmp/vgdb-pipe-from-vgdb-to-86246-by-root-on-??? 2023-11-05T08:43:33.120 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root cwd DIR 8,1 4096 265785 /home/ubuntu/cephtest 2023-11-05T08:43:33.120 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:33.120 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-05T08:43:33.120 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:33.120 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:33.121 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-05T08:43:33.121 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-05T08:43:33.121 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root mem REG 8,1 15752 265597 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-05T08:43:33.121 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-05T08:43:33.121 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-05T08:43:33.122 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-05T08:43:33.122 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-05T08:43:33.122 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-05T08:43:33.122 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-05T08:43:33.122 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:33.122 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-05T08:43:33.123 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-05T08:43:33.123 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:33.123 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-05T08:43:33.123 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-05T08:43:33.123 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-05T08:43:33.124 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-05T08:43:33.124 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-05T08:43:33.124 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-05T08:43:33.124 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:33.124 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:33.124 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:33.125 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-05T08:43:33.125 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-05T08:43:33.125 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-05T08:43:33.125 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-05T08:43:33.125 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-05T08:43:33.125 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-05T08:43:33.126 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-05T08:43:33.126 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-05T08:43:33.126 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-05T08:43:33.126 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-05T08:43:33.126 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-05T08:43:33.127 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-05T08:43:33.127 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-05T08:43:33.127 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-05T08:43:33.127 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-05T08:43:33.127 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-05T08:43:33.128 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-05T08:43:33.128 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-05T08:43:33.128 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-05T08:43:33.128 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-05T08:43:33.128 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-05T08:43:33.129 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:33.129 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-05T08:43:33.129 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:33.129 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-05T08:43:33.129 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-05T08:43:33.129 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-05T08:43:33.130 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-05T08:43:33.130 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-05T08:43:33.130 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root mem REG 8,1 83456 265542 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-05T08:43:33.130 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root mem REG 8,1 370416 265532 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-05T08:43:33.130 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root mem REG 8,1 1481856 265536 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-05T08:43:33.131 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root mem REG 8,1 45648 265517 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-05T08:43:33.131 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root mem REG 8,1 41304 265576 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-05T08:43:33.131 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root mem REG 8,1 49912 265561 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-05T08:43:33.131 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root mem REG 8,1 418096 265585 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-05T08:43:33.131 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root mem REG 8,1 83208 265579 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-05T08:43:33.131 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-05T08:43:33.132 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root mem REG 8,1 79224 265555 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-05T08:43:33.132 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root mem REG 8,1 49744 265609 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-05T08:43:33.132 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root mem REG 8,1 49856 265552 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-05T08:43:33.132 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root mem REG 8,1 83632 265549 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-05T08:43:33.132 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root mem REG 8,1 78744 265606 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-05T08:43:33.133 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root mem REG 8,1 53880 265603 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-05T08:43:33.133 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root mem REG 8,1 872944 265588 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-05T08:43:33.133 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root mem REG 8,1 116592 265558 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-05T08:43:33.133 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-05T08:43:33.133 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root mem REG 8,1 1242808 265591 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-05T08:43:33.133 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root mem REG 8,1 62224 265570 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-05T08:43:33.134 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root mem REG 8,1 95808 265564 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-05T08:43:33.134 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root mem REG 8,1 37272 265600 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-05T08:43:33.134 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root mem REG 8,1 104024 265582 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-05T08:43:33.134 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root mem REG 8,1 133480 265546 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-05T08:43:33.134 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root mem REG 8,1 834760 265573 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-05T08:43:33.135 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-05T08:43:33.135 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root mem REG 8,1 129280 265594 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-05T08:43:33.135 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root mem REG 8,1 83224 265567 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-05T08:43:33.135 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root mem REG 8,1 48 3081 /tmp/vgdb-pipe-shared-mem-vgdb-86246-by-root-on-??? 2023-11-05T08:43:33.135 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root DEL REG 0,17 182056 /[aio] 2023-11-05T08:43:33.135 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root DEL REG 0,17 182868 /[aio] 2023-11-05T08:43:33.136 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root 0r CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:33.136 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root 1w FIFO 0,13 0t0 182740 pipe 2023-11-05T08:43:33.136 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root 2w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:33.136 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root 3w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:33.136 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root 4r FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:33.137 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root 5w FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:33.137 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root 6u a_inode 0,14 0 1084 [eventpoll:7,20,21,22,23,24,25,26,27,66] 2023-11-05T08:43:33.137 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root 7r FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:33.137 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root 8w FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:33.137 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root 9u a_inode 0,14 0 1084 [eventpoll:10,67] 2023-11-05T08:43:33.138 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root 10r FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:33.138 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root 11w FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:33.138 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root 12u a_inode 0,14 0 1084 [eventpoll:13] 2023-11-05T08:43:33.138 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root 13r FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:33.138 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root 14w FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:33.139 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root 15w REG 8,1 465910012 276998 /var/log/ceph/ceph-osd.7.log 2023-11-05T08:43:33.139 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root 16uW REG 0,24 6 1974 /run/ceph/ceph-osd.7.pid 2023-11-05T08:43:33.139 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root 17r FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:33.139 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root 18w FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:33.139 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root 19u unix 0xffff8da307b0b300 0t0 187412 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-05T08:43:33.139 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root 20u IPv4 185761 0t0 TCP *:6802 (LISTEN) 2023-11-05T08:43:33.140 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root 21u IPv4 185765 0t0 TCP *:6803 (LISTEN) 2023-11-05T08:43:33.140 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root 22u IPv4 185770 0t0 TCP *:6804 (LISTEN) 2023-11-05T08:43:33.140 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root 23u IPv4 185776 0t0 TCP *:6805 (LISTEN) 2023-11-05T08:43:33.140 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root 24u IPv4 185783 0t0 TCP *:6806 (LISTEN) 2023-11-05T08:43:33.140 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root 25u IPv4 185791 0t0 TCP *:6807 (LISTEN) 2023-11-05T08:43:33.141 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root 26u IPv4 185800 0t0 TCP *:6808 (LISTEN) 2023-11-05T08:43:33.141 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root 27u IPv4 185810 0t0 TCP *:6809 (LISTEN) 2023-11-05T08:43:33.141 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root 28r FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:33.141 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root 29w FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:33.141 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root 30r FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:33.141 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root 31w FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:33.142 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root 32u sock 0,8 0t0 182041 protocol: UDPv6 2023-11-05T08:43:33.142 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-05T08:43:33.142 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-05T08:43:33.142 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.142 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.143 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.143 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.143 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.143 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.143 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.143 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.144 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.144 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.144 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.144 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.144 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.145 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.145 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.145 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.145 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.145 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.145 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.146 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.146 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.146 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.146 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.146 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.147 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root 60r FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:33.147 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root 61w FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:33.147 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root 62r FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:33.147 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root 63w FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:33.147 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root 66u IPv4 199302 0t0 TCP smithi156.front.sepia.ceph.com:56964->smithi156.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-05T08:43:33.147 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root 67u IPv4 199303 0t0 TCP smithi156.front.sepia.ceph.com:6802->smithi156.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-05T08:43:33.148 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:33.148 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root *525u REG 8,1 32 3087 /tmp/valgrind_proc_86246_cmdline_85358a06 (deleted) 2023-11-05T08:43:33.148 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root *526u REG 8,1 336 3088 /tmp/valgrind_proc_86246_auxv_85358a06 (deleted) 2023-11-05T08:43:33.148 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root *527w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:33.148 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root *528w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:33.149 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root *529r FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:33.149 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root *530w FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:33.149 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89444 finisher root *531r FIFO 8,1 0t0 3091 /tmp/vgdb-pipe-from-vgdb-to-86246-by-root-on-??? 2023-11-05T08:43:33.149 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root cwd DIR 8,1 4096 265785 /home/ubuntu/cephtest 2023-11-05T08:43:33.149 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:33.150 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-05T08:43:33.150 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:33.150 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:33.150 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-05T08:43:33.150 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-05T08:43:33.150 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root mem REG 8,1 15752 265597 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-05T08:43:33.151 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-05T08:43:33.151 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-05T08:43:33.151 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-05T08:43:33.151 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-05T08:43:33.151 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-05T08:43:33.152 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-05T08:43:33.152 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:33.152 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-05T08:43:33.152 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-05T08:43:33.152 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:33.153 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-05T08:43:33.153 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-05T08:43:33.153 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-05T08:43:33.153 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-05T08:43:33.153 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-05T08:43:33.153 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-05T08:43:33.154 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:33.154 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:33.154 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:33.154 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-05T08:43:33.154 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-05T08:43:33.155 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-05T08:43:33.155 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-05T08:43:33.155 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-05T08:43:33.155 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-05T08:43:33.155 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-05T08:43:33.155 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-05T08:43:33.156 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-05T08:43:33.156 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-05T08:43:33.156 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-05T08:43:33.156 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-05T08:43:33.156 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-05T08:43:33.157 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-05T08:43:33.157 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-05T08:43:33.157 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-05T08:43:33.157 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-05T08:43:33.157 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-05T08:43:33.157 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-05T08:43:33.158 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-05T08:43:33.158 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-05T08:43:33.158 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:33.158 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-05T08:43:33.158 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:33.158 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-05T08:43:33.159 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-05T08:43:33.159 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-05T08:43:33.159 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-05T08:43:33.159 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-05T08:43:33.159 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root mem REG 8,1 83456 265542 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-05T08:43:33.160 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root mem REG 8,1 370416 265532 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-05T08:43:33.160 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root mem REG 8,1 1481856 265536 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-05T08:43:33.160 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root mem REG 8,1 45648 265517 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-05T08:43:33.160 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root mem REG 8,1 41304 265576 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-05T08:43:33.160 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root mem REG 8,1 49912 265561 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-05T08:43:33.161 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root mem REG 8,1 418096 265585 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-05T08:43:33.161 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root mem REG 8,1 83208 265579 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-05T08:43:33.161 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-05T08:43:33.161 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root mem REG 8,1 79224 265555 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-05T08:43:33.161 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root mem REG 8,1 49744 265609 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-05T08:43:33.161 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root mem REG 8,1 49856 265552 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-05T08:43:33.162 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root mem REG 8,1 83632 265549 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-05T08:43:33.162 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root mem REG 8,1 78744 265606 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-05T08:43:33.162 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root mem REG 8,1 53880 265603 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-05T08:43:33.162 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root mem REG 8,1 872944 265588 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-05T08:43:33.162 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root mem REG 8,1 116592 265558 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-05T08:43:33.163 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-05T08:43:33.163 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root mem REG 8,1 1242808 265591 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-05T08:43:33.163 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root mem REG 8,1 62224 265570 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-05T08:43:33.163 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root mem REG 8,1 95808 265564 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-05T08:43:33.163 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root mem REG 8,1 37272 265600 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-05T08:43:33.164 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root mem REG 8,1 104024 265582 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-05T08:43:33.164 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root mem REG 8,1 133480 265546 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-05T08:43:33.164 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root mem REG 8,1 834760 265573 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-05T08:43:33.164 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-05T08:43:33.164 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root mem REG 8,1 129280 265594 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-05T08:43:33.164 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root mem REG 8,1 83224 265567 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-05T08:43:33.165 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root mem REG 8,1 48 3081 /tmp/vgdb-pipe-shared-mem-vgdb-86246-by-root-on-??? 2023-11-05T08:43:33.165 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root DEL REG 0,17 182056 /[aio] 2023-11-05T08:43:33.165 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root DEL REG 0,17 182868 /[aio] 2023-11-05T08:43:33.165 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:33.165 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root 1w FIFO 0,13 0t0 182740 pipe 2023-11-05T08:43:33.165 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root 2w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:33.166 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root 3w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:33.166 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root 4r FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:33.166 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root 5w FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:33.166 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root 6u a_inode 0,14 0 1084 [eventpoll:7,20,21,22,23,24,25,26,27,66] 2023-11-05T08:43:33.166 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root 7r FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:33.167 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root 8w FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:33.167 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root 9u a_inode 0,14 0 1084 [eventpoll:10,67] 2023-11-05T08:43:33.167 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root 10r FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:33.167 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root 11w FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:33.167 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root 12u a_inode 0,14 0 1084 [eventpoll:13] 2023-11-05T08:43:33.168 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root 13r FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:33.168 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root 14w FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:33.168 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root 15w REG 8,1 465910012 276998 /var/log/ceph/ceph-osd.7.log 2023-11-05T08:43:33.168 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root 16uW REG 0,24 6 1974 /run/ceph/ceph-osd.7.pid 2023-11-05T08:43:33.168 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root 17r FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:33.168 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root 18w FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:33.169 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root 19u unix 0xffff8da307b0b300 0t0 187412 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-05T08:43:33.169 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root 20u IPv4 185761 0t0 TCP *:6802 (LISTEN) 2023-11-05T08:43:33.169 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root 21u IPv4 185765 0t0 TCP *:6803 (LISTEN) 2023-11-05T08:43:33.169 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root 22u IPv4 185770 0t0 TCP *:6804 (LISTEN) 2023-11-05T08:43:33.169 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root 23u IPv4 185776 0t0 TCP *:6805 (LISTEN) 2023-11-05T08:43:33.169 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root 24u IPv4 185783 0t0 TCP *:6806 (LISTEN) 2023-11-05T08:43:33.170 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root 25u IPv4 185791 0t0 TCP *:6807 (LISTEN) 2023-11-05T08:43:33.170 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root 26u IPv4 185800 0t0 TCP *:6808 (LISTEN) 2023-11-05T08:43:33.170 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root 27u IPv4 185810 0t0 TCP *:6809 (LISTEN) 2023-11-05T08:43:33.170 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root 28r FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:33.170 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root 29w FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:33.171 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root 30r FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:33.171 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root 31w FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:33.171 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root 32u sock 0,8 0t0 182041 protocol: UDPv6 2023-11-05T08:43:33.171 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-05T08:43:33.171 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-05T08:43:33.172 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.172 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.172 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.172 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.172 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.172 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.173 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.173 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.173 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.173 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.173 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.174 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.174 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.174 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.174 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.174 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.174 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.175 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.175 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.175 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.175 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.175 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.176 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.176 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.176 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root 60r FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:33.176 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root 61w FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:33.176 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root 62r FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:33.176 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root 63w FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:33.177 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root 66u IPv4 199302 0t0 TCP smithi156.front.sepia.ceph.com:56964->smithi156.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-05T08:43:33.177 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root 67u IPv4 199303 0t0 TCP smithi156.front.sepia.ceph.com:6802->smithi156.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-05T08:43:33.177 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:33.177 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root *525u REG 8,1 32 3087 /tmp/valgrind_proc_86246_cmdline_85358a06 (deleted) 2023-11-05T08:43:33.177 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root *526u REG 8,1 336 3088 /tmp/valgrind_proc_86246_auxv_85358a06 (deleted) 2023-11-05T08:43:33.178 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root *527w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:33.178 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root *528w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:33.178 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root *529r FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:33.178 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root *530w FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:33.178 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89448 safe_time root *531r FIFO 8,1 0t0 3091 /tmp/vgdb-pipe-from-vgdb-to-86246-by-root-on-??? 2023-11-05T08:43:33.178 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root cwd DIR 8,1 4096 265785 /home/ubuntu/cephtest 2023-11-05T08:43:33.179 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:33.179 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-05T08:43:33.179 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:33.179 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:33.179 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-05T08:43:33.180 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-05T08:43:33.180 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root mem REG 8,1 15752 265597 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-05T08:43:33.180 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-05T08:43:33.180 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-05T08:43:33.180 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-05T08:43:33.181 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-05T08:43:33.181 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-05T08:43:33.181 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-05T08:43:33.181 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:33.181 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-05T08:43:33.181 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-05T08:43:33.182 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:33.182 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-05T08:43:33.182 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-05T08:43:33.182 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-05T08:43:33.182 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-05T08:43:33.183 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-05T08:43:33.183 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-05T08:43:33.183 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:33.183 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:33.183 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:33.183 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-05T08:43:33.184 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-05T08:43:33.184 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-05T08:43:33.184 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-05T08:43:33.184 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-05T08:43:33.184 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-05T08:43:33.185 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-05T08:43:33.185 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-05T08:43:33.185 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-05T08:43:33.185 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-05T08:43:33.185 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-05T08:43:33.186 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-05T08:43:33.186 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-05T08:43:33.186 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-05T08:43:33.186 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-05T08:43:33.186 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-05T08:43:33.186 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-05T08:43:33.187 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-05T08:43:33.187 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-05T08:43:33.187 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-05T08:43:33.187 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-05T08:43:33.187 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:33.188 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-05T08:43:33.188 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:33.188 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-05T08:43:33.188 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-05T08:43:33.188 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-05T08:43:33.189 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-05T08:43:33.189 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-05T08:43:33.189 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root mem REG 8,1 83456 265542 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-05T08:43:33.189 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root mem REG 8,1 370416 265532 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-05T08:43:33.189 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root mem REG 8,1 1481856 265536 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-05T08:43:33.189 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root mem REG 8,1 45648 265517 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-05T08:43:33.190 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root mem REG 8,1 41304 265576 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-05T08:43:33.190 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root mem REG 8,1 49912 265561 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-05T08:43:33.190 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root mem REG 8,1 418096 265585 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-05T08:43:33.190 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root mem REG 8,1 83208 265579 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-05T08:43:33.190 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-05T08:43:33.191 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root mem REG 8,1 79224 265555 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-05T08:43:33.191 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root mem REG 8,1 49744 265609 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-05T08:43:33.191 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root mem REG 8,1 49856 265552 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-05T08:43:33.191 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root mem REG 8,1 83632 265549 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-05T08:43:33.191 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root mem REG 8,1 78744 265606 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-05T08:43:33.192 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root mem REG 8,1 53880 265603 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-05T08:43:33.192 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root mem REG 8,1 872944 265588 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-05T08:43:33.192 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root mem REG 8,1 116592 265558 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-05T08:43:33.192 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-05T08:43:33.192 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root mem REG 8,1 1242808 265591 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-05T08:43:33.192 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root mem REG 8,1 62224 265570 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-05T08:43:33.193 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root mem REG 8,1 95808 265564 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-05T08:43:33.193 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root mem REG 8,1 37272 265600 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-05T08:43:33.193 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root mem REG 8,1 104024 265582 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-05T08:43:33.193 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root mem REG 8,1 133480 265546 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-05T08:43:33.193 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root mem REG 8,1 834760 265573 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-05T08:43:33.194 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-05T08:43:33.194 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root mem REG 8,1 129280 265594 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-05T08:43:33.194 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root mem REG 8,1 83224 265567 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-05T08:43:33.194 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root mem REG 8,1 48 3081 /tmp/vgdb-pipe-shared-mem-vgdb-86246-by-root-on-??? 2023-11-05T08:43:33.194 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root DEL REG 0,17 182056 /[aio] 2023-11-05T08:43:33.195 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root DEL REG 0,17 182868 /[aio] 2023-11-05T08:43:33.195 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:33.195 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root 1w FIFO 0,13 0t0 182740 pipe 2023-11-05T08:43:33.195 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root 2w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:33.195 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root 3w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:33.195 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root 4r FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:33.196 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root 5w FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:33.196 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root 6u a_inode 0,14 0 1084 [eventpoll:7,20,21,22,23,24,25,26,27,66] 2023-11-05T08:43:33.196 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root 7r FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:33.196 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root 8w FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:33.196 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root 9u a_inode 0,14 0 1084 [eventpoll:10,67] 2023-11-05T08:43:33.197 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root 10r FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:33.197 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root 11w FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:33.197 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root 12u a_inode 0,14 0 1084 [eventpoll:13] 2023-11-05T08:43:33.197 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root 13r FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:33.197 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root 14w FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:33.198 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root 15w REG 8,1 465910012 276998 /var/log/ceph/ceph-osd.7.log 2023-11-05T08:43:33.198 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root 16uW REG 0,24 6 1974 /run/ceph/ceph-osd.7.pid 2023-11-05T08:43:33.198 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root 17r FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:33.198 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root 18w FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:33.198 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root 19u unix 0xffff8da307b0b300 0t0 187412 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-05T08:43:33.199 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root 20u IPv4 185761 0t0 TCP *:6802 (LISTEN) 2023-11-05T08:43:33.199 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root 21u IPv4 185765 0t0 TCP *:6803 (LISTEN) 2023-11-05T08:43:33.199 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root 22u IPv4 185770 0t0 TCP *:6804 (LISTEN) 2023-11-05T08:43:33.199 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root 23u IPv4 185776 0t0 TCP *:6805 (LISTEN) 2023-11-05T08:43:33.199 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root 24u IPv4 185783 0t0 TCP *:6806 (LISTEN) 2023-11-05T08:43:33.199 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root 25u IPv4 185791 0t0 TCP *:6807 (LISTEN) 2023-11-05T08:43:33.200 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root 26u IPv4 185800 0t0 TCP *:6808 (LISTEN) 2023-11-05T08:43:33.200 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root 27u IPv4 185810 0t0 TCP *:6809 (LISTEN) 2023-11-05T08:43:33.200 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root 28r FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:33.200 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root 29w FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:33.200 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root 30r FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:33.201 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root 31w FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:33.201 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root 32u sock 0,8 0t0 182041 protocol: UDPv6 2023-11-05T08:43:33.201 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-05T08:43:33.201 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-05T08:43:33.201 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.201 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.202 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.202 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.202 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.202 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.202 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.203 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.203 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.203 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.203 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.203 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.203 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.204 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.204 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.204 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.204 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.204 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.205 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.205 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.205 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.205 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.205 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.205 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.206 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root 60r FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:33.206 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root 61w FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:33.206 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root 62r FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:33.206 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root 63w FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:33.206 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root 66u IPv4 199302 0t0 TCP smithi156.front.sepia.ceph.com:56964->smithi156.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-05T08:43:33.207 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root 67u IPv4 199303 0t0 TCP smithi156.front.sepia.ceph.com:6802->smithi156.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-05T08:43:33.207 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:33.207 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root *525u REG 8,1 32 3087 /tmp/valgrind_proc_86246_cmdline_85358a06 (deleted) 2023-11-05T08:43:33.207 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root *526u REG 8,1 336 3088 /tmp/valgrind_proc_86246_auxv_85358a06 (deleted) 2023-11-05T08:43:33.207 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root *527w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:33.208 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root *528w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:33.208 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root *529r FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:33.208 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root *530w FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:33.208 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89452 safe_time root *531r FIFO 8,1 0t0 3091 /tmp/vgdb-pipe-from-vgdb-to-86246-by-root-on-??? 2023-11-05T08:43:33.208 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root cwd DIR 8,1 4096 265785 /home/ubuntu/cephtest 2023-11-05T08:43:33.209 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:33.209 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-05T08:43:33.209 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:33.209 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:33.209 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-05T08:43:33.209 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-05T08:43:33.210 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root mem REG 8,1 15752 265597 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-05T08:43:33.210 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-05T08:43:33.210 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-05T08:43:33.210 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-05T08:43:33.210 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-05T08:43:33.211 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-05T08:43:33.211 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-05T08:43:33.211 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:33.211 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-05T08:43:33.211 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-05T08:43:33.211 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:33.212 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-05T08:43:33.212 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-05T08:43:33.212 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-05T08:43:33.212 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-05T08:43:33.212 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-05T08:43:33.213 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-05T08:43:33.213 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:33.213 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:33.213 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:33.213 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-05T08:43:33.213 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-05T08:43:33.214 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-05T08:43:33.214 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-05T08:43:33.214 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-05T08:43:33.214 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-05T08:43:33.214 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-05T08:43:33.215 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-05T08:43:33.215 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-05T08:43:33.215 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-05T08:43:33.215 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-05T08:43:33.215 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-05T08:43:33.215 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-05T08:43:33.216 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-05T08:43:33.216 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-05T08:43:33.216 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-05T08:43:33.216 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-05T08:43:33.216 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-05T08:43:33.217 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-05T08:43:33.217 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-05T08:43:33.217 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-05T08:43:33.217 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:33.217 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-05T08:43:33.218 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:33.218 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-05T08:43:33.218 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-05T08:43:33.218 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-05T08:43:33.218 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-05T08:43:33.219 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-05T08:43:33.219 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root mem REG 8,1 83456 265542 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-05T08:43:33.219 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root mem REG 8,1 370416 265532 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-05T08:43:33.219 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root mem REG 8,1 1481856 265536 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-05T08:43:33.219 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root mem REG 8,1 45648 265517 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-05T08:43:33.220 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root mem REG 8,1 41304 265576 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-05T08:43:33.220 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root mem REG 8,1 49912 265561 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-05T08:43:33.220 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root mem REG 8,1 418096 265585 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-05T08:43:33.220 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root mem REG 8,1 83208 265579 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-05T08:43:33.220 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-05T08:43:33.220 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root mem REG 8,1 79224 265555 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-05T08:43:33.221 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root mem REG 8,1 49744 265609 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-05T08:43:33.221 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root mem REG 8,1 49856 265552 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-05T08:43:33.221 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root mem REG 8,1 83632 265549 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-05T08:43:33.221 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root mem REG 8,1 78744 265606 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-05T08:43:33.221 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root mem REG 8,1 53880 265603 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-05T08:43:33.222 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root mem REG 8,1 872944 265588 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-05T08:43:33.222 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root mem REG 8,1 116592 265558 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-05T08:43:33.222 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-05T08:43:33.222 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root mem REG 8,1 1242808 265591 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-05T08:43:33.222 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root mem REG 8,1 62224 265570 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-05T08:43:33.222 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root mem REG 8,1 95808 265564 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-05T08:43:33.223 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root mem REG 8,1 37272 265600 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-05T08:43:33.223 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root mem REG 8,1 104024 265582 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-05T08:43:33.223 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root mem REG 8,1 133480 265546 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-05T08:43:33.223 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root mem REG 8,1 834760 265573 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-05T08:43:33.223 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-05T08:43:33.224 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root mem REG 8,1 129280 265594 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-05T08:43:33.224 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root mem REG 8,1 83224 265567 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-05T08:43:33.224 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root mem REG 8,1 48 3081 /tmp/vgdb-pipe-shared-mem-vgdb-86246-by-root-on-??? 2023-11-05T08:43:33.224 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root DEL REG 0,17 182056 /[aio] 2023-11-05T08:43:33.224 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root DEL REG 0,17 182868 /[aio] 2023-11-05T08:43:33.224 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root 0r CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:33.225 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root 1w FIFO 0,13 0t0 182740 pipe 2023-11-05T08:43:33.225 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root 2w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:33.225 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root 3w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:33.225 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root 4r FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:33.225 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root 5w FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:33.226 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root 6u a_inode 0,14 0 1084 [eventpoll:7,20,21,22,23,24,25,26,27,66] 2023-11-05T08:43:33.226 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root 7r FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:33.226 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root 8w FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:33.226 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root 9u a_inode 0,14 0 1084 [eventpoll:10,67] 2023-11-05T08:43:33.226 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root 10r FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:33.227 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root 11w FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:33.227 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root 12u a_inode 0,14 0 1084 [eventpoll:13] 2023-11-05T08:43:33.227 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root 13r FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:33.227 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root 14w FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:33.227 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root 15w REG 8,1 465910012 276998 /var/log/ceph/ceph-osd.7.log 2023-11-05T08:43:33.227 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root 16uW REG 0,24 6 1974 /run/ceph/ceph-osd.7.pid 2023-11-05T08:43:33.228 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root 17r FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:33.228 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root 18w FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:33.228 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root 19u unix 0xffff8da307b0b300 0t0 187412 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-05T08:43:33.228 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root 20u IPv4 185761 0t0 TCP *:6802 (LISTEN) 2023-11-05T08:43:33.228 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root 21u IPv4 185765 0t0 TCP *:6803 (LISTEN) 2023-11-05T08:43:33.229 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root 22u IPv4 185770 0t0 TCP *:6804 (LISTEN) 2023-11-05T08:43:33.229 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root 23u IPv4 185776 0t0 TCP *:6805 (LISTEN) 2023-11-05T08:43:33.229 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root 24u IPv4 185783 0t0 TCP *:6806 (LISTEN) 2023-11-05T08:43:33.229 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root 25u IPv4 185791 0t0 TCP *:6807 (LISTEN) 2023-11-05T08:43:33.229 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root 26u IPv4 185800 0t0 TCP *:6808 (LISTEN) 2023-11-05T08:43:33.230 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root 27u IPv4 185810 0t0 TCP *:6809 (LISTEN) 2023-11-05T08:43:33.230 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root 28r FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:33.230 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root 29w FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:33.230 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root 30r FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:33.230 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root 31w FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:33.231 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root 32u sock 0,8 0t0 182041 protocol: UDPv6 2023-11-05T08:43:33.231 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-05T08:43:33.231 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-05T08:43:33.231 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.231 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.232 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.232 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.232 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.232 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.232 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.232 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.233 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.233 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.233 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.233 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.233 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.234 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.234 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.234 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.234 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.234 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.234 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.235 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.235 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.235 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.235 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.235 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.236 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root 60r FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:33.236 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root 61w FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:33.236 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root 62r FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:33.236 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root 63w FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:33.236 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root 66u IPv4 199302 0t0 TCP smithi156.front.sepia.ceph.com:56964->smithi156.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-05T08:43:33.236 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root 67u IPv4 199303 0t0 TCP smithi156.front.sepia.ceph.com:6802->smithi156.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-05T08:43:33.237 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:33.237 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root *525u REG 8,1 32 3087 /tmp/valgrind_proc_86246_cmdline_85358a06 (deleted) 2023-11-05T08:43:33.237 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root *526u REG 8,1 336 3088 /tmp/valgrind_proc_86246_auxv_85358a06 (deleted) 2023-11-05T08:43:33.237 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root *527w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:33.237 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root *528w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:33.238 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root *529r FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:33.238 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root *530w FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:33.238 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89455 memcheck- root *531r FIFO 8,1 0t0 3091 /tmp/vgdb-pipe-from-vgdb-to-86246-by-root-on-??? 2023-11-05T08:43:33.238 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root cwd DIR 8,1 4096 265785 /home/ubuntu/cephtest 2023-11-05T08:43:33.238 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:33.238 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-05T08:43:33.239 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:33.239 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:33.239 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-05T08:43:33.239 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-05T08:43:33.239 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root mem REG 8,1 15752 265597 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-05T08:43:33.239 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-05T08:43:33.240 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-05T08:43:33.240 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-05T08:43:33.240 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-05T08:43:33.240 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-05T08:43:33.240 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-05T08:43:33.241 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:33.241 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-05T08:43:33.241 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-05T08:43:33.241 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:33.241 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-05T08:43:33.241 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-05T08:43:33.242 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-05T08:43:33.242 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-05T08:43:33.242 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-05T08:43:33.242 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-05T08:43:33.242 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:33.242 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:33.243 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:33.243 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-05T08:43:33.243 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-05T08:43:33.243 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-05T08:43:33.243 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-05T08:43:33.244 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-05T08:43:33.244 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-05T08:43:33.244 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-05T08:43:33.244 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-05T08:43:33.244 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-05T08:43:33.244 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-05T08:43:33.245 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-05T08:43:33.245 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-05T08:43:33.245 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-05T08:43:33.245 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-05T08:43:33.245 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-05T08:43:33.246 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-05T08:43:33.246 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-05T08:43:33.246 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-05T08:43:33.246 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-05T08:43:33.246 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-05T08:43:33.247 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-05T08:43:33.247 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:33.247 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-05T08:43:33.247 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:33.247 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-05T08:43:33.247 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-05T08:43:33.248 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-05T08:43:33.248 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-05T08:43:33.248 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-05T08:43:33.248 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root mem REG 8,1 83456 265542 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-05T08:43:33.248 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root mem REG 8,1 370416 265532 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-05T08:43:33.249 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root mem REG 8,1 1481856 265536 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-05T08:43:33.249 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root mem REG 8,1 45648 265517 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-05T08:43:33.249 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root mem REG 8,1 41304 265576 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-05T08:43:33.249 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root mem REG 8,1 49912 265561 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-05T08:43:33.249 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root mem REG 8,1 418096 265585 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-05T08:43:33.249 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root mem REG 8,1 83208 265579 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-05T08:43:33.250 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-05T08:43:33.250 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root mem REG 8,1 79224 265555 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-05T08:43:33.250 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root mem REG 8,1 49744 265609 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-05T08:43:33.250 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root mem REG 8,1 49856 265552 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-05T08:43:33.250 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root mem REG 8,1 83632 265549 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-05T08:43:33.251 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root mem REG 8,1 78744 265606 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-05T08:43:33.251 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root mem REG 8,1 53880 265603 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-05T08:43:33.251 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root mem REG 8,1 872944 265588 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-05T08:43:33.251 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root mem REG 8,1 116592 265558 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-05T08:43:33.251 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-05T08:43:33.252 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root mem REG 8,1 1242808 265591 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-05T08:43:33.252 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root mem REG 8,1 62224 265570 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-05T08:43:33.252 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root mem REG 8,1 95808 265564 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-05T08:43:33.252 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root mem REG 8,1 37272 265600 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-05T08:43:33.252 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root mem REG 8,1 104024 265582 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-05T08:43:33.252 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root mem REG 8,1 133480 265546 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-05T08:43:33.253 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root mem REG 8,1 834760 265573 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-05T08:43:33.253 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-05T08:43:33.253 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root mem REG 8,1 129280 265594 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-05T08:43:33.253 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root mem REG 8,1 83224 265567 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-05T08:43:33.253 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root mem REG 8,1 48 3081 /tmp/vgdb-pipe-shared-mem-vgdb-86246-by-root-on-??? 2023-11-05T08:43:33.254 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root DEL REG 0,17 182056 /[aio] 2023-11-05T08:43:33.254 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root DEL REG 0,17 182868 /[aio] 2023-11-05T08:43:33.254 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root 0r CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:33.254 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root 1w FIFO 0,13 0t0 182740 pipe 2023-11-05T08:43:33.254 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root 2w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:33.254 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root 3w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:33.255 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root 4r FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:33.255 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root 5w FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:33.255 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root 6u a_inode 0,14 0 1084 [eventpoll:7,20,21,22,23,24,25,26,27,66] 2023-11-05T08:43:33.255 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root 7r FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:33.255 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root 8w FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:33.256 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root 9u a_inode 0,14 0 1084 [eventpoll:10,67] 2023-11-05T08:43:33.256 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root 10r FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:33.256 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root 11w FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:33.256 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root 12u a_inode 0,14 0 1084 [eventpoll:13] 2023-11-05T08:43:33.256 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root 13r FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:33.256 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root 14w FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:33.257 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root 15w REG 8,1 465910012 276998 /var/log/ceph/ceph-osd.7.log 2023-11-05T08:43:33.257 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root 16uW REG 0,24 6 1974 /run/ceph/ceph-osd.7.pid 2023-11-05T08:43:33.257 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root 17r FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:33.257 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root 18w FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:33.257 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root 19u unix 0xffff8da307b0b300 0t0 187412 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-05T08:43:33.258 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root 20u IPv4 185761 0t0 TCP *:6802 (LISTEN) 2023-11-05T08:43:33.258 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root 21u IPv4 185765 0t0 TCP *:6803 (LISTEN) 2023-11-05T08:43:33.258 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root 22u IPv4 185770 0t0 TCP *:6804 (LISTEN) 2023-11-05T08:43:33.258 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root 23u IPv4 185776 0t0 TCP *:6805 (LISTEN) 2023-11-05T08:43:33.258 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root 24u IPv4 185783 0t0 TCP *:6806 (LISTEN) 2023-11-05T08:43:33.259 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root 25u IPv4 185791 0t0 TCP *:6807 (LISTEN) 2023-11-05T08:43:33.259 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root 26u IPv4 185800 0t0 TCP *:6808 (LISTEN) 2023-11-05T08:43:33.259 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root 27u IPv4 185810 0t0 TCP *:6809 (LISTEN) 2023-11-05T08:43:33.259 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root 28r FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:33.259 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root 29w FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:33.259 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root 30r FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:33.260 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root 31w FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:33.260 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root 32u sock 0,8 0t0 182041 protocol: UDPv6 2023-11-05T08:43:33.260 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-05T08:43:33.260 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-05T08:43:33.260 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.261 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.261 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.261 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.261 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.261 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.262 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.262 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.262 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.262 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.262 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.262 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.263 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.263 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.263 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.263 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.263 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.264 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.264 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.264 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.264 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.264 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.265 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.265 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.265 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root 60r FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:33.265 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root 61w FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:33.265 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root 62r FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:33.265 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root 63w FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:33.266 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root 66u IPv4 199302 0t0 TCP smithi156.front.sepia.ceph.com:56964->smithi156.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-05T08:43:33.266 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root 67u IPv4 199303 0t0 TCP smithi156.front.sepia.ceph.com:6802->smithi156.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-05T08:43:33.266 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:33.266 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root *525u REG 8,1 32 3087 /tmp/valgrind_proc_86246_cmdline_85358a06 (deleted) 2023-11-05T08:43:33.266 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root *526u REG 8,1 336 3088 /tmp/valgrind_proc_86246_auxv_85358a06 (deleted) 2023-11-05T08:43:33.267 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root *527w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:33.267 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root *528w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:33.267 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root *529r FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:33.267 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root *530w FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:33.267 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89458 osd_srv_a root *531r FIFO 8,1 0t0 3091 /tmp/vgdb-pipe-from-vgdb-to-86246-by-root-on-??? 2023-11-05T08:43:33.267 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root cwd DIR 8,1 4096 265785 /home/ubuntu/cephtest 2023-11-05T08:43:33.268 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:33.268 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-05T08:43:33.268 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:33.268 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:33.268 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-05T08:43:33.269 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-05T08:43:33.269 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root mem REG 8,1 15752 265597 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-05T08:43:33.269 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-05T08:43:33.269 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-05T08:43:33.269 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-05T08:43:33.269 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-05T08:43:33.270 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-05T08:43:33.270 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-05T08:43:33.270 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:33.270 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-05T08:43:33.270 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-05T08:43:33.271 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:33.271 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-05T08:43:33.271 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-05T08:43:33.271 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-05T08:43:33.271 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-05T08:43:33.272 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-05T08:43:33.272 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-05T08:43:33.272 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:33.272 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:33.272 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:33.272 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-05T08:43:33.273 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-05T08:43:33.273 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-05T08:43:33.273 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-05T08:43:33.273 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-05T08:43:33.273 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-05T08:43:33.274 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-05T08:43:33.274 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-05T08:43:33.274 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-05T08:43:33.274 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-05T08:43:33.274 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-05T08:43:33.275 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-05T08:43:33.275 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-05T08:43:33.275 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-05T08:43:33.275 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-05T08:43:33.275 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-05T08:43:33.275 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-05T08:43:33.276 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-05T08:43:33.276 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-05T08:43:33.276 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-05T08:43:33.276 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-05T08:43:33.276 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:33.277 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-05T08:43:33.277 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:33.277 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-05T08:43:33.277 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-05T08:43:33.277 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-05T08:43:33.278 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-05T08:43:33.278 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-05T08:43:33.278 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root mem REG 8,1 83456 265542 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-05T08:43:33.278 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root mem REG 8,1 370416 265532 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-05T08:43:33.278 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root mem REG 8,1 1481856 265536 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-05T08:43:33.279 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root mem REG 8,1 45648 265517 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-05T08:43:33.279 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root mem REG 8,1 41304 265576 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-05T08:43:33.279 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root mem REG 8,1 49912 265561 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-05T08:43:33.279 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root mem REG 8,1 418096 265585 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-05T08:43:33.279 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root mem REG 8,1 83208 265579 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-05T08:43:33.279 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-05T08:43:33.280 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root mem REG 8,1 79224 265555 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-05T08:43:33.280 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root mem REG 8,1 49744 265609 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-05T08:43:33.280 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root mem REG 8,1 49856 265552 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-05T08:43:33.280 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root mem REG 8,1 83632 265549 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-05T08:43:33.280 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root mem REG 8,1 78744 265606 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-05T08:43:33.281 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root mem REG 8,1 53880 265603 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-05T08:43:33.281 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root mem REG 8,1 872944 265588 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-05T08:43:33.281 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root mem REG 8,1 116592 265558 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-05T08:43:33.281 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-05T08:43:33.281 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root mem REG 8,1 1242808 265591 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-05T08:43:33.281 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root mem REG 8,1 62224 265570 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-05T08:43:33.282 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root mem REG 8,1 95808 265564 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-05T08:43:33.282 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root mem REG 8,1 37272 265600 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-05T08:43:33.282 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root mem REG 8,1 104024 265582 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-05T08:43:33.282 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root mem REG 8,1 133480 265546 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-05T08:43:33.282 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root mem REG 8,1 834760 265573 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-05T08:43:33.283 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-05T08:43:33.283 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root mem REG 8,1 129280 265594 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-05T08:43:33.283 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root mem REG 8,1 83224 265567 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-05T08:43:33.283 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root mem REG 8,1 48 3081 /tmp/vgdb-pipe-shared-mem-vgdb-86246-by-root-on-??? 2023-11-05T08:43:33.283 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root DEL REG 0,17 182056 /[aio] 2023-11-05T08:43:33.284 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root DEL REG 0,17 182868 /[aio] 2023-11-05T08:43:33.284 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:33.284 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root 1w FIFO 0,13 0t0 182740 pipe 2023-11-05T08:43:33.284 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root 2w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:33.284 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root 3w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:33.285 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root 4r FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:33.285 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root 5w FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:33.285 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root 6u a_inode 0,14 0 1084 [eventpoll:7,20,21,22,23,24,25,26,27,66] 2023-11-05T08:43:33.285 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root 7r FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:33.285 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root 8w FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:33.285 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root 9u a_inode 0,14 0 1084 [eventpoll:10,67] 2023-11-05T08:43:33.286 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root 10r FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:33.286 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root 11w FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:33.286 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root 12u a_inode 0,14 0 1084 [eventpoll:13] 2023-11-05T08:43:33.286 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root 13r FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:33.286 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root 14w FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:33.287 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root 15w REG 8,1 465910012 276998 /var/log/ceph/ceph-osd.7.log 2023-11-05T08:43:33.287 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root 16uW REG 0,24 6 1974 /run/ceph/ceph-osd.7.pid 2023-11-05T08:43:33.287 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root 17r FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:33.287 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root 18w FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:33.287 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root 19u unix 0xffff8da307b0b300 0t0 187412 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-05T08:43:33.288 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root 20u IPv4 185761 0t0 TCP *:6802 (LISTEN) 2023-11-05T08:43:33.288 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root 21u IPv4 185765 0t0 TCP *:6803 (LISTEN) 2023-11-05T08:43:33.288 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root 22u IPv4 185770 0t0 TCP *:6804 (LISTEN) 2023-11-05T08:43:33.288 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root 23u IPv4 185776 0t0 TCP *:6805 (LISTEN) 2023-11-05T08:43:33.288 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root 24u IPv4 185783 0t0 TCP *:6806 (LISTEN) 2023-11-05T08:43:33.288 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root 25u IPv4 185791 0t0 TCP *:6807 (LISTEN) 2023-11-05T08:43:33.289 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root 26u IPv4 185800 0t0 TCP *:6808 (LISTEN) 2023-11-05T08:43:33.289 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root 27u IPv4 185810 0t0 TCP *:6809 (LISTEN) 2023-11-05T08:43:33.289 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root 28r FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:33.289 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root 29w FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:33.289 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root 30r FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:33.290 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root 31w FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:33.290 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root 32u sock 0,8 0t0 182041 protocol: UDPv6 2023-11-05T08:43:33.290 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-05T08:43:33.290 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-05T08:43:33.290 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.290 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.291 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.291 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.291 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.291 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.291 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.291 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.292 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.292 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.292 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.292 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.292 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.293 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.293 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.293 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.293 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.293 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.293 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.294 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.294 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.294 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.294 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.294 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.295 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root 60r FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:33.295 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root 61w FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:33.295 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root 62r FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:33.295 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root 63w FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:33.295 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root 66u IPv4 199302 0t0 TCP smithi156.front.sepia.ceph.com:56964->smithi156.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-05T08:43:33.295 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root 67u IPv4 199303 0t0 TCP smithi156.front.sepia.ceph.com:6802->smithi156.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-05T08:43:33.296 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:33.296 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root *525u REG 8,1 32 3087 /tmp/valgrind_proc_86246_cmdline_85358a06 (deleted) 2023-11-05T08:43:33.296 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root *526u REG 8,1 336 3088 /tmp/valgrind_proc_86246_auxv_85358a06 (deleted) 2023-11-05T08:43:33.296 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root *527w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:33.296 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root *528w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:33.297 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root *529r FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:33.297 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root *530w FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:33.297 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89462 tp_osd_tp root *531r FIFO 8,1 0t0 3091 /tmp/vgdb-pipe-from-vgdb-to-86246-by-root-on-??? 2023-11-05T08:43:33.297 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root cwd DIR 8,1 4096 265785 /home/ubuntu/cephtest 2023-11-05T08:43:33.297 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:33.298 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-05T08:43:33.298 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:33.298 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:33.298 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-05T08:43:33.298 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-05T08:43:33.299 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root mem REG 8,1 15752 265597 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-05T08:43:33.299 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-05T08:43:33.299 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-05T08:43:33.299 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-05T08:43:33.299 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-05T08:43:33.300 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-05T08:43:33.300 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-05T08:43:33.300 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:33.300 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-05T08:43:33.300 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-05T08:43:33.301 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:33.301 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-05T08:43:33.301 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-05T08:43:33.301 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-05T08:43:33.301 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-05T08:43:33.301 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-05T08:43:33.302 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-05T08:43:33.302 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:33.302 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:33.302 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:33.302 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-05T08:43:33.303 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-05T08:43:33.303 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-05T08:43:33.303 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-05T08:43:33.303 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-05T08:43:33.303 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-05T08:43:33.304 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-05T08:43:33.304 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-05T08:43:33.304 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-05T08:43:33.304 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-05T08:43:33.304 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-05T08:43:33.304 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-05T08:43:33.305 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-05T08:43:33.305 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-05T08:43:33.305 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-05T08:43:33.305 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-05T08:43:33.305 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-05T08:43:33.306 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-05T08:43:33.306 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-05T08:43:33.306 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-05T08:43:33.306 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-05T08:43:33.306 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:33.307 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-05T08:43:33.307 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:33.307 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-05T08:43:33.307 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-05T08:43:33.307 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-05T08:43:33.307 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-05T08:43:33.308 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-05T08:43:33.308 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root mem REG 8,1 83456 265542 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-05T08:43:33.308 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root mem REG 8,1 370416 265532 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-05T08:43:33.308 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root mem REG 8,1 1481856 265536 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-05T08:43:33.308 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root mem REG 8,1 45648 265517 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-05T08:43:33.309 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root mem REG 8,1 41304 265576 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-05T08:43:33.309 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root mem REG 8,1 49912 265561 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-05T08:43:33.309 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root mem REG 8,1 418096 265585 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-05T08:43:33.309 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root mem REG 8,1 83208 265579 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-05T08:43:33.309 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-05T08:43:33.310 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root mem REG 8,1 79224 265555 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-05T08:43:33.310 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root mem REG 8,1 49744 265609 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-05T08:43:33.310 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root mem REG 8,1 49856 265552 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-05T08:43:33.310 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root mem REG 8,1 83632 265549 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-05T08:43:33.310 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root mem REG 8,1 78744 265606 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-05T08:43:33.310 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root mem REG 8,1 53880 265603 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-05T08:43:33.311 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root mem REG 8,1 872944 265588 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-05T08:43:33.311 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root mem REG 8,1 116592 265558 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-05T08:43:33.311 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-05T08:43:33.311 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root mem REG 8,1 1242808 265591 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-05T08:43:33.311 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root mem REG 8,1 62224 265570 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-05T08:43:33.312 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root mem REG 8,1 95808 265564 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-05T08:43:33.312 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root mem REG 8,1 37272 265600 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-05T08:43:33.312 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root mem REG 8,1 104024 265582 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-05T08:43:33.312 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root mem REG 8,1 133480 265546 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-05T08:43:33.312 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root mem REG 8,1 834760 265573 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-05T08:43:33.312 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-05T08:43:33.313 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root mem REG 8,1 129280 265594 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-05T08:43:33.313 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root mem REG 8,1 83224 265567 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-05T08:43:33.313 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root mem REG 8,1 48 3081 /tmp/vgdb-pipe-shared-mem-vgdb-86246-by-root-on-??? 2023-11-05T08:43:33.313 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root DEL REG 0,17 182056 /[aio] 2023-11-05T08:43:33.313 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root DEL REG 0,17 182868 /[aio] 2023-11-05T08:43:33.314 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:33.314 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root 1w FIFO 0,13 0t0 182740 pipe 2023-11-05T08:43:33.314 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root 2w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:33.314 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root 3w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:33.314 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root 4r FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:33.315 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root 5w FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:33.315 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root 6u a_inode 0,14 0 1084 [eventpoll:7,20,21,22,23,24,25,26,27,66] 2023-11-05T08:43:33.315 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root 7r FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:33.315 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root 8w FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:33.315 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root 9u a_inode 0,14 0 1084 [eventpoll:10,67] 2023-11-05T08:43:33.315 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root 10r FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:33.316 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root 11w FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:33.316 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root 12u a_inode 0,14 0 1084 [eventpoll:13] 2023-11-05T08:43:33.316 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root 13r FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:33.316 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root 14w FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:33.316 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root 15w REG 8,1 465910012 276998 /var/log/ceph/ceph-osd.7.log 2023-11-05T08:43:33.317 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root 16uW REG 0,24 6 1974 /run/ceph/ceph-osd.7.pid 2023-11-05T08:43:33.317 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root 17r FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:33.317 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root 18w FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:33.317 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root 19u unix 0xffff8da307b0b300 0t0 187412 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-05T08:43:33.317 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root 20u IPv4 185761 0t0 TCP *:6802 (LISTEN) 2023-11-05T08:43:33.317 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root 21u IPv4 185765 0t0 TCP *:6803 (LISTEN) 2023-11-05T08:43:33.318 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root 22u IPv4 185770 0t0 TCP *:6804 (LISTEN) 2023-11-05T08:43:33.318 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root 23u IPv4 185776 0t0 TCP *:6805 (LISTEN) 2023-11-05T08:43:33.318 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root 24u IPv4 185783 0t0 TCP *:6806 (LISTEN) 2023-11-05T08:43:33.318 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root 25u IPv4 185791 0t0 TCP *:6807 (LISTEN) 2023-11-05T08:43:33.318 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root 26u IPv4 185800 0t0 TCP *:6808 (LISTEN) 2023-11-05T08:43:33.319 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root 27u IPv4 185810 0t0 TCP *:6809 (LISTEN) 2023-11-05T08:43:33.319 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root 28r FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:33.319 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root 29w FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:33.319 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root 30r FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:33.319 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root 31w FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:33.319 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root 32u sock 0,8 0t0 182041 protocol: UDPv6 2023-11-05T08:43:33.320 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-05T08:43:33.320 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-05T08:43:33.320 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.320 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.320 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.321 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.321 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.321 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.321 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.321 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.322 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.322 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.322 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.322 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.322 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.323 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.323 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.323 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.323 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.323 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.323 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.324 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.324 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.324 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.324 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.324 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.325 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root 60r FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:33.325 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root 61w FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:33.325 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root 62r FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:33.325 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root 63w FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:33.325 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root 66u IPv4 199302 0t0 TCP smithi156.front.sepia.ceph.com:56964->smithi156.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-05T08:43:33.326 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root 67u IPv4 199303 0t0 TCP smithi156.front.sepia.ceph.com:6802->smithi156.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-05T08:43:33.326 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:33.326 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root *525u REG 8,1 32 3087 /tmp/valgrind_proc_86246_cmdline_85358a06 (deleted) 2023-11-05T08:43:33.326 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root *526u REG 8,1 336 3088 /tmp/valgrind_proc_86246_auxv_85358a06 (deleted) 2023-11-05T08:43:33.326 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root *527w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:33.326 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root *528w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:33.327 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root *529r FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:33.327 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root *530w FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:33.327 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89464 tp_osd_tp root *531r FIFO 8,1 0t0 3091 /tmp/vgdb-pipe-from-vgdb-to-86246-by-root-on-??? 2023-11-05T08:43:33.327 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root cwd DIR 8,1 4096 265785 /home/ubuntu/cephtest 2023-11-05T08:43:33.327 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:33.328 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-05T08:43:33.328 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:33.328 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:33.328 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-05T08:43:33.328 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-05T08:43:33.328 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root mem REG 8,1 15752 265597 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-05T08:43:33.329 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-05T08:43:33.329 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-05T08:43:33.329 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-05T08:43:33.329 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-05T08:43:33.329 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-05T08:43:33.330 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-05T08:43:33.330 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:33.330 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-05T08:43:33.330 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-05T08:43:33.330 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:33.331 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-05T08:43:33.331 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-05T08:43:33.331 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-05T08:43:33.331 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-05T08:43:33.331 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-05T08:43:33.332 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-05T08:43:33.332 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:33.332 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:33.332 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:33.332 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-05T08:43:33.332 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-05T08:43:33.333 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-05T08:43:33.333 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-05T08:43:33.333 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-05T08:43:33.333 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-05T08:43:33.333 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-05T08:43:33.334 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-05T08:43:33.334 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-05T08:43:33.334 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-05T08:43:33.334 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-05T08:43:33.334 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-05T08:43:33.334 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-05T08:43:33.335 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-05T08:43:33.335 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-05T08:43:33.335 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-05T08:43:33.335 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-05T08:43:33.335 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-05T08:43:33.336 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-05T08:43:33.336 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-05T08:43:33.336 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-05T08:43:33.336 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:33.336 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-05T08:43:33.337 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:33.337 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-05T08:43:33.337 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-05T08:43:33.337 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-05T08:43:33.337 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-05T08:43:33.338 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-05T08:43:33.338 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root mem REG 8,1 83456 265542 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-05T08:43:33.338 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root mem REG 8,1 370416 265532 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-05T08:43:33.338 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root mem REG 8,1 1481856 265536 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-05T08:43:33.338 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root mem REG 8,1 45648 265517 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-05T08:43:33.338 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root mem REG 8,1 41304 265576 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-05T08:43:33.339 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root mem REG 8,1 49912 265561 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-05T08:43:33.339 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root mem REG 8,1 418096 265585 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-05T08:43:33.339 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root mem REG 8,1 83208 265579 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-05T08:43:33.339 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-05T08:43:33.339 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root mem REG 8,1 79224 265555 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-05T08:43:33.340 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root mem REG 8,1 49744 265609 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-05T08:43:33.340 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root mem REG 8,1 49856 265552 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-05T08:43:33.340 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root mem REG 8,1 83632 265549 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-05T08:43:33.340 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root mem REG 8,1 78744 265606 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-05T08:43:33.340 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root mem REG 8,1 53880 265603 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-05T08:43:33.340 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root mem REG 8,1 872944 265588 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-05T08:43:33.341 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root mem REG 8,1 116592 265558 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-05T08:43:33.341 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-05T08:43:33.341 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root mem REG 8,1 1242808 265591 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-05T08:43:33.341 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root mem REG 8,1 62224 265570 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-05T08:43:33.341 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root mem REG 8,1 95808 265564 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-05T08:43:33.342 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root mem REG 8,1 37272 265600 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-05T08:43:33.342 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root mem REG 8,1 104024 265582 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-05T08:43:33.342 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root mem REG 8,1 133480 265546 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-05T08:43:33.342 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root mem REG 8,1 834760 265573 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-05T08:43:33.342 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-05T08:43:33.343 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root mem REG 8,1 129280 265594 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-05T08:43:33.343 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root mem REG 8,1 83224 265567 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-05T08:43:33.343 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root mem REG 8,1 48 3081 /tmp/vgdb-pipe-shared-mem-vgdb-86246-by-root-on-??? 2023-11-05T08:43:33.343 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root DEL REG 0,17 182056 /[aio] 2023-11-05T08:43:33.343 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root DEL REG 0,17 182868 /[aio] 2023-11-05T08:43:33.343 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:33.344 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root 1w FIFO 0,13 0t0 182740 pipe 2023-11-05T08:43:33.344 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root 2w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:33.344 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root 3w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:33.344 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root 4r FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:33.344 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root 5w FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:33.345 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root 6u a_inode 0,14 0 1084 [eventpoll:7,20,21,22,23,24,25,26,27,66] 2023-11-05T08:43:33.345 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root 7r FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:33.345 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root 8w FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:33.345 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root 9u a_inode 0,14 0 1084 [eventpoll:10,67] 2023-11-05T08:43:33.345 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root 10r FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:33.346 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root 11w FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:33.346 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root 12u a_inode 0,14 0 1084 [eventpoll:13] 2023-11-05T08:43:33.346 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root 13r FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:33.346 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root 14w FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:33.346 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root 15w REG 8,1 465910012 276998 /var/log/ceph/ceph-osd.7.log 2023-11-05T08:43:33.346 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root 16uW REG 0,24 6 1974 /run/ceph/ceph-osd.7.pid 2023-11-05T08:43:33.347 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root 17r FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:33.347 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root 18w FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:33.347 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root 19u unix 0xffff8da307b0b300 0t0 187412 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-05T08:43:33.347 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root 20u IPv4 185761 0t0 TCP *:6802 (LISTEN) 2023-11-05T08:43:33.347 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root 21u IPv4 185765 0t0 TCP *:6803 (LISTEN) 2023-11-05T08:43:33.348 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root 22u IPv4 185770 0t0 TCP *:6804 (LISTEN) 2023-11-05T08:43:33.348 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root 23u IPv4 185776 0t0 TCP *:6805 (LISTEN) 2023-11-05T08:43:33.348 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root 24u IPv4 185783 0t0 TCP *:6806 (LISTEN) 2023-11-05T08:43:33.348 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root 25u IPv4 185791 0t0 TCP *:6807 (LISTEN) 2023-11-05T08:43:33.348 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root 26u IPv4 185800 0t0 TCP *:6808 (LISTEN) 2023-11-05T08:43:33.348 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root 27u IPv4 185810 0t0 TCP *:6809 (LISTEN) 2023-11-05T08:43:33.349 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root 28r FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:33.349 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root 29w FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:33.349 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root 30r FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:33.349 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root 31w FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:33.349 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root 32u sock 0,8 0t0 182041 protocol: UDPv6 2023-11-05T08:43:33.350 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-05T08:43:33.350 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-05T08:43:33.350 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.350 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.350 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.351 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.351 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.351 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.351 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.351 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.351 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.352 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.352 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.352 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.352 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.352 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.352 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.353 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.353 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.353 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.353 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.353 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.354 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.354 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.354 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.354 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.354 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root 60r FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:33.355 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root 61w FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:33.355 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root 62r FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:33.355 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root 63w FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:33.355 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root 66u IPv4 199302 0t0 TCP smithi156.front.sepia.ceph.com:56964->smithi156.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-05T08:43:33.355 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root 67u IPv4 199303 0t0 TCP smithi156.front.sepia.ceph.com:6802->smithi156.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-05T08:43:33.356 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:33.356 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root *525u REG 8,1 32 3087 /tmp/valgrind_proc_86246_cmdline_85358a06 (deleted) 2023-11-05T08:43:33.356 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root *526u REG 8,1 336 3088 /tmp/valgrind_proc_86246_auxv_85358a06 (deleted) 2023-11-05T08:43:33.356 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root *527w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:33.356 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root *528w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:33.356 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root *529r FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:33.357 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root *530w FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:33.357 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89468 tp_osd_tp root *531r FIFO 8,1 0t0 3091 /tmp/vgdb-pipe-from-vgdb-to-86246-by-root-on-??? 2023-11-05T08:43:33.357 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root cwd DIR 8,1 4096 265785 /home/ubuntu/cephtest 2023-11-05T08:43:33.357 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:33.357 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-05T08:43:33.358 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:33.358 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:33.358 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-05T08:43:33.358 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-05T08:43:33.358 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root mem REG 8,1 15752 265597 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-05T08:43:33.358 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-05T08:43:33.359 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-05T08:43:33.359 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-05T08:43:33.359 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-05T08:43:33.359 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-05T08:43:33.359 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-05T08:43:33.360 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:33.360 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-05T08:43:33.360 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-05T08:43:33.360 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:33.360 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-05T08:43:33.360 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-05T08:43:33.361 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-05T08:43:33.361 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-05T08:43:33.361 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-05T08:43:33.361 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-05T08:43:33.361 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:33.362 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:33.362 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:33.362 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-05T08:43:33.362 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-05T08:43:33.362 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-05T08:43:33.363 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-05T08:43:33.363 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-05T08:43:33.363 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-05T08:43:33.363 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-05T08:43:33.363 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-05T08:43:33.363 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-05T08:43:33.364 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-05T08:43:33.364 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-05T08:43:33.364 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-05T08:43:33.364 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-05T08:43:33.364 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-05T08:43:33.365 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-05T08:43:33.365 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-05T08:43:33.365 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-05T08:43:33.365 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-05T08:43:33.365 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-05T08:43:33.366 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-05T08:43:33.366 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-05T08:43:33.366 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:33.366 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-05T08:43:33.366 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:33.366 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-05T08:43:33.367 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-05T08:43:33.367 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-05T08:43:33.367 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-05T08:43:33.367 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-05T08:43:33.367 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root mem REG 8,1 83456 265542 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-05T08:43:33.368 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root mem REG 8,1 370416 265532 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-05T08:43:33.368 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root mem REG 8,1 1481856 265536 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-05T08:43:33.368 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root mem REG 8,1 45648 265517 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-05T08:43:33.368 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root mem REG 8,1 41304 265576 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-05T08:43:33.368 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root mem REG 8,1 49912 265561 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-05T08:43:33.369 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root mem REG 8,1 418096 265585 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-05T08:43:33.369 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root mem REG 8,1 83208 265579 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-05T08:43:33.369 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-05T08:43:33.369 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root mem REG 8,1 79224 265555 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-05T08:43:33.369 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root mem REG 8,1 49744 265609 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-05T08:43:33.369 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root mem REG 8,1 49856 265552 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-05T08:43:33.370 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root mem REG 8,1 83632 265549 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-05T08:43:33.370 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root mem REG 8,1 78744 265606 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-05T08:43:33.370 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root mem REG 8,1 53880 265603 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-05T08:43:33.370 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root mem REG 8,1 872944 265588 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-05T08:43:33.370 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root mem REG 8,1 116592 265558 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-05T08:43:33.371 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-05T08:43:33.371 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root mem REG 8,1 1242808 265591 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-05T08:43:33.371 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root mem REG 8,1 62224 265570 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-05T08:43:33.371 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root mem REG 8,1 95808 265564 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-05T08:43:33.371 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root mem REG 8,1 37272 265600 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-05T08:43:33.371 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root mem REG 8,1 104024 265582 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-05T08:43:33.372 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root mem REG 8,1 133480 265546 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-05T08:43:33.372 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root mem REG 8,1 834760 265573 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-05T08:43:33.372 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-05T08:43:33.372 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root mem REG 8,1 129280 265594 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-05T08:43:33.372 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root mem REG 8,1 83224 265567 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-05T08:43:33.373 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root mem REG 8,1 48 3081 /tmp/vgdb-pipe-shared-mem-vgdb-86246-by-root-on-??? 2023-11-05T08:43:33.373 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root DEL REG 0,17 182056 /[aio] 2023-11-05T08:43:33.373 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root DEL REG 0,17 182868 /[aio] 2023-11-05T08:43:33.373 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:33.373 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root 1w FIFO 0,13 0t0 182740 pipe 2023-11-05T08:43:33.374 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root 2w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:33.374 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root 3w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:33.374 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root 4r FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:33.374 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root 5w FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:33.374 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root 6u a_inode 0,14 0 1084 [eventpoll:7,20,21,22,23,24,25,26,27,66] 2023-11-05T08:43:33.375 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root 7r FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:33.375 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root 8w FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:33.375 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root 9u a_inode 0,14 0 1084 [eventpoll:10,67] 2023-11-05T08:43:33.375 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root 10r FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:33.375 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root 11w FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:33.375 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root 12u a_inode 0,14 0 1084 [eventpoll:13] 2023-11-05T08:43:33.376 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root 13r FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:33.376 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root 14w FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:33.376 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root 15w REG 8,1 465910012 276998 /var/log/ceph/ceph-osd.7.log 2023-11-05T08:43:33.376 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root 16uW REG 0,24 6 1974 /run/ceph/ceph-osd.7.pid 2023-11-05T08:43:33.376 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root 17r FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:33.377 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root 18w FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:33.377 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root 19u unix 0xffff8da307b0b300 0t0 187412 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-05T08:43:33.377 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root 20u IPv4 185761 0t0 TCP *:6802 (LISTEN) 2023-11-05T08:43:33.377 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root 21u IPv4 185765 0t0 TCP *:6803 (LISTEN) 2023-11-05T08:43:33.377 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root 22u IPv4 185770 0t0 TCP *:6804 (LISTEN) 2023-11-05T08:43:33.378 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root 23u IPv4 185776 0t0 TCP *:6805 (LISTEN) 2023-11-05T08:43:33.378 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root 24u IPv4 185783 0t0 TCP *:6806 (LISTEN) 2023-11-05T08:43:33.378 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root 25u IPv4 185791 0t0 TCP *:6807 (LISTEN) 2023-11-05T08:43:33.378 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root 26u IPv4 185800 0t0 TCP *:6808 (LISTEN) 2023-11-05T08:43:33.378 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root 27u IPv4 185810 0t0 TCP *:6809 (LISTEN) 2023-11-05T08:43:33.378 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root 28r FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:33.379 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root 29w FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:33.379 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root 30r FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:33.379 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root 31w FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:33.379 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root 32u sock 0,8 0t0 182041 protocol: UDPv6 2023-11-05T08:43:33.379 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-05T08:43:33.380 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-05T08:43:33.380 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.380 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.380 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.380 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.380 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.381 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.381 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.381 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.381 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.381 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.381 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.382 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.382 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.382 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.382 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.382 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.383 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.383 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.383 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.383 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.383 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.384 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.384 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.384 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.384 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root 60r FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:33.384 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root 61w FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:33.384 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root 62r FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:33.385 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root 63w FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:33.385 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root 66u IPv4 199302 0t0 TCP smithi156.front.sepia.ceph.com:56964->smithi156.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-05T08:43:33.385 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root 67u IPv4 199303 0t0 TCP smithi156.front.sepia.ceph.com:6802->smithi156.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-05T08:43:33.385 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:33.385 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root *525u REG 8,1 32 3087 /tmp/valgrind_proc_86246_cmdline_85358a06 (deleted) 2023-11-05T08:43:33.386 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root *526u REG 8,1 336 3088 /tmp/valgrind_proc_86246_auxv_85358a06 (deleted) 2023-11-05T08:43:33.386 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root *527w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:33.386 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root *528w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:33.386 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root *529r FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:33.386 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root *530w FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:33.386 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89472 tp_osd_tp root *531r FIFO 8,1 0t0 3091 /tmp/vgdb-pipe-from-vgdb-to-86246-by-root-on-??? 2023-11-05T08:43:33.387 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root cwd DIR 8,1 4096 265785 /home/ubuntu/cephtest 2023-11-05T08:43:33.387 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:33.387 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-05T08:43:33.387 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:33.387 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:33.388 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-05T08:43:33.388 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-05T08:43:33.388 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root mem REG 8,1 15752 265597 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-05T08:43:33.388 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-05T08:43:33.388 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-05T08:43:33.389 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-05T08:43:33.389 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-05T08:43:33.389 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-05T08:43:33.389 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-05T08:43:33.389 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:33.389 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-05T08:43:33.390 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-05T08:43:33.390 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:33.390 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-05T08:43:33.390 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-05T08:43:33.390 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-05T08:43:33.391 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-05T08:43:33.391 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-05T08:43:33.391 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-05T08:43:33.391 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:33.391 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:33.391 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:33.392 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-05T08:43:33.392 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-05T08:43:33.392 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-05T08:43:33.392 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-05T08:43:33.392 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-05T08:43:33.393 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-05T08:43:33.393 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-05T08:43:33.393 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-05T08:43:33.393 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-05T08:43:33.393 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-05T08:43:33.394 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-05T08:43:33.394 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-05T08:43:33.394 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-05T08:43:33.394 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-05T08:43:33.394 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-05T08:43:33.394 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-05T08:43:33.395 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-05T08:43:33.395 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-05T08:43:33.395 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-05T08:43:33.395 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-05T08:43:33.395 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-05T08:43:33.396 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:33.396 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-05T08:43:33.396 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:33.396 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-05T08:43:33.396 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-05T08:43:33.396 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-05T08:43:33.397 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-05T08:43:33.397 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-05T08:43:33.397 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root mem REG 8,1 83456 265542 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-05T08:43:33.397 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root mem REG 8,1 370416 265532 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-05T08:43:33.397 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root mem REG 8,1 1481856 265536 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-05T08:43:33.398 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root mem REG 8,1 45648 265517 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-05T08:43:33.398 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root mem REG 8,1 41304 265576 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-05T08:43:33.398 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root mem REG 8,1 49912 265561 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-05T08:43:33.398 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root mem REG 8,1 418096 265585 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-05T08:43:33.398 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root mem REG 8,1 83208 265579 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-05T08:43:33.399 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-05T08:43:33.399 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root mem REG 8,1 79224 265555 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-05T08:43:33.399 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root mem REG 8,1 49744 265609 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-05T08:43:33.399 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root mem REG 8,1 49856 265552 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-05T08:43:33.399 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root mem REG 8,1 83632 265549 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-05T08:43:33.400 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root mem REG 8,1 78744 265606 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-05T08:43:33.400 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root mem REG 8,1 53880 265603 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-05T08:43:33.400 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root mem REG 8,1 872944 265588 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-05T08:43:33.400 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root mem REG 8,1 116592 265558 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-05T08:43:33.400 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-05T08:43:33.400 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root mem REG 8,1 1242808 265591 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-05T08:43:33.401 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root mem REG 8,1 62224 265570 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-05T08:43:33.401 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root mem REG 8,1 95808 265564 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-05T08:43:33.401 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root mem REG 8,1 37272 265600 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-05T08:43:33.401 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root mem REG 8,1 104024 265582 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-05T08:43:33.401 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root mem REG 8,1 133480 265546 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-05T08:43:33.402 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root mem REG 8,1 834760 265573 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-05T08:43:33.402 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-05T08:43:33.402 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root mem REG 8,1 129280 265594 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-05T08:43:33.402 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root mem REG 8,1 83224 265567 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-05T08:43:33.402 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root mem REG 8,1 48 3081 /tmp/vgdb-pipe-shared-mem-vgdb-86246-by-root-on-??? 2023-11-05T08:43:33.403 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root DEL REG 0,17 182056 /[aio] 2023-11-05T08:43:33.403 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root DEL REG 0,17 182868 /[aio] 2023-11-05T08:43:33.403 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:33.403 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root 1w FIFO 0,13 0t0 182740 pipe 2023-11-05T08:43:33.403 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root 2w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:33.403 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root 3w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:33.404 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root 4r FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:33.404 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root 5w FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:33.404 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root 6u a_inode 0,14 0 1084 [eventpoll:7,20,21,22,23,24,25,26,27,66] 2023-11-05T08:43:33.404 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root 7r FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:33.404 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root 8w FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:33.405 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root 9u a_inode 0,14 0 1084 [eventpoll:10,67] 2023-11-05T08:43:33.405 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root 10r FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:33.405 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root 11w FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:33.405 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root 12u a_inode 0,14 0 1084 [eventpoll:13] 2023-11-05T08:43:33.405 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root 13r FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:33.405 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root 14w FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:33.406 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root 15w REG 8,1 465910012 276998 /var/log/ceph/ceph-osd.7.log 2023-11-05T08:43:33.406 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root 16uW REG 0,24 6 1974 /run/ceph/ceph-osd.7.pid 2023-11-05T08:43:33.406 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root 17r FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:33.406 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root 18w FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:33.406 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root 19u unix 0xffff8da307b0b300 0t0 187412 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-05T08:43:33.407 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root 20u IPv4 185761 0t0 TCP *:6802 (LISTEN) 2023-11-05T08:43:33.407 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root 21u IPv4 185765 0t0 TCP *:6803 (LISTEN) 2023-11-05T08:43:33.407 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root 22u IPv4 185770 0t0 TCP *:6804 (LISTEN) 2023-11-05T08:43:33.407 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root 23u IPv4 185776 0t0 TCP *:6805 (LISTEN) 2023-11-05T08:43:33.407 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root 24u IPv4 185783 0t0 TCP *:6806 (LISTEN) 2023-11-05T08:43:33.407 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root 25u IPv4 185791 0t0 TCP *:6807 (LISTEN) 2023-11-05T08:43:33.408 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root 26u IPv4 185800 0t0 TCP *:6808 (LISTEN) 2023-11-05T08:43:33.408 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root 27u IPv4 185810 0t0 TCP *:6809 (LISTEN) 2023-11-05T08:43:33.408 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root 28r FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:33.408 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root 29w FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:33.408 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root 30r FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:33.409 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root 31w FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:33.409 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root 32u sock 0,8 0t0 182041 protocol: UDPv6 2023-11-05T08:43:33.409 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-05T08:43:33.409 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-05T08:43:33.409 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.410 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.410 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.410 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.410 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.410 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.410 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.411 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.411 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.411 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.411 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.411 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.412 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.412 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.412 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.412 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.412 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.412 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.413 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.413 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.413 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.413 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.413 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.414 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.414 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root 60r FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:33.414 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root 61w FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:33.414 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root 62r FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:33.414 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root 63w FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:33.415 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root 66u IPv4 199302 0t0 TCP smithi156.front.sepia.ceph.com:56964->smithi156.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-05T08:43:33.415 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root 67u IPv4 199303 0t0 TCP smithi156.front.sepia.ceph.com:6802->smithi156.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-05T08:43:33.415 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:33.415 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root *525u REG 8,1 32 3087 /tmp/valgrind_proc_86246_cmdline_85358a06 (deleted) 2023-11-05T08:43:33.415 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root *526u REG 8,1 336 3088 /tmp/valgrind_proc_86246_auxv_85358a06 (deleted) 2023-11-05T08:43:33.415 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root *527w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:33.416 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root *528w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:33.416 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root *529r FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:33.416 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root *530w FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:33.416 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89476 tp_osd_tp root *531r FIFO 8,1 0t0 3091 /tmp/vgdb-pipe-from-vgdb-to-86246-by-root-on-??? 2023-11-05T08:43:33.416 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root cwd DIR 8,1 4096 265785 /home/ubuntu/cephtest 2023-11-05T08:43:33.417 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:33.417 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-05T08:43:33.417 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:33.417 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:33.417 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-05T08:43:33.417 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-05T08:43:33.418 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root mem REG 8,1 15752 265597 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-05T08:43:33.418 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-05T08:43:33.418 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-05T08:43:33.418 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-05T08:43:33.418 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-05T08:43:33.419 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-05T08:43:33.419 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-05T08:43:33.419 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:33.419 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-05T08:43:33.419 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-05T08:43:33.420 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:33.420 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-05T08:43:33.420 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-05T08:43:33.420 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-05T08:43:33.420 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-05T08:43:33.420 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-05T08:43:33.421 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-05T08:43:33.421 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:33.421 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:33.421 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:33.421 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-05T08:43:33.422 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-05T08:43:33.422 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-05T08:43:33.422 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-05T08:43:33.422 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-05T08:43:33.422 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-05T08:43:33.422 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-05T08:43:33.423 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-05T08:43:33.423 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-05T08:43:33.423 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-05T08:43:33.423 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-05T08:43:33.423 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-05T08:43:33.424 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-05T08:43:33.424 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-05T08:43:33.424 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-05T08:43:33.424 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-05T08:43:33.424 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-05T08:43:33.424 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-05T08:43:33.425 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-05T08:43:33.425 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-05T08:43:33.425 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-05T08:43:33.425 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:33.425 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-05T08:43:33.426 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:33.426 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-05T08:43:33.426 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-05T08:43:33.426 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-05T08:43:33.426 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-05T08:43:33.427 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-05T08:43:33.427 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root mem REG 8,1 83456 265542 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-05T08:43:33.427 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root mem REG 8,1 370416 265532 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-05T08:43:33.427 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root mem REG 8,1 1481856 265536 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-05T08:43:33.427 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root mem REG 8,1 45648 265517 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-05T08:43:33.427 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root mem REG 8,1 41304 265576 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-05T08:43:33.428 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root mem REG 8,1 49912 265561 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-05T08:43:33.428 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root mem REG 8,1 418096 265585 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-05T08:43:33.428 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root mem REG 8,1 83208 265579 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-05T08:43:33.428 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-05T08:43:33.428 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root mem REG 8,1 79224 265555 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-05T08:43:33.429 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root mem REG 8,1 49744 265609 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-05T08:43:33.429 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root mem REG 8,1 49856 265552 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-05T08:43:33.429 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root mem REG 8,1 83632 265549 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-05T08:43:33.429 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root mem REG 8,1 78744 265606 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-05T08:43:33.429 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root mem REG 8,1 53880 265603 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-05T08:43:33.429 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root mem REG 8,1 872944 265588 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-05T08:43:33.430 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root mem REG 8,1 116592 265558 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-05T08:43:33.430 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-05T08:43:33.430 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root mem REG 8,1 1242808 265591 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-05T08:43:33.430 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root mem REG 8,1 62224 265570 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-05T08:43:33.430 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root mem REG 8,1 95808 265564 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-05T08:43:33.431 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root mem REG 8,1 37272 265600 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-05T08:43:33.431 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root mem REG 8,1 104024 265582 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-05T08:43:33.431 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root mem REG 8,1 133480 265546 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-05T08:43:33.431 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root mem REG 8,1 834760 265573 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-05T08:43:33.431 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-05T08:43:33.431 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root mem REG 8,1 129280 265594 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-05T08:43:33.432 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root mem REG 8,1 83224 265567 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-05T08:43:33.432 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root mem REG 8,1 48 3081 /tmp/vgdb-pipe-shared-mem-vgdb-86246-by-root-on-??? 2023-11-05T08:43:33.432 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root DEL REG 0,17 182056 /[aio] 2023-11-05T08:43:33.432 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root DEL REG 0,17 182868 /[aio] 2023-11-05T08:43:33.432 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:33.433 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root 1w FIFO 0,13 0t0 182740 pipe 2023-11-05T08:43:33.433 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root 2w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:33.433 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root 3w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:33.433 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root 4r FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:33.433 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root 5w FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:33.434 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root 6u a_inode 0,14 0 1084 [eventpoll:7,20,21,22,23,24,25,26,27,66] 2023-11-05T08:43:33.434 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root 7r FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:33.434 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root 8w FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:33.434 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root 9u a_inode 0,14 0 1084 [eventpoll:10,67] 2023-11-05T08:43:33.434 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root 10r FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:33.434 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root 11w FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:33.435 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root 12u a_inode 0,14 0 1084 [eventpoll:13] 2023-11-05T08:43:33.435 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root 13r FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:33.435 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root 14w FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:33.435 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root 15w REG 8,1 465910012 276998 /var/log/ceph/ceph-osd.7.log 2023-11-05T08:43:33.435 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root 16uW REG 0,24 6 1974 /run/ceph/ceph-osd.7.pid 2023-11-05T08:43:33.436 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root 17r FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:33.436 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root 18w FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:33.436 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root 19u unix 0xffff8da307b0b300 0t0 187412 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-05T08:43:33.436 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root 20u IPv4 185761 0t0 TCP *:6802 (LISTEN) 2023-11-05T08:43:33.436 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root 21u IPv4 185765 0t0 TCP *:6803 (LISTEN) 2023-11-05T08:43:33.436 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root 22u IPv4 185770 0t0 TCP *:6804 (LISTEN) 2023-11-05T08:43:33.437 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root 23u IPv4 185776 0t0 TCP *:6805 (LISTEN) 2023-11-05T08:43:33.437 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root 24u IPv4 185783 0t0 TCP *:6806 (LISTEN) 2023-11-05T08:43:33.437 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root 25u IPv4 185791 0t0 TCP *:6807 (LISTEN) 2023-11-05T08:43:33.437 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root 26u IPv4 185800 0t0 TCP *:6808 (LISTEN) 2023-11-05T08:43:33.437 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root 27u IPv4 185810 0t0 TCP *:6809 (LISTEN) 2023-11-05T08:43:33.438 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root 28r FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:33.438 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root 29w FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:33.438 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root 30r FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:33.438 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root 31w FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:33.438 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root 32u sock 0,8 0t0 182041 protocol: UDPv6 2023-11-05T08:43:33.439 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-05T08:43:33.439 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-05T08:43:33.439 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.439 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.439 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.439 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.440 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.440 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.440 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.440 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.440 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.441 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.441 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.441 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.441 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.441 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.441 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.442 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.442 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.442 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.442 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.442 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.443 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.443 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.443 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.443 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.443 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root 60r FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:33.443 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root 61w FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:33.444 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root 62r FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:33.444 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root 63w FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:33.444 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root 66u IPv4 199302 0t0 TCP smithi156.front.sepia.ceph.com:56964->smithi156.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-05T08:43:33.444 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root 67u IPv4 199303 0t0 TCP smithi156.front.sepia.ceph.com:6802->smithi156.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-05T08:43:33.444 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:33.445 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root *525u REG 8,1 32 3087 /tmp/valgrind_proc_86246_cmdline_85358a06 (deleted) 2023-11-05T08:43:33.445 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root *526u REG 8,1 336 3088 /tmp/valgrind_proc_86246_auxv_85358a06 (deleted) 2023-11-05T08:43:33.445 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root *527w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:33.445 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root *528w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:33.445 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root *529r FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:33.446 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root *530w FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:33.446 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89482 tp_osd_tp root *531r FIFO 8,1 0t0 3091 /tmp/vgdb-pipe-from-vgdb-to-86246-by-root-on-??? 2023-11-05T08:43:33.446 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root cwd DIR 8,1 4096 265785 /home/ubuntu/cephtest 2023-11-05T08:43:33.446 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:33.446 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-05T08:43:33.447 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:33.447 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:33.447 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-05T08:43:33.447 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-05T08:43:33.447 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root mem REG 8,1 15752 265597 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-05T08:43:33.447 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-05T08:43:33.448 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-05T08:43:33.448 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-05T08:43:33.448 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-05T08:43:33.448 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-05T08:43:33.448 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-05T08:43:33.448 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:33.449 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-05T08:43:33.449 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-05T08:43:33.449 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:33.449 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-05T08:43:33.449 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-05T08:43:33.450 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-05T08:43:33.450 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-05T08:43:33.450 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-05T08:43:33.450 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-05T08:43:33.450 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:33.450 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:33.451 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:33.451 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-05T08:43:33.451 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-05T08:43:33.451 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-05T08:43:33.451 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-05T08:43:33.452 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-05T08:43:33.452 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-05T08:43:33.452 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-05T08:43:33.452 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-05T08:43:33.452 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-05T08:43:33.452 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-05T08:43:33.453 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-05T08:43:33.453 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-05T08:43:33.453 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-05T08:43:33.453 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-05T08:43:33.453 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-05T08:43:33.454 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-05T08:43:33.454 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-05T08:43:33.454 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-05T08:43:33.454 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-05T08:43:33.454 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-05T08:43:33.455 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-05T08:43:33.455 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:33.455 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-05T08:43:33.455 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:33.455 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-05T08:43:33.455 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-05T08:43:33.456 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-05T08:43:33.456 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-05T08:43:33.456 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-05T08:43:33.456 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root mem REG 8,1 83456 265542 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-05T08:43:33.456 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root mem REG 8,1 370416 265532 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-05T08:43:33.457 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root mem REG 8,1 1481856 265536 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-05T08:43:33.457 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root mem REG 8,1 45648 265517 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-05T08:43:33.457 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root mem REG 8,1 41304 265576 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-05T08:43:33.457 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root mem REG 8,1 49912 265561 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-05T08:43:33.457 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root mem REG 8,1 418096 265585 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-05T08:43:33.457 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root mem REG 8,1 83208 265579 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-05T08:43:33.458 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-05T08:43:33.458 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root mem REG 8,1 79224 265555 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-05T08:43:33.458 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root mem REG 8,1 49744 265609 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-05T08:43:33.458 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root mem REG 8,1 49856 265552 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-05T08:43:33.458 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root mem REG 8,1 83632 265549 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-05T08:43:33.459 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root mem REG 8,1 78744 265606 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-05T08:43:33.459 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root mem REG 8,1 53880 265603 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-05T08:43:33.459 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root mem REG 8,1 872944 265588 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-05T08:43:33.459 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root mem REG 8,1 116592 265558 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-05T08:43:33.459 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-05T08:43:33.459 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root mem REG 8,1 1242808 265591 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-05T08:43:33.460 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root mem REG 8,1 62224 265570 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-05T08:43:33.460 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root mem REG 8,1 95808 265564 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-05T08:43:33.460 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root mem REG 8,1 37272 265600 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-05T08:43:33.460 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root mem REG 8,1 104024 265582 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-05T08:43:33.460 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root mem REG 8,1 133480 265546 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-05T08:43:33.461 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root mem REG 8,1 834760 265573 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-05T08:43:33.461 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-05T08:43:33.461 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root mem REG 8,1 129280 265594 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-05T08:43:33.461 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root mem REG 8,1 83224 265567 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-05T08:43:33.461 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root mem REG 8,1 48 3081 /tmp/vgdb-pipe-shared-mem-vgdb-86246-by-root-on-??? 2023-11-05T08:43:33.462 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root DEL REG 0,17 182056 /[aio] 2023-11-05T08:43:33.462 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root DEL REG 0,17 182868 /[aio] 2023-11-05T08:43:33.462 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:33.462 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root 1w FIFO 0,13 0t0 182740 pipe 2023-11-05T08:43:33.462 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root 2w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:33.462 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root 3w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:33.463 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root 4r FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:33.463 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root 5w FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:33.463 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root 6u a_inode 0,14 0 1084 [eventpoll:7,20,21,22,23,24,25,26,27,66] 2023-11-05T08:43:33.463 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root 7r FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:33.463 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root 8w FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:33.464 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root 9u a_inode 0,14 0 1084 [eventpoll:10,67] 2023-11-05T08:43:33.464 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root 10r FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:33.464 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root 11w FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:33.464 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root 12u a_inode 0,14 0 1084 [eventpoll:13] 2023-11-05T08:43:33.464 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root 13r FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:33.464 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root 14w FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:33.465 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root 15w REG 8,1 465910012 276998 /var/log/ceph/ceph-osd.7.log 2023-11-05T08:43:33.465 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root 16uW REG 0,24 6 1974 /run/ceph/ceph-osd.7.pid 2023-11-05T08:43:33.465 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root 17r FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:33.465 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root 18w FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:33.465 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root 19u unix 0xffff8da307b0b300 0t0 187412 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-05T08:43:33.466 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root 20u IPv4 185761 0t0 TCP *:6802 (LISTEN) 2023-11-05T08:43:33.466 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root 21u IPv4 185765 0t0 TCP *:6803 (LISTEN) 2023-11-05T08:43:33.466 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root 22u IPv4 185770 0t0 TCP *:6804 (LISTEN) 2023-11-05T08:43:33.466 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root 23u IPv4 185776 0t0 TCP *:6805 (LISTEN) 2023-11-05T08:43:33.466 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root 24u IPv4 185783 0t0 TCP *:6806 (LISTEN) 2023-11-05T08:43:33.466 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root 25u IPv4 185791 0t0 TCP *:6807 (LISTEN) 2023-11-05T08:43:33.467 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root 26u IPv4 185800 0t0 TCP *:6808 (LISTEN) 2023-11-05T08:43:33.467 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root 27u IPv4 185810 0t0 TCP *:6809 (LISTEN) 2023-11-05T08:43:33.467 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root 28r FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:33.467 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root 29w FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:33.467 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root 30r FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:33.468 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root 31w FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:33.468 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root 32u sock 0,8 0t0 182041 protocol: UDPv6 2023-11-05T08:43:33.468 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-05T08:43:33.468 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-05T08:43:33.468 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.469 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.469 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.469 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.469 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.469 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.469 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.470 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.470 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.470 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.470 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.470 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.471 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.471 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.471 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.471 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.471 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.471 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.472 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.472 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.472 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.472 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.472 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.473 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.473 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root 60r FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:33.473 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root 61w FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:33.473 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root 62r FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:33.473 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root 63w FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:33.473 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root 66u IPv4 199302 0t0 TCP smithi156.front.sepia.ceph.com:56964->smithi156.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-05T08:43:33.474 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root 67u IPv4 199303 0t0 TCP smithi156.front.sepia.ceph.com:6802->smithi156.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-05T08:43:33.474 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:33.474 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root *525u REG 8,1 32 3087 /tmp/valgrind_proc_86246_cmdline_85358a06 (deleted) 2023-11-05T08:43:33.474 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root *526u REG 8,1 336 3088 /tmp/valgrind_proc_86246_auxv_85358a06 (deleted) 2023-11-05T08:43:33.474 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root *527w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:33.475 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root *528w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:33.475 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root *529r FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:33.475 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root *530w FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:33.475 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89486 tp_osd_tp root *531r FIFO 8,1 0t0 3091 /tmp/vgdb-pipe-from-vgdb-to-86246-by-root-on-??? 2023-11-05T08:43:33.477 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root cwd DIR 8,1 4096 265785 /home/ubuntu/cephtest 2023-11-05T08:43:33.477 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:33.477 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-05T08:43:33.477 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:33.477 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:33.478 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-05T08:43:33.478 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-05T08:43:33.478 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root mem REG 8,1 15752 265597 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-05T08:43:33.478 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-05T08:43:33.478 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-05T08:43:33.479 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-05T08:43:33.479 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-05T08:43:33.479 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-05T08:43:33.479 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-05T08:43:33.479 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:33.480 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-05T08:43:33.480 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-05T08:43:33.480 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:33.480 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-05T08:43:33.480 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-05T08:43:33.480 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-05T08:43:33.481 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-05T08:43:33.481 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-05T08:43:33.481 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-05T08:43:33.481 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:33.481 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:33.482 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:33.482 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-05T08:43:33.482 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-05T08:43:33.482 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-05T08:43:33.482 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-05T08:43:33.482 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-05T08:43:33.483 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-05T08:43:33.483 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-05T08:43:33.483 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-05T08:43:33.483 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-05T08:43:33.483 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-05T08:43:33.484 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-05T08:43:33.484 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-05T08:43:33.484 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-05T08:43:33.484 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-05T08:43:33.484 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-05T08:43:33.484 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-05T08:43:33.485 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-05T08:43:33.485 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-05T08:43:33.485 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-05T08:43:33.485 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-05T08:43:33.485 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-05T08:43:33.485 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:33.486 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-05T08:43:33.486 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:33.486 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-05T08:43:33.486 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-05T08:43:33.486 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-05T08:43:33.487 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-05T08:43:33.487 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-05T08:43:33.487 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root mem REG 8,1 83456 265542 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-05T08:43:33.487 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root mem REG 8,1 370416 265532 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-05T08:43:33.487 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root mem REG 8,1 1481856 265536 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-05T08:43:33.487 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root mem REG 8,1 45648 265517 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-05T08:43:33.488 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root mem REG 8,1 41304 265576 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-05T08:43:33.488 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root mem REG 8,1 49912 265561 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-05T08:43:33.488 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root mem REG 8,1 418096 265585 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-05T08:43:33.488 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root mem REG 8,1 83208 265579 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-05T08:43:33.488 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-05T08:43:33.489 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root mem REG 8,1 79224 265555 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-05T08:43:33.489 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root mem REG 8,1 49744 265609 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-05T08:43:33.489 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root mem REG 8,1 49856 265552 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-05T08:43:33.489 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root mem REG 8,1 83632 265549 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-05T08:43:33.489 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root mem REG 8,1 78744 265606 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-05T08:43:33.489 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root mem REG 8,1 53880 265603 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-05T08:43:33.490 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root mem REG 8,1 872944 265588 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-05T08:43:33.490 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root mem REG 8,1 116592 265558 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-05T08:43:33.490 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-05T08:43:33.490 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root mem REG 8,1 1242808 265591 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-05T08:43:33.490 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root mem REG 8,1 62224 265570 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-05T08:43:33.491 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root mem REG 8,1 95808 265564 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-05T08:43:33.491 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root mem REG 8,1 37272 265600 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-05T08:43:33.491 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root mem REG 8,1 104024 265582 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-05T08:43:33.491 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root mem REG 8,1 133480 265546 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-05T08:43:33.491 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root mem REG 8,1 834760 265573 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-05T08:43:33.492 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-05T08:43:33.492 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root mem REG 8,1 129280 265594 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-05T08:43:33.492 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root mem REG 8,1 83224 265567 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-05T08:43:33.492 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root mem REG 8,1 48 3081 /tmp/vgdb-pipe-shared-mem-vgdb-86246-by-root-on-??? 2023-11-05T08:43:33.492 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root DEL REG 0,17 182056 /[aio] 2023-11-05T08:43:33.492 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root DEL REG 0,17 182868 /[aio] 2023-11-05T08:43:33.493 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:33.493 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root 1w FIFO 0,13 0t0 182740 pipe 2023-11-05T08:43:33.493 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root 2w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:33.493 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root 3w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:33.493 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root 4r FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:33.494 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root 5w FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:33.494 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root 6u a_inode 0,14 0 1084 [eventpoll:7,20,21,22,23,24,25,26,27,66] 2023-11-05T08:43:33.494 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root 7r FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:33.494 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root 8w FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:33.494 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root 9u a_inode 0,14 0 1084 [eventpoll:10,67] 2023-11-05T08:43:33.494 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root 10r FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:33.495 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root 11w FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:33.495 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root 12u a_inode 0,14 0 1084 [eventpoll:13] 2023-11-05T08:43:33.495 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root 13r FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:33.495 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root 14w FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:33.495 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root 15w REG 8,1 465910012 276998 /var/log/ceph/ceph-osd.7.log 2023-11-05T08:43:33.496 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root 16uW REG 0,24 6 1974 /run/ceph/ceph-osd.7.pid 2023-11-05T08:43:33.496 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root 17r FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:33.496 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root 18w FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:33.496 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root 19u unix 0xffff8da307b0b300 0t0 187412 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-05T08:43:33.496 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root 20u IPv4 185761 0t0 TCP *:6802 (LISTEN) 2023-11-05T08:43:33.496 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root 21u IPv4 185765 0t0 TCP *:6803 (LISTEN) 2023-11-05T08:43:33.497 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root 22u IPv4 185770 0t0 TCP *:6804 (LISTEN) 2023-11-05T08:43:33.497 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root 23u IPv4 185776 0t0 TCP *:6805 (LISTEN) 2023-11-05T08:43:33.497 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root 24u IPv4 185783 0t0 TCP *:6806 (LISTEN) 2023-11-05T08:43:33.497 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root 25u IPv4 185791 0t0 TCP *:6807 (LISTEN) 2023-11-05T08:43:33.497 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root 26u IPv4 185800 0t0 TCP *:6808 (LISTEN) 2023-11-05T08:43:33.498 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root 27u IPv4 185810 0t0 TCP *:6809 (LISTEN) 2023-11-05T08:43:33.498 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root 28r FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:33.498 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root 29w FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:33.498 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root 30r FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:33.498 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root 31w FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:33.498 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root 32u sock 0,8 0t0 182041 protocol: UDPv6 2023-11-05T08:43:33.499 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-05T08:43:33.499 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-05T08:43:33.499 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.499 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.499 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.500 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.500 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.500 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.500 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.500 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.500 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.501 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.501 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.501 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.501 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.501 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.502 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.502 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.502 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.502 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.502 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.502 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.503 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.503 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.503 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.503 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.503 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root 60r FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:33.504 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root 61w FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:33.504 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root 62r FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:33.504 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root 63w FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:33.504 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root 66u IPv4 199302 0t0 TCP smithi156.front.sepia.ceph.com:56964->smithi156.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-05T08:43:33.504 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root 67u IPv4 199303 0t0 TCP smithi156.front.sepia.ceph.com:6802->smithi156.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-05T08:43:33.505 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:33.505 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root *525u REG 8,1 32 3087 /tmp/valgrind_proc_86246_cmdline_85358a06 (deleted) 2023-11-05T08:43:33.505 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root *526u REG 8,1 336 3088 /tmp/valgrind_proc_86246_auxv_85358a06 (deleted) 2023-11-05T08:43:33.505 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root *527w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:33.505 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root *528w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:33.505 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root *529r FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:33.506 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root *530w FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:33.506 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89490 tp_osd_tp root *531r FIFO 8,1 0t0 3091 /tmp/vgdb-pipe-from-vgdb-to-86246-by-root-on-??? 2023-11-05T08:43:33.506 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root cwd DIR 8,1 4096 265785 /home/ubuntu/cephtest 2023-11-05T08:43:33.506 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:33.506 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-05T08:43:33.507 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:33.507 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:33.507 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-05T08:43:33.507 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-05T08:43:33.507 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root mem REG 8,1 15752 265597 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-05T08:43:33.508 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-05T08:43:33.508 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-05T08:43:33.508 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-05T08:43:33.508 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-05T08:43:33.508 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-05T08:43:33.508 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-05T08:43:33.509 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:33.509 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-05T08:43:33.509 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-05T08:43:33.509 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:33.509 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-05T08:43:33.509 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-05T08:43:33.510 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-05T08:43:33.510 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-05T08:43:33.510 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-05T08:43:33.510 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-05T08:43:33.510 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:33.511 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:33.511 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:33.511 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-05T08:43:33.511 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-05T08:43:33.511 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-05T08:43:33.511 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-05T08:43:33.512 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-05T08:43:33.512 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-05T08:43:33.512 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-05T08:43:33.512 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-05T08:43:33.512 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-05T08:43:33.513 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-05T08:43:33.513 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-05T08:43:33.513 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-05T08:43:33.513 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-05T08:43:33.513 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-05T08:43:33.513 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-05T08:43:33.514 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-05T08:43:33.514 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-05T08:43:33.514 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-05T08:43:33.514 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-05T08:43:33.514 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-05T08:43:33.515 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-05T08:43:33.515 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:33.515 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-05T08:43:33.515 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:33.515 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-05T08:43:33.516 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-05T08:43:33.516 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-05T08:43:33.516 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-05T08:43:33.516 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-05T08:43:33.516 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root mem REG 8,1 83456 265542 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-05T08:43:33.516 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root mem REG 8,1 370416 265532 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-05T08:43:33.517 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root mem REG 8,1 1481856 265536 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-05T08:43:33.517 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root mem REG 8,1 45648 265517 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-05T08:43:33.517 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root mem REG 8,1 41304 265576 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-05T08:43:33.517 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root mem REG 8,1 49912 265561 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-05T08:43:33.517 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root mem REG 8,1 418096 265585 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-05T08:43:33.518 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root mem REG 8,1 83208 265579 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-05T08:43:33.518 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-05T08:43:33.518 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root mem REG 8,1 79224 265555 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-05T08:43:33.518 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root mem REG 8,1 49744 265609 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-05T08:43:33.518 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root mem REG 8,1 49856 265552 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-05T08:43:33.519 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root mem REG 8,1 83632 265549 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-05T08:43:33.519 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root mem REG 8,1 78744 265606 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-05T08:43:33.519 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root mem REG 8,1 53880 265603 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-05T08:43:33.519 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root mem REG 8,1 872944 265588 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-05T08:43:33.519 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root mem REG 8,1 116592 265558 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-05T08:43:33.519 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-05T08:43:33.520 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root mem REG 8,1 1242808 265591 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-05T08:43:33.520 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root mem REG 8,1 62224 265570 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-05T08:43:33.520 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root mem REG 8,1 95808 265564 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-05T08:43:33.520 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root mem REG 8,1 37272 265600 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-05T08:43:33.520 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root mem REG 8,1 104024 265582 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-05T08:43:33.521 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root mem REG 8,1 133480 265546 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-05T08:43:33.521 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root mem REG 8,1 834760 265573 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-05T08:43:33.521 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-05T08:43:33.521 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root mem REG 8,1 129280 265594 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-05T08:43:33.521 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root mem REG 8,1 83224 265567 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-05T08:43:33.521 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root mem REG 8,1 48 3081 /tmp/vgdb-pipe-shared-mem-vgdb-86246-by-root-on-??? 2023-11-05T08:43:33.522 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root DEL REG 0,17 182056 /[aio] 2023-11-05T08:43:33.522 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root DEL REG 0,17 182868 /[aio] 2023-11-05T08:43:33.522 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:33.522 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root 1w FIFO 0,13 0t0 182740 pipe 2023-11-05T08:43:33.522 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root 2w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:33.523 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root 3w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:33.523 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root 4r FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:33.523 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root 5w FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:33.523 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root 6u a_inode 0,14 0 1084 [eventpoll:7,20,21,22,23,24,25,26,27,66] 2023-11-05T08:43:33.523 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root 7r FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:33.523 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root 8w FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:33.524 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root 9u a_inode 0,14 0 1084 [eventpoll:10,67] 2023-11-05T08:43:33.524 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root 10r FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:33.524 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root 11w FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:33.524 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root 12u a_inode 0,14 0 1084 [eventpoll:13] 2023-11-05T08:43:33.524 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root 13r FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:33.525 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root 14w FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:33.525 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root 15w REG 8,1 465910012 276998 /var/log/ceph/ceph-osd.7.log 2023-11-05T08:43:33.525 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root 16uW REG 0,24 6 1974 /run/ceph/ceph-osd.7.pid 2023-11-05T08:43:33.525 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root 17r FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:33.525 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root 18w FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:33.525 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root 19u unix 0xffff8da307b0b300 0t0 187412 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-05T08:43:33.526 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root 20u IPv4 185761 0t0 TCP *:6802 (LISTEN) 2023-11-05T08:43:33.526 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root 21u IPv4 185765 0t0 TCP *:6803 (LISTEN) 2023-11-05T08:43:33.526 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root 22u IPv4 185770 0t0 TCP *:6804 (LISTEN) 2023-11-05T08:43:33.526 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root 23u IPv4 185776 0t0 TCP *:6805 (LISTEN) 2023-11-05T08:43:33.526 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root 24u IPv4 185783 0t0 TCP *:6806 (LISTEN) 2023-11-05T08:43:33.527 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root 25u IPv4 185791 0t0 TCP *:6807 (LISTEN) 2023-11-05T08:43:33.527 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root 26u IPv4 185800 0t0 TCP *:6808 (LISTEN) 2023-11-05T08:43:33.527 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root 27u IPv4 185810 0t0 TCP *:6809 (LISTEN) 2023-11-05T08:43:33.527 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root 28r FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:33.527 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root 29w FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:33.528 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root 30r FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:33.528 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root 31w FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:33.528 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root 32u sock 0,8 0t0 182041 protocol: UDPv6 2023-11-05T08:43:33.528 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-05T08:43:33.528 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-05T08:43:33.529 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.529 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.529 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.529 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.529 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.529 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.530 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.530 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.530 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.530 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.530 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.531 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.531 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.531 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.531 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.531 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.532 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.532 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.532 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.532 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.532 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.532 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.533 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.533 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.533 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root 60r FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:33.533 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root 61w FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:33.533 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root 62r FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:33.534 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root 63w FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:33.534 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root 66u IPv4 199302 0t0 TCP smithi156.front.sepia.ceph.com:56964->smithi156.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-05T08:43:33.534 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root 67u IPv4 199303 0t0 TCP smithi156.front.sepia.ceph.com:6802->smithi156.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-05T08:43:33.534 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:33.534 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root *525u REG 8,1 32 3087 /tmp/valgrind_proc_86246_cmdline_85358a06 (deleted) 2023-11-05T08:43:33.534 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root *526u REG 8,1 336 3088 /tmp/valgrind_proc_86246_auxv_85358a06 (deleted) 2023-11-05T08:43:33.535 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root *527w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:33.535 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root *528w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:33.535 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root *529r FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:33.535 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root *530w FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:33.535 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89492 tp_osd_tp root *531r FIFO 8,1 0t0 3091 /tmp/vgdb-pipe-from-vgdb-to-86246-by-root-on-??? 2023-11-05T08:43:33.536 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root cwd DIR 8,1 4096 265785 /home/ubuntu/cephtest 2023-11-05T08:43:33.536 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:33.536 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-05T08:43:33.536 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:33.536 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:33.536 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-05T08:43:33.537 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-05T08:43:33.537 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root mem REG 8,1 15752 265597 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-05T08:43:33.537 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-05T08:43:33.537 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-05T08:43:33.537 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-05T08:43:33.538 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-05T08:43:33.538 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-05T08:43:33.538 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-05T08:43:33.538 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:33.538 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-05T08:43:33.539 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-05T08:43:33.539 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:33.539 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-05T08:43:33.539 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-05T08:43:33.539 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-05T08:43:33.539 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-05T08:43:33.540 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-05T08:43:33.540 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-05T08:43:33.540 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:33.540 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:33.540 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:33.541 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-05T08:43:33.541 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-05T08:43:33.541 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-05T08:43:33.541 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-05T08:43:33.541 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-05T08:43:33.541 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-05T08:43:33.542 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-05T08:43:33.542 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-05T08:43:33.542 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-05T08:43:33.542 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-05T08:43:33.542 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-05T08:43:33.543 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-05T08:43:33.543 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-05T08:43:33.543 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-05T08:43:33.543 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-05T08:43:33.543 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-05T08:43:33.543 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-05T08:43:33.544 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-05T08:43:33.544 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-05T08:43:33.544 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-05T08:43:33.544 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-05T08:43:33.544 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:33.545 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-05T08:43:33.545 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:33.545 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-05T08:43:33.545 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-05T08:43:33.545 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-05T08:43:33.545 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-05T08:43:33.546 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-05T08:43:33.546 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root mem REG 8,1 83456 265542 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-05T08:43:33.546 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root mem REG 8,1 370416 265532 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-05T08:43:33.546 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root mem REG 8,1 1481856 265536 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-05T08:43:33.546 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root mem REG 8,1 45648 265517 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-05T08:43:33.547 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root mem REG 8,1 41304 265576 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-05T08:43:33.547 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root mem REG 8,1 49912 265561 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-05T08:43:33.547 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root mem REG 8,1 418096 265585 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-05T08:43:33.547 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root mem REG 8,1 83208 265579 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-05T08:43:33.547 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-05T08:43:33.547 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root mem REG 8,1 79224 265555 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-05T08:43:33.548 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root mem REG 8,1 49744 265609 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-05T08:43:33.548 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root mem REG 8,1 49856 265552 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-05T08:43:33.548 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root mem REG 8,1 83632 265549 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-05T08:43:33.548 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root mem REG 8,1 78744 265606 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-05T08:43:33.548 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root mem REG 8,1 53880 265603 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-05T08:43:33.549 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root mem REG 8,1 872944 265588 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-05T08:43:33.549 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root mem REG 8,1 116592 265558 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-05T08:43:33.549 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-05T08:43:33.549 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root mem REG 8,1 1242808 265591 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-05T08:43:33.549 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root mem REG 8,1 62224 265570 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-05T08:43:33.549 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root mem REG 8,1 95808 265564 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-05T08:43:33.550 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root mem REG 8,1 37272 265600 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-05T08:43:33.550 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root mem REG 8,1 104024 265582 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-05T08:43:33.550 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root mem REG 8,1 133480 265546 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-05T08:43:33.550 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root mem REG 8,1 834760 265573 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-05T08:43:33.550 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-05T08:43:33.551 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root mem REG 8,1 129280 265594 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-05T08:43:33.551 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root mem REG 8,1 83224 265567 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-05T08:43:33.551 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root mem REG 8,1 48 3081 /tmp/vgdb-pipe-shared-mem-vgdb-86246-by-root-on-??? 2023-11-05T08:43:33.551 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root DEL REG 0,17 182056 /[aio] 2023-11-05T08:43:33.551 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root DEL REG 0,17 182868 /[aio] 2023-11-05T08:43:33.551 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:33.552 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root 1w FIFO 0,13 0t0 182740 pipe 2023-11-05T08:43:33.552 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root 2w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:33.552 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root 3w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:33.552 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root 4r FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:33.552 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root 5w FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:33.553 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root 6u a_inode 0,14 0 1084 [eventpoll:7,20,21,22,23,24,25,26,27,66] 2023-11-05T08:43:33.553 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root 7r FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:33.553 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root 8w FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:33.553 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root 9u a_inode 0,14 0 1084 [eventpoll:10,67] 2023-11-05T08:43:33.553 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root 10r FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:33.553 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root 11w FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:33.554 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root 12u a_inode 0,14 0 1084 [eventpoll:13] 2023-11-05T08:43:33.554 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root 13r FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:33.554 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root 14w FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:33.554 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root 15w REG 8,1 465910012 276998 /var/log/ceph/ceph-osd.7.log 2023-11-05T08:43:33.554 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root 16uW REG 0,24 6 1974 /run/ceph/ceph-osd.7.pid 2023-11-05T08:43:33.555 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root 17r FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:33.555 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root 18w FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:33.555 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root 19u unix 0xffff8da307b0b300 0t0 187412 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-05T08:43:33.555 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root 20u IPv4 185761 0t0 TCP *:6802 (LISTEN) 2023-11-05T08:43:33.555 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root 21u IPv4 185765 0t0 TCP *:6803 (LISTEN) 2023-11-05T08:43:33.556 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root 22u IPv4 185770 0t0 TCP *:6804 (LISTEN) 2023-11-05T08:43:33.556 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root 23u IPv4 185776 0t0 TCP *:6805 (LISTEN) 2023-11-05T08:43:33.556 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root 24u IPv4 185783 0t0 TCP *:6806 (LISTEN) 2023-11-05T08:43:33.556 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root 25u IPv4 185791 0t0 TCP *:6807 (LISTEN) 2023-11-05T08:43:33.556 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root 26u IPv4 185800 0t0 TCP *:6808 (LISTEN) 2023-11-05T08:43:33.556 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root 27u IPv4 185810 0t0 TCP *:6809 (LISTEN) 2023-11-05T08:43:33.557 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root 28r FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:33.557 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root 29w FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:33.557 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root 30r FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:33.557 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root 31w FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:33.557 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root 32u sock 0,8 0t0 182041 protocol: UDPv6 2023-11-05T08:43:33.558 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-05T08:43:33.558 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-05T08:43:33.558 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.558 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.558 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.558 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.559 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.559 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.559 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.559 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.559 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.560 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.560 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.560 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.560 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.560 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.560 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.561 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.561 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.561 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.561 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.561 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.562 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.562 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.562 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.562 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.562 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root 60r FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:33.562 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root 61w FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:33.563 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root 62r FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:33.563 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root 63w FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:33.563 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root 66u IPv4 199302 0t0 TCP smithi156.front.sepia.ceph.com:56964->smithi156.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-05T08:43:33.563 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root 67u IPv4 199303 0t0 TCP smithi156.front.sepia.ceph.com:6802->smithi156.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-05T08:43:33.563 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:33.564 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root *525u REG 8,1 32 3087 /tmp/valgrind_proc_86246_cmdline_85358a06 (deleted) 2023-11-05T08:43:33.564 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root *526u REG 8,1 336 3088 /tmp/valgrind_proc_86246_auxv_85358a06 (deleted) 2023-11-05T08:43:33.564 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root *527w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:33.564 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root *528w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:33.564 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root *529r FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:33.564 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root *530w FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:33.565 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89496 tp_osd_tp root *531r FIFO 8,1 0t0 3091 /tmp/vgdb-pipe-from-vgdb-to-86246-by-root-on-??? 2023-11-05T08:43:33.565 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root cwd DIR 8,1 4096 265785 /home/ubuntu/cephtest 2023-11-05T08:43:33.565 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:33.565 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-05T08:43:33.565 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:33.566 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:33.566 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-05T08:43:33.566 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-05T08:43:33.566 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root mem REG 8,1 15752 265597 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-05T08:43:33.566 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-05T08:43:33.566 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-05T08:43:33.567 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-05T08:43:33.567 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-05T08:43:33.567 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-05T08:43:33.567 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-05T08:43:33.567 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:33.568 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-05T08:43:33.568 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-05T08:43:33.568 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:33.568 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-05T08:43:33.568 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-05T08:43:33.568 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-05T08:43:33.569 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-05T08:43:33.569 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-05T08:43:33.569 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-05T08:43:33.569 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:33.569 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:33.570 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:33.570 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-05T08:43:33.570 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-05T08:43:33.570 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-05T08:43:33.570 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-05T08:43:33.571 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-05T08:43:33.571 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-05T08:43:33.571 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-05T08:43:33.571 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-05T08:43:33.571 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-05T08:43:33.571 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-05T08:43:33.572 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-05T08:43:33.572 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-05T08:43:33.572 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-05T08:43:33.572 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-05T08:43:33.572 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-05T08:43:33.573 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-05T08:43:33.573 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-05T08:43:33.573 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-05T08:43:33.573 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-05T08:43:33.573 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-05T08:43:33.573 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-05T08:43:33.574 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:33.574 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-05T08:43:33.574 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:33.574 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-05T08:43:33.574 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-05T08:43:33.575 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-05T08:43:33.575 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-05T08:43:33.575 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-05T08:43:33.575 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root mem REG 8,1 83456 265542 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-05T08:43:33.575 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root mem REG 8,1 370416 265532 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-05T08:43:33.575 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root mem REG 8,1 1481856 265536 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-05T08:43:33.576 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root mem REG 8,1 45648 265517 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-05T08:43:33.576 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root mem REG 8,1 41304 265576 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-05T08:43:33.576 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root mem REG 8,1 49912 265561 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-05T08:43:33.576 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root mem REG 8,1 418096 265585 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-05T08:43:33.576 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root mem REG 8,1 83208 265579 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-05T08:43:33.577 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-05T08:43:33.577 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root mem REG 8,1 79224 265555 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-05T08:43:33.577 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root mem REG 8,1 49744 265609 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-05T08:43:33.577 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root mem REG 8,1 49856 265552 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-05T08:43:33.577 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root mem REG 8,1 83632 265549 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-05T08:43:33.577 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root mem REG 8,1 78744 265606 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-05T08:43:33.578 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root mem REG 8,1 53880 265603 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-05T08:43:33.578 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root mem REG 8,1 872944 265588 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-05T08:43:33.578 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root mem REG 8,1 116592 265558 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-05T08:43:33.578 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-05T08:43:33.578 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root mem REG 8,1 1242808 265591 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-05T08:43:33.579 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root mem REG 8,1 62224 265570 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-05T08:43:33.579 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root mem REG 8,1 95808 265564 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-05T08:43:33.579 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root mem REG 8,1 37272 265600 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-05T08:43:33.579 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root mem REG 8,1 104024 265582 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-05T08:43:33.579 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root mem REG 8,1 133480 265546 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-05T08:43:33.579 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root mem REG 8,1 834760 265573 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-05T08:43:33.580 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-05T08:43:33.580 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root mem REG 8,1 129280 265594 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-05T08:43:33.580 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root mem REG 8,1 83224 265567 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-05T08:43:33.580 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root mem REG 8,1 48 3081 /tmp/vgdb-pipe-shared-mem-vgdb-86246-by-root-on-??? 2023-11-05T08:43:33.580 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root DEL REG 0,17 182056 /[aio] 2023-11-05T08:43:33.581 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root DEL REG 0,17 182868 /[aio] 2023-11-05T08:43:33.581 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:33.581 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root 1w FIFO 0,13 0t0 182740 pipe 2023-11-05T08:43:33.581 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root 2w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:33.581 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root 3w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:33.581 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root 4r FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:33.582 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root 5w FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:33.582 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root 6u a_inode 0,14 0 1084 [eventpoll:7,20,21,22,23,24,25,26,27,66] 2023-11-05T08:43:33.582 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root 7r FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:33.582 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root 8w FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:33.582 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root 9u a_inode 0,14 0 1084 [eventpoll:10,67] 2023-11-05T08:43:33.583 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root 10r FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:33.583 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root 11w FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:33.583 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root 12u a_inode 0,14 0 1084 [eventpoll:13] 2023-11-05T08:43:33.583 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root 13r FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:33.583 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root 14w FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:33.583 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root 15w REG 8,1 465910012 276998 /var/log/ceph/ceph-osd.7.log 2023-11-05T08:43:33.584 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root 16uW REG 0,24 6 1974 /run/ceph/ceph-osd.7.pid 2023-11-05T08:43:33.584 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root 17r FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:33.584 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root 18w FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:33.584 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root 19u unix 0xffff8da307b0b300 0t0 187412 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-05T08:43:33.584 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root 20u IPv4 185761 0t0 TCP *:6802 (LISTEN) 2023-11-05T08:43:33.585 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root 21u IPv4 185765 0t0 TCP *:6803 (LISTEN) 2023-11-05T08:43:33.585 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root 22u IPv4 185770 0t0 TCP *:6804 (LISTEN) 2023-11-05T08:43:33.585 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root 23u IPv4 185776 0t0 TCP *:6805 (LISTEN) 2023-11-05T08:43:33.585 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root 24u IPv4 185783 0t0 TCP *:6806 (LISTEN) 2023-11-05T08:43:33.585 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root 25u IPv4 185791 0t0 TCP *:6807 (LISTEN) 2023-11-05T08:43:33.585 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root 26u IPv4 185800 0t0 TCP *:6808 (LISTEN) 2023-11-05T08:43:33.586 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root 27u IPv4 185810 0t0 TCP *:6809 (LISTEN) 2023-11-05T08:43:33.586 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root 28r FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:33.586 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root 29w FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:33.586 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root 30r FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:33.586 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root 31w FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:33.587 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root 32u sock 0,8 0t0 182041 protocol: UDPv6 2023-11-05T08:43:33.587 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-05T08:43:33.587 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-05T08:43:33.587 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.587 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.587 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.588 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.588 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.588 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.588 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.588 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.589 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.589 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.589 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.589 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.589 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.589 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.590 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.590 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.590 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.590 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.590 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.591 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.591 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.591 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.591 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.591 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.591 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root 60r FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:33.592 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root 61w FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:33.592 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root 62r FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:33.592 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root 63w FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:33.592 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root 66u IPv4 199302 0t0 TCP smithi156.front.sepia.ceph.com:56964->smithi156.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-05T08:43:33.592 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root 67u IPv4 199303 0t0 TCP smithi156.front.sepia.ceph.com:6802->smithi156.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-05T08:43:33.592 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:33.593 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root *525u REG 8,1 32 3087 /tmp/valgrind_proc_86246_cmdline_85358a06 (deleted) 2023-11-05T08:43:33.593 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root *526u REG 8,1 336 3088 /tmp/valgrind_proc_86246_auxv_85358a06 (deleted) 2023-11-05T08:43:33.593 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root *527w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:33.593 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root *528w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:33.593 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root *529r FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:33.594 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root *530w FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:33.594 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89502 tp_osd_tp root *531r FIFO 8,1 0t0 3091 /tmp/vgdb-pipe-from-vgdb-to-86246-by-root-on-??? 2023-11-05T08:43:33.594 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root cwd DIR 8,1 4096 265785 /home/ubuntu/cephtest 2023-11-05T08:43:33.594 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:33.594 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-05T08:43:33.595 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:33.595 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:33.595 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-05T08:43:33.595 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-05T08:43:33.595 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root mem REG 8,1 15752 265597 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-05T08:43:33.596 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-05T08:43:33.596 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-05T08:43:33.596 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-05T08:43:33.596 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-05T08:43:33.596 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-05T08:43:33.596 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-05T08:43:33.597 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:33.597 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-05T08:43:33.597 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-05T08:43:33.597 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:33.597 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-05T08:43:33.598 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-05T08:43:33.598 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-05T08:43:33.598 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-05T08:43:33.598 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-05T08:43:33.598 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-05T08:43:33.598 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:33.599 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:33.599 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:33.599 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-05T08:43:33.599 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-05T08:43:33.599 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-05T08:43:33.599 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-05T08:43:33.600 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-05T08:43:33.600 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-05T08:43:33.600 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-05T08:43:33.600 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-05T08:43:33.600 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-05T08:43:33.601 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-05T08:43:33.601 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-05T08:43:33.601 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-05T08:43:33.601 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-05T08:43:33.601 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-05T08:43:33.601 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-05T08:43:33.602 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-05T08:43:33.602 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-05T08:43:33.602 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-05T08:43:33.602 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-05T08:43:33.602 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-05T08:43:33.603 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-05T08:43:33.603 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:33.603 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-05T08:43:33.603 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:33.603 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-05T08:43:33.603 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-05T08:43:33.604 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-05T08:43:33.604 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-05T08:43:33.604 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-05T08:43:33.604 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root mem REG 8,1 83456 265542 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-05T08:43:33.605 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root mem REG 8,1 370416 265532 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-05T08:43:33.605 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root mem REG 8,1 1481856 265536 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-05T08:43:33.605 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root mem REG 8,1 45648 265517 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-05T08:43:33.605 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root mem REG 8,1 41304 265576 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-05T08:43:33.605 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root mem REG 8,1 49912 265561 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-05T08:43:33.605 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root mem REG 8,1 418096 265585 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-05T08:43:33.606 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root mem REG 8,1 83208 265579 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-05T08:43:33.606 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-05T08:43:33.606 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root mem REG 8,1 79224 265555 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-05T08:43:33.606 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root mem REG 8,1 49744 265609 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-05T08:43:33.606 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root mem REG 8,1 49856 265552 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-05T08:43:33.607 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root mem REG 8,1 83632 265549 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-05T08:43:33.607 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root mem REG 8,1 78744 265606 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-05T08:43:33.607 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root mem REG 8,1 53880 265603 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-05T08:43:33.607 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root mem REG 8,1 872944 265588 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-05T08:43:33.607 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root mem REG 8,1 116592 265558 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-05T08:43:33.607 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-05T08:43:33.608 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root mem REG 8,1 1242808 265591 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-05T08:43:33.608 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root mem REG 8,1 62224 265570 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-05T08:43:33.608 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root mem REG 8,1 95808 265564 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-05T08:43:33.608 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root mem REG 8,1 37272 265600 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-05T08:43:33.608 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root mem REG 8,1 104024 265582 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-05T08:43:33.609 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root mem REG 8,1 133480 265546 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-05T08:43:33.609 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root mem REG 8,1 834760 265573 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-05T08:43:33.609 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-05T08:43:33.609 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root mem REG 8,1 129280 265594 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-05T08:43:33.609 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root mem REG 8,1 83224 265567 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-05T08:43:33.610 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root mem REG 8,1 48 3081 /tmp/vgdb-pipe-shared-mem-vgdb-86246-by-root-on-??? 2023-11-05T08:43:33.610 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root DEL REG 0,17 182056 /[aio] 2023-11-05T08:43:33.610 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root DEL REG 0,17 182868 /[aio] 2023-11-05T08:43:33.610 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:33.610 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root 1w FIFO 0,13 0t0 182740 pipe 2023-11-05T08:43:33.610 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root 2w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:33.611 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root 3w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:33.611 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root 4r FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:33.611 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root 5w FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:33.611 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root 6u a_inode 0,14 0 1084 [eventpoll:7,20,21,22,23,24,25,26,27,66] 2023-11-05T08:43:33.611 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root 7r FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:33.612 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root 8w FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:33.612 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root 9u a_inode 0,14 0 1084 [eventpoll:10,67] 2023-11-05T08:43:33.612 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root 10r FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:33.612 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root 11w FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:33.612 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root 12u a_inode 0,14 0 1084 [eventpoll:13] 2023-11-05T08:43:33.612 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root 13r FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:33.613 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root 14w FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:33.613 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root 15w REG 8,1 465910012 276998 /var/log/ceph/ceph-osd.7.log 2023-11-05T08:43:33.613 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root 16uW REG 0,24 6 1974 /run/ceph/ceph-osd.7.pid 2023-11-05T08:43:33.613 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root 17r FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:33.613 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root 18w FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:33.614 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root 19u unix 0xffff8da307b0b300 0t0 187412 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-05T08:43:33.614 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root 20u IPv4 185761 0t0 TCP *:6802 (LISTEN) 2023-11-05T08:43:33.614 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root 21u IPv4 185765 0t0 TCP *:6803 (LISTEN) 2023-11-05T08:43:33.614 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root 22u IPv4 185770 0t0 TCP *:6804 (LISTEN) 2023-11-05T08:43:33.614 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root 23u IPv4 185776 0t0 TCP *:6805 (LISTEN) 2023-11-05T08:43:33.615 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root 24u IPv4 185783 0t0 TCP *:6806 (LISTEN) 2023-11-05T08:43:33.615 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root 25u IPv4 185791 0t0 TCP *:6807 (LISTEN) 2023-11-05T08:43:33.615 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root 26u IPv4 185800 0t0 TCP *:6808 (LISTEN) 2023-11-05T08:43:33.615 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root 27u IPv4 185810 0t0 TCP *:6809 (LISTEN) 2023-11-05T08:43:33.615 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root 28r FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:33.615 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root 29w FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:33.616 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root 30r FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:33.616 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root 31w FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:33.616 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root 32u sock 0,8 0t0 182041 protocol: UDPv6 2023-11-05T08:43:33.616 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-05T08:43:33.616 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-05T08:43:33.617 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.617 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.617 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.617 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.617 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.617 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.618 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.618 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.618 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.618 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.618 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.619 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.619 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.619 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.619 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.619 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.619 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.620 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.620 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.620 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.620 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.620 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.621 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.621 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.621 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root 60r FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:33.621 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root 61w FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:33.621 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root 62r FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:33.621 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root 63w FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:33.622 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root 66u IPv4 199302 0t0 TCP smithi156.front.sepia.ceph.com:56964->smithi156.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-05T08:43:33.622 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root 67u IPv4 199303 0t0 TCP smithi156.front.sepia.ceph.com:6802->smithi156.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-05T08:43:33.622 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:33.622 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root *525u REG 8,1 32 3087 /tmp/valgrind_proc_86246_cmdline_85358a06 (deleted) 2023-11-05T08:43:33.622 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root *526u REG 8,1 336 3088 /tmp/valgrind_proc_86246_auxv_85358a06 (deleted) 2023-11-05T08:43:33.623 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root *527w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:33.623 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root *528w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:33.623 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root *529r FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:33.623 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root *530w FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:33.623 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89508 tp_osd_tp root *531r FIFO 8,1 0t0 3091 /tmp/vgdb-pipe-from-vgdb-to-86246-by-root-on-??? 2023-11-05T08:43:33.623 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root cwd DIR 8,1 4096 265785 /home/ubuntu/cephtest 2023-11-05T08:43:33.624 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:33.624 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-05T08:43:33.624 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:33.624 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:33.624 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-05T08:43:33.625 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-05T08:43:33.625 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root mem REG 8,1 15752 265597 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-05T08:43:33.625 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-05T08:43:33.625 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-05T08:43:33.625 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-05T08:43:33.625 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-05T08:43:33.626 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-05T08:43:33.626 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-05T08:43:33.626 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:33.626 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-05T08:43:33.626 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-05T08:43:33.627 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:33.627 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-05T08:43:33.627 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-05T08:43:33.627 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-05T08:43:33.627 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-05T08:43:33.627 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-05T08:43:33.628 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-05T08:43:33.628 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:33.628 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:33.628 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:33.628 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-05T08:43:33.629 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-05T08:43:33.629 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-05T08:43:33.629 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-05T08:43:33.629 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-05T08:43:33.629 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-05T08:43:33.629 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-05T08:43:33.630 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-05T08:43:33.630 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-05T08:43:33.630 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-05T08:43:33.630 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-05T08:43:33.630 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-05T08:43:33.631 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-05T08:43:33.631 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-05T08:43:33.631 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-05T08:43:33.631 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-05T08:43:33.631 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-05T08:43:33.631 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-05T08:43:33.632 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-05T08:43:33.632 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-05T08:43:33.632 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-05T08:43:33.632 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:33.632 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-05T08:43:33.633 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:33.633 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-05T08:43:33.633 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-05T08:43:33.633 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-05T08:43:33.633 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-05T08:43:33.634 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-05T08:43:33.634 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root mem REG 8,1 83456 265542 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-05T08:43:33.634 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root mem REG 8,1 370416 265532 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-05T08:43:33.634 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root mem REG 8,1 1481856 265536 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-05T08:43:33.634 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root mem REG 8,1 45648 265517 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-05T08:43:33.634 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root mem REG 8,1 41304 265576 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-05T08:43:33.635 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root mem REG 8,1 49912 265561 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-05T08:43:33.635 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root mem REG 8,1 418096 265585 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-05T08:43:33.635 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root mem REG 8,1 83208 265579 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-05T08:43:33.635 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-05T08:43:33.635 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root mem REG 8,1 79224 265555 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-05T08:43:33.636 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root mem REG 8,1 49744 265609 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-05T08:43:33.636 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root mem REG 8,1 49856 265552 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-05T08:43:33.636 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root mem REG 8,1 83632 265549 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-05T08:43:33.636 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root mem REG 8,1 78744 265606 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-05T08:43:33.636 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root mem REG 8,1 53880 265603 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-05T08:43:33.636 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root mem REG 8,1 872944 265588 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-05T08:43:33.637 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root mem REG 8,1 116592 265558 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-05T08:43:33.637 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-05T08:43:33.637 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root mem REG 8,1 1242808 265591 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-05T08:43:33.637 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root mem REG 8,1 62224 265570 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-05T08:43:33.637 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root mem REG 8,1 95808 265564 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-05T08:43:33.638 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root mem REG 8,1 37272 265600 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-05T08:43:33.638 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root mem REG 8,1 104024 265582 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-05T08:43:33.638 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root mem REG 8,1 133480 265546 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-05T08:43:33.638 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root mem REG 8,1 834760 265573 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-05T08:43:33.638 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-05T08:43:33.639 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root mem REG 8,1 129280 265594 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-05T08:43:33.639 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root mem REG 8,1 83224 265567 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-05T08:43:33.639 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root mem REG 8,1 48 3081 /tmp/vgdb-pipe-shared-mem-vgdb-86246-by-root-on-??? 2023-11-05T08:43:33.639 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root DEL REG 0,17 182056 /[aio] 2023-11-05T08:43:33.639 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root DEL REG 0,17 182868 /[aio] 2023-11-05T08:43:33.639 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:33.640 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root 1w FIFO 0,13 0t0 182740 pipe 2023-11-05T08:43:33.640 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root 2w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:33.640 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root 3w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:33.640 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root 4r FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:33.640 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root 5w FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:33.640 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root 6u a_inode 0,14 0 1084 [eventpoll:7,20,21,22,23,24,25,26,27,66] 2023-11-05T08:43:33.641 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root 7r FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:33.641 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root 8w FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:33.641 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root 9u a_inode 0,14 0 1084 [eventpoll:10,67] 2023-11-05T08:43:33.641 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root 10r FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:33.641 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root 11w FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:33.642 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root 12u a_inode 0,14 0 1084 [eventpoll:13] 2023-11-05T08:43:33.642 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root 13r FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:33.642 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root 14w FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:33.642 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root 15w REG 8,1 465910012 276998 /var/log/ceph/ceph-osd.7.log 2023-11-05T08:43:33.642 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root 16uW REG 0,24 6 1974 /run/ceph/ceph-osd.7.pid 2023-11-05T08:43:33.642 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root 17r FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:33.643 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root 18w FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:33.643 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root 19u unix 0xffff8da307b0b300 0t0 187412 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-05T08:43:33.643 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root 20u IPv4 185761 0t0 TCP *:6802 (LISTEN) 2023-11-05T08:43:33.643 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root 21u IPv4 185765 0t0 TCP *:6803 (LISTEN) 2023-11-05T08:43:33.643 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root 22u IPv4 185770 0t0 TCP *:6804 (LISTEN) 2023-11-05T08:43:33.644 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root 23u IPv4 185776 0t0 TCP *:6805 (LISTEN) 2023-11-05T08:43:33.644 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root 24u IPv4 185783 0t0 TCP *:6806 (LISTEN) 2023-11-05T08:43:33.644 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root 25u IPv4 185791 0t0 TCP *:6807 (LISTEN) 2023-11-05T08:43:33.644 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root 26u IPv4 185800 0t0 TCP *:6808 (LISTEN) 2023-11-05T08:43:33.644 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root 27u IPv4 185810 0t0 TCP *:6809 (LISTEN) 2023-11-05T08:43:33.644 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root 28r FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:33.645 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root 29w FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:33.645 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root 30r FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:33.645 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root 31w FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:33.645 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root 32u sock 0,8 0t0 182041 protocol: UDPv6 2023-11-05T08:43:33.645 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-05T08:43:33.646 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-05T08:43:33.646 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.646 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.646 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.646 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.646 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.647 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.647 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.647 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.647 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.647 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.648 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.648 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.648 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.648 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.648 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.648 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.649 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.649 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.649 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.649 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.649 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.650 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.650 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.650 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.650 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root 60r FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:33.650 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root 61w FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:33.651 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root 62r FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:33.651 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root 63w FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:33.651 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root 66u IPv4 199302 0t0 TCP smithi156.front.sepia.ceph.com:56964->smithi156.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-05T08:43:33.651 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root 67u IPv4 199303 0t0 TCP smithi156.front.sepia.ceph.com:6802->smithi156.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-05T08:43:33.651 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:33.651 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root *525u REG 8,1 32 3087 /tmp/valgrind_proc_86246_cmdline_85358a06 (deleted) 2023-11-05T08:43:33.652 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root *526u REG 8,1 336 3088 /tmp/valgrind_proc_86246_auxv_85358a06 (deleted) 2023-11-05T08:43:33.652 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root *527w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:33.652 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root *528w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:33.652 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root *529r FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:33.652 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root *530w FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:33.653 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89509 tp_osd_tp root *531r FIFO 8,1 0t0 3091 /tmp/vgdb-pipe-from-vgdb-to-86246-by-root-on-??? 2023-11-05T08:43:33.653 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root cwd DIR 8,1 4096 265785 /home/ubuntu/cephtest 2023-11-05T08:43:33.653 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:33.653 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-05T08:43:33.653 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:33.653 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:33.654 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-05T08:43:33.654 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-05T08:43:33.654 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root mem REG 8,1 15752 265597 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-05T08:43:33.654 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-05T08:43:33.654 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-05T08:43:33.655 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-05T08:43:33.655 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-05T08:43:33.655 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-05T08:43:33.655 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-05T08:43:33.655 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:33.656 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-05T08:43:33.656 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-05T08:43:33.656 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:33.656 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-05T08:43:33.656 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-05T08:43:33.656 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-05T08:43:33.657 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-05T08:43:33.657 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-05T08:43:33.657 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-05T08:43:33.657 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:33.657 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:33.657 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:33.658 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-05T08:43:33.658 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-05T08:43:33.658 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-05T08:43:33.658 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-05T08:43:33.658 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-05T08:43:33.659 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-05T08:43:33.659 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-05T08:43:33.659 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-05T08:43:33.659 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-05T08:43:33.659 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-05T08:43:33.660 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-05T08:43:33.660 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-05T08:43:33.660 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-05T08:43:33.660 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-05T08:43:33.660 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-05T08:43:33.660 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-05T08:43:33.661 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-05T08:43:33.661 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-05T08:43:33.661 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-05T08:43:33.661 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-05T08:43:33.661 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-05T08:43:33.662 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:33.662 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-05T08:43:33.662 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:33.662 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-05T08:43:33.662 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-05T08:43:33.663 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-05T08:43:33.663 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-05T08:43:33.663 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-05T08:43:33.663 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root mem REG 8,1 83456 265542 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-05T08:43:33.663 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root mem REG 8,1 370416 265532 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-05T08:43:33.663 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root mem REG 8,1 1481856 265536 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-05T08:43:33.664 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root mem REG 8,1 45648 265517 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-05T08:43:33.664 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root mem REG 8,1 41304 265576 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-05T08:43:33.664 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root mem REG 8,1 49912 265561 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-05T08:43:33.664 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root mem REG 8,1 418096 265585 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-05T08:43:33.664 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root mem REG 8,1 83208 265579 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-05T08:43:33.665 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-05T08:43:33.665 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root mem REG 8,1 79224 265555 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-05T08:43:33.665 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root mem REG 8,1 49744 265609 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-05T08:43:33.665 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root mem REG 8,1 49856 265552 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-05T08:43:33.665 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root mem REG 8,1 83632 265549 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-05T08:43:33.666 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root mem REG 8,1 78744 265606 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-05T08:43:33.666 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root mem REG 8,1 53880 265603 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-05T08:43:33.666 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root mem REG 8,1 872944 265588 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-05T08:43:33.666 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root mem REG 8,1 116592 265558 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-05T08:43:33.666 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-05T08:43:33.666 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root mem REG 8,1 1242808 265591 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-05T08:43:33.667 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root mem REG 8,1 62224 265570 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-05T08:43:33.667 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root mem REG 8,1 95808 265564 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-05T08:43:33.667 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root mem REG 8,1 37272 265600 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-05T08:43:33.667 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root mem REG 8,1 104024 265582 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-05T08:43:33.667 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root mem REG 8,1 133480 265546 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-05T08:43:33.668 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root mem REG 8,1 834760 265573 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-05T08:43:33.668 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-05T08:43:33.668 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root mem REG 8,1 129280 265594 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-05T08:43:33.668 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root mem REG 8,1 83224 265567 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-05T08:43:33.668 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root mem REG 8,1 48 3081 /tmp/vgdb-pipe-shared-mem-vgdb-86246-by-root-on-??? 2023-11-05T08:43:33.669 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root DEL REG 0,17 182056 /[aio] 2023-11-05T08:43:33.669 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root DEL REG 0,17 182868 /[aio] 2023-11-05T08:43:33.669 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:33.669 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root 1w FIFO 0,13 0t0 182740 pipe 2023-11-05T08:43:33.669 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root 2w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:33.669 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root 3w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:33.670 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root 4r FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:33.670 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root 5w FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:33.670 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root 6u a_inode 0,14 0 1084 [eventpoll:7,20,21,22,23,24,25,26,27,66] 2023-11-05T08:43:33.670 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root 7r FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:33.670 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root 8w FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:33.671 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root 9u a_inode 0,14 0 1084 [eventpoll:10,67] 2023-11-05T08:43:33.671 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root 10r FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:33.671 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root 11w FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:33.671 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root 12u a_inode 0,14 0 1084 [eventpoll:13] 2023-11-05T08:43:33.671 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root 13r FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:33.672 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root 14w FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:33.672 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root 15w REG 8,1 465910012 276998 /var/log/ceph/ceph-osd.7.log 2023-11-05T08:43:33.672 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root 16uW REG 0,24 6 1974 /run/ceph/ceph-osd.7.pid 2023-11-05T08:43:33.672 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root 17r FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:33.672 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root 18w FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:33.672 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root 19u unix 0xffff8da307b0b300 0t0 187412 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-05T08:43:33.673 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root 20u IPv4 185761 0t0 TCP *:6802 (LISTEN) 2023-11-05T08:43:33.673 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root 21u IPv4 185765 0t0 TCP *:6803 (LISTEN) 2023-11-05T08:43:33.673 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root 22u IPv4 185770 0t0 TCP *:6804 (LISTEN) 2023-11-05T08:43:33.673 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root 23u IPv4 185776 0t0 TCP *:6805 (LISTEN) 2023-11-05T08:43:33.673 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root 24u IPv4 185783 0t0 TCP *:6806 (LISTEN) 2023-11-05T08:43:33.674 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root 25u IPv4 185791 0t0 TCP *:6807 (LISTEN) 2023-11-05T08:43:33.674 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root 26u IPv4 185800 0t0 TCP *:6808 (LISTEN) 2023-11-05T08:43:33.674 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root 27u IPv4 185810 0t0 TCP *:6809 (LISTEN) 2023-11-05T08:43:33.674 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root 28r FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:33.674 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root 29w FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:33.674 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root 30r FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:33.675 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root 31w FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:33.675 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root 32u sock 0,8 0t0 182041 protocol: UDPv6 2023-11-05T08:43:33.675 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-05T08:43:33.675 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-05T08:43:33.675 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.676 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.676 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.676 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.676 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.676 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.676 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.677 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.677 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.677 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.677 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.677 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.677 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.678 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.678 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.678 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.678 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.678 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.679 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.679 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.679 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.679 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.679 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.679 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.681 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root 60r FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:33.681 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root 61w FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:33.681 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root 62r FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:33.681 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root 63w FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:33.682 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root 66u IPv4 199302 0t0 TCP smithi156.front.sepia.ceph.com:56964->smithi156.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-05T08:43:33.682 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root 67u IPv4 199303 0t0 TCP smithi156.front.sepia.ceph.com:6802->smithi156.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-05T08:43:33.682 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:33.682 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root *525u REG 8,1 32 3087 /tmp/valgrind_proc_86246_cmdline_85358a06 (deleted) 2023-11-05T08:43:33.682 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root *526u REG 8,1 336 3088 /tmp/valgrind_proc_86246_auxv_85358a06 (deleted) 2023-11-05T08:43:33.683 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root *527w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:33.683 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root *528w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:33.683 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root *529r FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:33.683 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root *530w FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:33.683 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89513 tp_osd_tp root *531r FIFO 8,1 0t0 3091 /tmp/vgdb-pipe-from-vgdb-to-86246-by-root-on-??? 2023-11-05T08:43:33.684 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root cwd DIR 8,1 4096 265785 /home/ubuntu/cephtest 2023-11-05T08:43:33.684 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:33.684 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-05T08:43:33.684 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:33.684 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:33.684 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-05T08:43:33.685 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-05T08:43:33.685 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root mem REG 8,1 15752 265597 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-05T08:43:33.685 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-05T08:43:33.685 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-05T08:43:33.685 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-05T08:43:33.686 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-05T08:43:33.686 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-05T08:43:33.686 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-05T08:43:33.686 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:33.686 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-05T08:43:33.687 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-05T08:43:33.687 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:33.687 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-05T08:43:33.687 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-05T08:43:33.687 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-05T08:43:33.687 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-05T08:43:33.688 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-05T08:43:33.688 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-05T08:43:33.688 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:33.688 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:33.688 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:33.689 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-05T08:43:33.689 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-05T08:43:33.689 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-05T08:43:33.689 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-05T08:43:33.689 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-05T08:43:33.689 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-05T08:43:33.690 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-05T08:43:33.690 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-05T08:43:33.690 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-05T08:43:33.690 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-05T08:43:33.690 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-05T08:43:33.691 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-05T08:43:33.691 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-05T08:43:33.691 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-05T08:43:33.691 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-05T08:43:33.691 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-05T08:43:33.691 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-05T08:43:33.692 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-05T08:43:33.692 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-05T08:43:33.692 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-05T08:43:33.692 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-05T08:43:33.692 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:33.693 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-05T08:43:33.693 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:33.693 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-05T08:43:33.693 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-05T08:43:33.693 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-05T08:43:33.693 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-05T08:43:33.694 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-05T08:43:33.694 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root mem REG 8,1 83456 265542 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-05T08:43:33.694 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root mem REG 8,1 370416 265532 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-05T08:43:33.694 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root mem REG 8,1 1481856 265536 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-05T08:43:33.694 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root mem REG 8,1 45648 265517 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-05T08:43:33.695 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root mem REG 8,1 41304 265576 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-05T08:43:33.695 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root mem REG 8,1 49912 265561 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-05T08:43:33.695 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root mem REG 8,1 418096 265585 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-05T08:43:33.695 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root mem REG 8,1 83208 265579 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-05T08:43:33.695 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-05T08:43:33.696 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root mem REG 8,1 79224 265555 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-05T08:43:33.696 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root mem REG 8,1 49744 265609 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-05T08:43:33.696 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root mem REG 8,1 49856 265552 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-05T08:43:33.696 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root mem REG 8,1 83632 265549 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-05T08:43:33.696 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root mem REG 8,1 78744 265606 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-05T08:43:33.697 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root mem REG 8,1 53880 265603 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-05T08:43:33.697 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root mem REG 8,1 872944 265588 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-05T08:43:33.697 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root mem REG 8,1 116592 265558 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-05T08:43:33.697 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-05T08:43:33.697 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root mem REG 8,1 1242808 265591 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-05T08:43:33.697 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root mem REG 8,1 62224 265570 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-05T08:43:33.698 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root mem REG 8,1 95808 265564 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-05T08:43:33.698 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root mem REG 8,1 37272 265600 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-05T08:43:33.698 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root mem REG 8,1 104024 265582 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-05T08:43:33.698 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root mem REG 8,1 133480 265546 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-05T08:43:33.698 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root mem REG 8,1 834760 265573 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-05T08:43:33.699 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-05T08:43:33.699 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root mem REG 8,1 129280 265594 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-05T08:43:33.699 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root mem REG 8,1 83224 265567 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-05T08:43:33.699 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root mem REG 8,1 48 3081 /tmp/vgdb-pipe-shared-mem-vgdb-86246-by-root-on-??? 2023-11-05T08:43:33.699 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root DEL REG 0,17 182056 /[aio] 2023-11-05T08:43:33.700 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root DEL REG 0,17 182868 /[aio] 2023-11-05T08:43:33.700 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:33.700 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root 1w FIFO 0,13 0t0 182740 pipe 2023-11-05T08:43:33.700 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root 2w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:33.700 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root 3w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:33.701 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root 4r FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:33.701 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root 5w FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:33.701 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root 6u a_inode 0,14 0 1084 [eventpoll:7,20,21,22,23,24,25,26,27,66] 2023-11-05T08:43:33.701 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root 7r FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:33.701 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root 8w FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:33.701 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root 9u a_inode 0,14 0 1084 [eventpoll:10,67] 2023-11-05T08:43:33.702 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root 10r FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:33.702 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root 11w FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:33.702 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root 12u a_inode 0,14 0 1084 [eventpoll:13] 2023-11-05T08:43:33.702 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root 13r FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:33.702 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root 14w FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:33.703 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root 15w REG 8,1 465910012 276998 /var/log/ceph/ceph-osd.7.log 2023-11-05T08:43:33.703 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root 16uW REG 0,24 6 1974 /run/ceph/ceph-osd.7.pid 2023-11-05T08:43:33.703 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root 17r FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:33.703 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root 18w FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:33.703 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root 19u unix 0xffff8da307b0b300 0t0 187412 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-05T08:43:33.703 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root 20u IPv4 185761 0t0 TCP *:6802 (LISTEN) 2023-11-05T08:43:33.704 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root 21u IPv4 185765 0t0 TCP *:6803 (LISTEN) 2023-11-05T08:43:33.704 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root 22u IPv4 185770 0t0 TCP *:6804 (LISTEN) 2023-11-05T08:43:33.704 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root 23u IPv4 185776 0t0 TCP *:6805 (LISTEN) 2023-11-05T08:43:33.704 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root 24u IPv4 185783 0t0 TCP *:6806 (LISTEN) 2023-11-05T08:43:33.704 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root 25u IPv4 185791 0t0 TCP *:6807 (LISTEN) 2023-11-05T08:43:33.705 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root 26u IPv4 185800 0t0 TCP *:6808 (LISTEN) 2023-11-05T08:43:33.705 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root 27u IPv4 185810 0t0 TCP *:6809 (LISTEN) 2023-11-05T08:43:33.705 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root 28r FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:33.705 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root 29w FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:33.705 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root 30r FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:33.705 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root 31w FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:33.706 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root 32u sock 0,8 0t0 182041 protocol: UDPv6 2023-11-05T08:43:33.706 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-05T08:43:33.706 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-05T08:43:33.706 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.706 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.707 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.707 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.707 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.707 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.707 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.708 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.708 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.708 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.708 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.708 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.709 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.709 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.709 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.709 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.709 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.710 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.710 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.710 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.710 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.710 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.711 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.711 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.711 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root 60r FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:33.711 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root 61w FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:33.711 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root 62r FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:33.711 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root 63w FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:33.712 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root 66u IPv4 199302 0t0 TCP smithi156.front.sepia.ceph.com:56964->smithi156.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-05T08:43:33.712 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root 67u IPv4 199303 0t0 TCP smithi156.front.sepia.ceph.com:6802->smithi156.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-05T08:43:33.712 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:33.712 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root *525u REG 8,1 32 3087 /tmp/valgrind_proc_86246_cmdline_85358a06 (deleted) 2023-11-05T08:43:33.712 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root *526u REG 8,1 336 3088 /tmp/valgrind_proc_86246_auxv_85358a06 (deleted) 2023-11-05T08:43:33.713 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root *527w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:33.713 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root *528w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:33.713 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root *529r FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:33.713 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root *530w FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:33.713 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89516 tp_osd_tp root *531r FIFO 8,1 0t0 3091 /tmp/vgdb-pipe-from-vgdb-to-86246-by-root-on-??? 2023-11-05T08:43:33.713 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root cwd DIR 8,1 4096 265785 /home/ubuntu/cephtest 2023-11-05T08:43:33.714 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:33.714 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-05T08:43:33.714 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:33.714 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:33.714 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-05T08:43:33.715 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-05T08:43:33.715 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root mem REG 8,1 15752 265597 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-05T08:43:33.715 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-05T08:43:33.715 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-05T08:43:33.715 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-05T08:43:33.715 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-05T08:43:33.716 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-05T08:43:33.716 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-05T08:43:33.716 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:33.716 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-05T08:43:33.716 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-05T08:43:33.717 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:33.717 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-05T08:43:33.717 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-05T08:43:33.717 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-05T08:43:33.717 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-05T08:43:33.717 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-05T08:43:33.718 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-05T08:43:33.718 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:33.718 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:33.718 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:33.718 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-05T08:43:33.719 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-05T08:43:33.719 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-05T08:43:33.719 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-05T08:43:33.719 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-05T08:43:33.719 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-05T08:43:33.720 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-05T08:43:33.720 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-05T08:43:33.720 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-05T08:43:33.720 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-05T08:43:33.720 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-05T08:43:33.720 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-05T08:43:33.721 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-05T08:43:33.721 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-05T08:43:33.721 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-05T08:43:33.721 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-05T08:43:33.721 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-05T08:43:33.722 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-05T08:43:33.722 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-05T08:43:33.722 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-05T08:43:33.722 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-05T08:43:33.722 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:33.722 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-05T08:43:33.723 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:33.723 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-05T08:43:33.723 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-05T08:43:33.723 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-05T08:43:33.723 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-05T08:43:33.724 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-05T08:43:33.724 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root mem REG 8,1 83456 265542 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-05T08:43:33.724 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root mem REG 8,1 370416 265532 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-05T08:43:33.724 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root mem REG 8,1 1481856 265536 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-05T08:43:33.724 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root mem REG 8,1 45648 265517 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-05T08:43:33.724 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root mem REG 8,1 41304 265576 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-05T08:43:33.725 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root mem REG 8,1 49912 265561 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-05T08:43:33.725 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root mem REG 8,1 418096 265585 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-05T08:43:33.725 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root mem REG 8,1 83208 265579 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-05T08:43:33.725 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-05T08:43:33.725 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root mem REG 8,1 79224 265555 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-05T08:43:33.726 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root mem REG 8,1 49744 265609 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-05T08:43:33.726 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root mem REG 8,1 49856 265552 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-05T08:43:33.726 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root mem REG 8,1 83632 265549 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-05T08:43:33.726 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root mem REG 8,1 78744 265606 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-05T08:43:33.726 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root mem REG 8,1 53880 265603 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-05T08:43:33.727 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root mem REG 8,1 872944 265588 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-05T08:43:33.727 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root mem REG 8,1 116592 265558 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-05T08:43:33.727 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-05T08:43:33.727 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root mem REG 8,1 1242808 265591 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-05T08:43:33.727 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root mem REG 8,1 62224 265570 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-05T08:43:33.727 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root mem REG 8,1 95808 265564 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-05T08:43:33.728 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root mem REG 8,1 37272 265600 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-05T08:43:33.728 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root mem REG 8,1 104024 265582 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-05T08:43:33.728 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root mem REG 8,1 133480 265546 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-05T08:43:33.728 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root mem REG 8,1 834760 265573 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-05T08:43:33.728 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-05T08:43:33.729 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root mem REG 8,1 129280 265594 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-05T08:43:33.729 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root mem REG 8,1 83224 265567 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-05T08:43:33.729 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root mem REG 8,1 48 3081 /tmp/vgdb-pipe-shared-mem-vgdb-86246-by-root-on-??? 2023-11-05T08:43:33.729 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root DEL REG 0,17 182056 /[aio] 2023-11-05T08:43:33.729 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root DEL REG 0,17 182868 /[aio] 2023-11-05T08:43:33.729 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:33.730 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root 1w FIFO 0,13 0t0 182740 pipe 2023-11-05T08:43:33.730 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root 2w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:33.730 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root 3w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:33.730 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root 4r FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:33.730 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root 5w FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:33.731 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root 6u a_inode 0,14 0 1084 [eventpoll:7,20,21,22,23,24,25,26,27,66] 2023-11-05T08:43:33.731 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root 7r FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:33.731 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root 8w FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:33.731 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root 9u a_inode 0,14 0 1084 [eventpoll:10,67] 2023-11-05T08:43:33.731 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root 10r FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:33.732 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root 11w FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:33.732 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root 12u a_inode 0,14 0 1084 [eventpoll:13] 2023-11-05T08:43:33.732 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root 13r FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:33.732 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root 14w FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:33.732 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root 15w REG 8,1 465910012 276998 /var/log/ceph/ceph-osd.7.log 2023-11-05T08:43:33.732 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root 16uW REG 0,24 6 1974 /run/ceph/ceph-osd.7.pid 2023-11-05T08:43:33.733 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root 17r FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:33.733 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root 18w FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:33.733 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root 19u unix 0xffff8da307b0b300 0t0 187412 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-05T08:43:33.733 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root 20u IPv4 185761 0t0 TCP *:6802 (LISTEN) 2023-11-05T08:43:33.733 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root 21u IPv4 185765 0t0 TCP *:6803 (LISTEN) 2023-11-05T08:43:33.733 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root 22u IPv4 185770 0t0 TCP *:6804 (LISTEN) 2023-11-05T08:43:33.734 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root 23u IPv4 185776 0t0 TCP *:6805 (LISTEN) 2023-11-05T08:43:33.734 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root 24u IPv4 185783 0t0 TCP *:6806 (LISTEN) 2023-11-05T08:43:33.734 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root 25u IPv4 185791 0t0 TCP *:6807 (LISTEN) 2023-11-05T08:43:33.734 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root 26u IPv4 185800 0t0 TCP *:6808 (LISTEN) 2023-11-05T08:43:33.734 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root 27u IPv4 185810 0t0 TCP *:6809 (LISTEN) 2023-11-05T08:43:33.735 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root 28r FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:33.735 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root 29w FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:33.735 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root 30r FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:33.735 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root 31w FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:33.735 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root 32u sock 0,8 0t0 182041 protocol: UDPv6 2023-11-05T08:43:33.735 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-05T08:43:33.736 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-05T08:43:33.736 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.736 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.736 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.736 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.737 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.737 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.737 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.737 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.737 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.737 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.738 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.738 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.738 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.738 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.738 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.739 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.739 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.739 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.739 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.739 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.739 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.740 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.740 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.740 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.740 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root 60r FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:33.740 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root 61w FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:33.741 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root 62r FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:33.741 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root 63w FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:33.741 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root 66u IPv4 199302 0t0 TCP smithi156.front.sepia.ceph.com:56964->smithi156.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-05T08:43:33.741 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root 67u IPv4 199303 0t0 TCP smithi156.front.sepia.ceph.com:6802->smithi156.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-05T08:43:33.741 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:33.741 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root *525u REG 8,1 32 3087 /tmp/valgrind_proc_86246_cmdline_85358a06 (deleted) 2023-11-05T08:43:33.742 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root *526u REG 8,1 336 3088 /tmp/valgrind_proc_86246_auxv_85358a06 (deleted) 2023-11-05T08:43:33.742 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root *527w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:33.742 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root *528w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:33.742 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root *529r FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:33.742 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root *530w FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:33.743 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89519 tp_osd_tp root *531r FIFO 8,1 0t0 3091 /tmp/vgdb-pipe-from-vgdb-to-86246-by-root-on-??? 2023-11-05T08:43:33.743 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root cwd DIR 8,1 4096 265785 /home/ubuntu/cephtest 2023-11-05T08:43:33.743 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:33.743 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2023-11-05T08:43:33.743 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root mem REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:33.743 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:33.744 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2023-11-05T08:43:33.744 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2023-11-05T08:43:33.744 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root mem REG 8,1 15752 265597 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2023-11-05T08:43:33.744 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root mem REG 8,1 326760 2084 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-05T08:43:33.744 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-05T08:43:33.745 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-05T08:43:33.745 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-05T08:43:33.745 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-05T08:43:33.745 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-05T08:43:33.745 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:33.745 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-05T08:43:33.746 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root mem REG 8,1 639224 2033 /usr/lib64/libthrift-0.15.0.so 2023-11-05T08:43:33.746 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:33.746 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-05T08:43:33.746 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-05T08:43:33.746 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-05T08:43:33.747 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-05T08:43:33.747 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-05T08:43:33.747 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-05T08:43:33.747 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:33.747 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:33.747 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:33.748 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root mem REG 8,1 61880 2074 /usr/lib64/libunwind.so.8.0.1 2023-11-05T08:43:33.748 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-05T08:43:33.748 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-05T08:43:33.748 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-05T08:43:33.748 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-05T08:43:33.749 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-05T08:43:33.749 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-05T08:43:33.749 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-05T08:43:33.749 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-05T08:43:33.749 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-05T08:43:33.749 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-05T08:43:33.750 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-05T08:43:33.750 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-05T08:43:33.750 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-05T08:43:33.750 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-05T08:43:33.750 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-05T08:43:33.750 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-05T08:43:33.751 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-05T08:43:33.751 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-05T08:43:33.751 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-05T08:43:33.751 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-05T08:43:33.751 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:33.752 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-05T08:43:33.752 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:33.752 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root mem REG 8,1 53272 2010 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-05T08:43:33.752 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root mem REG 8,1 53816 1703 /usr/lib64/libnuma.so.1.0.0 2023-11-05T08:43:33.752 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-05T08:43:33.752 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-05T08:43:33.753 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-05T08:43:33.753 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root mem REG 8,1 83456 265542 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-05T08:43:33.753 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root mem REG 8,1 370416 265532 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-05T08:43:33.753 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root mem REG 8,1 1481856 265536 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-05T08:43:33.753 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root mem REG 8,1 45648 265517 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-05T08:43:33.754 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root mem REG 8,1 41304 265576 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-05T08:43:33.754 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root mem REG 8,1 49912 265561 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-05T08:43:33.754 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root mem REG 8,1 418096 265585 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-05T08:43:33.754 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root mem REG 8,1 83208 265579 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-05T08:43:33.754 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root mem REG 8,1 69736 2048 /usr/lib64/liboath.so.0.1.3 2023-11-05T08:43:33.754 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root mem REG 8,1 79224 265555 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-05T08:43:33.755 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root mem REG 8,1 49744 265609 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-05T08:43:33.755 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root mem REG 8,1 49856 265552 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-05T08:43:33.755 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root mem REG 8,1 83632 265549 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-05T08:43:33.755 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root mem REG 8,1 78744 265606 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-05T08:43:33.755 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root mem REG 8,1 53880 265603 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-05T08:43:33.756 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root mem REG 8,1 872944 265588 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-05T08:43:33.756 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root mem REG 8,1 116592 265558 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-05T08:43:33.756 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root mem REG 8,1 133768 2095 /usr/lib64/libfmt.so.8.1.1 2023-11-05T08:43:33.756 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root mem REG 8,1 1242808 265591 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-05T08:43:33.756 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root mem REG 8,1 62224 265570 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-05T08:43:33.756 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root mem REG 8,1 95808 265564 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-05T08:43:33.757 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root mem REG 8,1 37272 265600 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2023-11-05T08:43:33.757 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root mem REG 8,1 104024 265582 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-05T08:43:33.757 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root mem REG 8,1 133480 265546 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-05T08:43:33.757 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root mem REG 8,1 834760 265573 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2023-11-05T08:43:33.757 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-05T08:43:33.758 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root mem REG 8,1 129280 265594 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-05T08:43:33.758 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root mem REG 8,1 83224 265567 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-05T08:43:33.758 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root mem REG 8,1 48 3081 /tmp/vgdb-pipe-shared-mem-vgdb-86246-by-root-on-??? 2023-11-05T08:43:33.758 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root DEL REG 0,17 182056 /[aio] 2023-11-05T08:43:33.758 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root DEL REG 0,17 182868 /[aio] 2023-11-05T08:43:33.758 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root 0r CHR 1,3 0t0 4 /dev/null 2023-11-05T08:43:33.759 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root 1w FIFO 0,13 0t0 182740 pipe 2023-11-05T08:43:33.759 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root 2w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:33.759 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root 3w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:33.759 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root 4r FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:33.759 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root 5w FIFO 0,13 0t0 182773 pipe 2023-11-05T08:43:33.760 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root 6u a_inode 0,14 0 1084 [eventpoll:7,20,21,22,23,24,25,26,27,66] 2023-11-05T08:43:33.760 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root 7r FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:33.760 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root 8w FIFO 0,13 0t0 182776 pipe 2023-11-05T08:43:33.760 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root 9u a_inode 0,14 0 1084 [eventpoll:10,67] 2023-11-05T08:43:33.760 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root 10r FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:33.760 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root 11w FIFO 0,13 0t0 182777 pipe 2023-11-05T08:43:33.761 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root 12u a_inode 0,14 0 1084 [eventpoll:13] 2023-11-05T08:43:33.761 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root 13r FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:33.761 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root 14w FIFO 0,13 0t0 182778 pipe 2023-11-05T08:43:33.761 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root 15w REG 8,1 465910012 276998 /var/log/ceph/ceph-osd.7.log 2023-11-05T08:43:33.761 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root 16uW REG 0,24 6 1974 /run/ceph/ceph-osd.7.pid 2023-11-05T08:43:33.761 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root 17r FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:33.762 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root 18w FIFO 0,13 0t0 187411 pipe 2023-11-05T08:43:33.762 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root 19u unix 0xffff8da307b0b300 0t0 187412 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2023-11-05T08:43:33.762 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root 20u IPv4 185761 0t0 TCP *:6802 (LISTEN) 2023-11-05T08:43:33.762 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root 21u IPv4 185765 0t0 TCP *:6803 (LISTEN) 2023-11-05T08:43:33.762 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root 22u IPv4 185770 0t0 TCP *:6804 (LISTEN) 2023-11-05T08:43:33.763 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root 23u IPv4 185776 0t0 TCP *:6805 (LISTEN) 2023-11-05T08:43:33.763 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root 24u IPv4 185783 0t0 TCP *:6806 (LISTEN) 2023-11-05T08:43:33.763 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root 25u IPv4 185791 0t0 TCP *:6807 (LISTEN) 2023-11-05T08:43:33.763 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root 26u IPv4 185800 0t0 TCP *:6808 (LISTEN) 2023-11-05T08:43:33.763 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root 27u IPv4 185810 0t0 TCP *:6809 (LISTEN) 2023-11-05T08:43:33.764 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root 28r FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:33.764 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root 29w FIFO 0,13 0t0 182026 pipe 2023-11-05T08:43:33.764 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root 30r FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:33.764 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root 31w FIFO 0,13 0t0 182027 pipe 2023-11-05T08:43:33.764 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root 32u sock 0,8 0t0 182041 protocol: UDPv6 2023-11-05T08:43:33.765 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2023-11-05T08:43:33.765 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2023-11-05T08:43:33.765 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.765 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.765 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.765 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.766 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.766 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.766 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.766 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.766 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.767 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.767 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.767 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.767 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.767 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.768 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.768 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.768 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.768 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.768 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.768 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.769 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.769 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.769 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.769 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2023-11-05T08:43:33.769 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root 60r FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:33.769 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root 61w FIFO 0,13 0t0 182061 pipe 2023-11-05T08:43:33.770 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root 62r FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:33.770 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root 63w FIFO 0,13 0t0 182062 pipe 2023-11-05T08:43:33.770 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root 66u IPv4 199302 0t0 TCP smithi156.front.sepia.ceph.com:56964->smithi156.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-05T08:43:33.770 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root 67u IPv4 199303 0t0 TCP smithi156.front.sepia.ceph.com:6802->smithi156.front.sepia.ceph.com:56964 (ESTABLISHED) 2023-11-05T08:43:33.770 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root *524r REG 8,1 25593496 2545 /usr/bin/ceph-osd 2023-11-05T08:43:33.771 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root *525u REG 8,1 32 3087 /tmp/valgrind_proc_86246_cmdline_85358a06 (deleted) 2023-11-05T08:43:33.771 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root *526u REG 8,1 336 3088 /tmp/valgrind_proc_86246_auxv_85358a06 (deleted) 2023-11-05T08:43:33.771 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root *527w FIFO 0,13 0t0 182741 pipe 2023-11-05T08:43:33.771 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root *528w REG 8,1 1234 524881 /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:33.771 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root *529r FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:33.772 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root *530w FIFO 0,13 0t0 182772 pipe 2023-11-05T08:43:33.772 INFO:teuthology.orchestra.run.smithi156.stdout:memcheck- 86246 89522 osd_srv_h root *531r FIFO 8,1 0t0 3091 /tmp/vgdb-pipe-from-vgdb-to-86246-by-root-on-??? 2023-11-05T08:43:33.772 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/5 89579 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:33.772 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/5 89579 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:33.772 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/5 89579 root txt unknown /proc/89579/exe 2023-11-05T08:43:33.772 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/7 89582 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:33.773 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/7 89582 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:33.773 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/7 89582 root txt unknown /proc/89582/exe 2023-11-05T08:43:33.773 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/0 89588 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:33.773 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/0 89588 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:33.773 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/0 89588 root txt unknown /proc/89588/exe 2023-11-05T08:43:33.774 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/u 89590 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:33.774 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/u 89590 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:33.774 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/u 89590 root txt unknown /proc/89590/exe 2023-11-05T08:43:33.774 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/1 89596 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:33.774 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/1 89596 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:33.774 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/1 89596 root txt unknown /proc/89596/exe 2023-11-05T08:43:33.775 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/1 89598 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:33.775 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/1 89598 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:33.775 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/1 89598 root txt unknown /proc/89598/exe 2023-11-05T08:43:33.775 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/6 89600 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:33.775 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/6 89600 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:33.776 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/6 89600 root txt unknown /proc/89600/exe 2023-11-05T08:43:33.776 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/5 89601 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:33.776 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/5 89601 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:33.776 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/5 89601 root txt unknown /proc/89601/exe 2023-11-05T08:43:33.776 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/u 89602 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:33.776 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/u 89602 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:33.777 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/u 89602 root txt unknown /proc/89602/exe 2023-11-05T08:43:33.777 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/6 89603 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:33.777 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/6 89603 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:33.777 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/6 89603 root txt unknown /proc/89603/exe 2023-11-05T08:43:33.777 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/5 89604 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:33.778 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/5 89604 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:33.778 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/5 89604 root txt unknown /proc/89604/exe 2023-11-05T08:43:33.778 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/1 89606 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:33.778 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/1 89606 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:33.778 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/1 89606 root txt unknown /proc/89606/exe 2023-11-05T08:43:33.778 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/u 89624 root cwd DIR 8,1 4096 2 / 2023-11-05T08:43:33.779 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/u 89624 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:33.779 INFO:teuthology.orchestra.run.smithi156.stdout:kworker/u 89624 root txt unknown /proc/89624/exe 2023-11-05T08:43:33.779 INFO:teuthology.orchestra.run.smithi156.stdout:bash 89684 ubuntu cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-05T08:43:33.779 INFO:teuthology.orchestra.run.smithi156.stdout:bash 89684 ubuntu rtd DIR 8,1 4096 2 / 2023-11-05T08:43:33.779 INFO:teuthology.orchestra.run.smithi156.stdout:bash 89684 ubuntu txt REG 8,1 1388920 9667 /usr/bin/bash 2023-11-05T08:43:33.779 INFO:teuthology.orchestra.run.smithi156.stdout:bash 89684 ubuntu mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-05T08:43:33.780 INFO:teuthology.orchestra.run.smithi156.stdout:bash 89684 ubuntu mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:33.780 INFO:teuthology.orchestra.run.smithi156.stdout:bash 89684 ubuntu mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-05T08:43:33.780 INFO:teuthology.orchestra.run.smithi156.stdout:bash 89684 ubuntu mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-05T08:43:33.780 INFO:teuthology.orchestra.run.smithi156.stdout:bash 89684 ubuntu mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-05T08:43:33.780 INFO:teuthology.orchestra.run.smithi156.stdout:bash 89684 ubuntu mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-05T08:43:33.781 INFO:teuthology.orchestra.run.smithi156.stdout:bash 89684 ubuntu mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-05T08:43:33.781 INFO:teuthology.orchestra.run.smithi156.stdout:bash 89684 ubuntu mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-05T08:43:33.781 INFO:teuthology.orchestra.run.smithi156.stdout:bash 89684 ubuntu mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-05T08:43:33.781 INFO:teuthology.orchestra.run.smithi156.stdout:bash 89684 ubuntu mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-05T08:43:33.781 INFO:teuthology.orchestra.run.smithi156.stdout:bash 89684 ubuntu mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-05T08:43:33.781 INFO:teuthology.orchestra.run.smithi156.stdout:bash 89684 ubuntu mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-05T08:43:33.782 INFO:teuthology.orchestra.run.smithi156.stdout:bash 89684 ubuntu mem REG 8,1 195080 9664 /usr/lib64/libtinfo.so.6.2 2023-11-05T08:43:33.782 INFO:teuthology.orchestra.run.smithi156.stdout:bash 89684 ubuntu mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-05T08:43:33.782 INFO:teuthology.orchestra.run.smithi156.stdout:bash 89684 ubuntu mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:33.782 INFO:teuthology.orchestra.run.smithi156.stdout:bash 89684 ubuntu mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-05T08:43:33.782 INFO:teuthology.orchestra.run.smithi156.stdout:bash 89684 ubuntu 0r FIFO 0,13 0t0 200382 pipe 2023-11-05T08:43:33.783 INFO:teuthology.orchestra.run.smithi156.stdout:bash 89684 ubuntu 1w FIFO 0,13 0t0 200383 pipe 2023-11-05T08:43:33.783 INFO:teuthology.orchestra.run.smithi156.stdout:bash 89684 ubuntu 2w FIFO 0,13 0t0 200384 pipe 2023-11-05T08:43:33.783 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 89700 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-05T08:43:33.783 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 89700 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:33.783 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 89700 root txt REG 8,1 185296 11759 /usr/bin/sudo 2023-11-05T08:43:33.783 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 89700 root mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2023-11-05T08:43:33.784 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 89700 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-05T08:43:33.784 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 89700 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-05T08:43:33.784 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 89700 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-05T08:43:33.784 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 89700 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-05T08:43:33.784 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 89700 root mem REG 8,1 19600 10967 /usr/lib64/libpam_misc.so.0.82.1 2023-11-05T08:43:33.785 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 89700 root mem REG 8,1 19400 32305 /usr/lib64/security/pam_succeed_if.so 2023-11-05T08:43:33.785 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 89700 root mem REG 8,1 514280 32422 /usr/lib64/security/pam_systemd.so 2023-11-05T08:43:33.785 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 89700 root mem REG 8,1 27536 32284 /usr/lib64/security/pam_limits.so 2023-11-05T08:43:33.785 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 89700 root mem REG 8,1 48392 10228 /usr/lib64/libcrack.so.2.9.0 2023-11-05T08:43:33.785 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 89700 root mem REG 8,1 32608 10961 /usr/lib64/libpwquality.so.1.0.2 2023-11-05T08:43:33.785 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 89700 root mem REG 8,1 15352 32282 /usr/lib64/security/pam_keyinit.so 2023-11-05T08:43:33.786 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 89700 root mem REG 8,1 15840 32264 /usr/lib64/security/pam_pwquality.so 2023-11-05T08:43:33.786 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 89700 root mem REG 8,1 14928 32270 /usr/lib64/security/pam_deny.so 2023-11-05T08:43:33.786 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 89700 root mem REG 8,1 56712 32310 /usr/lib64/security/pam_unix.so 2023-11-05T08:43:33.786 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 89700 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-05T08:43:33.786 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 89700 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-05T08:43:33.787 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 89700 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-05T08:43:33.787 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 89700 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-05T08:43:33.787 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 89700 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-05T08:43:33.787 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 89700 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-05T08:43:33.787 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 89700 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-05T08:43:33.787 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 89700 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-05T08:43:33.788 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 89700 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-05T08:43:33.788 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 89700 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-05T08:43:33.788 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 89700 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-05T08:43:33.788 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 89700 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-05T08:43:33.788 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 89700 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-05T08:43:33.789 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 89700 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:33.789 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 89700 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-05T08:43:33.789 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 89700 root mem REG 8,1 15184 32274 /usr/lib64/security/pam_faildelay.so 2023-11-05T08:43:33.789 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 89700 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-05T08:43:33.789 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 89700 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-05T08:43:33.789 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 89700 root mem REG 8,1 472568 54513 /usr/libexec/sudo/sudoers.so 2023-11-05T08:43:33.790 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 89700 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:33.790 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 89700 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:33.790 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 89700 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-05T08:43:33.790 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 89700 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-05T08:43:33.790 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 89700 root mem REG 8,1 19464 32272 /usr/lib64/security/pam_env.so 2023-11-05T08:43:33.791 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 89700 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-05T08:43:33.791 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 89700 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-05T08:43:33.791 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 89700 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-05T08:43:33.791 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 89700 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-05T08:43:33.791 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 89700 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-05T08:43:33.791 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 89700 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-05T08:43:33.792 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 89700 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-05T08:43:33.792 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 89700 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-05T08:43:33.792 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 89700 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-05T08:43:33.792 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 89700 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-05T08:43:33.792 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 89700 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-05T08:43:33.793 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 89700 root mem REG 8,1 119832 54509 /usr/libexec/sudo/libsudo_util.so.0.0.0 2023-11-05T08:43:33.793 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 89700 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:33.793 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 89700 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-05T08:43:33.793 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 89700 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-05T08:43:33.793 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 89700 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:33.793 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 89700 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-05T08:43:33.794 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 89700 root 0r FIFO 0,13 0t0 200382 pipe 2023-11-05T08:43:33.794 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 89700 root 1w FIFO 0,13 0t0 200383 pipe 2023-11-05T08:43:33.794 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 89700 root 2w FIFO 0,13 0t0 200384 pipe 2023-11-05T08:43:33.794 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 89700 root 3r FIFO 0,13 0t0 201170 pipe 2023-11-05T08:43:33.794 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 89700 root 4w FIFO 0,13 0t0 201170 pipe 2023-11-05T08:43:33.795 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 89700 root 5u netlink 0t0 201176 AUDIT 2023-11-05T08:43:33.795 INFO:teuthology.orchestra.run.smithi156.stdout:sudo 89700 root 6u unix 0xffff8da318879540 0t0 201177 type=DGRAM (CONNECTED) 2023-11-05T08:43:33.795 INFO:teuthology.orchestra.run.smithi156.stdout:lsof 89702 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-05T08:43:33.795 INFO:teuthology.orchestra.run.smithi156.stdout:lsof 89702 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:33.795 INFO:teuthology.orchestra.run.smithi156.stdout:lsof 89702 root txt REG 8,1 179232 12343 /usr/bin/lsof 2023-11-05T08:43:33.795 INFO:teuthology.orchestra.run.smithi156.stdout:lsof 89702 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-05T08:43:33.796 INFO:teuthology.orchestra.run.smithi156.stdout:lsof 89702 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-05T08:43:33.796 INFO:teuthology.orchestra.run.smithi156.stdout:lsof 89702 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:33.796 INFO:teuthology.orchestra.run.smithi156.stdout:lsof 89702 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-05T08:43:33.796 INFO:teuthology.orchestra.run.smithi156.stdout:lsof 89702 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-05T08:43:33.796 INFO:teuthology.orchestra.run.smithi156.stdout:lsof 89702 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:33.797 INFO:teuthology.orchestra.run.smithi156.stdout:lsof 89702 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-05T08:43:33.797 INFO:teuthology.orchestra.run.smithi156.stdout:lsof 89702 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-05T08:43:33.797 INFO:teuthology.orchestra.run.smithi156.stdout:lsof 89702 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-05T08:43:33.797 INFO:teuthology.orchestra.run.smithi156.stdout:lsof 89702 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-05T08:43:33.797 INFO:teuthology.orchestra.run.smithi156.stdout:lsof 89702 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-05T08:43:33.797 INFO:teuthology.orchestra.run.smithi156.stdout:lsof 89702 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:33.798 INFO:teuthology.orchestra.run.smithi156.stdout:lsof 89702 root mem REG 8,1 196112 11431 /usr/lib64/libtirpc.so.3.0.0 2023-11-05T08:43:33.798 INFO:teuthology.orchestra.run.smithi156.stdout:lsof 89702 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:33.798 INFO:teuthology.orchestra.run.smithi156.stdout:lsof 89702 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-05T08:43:33.798 INFO:teuthology.orchestra.run.smithi156.stdout:lsof 89702 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:33.798 INFO:teuthology.orchestra.run.smithi156.stdout:lsof 89702 root 0r FIFO 0,13 0t0 200382 pipe 2023-11-05T08:43:33.799 INFO:teuthology.orchestra.run.smithi156.stdout:lsof 89702 root 1w FIFO 0,13 0t0 200383 pipe 2023-11-05T08:43:33.799 INFO:teuthology.orchestra.run.smithi156.stdout:lsof 89702 root 2w FIFO 0,13 0t0 200384 pipe 2023-11-05T08:43:33.799 INFO:teuthology.orchestra.run.smithi156.stdout:lsof 89702 root 3r DIR 0,20 0 1 /proc 2023-11-05T08:43:33.799 INFO:teuthology.orchestra.run.smithi156.stdout:lsof 89702 root 4r DIR 0,20 0 202129 /proc/89702/fd 2023-11-05T08:43:33.799 INFO:teuthology.orchestra.run.smithi156.stdout:lsof 89702 root 5w FIFO 0,13 0t0 202134 pipe 2023-11-05T08:43:33.799 INFO:teuthology.orchestra.run.smithi156.stdout:lsof 89702 root 6r FIFO 0,13 0t0 202135 pipe 2023-11-05T08:43:33.800 INFO:teuthology.orchestra.run.smithi156.stdout:lsof 89703 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-05T08:43:33.800 INFO:teuthology.orchestra.run.smithi156.stdout:lsof 89703 root rtd DIR 8,1 4096 2 / 2023-11-05T08:43:33.800 INFO:teuthology.orchestra.run.smithi156.stdout:lsof 89703 root txt REG 8,1 179232 12343 /usr/bin/lsof 2023-11-05T08:43:33.800 INFO:teuthology.orchestra.run.smithi156.stdout:lsof 89703 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-05T08:43:33.800 INFO:teuthology.orchestra.run.smithi156.stdout:lsof 89703 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-05T08:43:33.801 INFO:teuthology.orchestra.run.smithi156.stdout:lsof 89703 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-05T08:43:33.801 INFO:teuthology.orchestra.run.smithi156.stdout:lsof 89703 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-05T08:43:33.801 INFO:teuthology.orchestra.run.smithi156.stdout:lsof 89703 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-05T08:43:33.801 INFO:teuthology.orchestra.run.smithi156.stdout:lsof 89703 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-05T08:43:33.801 INFO:teuthology.orchestra.run.smithi156.stdout:lsof 89703 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-05T08:43:33.801 INFO:teuthology.orchestra.run.smithi156.stdout:lsof 89703 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-05T08:43:33.802 INFO:teuthology.orchestra.run.smithi156.stdout:lsof 89703 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-05T08:43:33.802 INFO:teuthology.orchestra.run.smithi156.stdout:lsof 89703 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-05T08:43:33.802 INFO:teuthology.orchestra.run.smithi156.stdout:lsof 89703 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-05T08:43:33.802 INFO:teuthology.orchestra.run.smithi156.stdout:lsof 89703 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-05T08:43:33.802 INFO:teuthology.orchestra.run.smithi156.stdout:lsof 89703 root mem REG 8,1 196112 11431 /usr/lib64/libtirpc.so.3.0.0 2023-11-05T08:43:33.803 INFO:teuthology.orchestra.run.smithi156.stdout:lsof 89703 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-05T08:43:33.803 INFO:teuthology.orchestra.run.smithi156.stdout:lsof 89703 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-05T08:43:33.803 INFO:teuthology.orchestra.run.smithi156.stdout:lsof 89703 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-05T08:43:33.803 INFO:teuthology.orchestra.run.smithi156.stdout:lsof 89703 root 4r FIFO 0,13 0t0 202134 pipe 2023-11-05T08:43:33.803 INFO:teuthology.orchestra.run.smithi156.stdout:lsof 89703 root 7w FIFO 0,13 0t0 202135 pipe 2023-11-05T08:43:33.804 INFO:teuthology.orchestra.run.smithi156.stdout:USER PID %CPU %MEM VSZ RSS TTY STAT START TIME COMMAND 2023-11-05T08:43:33.804 INFO:teuthology.orchestra.run.smithi156.stdout:root 2 0.0 0.0 0 0 ? S 07:49 0:00 [kthreadd] 2023-11-05T08:43:33.804 INFO:teuthology.orchestra.run.smithi156.stdout:root 3 0.0 0.0 0 0 ? I< 07:49 0:00 \_ [rcu_gp] 2023-11-05T08:43:33.804 INFO:teuthology.orchestra.run.smithi156.stdout:root 4 0.0 0.0 0 0 ? I< 07:49 0:00 \_ [rcu_par_gp] 2023-11-05T08:43:33.804 INFO:teuthology.orchestra.run.smithi156.stdout:root 5 0.0 0.0 0 0 ? I< 07:49 0:00 \_ [slub_flushwq] 2023-11-05T08:43:33.805 INFO:teuthology.orchestra.run.smithi156.stdout:root 6 0.0 0.0 0 0 ? I< 07:49 0:00 \_ [netns] 2023-11-05T08:43:33.805 INFO:teuthology.orchestra.run.smithi156.stdout:root 8 0.0 0.0 0 0 ? I< 07:49 0:00 \_ [kworker/0:0H-events_highpri] 2023-11-05T08:43:33.805 INFO:teuthology.orchestra.run.smithi156.stdout:root 11 0.0 0.0 0 0 ? I< 07:49 0:00 \_ [mm_percpu_wq] 2023-11-05T08:43:33.805 INFO:teuthology.orchestra.run.smithi156.stdout:root 13 0.0 0.0 0 0 ? I 07:49 0:00 \_ [rcu_tasks_kthre] 2023-11-05T08:43:33.805 INFO:teuthology.orchestra.run.smithi156.stdout:root 14 0.0 0.0 0 0 ? I 07:49 0:00 \_ [rcu_tasks_rude_] 2023-11-05T08:43:33.806 INFO:teuthology.orchestra.run.smithi156.stdout:root 15 0.0 0.0 0 0 ? I 07:49 0:00 \_ [rcu_tasks_trace] 2023-11-05T08:43:33.806 INFO:teuthology.orchestra.run.smithi156.stdout:root 16 0.0 0.0 0 0 ? S 07:49 0:00 \_ [ksoftirqd/0] 2023-11-05T08:43:33.806 INFO:teuthology.orchestra.run.smithi156.stdout:root 17 0.1 0.0 0 0 ? S 07:49 0:04 \_ [pr/ttyS1] 2023-11-05T08:43:33.806 INFO:teuthology.orchestra.run.smithi156.stdout:root 18 0.0 0.0 0 0 ? I 07:49 0:00 \_ [rcu_preempt] 2023-11-05T08:43:33.806 INFO:teuthology.orchestra.run.smithi156.stdout:root 19 0.0 0.0 0 0 ? S 07:49 0:00 \_ [migration/0] 2023-11-05T08:43:33.807 INFO:teuthology.orchestra.run.smithi156.stdout:root 20 0.0 0.0 0 0 ? S 07:49 0:00 \_ [idle_inject/0] 2023-11-05T08:43:33.807 INFO:teuthology.orchestra.run.smithi156.stdout:root 21 0.0 0.0 0 0 ? S 07:49 0:00 \_ [cpuhp/0] 2023-11-05T08:43:33.807 INFO:teuthology.orchestra.run.smithi156.stdout:root 22 0.0 0.0 0 0 ? S 07:49 0:00 \_ [cpuhp/1] 2023-11-05T08:43:33.807 INFO:teuthology.orchestra.run.smithi156.stdout:root 23 0.0 0.0 0 0 ? S 07:49 0:00 \_ [idle_inject/1] 2023-11-05T08:43:33.807 INFO:teuthology.orchestra.run.smithi156.stdout:root 24 0.0 0.0 0 0 ? S 07:49 0:00 \_ [migration/1] 2023-11-05T08:43:33.807 INFO:teuthology.orchestra.run.smithi156.stdout:root 25 0.0 0.0 0 0 ? S 07:49 0:00 \_ [ksoftirqd/1] 2023-11-05T08:43:33.808 INFO:teuthology.orchestra.run.smithi156.stdout:root 27 0.0 0.0 0 0 ? I< 07:49 0:00 \_ [kworker/1:0H-events_highpri] 2023-11-05T08:43:33.808 INFO:teuthology.orchestra.run.smithi156.stdout:root 28 0.0 0.0 0 0 ? S 07:49 0:00 \_ [cpuhp/2] 2023-11-05T08:43:33.808 INFO:teuthology.orchestra.run.smithi156.stdout:root 29 0.0 0.0 0 0 ? S 07:49 0:00 \_ [idle_inject/2] 2023-11-05T08:43:33.808 INFO:teuthology.orchestra.run.smithi156.stdout:root 30 0.0 0.0 0 0 ? S 07:49 0:00 \_ [migration/2] 2023-11-05T08:43:33.808 INFO:teuthology.orchestra.run.smithi156.stdout:root 31 0.0 0.0 0 0 ? S 07:49 0:00 \_ [ksoftirqd/2] 2023-11-05T08:43:33.809 INFO:teuthology.orchestra.run.smithi156.stdout:root 33 0.0 0.0 0 0 ? I< 07:49 0:00 \_ [kworker/2:0H-events_highpri] 2023-11-05T08:43:33.809 INFO:teuthology.orchestra.run.smithi156.stdout:root 34 0.0 0.0 0 0 ? S 07:49 0:00 \_ [cpuhp/3] 2023-11-05T08:43:33.809 INFO:teuthology.orchestra.run.smithi156.stdout:root 35 0.0 0.0 0 0 ? S 07:49 0:00 \_ [idle_inject/3] 2023-11-05T08:43:33.809 INFO:teuthology.orchestra.run.smithi156.stdout:root 36 0.0 0.0 0 0 ? S 07:49 0:00 \_ [migration/3] 2023-11-05T08:43:33.809 INFO:teuthology.orchestra.run.smithi156.stdout:root 37 0.0 0.0 0 0 ? S 07:49 0:00 \_ [ksoftirqd/3] 2023-11-05T08:43:33.810 INFO:teuthology.orchestra.run.smithi156.stdout:root 39 0.0 0.0 0 0 ? I< 07:49 0:00 \_ [kworker/3:0H-events_highpri] 2023-11-05T08:43:33.810 INFO:teuthology.orchestra.run.smithi156.stdout:root 40 0.0 0.0 0 0 ? S 07:49 0:00 \_ [cpuhp/4] 2023-11-05T08:43:33.810 INFO:teuthology.orchestra.run.smithi156.stdout:root 41 0.0 0.0 0 0 ? S 07:49 0:00 \_ [idle_inject/4] 2023-11-05T08:43:33.810 INFO:teuthology.orchestra.run.smithi156.stdout:root 42 0.0 0.0 0 0 ? S 07:49 0:00 \_ [migration/4] 2023-11-05T08:43:33.810 INFO:teuthology.orchestra.run.smithi156.stdout:root 43 0.0 0.0 0 0 ? S 07:49 0:00 \_ [ksoftirqd/4] 2023-11-05T08:43:33.810 INFO:teuthology.orchestra.run.smithi156.stdout:root 45 0.0 0.0 0 0 ? I< 07:49 0:00 \_ [kworker/4:0H-events_highpri] 2023-11-05T08:43:33.811 INFO:teuthology.orchestra.run.smithi156.stdout:root 46 0.0 0.0 0 0 ? S 07:49 0:00 \_ [cpuhp/5] 2023-11-05T08:43:33.811 INFO:teuthology.orchestra.run.smithi156.stdout:root 47 0.0 0.0 0 0 ? S 07:49 0:00 \_ [idle_inject/5] 2023-11-05T08:43:33.811 INFO:teuthology.orchestra.run.smithi156.stdout:root 48 0.0 0.0 0 0 ? S 07:49 0:00 \_ [migration/5] 2023-11-05T08:43:33.811 INFO:teuthology.orchestra.run.smithi156.stdout:root 49 0.0 0.0 0 0 ? S 07:49 0:00 \_ [ksoftirqd/5] 2023-11-05T08:43:33.811 INFO:teuthology.orchestra.run.smithi156.stdout:root 51 0.0 0.0 0 0 ? I< 07:49 0:00 \_ [kworker/5:0H-events_highpri] 2023-11-05T08:43:33.812 INFO:teuthology.orchestra.run.smithi156.stdout:root 52 0.0 0.0 0 0 ? S 07:49 0:00 \_ [cpuhp/6] 2023-11-05T08:43:33.812 INFO:teuthology.orchestra.run.smithi156.stdout:root 53 0.0 0.0 0 0 ? S 07:49 0:00 \_ [idle_inject/6] 2023-11-05T08:43:33.812 INFO:teuthology.orchestra.run.smithi156.stdout:root 54 0.0 0.0 0 0 ? S 07:49 0:00 \_ [migration/6] 2023-11-05T08:43:33.812 INFO:teuthology.orchestra.run.smithi156.stdout:root 55 0.0 0.0 0 0 ? S 07:49 0:00 \_ [ksoftirqd/6] 2023-11-05T08:43:33.812 INFO:teuthology.orchestra.run.smithi156.stdout:root 57 0.0 0.0 0 0 ? I< 07:49 0:00 \_ [kworker/6:0H-events_highpri] 2023-11-05T08:43:33.813 INFO:teuthology.orchestra.run.smithi156.stdout:root 58 0.0 0.0 0 0 ? S 07:49 0:00 \_ [cpuhp/7] 2023-11-05T08:43:33.813 INFO:teuthology.orchestra.run.smithi156.stdout:root 59 0.0 0.0 0 0 ? S 07:49 0:00 \_ [idle_inject/7] 2023-11-05T08:43:33.813 INFO:teuthology.orchestra.run.smithi156.stdout:root 60 0.0 0.0 0 0 ? S 07:49 0:00 \_ [migration/7] 2023-11-05T08:43:33.813 INFO:teuthology.orchestra.run.smithi156.stdout:root 61 0.0 0.0 0 0 ? S 07:49 0:00 \_ [ksoftirqd/7] 2023-11-05T08:43:33.813 INFO:teuthology.orchestra.run.smithi156.stdout:root 63 0.0 0.0 0 0 ? I< 07:49 0:00 \_ [kworker/7:0H-events_highpri] 2023-11-05T08:43:33.813 INFO:teuthology.orchestra.run.smithi156.stdout:root 67 0.0 0.0 0 0 ? I 07:49 0:00 \_ [kworker/u16:4-writeback] 2023-11-05T08:43:33.814 INFO:teuthology.orchestra.run.smithi156.stdout:root 70 0.0 0.0 0 0 ? I 07:49 0:01 \_ [kworker/u16:7-flush-8:0] 2023-11-05T08:43:33.814 INFO:teuthology.orchestra.run.smithi156.stdout:root 71 0.0 0.0 0 0 ? S 07:49 0:00 \_ [kdevtmpfs] 2023-11-05T08:43:33.814 INFO:teuthology.orchestra.run.smithi156.stdout:root 72 0.0 0.0 0 0 ? I< 07:49 0:00 \_ [inet_frag_wq] 2023-11-05T08:43:33.814 INFO:teuthology.orchestra.run.smithi156.stdout:root 73 0.0 0.0 0 0 ? S 07:49 0:00 \_ [kauditd] 2023-11-05T08:43:33.814 INFO:teuthology.orchestra.run.smithi156.stdout:root 75 0.0 0.0 0 0 ? S 07:49 0:00 \_ [khungtaskd] 2023-11-05T08:43:33.815 INFO:teuthology.orchestra.run.smithi156.stdout:root 76 0.0 0.0 0 0 ? S 07:49 0:00 \_ [oom_reaper] 2023-11-05T08:43:33.815 INFO:teuthology.orchestra.run.smithi156.stdout:root 77 0.0 0.0 0 0 ? I< 07:49 0:00 \_ [writeback] 2023-11-05T08:43:33.815 INFO:teuthology.orchestra.run.smithi156.stdout:root 78 0.0 0.0 0 0 ? S 07:49 0:00 \_ [kcompactd0] 2023-11-05T08:43:33.815 INFO:teuthology.orchestra.run.smithi156.stdout:root 79 0.0 0.0 0 0 ? SN 07:49 0:00 \_ [ksmd] 2023-11-05T08:43:33.815 INFO:teuthology.orchestra.run.smithi156.stdout:root 80 0.0 0.0 0 0 ? I 07:49 0:00 \_ [kworker/6:1-mm_percpu_wq] 2023-11-05T08:43:33.815 INFO:teuthology.orchestra.run.smithi156.stdout:root 81 0.0 0.0 0 0 ? SN 07:49 0:00 \_ [khugepaged] 2023-11-05T08:43:33.816 INFO:teuthology.orchestra.run.smithi156.stdout:root 82 0.0 0.0 0 0 ? I< 07:49 0:00 \_ [cryptd] 2023-11-05T08:43:33.816 INFO:teuthology.orchestra.run.smithi156.stdout:root 83 0.0 0.0 0 0 ? I< 07:49 0:00 \_ [kintegrityd] 2023-11-05T08:43:33.816 INFO:teuthology.orchestra.run.smithi156.stdout:root 84 0.0 0.0 0 0 ? I< 07:49 0:00 \_ [kblockd] 2023-11-05T08:43:33.816 INFO:teuthology.orchestra.run.smithi156.stdout:root 85 0.0 0.0 0 0 ? I< 07:49 0:00 \_ [blkcg_punt_bio] 2023-11-05T08:43:33.816 INFO:teuthology.orchestra.run.smithi156.stdout:root 86 0.0 0.0 0 0 ? I< 07:49 0:00 \_ [tpm_dev_wq] 2023-11-05T08:43:33.817 INFO:teuthology.orchestra.run.smithi156.stdout:root 87 0.0 0.0 0 0 ? I< 07:49 0:00 \_ [md] 2023-11-05T08:43:33.817 INFO:teuthology.orchestra.run.smithi156.stdout:root 88 0.0 0.0 0 0 ? I< 07:49 0:00 \_ [md_bitmap] 2023-11-05T08:43:33.817 INFO:teuthology.orchestra.run.smithi156.stdout:root 89 0.0 0.0 0 0 ? I< 07:49 0:00 \_ [edac-poller] 2023-11-05T08:43:33.817 INFO:teuthology.orchestra.run.smithi156.stdout:root 90 0.0 0.0 0 0 ? S 07:49 0:00 \_ [watchdogd] 2023-11-05T08:43:33.817 INFO:teuthology.orchestra.run.smithi156.stdout:root 92 0.0 0.0 0 0 ? I< 07:49 0:00 \_ [kworker/5:1H-xfs-log/dm-2] 2023-11-05T08:43:33.817 INFO:teuthology.orchestra.run.smithi156.stdout:root 93 0.0 0.0 0 0 ? S 07:49 0:00 \_ [kswapd0] 2023-11-05T08:43:33.818 INFO:teuthology.orchestra.run.smithi156.stdout:root 99 0.0 0.0 0 0 ? I< 07:49 0:00 \_ [kthrotld] 2023-11-05T08:43:33.818 INFO:teuthology.orchestra.run.smithi156.stdout:root 109 0.0 0.0 0 0 ? I< 07:49 0:00 \_ [acpi_thermal_pm] 2023-11-05T08:43:33.818 INFO:teuthology.orchestra.run.smithi156.stdout:root 110 0.0 0.0 0 0 ? I< 07:49 0:00 \_ [kmpath_rdacd] 2023-11-05T08:43:33.818 INFO:teuthology.orchestra.run.smithi156.stdout:root 111 0.0 0.0 0 0 ? I< 07:49 0:00 \_ [kaluad] 2023-11-05T08:43:33.818 INFO:teuthology.orchestra.run.smithi156.stdout:root 113 0.0 0.0 0 0 ? I< 07:49 0:00 \_ [mld] 2023-11-05T08:43:33.819 INFO:teuthology.orchestra.run.smithi156.stdout:root 114 0.0 0.0 0 0 ? I< 07:49 0:00 \_ [kworker/1:1H-kblockd] 2023-11-05T08:43:33.819 INFO:teuthology.orchestra.run.smithi156.stdout:root 115 0.0 0.0 0 0 ? I< 07:49 0:00 \_ [ipv6_addrconf] 2023-11-05T08:43:33.819 INFO:teuthology.orchestra.run.smithi156.stdout:root 124 0.0 0.0 0 0 ? I< 07:49 0:00 \_ [kstrp] 2023-11-05T08:43:33.819 INFO:teuthology.orchestra.run.smithi156.stdout:root 126 0.0 0.0 0 0 ? I 07:49 0:00 \_ [kworker/3:2-events] 2023-11-05T08:43:33.819 INFO:teuthology.orchestra.run.smithi156.stdout:root 131 0.0 0.0 0 0 ? I< 07:49 0:00 \_ [zswap-shrink] 2023-11-05T08:43:33.819 INFO:teuthology.orchestra.run.smithi156.stdout:root 239 0.0 0.0 0 0 ? I< 07:49 0:00 \_ [kworker/u17:0] 2023-11-05T08:43:33.820 INFO:teuthology.orchestra.run.smithi156.stdout:root 289 0.0 0.0 0 0 ? I< 07:49 0:00 \_ [kworker/6:1H-xfs-log/dm-0] 2023-11-05T08:43:33.820 INFO:teuthology.orchestra.run.smithi156.stdout:root 290 0.0 0.0 0 0 ? I< 07:49 0:00 \_ [kworker/3:1H-kblockd] 2023-11-05T08:43:33.820 INFO:teuthology.orchestra.run.smithi156.stdout:root 305 0.0 0.0 0 0 ? I< 07:49 0:00 \_ [kworker/4:1H-kblockd] 2023-11-05T08:43:33.820 INFO:teuthology.orchestra.run.smithi156.stdout:root 353 0.0 0.0 0 0 ? I< 07:49 0:00 \_ [kworker/2:1H-xfs-log/dm-4] 2023-11-05T08:43:33.820 INFO:teuthology.orchestra.run.smithi156.stdout:root 377 0.0 0.0 0 0 ? I< 07:49 0:00 \_ [kworker/0:1H-kblockd] 2023-11-05T08:43:33.821 INFO:teuthology.orchestra.run.smithi156.stdout:root 411 0.0 0.0 0 0 ? I< 07:49 0:00 \_ [kworker/7:1H-xfs-log/dm-1] 2023-11-05T08:43:33.821 INFO:teuthology.orchestra.run.smithi156.stdout:root 427 0.0 0.0 0 0 ? I< 07:49 0:00 \_ [nvme-wq] 2023-11-05T08:43:33.821 INFO:teuthology.orchestra.run.smithi156.stdout:root 428 0.0 0.0 0 0 ? I< 07:49 0:00 \_ [ata_sff] 2023-11-05T08:43:33.821 INFO:teuthology.orchestra.run.smithi156.stdout:root 431 0.0 0.0 0 0 ? I< 07:49 0:00 \_ [nvme-reset-wq] 2023-11-05T08:43:33.821 INFO:teuthology.orchestra.run.smithi156.stdout:root 432 0.0 0.0 0 0 ? I< 07:49 0:00 \_ [nvme-delete-wq] 2023-11-05T08:43:33.821 INFO:teuthology.orchestra.run.smithi156.stdout:root 434 0.0 0.0 0 0 ? I< 07:49 0:00 \_ [nvme-auth-wq] 2023-11-05T08:43:33.822 INFO:teuthology.orchestra.run.smithi156.stdout:root 438 0.0 0.0 0 0 ? I< 07:49 0:00 \_ [ixgbe] 2023-11-05T08:43:33.822 INFO:teuthology.orchestra.run.smithi156.stdout:root 447 0.0 0.0 0 0 ? S 07:49 0:00 \_ [scsi_eh_0] 2023-11-05T08:43:33.822 INFO:teuthology.orchestra.run.smithi156.stdout:root 448 0.0 0.0 0 0 ? I< 07:49 0:00 \_ [scsi_tmf_0] 2023-11-05T08:43:33.822 INFO:teuthology.orchestra.run.smithi156.stdout:root 449 0.0 0.0 0 0 ? S 07:49 0:00 \_ [scsi_eh_1] 2023-11-05T08:43:33.822 INFO:teuthology.orchestra.run.smithi156.stdout:root 450 0.0 0.0 0 0 ? I< 07:49 0:00 \_ [scsi_tmf_1] 2023-11-05T08:43:33.823 INFO:teuthology.orchestra.run.smithi156.stdout:root 451 0.0 0.0 0 0 ? S 07:49 0:00 \_ [scsi_eh_2] 2023-11-05T08:43:33.823 INFO:teuthology.orchestra.run.smithi156.stdout:root 452 0.0 0.0 0 0 ? I< 07:49 0:00 \_ [scsi_tmf_2] 2023-11-05T08:43:33.823 INFO:teuthology.orchestra.run.smithi156.stdout:root 453 0.0 0.0 0 0 ? S 07:49 0:00 \_ [scsi_eh_3] 2023-11-05T08:43:33.823 INFO:teuthology.orchestra.run.smithi156.stdout:root 454 0.0 0.0 0 0 ? I< 07:49 0:00 \_ [scsi_tmf_3] 2023-11-05T08:43:33.823 INFO:teuthology.orchestra.run.smithi156.stdout:root 455 0.0 0.0 0 0 ? S 07:49 0:00 \_ [scsi_eh_4] 2023-11-05T08:43:33.824 INFO:teuthology.orchestra.run.smithi156.stdout:root 456 0.0 0.0 0 0 ? I< 07:49 0:00 \_ [scsi_tmf_4] 2023-11-05T08:43:33.824 INFO:teuthology.orchestra.run.smithi156.stdout:root 457 0.0 0.0 0 0 ? S 07:49 0:00 \_ [scsi_eh_5] 2023-11-05T08:43:33.824 INFO:teuthology.orchestra.run.smithi156.stdout:root 458 0.0 0.0 0 0 ? I< 07:49 0:00 \_ [scsi_tmf_5] 2023-11-05T08:43:33.824 INFO:teuthology.orchestra.run.smithi156.stdout:root 459 0.0 0.0 0 0 ? S 07:49 0:00 \_ [scsi_eh_6] 2023-11-05T08:43:33.824 INFO:teuthology.orchestra.run.smithi156.stdout:root 460 0.0 0.0 0 0 ? I< 07:49 0:00 \_ [scsi_tmf_6] 2023-11-05T08:43:33.824 INFO:teuthology.orchestra.run.smithi156.stdout:root 461 0.0 0.0 0 0 ? S 07:49 0:00 \_ [scsi_eh_7] 2023-11-05T08:43:33.825 INFO:teuthology.orchestra.run.smithi156.stdout:root 462 0.0 0.0 0 0 ? I< 07:49 0:00 \_ [scsi_tmf_7] 2023-11-05T08:43:33.825 INFO:teuthology.orchestra.run.smithi156.stdout:root 463 0.0 0.0 0 0 ? S 07:49 0:00 \_ [scsi_eh_8] 2023-11-05T08:43:33.825 INFO:teuthology.orchestra.run.smithi156.stdout:root 464 0.0 0.0 0 0 ? I< 07:49 0:00 \_ [scsi_tmf_8] 2023-11-05T08:43:33.825 INFO:teuthology.orchestra.run.smithi156.stdout:root 465 0.0 0.0 0 0 ? S 07:49 0:00 \_ [scsi_eh_9] 2023-11-05T08:43:33.825 INFO:teuthology.orchestra.run.smithi156.stdout:root 466 0.0 0.0 0 0 ? I< 07:49 0:00 \_ [scsi_tmf_9] 2023-11-05T08:43:33.826 INFO:teuthology.orchestra.run.smithi156.stdout:root 489 0.0 0.0 0 0 ? S 07:49 0:00 \_ [jbd2/sda1-8] 2023-11-05T08:43:33.826 INFO:teuthology.orchestra.run.smithi156.stdout:root 490 0.0 0.0 0 0 ? I< 07:49 0:00 \_ [ext4-rsv-conver] 2023-11-05T08:43:33.826 INFO:teuthology.orchestra.run.smithi156.stdout:root 571 0.0 0.0 0 0 ? S 07:49 0:00 \_ [ext4lazyinit] 2023-11-05T08:43:33.826 INFO:teuthology.orchestra.run.smithi156.stdout:root 624 0.0 0.0 0 0 ? I< 07:49 0:00 \_ [ipmi-msghandler] 2023-11-05T08:43:33.826 INFO:teuthology.orchestra.run.smithi156.stdout:root 633 0.0 0.0 0 0 ? SN 07:49 0:00 \_ [kipmi0] 2023-11-05T08:43:33.826 INFO:teuthology.orchestra.run.smithi156.stdout:root 659 0.0 0.0 0 0 ? I< 07:49 0:00 \_ [rpciod] 2023-11-05T08:43:33.827 INFO:teuthology.orchestra.run.smithi156.stdout:root 660 0.0 0.0 0 0 ? I< 07:49 0:00 \_ [xprtiod] 2023-11-05T08:43:33.827 INFO:teuthology.orchestra.run.smithi156.stdout:root 6564 0.0 0.0 0 0 ? I 07:50 0:00 \_ [kworker/4:3-events] 2023-11-05T08:43:33.827 INFO:teuthology.orchestra.run.smithi156.stdout:root 60996 0.0 0.0 0 0 ? I< 07:53 0:00 \_ [tls-strp] 2023-11-05T08:43:33.827 INFO:teuthology.orchestra.run.smithi156.stdout:root 66730 0.0 0.0 0 0 ? I 07:54 0:00 \_ [kworker/0:14-events] 2023-11-05T08:43:33.827 INFO:teuthology.orchestra.run.smithi156.stdout:root 70295 0.0 0.0 0 0 ? I< 07:54 0:00 \_ [kdmflush/253:0] 2023-11-05T08:43:33.827 INFO:teuthology.orchestra.run.smithi156.stdout:root 70415 0.0 0.0 0 0 ? I< 07:54 0:00 \_ [kdmflush/253:1] 2023-11-05T08:43:33.828 INFO:teuthology.orchestra.run.smithi156.stdout:root 70535 0.0 0.0 0 0 ? I< 07:54 0:00 \_ [kdmflush/253:2] 2023-11-05T08:43:33.828 INFO:teuthology.orchestra.run.smithi156.stdout:root 70655 0.0 0.0 0 0 ? I< 07:54 0:00 \_ [kdmflush/253:3] 2023-11-05T08:43:33.828 INFO:teuthology.orchestra.run.smithi156.stdout:root 70775 0.0 0.0 0 0 ? I< 07:54 0:00 \_ [kdmflush/253:4] 2023-11-05T08:43:33.828 INFO:teuthology.orchestra.run.smithi156.stdout:root 71668 0.0 0.0 0 0 ? I< 07:54 0:00 \_ [xfsalloc] 2023-11-05T08:43:33.828 INFO:teuthology.orchestra.run.smithi156.stdout:root 71669 0.0 0.0 0 0 ? I< 07:54 0:00 \_ [xfs_mru_cache] 2023-11-05T08:43:33.829 INFO:teuthology.orchestra.run.smithi156.stdout:root 71670 0.0 0.0 0 0 ? I< 07:54 0:00 \_ [xfs-buf/dm-4] 2023-11-05T08:43:33.829 INFO:teuthology.orchestra.run.smithi156.stdout:root 71671 0.0 0.0 0 0 ? I< 07:54 0:00 \_ [xfs-conv/dm-4] 2023-11-05T08:43:33.829 INFO:teuthology.orchestra.run.smithi156.stdout:root 71672 0.0 0.0 0 0 ? I< 07:54 0:00 \_ [xfs-reclaim/dm-] 2023-11-05T08:43:33.829 INFO:teuthology.orchestra.run.smithi156.stdout:root 71673 0.0 0.0 0 0 ? I< 07:54 0:00 \_ [xfs-blockgc/dm-] 2023-11-05T08:43:33.829 INFO:teuthology.orchestra.run.smithi156.stdout:root 71674 0.0 0.0 0 0 ? I< 07:54 0:00 \_ [xfs-inodegc/dm-] 2023-11-05T08:43:33.830 INFO:teuthology.orchestra.run.smithi156.stdout:root 71675 0.0 0.0 0 0 ? I< 07:54 0:00 \_ [xfs-log/dm-4] 2023-11-05T08:43:33.830 INFO:teuthology.orchestra.run.smithi156.stdout:root 71676 0.0 0.0 0 0 ? I< 07:54 0:00 \_ [xfs-cil/dm-4] 2023-11-05T08:43:33.830 INFO:teuthology.orchestra.run.smithi156.stdout:root 71677 0.0 0.0 0 0 ? S 07:54 0:00 \_ [xfsaild/dm-4] 2023-11-05T08:43:33.830 INFO:teuthology.orchestra.run.smithi156.stdout:root 74927 0.0 0.0 0 0 ? I 07:55 0:00 \_ [kworker/4:2-cgroup_destroy] 2023-11-05T08:43:33.830 INFO:teuthology.orchestra.run.smithi156.stdout:root 76735 0.0 0.0 0 0 ? I 07:56 0:00 \_ [kworker/2:55-events] 2023-11-05T08:43:33.830 INFO:teuthology.orchestra.run.smithi156.stdout:root 76946 0.0 0.0 0 0 ? I 07:56 0:00 \_ [kworker/3:0-cgroup_destroy] 2023-11-05T08:43:33.831 INFO:teuthology.orchestra.run.smithi156.stdout:root 78350 0.0 0.0 0 0 ? I 07:57 0:00 \_ [kworker/7:2-dio/dm-3] 2023-11-05T08:43:33.831 INFO:teuthology.orchestra.run.smithi156.stdout:root 80398 0.0 0.0 0 0 ? I< 08:05 0:00 \_ [xfs-buf/dm-3] 2023-11-05T08:43:33.831 INFO:teuthology.orchestra.run.smithi156.stdout:root 80399 0.0 0.0 0 0 ? I< 08:05 0:00 \_ [xfs-conv/dm-3] 2023-11-05T08:43:33.831 INFO:teuthology.orchestra.run.smithi156.stdout:root 80400 0.0 0.0 0 0 ? I< 08:05 0:00 \_ [xfs-reclaim/dm-] 2023-11-05T08:43:33.831 INFO:teuthology.orchestra.run.smithi156.stdout:root 80401 0.0 0.0 0 0 ? I< 08:05 0:00 \_ [xfs-blockgc/dm-] 2023-11-05T08:43:33.832 INFO:teuthology.orchestra.run.smithi156.stdout:root 80402 0.0 0.0 0 0 ? I< 08:05 0:00 \_ [xfs-inodegc/dm-] 2023-11-05T08:43:33.832 INFO:teuthology.orchestra.run.smithi156.stdout:root 80403 0.0 0.0 0 0 ? I< 08:05 0:00 \_ [xfs-log/dm-3] 2023-11-05T08:43:33.832 INFO:teuthology.orchestra.run.smithi156.stdout:root 80404 0.0 0.0 0 0 ? I< 08:05 0:00 \_ [xfs-cil/dm-3] 2023-11-05T08:43:33.832 INFO:teuthology.orchestra.run.smithi156.stdout:root 80405 0.0 0.0 0 0 ? S 08:05 0:00 \_ [xfsaild/dm-3] 2023-11-05T08:43:33.832 INFO:teuthology.orchestra.run.smithi156.stdout:root 83973 0.0 0.0 0 0 ? I< 08:05 0:00 \_ [dio/dm-3] 2023-11-05T08:43:33.833 INFO:teuthology.orchestra.run.smithi156.stdout:root 84361 0.0 0.0 0 0 ? I 08:05 0:00 \_ [kworker/2:0-events] 2023-11-05T08:43:33.833 INFO:teuthology.orchestra.run.smithi156.stdout:root 89579 0.0 0.0 0 0 ? I 08:07 0:00 \_ [kworker/5:1-events_power_efficient] 2023-11-05T08:43:33.833 INFO:teuthology.orchestra.run.smithi156.stdout:root 89582 0.0 0.0 0 0 ? I 08:10 0:00 \_ [kworker/7:0-events] 2023-11-05T08:43:33.833 INFO:teuthology.orchestra.run.smithi156.stdout:root 89588 0.0 0.0 0 0 ? I 08:20 0:00 \_ [kworker/0:2-events] 2023-11-05T08:43:33.833 INFO:teuthology.orchestra.run.smithi156.stdout:root 89590 0.0 0.0 0 0 ? I 08:20 0:00 \_ [kworker/u16:2-writeback] 2023-11-05T08:43:33.833 INFO:teuthology.orchestra.run.smithi156.stdout:root 89596 0.0 0.0 0 0 ? I 08:30 0:00 \_ [kworker/1:1-events] 2023-11-05T08:43:33.834 INFO:teuthology.orchestra.run.smithi156.stdout:root 89598 0.0 0.0 0 0 ? I 08:30 0:00 \_ [kworker/1:3] 2023-11-05T08:43:33.834 INFO:teuthology.orchestra.run.smithi156.stdout:root 89600 0.0 0.0 0 0 ? I 08:33 0:00 \_ [kworker/6:2-mm_percpu_wq] 2023-11-05T08:43:33.834 INFO:teuthology.orchestra.run.smithi156.stdout:root 89601 0.0 0.0 0 0 ? I 08:33 0:00 \_ [kworker/5:2-events_power_efficient] 2023-11-05T08:43:33.834 INFO:teuthology.orchestra.run.smithi156.stdout:root 89602 0.0 0.0 0 0 ? I 08:36 0:00 \_ [kworker/u16:0-flush-8:0] 2023-11-05T08:43:33.834 INFO:teuthology.orchestra.run.smithi156.stdout:root 89603 0.0 0.0 0 0 ? I 08:39 0:00 \_ [kworker/6:0-events] 2023-11-05T08:43:33.835 INFO:teuthology.orchestra.run.smithi156.stdout:root 89604 0.0 0.0 0 0 ? I 08:40 0:00 \_ [kworker/5:0-events_freezable] 2023-11-05T08:43:33.835 INFO:teuthology.orchestra.run.smithi156.stdout:root 89606 0.0 0.0 0 0 ? I 08:40 0:00 \_ [kworker/1:0-events] 2023-11-05T08:43:33.835 INFO:teuthology.orchestra.run.smithi156.stdout:root 89624 0.0 0.0 0 0 ? I 08:43 0:00 \_ [kworker/u16:1-flush-8:0] 2023-11-05T08:43:33.835 INFO:teuthology.orchestra.run.smithi156.stdout:root 1 0.1 0.0 175980 20200 ? Ss 07:49 0:03 /usr/lib/systemd/systemd --switched-root --system --deserialize 31 2023-11-05T08:43:33.835 INFO:teuthology.orchestra.run.smithi156.stdout:root 565 0.0 0.0 26668 15544 ? Ss 07:49 0:00 /usr/lib/systemd/systemd-journald 2023-11-05T08:43:33.836 INFO:teuthology.orchestra.run.smithi156.stdout:root 581 0.0 0.0 37556 15716 ? Ss 07:49 0:00 /usr/lib/systemd/systemd-udevd 2023-11-05T08:43:33.836 INFO:teuthology.orchestra.run.smithi156.stdout:rpc 651 0.0 0.0 13244 5692 ? Ss 07:49 0:00 /usr/bin/rpcbind -w -f 2023-11-05T08:43:33.836 INFO:teuthology.orchestra.run.smithi156.stdout:root 663 0.0 0.0 91824 4504 ? S sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-05T08:43:33.843 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~16s 2023-11-05T08:43:33.844 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2023-11-05T08:43:33.846 DEBUG:teuthology.orchestra.run.smithi156:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-05T08:43:33.895 INFO:teuthology.orchestra.run.smithi156.stdout:/var/log/ceph/valgrind/mon.b.log: Leak_StillReachable 2023-11-05T08:43:33.897 INFO:teuthology.orchestra.run.smithi052.stdout:/var/log/ceph/valgrind/mon.a.log: Leak_StillReachable 2023-11-05T08:43:33.898 INFO:teuthology.orchestra.run.smithi052.stdout:/var/log/ceph/valgrind/mon.c.log: Leak_StillReachable 2023-11-05T08:43:33.898 DEBUG:tasks.ceph:file /var/log/ceph/valgrind/mon.a.log kind Leak_StillReachable 2023-11-05T08:43:33.899 ERROR:tasks.ceph:saw valgrind issue Leak_StillReachable in /var/log/ceph/valgrind/mon.a.log 2023-11-05T08:43:33.899 DEBUG:tasks.ceph:file /var/log/ceph/valgrind/mon.c.log kind Leak_StillReachable 2023-11-05T08:43:33.900 ERROR:tasks.ceph:saw valgrind issue Leak_StillReachable in /var/log/ceph/valgrind/mon.c.log 2023-11-05T08:43:33.900 DEBUG:tasks.ceph:file /var/log/ceph/valgrind/mon.b.log kind Leak_StillReachable 2023-11-05T08:43:33.901 ERROR:tasks.ceph:saw valgrind issue Leak_StillReachable in /var/log/ceph/valgrind/mon.b.log 2023-11-05T08:43:33.901 INFO:tasks.ceph:Archiving crash dumps... 2023-11-05T08:43:33.903 DEBUG:teuthology.misc:Transferring archived files from smithi052:/var/lib/ceph/crash to /home/teuthworker/archive/benhanokh-2023-10-31_16:46:33-rados-DBG_maintain_prefix_itr_2-distro-default-smithi/7442385/remote/smithi052/crash 2023-11-05T08:43:33.904 DEBUG:teuthology.orchestra.run.smithi052:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-05T08:43:34.059 DEBUG:teuthology.misc:Transferring archived files from smithi156:/var/lib/ceph/crash to /home/teuthworker/archive/benhanokh-2023-10-31_16:46:33-rados-DBG_maintain_prefix_itr_2-distro-default-smithi/7442385/remote/smithi156/crash 2023-11-05T08:43:34.061 DEBUG:teuthology.orchestra.run.smithi156:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-05T08:43:34.107 INFO:tasks.ceph:Compressing logs... 2023-11-05T08:43:34.108 DEBUG:teuthology.orchestra.run.smithi052:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-11-05T08:43:34.111 DEBUG:teuthology.orchestra.run.smithi156:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-11-05T08:43:34.142 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-11-05T08:43:34.142 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86069.log 2023-11-05T08:43:34.142 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.7.log 2023-11-05T08:43:34.148 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.86069.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.5.log 2023-11-05T08:43:34.148 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/valgrind/osd.7.log: 55.1% -- replaced with /var/log/ceph/valgrind/osd.7.log.gz 2023-11-05T08:43:34.149 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/osd.6.log 2023-11-05T08:43:34.149 INFO:teuthology.orchestra.run.smithi156.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.86069.log.gz 2023-11-05T08:43:34.149 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mon.b.log 2023-11-05T08:43:34.149 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/valgrind/osd.5.log: /var/log/ceph/valgrind/osd.6.log: 63.9% -- replaced with /var/log/ceph/valgrind/osd.5.log.gz 2023-11-05T08:43:34.149 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/osd.4.log 2023-11-05T08:43:34.150 INFO:teuthology.orchestra.run.smithi156.stderr: 63.9% -- replaced with /var/log/ceph/valgrind/osd.6.log.gz 2023-11-05T08:43:34.150 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/valgrind/mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85818.log 2023-11-05T08:43:34.150 INFO:teuthology.orchestra.run.smithi156.stderr: 74.7% -- replaced with /var/log/ceph/valgrind/mon.b.log.gz 2023-11-05T08:43:34.150 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/valgrind/osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85858.log 2023-11-05T08:43:34.150 INFO:teuthology.orchestra.run.smithi156.stderr: 64.0% -- replaced with /var/log/ceph/valgrind/osd.4.log.gz 2023-11-05T08:43:34.151 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.85818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86029.log 2023-11-05T08:43:34.151 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.85858.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-11-05T08:43:34.151 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.86029.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.85818.log.gz 2023-11-05T08:43:34.151 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85938.log 2023-11-05T08:43:34.151 INFO:teuthology.orchestra.run.smithi156.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.85858.log.gz 2023-11-05T08:43:34.152 INFO:teuthology.orchestra.run.smithi156.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.86029.log.gz 2023-11-05T08:43:34.152 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-11-05T08:43:34.152 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-client.admin.85938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85898.log 2023-11-05T08:43:34.152 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-11-05T08:43:34.152 INFO:teuthology.orchestra.run.smithi156.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.85938.log.gz 2023-11-05T08:43:34.153 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.85898.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-11-05T08:43:34.153 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85982.log 2023-11-05T08:43:34.153 INFO:teuthology.orchestra.run.smithi156.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.85898.log.gz 2023-11-05T08:43:34.153 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85778.log 2023-11-05T08:43:34.153 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-osd.5.log: /var/log/ceph/ceph-client.admin.85982.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-11-05T08:43:34.154 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-client.admin.85778.log: gzip 87.8% -- replaced with /var/log/ceph/ceph-client.admin.85982.log.gz 2023-11-05T08:43:34.154 INFO:teuthology.orchestra.run.smithi156.stderr: -5 --verbose -- /var/log/ceph/ceph.log 2023-11-05T08:43:34.154 INFO:teuthology.orchestra.run.smithi156.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.85778.log.gzgzip 2023-11-05T08:43:34.154 INFO:teuthology.orchestra.run.smithi156.stderr: -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-11-05T08:43:34.155 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph-mon.b.log: 92.5% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-11-05T08:43:34.162 INFO:teuthology.orchestra.run.smithi156.stderr: 87.9% -- replaced with /var/log/ceph/ceph.log.gz 2023-11-05T08:43:34.180 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90561.log 2023-11-05T08:43:34.180 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92350.log 2023-11-05T08:43:34.180 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5/var/log/ceph/ceph-client.admin.90561.log: --verbose -- /var/log/ceph/ceph-mon.a.log 2023-11-05T08:43:34.180 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.92350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91677.log 2023-11-05T08:43:34.181 INFO:teuthology.orchestra.run.smithi052.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.90561.log.gz 2023-11-05T08:43:34.181 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117429.log 2023-11-05T08:43:34.181 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124689.log 2023-11-05T08:43:34.181 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.91677.log: /var/log/ceph/ceph-client.admin.117429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91708.log 2023-11-05T08:43:34.181 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.124689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158210.log 2023-11-05T08:43:34.182 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.91708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90572.log 2023-11-05T08:43:34.182 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.158210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91687.log 2023-11-05T08:43:34.182 INFO:teuthology.orchestra.run.smithi052.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.158210.log.gz 91.8% 2023-11-05T08:43:34.182 INFO:teuthology.orchestra.run.smithi052.stderr: -- replaced with /var/log/ceph/ceph-client.admin.91677.log.gz/var/log/ceph/ceph-client.admin.90572.log: 2023-11-05T08:43:34.182 INFO:teuthology.orchestra.run.smithi052.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.117429.log.gz 2023-11-05T08:43:34.183 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158504.log 2023-11-05T08:43:34.183 INFO:teuthology.orchestra.run.smithi052.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.90572.log.gz 2023-11-05T08:43:34.183 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.91687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91614.log 2023-11-05T08:43:34.183 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.158504.log: 91.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134789.log 2023-11-05T08:43:34.183 INFO:teuthology.orchestra.run.smithi052.stderr: -- replaced with /var/log/ceph/ceph-client.admin.92350.log.gz 2023-11-05T08:43:34.184 INFO:teuthology.orchestra.run.smithi052.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.124689.log.gz 2023-11-05T08:43:34.184 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.91614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88084.log 2023-11-05T08:43:34.184 INFO:teuthology.orchestra.run.smithi052.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.158504.log.gz 2023-11-05T08:43:34.184 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91953.log 2023-11-05T08:43:34.184 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.134789.log: /var/log/ceph/ceph-client.admin.88084.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mon.c.log 2023-11-05T08:43:34.185 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.91953.log: gzip 88.3% -- replaced with /var/log/ceph/ceph-client.admin.88084.log.gz 2023-11-05T08:43:34.185 INFO:teuthology.orchestra.run.smithi052.stderr: -5 --verbose -- /var/log/ceph/valgrind/osd.2.log 2023-11-05T08:43:34.185 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/osd.0.log 2023-11-05T08:43:34.185 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/valgrind/osd.2.log: /var/log/ceph/valgrind/mon.c.log: 64.1% 74.7% -- replaced with /var/log/ceph/valgrind/mon.c.log.gz 2023-11-05T08:43:34.185 INFO:teuthology.orchestra.run.smithi052.stderr: -- replaced with /var/log/ceph/valgrind/osd.2.log.gz 2023-11-05T08:43:34.186 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/osd.1.log 2023-11-05T08:43:34.186 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/valgrind/osd.0.log: gzip 64.0% -- replaced with /var/log/ceph/valgrind/osd.0.log.gz 2023-11-05T08:43:34.186 INFO:teuthology.orchestra.run.smithi052.stderr: -5 --verbose 90.6% -- replaced with /var/log/ceph/ceph-client.admin.134789.log.gz 2023-11-05T08:43:34.186 INFO:teuthology.orchestra.run.smithi052.stderr: -- /var/log/ceph/valgrind/mon.a.log 2023-11-05T08:43:34.186 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose --/var/log/ceph/valgrind/osd.1.log: /var/log/ceph/valgrind/osd.3.log 91.5% -- replaced with /var/log/ceph/ceph-client.admin.91687.log.gz 2023-11-05T08:43:34.187 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:43:34.187 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/valgrind/mon.a.log: 64.0% -- replaced with /var/log/ceph/valgrind/osd.1.log.gz 2023-11-05T08:43:34.187 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90967.log 2023-11-05T08:43:34.187 INFO:teuthology.orchestra.run.smithi052.stderr: 74.6% -- replaced with /var/log/ceph/valgrind/mon.a.log.gz 2023-11-05T08:43:34.187 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/valgrind/osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91017.log 2023-11-05T08:43:34.187 INFO:teuthology.orchestra.run.smithi052.stderr: 64.0% -- replaced with /var/log/ceph/valgrind/osd.3.log.gz 2023-11-05T08:43:34.188 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.90967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158252.log 2023-11-05T08:43:34.188 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.91017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107717.log 2023-11-05T08:43:34.188 INFO:teuthology.orchestra.run.smithi052.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.90967.log.gz 2023-11-05T08:43:34.188 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.158252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115346.log 2023-11-05T08:43:34.188 INFO:teuthology.orchestra.run.smithi052.stderr: 87.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90563.log 2023-11-05T08:43:34.189 INFO:teuthology.orchestra.run.smithi052.stderr: -- replaced with /var/log/ceph/ceph-client.admin.91017.log.gz 2023-11-05T08:43:34.189 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.107717.log: 87.1%/var/log/ceph/ceph-client.admin.115346.log: -- replaced with /var/log/ceph/ceph-client.admin.158252.log.gz 2023-11-05T08:43:34.189 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91937.log 2023-11-05T08:43:34.189 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.90563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91640.log 2023-11-05T08:43:34.189 INFO:teuthology.orchestra.run.smithi052.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.115346.log.gz 2023-11-05T08:43:34.190 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.91937.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.91953.log.gz 2023-11-05T08:43:34.190 INFO:teuthology.orchestra.run.smithi052.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.90563.log.gz 2023-11-05T08:43:34.190 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89991.log 2023-11-05T08:43:34.190 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.91640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158042.log 2023-11-05T08:43:34.190 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.89991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91173.log 2023-11-05T08:43:34.191 INFO:teuthology.orchestra.run.smithi052.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.107717.log.gz 2023-11-05T08:43:34.191 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.158042.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.89991.log.gz 2023-11-05T08:43:34.191 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90214.log 2023-11-05T08:43:34.191 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.91173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91732.log 2023-11-05T08:43:34.191 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.90214.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.158042.log.gz 2023-11-05T08:43:34.192 INFO:teuthology.orchestra.run.smithi052.stderr:gzip 87.2% -- replaced with /var/log/ceph/ceph-client.admin.91173.log.gz -5 2023-11-05T08:43:34.192 INFO:teuthology.orchestra.run.smithi052.stderr: --verbose -- /var/log/ceph/ceph-client.admin.157916.log 2023-11-05T08:43:34.192 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90435.log 2023-11-05T08:43:34.192 INFO:teuthology.orchestra.run.smithi052.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.90214.log.gz 2023-11-05T08:43:34.192 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.91732.log: /var/log/ceph/ceph-client.admin.157916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92400.log 2023-11-05T08:43:34.193 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.90435.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.157916.log.gz 2023-11-05T08:43:34.193 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92133.log 2023-11-05T08:43:34.193 INFO:teuthology.orchestra.run.smithi052.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.90435.log.gz 2023-11-05T08:43:34.193 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.92400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90937.log 2023-11-05T08:43:34.193 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.92133.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.92400.log.gz 2023-11-05T08:43:34.194 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91133.log 2023-11-05T08:43:34.194 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.90937.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.90937.log.gz 2023-11-05T08:43:34.194 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157958.log 2023-11-05T08:43:34.194 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.91133.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.91133.log.gz 2023-11-05T08:43:34.194 INFO:teuthology.orchestra.run.smithi052.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.91640.log.gz 2023-11-05T08:43:34.195 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124690.log 2023-11-05T08:43:34.195 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.157958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90033.log 2023-11-05T08:43:34.195 INFO:teuthology.orchestra.run.smithi052.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.91937.log.gz 2023-11-05T08:43:34.195 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.124690.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.157958.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90577.log 2023-11-05T08:43:34.195 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:43:34.196 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.90033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91919.log 2023-11-05T08:43:34.196 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.90577.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.90033.log.gz 2023-11-05T08:43:34.196 INFO:teuthology.orchestra.run.smithi052.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.90577.log.gz 2023-11-05T08:43:34.196 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89793.log 2023-11-05T08:43:34.196 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.91919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91894.log 2023-11-05T08:43:34.196 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.89793.log: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.92133.log.gz 2023-11-05T08:43:34.197 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-11-05T08:43:34.197 INFO:teuthology.orchestra.run.smithi052.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.89793.log.gz 2023-11-05T08:43:34.197 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.91894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158126.log 2023-11-05T08:43:34.197 INFO:teuthology.orchestra.run.smithi052.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.124690.log.gz 2023-11-05T08:43:34.197 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112194.log 2023-11-05T08:43:34.198 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.158126.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.158126.log.gz 2023-11-05T08:43:34.198 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90907.log 2023-11-05T08:43:34.198 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.112194.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.112194.log.gz 2023-11-05T08:43:34.198 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134788.log 2023-11-05T08:43:34.198 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.90907.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.90907.log.gz 2023-11-05T08:43:34.199 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90560.log 2023-11-05T08:43:34.199 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.134788.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.91919.log.gz 2023-11-05T08:43:34.199 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124686.log 2023-11-05T08:43:34.207 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.90560.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.90560.log.gz 2023-11-05T08:43:34.207 INFO:teuthology.orchestra.run.smithi052.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.134788.log.gz 2023-11-05T08:43:34.207 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92307.log 2023-11-05T08:43:34.207 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.124686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90432.log 2023-11-05T08:43:34.208 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.92307.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.92307.log.gz 2023-11-05T08:43:34.208 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92399.log 2023-11-05T08:43:34.208 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.90432.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.90432.log.gz 2023-11-05T08:43:34.208 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158336.log 2023-11-05T08:43:34.208 INFO:teuthology.orchestra.run.smithi052.stderr: 90.5%/var/log/ceph/ceph-client.admin.92399.log: -- replaced with /var/log/ceph/ceph-client.admin.124686.log.gz 2023-11-05T08:43:34.209 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157580.log 2023-11-05T08:43:34.209 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.158336.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.158336.log.gz 2023-11-05T08:43:34.209 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92244.log 2023-11-05T08:43:34.209 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.157580.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.157580.log.gz 2023-11-05T08:43:34.209 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158294.log 2023-11-05T08:43:34.209 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.92244.log: 95.5% 91.3% -- replaced with /var/log/ceph/ceph-client.admin.92399.log.gz 2023-11-05T08:43:34.210 INFO:teuthology.orchestra.run.smithi052.stderr: -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-11-05T08:43:34.210 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86240.log 2023-11-05T08:43:34.210 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92214.log 2023-11-05T08:43:34.210 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.158294.log: /var/log/ceph/ceph-client.admin.86240.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.158294.log.gz 2023-11-05T08:43:34.211 INFO:teuthology.orchestra.run.smithi052.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.86240.log.gz 2023-11-05T08:43:34.211 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157622.log 2023-11-05T08:43:34.211 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157790.log 2023-11-05T08:43:34.211 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.92214.log: /var/log/ceph/ceph-client.admin.157622.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.157622.log.gz 2023-11-05T08:43:34.211 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91624.log 2023-11-05T08:43:34.211 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.157790.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.157790.log.gz 2023-11-05T08:43:34.212 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-11-05T08:43:34.212 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.91624.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.92214.log.gz 2023-11-05T08:43:34.212 INFO:teuthology.orchestra.run.smithi052.stderr: 92.8% -- replaced with /var/log/ceph/ceph-client.admin.92244.log.gz 2023-11-05T08:43:34.212 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92016.log 2023-11-05T08:43:34.212 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85934.log 2023-11-05T08:43:34.213 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-osd.1.log: /var/log/ceph/ceph-client.admin.92016.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.92016.log.gz 2023-11-05T08:43:34.213 INFO:teuthology.orchestra.run.smithi052.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.91624.log.gz 2023-11-05T08:43:34.214 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157538.log 2023-11-05T08:43:34.214 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158168.log 2023-11-05T08:43:34.214 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.85934.log: /var/log/ceph/ceph-client.admin.157538.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.157538.log.gz 2023-11-05T08:43:34.215 INFO:teuthology.orchestra.run.smithi052.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.85934.log.gz 2023-11-05T08:43:34.223 INFO:teuthology.orchestra.run.smithi052.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.91614.log.gz 2023-11-05T08:43:34.224 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86263.log 2023-11-05T08:43:34.224 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.158168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91301.log 2023-11-05T08:43:34.224 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.86263.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.158168.log.gz 2023-11-05T08:43:34.224 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91080.log 2023-11-05T08:43:34.224 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.91301.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.86263.log.gz 2023-11-05T08:43:34.227 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124687.log 2023-11-05T08:43:34.227 INFO:teuthology.orchestra.run.smithi052.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.91301.log.gz/var/log/ceph/ceph-client.admin.91080.log: 2023-11-05T08:43:34.227 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92096.log 2023-11-05T08:43:34.227 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.124687.log: gzip 87.4% -- replaced with /var/log/ceph/ceph-client.admin.91080.log.gz -5 2023-11-05T08:43:34.228 INFO:teuthology.orchestra.run.smithi052.stderr: --verbose -- /var/log/ceph/ceph-client.admin.91700.log 2023-11-05T08:43:34.228 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90209.log 2023-11-05T08:43:34.228 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.92096.log: /var/log/ceph/ceph-client.admin.91700.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.124687.log.gz 2023-11-05T08:43:34.233 INFO:teuthology.orchestra.run.smithi052.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.92096.log.gz 2023-11-05T08:43:34.235 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92311.log 2023-11-05T08:43:34.235 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.90209.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.80083.log 2023-11-05T08:43:34.235 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.92311.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.90209.log.gz 2023-11-05T08:43:34.236 INFO:teuthology.orchestra.run.smithi052.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.92311.log.gz 2023-11-05T08:43:34.237 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89849.log 2023-11-05T08:43:34.237 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92060.log 2023-11-05T08:43:34.238 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph.tmp-client.admin.80083.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.80083.log.gz 2023-11-05T08:43:34.239 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.89849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91588.log 2023-11-05T08:43:34.239 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.92060.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.89849.log.gz 2023-11-05T08:43:34.245 INFO:teuthology.orchestra.run.smithi052.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.92060.log.gz 2023-11-05T08:43:34.246 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90877.log 2023-11-05T08:43:34.247 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157832.log 2023-11-05T08:43:34.247 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.91588.log: /var/log/ceph/ceph-client.admin.90877.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.90877.log.gz 2023-11-05T08:43:34.256 INFO:teuthology.orchestra.run.smithi052.stderr: 94.3% -- replaced with /var/log/ceph/ceph-client.admin.91732.log.gz 2023-11-05T08:43:34.261 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-11-05T08:43:34.261 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157748.log 2023-11-05T08:43:34.262 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.157832.log: /var/log/ceph/ceph-osd.3.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.157832.log.gz 2023-11-05T08:43:34.268 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90206.log 2023-11-05T08:43:34.269 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.157748.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.157748.log.gz 2023-11-05T08:43:34.270 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115347.log 2023-11-05T08:43:34.271 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.90206.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.90206.log.gz 2023-11-05T08:43:34.272 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92379.log 2023-11-05T08:43:34.275 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.115347.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.115347.log.gz 2023-11-05T08:43:34.276 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107716.log 2023-11-05T08:43:34.276 INFO:teuthology.orchestra.run.smithi052.stderr: 92.8% -- replaced with /var/log/ceph/ceph-client.admin.91700.log.gz 2023-11-05T08:43:34.276 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.92379.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90456.log 2023-11-05T08:43:34.279 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.107716.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.107716.log.gz 2023-11-05T08:43:34.279 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158463.log 2023-11-05T08:43:34.280 INFO:teuthology.orchestra.run.smithi052.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.92379.log.gz/var/log/ceph/ceph-client.admin.90456.log: 2023-11-05T08:43:34.283 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86369.log 2023-11-05T08:43:34.283 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.158463.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.90456.log.gz 2023-11-05T08:43:34.283 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90198.log 2023-11-05T08:43:34.284 INFO:teuthology.orchestra.run.smithi052.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.91588.log.gz 2023-11-05T08:43:34.284 INFO:teuthology.orchestra.run.smithi052.stderr: 87.7%/var/log/ceph/ceph-client.admin.86369.log: -- replaced with /var/log/ceph/ceph-client.admin.158463.log.gz 2023-11-05T08:43:34.284 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90211.log 2023-11-05T08:43:34.284 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.90198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91779.log 2023-11-05T08:43:34.284 INFO:teuthology.orchestra.run.smithi052.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.86369.log.gz 2023-11-05T08:43:34.285 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.90211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89404.log 2023-11-05T08:43:34.285 INFO:teuthology.orchestra.run.smithi052.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.90198.log.gz 2023-11-05T08:43:34.285 INFO:teuthology.orchestra.run.smithi052.stderr: 87.6%/var/log/ceph/ceph-client.admin.91779.log: -- replaced with /var/log/ceph/ceph-client.admin.90211.log.gz 2023-11-05T08:43:34.285 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158000.log 2023-11-05T08:43:34.287 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.89404.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.89404.log.gz 2023-11-05T08:43:34.287 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90199.log 2023-11-05T08:43:34.287 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.158000.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-11-05T08:43:34.288 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.90199.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.158000.log.gz 2023-11-05T08:43:34.288 INFO:teuthology.orchestra.run.smithi052.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.90199.log.gz 2023-11-05T08:43:34.288 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134787.log 2023-11-05T08:43:34.289 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-mgr.y.log: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.91779.log.gz 2023-11-05T08:43:34.289 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87159.log 2023-11-05T08:43:34.289 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92143.log 2023-11-05T08:43:34.290 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.134787.log: /var/log/ceph/ceph-client.admin.87159.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.87159.log.gz 2023-11-05T08:43:34.291 INFO:teuthology.orchestra.run.smithi052.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.134787.log.gz 2023-11-05T08:43:34.292 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112193.log 2023-11-05T08:43:34.293 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90212.log 2023-11-05T08:43:34.295 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.92143.log: /var/log/ceph/ceph-client.admin.112193.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.112193.log.gz 2023-11-05T08:43:34.301 INFO:teuthology.orchestra.run.smithi052.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.92143.log.gz 2023-11-05T08:43:34.302 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158378.log 2023-11-05T08:43:34.302 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89901.log 2023-11-05T08:43:34.303 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.90212.log: /var/log/ceph/ceph-client.admin.158378.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.90212.log.gz 2023-11-05T08:43:34.303 INFO:teuthology.orchestra.run.smithi052.stderr: 89.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92351.log 2023-11-05T08:43:34.304 INFO:teuthology.orchestra.run.smithi052.stderr: -- replaced with /var/log/ceph/ceph-client.admin.158378.log.gz 2023-11-05T08:43:34.305 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.89901.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.89901.log.gz 2023-11-05T08:43:34.305 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89947.log 2023-11-05T08:43:34.305 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115343.log 2023-11-05T08:43:34.306 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.92351.log: /var/log/ceph/ceph-client.admin.89947.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.89947.log.gz 2023-11-05T08:43:34.307 INFO:teuthology.orchestra.run.smithi052.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.admin.92351.log.gz 2023-11-05T08:43:34.308 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-11-05T08:43:34.308 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90817.log 2023-11-05T08:43:34.311 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.115343.log: /var/log/ceph/ceph-osd.0.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.115343.log.gz 2023-11-05T08:43:34.311 INFO:teuthology.orchestra.run.smithi052.stderr: 94.8% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-11-05T08:43:34.312 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91959.log 2023-11-05T08:43:34.312 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158420.log 2023-11-05T08:43:34.314 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.90817.log: /var/log/ceph/ceph-client.admin.91959.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.90817.log.gz 2023-11-05T08:43:34.314 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157664.log 2023-11-05T08:43:34.314 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.158420.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.158420.log.gz 2023-11-05T08:43:34.316 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92112.log 2023-11-05T08:43:34.316 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.157664.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.157664.log.gz 2023-11-05T08:43:34.316 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-11-05T08:43:34.317 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.92112.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.91959.log.gz 2023-11-05T08:43:34.318 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117428.log 2023-11-05T08:43:34.325 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.92112.log.gz 2023-11-05T08:43:34.326 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92380.log 2023-11-05T08:43:34.329 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.117428.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.117428.log.gz 2023-11-05T08:43:34.329 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-11-05T08:43:34.331 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.92380.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.92380.log.gz 2023-11-05T08:43:34.331 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124688.log 2023-11-05T08:43:34.331 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-osd.2.log: 93.3% -- replaced with /var/log/ceph/ceph.log.gz 2023-11-05T08:43:34.332 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157706.log 2023-11-05T08:43:34.335 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.124688.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.124688.log.gz 2023-11-05T08:43:34.336 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117430.log 2023-11-05T08:43:34.336 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.157706.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.157706.log.gz 2023-11-05T08:43:34.337 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90748.log 2023-11-05T08:43:34.340 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.117430.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.117430.log.gz 2023-11-05T08:43:34.340 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91217.log 2023-11-05T08:43:34.341 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.90748.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.90748.log.gz 2023-11-05T08:43:34.342 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90216.log 2023-11-05T08:43:34.342 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.91217.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.91217.log.gz 2023-11-05T08:43:34.343 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157874.log 2023-11-05T08:43:34.343 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.90216.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.90216.log.gz 2023-11-05T08:43:34.344 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107718.log 2023-11-05T08:43:34.345 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.157874.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.157874.log.gz 2023-11-05T08:43:34.346 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89754.log 2023-11-05T08:43:34.348 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.107718.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.107718.log.gz 2023-11-05T08:43:34.349 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92258.log 2023-11-05T08:43:34.350 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.89754.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.89754.log.gz 2023-11-05T08:43:34.350 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91259.log 2023-11-05T08:43:34.363 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.92258.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-11-05T08:43:34.364 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.91259.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.91259.log.gz 2023-11-05T08:43:34.377 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90797.log 2023-11-05T08:43:34.390 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158084.log 2023-11-05T08:43:34.391 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.90797.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.90797.log.gz 2023-11-05T08:43:34.414 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.158084.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.158084.log.gz 2023-11-05T08:43:34.443 INFO:teuthology.orchestra.run.smithi052.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.92258.log.gz 2023-11-05T08:43:34.669 INFO:teuthology.orchestra.run.smithi156.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-11-05T08:43:34.692 INFO:teuthology.orchestra.run.smithi052.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.91894.log.gz 2023-11-05T08:43:35.402 INFO:teuthology.orchestra.run.smithi156.stderr: 91.0% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-11-05T08:43:35.529 INFO:teuthology.orchestra.run.smithi052.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.91708.log.gz 2023-11-05T08:43:36.018 INFO:teuthology.orchestra.run.smithi052.stderr: 91.0% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-11-05T08:43:36.823 INFO:teuthology.orchestra.run.smithi052.stderr: 90.3% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-11-05T08:43:37.824 INFO:teuthology.orchestra.run.smithi156.stderr: 93.2% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-11-05T08:43:37.931 INFO:teuthology.orchestra.run.smithi156.stderr: 93.2% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-11-05T08:43:38.048 INFO:teuthology.orchestra.run.smithi052.stderr: 93.1% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-11-05T08:43:38.493 INFO:teuthology.orchestra.run.smithi156.stderr:gzip: /var/log/ceph/ceph-osd.7.log: file size changed while zipping 2023-11-05T08:43:38.494 INFO:teuthology.orchestra.run.smithi156.stderr: 93.2% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-11-05T08:43:38.674 INFO:teuthology.orchestra.run.smithi156.stderr: 93.2% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-11-05T08:43:38.676 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-11-05T08:43:38.677 INFO:teuthology.orchestra.run.smithi156.stderr:real 0m4.548s 2023-11-05T08:43:38.677 INFO:teuthology.orchestra.run.smithi156.stderr:user 0m17.452s 2023-11-05T08:43:38.677 INFO:teuthology.orchestra.run.smithi156.stderr:sys 0m0.569s 2023-11-05T08:43:38.707 INFO:teuthology.orchestra.run.smithi052.stderr: 93.2% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-11-05T08:43:38.747 INFO:teuthology.orchestra.run.smithi052.stderr: 93.1% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-11-05T08:43:38.945 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~23s 2023-11-05T08:43:39.112 INFO:teuthology.orchestra.run.smithi052.stderr: 93.2% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-11-05T08:43:39.114 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-11-05T08:43:39.114 INFO:teuthology.orchestra.run.smithi052.stderr:real 0m4.987s 2023-11-05T08:43:39.114 INFO:teuthology.orchestra.run.smithi052.stderr:user 0m23.558s 2023-11-05T08:43:39.114 INFO:teuthology.orchestra.run.smithi052.stderr:sys 0m0.812s 2023-11-05T08:43:39.115 INFO:tasks.ceph:Archiving logs... 2023-11-05T08:43:39.115 DEBUG:teuthology.misc:Transferring archived files from smithi052:/var/log/ceph to /home/teuthworker/archive/benhanokh-2023-10-31_16:46:33-rados-DBG_maintain_prefix_itr_2-distro-default-smithi/7442385/remote/smithi052/log 2023-11-05T08:43:39.117 DEBUG:teuthology.orchestra.run.smithi052:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-05T08:43:42.475 DEBUG:teuthology.misc:Transferring archived files from smithi156:/var/log/ceph to /home/teuthworker/archive/benhanokh-2023-10-31_16:46:33-rados-DBG_maintain_prefix_itr_2-distro-default-smithi/7442385/remote/smithi156/log 2023-11-05T08:43:42.476 DEBUG:teuthology.orchestra.run.smithi156:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-05T08:43:44.054 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~29s 2023-11-05T08:43:45.018 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_420cd129397301b1521ceb74e1bdbd9b855d2189/qa/tasks/ceph.py", line 1134, in cluster yield File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_420cd129397301b1521ceb74e1bdbd9b855d2189/qa/tasks/ceph.py", line 1471, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_420cd129397301b1521ceb74e1bdbd9b855d2189/qa/tasks/ceph.py", line 328, in valgrind_post yield File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_ceph_ceph-c_420cd129397301b1521ceb74e1bdbd9b855d2189/qa/tasks/ceph.py", line 1203, in cluster raise e File "/home/teuthworker/src/github.com_ceph_ceph-c_420cd129397301b1521ceb74e1bdbd9b855d2189/qa/tasks/ceph.py", line 1185, in cluster remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi156 with status 32: 'sync && sudo umount -f /var/lib/ceph/osd/ceph-7' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_420cd129397301b1521ceb74e1bdbd9b855d2189/qa/tasks/ceph.py", line 1957, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_ceph_ceph-c_420cd129397301b1521ceb74e1bdbd9b855d2189/qa/tasks/ceph.py", line 251, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_ceph_ceph-c_420cd129397301b1521ceb74e1bdbd9b855d2189/qa/tasks/ceph.py", line 368, in valgrind_post raise valgrind_exception Exception: saw valgrind issues 2023-11-05T08:43:45.019 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-11-05T08:43:45.030 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_420cd129397301b1521ceb74e1bdbd9b855d2189/qa/tasks/ceph.py", line 1134, in cluster yield File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_420cd129397301b1521ceb74e1bdbd9b855d2189/qa/tasks/ceph.py", line 1471, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_420cd129397301b1521ceb74e1bdbd9b855d2189/qa/tasks/ceph.py", line 328, in valgrind_post yield File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_ceph_ceph-c_420cd129397301b1521ceb74e1bdbd9b855d2189/qa/tasks/ceph.py", line 1203, in cluster raise e File "/home/teuthworker/src/github.com_ceph_ceph-c_420cd129397301b1521ceb74e1bdbd9b855d2189/qa/tasks/ceph.py", line 1185, in cluster remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi156 with status 32: 'sync && sudo umount -f /var/lib/ceph/osd/ceph-7' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_420cd129397301b1521ceb74e1bdbd9b855d2189/qa/tasks/ceph.py", line 1957, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_ceph_ceph-c_420cd129397301b1521ceb74e1bdbd9b855d2189/qa/tasks/ceph.py", line 251, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_ceph_ceph-c_420cd129397301b1521ceb74e1bdbd9b855d2189/qa/tasks/ceph.py", line 368, in valgrind_post raise valgrind_exception Exception: saw valgrind issues 2023-11-05T08:43:45.031 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-11-05T08:43:45.031 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-05T08:43:45.035 DEBUG:teuthology.orchestra.run.smithi156:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-05T08:43:45.131 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-11-05T08:43:45.140 INFO:teuthology.task.clock:Checking final clock skew... 2023-11-05T08:43:45.140 DEBUG:teuthology.orchestra.run.smithi052:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-05T08:43:45.143 DEBUG:teuthology.orchestra.run.smithi156:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-05T08:43:45.158 INFO:teuthology.orchestra.run.smithi052.stderr:bash: line 1: ntpq: command not found 2023-11-05T08:43:45.160 INFO:teuthology.orchestra.run.smithi156.stderr:bash: line 1: ntpq: command not found 2023-11-05T08:43:45.163 INFO:teuthology.orchestra.run.smithi052.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-05T08:43:45.164 INFO:teuthology.orchestra.run.smithi052.stdout:=============================================================================== 2023-11-05T08:43:45.164 INFO:teuthology.orchestra.run.smithi052.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 52 +1263us[+1263us] +/- 80ms 2023-11-05T08:43:45.164 INFO:teuthology.orchestra.run.smithi052.stdout:^* hv02.front.sepia.ceph.com 3 6 377 57 -651us[ -640us] +/- 64ms 2023-11-05T08:43:45.164 INFO:teuthology.orchestra.run.smithi052.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 57 -436us[ -425us] +/- 76ms 2023-11-05T08:43:45.164 INFO:teuthology.orchestra.run.smithi052.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-11-05T08:43:45.165 INFO:teuthology.orchestra.run.smithi156.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-05T08:43:45.166 INFO:teuthology.orchestra.run.smithi156.stdout:=============================================================================== 2023-11-05T08:43:45.166 INFO:teuthology.orchestra.run.smithi156.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 58 +1275us[+1327us] +/- 80ms 2023-11-05T08:43:45.166 INFO:teuthology.orchestra.run.smithi156.stdout:^* hv02.front.sepia.ceph.com 3 6 377 55 -646us[ -594us] +/- 64ms 2023-11-05T08:43:45.166 INFO:teuthology.orchestra.run.smithi156.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 56 -435us[ -383us] +/- 76ms 2023-11-05T08:43:45.167 INFO:teuthology.orchestra.run.smithi156.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-11-05T08:43:45.167 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-11-05T08:43:45.175 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-11-05T08:43:45.176 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-11-05T08:43:45.184 DEBUG:teuthology.orchestra.run.smithi052:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-11-05T08:43:45.311 DEBUG:teuthology.orchestra.run.smithi156:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-11-05T08:43:45.411 DEBUG:teuthology.orchestra.run.smithi052:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-05T08:43:45.448 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-05T08:43:45.449 DEBUG:teuthology.orchestra.run.smithi156:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-05T08:43:45.481 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-05T08:43:45.482 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-11-05T08:43:45.492 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-11-05T08:43:45.500 INFO:teuthology.task.internal:Duration was 3241.002133 seconds 2023-11-05T08:43:45.501 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-11-05T08:43:45.509 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-11-05T08:43:45.510 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-05T08:43:45.513 DEBUG:teuthology.orchestra.run.smithi156:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-05T08:43:45.562 INFO:teuthology.orchestra.run.smithi052.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-05T08:43:45.567 INFO:teuthology.orchestra.run.smithi156.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-05T08:43:45.853 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-11-05T08:43:45.854 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi052.front.sepia.ceph.com 2023-11-05T08:43:45.855 DEBUG:teuthology.orchestra.run.smithi052:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-05T08:43:45.875 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi156.front.sepia.ceph.com 2023-11-05T08:43:45.875 DEBUG:teuthology.orchestra.run.smithi156:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-05T08:43:45.898 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-11-05T08:43:45.899 DEBUG:teuthology.orchestra.run.smithi052:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-05T08:43:45.917 DEBUG:teuthology.orchestra.run.smithi156:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-05T08:43:45.970 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-11-05T08:43:45.970 DEBUG:teuthology.orchestra.run.smithi052:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-05T08:43:45.989 DEBUG:teuthology.orchestra.run.smithi156:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-05T08:43:46.107 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-11-05T08:43:46.117 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-11-05T08:43:46.118 DEBUG:teuthology.orchestra.run.smithi052:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-05T08:43:46.150 DEBUG:teuthology.orchestra.run.smithi156:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-05T08:43:46.177 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-11-05T08:43:46.187 DEBUG:teuthology.orchestra.run.smithi052:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-05T08:43:46.192 DEBUG:teuthology.orchestra.run.smithi156:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-05T08:43:46.219 INFO:teuthology.orchestra.run.smithi052.stdout:kernel.core_pattern = core 2023-11-05T08:43:46.242 INFO:teuthology.orchestra.run.smithi156.stdout:kernel.core_pattern = core 2023-11-05T08:43:46.265 DEBUG:teuthology.orchestra.run.smithi052:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-05T08:43:46.292 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-05T08:43:46.292 DEBUG:teuthology.orchestra.run.smithi156:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-05T08:43:46.319 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-05T08:43:46.320 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-11-05T08:43:46.329 INFO:teuthology.task.internal:Transferring archived files... 2023-11-05T08:43:46.330 DEBUG:teuthology.misc:Transferring archived files from smithi052:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/benhanokh-2023-10-31_16:46:33-rados-DBG_maintain_prefix_itr_2-distro-default-smithi/7442385/remote/smithi052 2023-11-05T08:43:46.331 DEBUG:teuthology.orchestra.run.smithi052:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-05T08:43:46.374 DEBUG:teuthology.misc:Transferring archived files from smithi156:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/benhanokh-2023-10-31_16:46:33-rados-DBG_maintain_prefix_itr_2-distro-default-smithi/7442385/remote/smithi156 2023-11-05T08:43:46.375 DEBUG:teuthology.orchestra.run.smithi156:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-05T08:43:46.410 INFO:teuthology.task.internal:Removing archive directory... 2023-11-05T08:43:46.411 DEBUG:teuthology.orchestra.run.smithi052:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-05T08:43:46.413 DEBUG:teuthology.orchestra.run.smithi156:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-05T08:43:46.459 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-11-05T08:43:46.469 INFO:teuthology.task.internal:Not uploading archives. 2023-11-05T08:43:46.470 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-11-05T08:43:46.483 INFO:teuthology.task.internal:Tidying up after the test... 2023-11-05T08:43:46.484 DEBUG:teuthology.orchestra.run.smithi052:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-05T08:43:46.486 DEBUG:teuthology.orchestra.run.smithi156:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-05T08:43:46.499 INFO:teuthology.orchestra.run.smithi052.stdout: 265243 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Nov 5 08:43 /home/ubuntu/cephtest 2023-11-05T08:43:46.499 INFO:teuthology.orchestra.run.smithi052.stdout: 786493 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 5 08:05 /home/ubuntu/cephtest/ceph.data 2023-11-05T08:43:46.500 INFO:teuthology.orchestra.run.smithi052.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2023-11-05T08:43:46.501 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-05T08:43:46.501 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_420cd129397301b1521ceb74e1bdbd9b855d2189/qa/tasks/ceph.py", line 1134, in cluster yield File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_420cd129397301b1521ceb74e1bdbd9b855d2189/qa/tasks/ceph.py", line 1471, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_420cd129397301b1521ceb74e1bdbd9b855d2189/qa/tasks/ceph.py", line 328, in valgrind_post yield File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_ceph_ceph-c_420cd129397301b1521ceb74e1bdbd9b855d2189/qa/tasks/ceph.py", line 1203, in cluster raise e File "/home/teuthworker/src/github.com_ceph_ceph-c_420cd129397301b1521ceb74e1bdbd9b855d2189/qa/tasks/ceph.py", line 1185, in cluster remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi156 with status 32: 'sync && sudo umount -f /var/lib/ceph/osd/ceph-7' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_420cd129397301b1521ceb74e1bdbd9b855d2189/qa/tasks/ceph.py", line 1957, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_ceph_ceph-c_420cd129397301b1521ceb74e1bdbd9b855d2189/qa/tasks/ceph.py", line 251, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_ceph_ceph-c_420cd129397301b1521ceb74e1bdbd9b855d2189/qa/tasks/ceph.py", line 368, in valgrind_post raise valgrind_exception Exception: saw valgrind issues During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi052 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2023-11-05T08:43:46.502 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-11-05T08:43:46.512 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-11-05T08:43:46.522 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: Exception: saw valgrind issues 2023-11-05T08:43:46.523 INFO:teuthology.nuke:Checking targets against current locks 2023-11-05T08:43:46.526 INFO:teuthology.orchestra.run.smithi156.stdout: 265785 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Nov 5 08:43 /home/ubuntu/cephtest 2023-11-05T08:43:46.527 INFO:teuthology.orchestra.run.smithi156.stdout: 524599 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 5 08:05 /home/ubuntu/cephtest/ceph.data 2023-11-05T08:43:46.528 INFO:teuthology.orchestra.run.smithi156.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2023-11-05T08:43:46.552 DEBUG:teuthology.nuke:shortname: smithi052 2023-11-05T08:43:46.552 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-05T08:43:46.580 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi052.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/benhanokh-2023-10-31_16:46:33-rados-DBG_maintain_prefix_itr_2-distro-default-smithi/7442385', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-05 07:41:34.821814', 'locked_by': 'scheduled_benhanokh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEnDpDiifinTJpL2PjgfOfqPw0mIrozR3cpuVohSdrZusZbneajbBvaY0GmuKnMds6oReCVH86Po0gxqygx6Zs4='} 2023-11-05T08:43:46.582 DEBUG:teuthology.nuke:shortname: smithi156 2023-11-05T08:43:46.582 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-05T08:43:46.610 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi156.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/benhanokh-2023-10-31_16:46:33-rados-DBG_maintain_prefix_itr_2-distro-default-smithi/7442385', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-05 07:41:34.820359', 'locked_by': 'scheduled_benhanokh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBjlaTh+P400Hnio2yqVR2ZsDZeYdz/ykjr62agH2TJg9XA0N+iYqmUCBbjM03GAMAR+MiFjR/S3l40LvJzmwTI='} 2023-11-05T08:43:46.636 INFO:teuthology.orchestra.console.smithi052:Power off 2023-11-05T08:43:46.637 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-05T08:43:46.659 DEBUG:teuthology.orchestra.console.smithi052:power off output: Chassis Power Control: Down/Off 2023-11-05T08:43:46.659 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-05T08:43:46.677 INFO:teuthology.orchestra.console.smithi156:Power off 2023-11-05T08:43:46.678 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-05T08:43:46.687 DEBUG:teuthology.orchestra.console.smithi052:check power output: Chassis Power is on 2023-11-05T08:43:46.700 DEBUG:teuthology.orchestra.console.smithi156:power off output: Chassis Power Control: Down/Off 2023-11-05T08:43:46.700 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-05T08:43:46.723 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is on 2023-11-05T08:43:49.157 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~34s 2023-11-05T08:43:50.688 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-05T08:43:50.724 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-05T08:43:50.799 DEBUG:teuthology.orchestra.console.smithi052:check power output: Chassis Power is on 2023-11-05T08:43:50.835 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is on 2023-11-05T08:43:54.158 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~39s 2023-11-05T08:43:54.159 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2023-11-05T08:43:54.801 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-05T08:43:54.837 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-05T08:43:54.912 DEBUG:teuthology.orchestra.console.smithi052:check power output: Chassis Power is off 2023-11-05T08:43:54.947 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off 2023-11-05T08:43:55.014 INFO:teuthology.orchestra.console.smithi052:Power off completed 2023-11-05T08:43:55.049 INFO:teuthology.orchestra.console.smithi156:Power off completed 2023-11-05T08:43:55.155 INFO:teuthology.run:Summary data: description: rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/valgrind} duration: 3241.00213265419 failure_reason: saw valgrind issues flavor: default owner: scheduled_benhanokh@teuthology status: fail success: false 2023-11-05T08:43:55.155 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T08:43:55.230 INFO:teuthology.run:FAIL